UCYMICRA: distributed indexing of the web using migrating crawlers

Odysseas Papapetrou; Stavros Papastavrou; George Samaras

doi:10.1007/978-3-540-39403-7_12

UCYMICRA: distributed indexing of the web using migrating crawlers

Odysseas Papapetrou, Stavros Papastavrou, George Samaras

Research output: Chapter in Book/Report/Conference proceeding › Chapter › Academic › peer-review

1 Citation (Scopus)

Abstract

Due to the tremendous increase rate and the high change frequency of Web documents, maintaining an up-to-date index for searching purposes (search engines) is becoming a challenge. The traditional crawling methods are no longer able to catch up with the constantly updating and growing Web. Realizing the problem, in this paper we suggest an alternative distributed crawling method with the use of mobile agents. Our goal is a scalable crawling scheme that minimizes network utilization, keeps up with document changes, employs time realization, and is easily upgradeable.

Original language	English
Title of host publication	Advances in Databases and Information Systems
Subtitle of host publication	7th East European Conference, ADBIS 2003, Dresden, Germany, September 3-6, 2003. Proceedings
Place of Publication	Berlin
Publisher	Springer
Chapter	12
Pages	133-147
Number of pages	15
ISBN (Electronic)	978-3-540-39403-7
DOIs	https://doi.org/10.1007/978-3-540-39403-7_12
Publication status	Published - 1 Dec 2003
Externally published	Yes

Publication series

Name	Lecture Notes in Computer Science (LNCS)
Publisher	Springer
Volume	2798
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Access to Document

10.1007/978-3-540-39403-7_12

Cite this

Papapetrou, O., Papastavrou, S., & Samaras, G. (2003). UCYMICRA: distributed indexing of the web using migrating crawlers. In Advances in Databases and Information Systems: 7th East European Conference, ADBIS 2003, Dresden, Germany, September 3-6, 2003. Proceedings (pp. 133-147). (Lecture Notes in Computer Science (LNCS); Vol. 2798). Springer. https://doi.org/10.1007/978-3-540-39403-7_12

@inbook{f1162f67ab444d90af98b178d5d1b0d2,

title = "UCYMICRA: distributed indexing of the web using migrating crawlers",

abstract = "Due to the tremendous increase rate and the high change frequency of Web documents, maintaining an up-to-date index for searching purposes (search engines) is becoming a challenge. The traditional crawling methods are no longer able to catch up with the constantly updating and growing Web. Realizing the problem, in this paper we suggest an alternative distributed crawling method with the use of mobile agents. Our goal is a scalable crawling scheme that minimizes network utilization, keeps up with document changes, employs time realization, and is easily upgradeable.",

author = "Odysseas Papapetrou and Stavros Papastavrou and George Samaras",

year = "2003",

month = dec,

day = "1",

doi = "10.1007/978-3-540-39403-7_12",

language = "English",

series = "Lecture Notes in Computer Science (LNCS)",

publisher = "Springer",

pages = "133--147",

booktitle = "Advances in Databases and Information Systems",

address = "Germany",

}

Papapetrou, O, Papastavrou, S & Samaras, G 2003, UCYMICRA: distributed indexing of the web using migrating crawlers. in Advances in Databases and Information Systems: 7th East European Conference, ADBIS 2003, Dresden, Germany, September 3-6, 2003. Proceedings. Lecture Notes in Computer Science (LNCS), vol. 2798, Springer, Berlin, pp. 133-147. https://doi.org/10.1007/978-3-540-39403-7_12

UCYMICRA: distributed indexing of the web using migrating crawlers. / Papapetrou, Odysseas; Papastavrou, Stavros; Samaras, George.
Advances in Databases and Information Systems: 7th East European Conference, ADBIS 2003, Dresden, Germany, September 3-6, 2003. Proceedings. Berlin: Springer, 2003. p. 133-147 (Lecture Notes in Computer Science (LNCS); Vol. 2798).

Research output: Chapter in Book/Report/Conference proceeding › Chapter › Academic › peer-review

TY - CHAP

T1 - UCYMICRA

T2 - distributed indexing of the web using migrating crawlers

AU - Papapetrou, Odysseas

AU - Papastavrou, Stavros

AU - Samaras, George

PY - 2003/12/1

Y1 - 2003/12/1

N2 - Due to the tremendous increase rate and the high change frequency of Web documents, maintaining an up-to-date index for searching purposes (search engines) is becoming a challenge. The traditional crawling methods are no longer able to catch up with the constantly updating and growing Web. Realizing the problem, in this paper we suggest an alternative distributed crawling method with the use of mobile agents. Our goal is a scalable crawling scheme that minimizes network utilization, keeps up with document changes, employs time realization, and is easily upgradeable.

AB - Due to the tremendous increase rate and the high change frequency of Web documents, maintaining an up-to-date index for searching purposes (search engines) is becoming a challenge. The traditional crawling methods are no longer able to catch up with the constantly updating and growing Web. Realizing the problem, in this paper we suggest an alternative distributed crawling method with the use of mobile agents. Our goal is a scalable crawling scheme that minimizes network utilization, keeps up with document changes, employs time realization, and is easily upgradeable.

UR - http://www.scopus.com/inward/record.url?scp=35248847817&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-39403-7_12

DO - 10.1007/978-3-540-39403-7_12

M3 - Chapter

AN - SCOPUS:35248847817

T3 - Lecture Notes in Computer Science (LNCS)

SP - 133

EP - 147

BT - Advances in Databases and Information Systems

PB - Springer

CY - Berlin

ER -

UCYMICRA: distributed indexing of the web using migrating crawlers

Abstract

Publication series

Access to Document

Other files and links

Fingerprint

Cite this