UCYMICRA: distributed indexing of the web using migrating crawlers

Odysseas Papapetrou, Stavros Papastavrou, George Samaras

Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

1 Citation (Scopus)


Due to the tremendous increase rate and the high change frequency of Web documents, maintaining an up-to-date index for searching purposes (search engines) is becoming a challenge. The traditional crawling methods are no longer able to catch up with the constantly updating and growing Web. Realizing the problem, in this paper we suggest an alternative distributed crawling method with the use of mobile agents. Our goal is a scalable crawling scheme that minimizes network utilization, keeps up with document changes, employs time realization, and is easily upgradeable.

Original languageEnglish
Title of host publicationAdvances in Databases and Information Systems
Subtitle of host publication7th East European Conference, ADBIS 2003, Dresden, Germany, September 3-6, 2003. Proceedings
Place of PublicationBerlin
Number of pages15
ISBN (Electronic)978-3-540-39403-7
Publication statusPublished - 1 Dec 2003
Externally publishedYes

Publication series

NameLecture Notes in Computer Science (LNCS)
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Dive into the research topics of 'UCYMICRA: distributed indexing of the web using migrating crawlers'. Together they form a unique fingerprint.

Cite this