Distributed location aware web crawling

Odysseas Papapetrou, George Samaras

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

4 Citations (Scopus)

Abstract

Distributed crawling has shown that it can overcome important limitations of the today's crawling paradigm. However, the optimal benefits of this approach are usually limited to the sites hosting the crawler. In this work, we propose a location-Aware method, called IPMicra, that utilizes an IP address hierarchy, and allows crawling of links in a near optimal location aware manner.

Original languageEnglish
Title of host publicationProceedings of the 13th International World Wide Web Conference on Alternate Track, Papers and Posters, WWW Alt. 2004
PublisherAssociation for Computing Machinery, Inc
Pages468-469
Number of pages2
ISBN (Electronic)1581139128, 9781581139129
DOIs
Publication statusPublished - 19 May 2004
Externally publishedYes
Event13th International World Wide Web Conference on Alternate Track, Papers and Posters, WWW Alt. 2004 - New York, United States
Duration: 19 May 200421 May 2004

Conference

Conference13th International World Wide Web Conference on Alternate Track, Papers and Posters, WWW Alt. 2004
CountryUnited States
CityNew York
Period19/05/0421/05/04

Keywords

  • Distributed web crawling
  • Location aware web crawling

Cite this