Samenvatting
Distributed Web crawlers are extensively used for Web mining nowadays, but their accuracy, dependability and other operational measures have not been fully studied. Distributed Web crawlers are costly and require careful selection of configuration parameters. It is important to have some estimation about the performance, dependability and accuracy of a Web crawler. This paper presents a model-based evaluation of the accuracy and availability of a distributed Web crawler whose architecture is based on UbiCrawler. Stochastic activity networks are used for modelling the crawler. Accuracy and availability of the Web crawler are formally defined, and the effects of environmental failure rates on crawling nodes and on the availability of the whole system are discussed.
Originele taal-2 | Engels |
---|---|
Titel | Proceedings - EMS 2008, European Modelling Symposium, 2nd UKSim European Symposium on Computer Modelling and Simulation |
Uitgeverij | Institute of Electrical and Electronics Engineers |
Pagina's | 453-458 |
Aantal pagina's | 6 |
ISBN van geprinte versie | 9780769533254 |
DOI's | |
Status | Gepubliceerd - 2008 |
Extern gepubliceerd | Ja |
Evenement | EMS 2008, European Modelling Symposium, 2nd UKSim European Symposium on Computer Modelling and Simulation - Liverpool, Verenigd Koninkrijk Duur: 8 sep. 2008 → 10 sep. 2008 |
Congres
Congres | EMS 2008, European Modelling Symposium, 2nd UKSim European Symposium on Computer Modelling and Simulation |
---|---|
Land/Regio | Verenigd Koninkrijk |
Stad | Liverpool |
Periode | 8/09/08 → 10/09/08 |