UCYMICRA: Distributed indexing of the web using migrating crawlers

Autor:	Papapetrou, Odysseas, Papastavrou, Stavros, Samaras, George S.
Přispěvatelé:	Papapetrou, Odysseas [0000-0003-0045-1648]
Rok vydání:	2003
Předmět:	World Wide Web Net work utilization Distributed crawling Change frequencies Distributed indexing Web document Search engines Mobile agents
Zdroj:	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Lect. Notes Comput. Sci.
Popis:	Due to the tremendous increase rate and the high change frequency of Web documents, maintaining an up-to-date index for searching purposes (search engines) is becoming a challenge. The traditional crawling methods are no longer able to catch up with the constantly updating and growing Web. Realizing the problem, in this paper we suggest an alternative distributed crawling method with the use of mobile agents. Our goal is a scalable crawling scheme that minimizes network utilization, keeps up with document changes, employs time realization, and is easily upgradeable. © Springer-Verlag Berlin Heidelberg 2003. 2798 133 147 Cited By :1
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=od______4485::17cf13ba106c4205be3ed5bd07254388 http://gnosis.library.ucy.ac.cy/handle/7/54758 Zobrazit plný text záznamu