Uso de robots.txt y sitemaps en la administración pública española

Autor: Martín-Galán, Bonifacio, Hernández-Pérez, Tony, Rodríguez-Mateos, David, Peña-Gil, Daniel
Jazyk: Spanish; Castilian
Rok vydání: 2009
Předmět:
Zdroj: Martín-Galán, Bonifacio and Hernández-Pérez, Tony and Rodríguez-Mateos, David and Peña-Gil, Daniel Uso de robots.txt y sitemaps en la administración pública española. El profesional de la información, 2009, vol. 18, n. 6, pp. 625-630. [Journal article (Paginated)]
Druh dokumentu: Journal article (Paginated)
Popis: The use of robots.txt and sitemaps in the Spanish public administration. Robots.txt and sitemaps files are the main methods to regulate search engine crawler access to its content. This article explain the importance of such files and analyze robots.txt and sitemaps from more than 4,000 web sites belonging to Spanish public administration to determine the use of these files as a medium of optimization for crawlers.
Databáze: E-LIS (Eprints in Library & Information Science)