Extraction of User-Defined Data Blocks Using the Regularity of Dynamic Web Pages

Autor:	Cheolhee Choi, Joongmin Choi, Jinbeom Kang
Rok vydání:	2007
Předmět:	Structure (mathematical logic) Sequence Information retrieval Computer science Path (graph theory) Supervised learning Web page Website Parse Template Dynamic web page Data mining Precision and recall computer.software_genre computer
Zdroj:	Lecture Notes in Computer Science ISBN: 9783540741701 ICIC (1)
DOI:	10.1007/978-3-540-74171-8_13
Popis:	This paper proposes an enhanced method of Web information extraction by exploiting general phenomena that Web pages in a site tend to have common structures and dynamic Web pages contain multiple data blocks with repeating structural patterns. By considering this kind of regularity in dynamic Web pages, we develop a data block extraction system which basically adopts a supervised learning mechanism with training and extraction phases. In the training phase, the user selects and specifies a data block and the extraction rules for the block are generated. During this phase, the block is defined with the HTML DOM-tree path to the block and the tag sequence of the block. In the extraction phase, the rules are applied to the target pages to extract those blocks that have similar structure as the user-defined block. A series of experiments are performed to evaluate the user-defined data block extraction method for a number of well-known Web sites with dynamic Web pages, and the result of evaluation is satisfactory with high precision and recall measures.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::3b0db950cce3ef2951c7f46444827737 https://doi.org/10.1007/978-3-540-74171-8_13 Zobrazit plný text záznamu