A Feature Selection and Classification Technique for Text Categorization

Autor:	A.E.-M.A. Aly, Moheb R. Girgis
Rok vydání:	2003
Předmět:	Information retrieval Text categorization Categorization Computer science Document classification Feature selection Boosting methods for object categorization computer.software_genre computer Computer Science Applications Information Systems
Zdroj:	International Journal of Cooperative Information Systems. 12:441-454
ISSN:	1793-6365 0218-8430
DOI:	10.1142/s0218843003000826
Popis:	Text categorization is the automated assigning of documents to predefined categories based on their contents. It involves two main tasks — feature selection and document classification. This paper discusses the weak points of the text categorization technique developed by Maron and modified by Lewis. Then, it introduces a technique for text categorization that uses new formulas for feature selection and document classification. These formulas have been formulated to overcome the weak points of Maron's and Lewis' techniques. Also, the paper describes the design of an experimental text categorization system that is composed of the same set of processes as the MAXCAT system developed by Lewis. The paper presents and analyses the results of applying the system on a set of training and test documents by using Lewis' and the proposed formulas. In addition, a method for separately evaluating the effectiveness of feature selection is given. Finally, the impact of the feature set size on the effectiveness of the classification system is investigated, using the system and applying one of the proposed classification formulas with different feature set sizes.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::23519fadeaade9a5113fc540fbabb54b https://doi.org/10.1142/s0218843003000826 Zobrazit plný text záznamu