Automatic construction of generic stop words list for hausa text

Autor:	Bichi, Abdulkadir Abubakar, Samsudin, Ruhaidah, Hassan, Rohayanti
Rok vydání:	2022
Předmět:	Stop words Control and Optimization Text mining Document pre-processing Computer Networks and Communications Hardware and Architecture Natural language processing Signal Processing Electrical and Electronic Engineering Hausa stop words Information Systems
Zdroj:	Indonesian Journal of Electrical Engineering and Computer Science. 25:1501
ISSN:	2502-4760 2502-4752
DOI:	10.11591/ijeecs.v25.i3.pp1501-1507
Popis:	Stop-words are words having the highest frequencies in a document without any significant information. They are characterized by having common relations within a cluster. They are the noise of the text that are evenly distributed over a document. Removal of stop words improve the performance and accuracy of information retrieval algorithms and machine learning at large. It saves the storage space by reducing the vector space dimension, and helps in effective documents indexing. This research generated a list of Hausa stop words automatically using aggregated method by combining frequency and statistics methods. The experiments are conducted using a primarily collected Hausa corpus consisting of 841 Hausa news articles of size 646862 words and finally a list of distinct 81 Hausa stop words is generated.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_dedup___::b060455921c010f20882857c4bab0439 https://doi.org/10.11591/ijeecs.v25.i3.pp1501-1507 Zobrazit plný text záznamu