A CLUSTERING TECHNIQUE FOR THE VIETNAMESE WORD CATEGORIZATION

Autor: Nguyễn Minh Hiệp, Nguyễn Thị Minh Huyền, Ngô Thế Quyền, Trần Thị Phương Linh
Jazyk: English<br />Vietnamese
Rok vydání: 2016
Předmět:
Zdroj: Tạp chí Khoa học Đại học Đà Lạt, Vol 6, Iss 2 (2016)
Druh dokumentu: article
ISSN: 0866-787X
DOI: 10.37569/DalatUniversity.6.2.40(2016)
Popis: In natural language processing, part-of-speech (POS) tagging plays an important role, as its output is the input of many other tasks (syntax analysis, semantic analysis. . . ). One of the problems related to POS tagging is to define the POS set. This could be solved using unsupervised machine learning methods. This paper presents an application of the DBSCAN clustering algorithm to classify Vietnamese words from a large corpus. The features used to characterize each word are naturally defined by the context of that word in a sentence. We use a large corpus containing sentences automatically extracted from the online Nhan Dan newspaper.
Databáze: Directory of Open Access Journals