Topic Modeling Techniques for Text Mining Over a Large-Scale Scientific and Biomedical Text Corpus

Autor: Sandhya Avasthi, Ritu Chauhan, Debi Prasanna Acharjya
Rok vydání: 2022
Předmět:
Zdroj: International Journal of Ambient Computing and Intelligence. 13:1-18
ISSN: 1941-6245
1941-6237
DOI: 10.4018/ijaci.293137
Popis: Topic models are efficient in extracting central themes from large-scale document collection and it is an active research area. The state-of-the-art techniques like Latent Dirichlet Allocation, Correlated Topic Model (CTM), Hierarchical Dirichlet Process (HDP), Dirichlet Multinomial Regression (DMR) and Hierarchical Pachinko Allocation (HPA) model is considered for comparison. . The abstracts of articles were collected between different periods from PUBMED library by keywords adolescence substance use and depression. A lot of research has happened in this area and thousands of articles are available on PubMed in this area. This collection is huge and so extracting information is very time-consuming. To fit the topic models this extracted text data is used and fitted models were evaluated using both likelihood and non-likelihood measures. The topic models are compared using the evaluation parameters like log-likelihood and perplexity. To evaluate the quality of topics topic coherence measures has been used.
Databáze: OpenAIRE