Topic Modeling Techniques for Text Mining Over a Large-Scale Scientific and Biomedical Text Corpus
Autor: | Sandhya Avasthi, Ritu Chauhan, Debi Prasanna Acharjya |
---|---|
Rok vydání: | 2022 |
Předmět: | |
Zdroj: | International Journal of Ambient Computing and Intelligence. 13:1-18 |
ISSN: | 1941-6245 1941-6237 |
DOI: | 10.4018/ijaci.293137 |
Popis: | Topic models are efficient in extracting central themes from large-scale document collection and it is an active research area. The state-of-the-art techniques like Latent Dirichlet Allocation, Correlated Topic Model (CTM), Hierarchical Dirichlet Process (HDP), Dirichlet Multinomial Regression (DMR) and Hierarchical Pachinko Allocation (HPA) model is considered for comparison. . The abstracts of articles were collected between different periods from PUBMED library by keywords adolescence substance use and depression. A lot of research has happened in this area and thousands of articles are available on PubMed in this area. This collection is huge and so extracting information is very time-consuming. To fit the topic models this extracted text data is used and fitted models were evaluated using both likelihood and non-likelihood measures. The topic models are compared using the evaluation parameters like log-likelihood and perplexity. To evaluate the quality of topics topic coherence measures has been used. |
Databáze: | OpenAIRE |
Externí odkaz: |