Short-Text Topic Modeling via Non-negative Matrix Factorization Enriched with Local Word-Context Correlations
| Autor: | Chandan K. Reddy, Jaegul Choo, Kyeongpil Kang, Tian Shi |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
Topic model
Word embedding Computer science business.industry Semantic analysis (machine learning) Context (language use) 02 engineering and technology computer.software_genre Matrix decomposition Non-negative matrix factorization 020204 information systems 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Artificial intelligence business Coordinate descent computer Natural language processing Interpretability |
| Zdroj: | WWW |
| DOI: | 10.1145/3178876.3186009 |
| Popis: | Being a prevalent form of social communications on the Internet, billions of short texts are generated everyday. Discovering knowledge from them has gained a lot of interest from both industry and academia. The short texts have a limited contextual information, and they are sparse, noisy and ambiguous, and hence, automatically learning topics from them remains an important challenge. To tackle this problem, in this paper, we propose a semantics-assisted non-negative matrix factorization (SeaNMF) model to discover topics for the short texts. It effectively incorporates the word-context semantic correlations into the model, where the semantic relationships between the words and their contexts are learned from the skip-gram view of the corpus. The SeaNMF model is solved using a block coordinate descent algorithm. We also develop a sparse variant of the SeaNMF model which can achieve a better model interpretability. Extensive quantitative evaluations on various real-world short text datasets demonstrate the superior performance of the proposed models over several other state-of-the-art methods in terms of topic coherence and classification accuracy. The qualitative semantic analysis demonstrates the interpretability of our models by discovering meaningful and consistent topics. With a simple formulation and the superior performance, SeaNMF can be an effective standard topic model for short texts. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|