TFW2V: An Enhanced Document Similarity Method for the Morphologically Rich Finnish Language

Autor:	Duong, Quan, Hämäläinen, Mika, Alnajjar, Khalid
Rok vydání:	2021
Předmět:	Computer Science - Computation and Language
Druh dokumentu:	Working Paper
Popis:	Measuring the semantic similarity of different texts has many important applications in Digital Humanities research such as information retrieval, document clustering and text summarization. The performance of different methods depends on the length of the text, the domain and the language. This study focuses on experimenting with some of the current approaches to Finnish, which is a morphologically rich language. At the same time, we propose a simple method, TFW2V, which shows high efficiency in handling both long text documents and limited amounts of data. Furthermore, we design an objective evaluation method which can be used as a framework for benchmarking text similarity approaches. Comment: Workshop on Natural Language Processing for Digital Humanities (NLP4DH)
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2112.12489 Zobrazit plný text záznamu View this record from Arxiv