Attention-Based Overall Enhance Network for Chinese Semantic Textual Similarity Measure
Autor: | Hao Zhang, HuaXiong Zhang, XingYu Lu, Qiang Gao |
---|---|
Jazyk: | angličtina |
Rok vydání: | 2021 |
Předmět: | |
Zdroj: | Journal of Applied Science and Engineering, Vol 25, Iss 2, Pp 287-295 (2021) |
Druh dokumentu: | article |
ISSN: | 2708-9967 2708-9975 |
DOI: | 10.6180/jase.202204_25(2).0005 |
Popis: | Semantic text similarity(STS) measure plays an important role in the practical application of natural language processing. However, due to the complexity of Chinese semantic comprehension and the lack of currently available Chinese text similarity datasets, present research on Chinese semantic text similarity still exists many limitations. In this paper, we construct a new private self-built Chinese semantic similarity (NCSS) dataset and propose a new method called Attention-based Overall Enhance Network (ABOEN) for measuring semantic textual similarity. This model takes advantage of a convolutional neural network upon soft attention layers to capture more fine-grained interactive features between two sentences. Besides, inspired by the channel attention mechanism in image classification, we adopt a channel attention mechanism to enhance the critical overall interactive features between two sentences. The experimental results show that compared with other baseline models, the accuracy based on our model on the NCSS and LCQMC datasets has increased by 1.38% and 1.49%, respectively, which proves the effectiveness of our proposed model. |
Databáze: | Directory of Open Access Journals |
Externí odkaz: |