Attention-Based Overall Enhance Network for Chinese Semantic Textual Similarity Measure

Autor: Hao Zhang, HuaXiong Zhang, XingYu Lu, Qiang Gao
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: Journal of Applied Science and Engineering, Vol 25, Iss 2, Pp 287-295 (2021)
Druh dokumentu: article
ISSN: 2708-9967
2708-9975
DOI: 10.6180/jase.202204_25(2).0005
Popis: Semantic text similarity(STS) measure plays an important role in the practical application of natural language processing. However, due to the complexity of Chinese semantic comprehension and the lack of currently available Chinese text similarity datasets, present research on Chinese semantic text similarity still exists many limitations. In this paper, we construct a new private self-built Chinese semantic similarity (NCSS) dataset and propose a new method called Attention-based Overall Enhance Network (ABOEN) for measuring semantic textual similarity. This model takes advantage of a convolutional neural network upon soft attention layers to capture more fine-grained interactive features between two sentences. Besides, inspired by the channel attention mechanism in image classification, we adopt a channel attention mechanism to enhance the critical overall interactive features between two sentences. The experimental results show that compared with other baseline models, the accuracy based on our model on the NCSS and LCQMC datasets has increased by 1.38% and 1.49%, respectively, which proves the effectiveness of our proposed model.
Databáze: Directory of Open Access Journals