Bi-directional attention comparison for semantic sentence matching
| Autor: | Gongliang Li, Chunliu Wang, Lunfan Xu, Huiyuan Lai, Yizheng Tao, Dingyong Tang |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Matching (statistics)
Similarity (geometry) Artificial neural network Computer Networks and Communications Computer science business.industry Pooling Aggregate (data warehouse) 020207 software engineering 02 engineering and technology computer.software_genre Interaction information Focus (linguistics) Hardware and Architecture 0202 electrical engineering electronic engineering information engineering Media Technology Artificial intelligence business computer Software Natural language processing Sentence |
| Zdroj: | Multimedia Tools and Applications. 79:14609-14624 |
| ISSN: | 1573-7721 1380-7501 |
| Popis: | Semantic sentence matching, also known as calculation of text similarity, is one of the most important problems in natural language processing. Existing deep models mostly focus on the neural networks with attention mechanism. In this paper, we present a deep architecture to match two Chinese sentences, which only relies on alignment instead of long short-term memory network after attention mechanism is employed to get interaction information between sentence-pairs, the model becomes more lightweight and simple. Meanwhile, in order to capture semantic features enough, in addition to using max pooling and average pooling operation, we also employ a pooling operation named attention-pooling to aggregate information from the whole sentence, the final matching score is obtained after a multilayer perceptron classifier. Experiments are carried out on ATEC-NLP dataset and outline the effectiveness of our approach. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink