NeuralLog: Natural Language Inference with Joint Neural and Logical Reasoning
Autor: | Qiyue Gao, Lawrence S. Moss, Zeming Chen |
---|---|
Rok vydání: | 2021 |
Předmět: |
FOS: Computer and information sciences
Computer Science - Computation and Language Phrase Artificial neural network Computer Science - Artificial Intelligence Computer science business.industry Deep learning Inference Artificial Intelligence (cs.AI) Search problem Beam search Language model Artificial intelligence business Computation and Language (cs.CL) Merge (linguistics) |
Zdroj: | SEM |
DOI: | 10.18653/v1/2021.starsem-1.7 |
Popis: | Deep learning (DL) based language models achieve high performance on various benchmarks for Natural Language Inference (NLI). And at this time, symbolic approaches to NLI are receiving less attention. Both approaches (symbolic and DL) have their advantages and weaknesses. However, currently, no method combines them in a system to solve the task of NLI. To merge symbolic and deep learning methods, we propose an inference framework called NeuralLog, which utilizes both a monotonicity-based logical inference engine and a neural network language model for phrase alignment. Our framework models the NLI task as a classic search problem and uses the beam search algorithm to search for optimal inference paths. Experiments show that our joint logic and neural inference system improves accuracy on the NLI task and can achieve state-of-art accuracy on the SICK and MED datasets. 8 pages, 4 figures, The 10th Joint Conference on Lexical and Computational Semantics (*SEM2021) @ ACL2021 |
Databáze: | OpenAIRE |
Externí odkaz: |