Auxiliary Capsules for Natural Language Understanding
| Autor: | Ignacio Iacobacci, Ieva Staliunaite |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Computer science
business.industry Learning environment 05 social sciences Natural language understanding Multi-task learning 010501 environmental sciences computer.software_genre Part of speech 01 natural sciences Field (computer science) Named entity Named-entity recognition 0502 economics and business Artificial intelligence 050207 economics Joint (audio engineering) business computer Natural language processing 0105 earth and related environmental sciences |
| Zdroj: | ICASSP |
| DOI: | 10.1109/icassp40776.2020.9053899 |
| Popis: | Lately, joint training of Intent detection and Slot filling has become the best-performing approach in the field of Natural Language Understanding (NLU). In this work we extend the newly introduced application of Capsule Networks for NLU to a multi-task learning environment, using relevant auxiliary tasks. Specifically, our models perform joint Intent classification and Slot filling with the aid of Named Entity Recognition (NER) and Part of Speech (POS) tagging tasks. This allows us to exploit the hierarchical relationships between the Intents of the utterances and the different features of input text, not only Slots but also Named Entity mentions, Parts of Speech, quantity indications, etc. The models developed in this work are evaluated on standard benchmarks, achieving state-of-the-art results on the SNIPS dataset while outperforming the best commercial systems on several low-resource datasets. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|