| Autor: |
Lorenzo Ferrone, Fabio Massimo Zanzotto |
| Jazyk: |
angličtina |
| Rok vydání: |
2020 |
| Předmět: |
|
| Zdroj: |
Frontiers in Robotics and AI, Vol 6 (2020) |
| Druh dokumentu: |
article |
| ISSN: |
2296-9144 |
| DOI: |
10.3389/frobt.2019.00153 |
| Popis: |
Natural language is inherently a discrete symbolic representation of human knowledge. Recent advances in machine learning (ML) and in natural language processing (NLP) seem to contradict the above intuition: discrete symbols are fading away, erased by vectors or tensors called distributed and distributional representations. However, there is a strict link between distributed/distributional representations and discrete symbols, being the first an approximation of the second. A clearer understanding of the strict link between distributed/distributional representations and symbols may certainly lead to radically new deep learning networks. In this paper we make a survey that aims to renew the link between symbolic representations and distributed/distributional representations. This is the right time to revitalize the area of interpreting how discrete symbols are represented inside neural networks. |
| Databáze: |
Directory of Open Access Journals |
| Externí odkaz: |
|
