Avoiding Echo-Responses in a Retrieval-Based Conversation System

Autor: Fedorenko, Denis, Smetanin, Nikita, Rodichev, Artem
Rok vydání: 2017
Předmět:
Zdroj: In: Artificial Intelligence and Natural Language. AINL 2018. Vol 930. Springer
Druh dokumentu: Working Paper
DOI: 10.1007/978-3-030-01204-5_9
Popis: Retrieval-based conversation systems generally tend to highly rank responses that are semantically similar or even identical to the given conversation context. While the system's goal is to find the most appropriate response, rather than the most semantically similar one, this tendency results in low-quality responses. We refer to this challenge as the echoing problem. To mitigate this problem, we utilize a hard negative mining approach at the training stage. The evaluation shows that the resulting model reduces echoing and achieves better results in terms of Average Precision and Recall@N metrics, compared to the models trained without the proposed approach.
Databáze: arXiv