Not All Dialogues are Created Equal: Instance Weighting for Neural Conversational Models

Autor:	Lison, Pierre, Bibauw, Serge
Rok vydání:	2017
Předmět:	Computer Science - Computation and Language Computer Science - Artificial Intelligence I.2.7 I.2.6
Druh dokumentu:	Working Paper
Popis:	Neural conversational models require substantial amounts of dialogue data for their parameter estimation and are therefore usually learned on large corpora such as chat forums or movie subtitles. These corpora are, however, often challenging to work with, notably due to their frequent lack of turn segmentation and the presence of multiple references external to the dialogue itself. This paper shows that these challenges can be mitigated by adding a weighting model into the architecture. The weighting model, which is itself estimated from dialogue data, associates each training example to a numerical weight that reflects its intrinsic quality for dialogue modelling. At training time, these sample weights are included into the empirical loss to be minimised. Evaluation results on retrieval-based models trained on movie and TV subtitles demonstrate that the inclusion of such a weighting model improves the model performance on unsupervised metrics. Comment: Accepted to SIGDIAL 2017
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/1704.08966 Zobrazit plný text záznamu View this record from Arxiv