A comprehensive solution to retrieval-based chatbot construction
| Autor: | Kristen Moore, Shenjun Zhong, Zhen He, Torsten Rudolf, Nils Fisher, Brandon Victor, Neha Jindal |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Human-Computer Interaction
FOS: Computer and information sciences Computer Science - Machine Learning Computer Science - Computation and Language ComputingMethodologies_PATTERNRECOGNITION Artificial Intelligence (cs.AI) Computer Science - Artificial Intelligence Computation and Language (cs.CL) Software Theoretical Computer Science Machine Learning (cs.LG) |
| DOI: | 10.48550/arxiv.2106.06139 |
| Popis: | In this paper we present the results of our experiments in training and deploying a self-supervised retrieval-based chatbot trained with contrastive learning for assisting customer support agents. In contrast to most existing research papers in this area where the focus is on solving just one component of a deployable chatbot, we present an end-to-end set of solutions to take the reader from an unlabelled chatlogs to a deployed chatbot. This set of solutions includes creating a self-supervised dataset and a weakly labelled dataset from chatlogs, as well as a systematic approach to selecting a fixed list of canned responses. We present a hierarchical-based RNN architecture for the response selection model, chosen for its ability to cache intermediate utterance embeddings, which helped to meet deployment inference speed requirements. We compare the performance of this architecture across 3 different learning objectives: self-supervised contrastive learning, binary classification, and multi-class classification. We find that using a self-supervised contrastive learning model outperforms training the binary and multi-class classification models on a weakly labelled dataset. Our results validate that the self-supervised contrastive learning approach can be effectively used for a real-world chatbot scenario. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|