MatDC: A Multi-turn Multi-domain Annotated Task-oriented Dialogue Dataset in Chinese

Autor: Yu-Lin Chang, Li-Ping Chang, Yu-Hsiang Tseng, Chiung-Yu Chiang, Shu-Kai Hsieh, Ji-Lung Hsieh, Richard Lian
Rok vydání: 2020
Předmět:
Zdroj: TAAI
Popis: The modern conversational agent requires high-quality datasets, which are often the bottlenecks when building models. This paper introduces MatDC, an entirely human-produced dialogue dataset with full semantic annotations in Chinese. The dataset features linguistic variations given users’ intents and fully annotated semantic slots. MatDC dataset was completely human-edited, and the curation comprises two stages. At first, templates design stage, domain editors first construct schemas and compose ten dialogues between the agents and the users based on the back- end database. Secondly, in the dialogue rewrite stage, rewriters generate sentential variations for each template, under the constraints that the normalized slot values are kept unchanged. The underlying methodology of the MatDC is more open to extension and more adaptable to different domains. To demonstrate the applicability of the dataset, we build a dialogue agent with conventional pipeline architecture. We expect the MatDC dataset to provide additional training data and testing ground for dialogue agent studies.
Databáze: OpenAIRE