When Crowd Meets Persona: Creating a Large-Scale Open-Domain Persona Dialogue Corpus
Autor: | Cho, Won Ik, Lee, Yoon Kyung, Bae, Seoyeon, Kim, Jihwan, Park, Sangah, Kim, Moosung, Hahn, Sowon, Kim, Nam Soo |
---|---|
Rok vydání: | 2023 |
Předmět: | |
Druh dokumentu: | Working Paper |
Popis: | Building a natural language dataset requires caution since word semantics is vulnerable to subtle text change or the definition of the annotated concept. Such a tendency can be seen in generative tasks like question-answering and dialogue generation and also in tasks that create a categorization-based corpus, like topic classification or sentiment analysis. Open-domain conversations involve two or more crowdworkers freely conversing about any topic, and collecting such data is particularly difficult for two reasons: 1) the dataset should be ``crafted" rather than ``obtained" due to privacy concerns, and 2) paid creation of such dialogues may differ from how crowdworkers behave in real-world settings. In this study, we tackle these issues when creating a large-scale open-domain persona dialogue corpus, where persona implies that the conversation is performed by several actors with a fixed persona and user-side workers from an unspecified crowd. Comment: Presented at HCOMP 2022 as Works-in-Progress |
Databáze: | arXiv |
Externí odkaz: |