Analysis and Detection of Differences in Spoken User Behaviors between Autonomous and Wizard-of-Oz Systems

Autor:	Elmers, Mikey, Inoue, Koji, Lala, Divesh, Ochi, Keiko, Kawahara, Tatsuya
Rok vydání:	2024
Předmět:	Computer Science - Computation and Language Computer Science - Human-Computer Interaction Computer Science - Robotics
Druh dokumentu:	Working Paper
Popis:	This study examined users' behavioral differences in a large corpus of Japanese human-robot interactions, comparing interactions between a tele-operated robot and an autonomous dialogue system. We analyzed user spoken behaviors in both attentive listening and job interview dialogue scenarios. Results revealed significant differences in metrics such as speech length, speaking rate, fillers, backchannels, disfluencies, and laughter between operator-controlled and autonomous conditions. Furthermore, we developed predictive models to distinguish between operator and autonomous system conditions. Our models demonstrated higher accuracy and precision compared to the baseline model, with several models also achieving a higher F1 score than the baseline. Comment: Accepted and will be presented at the 27th conference of the Oriental COCOSDA (O-COCOSDA 2024)
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2410.03147 Zobrazit plný text záznamu View this record from Arxiv