It’s a Joint Effort: Understanding Speech and Gesture in Collaborative Tasks
Autor: | Jaime Ruiz, Rahul Bangar, Dhruva Patil, J. Ross Beveridge, Bruce A. Draper, Pradyumna Narayana, Isaac Wang |
---|---|
Rok vydání: | 2021 |
Předmět: | |
Zdroj: | Lecture Notes in Computer Science ISBN: 9783030784645 HCI (2) |
Popis: | Computers are evolving from computational tools to collaborative agents through the emergence of natural, speech-driven interfaces. However, relying on speech alone is a limitation; gesture and other non-verbal aspects of communication also play a vital role in natural human discourse. To understand the use of gesture in human communication, we conducted a study to explore how people use gesture and speech to communicate when solving collaborative tasks. We asked 30 pairs of people to build structures out of blocks, limiting their communication to either Gesture Only, Speech Only, or Gesture and Speech. We found differences in how gesture and speech were used to communicate across the three conditions and found that pairs in the Gesture and Speech condition completed tasks faster than those in Speech Only. From our results, we draw conclusions about how our work impacts the design of collaborative systems and virtual agents that support gesture. |
Databáze: | OpenAIRE |
Externí odkaz: |