Wait, but Why?:Assessing Behavior Explanation Strategies for Real-Time Strategy Games
| Autor: | Sagarika Patra, Simon Demediuk, Ben Kirman, Athanasios V. Kokkinakis, Anders Drachen, Jonathan Hook, Justus Robertson, Marian F. Ursu, Oluseyi Olarewaju, Florian Block |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
Esports
Modalities Recall Explainable Artificial Intelligence business.industry Computer science 05 social sciences Context (language use) 010501 environmental sciences 01 natural sciences 050105 experimental psychology Comprehension Interactivity Cognitive resource theory 0501 psychology and cognitive sciences business Data-Driven Storytelling Cognitive load Interactive media 0105 earth and related environmental sciences Cognitive psychology |
| Zdroj: | Robertson, J, Kokkinakis, A V, Hook, J, Kirman, B, Block, F, Ursu, M F, Patra, S, Demediuk, S, Drachen, A & Olarewaju, O 2021, Wait, but Why? Assessing Behavior Explanation Strategies for Real-Time Strategy Games . in 26th International Conference on Intelligent User Interfaces, IUI 2021 . Association for Computing Machinery, International Conference on Intelligent User Interfaces, Proceedings IUI, pp. 32-42, 26th International Conference on Intelligent User Interfaces: Where HCI Meets AI, IUI 2021, Virtual, Online, United States, 14/04/2021 . https://doi.org/10.1145/3397481.3450699 IUI |
| DOI: | 10.1145/3397481.3450699 |
| Popis: | Work in AI-based explanation systems has uncovered an interesting contradiction: People prefer and learn best from why explanations but expert esports commentators primarily answer what questions when explaining complex behavior in real-time strategy games. Three possible explanations for this contradiction are: 1.) broadcast audiences are well-informed and do not need why explanations; 2.) consuming why explanations in real-time is too cognitively demanding for audiences; or 3.) producing live why explanations is too difficult for commentators. We answer this open question by investigating the effects of explanation types and presentation modalities on audience recall and cognitive load in the context of an esports broadcast. We recruit 111 Dota 2 players and split them into three groups: The first group views a Dota 2 broadcast, the second group has the addition of an interactive map that provides what explanations, and the final group receives the interactive map with detailed why explanations. We find that participants who receive short interactive text prompts that provide what explanations outperform the no explanation group on a multiple-choice recall task. We also find that participants who receive detailed why explanations submit reports of cognitive load that are higher than the no explanation group. Our evidence supports the conclusion that informed audiences benefit from explanations but do not have the cognitive resources to process why answers in real-time. It also supports the conclusion that stacked explanation interventions across different modalities, like audio, interactivity, and text, can aid real-time comprehension when attention resources are limited. Together, our results indicate that interactive multimedia interfaces can be leveraged to quickly guide attention and provide low-cost explanations to improve intelligibility when time is too scarce for cognitively demanding why explanations. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|