Multimodal Trajectory Analysis of Visitor Engagement with Interactive Science Museum Exhibits
Autor: | James C. Lester, Jonathan P. Rowe, Andrew Emerson, James Minogue, Wookhee Min, Nathan Henderson |
---|---|
Rok vydání: | 2021 |
Předmět: |
Modalities
InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g. HCI) Process (engineering) Computer science Human–computer interaction Visitor pattern Multimodal data media_common.quotation_subject Curiosity Trajectory analysis Construct (philosophy) Multimodal learning analytics media_common |
Zdroj: | Lecture Notes in Computer Science ISBN: 9783030782696 AIED (2) |
DOI: | 10.1007/978-3-030-78270-2_27 |
Popis: | Recent years have seen a growing interest in investigating visitor engagement in science museums with multimodal learning analytics. Visitor engagement is a multidimensional process that unfolds temporally over the course of a museum visit. In this paper, we introduce a multimodal trajectory analysis framework for modeling visitor engagement with an interactive science exhibit for environmental sustainability. We investigate trajectories of multimodal data captured during visitor interactions with the exhibit through slope-based time series analysis. Utilizing the slopes of the time series representations for each multimodal data channel, we conduct an ablation study to investigate how additional modalities lead to improved accuracy while modeling visitor engagement. We are able to enhance visitor engagement models by accounting for varying levels of visitors’ science fascination, a construct integrating science interest, curiosity, and mastery goals. The results suggest that trajectory-based representations of the multimodal visitor data can serve as the foundation for visitor engagement modeling to enhance museum learning experiences. |
Databáze: | OpenAIRE |
Externí odkaz: |