ODO: Design of Multimodal Chatbot for an Experiential Media System

Autor: Ravi Bhushan, Karthik Kulkarni, Vishal Kumar Pandey, Connor Rawls, Brandon Mechtley, Suren Jayasuriya, Christian Ziegler
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: Multimodal Technologies and Interaction, Vol 4, Iss 4, p 68 (2020)
Druh dokumentu: article
ISSN: 2414-4088
DOI: 10.3390/mti4040068
Popis: This paper presents the design of a multimodal chatbot for use in an interactive theater performance. This chatbot has an architecture consisting of vision and natural language processing capabilities, as well as embodiment in a non-anthropomorphic movable LED array set in a stage. Designed for interaction with up to five users at a time, the system can perform tasks including face detection and emotion classification, tracking of crowd movement through mobile phones, and real-time conversation to guide users through a nonlinear story and interactive games. The final prototype, named ODO, is a tangible embodiment of a distributed multimedia system that solves several technical challenges to provide users with a unique experience through novel interaction.
Databáze: Directory of Open Access Journals