Gestural Communication over Video Stream: Supporting Multimodal Interaction for Remote Collaborative Physical Tasks

Autor:	Leslie D. Setlock, Xilin Chen, Jie Yang, Susan R. Fussell, Jiazhi Ou
Rok vydání:	2018
Předmět:	Multimedia Computer science InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g. HCI) Workspace computer.software_genre Multimodal interaction Task (computing) Videoconferencing Gesture recognition Applied Computer Science Component (UML) Computer-supported cooperative work computer Gesture
Zdroj:	ICMI
DOI:	10.1184/r1/6470087.v1
Popis:	We present a system integrating gesture and live video to support collaboration on physical tasks. The architecture combines network IP cameras, desktop PCs, and tablet PCs to allow a remote helper to draw on a video feed of a workspace as he/she provides task instructions. A gesture recognition component enables the system both to normalize freehand drawings to facilitate communication with remote partners and to use pen-based input as a camera control device. Results of a preliminary user study suggest that our gesture over video communication system enhances task performance over traditional video-only systems. Implications for the design of multimodal systems to support collaborative physical tasks are also discussed.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_dedup___::80fec8f19a7cc7a68afbecfa7d60ffd4 Zobrazit plný text záznamu