Communicative rhythm in gesture and speech

Autor:	Wachsmuth, Ipke, Braffort, Annelies, Gherbi, Rachid, Gibet, Sylvie, Richardson, James, Teil, Daniel
Rok vydání:	2002
Předmět:	Rhythm Computer science Speech recognition Multimodal data Synchronizing User interface Polling Gesture
Zdroj:	Gesture-Based Communication in Human-Computer Interaction ISBN: 9783540669357 Gesture Workshop
DOI:	10.1075/aicr.35.12wac
Popis:	Led by the fundamental role that rhythms apparently play in speech and gestural communication among humans, this study was undertaken to substantiate a biologically motivated model for synchronizing speech and gesture input in human computer interaction. Our approach presents a novel method which conceptualizes a multimodal user interface on the basis of timed agent systems. We use multiple agents for the purpose of polling presemantic information from different sensory channels (speech and hand gestures) and integrating them to multimodal data structures that can be processed by an application system which is again based on agent systems. This article motivates and presents technical work which exploits rhythmic patterns in the development; of biologically and cognitively motivated mediator systems between humans and machines.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_dedup___::3cfbe35398e10896c017c5065bb6d210 https://doi.org/10.1075/aicr.35.12wac Zobrazit plný text záznamu