Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints

Autor: Bergmann, Kirsten, Kahl, Sebastian, Kopp, Stefan, Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H.
Jazyk: angličtina
Rok vydání: 2013
Zdroj: PUB-Publications at Bielefeld University
Popis: This paper addresses the semantic coordination of speech and gesture, a major prerequisite when endowing virtual agents with convincing multimodal behavior. Previous research has focused on build- ing rule- or data-based models speci c for a particular language, culture or individual speaker, but without considering the underlying cognitive processes. We present a exible cognitive model in which both linguistic as well as cognitive constraints are considered in order to simulate natu- ral semantic coordination across speech and gesture. An implementation of this model is presented and rst simulation results, compatible with empirical data from the literature are reported.
Databáze: OpenAIRE