The Ecological Approach to Multimodal System Design

Autor: Laurent Romary, Frédéric Wolff, Antonella De Angeli, Walter Gerbino
Přispěvatelé: Cognitive Technology Laboratory, Department of Psychology (CTL), Università degli studi di Trieste, Human-machine dialogue with a significant language component (LANGUE ET DIALOGUE), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS), Annelies Braffort, Rachid Gherbi, Sylvie Gibet, James Richardson, Daniel Teil, Università degli studi di Trieste = University of Trieste
Rok vydání: 1999
Předmět:
Zdroj: Gesture-Based Communication in Human-Computer Interaction ISBN: 9783540669357
Gesture Workshop
Gesture-Based Communication in Human-Computer Interaction: International Gesture Workshop, GW'99, Gif-sur-Yvette, France, March 1999. Proceedings
Lecture Notes in Computer Science
Gesture-Based Communication in Human-Computer Interaction
DOI: 10.1007/3-540-46616-9_4
Popis: Following the ecological approach to visual perception, this paper presents a framework that emphasizes the role of vision on referring actions. In particular, affordances are utilized to explain gestures variability in a multimodal human-computer interaction. Such a proposal is consistent with empirical findings obtained in different simulation studies showing how referring gestures are determined by the mutuality of information coming from the target and the set of movements available to the speaker. A prototype that follows anthropomorphic perceptual principles to analyze gestures has been developed and tested in preliminary computational validations.
Databáze: OpenAIRE