Enabling Multimodal Human–Robot Interaction for the Karlsruhe Humanoid Robot
| Autor: | Hartwig Holzapfel, Kai Nickel, Alex Waibel, Florian Kraft, Rainer Stiefelhagen, Michael Voit, Christian Fügen, Petra Gieselmann, Hazim Kemal Ekenel |
|---|---|
| Rok vydání: | 2007 |
| Předmět: |
business.industry
Computer science Robotics Speech processing Multimodal interaction Human–robot interaction Computer Science Applications Control and Systems Engineering Gesture recognition Human–computer interaction Computer vision Artificial intelligence Electrical and Electronic Engineering User interface business Humanoid robot Gesture |
| Zdroj: | IEEE Transactions on Robotics. 23:840-851 |
| ISSN: | 1941-0468 1552-3098 |
| DOI: | 10.1109/tro.2007.907484 |
| Popis: | In this paper, we present our work in building technologies for natural multimodal human-robot interaction. We present our systems for spontaneous speech recognition, multimodal dialogue processing, and visual perception of a user, which includes localization, tracking, and identification of the user, recognition of pointing gestures, as well as the recognition of a person's head orientation. Each of the components is described in the paper and experimental results are presented. We also present several experiments on multimodal human-robot interaction, such as interaction using speech and gestures, the automatic determination of the addressee during human-human-robot interaction, as well on interactive learning of dialogue strategies. The work and the components presented here constitute the core building blocks for audiovisual perception of humans and multimodal human-robot interaction used for the humanoid robot developed within the German research project (Sonderforschungsbereich) on humanoid cooperative robots. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|