Towards Believable Behavior Generation for Embodied Conversational Agents
Autor: | Manish Mehta, Jürgen Königsmann, Lasse Johannesson, Andrea Corradini, Morgan Fredriksson, Niels Ole Bernsen |
---|---|
Rok vydání: | 2004 |
Předmět: | |
Zdroj: | Computational Science-ICCS 2004 ISBN: 9783540221166 International Conference on Computational Science |
DOI: | 10.1007/978-3-540-24688-6_121 |
Popis: | This paper reports on the generation of coordinated multimodal output for the NICE (Natural Interactive Communication for Edutainment) system [1]. In its first prototype, the system allows for fun and experientially rich interaction between primarily 10 to 18 years old human users and 3D-embodied fairy tale author H.C. Andersen in his study. User input consists of domain-oriented spoken conversation combined with 2D input gesture, entered via a mouse-compatible device. The animated character can move about and interact with his environment as well as communicate with the user through spoken conversation and non-verbal gesture, body posture, facial expression and gaze. The described approach aims to make the virtual agent’s appearance, voice, actions, and communicative behavior convey the impression of a character with human-like behavior, emotions, relevant domain knowledge, and a distinct personality. We propose an approach to multimodal output generation, which exploits a richly parameterized semantic instruction from the conversation manager and splits the instruction into synchronized text instructions to the text-to-speech synthesizer, and behavioral instructions to the animated character. Based on the implemented version of this approach, we are in the process of creating a behavior sub-system that combines the described multimodal output instructions with parameters representing the current emotional state of the character, producing animations that express emotional state through speech and non-verbal behavior. |
Databáze: | OpenAIRE |
Externí odkaz: |