Being bored? Recognising natural interest by extensive audiovisual integration for real-life application
| Autor: | Jürgen Gast, Anja Hothker, Florian Eyben, Gerhard Rigoll, Hitoshi Konosu, R. Muller, Martin Wöllmer, Benedikt Hornler, Björn Schuller |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2009 |
| Předmět: |
Facial expression
Modalities Computer science business.industry Process (engineering) 020206 networking & telecommunications Usability 02 engineering and technology Machine learning computer.software_genre Identification (information) Human–computer interaction Signal Processing 0202 electrical engineering electronic engineering information engineering Natural (music) 020201 artificial intelligence & image processing Relevance (information retrieval) Computer Vision and Pattern Recognition Artificial intelligence business Affective computing computer |
| Popis: | Automatic detection of the level of human interest is of high relevance for many technical applications, such as automatic customer care or tutoring systems. However, the recognition of spontaneous interest in natural conversations independently of the subject remains a challenge. Identification of human affective states relying on single modalities only is often impossible, even for humans, since different modalities contain partially disjunctive cues. Multimodal approaches to human affect recognition generally are shown to boost recognition performance, yet are evaluated in restrictive laboratory settings only. Herein we introduce a fully automatic processing combination of Active-Appearance-Model-based facial expression, vision-based eye-activity estimation, acoustic features, linguistic analysis, non-linguistic vocalisations, and temporal context information in an early feature fusion process. We provide detailed subject-independent results for classification and regression of the Level of Interest using Support-Vector Machines on an audiovisual interest corpus ( AVIC ) consisting of spontaneous, conversational speech demonstrating "theoretical" effectiveness of the approach. Further, to evaluate the approach with regards to real-life usability a user-study is conducted for proof of "practical" effectiveness. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|