An Initial Analysis of Structured Video Interviews by Using Multimodal Emotion Detection

Autor: Michelle Paulette Martin, Su-Youn Yoon, Lei Chen, Min Ma, Chee Wee Leong
Rok vydání: 2014
Předmět:
Zdroj: ERM4HCI@ICMI
DOI: 10.1145/2668056.2668057
Popis: Recently online video interviews have been increasingly used in the employment process. Though several automatic techniques have emerged to analyze the interview videos, so far, only simple emotion analyses have been attempted, e.g. counting the number of smiles on the face of an interviewee. In this paper, we report our initial study of employing advanced multimodal emotion detection approaches for the purpose of measuring performance on an interview task that elicits emotion. On an acted interview corpus we created, we performed our evaluations using a Speech-based Emotion Recognition (SER) system, as well as an off-the-shelf facial expression analysis toolkit (FACET). While the results obtained suggest the promise of using FACET for emotion detection, the benefits of employing the SER are somewhat limited.
Databáze: OpenAIRE