A Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions

Autor: Fenglei Yang, Sijung Hu, Baomin Li, Vincent M. Dwyer, Harnani Hassan, Dong-Qing Wei, Ping Shi
Jazyk: angličtina
Rok vydání: 2017
Předmět:
Zdroj: Scientific Reports, Vol 7, Iss 1, Pp 1-12 (2017)
Druh dokumentu: article
ISSN: 2045-2322
DOI: 10.1038/s41598-017-07122-x
Popis: Abstract Recent progress in Affective Computing (AC) has enabled integration of physiological cues and spontaneous expressions to reveal a subject’s emotional state. Due to the lack of an effective technique for evaluating multimodal correlations, experience and intuition play a main role in present AC studies when fusing affective cues or modalities, resulting in unexpected outcomes. This study seeks to demonstrate a dynamic correlation between two such affective cues, physiological changes and spontaneous expressions, which were obtained by a combination of stereo vision based tracking and imaging photoplethysmography (iPPG), with a designed protocol involving 20 healthy subjects. The two cues obtained were sampled into a Statistical Association Space (SAS) to evaluate their dynamic correlation. It is found that the probability densities in the SAS increase as the peaks in two cues are approached. Also the complex form of the high probability density region in the SAS suggests a nonlinear correlation between two cues. Finally the cumulative distribution on the zero time-difference surface is found to be small (
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje