Autor: |
Laura Fry, David Pautler, Alaa Sakallah, Michael Neumann, Saige Portera, Andrew E. Cornish, Vikram Ramanarayanan, Doug Habberstad, Jackson Liscombe, Yasmine Bensidi-Slimane, Hardik Kothare, Sara Markuson, Carly Demopoulos, David Suendermann-Oeft, Afik Faerman, William T. Burke, Oliver Roesler, Seemran Kansara |
Rok vydání: |
2021 |
Předmět: |
|
Zdroj: |
Interspeech 2021. |
Popis: |
We explore the utility of an on-demand multimodal conversational platform in extracting speech and facial metrics in children with Autism Spectrum Disorder (ASD). We investigate the extent to which these metrics correlate with objective clinical measures, particularly as they pertain to the interplay be-tween the affective, phonatory and motoric subsystems. 22 participants diagnosed with ASD engaged with a virtual agent in conversational affect production tasks designed to elicit facial and vocal affect. We found significant correlations between vocal pitch and loudness extracted by our platform during these tasks and accuracy in recognition of facial and vocal affect, as-sessed via the Diagnostic Analysis of Nonverbal Accuracy-2 (DANVA-2) neuropsychological task. We also found significant correlations between jaw kinematic metrics extracted using our platform and motor speed of the dominant hand assessed via a standardised neuropsychological finger tapping task. These findings offer preliminary evidence for the usefulness of these audiovisual analytic metrics and could help us better model the interplay between different physiological subsystems in individuals with ASD. |
Databáze: |
OpenAIRE |
Externí odkaz: |
|