Explaining face-voice matching decisions: the contribution of mouth movements, stimulus effects and response biases
| Autor: | Nadine Lavan, Carolyn McGettigan, Harriet M. J. Smith, Li Jiang |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
Linguistics and Language
Matching (statistics) Original Manuscript Experimental and Cognitive Psychology Stimulus (physiology) Face-voice matching 050105 experimental psychology Language and Linguistics Task (project management) 03 medical and health sciences 0302 clinical medicine Bias Cross-modal Humans 0501 psychology and cognitive sciences Set (psychology) Identity perception Mouth Modalities Social perception 05 social sciences Sensory Systems Face Face (geometry) Voice Identity (object-oriented programming) Psychology Mouth movements 030217 neurology & neurosurgery Cognitive psychology |
| Zdroj: | Attention, Perception & Psychophysics |
| ISSN: | 1943-3921 |
| Popis: | Previous studies have shown that face-voice matching accuracy is more consistently above chance for dynamic (i.e. speaking) faces than for static faces. This suggests that dynamic information can play an important role in informing matching decisions. We initially asked whether this advantage for dynamic stimuli is due to shared information across modalities that is encoded in articulatory mouth movements. Participants completed a sequential face-voice matching task with (1) static images of faces, (2) dynamic videos of faces, (3) dynamic videos where only the mouth was visible, and (4) dynamic videos where the mouth was occluded, in a well-controlled stimulus set. Surprisingly, after accounting for random variation in the data due to design choices, accuracy for all four conditions was at chance. Crucially, however, exploratory analyses revealed that participants were not responding randomly, with different patterns of response biases being apparent for different conditions. Our findings suggest that face-voice identity matching may not be possible with above-chance accuracy but that analyses of response biases can shed light upon how people attempt face-voice matching. We discuss these findings with reference to the differential functional roles for faces and voices recently proposed for multimodal person perception. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink