Attentional resources contribute to the perceptual learning of talker idiosyncrasies in audiovisual speech
| Autor: | Alexandra Jesse, Elina Kaplan |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Adult
Male Linguistics and Language medicine.medical_specialty Speech perception Experimental and Cognitive Psychology Audiology 050105 experimental psychology Language and Linguistics 03 medical and health sciences Tone (musical instrument) Young Adult 0302 clinical medicine Perceptual learning Phonetics medicine Humans Learning 0501 psychology and cognitive sciences Attention Modality (human–computer interaction) Modalities 05 social sciences Sensory Systems Task (computing) Acoustic Stimulation Auditory Perception Female Audiovisual speech Psychology 030217 neurology & neurosurgery Photic Stimulation Gesture |
| Zdroj: | Attention, perceptionpsychophysics. 81(4) |
| ISSN: | 1943-393X |
| Popis: | To recognize audiovisual speech, listeners evaluate and combine information obtained from the auditory and visual modalities. Listeners also use information from one modality to adjust their phonetic categories to a talker's idiosyncrasy encountered in the other modality. In this study, we examined whether the outcome of this cross-modal recalibration relies on attentional resources. In a standard recalibration experiment in Experiment 1, participants heard an ambiguous sound, disambiguated by the accompanying visual speech as either /p/ or /t/. Participants' primary task was to attend to the audiovisual speech while either monitoring a tone sequence for a target tone or ignoring the tones. Listeners subsequently categorized the steps of an auditory /p/-/t/ continuum more often in line with their exposure. The aftereffect of phonetic recalibration was reduced, but not eliminated, by attentional load during exposure. In Experiment 2, participants saw an ambiguous visual speech gesture that was disambiguated auditorily as either /p/ or /t/. At test, listeners categorized the steps of a visual /p/-/t/ continuum more often in line with the prior exposure. Imposing load in the auditory modality during exposure did not reduce the aftereffect of this type of cross-modal phonetic recalibration. Together, these results suggest that auditory attentional resources are needed for the processing of auditory speech and/or for the shifting of auditory phonetic category boundaries. Listeners thus need to dedicate attentional resources in order to accommodate talker idiosyncrasies in audiovisual speech. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink