Audiovisual perception of interrupted speech by nonnative listeners.

Autor: Yang J; Program of Communication Sciences and Disorders, University of Wisconsin-Milwaukee, Enderis Hall 873, P.O. Box 413, Milwaukee, WI, 53201, USA. jyang888@uwm.edu., Nagaraj NK; Cognitive Hearing Science Lab, Utah State University, Logan, UT, USA., Magimairaj BM; Cognitive Hearing Science Lab, Utah State University, Logan, UT, USA.
Jazyk: angličtina
Zdroj: Attention, perception & psychophysics [Atten Percept Psychophys] 2024 Jul; Vol. 86 (5), pp. 1763-1776. Date of Electronic Publication: 2024 Jun 17.
DOI: 10.3758/s13414-024-02909-3
Abstrakt: The purpose of the present study was to examine the influence of visual cues in audiovisual perception of interrupted speech by nonnative English listeners and to identify the role of working memory, long-term memory retrieval, and vocabulary knowledge in audiovisual perception by nonnative listeners. The participants included 31 Mandarin-speaking English learners between 19 and 41 years of age. The perceptual stimuli were noise-filled periodically interrupted AzBio and QuickSIN sentences with or without visual cues that showed a male speaker uttering the sentences. In addition to sentence recognition, the listeners completed a semantic fluency task, verbal (operation span) and visuospatial (symmetry span) working memory tasks, and two vocabulary knowledge tests (Vocabulary Level Test and Lexical Test for Advanced Learners of English). The results revealed significantly better speech recognition in the audio-visual condition than the audio-only condition, but the magnitude of visual benefit was substantially attenuated for sentences that had limited semantic context. The listeners' vocabulary size in English played a key role in the restoration of missing speech information and audiovisual integration in the perception of interrupted speech. Meanwhile, the listeners' verbal working memory capacity played an important role in audiovisual integration especially for the difficult stimuli with limited semantic context.
Competing Interests: Declarations Conflicts of interest The authors have no relevant financial or nonfinancial interests to disclose.There are no conflicts of interest, financial, or otherwise. Ethics approval Approval was obtained from the ethics committee of the University of Wisconsin-Milwaukee (IRB No. 19.A.194). Consent to participate Informed consent was obtained from all individual participants included in the study. Consent for publication The authors affirm that human research participants provided informed consent for publication of the de-identified data.
(© 2024. The Psychonomic Society, Inc.)
Databáze: MEDLINE
Externí odkaz: