The Role of the Auditory and Visual Modalities in the Perceptual Identification of Brazilian Portuguese Statements and Echo Questions
| Autor: | Marc Swerts, Albert Rilliard, João Antônio de Moraes, Luma da Silva Miranda |
|---|---|
| Přispěvatelé: | Tilburg University [Netherlands], Universidade Federal do Rio de Janeiro (UFRJ), Traitement du Langage Parlé (TLP ), Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Sciences et Technologies des Langues (STL), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Sciences et Technologies des Langues (STL), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Language, Communication and Cognition |
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
Adult
Male 050101 languages & linguistics Linguistics and Language Sociology and Political Science Statement (logic) media_common.quotation_subject Audiovisual perception Prosody Language and Linguistics 030507 speech-language pathology & audiology 03 medical and health sciences Speech and Hearing Brazilian Portuguese Phonetics Perception Humans CUES 0501 psychology and cognitive sciences [SHS.LANGUE]Humanities and Social Sciences/Linguistics media_common Language Modalities 05 social sciences Echo (computing) General Medicine SPEECH PROSODIC PROMINENCE Echo question language.human_language Facial Expression Identification (information) Acoustic Stimulation language Speech Perception Female Statement 0305 other medical science Psychology Brazil Photic Stimulation Cognitive psychology |
| Zdroj: | Language and Speech Language and Speech, SAGE Publications (UK and US), 2021, 64 (1), pp.3-23. ⟨10.1177/0023830919898886⟩ Language and Speech, 2021, 64 (1), pp.3-23. ⟨10.1177/0023830919898886⟩ Language and Speech, 64(1):0023830919898886, 3-23. SAGE Publications Inc. |
| ISSN: | 0023-8309 |
| DOI: | 10.1177/0023830919898886⟩ |
| Popis: | International audience; This paper presents the results of three perceptual experiments investigating the role of auditory and visual channels for the identification of statements and echo questions in Brazilian Portuguese. Ten Brazilian speakers (five male) were video-recorded (frontal view of the face) while they produced a sentence ("Como você sabe"), either as a statement (meaning "As you know.") or as an echo question (meaning "As you know?"). Experiments were set up with the two different intonation contours. Stimuli were presented in conditions with clear and degraded audio as well as congruent and incongruent information from both channels. Results show that Brazilian listeners were able to distinguish statements and questions prosodically and visually, with auditory performances being dominant over visual ones. In noisy conditions, the visual channel improved the interpretation of prosodic cues robustly, while it degraded them in conditions where the visual information is incongruent with the auditory information. This study confirms the previous findings on auditory and visual integration within speech perception, also when applied to prosodic patterns. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|