The challenges of multimodality and multi-sensoriality: Methodological issues in analyzing tactile signed interaction
| Autor: | Meredith Bartlett, Howard Manns, Shimako Iwasaki, Louisa Willoughby |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
050101 languages & linguistics
Linguistics and Language Modalities Computer science Continuous flow 05 social sciences Sign language 050105 experimental psychology Language and Linguistics Social relation language.human_language Multimodality Conversation analysis Artificial Intelligence Human–computer interaction Australian Sign Language language 0501 psychology and cognitive sciences Haptic technology |
| Zdroj: | Journal of Pragmatics. 143:215-227 |
| ISSN: | 0378-2166 |
| DOI: | 10.1016/j.pragma.2018.05.003 |
| Popis: | Reflecting on the challenges of capturing and analyzing the multimodal complexity of human interactions, this paper examines the potentials of Conversation Analysis (CA) methods for illuminating the language and social interaction of deafblind signers, who operate with alternative resources in interaction. Generally, human interaction is managed through the rich and continuous flow of multimodal information and relies on simultaneous use of vocal-auditive and visuo-spatial resources to establish and coordinate interaction. CA can help us analyze how deafblind interactants who have no access to such resources manage to coordinate interaction, initiating, sustaining, and terminating social encounters. In this study, the primary modes and resources that deafblind interactants employ for communication are a tactile form of Australian Sign Language (Auslan) and haptic sensations that they experience and generate. Despite the limited range of modalities available, deafblind participants orient to the turn-taking mechanisms proposed by CA frameworks for spoken interaction. This paper considers the involvement of entire bodies in social interaction, addressing an audio and visual basis for communication. This study increases understanding of interaction through multi-sensory resources and bodily conduct that constitute the intersubjective worlds of deafblind interlocutors. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect