Convergent and invariant object representations for sight, sound, and touch
| Autor: | Man, Kingson, Damasio, Antonio, Meyer, Kaspar, Kaplan, Jonas T. |
|---|---|
| Přispěvatelé: | University of Zurich, Man, Kingson |
| Jazyk: | angličtina |
| Rok vydání: | 2015 |
| Předmět: |
Male
Brain Mapping genetic structures Radiological and Ultrasound Technology 10216 Institute of Anesthesiology Clinical Neurology Brain Signal Processing Computer-Assisted 610 Medicine & health 2702 Anatomy Magnetic Resonance Imaging 2728 Neurology (clinical) Touch Perception Neurology Radiology Nuclear Medicine and imaging Physical Stimulation 2808 Neurology Auditory Perception Visual Perception Humans 2741 Radiology Nuclear Medicine and Imaging Female Anatomy Research Articles 3614 Radiological and Ultrasound Technology |
| Zdroj: | Hum Brain Mapp |
| Popis: | We continuously perceive objects in the world through multiple sensory channels. In this study, we investigated the convergence of information from different sensory streams within the cerebral cortex. We presented volunteers with three common objects via three different modalities—sight, sound, and touch—and used multivariate pattern analysis of functional magnetic resonance imaging data to map the cortical regions containing information about the identity of the objects. We could reliably predict which of the three stimuli a subject had seen, heard, or touched from the pattern of neural activity in the corresponding early sensory cortices. Intramodal classification was also successful in large portions of the cerebral cortex beyond the primary areas, with multiple regions showing convergence of information from two or all three modalities. Using crossmodal classification, we also searched for brain regions that would represent objects in a similar fashion across different modalities of presentation. We trained a classifier to distinguish objects presented in one modality and then tested it on the same objects presented in a different modality. We detected audiovisual invariance in the right temporo‐occipital junction, audiotactile invariance in the left postcentral gyrus and parietal operculum, and visuotactile invariance in the right postcentral and supramarginal gyri. Our maps of multisensory convergence and crossmodal generalization reveal the underlying organization of the association cortices, and may be related to the neural basis for mental concepts. Hum Brain Mapp 36:3629–3640, 2015. © 2015 Wiley Periodicals, Inc. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|