J. Cogn. Neurosci.
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Teder-Sälejärvi, W. A.
Right arrow Articles by Hillyard, S. A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Teder-Sälejärvi, W. A.
Right arrow Articles by Hillyard, S. A.
(Journal of Cognitive Neuroscience. 2005;17:1396-1409.)
© 2005 The MIT Press

Effects of Spatial Congruity on Audio-Visual Multimodal Integration

W. A. Teder-Sälejärvi1, F. Di Russo2, J. J. McDonald3 and S. A. Hillyard1

1 University of California—San Diego, 2 University Institute of Motor Sciences (IUSM) and Santa Lucia Foundation IRCCS, Rome, Italy, 3 Simon Fraser University, Vancouver, Canada

Reprint requests should be sent to Steven A. Hillyard, University of California, San Diego, Department of Neurosciences 0608, School of Medicine, La Jolla, CA 92093–0608, USA, or via e-mail: wat{at}sdepl.ucsd.edu.

Spatial constraints on multisensory integration of auditory (A) and visual (V) stimuli were investigated in humans using behavioral and electrophysiological measures. The aim was to find out whether cross-modal interactions between A and V stimuli depend on their spatial congruity, as has been found for multisensory neurons in animal studies (Stein & Meredith, 1993). Randomized sequences of unimodal (A or V) and simultaneous bimodal (AV) stimuli were presented to right- or left-field locations while subjects made speeded responses to infrequent targets of greater intensity that occurred in either or both modalities. Behavioral responses to the bimodal stimuli were faster and more accurate than to the unimodal stimuli for both same-location and different-location AV pairings. The neural basis of this cross-modal facilitation was studied by comparing event-related potentials (ERPs) to the bimodal AV stimuli with the summed ERPs to the unimodal A and V stimuli. These comparisons revealed neural interactions localized to the ventral occipito-temporal cortex (at 190 msec) and to the superior temporal cortical areas (at 260 msec) for both same- and different-location AV pairings. In contrast, ERP interactions that differed according to spatial congruity included a phase and amplitude modulation of visual-evoked activity localized to the ventral occipito-temporal cortex at 100–400 msec and an amplitude modulation of activity localized to the superior temporal region at 260–280 msec. These results demonstrate overlapping but distinctive patterns of multisensory integration for spatially congruent and incongruent AV stimuli.




This article has been cited by other articles:


Home page
Percept PsychophysHome page
M. KEETELS and J. VROOMEN
Tactile-visual temporal ventriloquism: No effect of spatial disparity
Percept Psychophys, July 1, 2008; 70(5): 765 - 771.
[Abstract] [PDF]


Home page
J. Neurosci.Home page
G. F. Alpert, G. Hein, N. Tsai, M. J. Naumer, and R. T. Knight
Temporal Characteristics of Audiovisual Information Processing
J. Neurosci., May 14, 2008; 28(20): 5344 - 5349.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
J. Mishra, A. Martinez, T. J. Sejnowski, and S. A. Hillyard
Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion
J. Neurosci., April 11, 2007; 27(15): 4120 - 4131.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
D. Talsma, T. J. Doty, and M. G. Woldorff
Selective Attention and Audiovisual Integration: Is Attending to Both Modalities a Prerequisite for Early Integration?
Cereb Cortex, March 1, 2007; 17(3): 679 - 690.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
C. Kayser, C. I. Petkov, M. Augath, and N. K. Logothetis
Functional Imaging Reveals Visual Modulation of Specific Fields in Auditory Cortex
J. Neurosci., February 21, 2007; 27(8): 1824 - 1835.
[Abstract] [Full Text] [PDF]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
NEURAL COMPUTATION J COGNITIVE NEUROSCIENCE MIT PRESS JOURNALS
Copyright © 2005 by The MIT Press.