J. Cogn. Neurosci.
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Barraclough, N. E.
Right arrow Articles by Perrett, D. I.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Barraclough, N. E.
Right arrow Articles by Perrett, D. I.
(Journal of Cognitive Neuroscience. 2005;17:377-391.)
© 2005 The MIT Press

Integration of Visual and Auditory Information by Superior Temporal Sulcus Neurons Responsive to the Sight of Actions

Nick E. Barraclough1,*, Dengke Xiao1,*, Chris I. Baker2, Mike W. Oram1 and David I. Perrett1

1 University of St Andrews, Scotland
2 Massachusetts Institute of Technology

Processing of complex visual stimuli comprising facial movements, hand actions, and body movements is known to occur in the superior temporal sulcus (STS) of humans and nonhuman primates. The STS is also thought to play a role in the integration of multimodal sensory input. We investigated whether STS neurons coding the sight of actions also integrated the sound of those actions. For 23% of neurons responsive to the sight of an action, the sound of that action significantly modulated the visual response. The sound of the action increased or decreased the visually evoked response for an equal number of neurons. In the neurons whose visual response was increased by the addition of sound (but not those neurons whose responses were decreased), the audiovisual integration was dependent upon the sound of the action matching the sight of the action. These results suggest that neurons in the STS form multisensory representations of observed actions.




This article has been cited by other articles:


Home page
Cereb CortexHome page
B. L. Allman, R. E. Bittencourt-Navarrete, L. P. Keniston, A. E. Medina, M. Y. Wang, and M. A. Meredith
Do Cross-Modal Projections Always Result in Multisensory Integration?
Cereb Cortex, September 1, 2008; 18(9): 2066 - 2076.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
J. Vangeneugden, F. Pollick, and R. Vogels
Functional Differentiation of Macaque Visual Temporal Cortical Neurons Using a Parametric Action Space
Cereb Cortex, July 16, 2008; (2008) bhn109v1.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
B. N. Carriere, D. W. Royal, and M. T. Wallace
Spatial Heterogeneity of Cortical Receptive Fields and Its Impact on Multisensory Interactions
J Neurophysiol, May 1, 2008; 99(5): 2357 - 2368.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
A. A. Ghazanfar, C. Chandrasekaran, and N. K. Logothetis
Interactions between the Superior Temporal Sulcus and Auditory Cortex Mediate Dynamic Face/Voice Integration in Rhesus Monkeys
J. Neurosci., April 23, 2008; 28(17): 4457 - 4469.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
U. Noppeney, O. Josephs, J. Hocking, C. J. Price, and K. J. Friston
The Effect of Prior Visual Information on Recognition of Speech and Sounds
Cereb Cortex, March 1, 2008; 18(3): 598 - 609.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
D. R. Bach, H. Schachinger, J. G. Neuhoff, F. Esposito, F. D. Salle, C. Lehmann, M. Herdener, K. Scheffler, and E. Seifritz
Rising Sound Intensity: An Intrinsic Warning Cue Activating the Amygdala
Cereb Cortex, January 1, 2008; 18(1): 145 - 150.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
T. Noesselt, J. W. Rieger, M. A. Schoenfeld, M. Kanowski, H. Hinrichs, H.-J. Heinze, and J. Driver
Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices
J. Neurosci., October 17, 2007; 27(42): 11431 - 11441.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
L. M. Romanski
Representation and Integration of Auditory and Visual Stimuli in the Primate Ventral Lateral Prefrontal Cortex
Cereb Cortex, September 1, 2007; 17(suppl_1): i61 - i69.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
G. Hein, O. Doehrmann, N. G. Muller, J. Kaiser, L. Muckli, and M. J. Naumer
Object Familiarity and Semantic Congruency Modulate Responses in Cortical Audiovisual Integration Areas
J. Neurosci., July 25, 2007; 27(30): 7881 - 7887.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
M. Avillac, S. Ben Hamed, and J.-R. Duhamel
Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey
J. Neurosci., February 21, 2007; 27(8): 1922 - 1932.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
K. Kuraoka and K. Nakamura
Responses of Single Neurons in Monkey Amygdala to Facial and Vocal Emotions
J Neurophysiol, February 1, 2007; 97(2): 1379 - 1387.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
T. Sugihara, M. D. Diltz, B. B. Averbeck, and L. M. Romanski
Integration of Auditory and Visual Communication Information in the Primate Ventrolateral Prefrontal Cortex
J. Neurosci., October 25, 2006; 26(43): 11138 - 11147.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
A. A. Ghazanfar, J. X. Maier, K. L. Hoffman, and N. K. Logothetis
Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex
J. Neurosci., May 18, 2005; 25(20): 5004 - 5012.
[Abstract] [Full Text] [PDF]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
NEURAL COMPUTATION J COGNITIVE NEUROSCIENCE MIT PRESS JOURNALS
Copyright © 2005 by The MIT Press.