| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
University of Oxford
University College London
Speech is perceived both by ear and by eye. Unlike heard speech, some seen speech gestures can be captured in stilled image sequences. Previous studies have shown that in hearing people, natural time-varying silent seen speech can access the auditory cortex (left superior temporal regions). Using functional magnetic resonance imaging (fMRI), the present study explored the extent to which this circuitry was activated when seen speech was deprived of its time-varying characteristics.
In the scanner, hearing participants were instructed to look for a prespecified visible speech target sequence ("voo" or "ahv") among other monosyllables. In one condition, the image sequence comprised a series of stilled key frames showing apical gestures (e.g., separate frames for "v" and "oo" [from the target] or "ee" and "m" [i.e., from nontarget syllables]). In the other condition, natural speech movement of the same overall segment duration was seen.
In contrast to a baseline condition in which the letter "V" was superimposed on a resting face, stilled speech face images generated activation in posterior cortical regions associated with the perception of biological movement, despite the lack of apparent movement in the speech image sequence. Activation was also detected in traditional speech-processing regions including the left inferior frontal (Broca's) area, left superior temporal sulcus (STS), and left supramarginal gyrus (the dorsal aspect of Wernicke's area). Stilled speech sequences also generated activation in the ventral premotor cortex and anterior inferior parietal sulcus bilaterally.
Moving faces generated significantly greater cortical activation than stilled face sequences, and in similar regions. However, a number of differences between stilled and moving speech were also observed. In the visual cortex, stilled faces generated relatively more activation in primary visual regions (V1/V2), while visual movement areas (V5/MT+) were activated to a greater extent by moving faces. Cortical regions activated more by naturally moving speaking faces included the auditory cortex (Brodmann's Areas 41/42; lateral parts of Heschl's gyrus) and the left STS and inferior frontal gyrus.
Seen speech with normal time-varying characteristics appears to have preferential access to "purely" auditory processing regions specialized for language, possibly via acquired dynamic audiovisual integration mechanisms in STS. When seen speech lacks natural time-varying characteristics, access to speech-processing systems in the left temporal lobe may be achieved predominantly via action-based speech representations, realized in the ventral premotor cortex.
Key Words: Speech reading • biological movement • superior temporal sulcus • speech processing • ventral premotor cortex • intraparietal sulcus
This article has been cited by other articles:
|
|
 |
|
  C. Kayser, C. I. Petkov, and N. K. Logothetis Visual Modulation of Neurons in Auditory Cortex Cereb Cortex, July 1, 2008; 18(7): 1560 - 1574. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. F. Alpert, G. Hein, N. Tsai, M. J. Naumer, and R. T. Knight Temporal Characteristics of Audiovisual Information Processing J. Neurosci., May 14, 2008; 28(20): 5344 - 5349. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. A. Ghazanfar, C. Chandrasekaran, and N. K. Logothetis Interactions between the Superior Temporal Sulcus and Auditory Cortex Mediate Dynamic Face/Voice Integration in Rhesus Monkeys J. Neurosci., April 23, 2008; 28(17): 4457 - 4469. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Dayan, A. Casile, N. Levit-Binnun, M. A. Giese, T. Hendler, and T. Flash Neural representations of kinematic laws of motion: Evidence for action-perception coupling PNAS, December 18, 2007; 104(51): 20582 - 20587. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. J. Stekelenburg and J. Vroomen Neural correlates of multisensory integration of ecologically valid audiovisual events. J. Cogn. Neurosci., December 1, 2007; 19(12): 1964 - 1973. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H.-J. Lee, E. Truy, G. Mamou, D. Sappey-Marinier, and A.-L. Giraud Visual speech circuits in profound acquired deafness: a possible role for latent multimodal connectivity Brain, November 1, 2007; 130(11): 2929 - 2941. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. I. Skipper, V. van Wassenhove, H. C. Nusbaum, and S. L. Small Hearing Lips and Seeing Voices: How Cortical Areas Supporting Speech Production Mediate Audiovisual Speech Perception Cereb Cortex, October 1, 2007; 17(10): 2387 - 2399. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. A. Ross, D. Saint-Amour, V. M. Leavitt, D. C. Javitt, and J. J. Foxe Do You See What I Am Saying? Exploring Visual Enhancement of Speech Comprehension in Noisy Environments Cereb Cortex, May 1, 2007; 17(5): 1147 - 1153. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Kayser, C. I. Petkov, M. Augath, and N. K. Logothetis Functional Imaging Reveals Visual Modulation of Specific Fields in Auditory Cortex J. Neurosci., February 21, 2007; 27(8): 1824 - 1835. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. R. Atkinson The Perceptual Characteristics of Voice-Hallucinations in Deaf People: Insights into the Nature of Subvocal Thought and Sensory Feedback Loops Schizophr Bull, October 1, 2006; 32(4): 701 - 708. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. A. Pelphrey, J. P. Morris, C. R. Michelich, T. Allison, and G. McCarthy Functional Anatomy of Biological Motion Perception in Posterior Temporal Cortex: An fMRI Study of Eye, Mouth and Hand Movements Cereb Cortex, December 1, 2005; 15(12): 1866 - 1876. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N. Sadato, T. Okada, M. Honda, K.-I. Matsuki, M. Yoshida, K.-I. Kashikura, W. Takei, T. Sato, T. Kochiyama, and Y. Yonekura Cross-modal integration and plastic changes revealed by lip movement, random-dot motion and sign languages in the hearing and deaf Cereb Cortex, August 1, 2005; 15(8): 1113 - 1122. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. A. Hall, C. Fussell, and A. Q. Summerfield Reading Fluent Speech from Talking Faces: Typical Brain Networks and Individual Differences J. Cogn. Neurosci., June 1, 2005; 17(6): 939 - 953. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Kaiser, I. Hertrich, H. Ackermann, K. Mathiak, and W. Lutzenberger Hearing Lips: Gamma-band Activity During Audiovisual Speech Perception Cereb Cortex, May 1, 2005; 15(5): 646 - 653. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. E. Callan, J. A. Jones, K. Munhall, C. Kroos, A. M. Callan, and E. Vatikiotis-Bateson Multisensory Integration Sites Identified by Perception of Spatial Wavelet Filtered Visual Speech Gesture Information J. Cogn. Neurosci., June 1, 2004; 16(5): 805 - 816. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
G. Buccino, F. Lui, N. Canessa, I. Patteri, G. Lagravinese, F. Benuzzi, C. A. Porro, and G. Rizzolatti Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study J. Cogn. Neurosci., January 1, 2004; 16(1): 114 - 126. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Paulesu, D. Perani, V. Blasi, G. Silani, N. A. Borghese, U. De Giovanni, S. Sensolo, and F. Fazio A Functional-Anatomical Model for Lipreading J Neurophysiol, September 1, 2003; 90(3): 2005 - 2013. [Abstract] [Full Text] [PDF]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| NEURAL COMPUTATION | J COGNITIVE NEUROSCIENCE | MIT PRESS JOURNALS |
