|
|
||||||||
MRC Institute of Hearing Research, Nottingham, UK
Reprint request should be sent to Deborah A. Hall, MRC Institute of Hearing Research, University Park, Nottingham, NG7 2RD, UK, or via e-mail: d.hall{at}ihr.mrc.ac.uk.
Listeners are able to extract important linguistic information by viewing the talker's facea process known as "speechreading." Previous studies of speechreading present small closed sets of simple words and their results indicate that visual speech processing engages a wide network of brain regions in the temporal, frontal, and parietal lobes that are likely to underlie multiple stages of the receptive language system. The present study further explored this network in a large group of subjects by presenting naturally spoken sentences which tap the richer complexities of visual speech processing. Four different baselines (blank screen, static face, nonlinguistic facial gurning, and auditory speech) enabled us to determine the hierarchy of neural processing involved in speechreading and to test the claim that visual input reliably accesses sound-based representations in the auditory cortex.
In contrast to passively viewing a blank screen, the static-face condition evoked activation bilaterally across the border of the fusiform gyrus and cerebellum, and in the medial superior frontal gyrus and left precentral gyrus (p < .05, whole brain corrected). With the static face as baseline, the gurning face evoked bilateral activation in the motion-sensitive region of the occipital cortex, whereas visual speech additionally engaged the middle temporal gyrus, inferior and middle frontal gyri, and the inferior parietal lobe, particularly in the left hemisphere. These latter regions are implicated in lexical stages of spoken language processing. Although auditory speech generated extensive bilateral activation across both superior and middle temporal gyri, the group-averaged pattern of speechreading activation failed to include any auditory regions along the superior temporal gyrus, suggesting that fluent visual speech does not always involve sound-based coding of the visual input.
An important finding from the individual subject analyses was that activation in the superior temporal gyrus did reach significance (p < .001, small-volume corrected) for a subset of the group. Moreover, the extent of the left-sided superior temporal gyrus activity was strongly correlated with speechreading performance. Skilled speechreading was also associated with activations and deactivations in other brain regions, suggesting that individual differences reflect the efficiency of a circuit linking sensory, perceptual, memory, cognitive, and linguistic processes rather than the operation of a single component process.
This article has been cited by other articles:
![]() |
K. L. Roberts and D. A. Hall Examining a supramodal network for conflict processing: a systematic review and novel functional magnetic resonance imaging data for related visual and auditory stroop tasks. J. Cogn. Neurosci., June 1, 2008; 20(6): 1063 - 1078. [Abstract] [Full Text] [PDF] |
||||
![]() |
H.-J. Lee, E. Truy, G. Mamou, D. Sappey-Marinier, and A.-L. Giraud Visual speech circuits in profound acquired deafness: a possible role for latent multimodal connectivity Brain, November 1, 2007; 130(11): 2929 - 2941. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. T. Auer Jr. and L. E. Bernstein Enhanced Visual Speech Perception in Individuals With Early-Onset Hearing Impairment J Speech Lang Hear Res, October 1, 2007; 50(5): 1157 - 1165. [Abstract] [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| NEURAL COMPUTATION | J COGNITIVE NEUROSCIENCE | MIT PRESS JOURNALS |