J. Cogn. Neurosci.
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Hall, D. A.
Right arrow Articles by Summerfield, A. Q.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Hall, D. A.
Right arrow Articles by Summerfield, A. Q.
(Journal of Cognitive Neuroscience. 2005;17:939-953.)
© 2005 The MIT Press

Reading Fluent Speech from Talking Faces: Typical Brain Networks and Individual Differences

Deborah A. Hall, Clayton Fussell and A. Quentin Summerfield

MRC Institute of Hearing Research, Nottingham, UK

Reprint request should be sent to Deborah A. Hall, MRC Institute of Hearing Research, University Park, Nottingham, NG7 2RD, UK, or via e-mail: d.hall{at}ihr.mrc.ac.uk.

Listeners are able to extract important linguistic information by viewing the talker's face—a process known as "speechreading." Previous studies of speechreading present small closed sets of simple words and their results indicate that visual speech processing engages a wide network of brain regions in the temporal, frontal, and parietal lobes that are likely to underlie multiple stages of the receptive language system. The present study further explored this network in a large group of subjects by presenting naturally spoken sentences which tap the richer complexities of visual speech processing. Four different baselines (blank screen, static face, nonlinguistic facial gurning, and auditory speech) enabled us to determine the hierarchy of neural processing involved in speechreading and to test the claim that visual input reliably accesses sound-based representations in the auditory cortex.

In contrast to passively viewing a blank screen, the static-face condition evoked activation bilaterally across the border of the fusiform gyrus and cerebellum, and in the medial superior frontal gyrus and left precentral gyrus (p < .05, whole brain corrected). With the static face as baseline, the gurning face evoked bilateral activation in the motion-sensitive region of the occipital cortex, whereas visual speech additionally engaged the middle temporal gyrus, inferior and middle frontal gyri, and the inferior parietal lobe, particularly in the left hemisphere. These latter regions are implicated in lexical stages of spoken language processing. Although auditory speech generated extensive bilateral activation across both superior and middle temporal gyri, the group-averaged pattern of speechreading activation failed to include any auditory regions along the superior temporal gyrus, suggesting that fluent visual speech does not always involve sound-based coding of the visual input.

An important finding from the individual subject analyses was that activation in the superior temporal gyrus did reach significance (p < .001, small-volume corrected) for a subset of the group. Moreover, the extent of the left-sided superior temporal gyrus activity was strongly correlated with speechreading performance. Skilled speechreading was also associated with activations and deactivations in other brain regions, suggesting that individual differences reflect the efficiency of a circuit linking sensory, perceptual, memory, cognitive, and linguistic processes rather than the operation of a single component process.




This article has been cited by other articles:


Home page
J. Cogn. Neurosci.Home page
K. L. Roberts and D. A. Hall
Examining a supramodal network for conflict processing: a systematic review and novel functional magnetic resonance imaging data for related visual and auditory stroop tasks.
J. Cogn. Neurosci., June 1, 2008; 20(6): 1063 - 1078.
[Abstract] [Full Text] [PDF]


Home page
BrainHome page
H.-J. Lee, E. Truy, G. Mamou, D. Sappey-Marinier, and A.-L. Giraud
Visual speech circuits in profound acquired deafness: a possible role for latent multimodal connectivity
Brain, November 1, 2007; 130(11): 2929 - 2941.
[Abstract] [Full Text] [PDF]


Home page
JSLHRHome page
E. T. Auer Jr. and L. E. Bernstein
Enhanced Visual Speech Perception in Individuals With Early-Onset Hearing Impairment
J Speech Lang Hear Res, October 1, 2007; 50(5): 1157 - 1165.
[Abstract] [Full Text] [PDF]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
NEURAL COMPUTATION J COGNITIVE NEUROSCIENCE MIT PRESS JOURNALS
Copyright © 2005 by The MIT Press.