|
|
||||||||
RIKEN Brain Science Institute, Saitama, Japan
ERATO, JST and ATR International, Japan
Juntendo University, Japan
Experimental studies have suggested that many brain areas, including the basal ganglia (BG), contribute to procedural learning. Focusing on the basal gangliathalamocortical (BGTC) system, we propose a computational model to explain how different brain areas work together in procedural learning. The BGTC system is composed of multiple separate loop circuits. According to our model, two separate BGTC loops learn a visuomotor sequence concurrently but using different coordinates, one visual, and the other motor. The visual loop includes the dorsolateral prefrontal (DLPF) cortex and the anterior part of the BG, while the motor loop includes the supplementary motor area (SMA) and the posterior BG. The concurrent learning in these loops is based on reinforcement signals carried by dopaminergic (DA) neurons that project divergently to the anterior ("visual") and posterior ("motor") parts of the striatum. It is expected, however, that the visual loop learns a sequence faster than the motor loop due to their different coordinates. The difference in learning speed may lead to inconsistent outputs from the visual and motor loops, and this problem is solved by a mechanism called a "coordinator," which adjusts the contribution of the visual and motor loops to a final motor output. The coordinator is assumed to be in the presupplementary motor area (pre-SMA). We hypothesize that the visual and motor loops, with the help of the coordinator, achieve both the quick acquisition of novel sequences and the robust execution of well-learned sequences. A computational model based on the hypothesis is examined in a series of computer simulations, referring to the results of the 2 x 5 task experiments that have been used on both monkeys and humans. We found that the dual mechanism with the coordinator was superior to the single (visual or motor) mechanism. The model replicated the following essential features of the experimental results: (1) the time course of learning, (2) the effect of opposite hand use, (3) the effect of sequence reversal, and (4) the effects of localized brain inactivations. Our model may account for a common feature of procedural learning: A spatial sequence of discrete actions (subserved by the visual loop) is gradually replaced by a robust motor skill (subserved by the motor loop).
This article has been cited by other articles:
![]() |
B. W. BALLEINE and S. B. OSTLUND Still at the Choice-Point: Action Selection and Initiation in Instrumental Conditioning Ann. N.Y. Acad. Sci., May 1, 2007; 1104(1): 147 - 171. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. Hikosaka, K. Nakamura, and H. Nakahara Basal Ganglia Orient Eyes to Reward J Neurophysiol, February 1, 2006; 95(2): 567 - 584. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Floyer-Lea and P. M. Matthews Distinguishable Brain Activation Networks for Short- and Long-Term Motor Skill Learning J Neurophysiol, July 1, 2005; 94(1): 512 - 518. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. A. Boettiger and M. D'Esposito Frontal Networks for Learning and Executing Arbitrary Stimulus-Response Associations J. Neurosci., March 9, 2005; 25(10): 2723 - 2732. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Capi and K. Doya Evolution of Neural Architecture Fitting Environmental Dynamics Adaptive Behavior, March 1, 2005; 13(1): 53 - 66. [Abstract] [PDF] |
||||
![]() |
R. C. O'Reilly and M. J. Frank Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia Neural Comput., February 1, 2005; 18(2): 283 - 328. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. M. Roth, L. A. Flashman, A. J. Saykin, T. W. McAllister, and R. Vidaver Apathy in Schizophrenia: Reduced Frontal Lobe Volume and Neuropsychological Deficits Am J Psychiatry, January 1, 2004; 161(1): 157 - 159. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Bischoff-Grethe, K. M. Goedert, D. T. Willingham, and S. T. Grafton Neural Substrates of Response-based Sequence Learning using fMRI J. Cogn. Neurosci., January 1, 2004; 16(1): 127 - 138. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. K. Goerendt, C. Messa, A. D. Lawrence, P. M. Grasby, P. Piccini, and D. J. Brooks Dopamine release during sequential finger movements in health and Parkinson's disease: a PET study Brain, February 1, 2003; 126(2): 312 - 325. [Abstract] [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| NEURAL COMPUTATION | J COGNITIVE NEUROSCIENCE | MIT PRESS JOURNALS |