The Journal of Cognitive Neuroscience, Vol 10, 108-121, Copyright © 1998 by The MIT Press

ARTICLES

A Computational Model of How the Basal Ganglia Produce Sequences

Gregory S. Berns and Terrence J. Sejnowski

We propose a systems-level computational model of the basal ganglia based closely on known anatomy and physiology. First, we assume that the thalamic targets, which relay ascending information to cortical action and planning areas, are tonically inhibited by the basal ganglia. Second, we assume that the output stage of the basal ganglia, the internal segment of the globus pallidus (GPi), selects a single action from several competing actions via lateral interactions. Third, we propose that a form of local working memory exists in the form of reciprocal connections between the external globus pallidus (GPe) and the subthalamic nucleus (STN). As a test of the model, the system was trained to learn a sequence of states that required the context of previous actions. The striatum, which was assumed to represent a conjunction of cortical states, directly selected the action in the GP during training. The STN-to-GP connection strengths were modified by an associative learning rule and came to encode the sequence after 20 to 40 iterations through the sequence. Subsequently, the system automatically reproduced the sequence when cued to the first action. The behavior of the model was found to be sensitive to the ratio of the striatal-nigral learning rate to the STN-GP learning rate. Additionally, the degree of striatal inhibition of the globus pallidus had a significant influence on both learning and the ability to select an action. Low learning rates, which would be hypothesized to reflect low levels of dopamine, as in Parkinson's disease, led to slow acquisition of contextual information. However, this could be partially offset by modeling a lesion of the globus pallidus that resulted in an increase in the gain of the STN units. The parameter sensitivity of the model is discussed within the framework of existing behavioral and lesion data.

This article has been cited by other articles:

				M. D. Humphries, R. D. Stewart, and K. N. Gurney A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Ganglia J. Neurosci., December 13, 2006; 26(50): 12921 - 12942. [Abstract] [Full Text] [PDF]

				W. R. Marchand and V. Dilda New Models of Frontal-Subcortical Skeletomotor Circuit Pathology in Tardive Dyskinesia Neuroscientist, June 1, 2006; 12(3): 186 - 198. [Abstract] [PDF]

				F. Worgotter and B. Porr Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms Neural Comput., February 1, 2005; 17(2): 245 - 319. [Abstract] [Full Text] [PDF]

				H. J. Aizenstein, V. A. Stenger, J. Cochran, K. Clark, M. Johnson, R. D. Nebes, and C. S. Carter Regional Brain Activation during Concurrent Implicit and Explicit Sequence Learning Cereb Cortex, February 1, 2004; 14(2): 199 - 208. [Abstract] [Full Text] [PDF]

				L. L. Rubchinsky, N. Kopell, and K. A. Sigvardt Modeling facilitation and inhibition of competing motor programs in basal ganglia subthalamic nucleus-pallidal circuits PNAS, November 25, 2003; 100(24): 14427 - 14432. [Abstract] [Full Text] [PDF]

				I. Bar-Gad, G. Heimer, Y.'a. Ritov, and H. Bergman Functional Correlations between Neighboring Neurons in the Primate Globus Pallidus Are Weak or Nonexistent J. Neurosci., May 15, 2003; 23(10): 4012 - 4016. [Abstract] [Full Text] [PDF]

				I. K. Goerendt, C. Messa, A. D. Lawrence, P. M. Grasby, P. Piccini, and D. J. Brooks Dopamine release during sequential finger movements in health and Parkinson's disease: a PET study Brain, February 1, 2003; 126(2): 312 - 325. [Abstract] [Full Text] [PDF]

				M. J. Tunstall, D. E. Oorschot, A. Kean, and J. R. Wickens Inhibitory Interactions Between Spiny Projection Neurons in the Rat Striatum J Neurophysiol, September 1, 2002; 88(3): 1263 - 1269. [Abstract] [Full Text] [PDF]

				J. E. Hanson and D. Jaeger Short-Term Plasticity Shapes the Response to Simulated Normal and Parkinsonian Input Patterns in the Globus Pallidus J. Neurosci., June 15, 2002; 22(12): 5164 - 5172. [Abstract] [Full Text] [PDF]

				H. Nakahara, S.-i. Amari, and O. Hikosaka Self-Organization in the Basal Ganglia with Modulation of Reinforcement Signals Neural Comput., April 1, 2002; 14(4): 819 - 844. [Abstract] [Full Text] [PDF]

				A. Bischoff-Grethe, M. Martin, H. Mao, and G. S. Berns The Context of Uncertainty Modulates the Subcortical Response to Predictability J. Cogn. Neurosci., October 1, 2001; 13(7): 986 - 993. [Abstract] [Full Text] [PDF]

				G. S. Berns, S. M. McClure, G. Pagnoni, and P. R. Montague Predictability Modulates Human Brain Response to Reward J. Neurosci., April 15, 2001; 21(8): 2793 - 2798. [Abstract] [Full Text] [PDF]

				A. S. Dave and D. Margoliash Song Replay During Sleep and Computational Rules for Sensorimotor Vocal Learning Science, October 27, 2000; 290(5492): 812 - 816. [Abstract] [Full Text]

				A. D. Lawrence, L. H. A. Watkins, B. J. Sahakian, J. R. Hodges, and T. W. Robbins Visual object and visuospatial cognition in Huntington's disease: implications for information processing in corticostriatal circuits Brain, July 1, 2000; 123(7): 1349 - 1364. [Abstract] [Full Text] [PDF]

				O. Hikosaka, Y. Takikawa, and R. Kawagoe Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements Physiol Rev, July 1, 2000; 80(3): 953 - 978. [Abstract] [Full Text] [PDF]

				J. Brown, D. Bullock, and S. Grossberg How the Basal Ganglia Use Parallel Excitatory and Inhibitory Learning Pathways to Selectively Respond to Unexpected Rewarding Cues J. Neurosci., December 1, 1999; 19(23): 10502 - 10511. [Abstract] [Full Text] [PDF]

				M. Luo and D. J. Perkel A GABAergic, Strongly Inhibitory Projection to a Thalamic Nucleus in the Zebra Finch Song System J. Neurosci., August 1, 1999; 19(15): 6700 - 6711. [Abstract] [Full Text] [PDF]