Basal ganglia orient eyes to reward

被引:272
作者
Hikosaka, O [1 ]
Nakamura, K
Nakahara, H
机构
[1] NEI, Lab Sensorimotor Res, NIH, Bethesda, MD 20892 USA
[2] RIKEN, Lab Math Neurosci, Brain Res Inst, Saitama, Japan
关键词
D O I
10.1152/jn.00458.2005
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Basal ganglia orient eyes to reward. J Neurophysiol 95: 567-584, 2006. doi: 10.1152/jn. 00458.2005. Expectation of reward motivates our behaviors and influences our decisions. Indeed, neuronal activity in many brain areas is modulated by expected reward. However, it is still unclear where and how the reward-dependent modulation of neuronal activity occurs and how the reward-modulated signal is transformed into motor outputs. Recent studies suggest an important role of the basal ganglia. Sensorimotor/cognitive activities of neurons in the basal ganglia are strongly modulated by expected reward. Through their abundant outputs to the brain stem motor areas and the thalamocortical circuits, the basal ganglia appear capable of producing body movements based on expected reward. A good behavioral measure to test this hypothesis is saccadic eye movement because its brain stem mechanism has been extensively studied. Studies from our laboratory suggest that the basal ganglia play a key role in guiding the gaze to the location where reward is available. Neurons in the caudate nucleus and the substantia nigra pars reticulata are extremely sensitive to the positional difference in expected reward, which leads to a bias in excitability between the superior colliculi such that the saccade to the to-be-rewarded position occurs more quickly. It is suggested that the reward modulation occurs in the caudate where cortical inputs carrying spatial signals and dopaminergic inputs carrying reward-related signals are integrated. These data support a specific form of reinforcement learning theories, but also suggest further refinement of the theory.
引用
收藏
页码:567 / 584
页数:18
相关论文
共 205 条
[1]   PARALLEL ORGANIZATION OF FUNCTIONALLY SEGREGATED CIRCUITS LINKING BASAL GANGLIA AND CORTEX [J].
ALEXANDER, GE ;
DELONG, MR ;
STRICK, PL .
ANNUAL REVIEW OF NEUROSCIENCE, 1986, 9 :357-381
[2]  
[Anonymous], 1995, MODELS INFORM PROCES
[3]   Goal-directed instrumental action: contingency and incentive learning and their cortical substrates [J].
Balleine, BW ;
Dickinson, A .
NEUROPHARMACOLOGY, 1998, 37 (4-5) :407-419
[4]   Prefrontal cortex and decision making in a mixed-strategy game [J].
Barraclough, DJ ;
Conroy, ML ;
Lee, D .
NATURE NEUROSCIENCE, 2004, 7 (04) :404-410
[5]  
Barto AG., 1995, Models of information processing in the basal ganglia, P215
[6]  
Barto Andrew G., 1994, Current Opinion in Neurobiology, V4, P888, DOI 10.1016/0959-4388(94)90138-4
[7]   The amygdala and reward [J].
Baxter, MG ;
Murray, EA .
NATURE REVIEWS NEUROSCIENCE, 2002, 3 (07) :563-573
[8]  
BECKSTEAD RM, 1981, J NEUROSCI, V1, P121
[9]   Addiction, dopamine, and the molecular mechanisms of memory [J].
Berke, JD ;
Hyman, SE .
NEURON, 2000, 25 (03) :515-532
[10]   Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards [J].
Bowman, EM ;
Aigner, TG ;
Richmond, BJ .
JOURNAL OF NEUROPHYSIOLOGY, 1996, 75 (03) :1061-1073