The role of ventral frontostriatal circuitry in reward-based learning in humans

被引:166
作者
Galvan, A
Hare, TA
Davidson, M
Spicer, J
Glover, G
Casey, BJ
机构
[1] Cornell Univ, Weill Med Coll, Sackler Inst, New York, NY 10021 USA
[2] Stanford Univ, Ctr Adv Magnet Resonance Technol, Dept Radiol & Neurosci Program, Stanford, CA 94305 USA
关键词
reward; learning; basal ganglia; nucleus accumbens; orbital frontal cortex; thalamocortical circuitry; fMRI;
D O I
10.1523/JNEUROSCI.2431-05.2005
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
This study examined changes in behavior and neural activity with reward learning. Using an event-related functional magnetic resonance imaging paradigm, we show that the nucleus accumbens, thalamus, and orbital frontal cortex are each sensitive to reward magnitude, with the accumbens showing the greatest discrimination between reward values. Mean reaction times were significantly faster to cues predicting the greatest reward and slower to cues predicting the smallest reward. This behavioral change over the course of the experiment was paralleled by a shift in peak in accumbens activity from anticipation of the reward ( immediately after the response), to the cue predicting the reward. The orbitofrontal and thalamic regions peaked in anticipation of the reward throughout the experiment. Our findings suggest discrete functions of regions within basal ganglia thalamocortical circuitry in adjusting behavior to maximize reward.
引用
收藏
页码:8650 / 8656
页数:7
相关论文
共 52 条
[1]   PARALLEL ORGANIZATION OF FUNCTIONALLY SEGREGATED CIRCUITS LINKING BASAL GANGLIA AND CORTEX [J].
ALEXANDER, GE ;
DELONG, MR ;
STRICK, PL .
ANNUAL REVIEW OF NEUROSCIENCE, 1986, 9 :357-381
[2]   Contributions of the hippocampus and the striatum to simple association and frequency-based learning [J].
Amso, D ;
Davidson, MC ;
Johnson, SP ;
Glover, G ;
Casey, BJ .
NEUROIMAGE, 2005, 27 (02) :291-298
[3]   Predictability modulates human brain response to reward [J].
Berns, GS ;
McClure, SM ;
Pagnoni, G ;
Montague, PR .
JOURNAL OF NEUROSCIENCE, 2001, 21 (08) :2793-2798
[4]   Incentive-elicited brain activation in adolescents: Similarities and differences from young adults [J].
Bjork, JM ;
Knutson, B ;
Fong, GW ;
Caggiano, DM ;
Bennett, SM ;
Hommer, DW .
JOURNAL OF NEUROSCIENCE, 2004, 24 (08) :1793-1802
[5]   Linear systems analysis of functional magnetic resonance imaging in human V1 [J].
Boynton, GM ;
Engel, SA ;
Glover, GH ;
Heeger, DJ .
JOURNAL OF NEUROSCIENCE, 1996, 16 (13) :4207-4221
[6]   Acute effects of cocaine on human brain activity and emotion [J].
Breiter, HC ;
Gollub, RL ;
Weisskoff, RM ;
Kennedy, DN ;
Makris, N ;
Berke, JD ;
Goodman, JM ;
Kantor, HL ;
Gastfriend, DR ;
Riorden, JP ;
Mathew, RT ;
Rosen, BR ;
Hyman, SE .
NEURON, 1997, 19 (03) :591-611
[7]   Effects of expectations for different reward magnitudes on neuronal activity in primate striatum [J].
Cromwell, HC ;
Schultz, W .
JOURNAL OF NEUROPHYSIOLOGY, 2003, 89 (05) :2823-2838
[8]   Human verbal working memory impairments associated with thalamic damage [J].
Dagenbach, D ;
Kubat-Silman, AK ;
Absher, JR .
INTERNATIONAL JOURNAL OF NEUROSCIENCE, 2001, 111 (1-2) :67-87
[9]   Differential cingulate and caudate activation following unexpected nonrewarding stimuli [J].
Davidson, MC ;
Horvitz, JC ;
Tottenham, N ;
Fossella, JA ;
Watts, R ;
Ulug, AM ;
Casey, BJ .
NEUROIMAGE, 2004, 23 (03) :1039-1045
[10]   Reward, motivation, and reinforcement learning [J].
Dayan, P ;
Balleine, BW .
NEURON, 2002, 36 (02) :285-298