A neural correlate of reward-based behavioral learning in caudate nucleus: A functional magnetic resonance Imaging study of a stochastic decision task

被引:231
作者
Haruno, M
Kuroda, T
Doya, K
Toyama, K
Kimura, M
Samejima, K
Imamizu, H
Kawato, M
机构
[1] Adv Telecommun Res Inst, Computat Neurosci Labs, Dept Cognit Neurosci, Seika, Kyoto 6190288, Japan
[2] Japan Sci & Technol Agcy, Core Res Evolut Sci & Technol, Kyoto 6190288, Japan
[3] Shimadzu Tech Res Lab, Kyoto 6190237, Japan
[4] Kyoto Prefectural Univ Med, Kyoto 6058566, Japan
关键词
basal ganglia; imaging; learning; motivation; reinforcement; reward;
D O I
10.1523/JNEUROSCI.3417-03.2004
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Humans can acquire appropriate behaviors that maximize rewards on a trial-and-error basis. Recent electrophysiological and imaging studies have demonstrated that neural activity in the midbrain and ventral striatum encodes the error of reward prediction. However, it is yet to be examined whether the striatum is the main locus of reward-based behavioral learning. To address this, we conducted functional magnetic resonance imaging (fMRI) of a stochastic decision task involving monetary rewards, in which subjects had to learn behaviors involving different task difficulties that were controlled by probability. We performed a correlation analysis of fMRI data by using the explanatory variables derived from subject behaviors. We found that activity in the caudate nucleus was correlated with short-term reward and, furthermore, paralleled the magnitude of a subject's behavioral change during learning. In addition, we confirmed that this parallelism between learning and activity in the caudate nucleus is robustly maintained even when we vary task difficulty by controlling the probability. These findings suggest that the caudate nucleus is one of the main loci for reward-based behavioral learning.
引用
收藏
页码:1660 / 1665
页数:6
相关论文
共 20 条
  • [1] Predictability modulates human brain response to reward
    Berns, GS
    McClure, SM
    Pagnoni, G
    Montague, PR
    [J]. JOURNAL OF NEUROSCIENCE, 2001, 21 (08) : 2793 - 2798
  • [2] Functional imaging of neural responses to expectancy and experience of monetary gains and losses
    Breiter, HC
    Aharon, I
    Kahneman, D
    Dale, A
    Shizgal, P
    [J]. NEURON, 2001, 30 (02) : 619 - 639
  • [3] Chatterjee S., 1977, REGRESSION ANAL EXAM
  • [4] Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
  • [5] Dissociable neural responses in human reward systems
    Elliott, R
    Friston, KJ
    Dolan, RJ
    [J]. JOURNAL OF NEUROSCIENCE, 2000, 20 (16) : 6159 - 6165
  • [6] Friston K.J., 1994, Human Brain Mapping, V2, P189, DOI DOI 10.1002/HBM.460020402
  • [7] Dopamine neurons report an error in the temporal prediction of reward during learning
    Hollerman, JR
    Schultz, W
    [J]. NATURE NEUROSCIENCE, 1998, 1 (04) : 304 - 309
  • [8] Dynamic cortical involvement in implicit and explicit motor sequence learning -: A PET study
    Honda, M
    Deiber, MP
    Ibáñez, V
    Pascual-Leone, A
    Zhuang, P
    Hallett, M
    [J]. BRAIN, 1998, 121 : 2159 - 2173
  • [9] Houk J., 1995, Models ofInformation Processing in the Basal Ganglia, P249
  • [10] Human cerebellar activity reflecting an acquired internal model of a new tool
    Imamizu, H
    Miyauchi, S
    Tamada, T
    Sasaki, Y
    Takino, R
    Pütz, B
    Yoshioka, T
    Kawato, M
    [J]. NATURE, 2000, 403 (6766) : 192 - 195