Choice, uncertainty and value in prefrontal and cingulate cortex

被引:615
作者
Rushworth, Matthew F. S. [1 ]
Behrens, Timothy E. J.
机构
[1] Univ Oxford, Dept Expt Psychol, John Radcliffe Hosp, Oxford OX1 3UD, England
基金
英国医学研究理事会;
关键词
D O I
10.1038/nn2066
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Reinforcement learning models that focus on the striatum and dopamine can predict the choices of animals and people. Representations of reward expectation and of reward prediction errors that are pertinent to decision making, however, are not confined to these regions but are also found in prefrontal and cingulate cortex. Moreover, decisions are not guided solely by the magnitude of the reward that is expected. Uncertainty in the estimate of the reward expectation, the value of information that might be gained by taking a course of action and the cost of an action all influence the manner in which decisions are made through prefrontal and cingulate cortex.
引用
收藏
页码:389 / 397
页数:9
相关论文
共 101 条
[21]  
Dum RP, 1996, J NEUROSCI, V16, P6513
[22]   Representation of spatial goals in rat orbitofrontal cortex [J].
Feierstein, Claudia E. ;
Quirk, Michael C. ;
Uchida, Naoshige ;
Sosulski, Dara L. ;
Mainen, Zachary F. .
NEURON, 2006, 51 (04) :495-507
[23]   Discrete coding of reward probability and uncertainty by dopamine neurons [J].
Fiorillo, CD ;
Tobler, PN ;
Schultz, W .
SCIENCE, 2003, 299 (5614) :1898-1902
[24]   Voluntary selection of task sets revealed by functional magnetic resonance Imaging [J].
Forstmann, BU ;
Brass, M ;
Koch, I ;
von Cramon, DY .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2006, 18 (03) :388-398
[25]  
Gallagher M, 1999, J NEUROSCI, V19, P6610
[26]   Representation of future and previous spatial goals by separate neural populations in prefrontal cortex [J].
Genovesio, Aldo ;
Brasted, Peter J. ;
Wise, Steven P. .
JOURNAL OF NEUROSCIENCE, 2006, 26 (27) :7305-7316
[27]   The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans [J].
Hampton, Alan N. ;
Bossaerts, Peter ;
O'Doherty, John P. .
JOURNAL OF NEUROSCIENCE, 2006, 26 (32) :8360-8367
[28]   Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning [J].
Haruno, M ;
Kawato, M .
JOURNAL OF NEUROPHYSIOLOGY, 2006, 95 (02) :948-959
[29]   A neural correlate of reward-based behavioral learning in caudate nucleus: A functional magnetic resonance Imaging study of a stochastic decision task [J].
Haruno, M ;
Kuroda, T ;
Doya, K ;
Toyama, K ;
Kimura, M ;
Samejima, K ;
Imamizu, H ;
Kawato, M .
JOURNAL OF NEUROSCIENCE, 2004, 24 (07) :1660-1665
[30]   Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning [J].
Haruno, Masahiko ;
Kawato, Mitsuo .
NEURAL NETWORKS, 2006, 19 (08) :1242-1254