Neural coding of distinct statistical properties of reward information in humans

被引:143
作者
Dreher, JC [1 ]
Kohn, P [1 ]
Berman, KF [1 ]
机构
[1] NIMH, Unit Integrat Neuroimaging, Clin Brain Disorders Branch, NIH, Bethesda, MD USA
关键词
dopamine; error prediction; fMRI; gambling; information theory; uncertainty;
D O I
10.1093/cercor/bhj004
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Brain processing of reward information is essential for complex functions such as learning and motivation. Recent primate electrophysiological studies using concepts from information, economic and learning theories indicate that the midbrain may code two statistical parameters of reward information: a transient reward error prediction signal that varies linearly with reward probability and a sustained signal that varies highly non-linearly with reward probability and that is highest with maximal reward uncertainty (reward probability = 0.5). Here, using event-related functional magnetic resonance imaging, we disentangled these two signals in humans using a novel paradigm that systematically varied monetary reward probability, magnitude and expected reward value. The midbrain was activated both transiently with the error prediction signal and in a sustained fashion with reward uncertainty. Moreover, distinct activity dynamics were observed in post-synaptic midbrain projection sites: the prefrontal cortex responded to the transient error prediction signal while the ventral striatum covaried with the sustained reward uncertainty signal. These data suggest that the prefrontal cortex may generate the reward prediction while the ventral striatum may be involved in motivational processes that are useful when an organism needs to obtain more information about its environment. Our results indicate that distinct functional brain networks code different aspects of the statistical properties of reward information in humans.
引用
收藏
页码:561 / 573
页数:13
相关论文
共 54 条
[1]   NEURONAL-ACTIVITY IN MONKEY STRIATUM RELATED TO THE EXPECTATION OF PREDICTABLE ENVIRONMENTAL EVENTS [J].
APICELLA, P ;
SCARNATI, E ;
LJUNGBERG, T ;
SCHULTZ, W .
JOURNAL OF NEUROPHYSIOLOGY, 1992, 68 (03) :945-960
[2]   Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning [J].
Aron, AR ;
Shohamy, D ;
Clark, J ;
Myers, C ;
Gluck, MA ;
Poldrack, RA .
JOURNAL OF NEUROPHYSIOLOGY, 2004, 92 (02) :1144-1152
[3]   Predictability modulates human brain response to reward [J].
Berns, GS ;
McClure, SM ;
Pagnoni, G ;
Montague, PR .
JOURNAL OF NEUROSCIENCE, 2001, 21 (08) :2793-2798
[4]   What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? [J].
Berridge, KC ;
Robinson, TE .
BRAIN RESEARCH REVIEWS, 1998, 28 (03) :309-369
[5]   Acute and chronic dopamine dynamics in a nonhuman primate model of recreational cocaine use [J].
Bradberry, CW .
JOURNAL OF NEUROSCIENCE, 2000, 20 (18) :7109-7115
[6]   Functional imaging of neural responses to expectancy and experience of monetary gains and losses [J].
Breiter, HC ;
Aharon, I ;
Kahneman, D ;
Dale, A ;
Shizgal, P .
NEURON, 2001, 30 (02) :619-639
[7]   Prediction error during retrospective revaluation of causal associations in humans: fMRI evidence in favor of an associative model of learning [J].
Corlett, PR ;
Aitken, MRF ;
Dickinson, A ;
Shanks, DR ;
Honey, GD ;
Honey, RAE ;
Robbins, TW ;
Bullmore, ET ;
Fletcher, PC .
NEURON, 2004, 44 (05) :877-888
[8]  
DAW ND, 2005, COSYNE 2005 COMPUTAT
[9]   Reward, motivation, and reinforcement learning [J].
Dayan, P ;
Balleine, BW .
NEURON, 2002, 36 (02) :285-298
[10]  
Dehaene S, 2000, PROG BRAIN RES, V126, P217