A computational substrate for incentive salience

被引:277
作者
McClure, SM
Daw, ND
Montague, PR [1 ]
机构
[1] Baylor Coll Med, Ctr Theoret Neurosci, Human Neuroimaging Lab, Houston, TX 77030 USA
[2] Carnegie Mellon Univ, Dept Comp Sci, Ctr Neural Basis Cognit, Pittsburgh, PA 15213 USA
关键词
D O I
10.1016/S0166-2236(03)00177-2
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Theories of dopamine function are at a crossroads. Computational models derived from single-unit recordings capture changes in dopaminergic neuron firing rate as a prediction error signal. These models employ the prediction error signal in two roles: learning to predict future rewarding events and biasing action choice. Conversely, pharmacological inhibition or lesion of dopaminergic neuron function diminishes the ability of an animal to motivate behaviors directed at acquiring rewards. These lesion experiments have raised the possibility that dopamine release encodes a measure of the incentive value of a contemplated behavioral act. The most complete psychological idea that captures this notion frames the dopamine signal as carrying 'incentive salience'. On the surface, these two competing accounts of dopamine function seem incommensurate. To the contrary, we demonstrate that both of these functions can be captured in a single computational model of the involvement of dopamine in reward prediction for the purpose of reward seeking.
引用
收藏
页码:423 / 428
页数:6
相关论文
共 27 条
[1]  
Bellman R., 1957, DYNAMIC PROGRAMMING
[2]   Predictability modulates human brain response to reward [J].
Berns, GS ;
McClure, SM ;
Pagnoni, G ;
Montague, PR .
JOURNAL OF NEUROSCIENCE, 2001, 21 (08) :2793-2798
[3]   What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? [J].
Berridge, KC ;
Robinson, TE .
BRAIN RESEARCH REVIEWS, 1998, 28 (03) :309-369
[4]   Opponent interactions between serotonin and dopamine [J].
Daw, ND ;
Kakade, S ;
Dayan, P .
NEURAL NETWORKS, 2002, 15 (4-6) :603-616
[5]  
Dayan P, 2002, ADV NEUR IN, V14, P11
[6]   Reward, motivation, and reinforcement learning [J].
Dayan, P ;
Balleine, BW .
NEURON, 2002, 36 (02) :285-298
[7]  
Dayan P., 2001, THEORETICAL NEUROSCI
[9]   A computational role for dopamine delivery in human decision-making [J].
Egelman, DM ;
Person, C ;
Montague, PR .
JOURNAL OF COGNITIVE NEUROSCIENCE, 1998, 10 (05) :623-630
[10]   Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation [J].
Garris, PA ;
Kilpatrick, M ;
Bunin, MA ;
Michael, D ;
Walker, QD ;
Wightman, RM .
NATURE, 1999, 398 (6722) :67-69