The temporal precision of reward prediction in dopamine neurons

被引:212
作者
Fiorillo, Christopher D. [1 ]
Newsome, William T. [1 ]
Schultz, Wolfram [2 ]
机构
[1] Stanford Univ, Dept Neurobiol, Stanford, CA 94305 USA
[2] Univ Cambridge, Dept Physiol Dev & Neurosci, Cambridge CB2 3DY, England
基金
英国医学研究理事会; 英国惠康基金;
关键词
D O I
10.1038/nn.2159
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Midbrain dopamine neurons are activated when reward is greater than predicted, and this error signal could teach target neurons both the value of reward and when it will occur. We used the dopamine error signal to measure how the expectation of reward was distributed over time. Animals were trained with fixed-duration intervals of 1-16 s between conditioned stimulus onset and reward. In contrast to the weak responses that have been observed after short intervals (1-2 s), activations to reward increased steeply and linearly with the logarithm of the interval. Results with varied stimulus-reward intervals suggest that the neural expectation was substantial after just half an interval had elapsed. Thus, the neural expectation of reward in these experiments was not highly precise and the precision declined sharply with interval duration. The neural precision of expectation appeared to be at least qualitatively similar to the precision of anticipatory licking behavior.
引用
收藏
页码:966 / 973
页数:8
相关论文
共 38 条
[31]   Time is a rubberband: neuronal activity in monkey motor cortex in relation to time estimation [J].
Renoult, Louis ;
Roux, Sebastien ;
Riehle, Alexa .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2006, 23 (11) :3098-3108
[32]  
Satoh T, 2003, J NEUROSCI, V23, P9913
[33]   A neural substrate of prediction and reward [J].
Schultz, W ;
Dayan, P ;
Montague, PR .
SCIENCE, 1997, 275 (5306) :1593-1599
[34]   Predictive reward signal of dopamine neurons [J].
Schultz, W .
JOURNAL OF NEUROPHYSIOLOGY, 1998, 80 (01) :1-27
[35]  
SCHULTZ W, 1993, J NEUROSCI, V13, P900
[36]   RESPONSES OF NIGROSTRIATAL DOPAMINE NEURONS TO HIGH-INTENSITY SOMATOSENSORY STIMULATION IN THE ANESTHETIZED MONKEY [J].
SCHULTZ, W ;
ROMO, R .
JOURNAL OF NEUROPHYSIOLOGY, 1987, 57 (01) :201-217
[37]   A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task [J].
Suri, RE ;
Schultz, W .
NEUROSCIENCE, 1999, 91 (03) :871-890
[38]   Adaptive coding of reward value by dopamine neurons [J].
Tobler, PN ;
Fiorillo, CD ;
Schultz, W .
SCIENCE, 2005, 307 (5715) :1642-1645