The temporal precision of reward prediction in dopamine neurons

被引:212
作者
Fiorillo, Christopher D. [1 ]
Newsome, William T. [1 ]
Schultz, Wolfram [2 ]
机构
[1] Stanford Univ, Dept Neurobiol, Stanford, CA 94305 USA
[2] Univ Cambridge, Dept Physiol Dev & Neurosci, Cambridge CB2 3DY, England
基金
英国医学研究理事会; 英国惠康基金;
关键词
D O I
10.1038/nn.2159
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Midbrain dopamine neurons are activated when reward is greater than predicted, and this error signal could teach target neurons both the value of reward and when it will occur. We used the dopamine error signal to measure how the expectation of reward was distributed over time. Animals were trained with fixed-duration intervals of 1-16 s between conditioned stimulus onset and reward. In contrast to the weak responses that have been observed after short intervals (1-2 s), activations to reward increased steeply and linearly with the logarithm of the interval. Results with varied stimulus-reward intervals suggest that the neural expectation was substantial after just half an interval had elapsed. Thus, the neural expectation of reward in these experiments was not highly precise and the precision declined sharply with interval duration. The neural precision of expectation appeared to be at least qualitatively similar to the precision of anticipatory licking behavior.
引用
收藏
页码:966 / 973
页数:8
相关论文
共 38 条
[1]   ACCURACY OF MEMORY FOR AMOUNT IN THE FORAGING STARLING, STURNUS-VULGARIS [J].
BATESON, M ;
KACELNIK, A .
ANIMAL BEHAVIOUR, 1995, 50 :431-443
[2]   Midbrain dopamine neurons encode a quantitative reward prediction error signal [J].
Bayer, HM ;
Glimcher, PW .
NEURON, 2005, 47 (01) :129-141
[3]   A computational model of how the basal ganglia produce sequences [J].
Berns, GS ;
Sejnowski, TJ .
JOURNAL OF COGNITIVE NEUROSCIENCE, 1998, 10 (01) :108-121
[4]   Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex [J].
Brody, CD ;
Hernández, A ;
Zainos, A ;
Romo, R .
CEREBRAL CORTEX, 2003, 13 (11) :1196-1207
[5]  
Brown J, 1999, J NEUROSCI, V19, P10502
[6]   What makes us tick? Functional and neural mechanisms of interval timing [J].
Buhusi, CV ;
Meck, WH .
NATURE REVIEWS NEUROSCIENCE, 2005, 6 (10) :755-765
[7]   A predictive reinforcement model of dopamine neurons for learning approach behavior [J].
Contreras-Vidal, JL ;
Schultz, W .
JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 1999, 6 (03) :191-214
[8]   Representation and timing in theories of the dopamine system [J].
Daw, Nathaniel D. ;
Courville, Aaron C. ;
Tourtezky, David S. .
NEURAL COMPUTATION, 2006, 18 (07) :1637-1677
[9]   Discrete coding of reward probability and uncertainty by dopamine neurons [J].
Fiorillo, CD ;
Tobler, PN ;
Schultz, W .
SCIENCE, 2003, 299 (5614) :1898-1902
[10]   Attentional modulation in visual cortex depends on task timing [J].
Ghose, GM ;
Maunsell, JHR .
NATURE, 2002, 419 (6907) :616-620