Prolonged dopamine signalling in striatum signals proximity and value of distant rewards

被引:365
作者
Howe, Mark W. [1 ,2 ]
Tierney, Patrick L. [1 ,2 ]
Sandberg, Stefan G. [3 ,4 ]
Phillips, Paul E. M. [3 ,4 ]
Graybiel, Ann M. [1 ,2 ]
机构
[1] MIT, McGovern Inst Brain Res, Cambridge, MA 02139 USA
[2] MIT, Dept Brain & Cognit Sci, Cambridge, MA 02139 USA
[3] Univ Washington, Dept Psychiat & Behav Sci, Seattle, WA 98195 USA
[4] Univ Washington, Dept Pharmacol, Seattle, WA 98195 USA
基金
美国国家卫生研究院;
关键词
NUCLEUS-ACCUMBENS DOPAMINE; NEURONS; PREDICTION; NAVIGATION; DEPLETION;
D O I
10.1038/nature12475
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Predictions about future rewarding events have a powerful influence on behaviour. The phasic spike activity of dopamine-containing neurons, and corresponding dopamine transients in the striatum, are thought to underlie these predictions, encoding positive and negative reward prediction errors(1-5). However, many behaviours are directed towards distant goals, for which transient signals may fail to provide sustained drive. Here we report an extended mode of reward-predictive dopamine signalling in the striatum that emerged as rats moved towards distant goals. These dopamine signals, which were detected with fast-scan cyclic voltammetry (FSCV), gradually increased or-in rare instances-decreased as the animals navigated mazes to reach remote rewards, rather than having phasic or steady tonic profiles. These dopamine increases (ramps) scaled flexibly with both the distance and size of the rewards. During learning, these dopamine signals showed spatial preferences for goals in different locations and readily changed in magnitude to reflect changing values of the distant rewards. Such prolonged dopamine signalling could provide sustained motivational drive, a control mechanism that may be important for normal behaviour and that can be impaired in a range of neurologic and neuropsychiatric disorders.
引用
收藏
页码:575 / +
页数:16
相关论文
共 28 条
[1]   Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories [J].
Barnes, TD ;
Kubota, Y ;
Hu, D ;
Jin, DZZ ;
Graybiel, AM .
NATURE, 2005, 437 (7062) :1158-1161
[2]   Midbrain dopamine neurons encode a quantitative reward prediction error signal [J].
Bayer, HM ;
Glimcher, PW .
NEURON, 2005, 47 (01) :129-141
[3]   The debate over dopamine's role in reward: the case for incentive salience [J].
Berridge, Kent C. .
PSYCHOPHARMACOLOGY, 2007, 191 (03) :391-431
[4]   Dorsal striatal dopamine depletion impairs both allocentric and egocentric navigation in rats [J].
Braun, Amanda A. ;
Graham, Devon L. ;
Schaefer, Tori L. ;
Vorhees, Charles V. ;
Williams, Michael T. .
NEUROBIOLOGY OF LEARNING AND MEMORY, 2012, 97 (04) :402-408
[5]  
Clark JJ, 2010, NAT METHODS, V7, P126, DOI [10.1038/nmeth.1412, 10.1038/NMETH.1412]
[6]   Neuron-type-specific signals for reward and punishment in the ventral tegmental area [J].
Cohen, Jeremiah Y. ;
Haesler, Sebastian ;
Vong, Linh ;
Lowell, Bradford B. ;
Uchida, Naoshige .
NATURE, 2012, 482 (7383) :85-U109
[7]   Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens [J].
Day, Jeremy J. ;
Roitman, Mitchell F. ;
Wightman, R. Mark ;
Carelli, Regina M. .
NATURE NEUROSCIENCE, 2007, 10 (08) :1020-1028
[8]   Phasic Nucleus Accumbens Dopamine Release Encodes Effort- and Delay-Related Costs [J].
Day, Jeremy J. ;
Jones, Joshua L. ;
Wightman, R. Mark ;
Carelli, Regina M. .
BIOLOGICAL PSYCHIATRY, 2010, 68 (03) :306-309
[9]   A manifold of spatial maps in the brain [J].
Derdikman, Dori ;
Moser, Edvard I. .
TRENDS IN COGNITIVE SCIENCES, 2010, 14 (12) :561-569
[10]   Discrete coding of reward probability and uncertainty by dopamine neurons [J].
Fiorillo, CD ;
Tobler, PN ;
Schultz, W .
SCIENCE, 2003, 299 (5614) :1898-1902