Multiple Timescales of Memory in Lateral Habenula and Dopamine Neurons

被引:63
作者
Bromberg-Martin, Ethan S. [1 ]
Matsumoto, Masayuki [1 ,2 ]
Nakahara, Hiroyuki [3 ,4 ]
Hikosaka, Okihide [1 ]
机构
[1] NEI, Sensorimotor Res Lab, Bethesda, MD 20892 USA
[2] Kyoto Univ, Primate Res Inst, Aichi 4848506, Japan
[3] RIKEN, Brain Sci Inst, Lab Integrated Theoret Neurosci, Wako, Saitama 3510198, Japan
[4] Tokyo Inst Technol, Dept Computat Intelligence & Syst Sci, Yokohama, Kanagawa 227, Japan
关键词
VENTRAL TEGMENTAL AREA; MIXED-STRATEGY GAME; PREFRONTAL CORTEX; PREDICTION ERROR; REWARD SIGNALS; SHORT-TERM; RESPONSES; RAT; MONKEY; ADAPTATION;
D O I
10.1016/j.neuron.2010.06.031
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Midbrain dopamine neurons are thought to signal predictions about future rewards based on the memory of past rewarding experience. Little is known about the source of their reward memory and the factors that control its timescale. Here we recorded from dopamine neurons, as well as one of their sources of input, the lateral habenula, while animals predicted upcoming rewards based on the past reward history. We found that lateral habenula and dopamine neurons accessed two distinct reward memories: a short-timescale memory expressed at the start of the task and a near-optimal long-timescale memory expressed when a future reward outcome was revealed. The short- and long-timescale memories were expressed in different forms of reward-oriented eye movements. Our data show that the habenula-dopamine pathway contains multiple timescales of memory and provide evidence for their role in motivated behavior.
引用
收藏
页码:499 / 510
页数:12
相关论文
共 51 条
  • [1] [Anonymous], 1988, Signal Detection Theory and Psychophysics
  • [2] Prefrontal cortex and decision making in a mixed-strategy game
    Barraclough, DJ
    Conroy, ML
    Lee, D
    [J]. NATURE NEUROSCIENCE, 2004, 7 (04) : 404 - 410
  • [3] Midbrain dopamine neurons encode a quantitative reward prediction error signal
    Bayer, HM
    Glimcher, PW
    [J]. NEURON, 2005, 47 (01) : 129 - 141
  • [4] Learning the value of information in an uncertain world
    Behrens, Timothy E. J.
    Woolrich, Mark W.
    Walton, Mark E.
    Rushworth, Matthew F. S.
    [J]. NATURE NEUROSCIENCE, 2007, 10 (09) : 1214 - 1221
  • [5] Distinct Tonic and Phasic Anticipatory Activity in Lateral Habenula and Dopamine Neurons
    Bromberg-Martin, Ethan S.
    Matsumoto, Masayuki
    Hikosaka, Okihide
    [J]. NEURON, 2010, 67 (01) : 144 - 155
  • [6] Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards
    Bromberg-Martin, Ethan S.
    Hikosaka, Okihide
    [J]. NEURON, 2009, 63 (01) : 119 - 126
  • [7] CHRISTOPH GR, 1986, J NEUROSCI, V6, P613
  • [8] Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
    Day, Jeremy J.
    Roitman, Mitchell F.
    Wightman, R. Mark
    Carelli, Regina M.
    [J]. NATURE NEUROSCIENCE, 2007, 10 (08) : 1020 - 1028
  • [9] Metalearning and neuromodulation
    Doya, K
    [J]. NEURAL NETWORKS, 2002, 15 (4-6) : 495 - 506
  • [10] Discrete coding of reward probability and uncertainty by dopamine neurons
    Fiorillo, CD
    Tobler, PN
    Schultz, W
    [J]. SCIENCE, 2003, 299 (5614) : 1898 - 1902