Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex

被引:193
作者
Takahashi, Yuji K. [1 ]
Roesch, Matthew R. [2 ,3 ]
Wilson, Robert C. [4 ,5 ]
Toreson, Kathy [1 ]
O'Donnell, Patricio [6 ]
Niv, Yael [4 ,5 ]
Schoenbaum, Geoffrey [1 ,6 ,7 ]
机构
[1] Univ Maryland, Sch Med, Dept Anat & Neurobiol, Baltimore, MD 21201 USA
[2] Univ Maryland, Dept Psychol, College Pk, MD 20742 USA
[3] Univ Maryland, Program Neurosci & Cognit Sci, College Pk, MD 20742 USA
[4] Princeton Univ, Dept Psychol, Princeton, NJ 08544 USA
[5] Princeton Univ, Inst Neurosci, Princeton, NJ 08544 USA
[6] Univ Maryland, Sch Med, Dept Psychiat, Baltimore, MD 21201 USA
[7] NIDA, Intramural Res Program, Baltimore, MD USA
基金
以色列科学基金会;
关键词
VENTRAL TEGMENTAL AREA; ORBITAL PREFRONTAL CORTEX; ENCODES RESPONSE; DECISION-MAKING; FRONTAL-CORTEX; REWARD VALUE; MODEL-FREE; RAT; PREDICTION; STRIATUM;
D O I
10.1038/nn.2957
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The orbitofrontal cortex has been hypothesized to carry information regarding the value of expected rewards. Such information is essential for associative learning, which relies on comparisons between expected and obtained reward for generating instructive error signals. These error signals are thought to be conveyed by dopamine neurons. To test whether orbitofrontal cortex contributes to these error signals, we recorded from dopamine neurons in orbitofrontal-lesioned rats performing a reward learning task. Lesions caused marked changes in dopaminergic error signaling. However, the effect of lesions was not consistent with a simple loss of information regarding expected value. Instead, without orbitofrontal input, dopaminergic error signals failed to reflect internal information about the impending response that distinguished externally similar states leading to differently valued future rewards. These results are consistent with current conceptualizations of orbitofrontal cortex as supporting model-based behavior and suggest an unexpected role for this information in dopaminergic error signaling.
引用
收藏
页码:1590 / U129
页数:10
相关论文
共 50 条
[1]   Distributed Coding of Actual and Hypothetical Outcomes in the Orbital and Dorsolateral Prefrontal Cortex [J].
Abe, Hiroshi ;
Lee, Daeyeol .
NEURON, 2011, 70 (04) :731-741
[2]   Midbrain dopamine neurons encode a quantitative reward prediction error signal [J].
Bayer, HM ;
Glimcher, PW .
NEURON, 2005, 47 (01) :129-141
[3]   A Pallidus-Habenula-Dopamine Pathway Signals Inferred Stimulus Values [J].
Bromberg-Martin, Ethan S. ;
Matsumoto, Masayuki ;
Hong, Simon ;
Hikosaka, Okihide .
JOURNAL OF NEUROPHYSIOLOGY, 2010, 104 (02) :1068-1076
[4]   The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards [J].
Burke, Kathryn A. ;
Franz, Theresa M. ;
Miller, Danielle N. ;
Schoenbaum, Geoffrey .
NATURE, 2008, 454 (7202) :340-U45
[5]  
Chudasama Y, 2003, J NEUROSCI, V23, P8771
[6]   Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control [J].
Daw, ND ;
Niv, Y ;
Dayan, P .
NATURE NEUROSCIENCE, 2005, 8 (12) :1704-1711
[7]  
DAW ND, NEURON IN PRESS
[8]   Representation of spatial goals in rat orbitofrontal cortex [J].
Feierstein, Claudia E. ;
Quirk, Michael C. ;
Uchida, Naoshige ;
Sosulski, Dara L. ;
Mainen, Zachary F. .
NEURON, 2006, 51 (04) :495-507
[9]   Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm [J].
Fellows, LK ;
Farah, MJ .
BRAIN, 2003, 126 :1830-1837
[10]   Rat orbitofrontal cortex separately encodes response and outcome information during performance of goal-directed behavior [J].
Furuyashiki, Tomoyuki ;
Holland, Peter C. ;
Gallagher, Michela .
JOURNAL OF NEUROSCIENCE, 2008, 28 (19) :5127-5138