Orbitofrontal Cortex as a Cognitive Map of Task Space

被引:553
作者
Wilson, Robert C. [1 ,2 ]
Takahashi, Yuji K. [3 ]
Schoenbaum, Geoffrey [3 ,4 ]
Niv, Yael [1 ,2 ]
机构
[1] Princeton Univ, Dept Psychol, Princeton, NJ 08544 USA
[2] Princeton Univ, Inst Neurosci, Princeton, NJ 08544 USA
[3] Univ Maryland, Sch Med, Dept Anat & Neurobiol, Baltimore, MD 21201 USA
[4] Univ Maryland, Sch Med, Dept Psychiat, Baltimore, MD 21201 USA
关键词
ORBITAL PREFRONTAL CORTEX; BASOLATERAL AMYGDALA; ENCODES RESPONSE; DECISION-MAKING; ATTENTIONAL SET; DISTINCT ROLES; FRONTAL-CORTEX; REWARD VALUE; LESIONS; REVERSAL;
D O I
10.1016/j.neuron.2013.11.005
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Orbitofrontal cortex (OFC) has long been known to play an important role in decision making. However, the exact nature of that role has remained elusive. Here, we propose a unifying theory of OFC function. We hypothesize that OFC provides an abstraction of currently available information in the form of a labeling of the current task state, which is used for reinforcement learning (RL) elsewhere in the brain. This function is especially critical when task states include unobservable information, for instance, from working memory. We use this framework to explain classic findings in reversal learning, delayed alternation, extinction, and devaluation as well as more recent findings showing the effect of OFC lesions on the firing of dopaminergic neurons in ventral tegmental area (VTA) in rodents performing an RL task. In addition, we generate a number of testable experimental predictions that can distinguish our theory from other accounts of OFC function.
引用
收藏
页码:267 / 279
页数:13
相关论文
共 97 条
[1]   Goal-directed instrumental action: contingency and incentive learning and their cortical substrates [J].
Balleine, BW ;
Dickinson, A .
NEUROPHARMACOLOGY, 1998, 37 (4-5) :407-419
[2]   Prefrontal regions play a predominant role in imposing an attentional 'set': evidence from fMIRI [J].
Banich, MT ;
Milham, MP ;
Atchley, RA ;
Cohen, NJ ;
Webb, A ;
Wszalek, T ;
Kramer, AF ;
Liang, ZP ;
Barad, V ;
Gullett, D ;
Shah, C ;
Brown, C .
COGNITIVE BRAIN RESEARCH, 2000, 10 (1-2) :1-9
[3]   Orbital prefrontal cortex and guidance of instrumental behaviour in rats under reversal conditions [J].
Bohn, I ;
Giertler, C ;
Hauber, W .
BEHAVIOURAL BRAIN RESEARCH, 2003, 143 (01) :49-56
[4]   Context and behavioral processes in extinction [J].
Bouton, ME .
LEARNING & MEMORY, 2004, 11 (05) :485-494
[5]  
Brass M., 2008, NEUROSCIENCE RULE GU
[6]   Which Way Was I Going? Contextual Retrieval Supports the Disambiguation of Well Learned Overlapping Navigational Routes [J].
Brown, Thackery I. ;
Ross, Robert S. ;
Keller, Joseph B. ;
Hasselmo, Michael E. ;
Stern, Chantal E. .
JOURNAL OF NEUROSCIENCE, 2010, 30 (21) :7414-7422
[7]   Dissociable Components of Rule-Guided Behavior Depend on Distinct Medial and Prefrontal Regions [J].
Buckley, Mark J. ;
Mansouri, Farshad A. ;
Hoda, Hassan ;
Mahboubi, Majid ;
Browning, Philip G. F. ;
Kwok, Sze C. ;
Phillips, Adam ;
Tanaka, Keiji .
SCIENCE, 2009, 325 (5936) :52-58
[9]   CONDITIONING AND EXTINCTION OF A FOOD-REWARDED RESPONSE AFTER SELECTIVE ABLATIONS OF FRONTAL CORTEX IN RHESUS MONKEYS [J].
BUTTER, CM ;
MISHKIN, M ;
ROSVOLD, HE .
EXPERIMENTAL NEUROLOGY, 1963, 7 (01) :65-&
[10]   BEHAVIORAL EFFECTS OF SEQUENTIAL AND ONE-STAGE ABLATIONS OF ORBITAL PREFRONTAL CORTEX IN MONKEY [J].
BUTTERS, N ;
BUTTER, C ;
ROSEN, J ;
STEIN, D .
EXPERIMENTAL NEUROLOGY, 1973, 39 (02) :204-214