Banishing the homunculus: Making working memory work

被引:215
作者
Hazy, TE [1 ]
Frank, MJ [1 ]
O'Reilly, RC [1 ]
机构
[1] Univ Colorado, Dept Psychol, Boulder, CO 80309 USA
基金
美国国家卫生研究院;
关键词
basal ganglia; prefrontal cortex; dopamine; reinforcement learning; Pavlovian conditioning; computational modeling;
D O I
10.1016/j.neuroscience.2005.04.067
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The prefrontal cortex has long been thought to subserve both working memory and "executive" function, but the mechanistic basis of their integrated function has remained poorly understood, often amounting to a homunculus. This paper reviews the progress in our laboratory and others pursuing a long-term research agenda to deconstruct this homunculus by elucidating the precise computational and neural mechanisms underlying these phenomena. We outline six key functional demands underlying working memory, and then describe the current state of our computational model of the prefrontal cortex and associated systems in the basal ganglia (BG). The model, called PBWM (prefrontal cortex, basal ganglia working memory model), relies on actively maintained representations in the prefrontal cortex, which are dynamically updated/gated by the basal ganglia. It is capable of developing human-like performance largely on its own by taking advantage of powerful reinforcement learning mechanisms, based on the midbrain dopaminergic system and its activation via the basal ganglia and amygdala. These learning mechanisms enable the model to learn to control both itself and other brain areas in a strategic, task-appropriate manner. The model can learn challenging working memory tasks, and has been corroborated by several important empirical studies. (C) 2005 Published by Elsevier Ltd on behalf of IBRO.
引用
收藏
页码:105 / 118
页数:14
相关论文
共 103 条
[1]   PARALLEL ORGANIZATION OF FUNCTIONALLY SEGREGATED CIRCUITS LINKING BASAL GANGLIA AND CORTEX [J].
ALEXANDER, GE ;
DELONG, MR ;
STRICK, PL .
ANNUAL REVIEW OF NEUROSCIENCE, 1986, 9 :357-381
[2]   A computational model of information processing in the frontal cortex and basal ganglia [J].
Amos, A .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2000, 12 (03) :505-519
[3]  
Anderson J., 1983, The architecture of cognition
[4]  
[Anonymous], MODELS INFORM PROCES
[5]   Hippocampus, cortex, and basal ganglia: Insights from computational models of complementary learning systems [J].
Atallah, HE ;
Frank, MJ ;
O'Reilly, RC .
NEUROBIOLOGY OF LEARNING AND MEMORY, 2004, 82 (03) :253-267
[6]  
Aubert I, 2000, J COMP NEUROL, V418, P22
[7]  
Baddeley A., 1986, WORKING MEMORY
[8]   Model of cortical-basal ganglionic processing: Encoding the serial order of sensory events [J].
Beiser, DG ;
Houk, JC .
JOURNAL OF NEUROPHYSIOLOGY, 1998, 79 (06) :3168-3188
[9]  
Berns GS, 1996, RES PER NEUROSCI, P101
[10]   A computational model of how the basal ganglia produce sequences [J].
Berns, GS ;
Sejnowski, TJ .
JOURNAL OF COGNITIVE NEUROSCIENCE, 1998, 10 (01) :108-121