From reinforcement learning models to psychiatric and neurological disorders

被引:484
作者
Maia, Tiago V. [1 ,2 ]
Frank, Michael J. [3 ,4 ,5 ]
机构
[1] Columbia Univ, Dept Psychiat, New York, NY 10027 USA
[2] New York State Psychiat Inst & Hosp, New York, NY 10032 USA
[3] Brown Univ, Dept Cognit Linguist & Psychol Sci, Providence, RI 02912 USA
[4] Brown Univ, Dept Psychiat & Human Behav, Providence, RI 02912 USA
[5] Brown Univ, Brown Inst Brain Sci, Providence, RI 02912 USA
关键词
ATTENTION-DEFICIT/HYPERACTIVITY DISORDER; BASAL GANGLIA; PREFRONTAL CORTEX; PREDICTION-ERROR; DECISION-MAKING; COMPUTATIONAL MODELS; NUCLEUS-ACCUMBENS; WORKING-MEMORY; DOPAMINE MODULATION; OPTOGENETIC CONTROL;
D O I
10.1038/nn.2723
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Over the last decade and a half, reinforcement learning models have fostered an increasingly sophisticated understanding of the functions of dopamine and cortico-basal ganglia-thalamo-cortical (CBGTC) circuits. More recently, these models, and the insights that they afford, have started to be used to understand important aspects of several psychiatric and neurological disorders that involve disturbances of the dopaminergic system and CBGTC circuits. We review this approach and its existing and potential applications to Parkinson's disease, Tourette's syndrome, attention-deficit/hyperactivity disorder, addiction, schizophrenia and preclinical animal models used to screen new antipsychotic drugs. The approach's proven explanatory and predictive power bodes well for the continued growth of computational psychiatry and computational neurology.
引用
收藏
页码:154 / 162
页数:9
相关论文
共 101 条
[1]   THE FUNCTIONAL-ANATOMY OF BASAL GANGLIA DISORDERS [J].
ALBIN, RL ;
YOUNG, AB ;
PENNEY, JB .
TRENDS IN NEUROSCIENCES, 1989, 12 (10) :366-375
[2]   PARALLEL ORGANIZATION OF FUNCTIONALLY SEGREGATED CIRCUITS LINKING BASAL GANGLIA AND CORTEX [J].
ALEXANDER, GE ;
DELONG, MR ;
STRICK, PL .
ANNUAL REVIEW OF NEUROSCIENCE, 1986, 9 :357-381
[3]  
[Anonymous], BEHAV BRAIN SCI, DOI DOI 10.1017/S0110525X0100472X
[4]   Keeping Memory Clear and Stable-The Contribution of Human Basal Ganglia and Prefrontal Cortex to Working Memory [J].
Baier, Bernhard ;
Karnath, Hans-Otto ;
Dieterich, Marianne ;
Birklein, Frank ;
Heinze, Carolin ;
Mueller, Notger G. .
JOURNAL OF NEUROSCIENCE, 2010, 30 (29) :9788-9792
[5]   Behavioral inhibition, sustained attention, and executive functions: Constructing a unifying theory of ADHD [J].
Barkley, RA .
PSYCHOLOGICAL BULLETIN, 1997, 121 (01) :65-94
[6]   Statistics of midbrain dopamine neuron spike trains in the awake primate [J].
Bayer, Hannah M. ;
Lau, Brian ;
Glimcher, Paul W. .
JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (03) :1428-1439
[7]   Midbrain dopamine neurons encode a quantitative reward prediction error signal [J].
Bayer, HM ;
Glimcher, PW .
NEURON, 2005, 47 (01) :129-141
[8]   What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? [J].
Berridge, KC ;
Robinson, TE .
BRAIN RESEARCH REVIEWS, 1998, 28 (03) :309-369
[9]   Attention-deficit/hyperactivity disorder (ADHD) as a noradrenergic disorder [J].
Biederman, J ;
Spencer, T .
BIOLOGICAL PSYCHIATRY, 1999, 46 (09) :1234-1242
[10]   The basal ganglia and cortex implement optimal decision making between alternative actions [J].
Bogacz, Rafal ;
Gurney, Kevin .
NEURAL COMPUTATION, 2007, 19 (02) :442-477