From reinforcement learning models to psychiatric and neurological disorders

被引:484
作者
Maia, Tiago V. [1 ,2 ]
Frank, Michael J. [3 ,4 ,5 ]
机构
[1] Columbia Univ, Dept Psychiat, New York, NY 10027 USA
[2] New York State Psychiat Inst & Hosp, New York, NY 10032 USA
[3] Brown Univ, Dept Cognit Linguist & Psychol Sci, Providence, RI 02912 USA
[4] Brown Univ, Dept Psychiat & Human Behav, Providence, RI 02912 USA
[5] Brown Univ, Brown Inst Brain Sci, Providence, RI 02912 USA
关键词
ATTENTION-DEFICIT/HYPERACTIVITY DISORDER; BASAL GANGLIA; PREFRONTAL CORTEX; PREDICTION-ERROR; DECISION-MAKING; COMPUTATIONAL MODELS; NUCLEUS-ACCUMBENS; WORKING-MEMORY; DOPAMINE MODULATION; OPTOGENETIC CONTROL;
D O I
10.1038/nn.2723
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Over the last decade and a half, reinforcement learning models have fostered an increasingly sophisticated understanding of the functions of dopamine and cortico-basal ganglia-thalamo-cortical (CBGTC) circuits. More recently, these models, and the insights that they afford, have started to be used to understand important aspects of several psychiatric and neurological disorders that involve disturbances of the dopaminergic system and CBGTC circuits. We review this approach and its existing and potential applications to Parkinson's disease, Tourette's syndrome, attention-deficit/hyperactivity disorder, addiction, schizophrenia and preclinical animal models used to screen new antipsychotic drugs. The approach's proven explanatory and predictive power bodes well for the continued growth of computational psychiatry and computational neurology.
引用
收藏
页码:154 / 162
页数:9
相关论文
共 101 条
[91]   Dopamine in drug abuse and addiction - Results of imaging studies and treatment implications [J].
Volkow, Nora D. ;
Fowler, Joanna S. ;
Wang, Gene-Jack ;
Swanson, James M. ;
Telang, Frank .
ARCHIVES OF NEUROLOGY, 2007, 64 (11) :1575-1579
[92]   SUPPRESSION OF CONDITIONED AVOIDANCE-BEHAVIOR BY THE LOCAL APPLICATION OF (-)SULPIRIDE INTO THE VENTRAL, BUT NOT THE DORSAL, STRIATUM OF THE RAT [J].
WADENBERG, ML ;
ERICSON, E ;
MAGNUSSON, O ;
AHLENIUS, S .
BIOLOGICAL PSYCHIATRY, 1990, 28 (04) :297-307
[93]   The conditioned avoidance response test re-evaluated: is it a sensitive test for the detection of potentially atypical antipsychotics? [J].
Wadenberg, MLG ;
Hicks, PB .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 1999, 23 (06) :851-862
[94]  
WALTERS JR, 1987, SCIENCE, V236, P719
[95]   Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction [J].
Waltz, James A. ;
Frank, Michael J. ;
Robinson, Benjamin M. ;
Gold, James M. .
BIOLOGICAL PSYCHIATRY, 2007, 62 (07) :756-764
[96]   Altered Probabilistic Learning and Response Biases in Schizophrenia: Behavioral Evidence and Neurocomputational Modeling [J].
Waltz, James A. ;
Frank, Michael J. ;
Wiecki, Thomas V. ;
Gold, James M. .
NEUROPSYCHOLOGY, 2011, 25 (01) :86-97
[97]   Patients with Schizophrenia have a Reduced Neural Response to Both Unpredictable and Predictable Primary Reinforcers [J].
Waltz, James A. ;
Schweitzer, Julie B. ;
Gold, James M. ;
Kurup, Pradeep K. ;
Ross, Thomas J. ;
Salmeron, Betty Jo ;
Rose, Emma Jane ;
McClure, Samuel M. ;
Stein, Elliot A. .
NEUROPSYCHOPHARMACOLOGY, 2009, 34 (06) :1567-1577
[98]   Neurocomputational models of motor and cognitive deficits in Parkinson's disease [J].
Wiecki, Thomas V. ;
Frank, Michael J. .
RECENT ADVANCES IN PARKINSONS DISEASE: BASIC RESEARCH, 2010, 183 :275-297
[99]   Interactions between serotonin and dopamine in the control of impulsive choice in rats: Therapeutic implications for impulse control disorders [J].
Winstanley, CA ;
Theobald, DEH ;
Dalley, JW ;
Robbins, TW .
NEUROPSYCHOPHARMACOLOGY, 2005, 30 (04) :669-682
[100]   Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks [J].
Yin, Henry H. ;
Ostlund, Sean B. ;
Balleine, Bernard W. .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2008, 28 (08) :1437-1448