By carrot or by stick: Cognitive reinforcement learning in Parkinsonism

被引:1402
作者
Frank, MJ [1 ]
Seeberger, LC
O'Reilly, RC
机构
[1] Univ Colorado, Dept Psychol, Boulder, CO 80309 USA
[2] Univ Colorado, Ctr Neurosci, Boulder, CO 80309 USA
[3] Colorado Neurol Inst, Movement Disorders Ctr, Englewood, CO 80113 USA
关键词
D O I
10.1126/science.1102941
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
To what extent do we learn from the positive versus negative outcomes of our decisions? The neuromodulator dopamine plays a key role in these reinforcement learning processes. Patients with Parkinson's disease, who have depleted dopamine in the basal ganglia, are impaired in tasks that require learning from trial and error. Here, we show, using two cognitive procedural learning tasks, that Parkinson's patients off medication are better at learning to avoid choices that lead to negative outcomes than they are at learning from positive outcomes. Dopamine medication reverses this bias, making patients more sensitive to positive than negative outcomes. This pattern was predicted by our biologically based computational model of basal ganglia-dopamine interactions in cognition, which has separate pathways for "Go" and "NoGo" responses that are differentially modulated by positive and negative reinforcement.
引用
收藏
页码:1940 / 1943
页数:4
相关论文
共 34 条
  • [1] A neuropsychological theory of multiple systems in category learning
    Ashby, FG
    Alfonso-Reese, LA
    Turken, AU
    Waldron, EM
    [J]. PSYCHOLOGICAL REVIEW, 1998, 105 (03) : 442 - 481
  • [2] Aubert I, 2000, J COMP NEUROL, V418, P22
  • [3] Dopaminergic control of synaptic plasticity in the dorsal striatum
    Centonze, D
    Picconi, B
    Gubellini, P
    Bernardi, G
    Calabresi, P
    [J]. EUROPEAN JOURNAL OF NEUROSCIENCE, 2001, 13 (06) : 1071 - 1077
  • [4] DISINHIBITION AS A BASIC PROCESS IN THE EXPRESSION OF STRIATAL FUNCTIONS
    CHEVALIER, G
    DENIAU, JM
    [J]. TRENDS IN NEUROSCIENCES, 1990, 13 (07) : 277 - 280
  • [5] Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands
    Cools, R
    Barker, RA
    Sahakian, BJ
    Robbins, TW
    [J]. CEREBRAL CORTEX, 2001, 11 (12) : 1136 - 1143
  • [6] Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations
    Delgado, M. R.
    Locke, H. M.
    Stenger, V. A.
    Fiez, J. A.
    [J]. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2003, 3 (01) : 27 - 38
  • [7] Transitive responding in animals and humans: Exaptation rather than adaptation?
    Delius, JD
    Siemann, M
    [J]. BEHAVIOURAL PROCESSES, 1998, 42 (2-3) : 107 - 137
  • [8] FRANK M, IN PRESS J COGNIT NE
  • [9] FRANK M, IN PRESS MEM COGNIT
  • [10] Interactions between frontal cortex and basal ganglia in working memory: A computational model
    Frank, Michael J.
    Loughry, Bryan
    O'Reilly, Randall C.
    [J]. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2001, 1 (02) : 137 - 160