Mechanisms Underlying Dopamine-Mediated Reward Bias in Compulsive Behaviors

被引:223
作者
Voon, Valerie [1 ]
Pessiglione, Mathias [2 ]
Brezing, Christina [1 ]
Gallea, Cecile [1 ]
Fernandez, Hubert H. [3 ]
Dolan, Raymond J. [4 ]
Hallett, Mark [1 ]
机构
[1] NIH, Bethesda, MD 20892 USA
[2] Hop La Pitie Salpetriere, INSERM, F-75013 Paris, France
[3] Univ Florida, Gainesville, FL 32610 USA
[4] UCL, Wellcome Trust Ctr Neuroimaging, London WC1N 3BG, England
基金
美国国家卫生研究院; 英国惠康基金;
关键词
TEMPORAL DIFFERENCE MODELS; IMPULSE CONTROL DISORDERS; PARKINSONS-DISEASE; PATHOLOGICAL GAMBLERS; DRUG-USE; STIMULATION; PREDICTION; MEDICATION; ADDICTION; HUMANS;
D O I
10.1016/j.neuron.2009.12.027
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Pathological behaviors such as problem gambling or shopping are characterized by compulsive choice despite alternative options and negative costs. Reinforcement learning algorithms allow a computation of prediction error, a comparison of actual and expected outcomes, which updates our predictions and influences our subsequent choices. Using a reinforcement learning model, we show data consistent with the idea that dopamine agonists in susceptible individuals with Parkinson's disease increase the rate of learning from gain outcomes. Dopamine agonists also increase striatal prediction error activity, thus signifying a "better than expected" outcome. Thus, our findings are consistent with a model whereby a distorted estimation of the gain cue underpins a choice bias toward gains.
引用
收藏
页码:135 / 142
页数:8
相关论文
共 29 条
[1]   Midbrain dopamine neurons encode a quantitative reward prediction error signal [J].
Bayer, HM ;
Glimcher, PW .
NEURON, 2005, 47 (01) :129-141
[2]   Pharmacological Analysis Demonstrates Dramatic Alteration of D1 Dopamine Receptor Neuronal Distribution in the Rat Analog of L-DOPA-Induced Dyskinesia [J].
Berthet, Amandine ;
Porras, Gregory ;
Doudnikoff, Evelyne ;
Stark, Holger ;
Cador, Martine ;
Bezard, Erwan ;
Bloch, Bertrand .
JOURNAL OF NEUROSCIENCE, 2009, 29 (15) :4829-4835
[3]   Personality, Addiction, Dopamine: Insights from Parkinson's Disease [J].
Dagher, Alain ;
Robbins, Trevor W. .
NEURON, 2009, 61 (04) :502-510
[4]   Opponent interactions between serotonin and dopamine [J].
Daw, ND ;
Kakade, S ;
Dayan, P .
NEURAL NETWORKS, 2002, 15 (4-6) :603-616
[5]   The human amygdala and orbital prefrontal cortex in behavioural regulation [J].
Dolan, R. J. .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2007, 362 (1481) :787-799
[6]  
Duvernoy H, 1999, HUMAN BRAIN SURFACE
[7]   Compulsive drug use linked to sensitized ventral striatal dopamine transmission [J].
Evans, AH ;
Pavese, N ;
Lawrence, AD ;
Tai, YF ;
Appel, S ;
Doder, M ;
Brooks, DJ ;
Lees, AJ ;
Piccini, P .
ANNALS OF NEUROLOGY, 2006, 59 (05) :852-858
[8]   Hold your horses: Impulsivity, deep brain stimulation, and medication in parkinsonism [J].
Frank, Michael J. ;
Samanta, Johan ;
Moustafa, Ahmed A. ;
Sherman, Scott J. .
SCIENCE, 2007, 318 (5854) :1309-1312
[9]   Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning [J].
Frank, Michael J. ;
Moustafa, Ahmed A. ;
Haughey, Heather M. ;
Curran, Tim ;
Hutchison, Kent E. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (41) :16311-16316
[10]   By carrot or by stick: Cognitive reinforcement learning in Parkinsonism [J].
Frank, MJ ;
Seeberger, LC ;
O'Reilly, RC .
SCIENCE, 2004, 306 (5703) :1940-1943