Neuroelectric Signatures of Reward Learning and Decision-Making in the Human Nucleus Accumbens

被引:58
作者
Cohen, Michael X. [1 ,2 ,3 ]
Axmacher, Nikolai [1 ,2 ]
Lenartz, Doris [5 ]
Elger, Christian E. [1 ,2 ]
Sturm, Volker [5 ]
Schlaepfer, Thomas E. [4 ,6 ]
机构
[1] Univ Bonn, Dept Epileptol, D-53105 Bonn, Germany
[2] Univ Bonn, Ctr Life & Brain, D-53105 Bonn, Germany
[3] Univ Calif Davis, Dept Psychol, Davis, CA 95616 USA
[4] Univ Bonn, Dept Psychiat & Psychotherapy, D-53105 Bonn, Germany
[5] Univ Cologne, Dept Stereotact Neurosurg, Cologne, Germany
[6] Johns Hopkins Univ, Dept Psychiat, Baltimore, MD USA
关键词
nucleus accumbens; risk-taking; reward; prediction error; intracranial EEG; motivation; DEEP BRAIN-STIMULATION; MEDIAL FRONTAL-CORTEX; RAT PREFRONTAL CORTEX; VENTRAL STRIATUM; IN-VIVO; PREDICTION ERRORS; NEURONAL-ACTIVITY; MAJOR DEPRESSION; DOPAMINE NEURONS; DORSAL STRIATUM;
D O I
10.1038/npp.2008.222
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Learning that certain actions lead to risky rewards is critical for biological, social, and economic survival, but the precise neural mechanisms of such reward-guided learning remain unclear. Here, we show that the human nucleus accumbens plays a key role in learning about risks by representing reward value. We recorded electrophysiological activity directly from the nucleus accumbens of five patients undergoing deep brain stimulation for treatment of refractory major depression. Patients engaged in a simple reward-learning task in which they first learned stimulus-outcome associations (learning task), and then were able to choose from among the learned stimuli (choosing task). During the learning task, nucleus accumbens activity reflected potential and received reward values both during the cue stimulus and during the feedback. During the choosing task, there was no nucleus accumbens activity during the cue stimulus, but feedback-related activity was pronounced and similar to that during the learning task. This pattern of results is inconsistent with a prediction error response. Finally, analyses of cross-correlations between the accumbens and simultaneous recordings of medial frontal cortex suggest a dynamic interaction between these structures. The high spatial and temporal resolution of these recordings provides novel insights into the timing of activity in the human nucleus accumbens, its functions during reward-guided learning and decision-making, and its interactions with medial frontal cortex. Neuropsychopharmacology (2009) 34, 1649-1658; doi:10.1038/npp.2008.222; published online 17 December 2008
引用
收藏
页码:1649 / 1658
页数:10
相关论文
共 62 条
  • [11] Neural systems implicated in delayed and probabilistic reinforcement
    Cardinal, Rudolf N.
    [J]. NEURAL NETWORKS, 2006, 19 (08) : 1277 - 1301
  • [12] Cellular mechanisms underlying reinforcement-related processing in the nucleus accumbens, electrophysiological studies in behaving animals
    Carelli, RM
    Deadwyler, SA
    [J]. PHARMACOLOGY BIOCHEMISTRY AND BEHAVIOR, 1997, 57 (03) : 495 - 504
  • [13] Projections from the rat prefrontal cortex to the ventral tegmental area: Target specificity in the synaptic associations with mesoaccumbens and mesocortical neurons
    Carr, DB
    Sesack, SR
    [J]. JOURNAL OF NEUROSCIENCE, 2000, 20 (10) : 3864 - 3873
  • [14] Reinforcement learning signals predict future decisions
    Cohen, Michael X.
    Ranganath, Charan
    [J]. JOURNAL OF NEUROSCIENCE, 2007, 27 (02) : 371 - 378
  • [15] Functional connectivity with anterior cingulate and orbitofrontal cortices during decision-making
    Cohen, MX
    Heller, AS
    Ranganath, C
    [J]. COGNITIVE BRAIN RESEARCH, 2005, 23 (01): : 61 - 70
  • [16] Relative reward processing in primate striatum
    Cromwell, HC
    Hassani, OK
    Schultz, W
    [J]. EXPERIMENTAL BRAIN RESEARCH, 2005, 162 (04) : 520 - 525
  • [17] The nucleus accumbens and pavlovian reward learning
    Day, Jeremy J.
    Carelli, Regina M.
    [J]. NEUROSCIENTIST, 2007, 13 (02) : 148 - 159
  • [18] Tracking the hemodynamic responses to reward and punishment in the striatum
    Delgado, MR
    Nystrom, LE
    Fissell, C
    Noll, DC
    Fiez, JA
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2000, 84 (06) : 3072 - 3077
  • [19] Lack of ventral striatal response to positive stimuli in depressed versus normal subjects
    Epstein, Jane
    Pan, Hong
    Kocsis, James H.
    Yang, Yihong
    Butler, Tracy
    Chusid, Jesse
    Hochberg, Hilary
    Murrough, James
    Strohmayer, Erika
    Stern, Emily
    Silbersweig, David A.
    [J]. AMERICAN JOURNAL OF PSYCHIATRY, 2006, 163 (10) : 1784 - 1790
  • [20] Amygdala and nucleus accumbens in responses to receipt and omission of gains in adults and adolescents
    Ernst, M
    Nelson, EE
    Jazbec, S
    McClure, EB
    Monk, CS
    Leibenluft, E
    Blair, J
    Pine, DS
    [J]. NEUROIMAGE, 2005, 25 (04) : 1279 - 1291