Neural differentiation of expected reward and risk in human subcortical structures

被引:458
作者
Preuschoff, Kerstin
Bossaerts, Peter
Quartz, Steven R.
机构
[1] CALTECH, Computat & Neural Syst Program, Social Cognit Neurosci Lab, Pasadena, CA 91125 USA
[2] CALTECH, Div Humanities & Social Sci, Pasadena, CA 91125 USA
基金
美国国家科学基金会;
关键词
D O I
10.1016/j.neuron.2006.06.024
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
In decision-making under uncertainty, economic studies emphasize the importance of risk in addition to expected reward. Studies in neuroscience focus on expected reward and learning rather than risk. We combined functional imaging with a simple gambling task to vary expected reward and risk simultaneously and in an uncorrelated manner. Drawing on financial decision theory, we modeled expected reward as mathematical expectation of reward, and risk as reward variance. Activations in dopaminoceptive structures correlated with both mathematical parameters. These activations differentiated spatially and temporally. Temporally, the activation related to expected reward was immediate, while the activation related to risk was delayed. Analyses confirmed that our paradigm minimized confounds from learning, motivation, and salience. These results suggest that the primary task of the dopaminergic system is to convey signals of upcoming stochastic rewards, such as expected reward and risk, beyond its role in learning, motivation, and salience.
引用
收藏
页码:381 / 390
页数:10
相关论文
共 54 条
  • [41] EQUILIBRIUM IN A CAPITAL ASSET MARKET
    MOSSIN, J
    [J]. ECONOMETRICA, 1966, 34 (04) : 768 - +
  • [42] Dopamine, uncertainty and TD learning
    Niv, Yael
    Duff, Michael O.
    Dayan, Peter
    [J]. BEHAVIORAL AND BRAIN FUNCTIONS, 2005, 1 (1)
  • [43] Neural responses during anticipation of a primary taste reward
    O'Doherty, JP
    Deichmann, R
    Critchley, HD
    Dolan, RJ
    [J]. NEURON, 2002, 33 (05) : 815 - 826
  • [44] ANIMAL CHOICE BEHAVIOR AND THE EVOLUTION OF COGNITIVE ARCHITECTURE
    REAL, LA
    [J]. SCIENCE, 1991, 253 (5023) : 980 - 986
  • [45] DOPAMINE NEURONS OF THE MONKEY MIDBRAIN - CONTINGENCIES OF RESPONSES TO ACTIVE TOUCH DURING SELF-INITIATED ARM MOVEMENTS
    ROMO, R
    SCHULTZ, W
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 1990, 63 (03) : 592 - 606
  • [46] A brain imaging study of the choice procedure
    Rustichini, A
    Dickhaut, J
    Ghirardato, P
    Smith, K
    Pardo, JV
    [J]. GAMES AND ECONOMIC BEHAVIOR, 2005, 52 (02) : 257 - 282
  • [47] Samuelson W., 1988, J RISK UNCERTAINTY, V1, P7, DOI [10.1007/BF00055564, DOI 10.1007/BF00055564]
  • [48] CAPITAL-ASSET PRICES - A THEORY OF MARKET EQUILIBRIUM UNDER CONDITIONS OF RISK
    SHARPE, WF
    [J]. JOURNAL OF FINANCE, 1964, 19 (03) : 425 - 442
  • [49] Schizophrenia patients demonstrate a distinctive pattern of decision-making impairment on the Iowa Gambling Task
    Shurman, B
    Horan, WP
    Ntuechterlein, KH
    [J]. SCHIZOPHRENIA RESEARCH, 2005, 72 (2-3) : 215 - 224
  • [50] Sutton R. S., 1988, Machine Learning, V3, P9, DOI 10.1023/A:1022633531479