Discrete coding of reward probability and uncertainty by dopamine neurons

被引:1331
作者
Fiorillo, CD [1 ]
Tobler, PN
Schultz, W
机构
[1] Univ Fribourg, Inst Physiol, CH-1700 Fribourg, Switzerland
[2] Univ Cambridge, Dept Anat, Cambridge CB2 3DY, England
基金
英国惠康基金;
关键词
D O I
10.1126/science.1077349
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Uncertainty is critical in the measure of information and in assessing the accuracy of predictions. It is determined by probability P, being maximal. at P = 0.5 and decreasing at higher and lower probabilities. Using distinct stimuli to indicate the probability of reward, we found that the phasic activation of dopamine neurons varied monotonically across the full range of probabilities, supporting past claims that this response codes the discrepancy between predicted and actual reward. In contrast, a previously unobserved response co-varied with uncertainty and consisted of a gradual increase in activity until the potential time of reward. The coding of uncertainty suggests a possible role for dopamine signals in attention-based learning and risk-taking behavior.
引用
收藏
页码:1898 / 1902
页数:5
相关论文
共 23 条
  • [1] Learning and selective attention
    Dayan, Peter
    Kakade, Sham
    Montague, P. Read
    [J]. NATURE NEUROSCIENCE, 2000, 3 (11) : 1218 - 1223
  • [2] Dickinson A., 1980, CONT ANIMAL LEARNING
  • [3] Dynamic predictions: Oscillations and synchrony in top-down processing
    Engel, AK
    Fries, P
    Singer, W
    [J]. NATURE REVIEWS NEUROSCIENCE, 2001, 2 (10) : 704 - 716
  • [4] Efficiency and ambiguity in an adaptive neural code
    Fairhall, AL
    Lewen, GD
    Bialek, W
    van Steveninck, RRD
    [J]. NATURE, 2001, 412 (6849) : 787 - 792
  • [5] FIORILLO CD, UNPUB
  • [6] Gallistel C. R., 1990, ORG LEARNING
  • [7] Time, rate, and conditioning
    Gallistel, CR
    Gibbon, J
    [J]. PSYCHOLOGICAL REVIEW, 2000, 107 (02) : 289 - 344
  • [8] THE STRENGTH OF THE ORIENTING RESPONSE DURING PAVLOVIAN CONDITIONING
    KAYE, H
    PEARCE, JM
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES, 1984, 10 (01): : 90 - 109
  • [9] THEORY OF ATTENTION - VARIATIONS IN ASSOCIABILITY OF STIMULI WITH REINFORCEMENT
    MACKINTOSH, NJ
    [J]. PSYCHOLOGICAL REVIEW, 1975, 82 (04) : 276 - 298
  • [10] Hyperbolic value addition and general models of animal choice
    Mazur, JE
    [J]. PSYCHOLOGICAL REVIEW, 2001, 108 (01) : 96 - 112