Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors

被引：54

作者：

Fiorillo, Christopher D. ^{[1
]}

Tobler, Philippe N. ^{[2
]}

Schultz, Wolfram ^{[2
]}

机构：

[1] Stanford Univ, Dept Neurobiol, Stanford, CA 94305 USA

[2] Univ Cambridge, Dept Anat, Cambridge CB2 3DY, England

来源：

BEHAVIORAL AND BRAIN FUNCTIONS | 2005年 / 1卷 / 1期

基金：

英国惠康基金;

关键词：

Conditioned Stimulus; Prediction Error; Firing Rate; Dopamine Neuron; Single Trial;

D O I：

10.1186/1744-9081-1-7

中图分类号：

B84 [心理学]; C [社会科学总论]; Q98 [人类学];

学科分类号：

03 ; 0303 ; 030303 ; 04 ; 0402 ;

摘要：

引用

页数：5

共 13 条

[1]

Brown J, 1999, J NEUROSCI, V19, P10502

[2] NONLINEAR RELATIONSHIP BETWEEN IMPULSE FLOW, DOPAMINE RELEASE AND DOPAMINE ELIMINATION IN THE RAT-BRAIN IN-VIVO [J].

CHERGUI, K ;

SUAUDCHAGNY, MF ;

GONON, F .

NEUROSCIENCE, 1994, 62 (03) :641-645

[3] Discrete coding of reward probability and uncertainty by dopamine neurons [J].

Fiorillo, CD ;

Tobler, PN ;

Schultz, W .

SCIENCE, 2003, 299 (5614) :1898-1902

[4] Dopamine neurons report an error in the temporal prediction of reward during learning [J].

Hollerman, JR ;

Schultz, W .

NATURE NEUROSCIENCE, 1998, 1 (04) :304-309

[5] A representation of the hazard rate of elapsed time in macaque area LIP [J].

Janssen, P ;

Shadlen, MN .

NATURE NEUROSCIENCE, 2005, 8 (02) :234-241

[6] Dopamine: generalization and bonuses [J].

Kakade, S ;

Dayan, P .

NEURAL NETWORKS, 2002, 15 (4-6) :549-559

[7] A framework for mesencephalic dopamine systems based on predictive Hebbian learning [J].

Montague, PR ;

Dayan, P ;

Sejnowski, TJ .

JOURNAL OF NEUROSCIENCE, 1996, 16 (05) :1936-1947

[8] Dopamine, uncertainty and TD learning [J].

Niv, Yael ;

Duff, Michael O. ;

Dayan, Peter .

BEHAVIORAL AND BRAIN FUNCTIONS, 2005, 1 (1)

[9] A neural substrate of prediction and reward [J].

Schultz, W ;

Dayan, P ;

Montague, PR .

SCIENCE, 1997, 275 (5306) :1593-1599

[10] A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task [J].

Suri, RE ;

Schultz, W .

NEUROSCIENCE, 1999, 91 (03) :871-890

← 1 2 →