Dialogues on prediction errors

被引:212
作者
Niv, Yael [1 ,2 ]
Schoenbaum, Geoffrey [3 ,4 ]
机构
[1] Princeton Univ, Ctr Study Brain Mind & Behav, Princeton, NJ 08544 USA
[2] Princeton Univ, Dept Psychol, Princeton, NJ 08544 USA
[3] Univ Maryland, Sch Med, Dept Anat & Neurobiol, Baltimore, MD 21201 USA
[4] Univ Maryland, Sch Med, Dept Psychiat, Baltimore, MD 21201 USA
关键词
D O I
10.1016/j.tics.2008.03.006
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
The recognition that computational ideas from reinforcement learning are relevant to the study of neural circuits has taken the cognitive neuroscience community by storm. A central tenet of these models is that discrepancies between actual and expected outcomes can be used for learning. Neural correlates of such prediction-error signals have been observed now in midbrain dopaminergic neurons, striatum, amygdala and even prefrontal cortex, and models incorporating prediction errors have been invoked to explain complex phenomena such as the transition from goal-directed to habitual behavior. Yet, like any revolution, the fast-paced progress has left an uneven understanding in its wake. Here, we provide answers to ten simple questions about prediction errors, with the aim of exposing both the strengths and the limitations of this active area of neuroscience research.
引用
收藏
页码:265 / 272
页数:8
相关论文
共 61 条
[1]   The neural basis of functional brain imaging signals [J].
Attwell, D ;
Iadecola, C .
TRENDS IN NEUROSCIENCES, 2002, 25 (12) :621-625
[2]  
Barto AG., 1995, Models of information processing in the basal ganglia, P215
[3]   Statistics of midbrain dopamine neuron spike trains in the awake primate [J].
Bayer, Hannah M. ;
Lau, Brian ;
Glimcher, Paul W. .
JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (03) :1428-1439
[4]   Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala [J].
Belova, Marina A. ;
Paton, Joseph J. ;
Morrison, Sara E. ;
Salzman, C. Daniel .
NEURON, 2007, 55 (06) :970-984
[5]   The debate over dopamine's role in reward: the case for incentive salience [J].
Berridge, Kent C. .
PSYCHOPHARMACOLOGY, 2007, 191 (03) :391-431
[6]  
Carelli RM, 2003, J NEUROSCI, V23, P11214
[7]   Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. 'natural' reinforcement [J].
Carelli, RM .
PHYSIOLOGY & BEHAVIOR, 2002, 76 (03) :379-387
[8]  
CHRISTOPH GR, 1986, J NEUROSCI, V6, P613
[9]   Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat [J].
Coizet, V ;
Dommett, EJ ;
Redgrave, P ;
Overton, PG .
NEUROSCIENCE, 2006, 139 (04) :1479-1493
[10]   Rapid alterations in corticostriatal ensemble coordination during acute dopamine-dependent motor dysfunction [J].
Costa, Rui M. ;
Lin, Shih-Chieh ;
Sotnikova, Tatyana D. ;
Cyr, Michel ;
Gainetdinov, Raul R. ;
Caron, Marc G. ;
Nicolelis, Miguel A. L. .
NEURON, 2006, 52 (02) :359-369