How prediction errors shape perception, attention, and motivation

被引:279
作者
den Ouden, Hanneke E. M. [1 ,2 ]
Kok, Peter [1 ]
de Lange, Floris P. [1 ]
机构
[1] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, NL-6500 HB Nijmegen, Netherlands
[2] NYU, Ctr Neural Sci, New York, NY 10003 USA
来源
FRONTIERS IN PSYCHOLOGY | 2012年 / 3卷
关键词
prediction; prediction error; expectation; predictive coding; learning; perceptual inference; decision-making; MIDBRAIN DOPAMINE NEURONS; MEDIAL PREFRONTAL CORTEX; BASAL GANGLIA; ORBITOFRONTAL CORTEX; REWARD PROBABILITY; FRONTAL-CORTEX; RESPONSES; SIGNALS; MODEL; INFORMATION;
D O I
10.3389/fpsyg.2012.00548
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Prediction errors (PE) are a central notion in theoretical models of reinforcement learning, perceptual inference, decision-making and cognition, and prediction error signals have been reported across a wide range of brain regions and experimental paradigms. Here, we will make an attempt to see the forest for the trees and consider the commonalities and differences of reported PE signals in light of recent suggestions that the computation of PE forms a fundamental mode of brain function. We discuss where different types of PE are encoded, how they are generated, and the different functional roles they fulfill. We suggest that while encoding of PE is a common computation across brain regions, the content and function of these error signals can be very different and are determined by the afferent and efferent connections within the neural circuitry in which they arise.
引用
收藏
页数:12
相关论文
共 134 条
[91]   A NUMERICAL-ANALYSIS OF THE GENICULOCORTICAL INPUT TO STRIATE CORTEX IN THE MONKEY [J].
PETERS, A ;
PAYNE, BR ;
BUDD, J .
CEREBRAL CORTEX, 1994, 4 (03) :215-229
[92]   Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects [J].
Rao, RPN ;
Ballard, DH .
NATURE NEUROSCIENCE, 1999, 2 (01) :79-87
[93]   Top-down effects on early visual processing in humans: A predictive coding framework [J].
Rauss, Karsten ;
Schwartz, Sophie ;
Pourtois, Gilles .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2011, 35 (05) :1237-1253
[94]   FUNCTIONAL PROPERTIES OF THE BASAL GANGLIA'S RE-ENTRANT LOOP ARCHITECTURE: SELECTION AND REINFORCEMENT [J].
Redgrave, P. ;
Vautrelle, N. ;
Reynolds, J. N. J. .
NEUROSCIENCE, 2011, 198 :138-151
[95]   The basal ganglia: A vertebrate solution to the selection problem? [J].
Redgrave, P ;
Prescott, TJ ;
Gurney, K .
NEUROSCIENCE, 1999, 89 (04) :1009-1023
[96]   The short-latency dopamine signal: a role in discovering novel actions? [J].
Redgrave, Peter ;
Gurney, Kevin .
NATURE REVIEWS NEUROSCIENCE, 2006, 7 (12) :967-975
[97]  
Rescorla R.A., 1972, Class. Cond. II: Curr. Res. Theory, V2, P64, DOI DOI 10.1101/GR.110528.110
[98]   Ventral-striatal/nucleus-accumbens sensitivity to prediction errors during classification learning [J].
Rodriguez, PF ;
Aron, AR ;
Poldrack, RA .
HUMAN BRAIN MAPPING, 2006, 27 (04) :306-313
[99]   DOPAMINE NEURONS OF THE MONKEY MIDBRAIN - CONTINGENCIES OF RESPONSES TO ACTIVE TOUCH DURING SELF-INITIATED ARM MOVEMENTS [J].
ROMO, R ;
SCHULTZ, W .
JOURNAL OF NEUROPHYSIOLOGY, 1990, 63 (03) :592-606
[100]   Shaping of Object Representations in the Human Medial Temporal Lobe Based on Temporal Regularities [J].
Schapiro, Anna C. ;
Kustner, Lauren V. ;
Turk-Browne, Nicholas B. .
CURRENT BIOLOGY, 2012, 22 (17) :1622-1627