A Dual Role for Prediction Error in Associative Learning

被引:224
作者
den Ouden, Hanneke E. M. [1 ]
Friston, Karl J. [1 ]
Daw, Nathaniel D. [2 ]
McIntosh, Anthony R. [3 ]
Stephan, Klaas E. [1 ,4 ]
机构
[1] UCL, Wellcome Trust Ctr Neuroimaging, Inst Neurol, London WC1N 3BG, England
[2] NYU, Dept Psychol, New York, NY 10003 USA
[3] Univ Toronto, Rotman Res Inst, Baycrest Ctr, Toronto, ON M6A 2E1, Canada
[4] Univ Zurich, Branco Weiss Lab, Inst Empir Res Econ, CH-8006 Zurich, Switzerland
基金
英国惠康基金;
关键词
associative learning; cross-modal; dynamic causal modeling; effective connectivity; fMRI; Rescorla-Wagner model; TEMPORAL DIFFERENCE MODELS; DYNAMIC CAUSAL-MODELS; FRONTAL-CORTEX; MISMATCH NEGATIVITY; AUDITORY-CORTEX; VISUAL-CORTEX; BRAIN-REGIONS; REWARD; HUMANS; INTEGRATION;
D O I
10.1093/cercor/bhn161
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Confronted with a rich sensory environment, the brain must learn statistical regularities across sensory domains to construct causal models of the world. Here, we used functional magnetic resonance imaging and dynamic causal modeling (DCM) to furnish neurophysiological evidence that statistical associations are learnt, even when task-irrelevant. Subjects performed an audio-visual target-detection task while being exposed to distractor stimuli. Unknown to them, auditory distractors predicted the presence or absence of subsequent visual distractors. We modeled incidental learning of these associations using a Rescorla-Wagner (RW) model. Activity in primary visual cortex and putamen reflected learning-dependent surprise: these areas responded progressively more to unpredicted, and progressively less to predicted visual stimuli. Critically, this prediction-error response was observed even when the absence of a visual stimulus was surprising. We investigated the underlying mechanism by embedding the RW model into a DCM to show that auditory to visual connectivity changed significantly over time as a function of prediction error. Thus, consistent with predictive coding models of perception, associative learning is mediated by prediction-error dependent changes in connectivity. These results posit a dual role for prediction-error in encoding surprise and driving associative plasticity.
引用
收藏
页码:1175 / 1185
页数:11
相关论文
共 63 条
[1]   Modeling geometric deformations in EPI time series [J].
Andersson, JLR ;
Hutton, C ;
Ashburner, J ;
Turner, R ;
Friston, K .
NEUROIMAGE, 2001, 13 (05) :903-919
[2]   Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning [J].
Aron, AR ;
Shohamy, D ;
Clark, J ;
Myers, C ;
Gluck, MA ;
Poldrack, RA .
JOURNAL OF NEUROPHYSIOLOGY, 2004, 92 (02) :1144-1152
[3]   Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information [J].
Baier, Bernhard ;
Kleinschmidt, Andreas ;
Mueller, Notger G. .
JOURNAL OF NEUROSCIENCE, 2006, 26 (47) :12260-12265
[4]   Repetition effects to sounds: evidence for predictive coding in the auditory system [J].
Baldeweg, T .
TRENDS IN COGNITIVE SCIENCES, 2006, 10 (03) :93-94
[5]   Central cancellation of self-produced tickle sensation [J].
Blakemore, SJ ;
Wolpert, DM ;
Frith, CD .
NATURE NEUROSCIENCE, 1998, 1 (07) :635-640
[6]   Sensory pre-conditioning [J].
Brogden, WJ .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1939, 25 (04) :323-332
[7]  
Büchel C, 1999, SCIENCE, V283, P1538, DOI 10.1126/science.283.5407.1538
[8]   Prediction error during retrospective revaluation of causal associations in humans: fMRI evidence in favor of an associative model of learning [J].
Corlett, PR ;
Aitken, MRF ;
Dickinson, A ;
Shanks, DR ;
Honey, GD ;
Honey, RAE ;
Robbins, TW ;
Bullmore, ET ;
Fletcher, PC .
NEURON, 2004, 44 (05) :877-888
[9]   EVOKED-POTENTIAL CORRELATES OF STIMULUS DEVIANCE DURING WAKEFULNESS AND SLEEP IN CAT - ANIMAL-MODEL OF MISMATCH NEGATIVITY [J].
CSEPE, V ;
KARMOS, G ;
MOLNAR, M .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1987, 66 (06) :571-578
[10]   Dynamic causal modeling of evoked responses in EEG and MEG [J].
David, Olivier ;
Kiebel, Stefan J. ;
Harrison, Lee M. ;
Mattout, Jrmie ;
Kilner, James M. ;
Friston, Karl J. .
NEUROIMAGE, 2006, 30 (04) :1255-1272