Striatal Prediction Error Modulates Cortical Coupling

被引:210
作者
den Ouden, Hanneke E. M. [1 ,3 ]
Daunizeau, Jean [1 ,4 ]
Roiser, Jonathan [2 ]
Friston, Karl J. [1 ]
Stephan, Klaas E. [1 ,4 ]
机构
[1] UCL, Inst Neurol, Wellcome Trust Ctr Neuroimaging, London WC1E 6BT, England
[2] UCL, Inst Cognit Neurosci, London WC1E 6BT, England
[3] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, Ctr Cognit Neuroimaging, NL-6525 EN Nijmegen, Netherlands
[4] Univ Zurich, Lab Social & Neural Syst Res, Inst Empir Res Econ, CH-8006 Zurich, Switzerland
基金
英国惠康基金;
关键词
TEMPORAL DIFFERENCE MODELS; SACCADIC EYE-MOVEMENTS; DYNAMIC CAUSAL-MODELS; PREMOTOR CORTEX; MACAQUE MONKEY; CORTICOSPINAL EXCITABILITY; BASAL GANGLIA; FREE-ENERGY; VISUOSPATIAL ATTENTION; REWARD PREDICTION;
D O I
10.1523/JNEUROSCI.4458-09.2010
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Both perceptual inference and motor responses are shaped by learned probabilities. For example, stimulus-induced responses in sensory cortices and preparatory activity in premotor cortex reflect how (un)expected a stimulus is. This is in accordance with predictive coding accounts of brain function, which posit a fundamental role of prediction errors for learning and adaptive behavior. We used functional magnetic resonance imaging and recent advances in computational modeling to investigate how (failures of) learned predictions about visual stimuli influence subsequent motor responses. Healthy volunteers discriminated visual stimuli that were differentially predicted by auditory cues. Critically, the predictive strengths of cues varied over time, requiring subjects to continuously update estimates of stimulus probabilities. This online inference, modeled using a hierarchical Bayesian learner, was reflected behaviorally: speed and accuracy of motor responses increased significantly with predictability of the stimuli. We used nonlinear dynamic causal modeling to demonstrate that striatal prediction errors are used to tune functional coupling in cortical networks during learning. Specifically, the degree of striatal trial-by-trial prediction error activity controls the efficacy of visuomotor connections and thus the influence of surprising stimuli on premotor activity. This finding substantially advances our understanding of striatal function and provides direct empirical evidence for formal learning theories that posit a central role for prediction error-dependent plasticity.
引用
收藏
页码:3210 / 3219
页数:10
相关论文
共 81 条
[1]   The effect of stimulus probability on the somatosensory mismatch field [J].
Akatsuka, Kosuke ;
Wasaka, Toshiaki ;
Nakata, Hiroki ;
Kida, Tetsuo ;
Kakigi, Ryusuke .
EXPERIMENTAL BRAIN RESEARCH, 2007, 181 (04) :607-614
[2]   FUNCTIONAL ARCHITECTURE OF BASAL GANGLIA CIRCUITS - NEURAL SUBSTRATES OF PARALLEL PROCESSING [J].
ALEXANDER, GE ;
CRUTCHER, MD .
TRENDS IN NEUROSCIENCES, 1990, 13 (07) :266-271
[3]   Modeling geometric deformations in EPI time series [J].
Andersson, JLR ;
Hutton, C ;
Ashburner, J ;
Turner, R ;
Friston, K .
NEUROIMAGE, 2001, 13 (05) :903-919
[4]   Unified segmentation [J].
Ashburner, J ;
Friston, KJ .
NEUROIMAGE, 2005, 26 (03) :839-851
[5]   Learning the value of information in an uncertain world [J].
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Walton, Mark E. ;
Rushworth, Matthew F. S. .
NATURE NEUROSCIENCE, 2007, 10 (09) :1214-1221
[6]   Influence of uncertainty and surprise on human corticospinal excitability during preparation for action [J].
Bestmann, Sven ;
Harrison, Lee M. ;
Blankenburg, Felix ;
Mars, Rogier B. ;
Haggard, Patrick ;
Friston, Karl J. ;
Rothwell, John C. .
CURRENT BIOLOGY, 2008, 18 (10) :775-780
[7]   Integrated Bayesian models of learning and decision making for saccadic eye movements [J].
Brodersen, Kay H. ;
Penny, Will D. ;
Harrison, Lee M. ;
Daunizeau, Jean ;
Ruff, Christian C. ;
Duzel, Emrah ;
Friston, Karl J. ;
Stephan, Klaas E. .
NEURAL NETWORKS, 2008, 21 (09) :1247-1260
[8]   NEURAL COMPUTATION OF LOG LIKELIHOOD IN CONTROL OF SACCADIC EYE-MOVEMENTS [J].
CARPENTER, RHS ;
WILLIAMS, MLL .
NATURE, 1995, 377 (6544) :59-62
[9]   Differential responses in human striatum and prefrontal cortex to changes in object and rule relevance [J].
Cools, R ;
Clark, L ;
Robbins, TW .
JOURNAL OF NEUROSCIENCE, 2004, 24 (05) :1129-1135
[10]   The human striatum is necessary for responding to changes in stimulus relevance [J].
Cools, R. ;
Ivry, R. B. ;
D'Esposito, M. .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2006, 18 (12) :1973-1983