Frontal Oscillatory Dynamics Predict Feedback Learning and Action Adjustment

被引:135
作者
van de Vijver, Irene [1 ]
Ridderinkhof, K. Richard
Cohen, Michael X. [2 ]
机构
[1] Univ Amsterdam, Dept Psychol, NL-1018 WB Amsterdam, Netherlands
[2] Univ Arizona, Tucson, AZ 85721 USA
关键词
ANTERIOR CINGULATE CORTEX; ERROR-RELATED NEGATIVITY; PREFRONTAL CORTEX; DECISION-MAKING; REWARD PREDICTION; NEURONAL COHERENCE; COGNITIVE CONTROL; BRAIN POTENTIALS; EEG DYNAMICS; THETA;
D O I
10.1162/jocn_a_00110
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Frontal oscillatory dynamics in the theta (4-8 Hz) and beta (20-30 Hz) frequency bands have been implicated in cognitive control processes. Here we investigated the changes in coordinated activity within and between frontal brain areas during feedback-based response learning. In a time estimation task, participants learned to press a button after specific, randomly selected time intervals (300-2000 msec) using the feedback after each button press (correct, too fast, too slow). Consistent with previous findings, theta-band activity over medial frontal scalp sites (presumably reflecting medial frontal cortex activity) was stronger after negative feedback, whereas beta-band activity was stronger after positive feedback. Theta-band power predicted learning only after negative feedback, and beta-band power predicted learning after positive and negative feedback. Furthermore, negative feedback increased theta-band intersite phase synchrony (a millisecond resolution measure of functional connectivity) among right lateral prefrontal, medial frontal, and sensorimotor sites. These results demonstrate the importance of frontal theta-and beta-band oscillations and intersite communication in the realization of reinforcement learning.
引用
收藏
页码:4106 / 4121
页数:16
相关论文
共 59 条
[1]   Oscillations and Filtering Networks Support Flexible Routing of Information [J].
Akam, Thomas ;
Kullmann, Dimitri M. .
NEURON, 2010, 67 (02) :308-320
[2]   Functional coupling between anterior prefrontal cortex (BA10) and hand muscle contraction during intentional and imitative motor acts [J].
Babiloni, Claudio ;
Vecchio, Fabrizio ;
Bares, Martin ;
Brazdil, Milan ;
Nestrasil, Igor ;
Eusebi, Fabrizio ;
Rossini, Paolo Maria ;
Rektor, Ivan .
NEUROIMAGE, 2008, 39 (03) :1314-1323
[3]   Learning the value of information in an uncertain world [J].
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Walton, Mark E. ;
Rushworth, Matthew F. S. .
NATURE NEUROSCIENCE, 2007, 10 (09) :1214-1221
[4]   Learning-related changes in reward expectancy are reflected in the feedback-related negativity [J].
Bellebaum, Christian ;
Daum, Irene .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2008, 27 (07) :1823-1835
[5]   Conflict monitoring and anterior cingulate cortex: an update [J].
Botvinick, Matthew M. ;
Cohen, Jonathan D. ;
Carter, Cameron S. .
TRENDS IN COGNITIVE SCIENCES, 2004, 8 (12) :539-546
[6]   Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function [J].
Botvinick, Matthiew M. .
COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2007, 7 (04) :356-366
[7]   Learned predictions of error likelihood in the anterior cingulate cortex [J].
Brown, JW ;
Braver, TS .
SCIENCE, 2005, 307 (5712) :1118-1121
[8]   Frontal theta links prediction errors to behavioral adaptation in reinforcement learning [J].
Cavanagh, James F. ;
Frank, Michael J. ;
Klein, Theresa J. ;
Allen, John J. B. .
NEUROIMAGE, 2010, 49 (04) :3198-3209
[9]   Prelude to and Resolution of an Error: EEG Phase Synchrony Reveals Cognitive Control Dynamics during Action Monitoring [J].
Cavanagh, James F. ;
Cohen, Michael X. ;
Allen, John J. B. .
JOURNAL OF NEUROSCIENCE, 2009, 29 (01) :98-105
[10]   Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning [J].
Chase, Henry W. ;
Swainson, Rachel ;
Durham, Lucy ;
Benham, Laura ;
Cools, Roshan .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2011, 23 (04) :936-946