Flexible shaping: How learning in small steps helps

被引:111
作者
Krueger, Kai A. [1 ]
Dayan, Peter [1 ]
机构
[1] UCL, Gatsby Computat Neurosci Unit, London WC1N 3AR, England
关键词
PFC; Gating; Shaping; Sequence learning; Computational modeling; PREFRONTAL CORTEX; STIMULUS; MODELS; EXTINCTION; SELECTION; LESIONS;
D O I
10.1016/j.cognition.2008.11.014
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Humans and animals can perform much more complex tasks than they can acquire using pure trial and error learning. This gap is filled by teaching. One important method of instruction is shaping, in which a teacher decomposes a complete task into sub-components, thereby providing an easier path to learning. Despite its importance, shaping has not been substantially studied in the context of computational modeling of cognitive learning. Here we study the shaping of a hierarchical working memory task using an abstract neural network model as the target learner. Shaping significantly boosts the speed of acquisition of the task compared with conventional training, to a degree that increases with the temporal complexity of the task. Further, it leads to internal representations that are more robust to task manipulations such as reversals. We use the model to investigate some of the elements of successful shaping. (C) 2008 Elsevier B.V. All rights reserved
引用
收藏
页码:380 / 394
页数:15
相关论文
共 51 条
[1]  
[Anonymous], 1998, Robot shaping: an experiment in behavior engineering
[2]  
[Anonymous], 2001, INT C MACHINE LEARNI
[3]   Dissociable controlled retrieval and generalized selection mechanisms in ventrolateral prefrontal cortex [J].
Badre, D ;
Poldrack, RA ;
Paré-Blagoev, EJ ;
Insler, RZ ;
Wagner, AD .
NEURON, 2005, 47 (06) :907-918
[4]  
Bakker B., 2004, Proc. of the 8-th Conf. on Intelligent Autonomous Systems, P438
[5]  
Barto AG, 2003, DISCRETE EVENT DYN S, V13, P343
[6]   THE MISBEHAVIOR OF ORGANISMS [J].
BRELAND, K ;
BRELAND, M .
AMERICAN PSYCHOLOGIST, 1961, 16 (11) :681-684
[7]   Encoding a temporally structured stimulus with a temporally structured neural representation [J].
Brown, SL ;
Joseph, J ;
Stopfer, M .
NATURE NEUROSCIENCE, 2005, 8 (11) :1568-1576
[9]   Transfer of learning after updating training mediated by the striatum [J].
Dahlin, Erika ;
Neely, Anna Stigsdotter ;
Larsson, Anne ;
Backman, Lars ;
Nyberg, Lars .
SCIENCE, 2008, 320 (5882) :1510-1512
[10]   Phasic norepinephrine: A neural interrupt signal for unexpected events [J].
Dayan, Peter ;
Yu, Angela J. .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2006, 17 (04) :335-350