Hierarchical MOSAIC for movement generation

被引:85
作者
Haruno, M [1 ]
Wolpert, DM [1 ]
Kawato, M [1 ]
机构
[1] ATR, Human Informat Sci Labs, Kyoto 6190288, Japan
来源
COGNITION AND EMOTION IN THE BRAIN | 2003年 / 1250卷
关键词
hierarchy; MOSAIC; predictors and controllers; internal model; cerebellum; cerebro-cerebellar communication loop;
D O I
10.1016/S0531-5131(03)00190-0
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Hierarchy plays a key role in human motor control and learning. We can generate a variety of structured motor sequences such as writing or speech and learn to combine elemental actions in novel orders. We previously proposed the Modular Selection and Identification for Control (MOSAIC) model to explain the remarkable ability animals show in motor learning, adaptation and behavioral switching. In this paper, we extend this to a hierarchical MOSAIC (HMOSAIC). Each layer of HMOSAIC consists of a MOSAIC, which is a set of paired control and predictive models. The higher-level MOSAIC receives two inputs: an abstract (symbolic) desired trajectory and posterior probabilities of its subordinate level, which represent which modules are playing a crucial role in the lower level under the current behavioral situation. The higher control model generates, as a motor command, prior probabilities for the lower-level modules, and therefore prioritizes which lower-level modules should be selected. In contrast, the higher predictive model learns to estimate the posterior probability at the next time step. The outputs from controllers as well as the learning of both predictors and controllers are weighted by the precision of the prediction. We first show that this bidirectional architecture provides a general framework capable of hierarchical motor learning that is chunking of movement patterns. Then, we discuss the similarities between the HMOSAIC architecture and the closed cerebro-cerebellar loop circuits recently found by Middleton and Strick (Trends in Neuroscience 21 (1998) 367). In our view, modules in one layer are involved with similar functions and assumed to be implemented by one of the cerebro-cerebellar loop circuits. These layers are then connected to each other by the bidirectional information flows within the cerebral cortex. (C) 2003 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:575 / 590
页数:16
相关论文
共 26 条
[1]   A computational model of how the basal ganglia produce sequences [J].
Berns, GS ;
Sejnowski, TJ .
JOURNAL OF COGNITIVE NEUROSCIENCE, 1998, 10 (01) :108-121
[2]   DISTRIBUTED REPRESENTATION OF LIMB MOTOR PROGRAMS IN ARRAYS OF ADJUSTABLE PATTERN GENERATORS [J].
BERTHIER, NE ;
SINGH, SP ;
BARTO, AG ;
HOUK, JC .
JOURNAL OF COGNITIVE NEUROSCIENCE, 1993, 5 (01) :56-78
[3]   Prefrontal cortex activation in task switching: an event-related fMRI study [J].
Dove, A ;
Pollmann, S ;
Schubert, T ;
Wiggins, CJ ;
von Cramon, DY .
COGNITIVE BRAIN RESEARCH, 2000, 9 (01) :103-109
[4]   ADAPTIVE NEURAL OSCILLATOR USING CONTINUOUS-TIME BACK-PROPAGATION LEARNING [J].
DOYA, K ;
YOSHIZAWA, S .
NEURAL NETWORKS, 1989, 2 (05) :375-385
[5]   Multiple model-based reinforcement learning [J].
Doya, K ;
Samejima, K ;
Katagiri, K ;
Kawato, M .
NEURAL COMPUTATION, 2002, 14 (06) :1347-1369
[6]   Temporal firing patterns of Purkinje cells in the cerebellar ventral paraflocculus during ocular following responses in monkeys I. Simple spikes [J].
Gomi, H ;
Shidara, M ;
Takemura, A ;
Inoue, Y ;
Kawano, K ;
Kawato, M .
JOURNAL OF NEUROPHYSIOLOGY, 1998, 80 (02) :818-831
[7]   MOSAIC model for sensorimotor learning and control [J].
Haruno, M ;
Wolpert, DM ;
Kawato, M .
NEURAL COMPUTATION, 2001, 13 (10) :2201-2220
[8]   Parallel neural networks for learning sequential procedures [J].
Hikosaka, O ;
Nakahara, H ;
Rand, MK ;
Sakai, K ;
Lu, XF ;
Nakamura, K ;
Miyachi, S ;
Doya, K .
TRENDS IN NEUROSCIENCES, 1999, 22 (10) :464-471
[9]  
HOUK JC, 1995, MODELS INFORMATION P
[10]   Human cerebellar activity reflecting an acquired internal model of a new tool [J].
Imamizu, H ;
Miyauchi, S ;
Tamada, T ;
Sasaki, Y ;
Takino, R ;
Pütz, B ;
Yoshioka, T ;
Kawato, M .
NATURE, 2000, 403 (6766) :192-195