Adaptive Mixtures of Local Experts

被引:2572
作者
Jacobs, Robert A. [1 ]
Jordan, Michael I. [1 ]
Nowlan, Steven J. [2 ]
Hinton, Geoffrey E. [2 ]
机构
[1] MIT, Dept Brain & Cognit Sci, E25-618, Cambridge, MA 02139 USA
[2] Univ Toronto, Dept Comp Sci, Toronto, ON M5S 1A4, Canada
关键词
D O I
10.1162/neco.1991.3.1.79
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a new supervised learning procedure for systems composed of many separate networks, each of which learns to handle a subset of the complete set of training cases. The new procedure can be viewed either as a modular version of a multilayer supervised network, or as an associative version of competitive learning. It therefore provides a new link between these two apparently different approaches. We demonstrate that the learning procedure divides up a vowel discrimination task into appropriate subtasks, each of which can be solved by a very simple expert network.
引用
收藏
页码:79 / 87
页数:9
相关论文
共 9 条
  • [1] BARTO AG, 1985, HUM NEUROBIOL, V4, P229
  • [2] Hampshire J., 1989, CMUCS89166
  • [3] Jacobs R. A., 1991, COG SCI IN PRESS
  • [4] Jacobs R. A., 1991, LEARNING PIECE UNPUB
  • [5] McLachlan GJ., 1988, MIXTURE MODELS INFER
  • [6] Fast Learning in Networks of Locally-Tuned Processing Units
    Moody, John
    Darken, Christian J.
    [J]. NEURAL COMPUTATION, 1989, 1 (02) : 281 - 294
  • [7] Nowlan S. J., 1990, CRGTR905 U TOR
  • [8] Nowlan S.J., 1990, ADV NEURAL INFORM PR, P574
  • [9] CONTROL METHODS USED IN A STUDY OF THE VOWELS
    PETERSON, GE
    BARNEY, HL
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1952, 24 (02) : 175 - 184