COARSE CODING RESOURCE-ALLOCATING NETWORK

被引:6
作者
DECO, G
EBMEYER, J
机构
关键词
D O I
10.1162/neco.1993.5.1.105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years localized receptive fields have been the subject of intensive research, due to their learning speed and efficient reconstruction of hypersurfaces. A very efficient implementation for such a network was proposed recently by Platt (1991). This resource-allocating network (RAN) allocates a new neuron whenever an unknown pattern is presented at its input layer. In this paper we introduce a new network architecture and learning paradigm. The aim of our approach is to incorporate ''coarse coding'' to the resource-allocating network. The network presented here provides for each input coordinate a separate layer, which consists of one-dimensional, locally tuned gaussian neurons. In the following layer multidimensional receptive fields are built by using pi-neurons. Linear neurons aggregate the outputs of the pi-neurons in order to approximate the required input-output mapping. The learning process follows the ideas of the resource-allocating network of Platt but due to the extended architecture of our network other improvements of the learning process had to be defined. Compared to the resource-allocating network a more compact network with comparable accuracy is obtained.
引用
收藏
页码:105 / 114
页数:10
相关论文
共 10 条
[1]  
[Anonymous], 1987, NONLINEAR SIGNAL PRO
[2]   Product Units: A Computationally Powerful and Biologically Plausible Extension to Backpropagation Networks [J].
Durbin, Richard ;
Rumelhart, David E. .
NEURAL COMPUTATION, 1989, 1 (01) :133-142
[3]   Layered Neural Networks with Gaussian Hidden Units as Universal Approximations [J].
Hartman, Eric J. ;
Keeler, James D. ;
Kowalski, Jacek M. .
NEURAL COMPUTATION, 1990, 2 (02) :210-215
[4]   OSCILLATION AND CHAOS IN PHYSIOLOGICAL CONTROL-SYSTEMS [J].
MACKEY, MC ;
GLASS, L .
SCIENCE, 1977, 197 (4300) :287-288
[5]   Fast Learning in Networks of Locally-Tuned Processing Units [J].
Moody, John ;
Darken, Christian J. .
NEURAL COMPUTATION, 1989, 1 (02) :281-294
[6]   A Resource-Allocating Network for Function Interpolation [J].
Platt, John .
NEURAL COMPUTATION, 1991, 3 (02) :213-225
[7]   NETWORKS FOR APPROXIMATION AND LEARNING [J].
POGGIO, T ;
GIROSI, F .
PROCEEDINGS OF THE IEEE, 1990, 78 (09) :1481-1497
[8]  
POGGIO T, 1990, AI1253 MIT ART INT L
[9]  
POGGIO T, 1990, AI1140 MIT ART INT L
[10]   LEARNING REPRESENTATIONS BY BACK-PROPAGATING ERRORS [J].
RUMELHART, DE ;
HINTON, GE ;
WILLIAMS, RJ .
NATURE, 1986, 323 (6088) :533-536