NEURAL-GAS NETWORK FOR VECTOR QUANTIZATION AND ITS APPLICATION TO TIME-SERIES PREDICTION

被引:928
作者
MARTINETZ, TM [1 ]
BERKOVICH, SG [1 ]
SCHULTEN, KJ [1 ]
机构
[1] UNIV ILLINOIS, DEPT PHYS, URBANA, IL 61801 USA
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1993年 / 4卷 / 04期
基金
美国国家科学基金会;
关键词
D O I
10.1109/72.238311
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a data compression technique, vector quantization requires the minimization of a cost function-the distortion error-which, in general, has many local minima. In this paper, a neural network algorithm based on a ''soft-max'' adaptation rule is presented that exhibits good performance in reaching the optimum, or at least coming close. The soft-max rule employed is an extension of the standard K-means clustering procedure and takes into account a ''neighborhood ranking'' of the reference (weight) vectors. It is shown that the dynamics of the reference (weight) vectors during the input-driven adaptation procedure 1) is determined by the gradient of an energy function whose shape can be modulated through a neighborhood determining parameter, and 2) resembles the dynamics of Brownian particles moving in a potential determined by the data point density. The network is employed to represent the attractor of the Mackey-Glass equation and to predict the Mackey-Glass time series, with additional local linear mappings for generating output values. The results obtained for the time-series prediction compare very favorably with the results achieved by back-propagation and radial basis function networks.
引用
收藏
页码:558 / 569
页数:12
相关论文
共 33 条
[31]  
WALTER J, 1990, IJCNN 90 C P SAN DIE, V3, P589
[32]  
WALTER J, ARTIFICIAL NEURAL NE, V1, P357