Rival-model penalized self-organizing map

被引:39
作者
Cheung, Yiu-ming [1 ]
Law, Lap-tak [1 ]
机构
[1] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2007年 / 18卷 / 01期
关键词
constant learning rate; rival-model penalized self-organizing map (RPSOM); self-organizing map (SOM);
D O I
10.1109/TNN.2006.885039
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a typical data visualization technique, self-organizing map (SOM) has been extensively applied to data clustering, image analysis, dimension reduction, and so forth. In a conventional adaptive SOM, it needs to choose an appropriate learning rate whose value is monotonically reduced over time to ensure the convergence of the map, meanwhile being kept large enough so that the map is able to gradually learn the data topology. Otherwise, the SOM's performance may seriously deteriorate. In general, it is nontrivial to choose an appropriate monotonically decreasing function for such a learning rate. In this letter, we therefore propose a novel rival-model penalized self-organizing map (RPSOM) learning algorithm that, for each input, adaptively chooses several rivals of the best-matching unit (BMU) and penalizes their associated models, i.e., those parametric real vectors with the same dimension as the input vectors, a little far away from the input. Compared to the existing methods, this RPSOM utilizes a constant learning rate to circumvent the awkward selection of a monotonically decreased function for the learning rate, but still reaches a robust result. The numerical experiments have shown the efficacy of our algorithm.
引用
收藏
页码:289 / 295
页数:7
相关论文
共 17 条
[11]  
Kohonen T, 2001, SELF ORG MAPS, DOI [10.1007/978-3-642-56927-2_1, DOI 10.1007/978-3-642-56927-2_1]
[12]  
Laaksonen J, 1999, IEE CONF PUBL, P174, DOI 10.1049/cp:19991104
[13]  
Law LT, 2004, PROCEEDINGS OF THE SECOND IASTED INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND COMPUTATIONAL INTELLIGENCE, P142
[14]  
Vesanto J., 1999, Intelligent Data Analysis, V3, P111, DOI 10.1016/S1088-467X(99)00013-X
[15]   RIVAL PENALIZED COMPETITIVE LEARNING FOR CLUSTERING ANALYSIS, RBF NET, AND CURVE DETECTION [J].
XU, L ;
KRZYZAK, A ;
OJA, E .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (04) :636-649
[16]  
Yang H., 1992, P ACM SIGAPP S APPL, P412
[17]  
YIN H, 1993, P 3 INT C ART NEUR N, P182