Rival-model penalized self-organizing map

被引:39
作者
Cheung, Yiu-ming [1 ]
Law, Lap-tak [1 ]
机构
[1] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2007年 / 18卷 / 01期
关键词
constant learning rate; rival-model penalized self-organizing map (RPSOM); self-organizing map (SOM);
D O I
10.1109/TNN.2006.885039
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a typical data visualization technique, self-organizing map (SOM) has been extensively applied to data clustering, image analysis, dimension reduction, and so forth. In a conventional adaptive SOM, it needs to choose an appropriate learning rate whose value is monotonically reduced over time to ensure the convergence of the map, meanwhile being kept large enough so that the map is able to gradually learn the data topology. Otherwise, the SOM's performance may seriously deteriorate. In general, it is nontrivial to choose an appropriate monotonically decreasing function for such a learning rate. In this letter, we therefore propose a novel rival-model penalized self-organizing map (RPSOM) learning algorithm that, for each input, adaptively chooses several rivals of the best-matching unit (BMU) and penalizes their associated models, i.e., those parametric real vectors with the same dimension as the input vectors, a little far away from the input. Compared to the existing methods, this RPSOM utilizes a constant learning rate to circumvent the awkward selection of a monotonically decreased function for the learning rate, but still reaches a robust result. The numerical experiments have shown the efficacy of our algorithm.
引用
收藏
页码:289 / 295
页数:7
相关论文
共 17 条
[1]  
[Anonymous], 1999, MATL DSP C ESP FINL
[2]  
[Anonymous], THESIS HELSINKI U TE
[3]   On rival penalization controlled competitive learning for clustering with automatic cluster number selection [J].
Cheung, YM .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (11) :1583-1588
[4]  
CHEUNG YM, 2002, P 9 INT C NEUR INF P, V2, P467
[5]   The use of multiple measurements in taxonomic problems [J].
Fisher, RA .
ANNALS OF EUGENICS, 1936, 7 :179-188
[6]  
Flexer A., 2001, Intelligent Data Analysis, V5, P373
[7]   Self-organizing feature map with a momentum term [J].
Hagiwara, M .
NEUROCOMPUTING, 1996, 10 (01) :71-81
[8]  
HONKELA T, 1997, P WSOM 97 WORKSH SEL, P310
[9]  
Kaski S., 1998, NEURAL COMPUTING SUR, V1, P102
[10]  
KOHONEN T, 1993, P IEEE INT C NEUR NE, V3, P1147, DOI DOI 10.1109/ICNN.1993.298719