Evolutionary design of nearest prototype classifiers

被引:47
作者
Fernández, F [1 ]
Isasi, P [1 ]
机构
[1] Univ Carlos III Madrid, Madrid 28911, Spain
关键词
classifier design; nearest prototype classifiers; evolutionary learning;
D O I
10.1023/B:HEUR.0000034715.70386.5b
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In pattern classification problems, many works have been carried out with the aim of designing good classifiers from different perspectives. These works achieve very good results in many domains. However, in general they are very dependent on some crucial parameters involved in the design. These parameters have to be found by a trial and error process or by some automatic methods, like heuristic search and genetic algorithms, that strongly decrease the performance of the method. For instance, in nearest prototype approaches, main parameters are the number of prototypes to use, the initial set, and a smoothing parameter. In this work, an evolutionary approach based on Nearest Prototype Classifier (ENPC) is introduced where no parameters are involved, thus overcoming all the problems that classical methods have in tuning and searching for the appropiate values. The algorithm is based on the evolution of a set of prototypes that can execute several operators in order to increase their quality in a local sense, and with a high classification accuracy emerging for the whole classifier. This new approach has been tested using four different classical domains, including such artificial distributions as spiral and uniform distibuted data sets, the Iris Data Set and an application domain about diabetes. In all the cases, the experiments show successfull results, not only in the classification accuracy, but also in the number and distribution of the prototypes achieved.
引用
收藏
页码:431 / 454
页数:24
相关论文
共 32 条
[21]   Probabilistic neural-network structure determination for pattern classification [J].
Mao, KZ ;
Tan, KC ;
Ser, W .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (04) :1009-1016
[22]  
MERELO JJ, 1998, ADV EVOLUTIONARY SYN
[23]   GENERALIZED CLUSTERING NETWORKS AND KOHONEN SELF-ORGANIZING SCHEME [J].
PAL, NR ;
BEZDEK, JC ;
TSAO, ECK .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (04) :549-557
[24]   The enhanced LBG algorithm [J].
Patané, Giuseppe ;
Russo, Marco .
Neural Networks, 2001, 14 (09) :1219-1237
[25]  
PEREZ JC, 1993, LECT NOTES COMPUTER, V686
[26]  
Quinlan J. R., 2014, C4 5 PROGRAMS MACHIN
[27]   ALGORITHM FOR A SELECTIVE NEAREST NEIGHBOR DECISION RULE [J].
RITTER, GL ;
WOODRUFF, HB ;
LOWRY, SR ;
ISENHOUR, TL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1975, 21 (06) :665-669
[28]  
RUSSO M, 2000, INT J KNOWLEDGE BASE, V2, P94
[29]   PROBABILISTIC NEURAL NETWORKS [J].
SPECHT, DF .
NEURAL NETWORKS, 1990, 3 (01) :109-118
[30]   Reduction techniques for instance-based learning algorithms [J].
Wilson, DR ;
Martinez, TR .
MACHINE LEARNING, 2000, 38 (03) :257-286