Evolutionary design of nearest prototype classifiers

被引:47
作者
Fernández, F [1 ]
Isasi, P [1 ]
机构
[1] Univ Carlos III Madrid, Madrid 28911, Spain
关键词
classifier design; nearest prototype classifiers; evolutionary learning;
D O I
10.1023/B:HEUR.0000034715.70386.5b
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In pattern classification problems, many works have been carried out with the aim of designing good classifiers from different perspectives. These works achieve very good results in many domains. However, in general they are very dependent on some crucial parameters involved in the design. These parameters have to be found by a trial and error process or by some automatic methods, like heuristic search and genetic algorithms, that strongly decrease the performance of the method. For instance, in nearest prototype approaches, main parameters are the number of prototypes to use, the initial set, and a smoothing parameter. In this work, an evolutionary approach based on Nearest Prototype Classifier (ENPC) is introduced where no parameters are involved, thus overcoming all the problems that classical methods have in tuning and searching for the appropiate values. The algorithm is based on the evolution of a set of prototypes that can execute several operators in order to increase their quality in a local sense, and with a high classification accuracy emerging for the whole classifier. This new approach has been tested using four different classical domains, including such artificial distributions as spiral and uniform distibuted data sets, the Iris Data Set and an application domain about diabetes. In all the cases, the experiments show successfull results, not only in the classification accuracy, but also in the number and distribution of the prototypes achieved.
引用
收藏
页码:431 / 454
页数:24
相关论文
共 32 条
[1]  
AHA DW, 1991, MACH LEARN, V6, P37, DOI 10.1007/BF00153759
[2]  
[Anonymous], 1998, P 15 INT C MACH LEAR
[3]  
[Anonymous], IEEE T INF THEORY
[4]   A batch learning vector quantization algorithm for nearest neighbour classification [J].
Bermejo, S ;
Cabestany, J .
NEURAL PROCESSING LETTERS, 2000, 11 (03) :173-184
[5]   Multiple-prototype classifier design [J].
Bezdek, JC ;
Reichherzer, TR ;
Lim, GS ;
Attikiouzel, Y .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 1998, 28 (01) :67-79
[6]   Nearest prototype classifier designs: An experimental study [J].
Bezdek, JC ;
Kuncheva, LI .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2001, 16 (12) :1445-1473
[7]  
BLAKE C, 1998, UCI RESPOSITORY MACH
[8]   LEARNING VECTOR QUANTIZATION FOR THE PROBABILISTIC NEURAL NETWORK [J].
BURRASCANO, P .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (04) :458-461
[9]  
CAGNONI S, 1994, IEEE INT C NEUR NETW, P762
[10]  
Duda R. O., 1973, PATTERN CLASSIFICATI