Sensitivity Versus Accuracy in Multiclass Problems Using Memetic Pareto Evolutionary Neural Networks

被引:114
作者
Fernandez Caballero, Juan Carlos [1 ]
Jose Martinez, Francisco [2 ]
Hervas, Cesar [1 ]
Antonio Gutierrez, Pedro [1 ]
机构
[1] Univ Cordoba, Dept Comp Sci & Numer Anal, E-14071 Cordoba, Spain
[2] ETEA, Dept Management & Quantitat Methods, Cordoba 14005, Spain
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2010年 / 21卷 / 05期
关键词
Accuracy; local search; multiclassification; multiobjective evolutionary algorithms; neural networks; sensitivity; DIFFERENTIAL EVOLUTION; CLASSIFICATION; OPTIMIZATION; ALGORITHMS;
D O I
10.1109/TNN.2010.2041468
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a multiclassification algorithm using multilayer perceptron neural network models. It tries to boost two conflicting main objectives of multiclassifiers: a high correct classification rate level and a high classification rate for each class. This last objective is not usually optimized in classification, but is considered here given the need to obtain high precision in each class in real problems. To solve this machine learning problem, we use a Pareto-based multiobjective optimization methodology based on a memetic evolutionary algorithm. We consider a memetic Pareto evolutionary approach based on the NSGA2 evolutionary algorithm (MPENSGA2). Once the Pareto front is built, two strategies or automatic individual selection are used: the best model in accuracy and the best model in sensitivity ( extremes in the Pareto front). These methodologies are applied to solve 17 classification benchmark problems obtained from the University of California at Irvine (UCI) repository and one complex real classification problem. The models obtained show high accuracy and a high classification rate for each class.
引用
收藏
页码:750 / 770
页数:21
相关论文
共 74 条
[1]   Speeding up backpropagation using multiobjective evolutionary algorithms [J].
Abbass, HA .
NEURAL COMPUTATION, 2003, 15 (11) :2705-2726
[2]  
Abbass HA, 2003, IEEE C EVOL COMPUTAT, P2074
[3]   An evolutionary artificial neural networks approach for breast cancer diagnosis [J].
Abbass, HA .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2002, 25 (03) :265-281
[4]  
Abbass HA, 2001, IEEE C EVOL COMPUTAT, P971, DOI 10.1109/CEC.2001.934295
[5]  
ABBASS HA, 2001, P 14 AUSTR JOINT C A, P1
[6]   AN EVOLUTIONARY ALGORITHM THAT CONSTRUCTS RECURRENT NEURAL NETWORKS [J].
ANGELINE, PJ ;
SAUNDERS, GM ;
POLLACK, JB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (01) :54-65
[7]  
[Anonymous], 1987, Multiple comparison procedures
[8]  
[Anonymous], 2007, Uci machine learning repository
[9]  
[Anonymous], 2006, Pattern recognition and machine learning
[10]  
Bishop CM., 1995, NEURAL NETWORKS PATT