An empirical comparison of combinations of evolutionary algorithms and neural networks for classification problems

被引:106
作者
Cantú-Paz, E [1 ]
Kamath, C [1 ]
机构
[1] Lawrence Livermore Natl Lab, Ctr Appl Sci Comp, Livermore, CA 94605 USA
来源
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS | 2005年 / 35卷 / 05期
关键词
classification; evolutionary algorithms; feature election; machine learning; network design; training algorithms;
D O I
10.1109/TSMCB.2005.847740
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There are numerous combinations of neural networks (NNs) and evolutionary algorithms (EAs) used in classification problems. EAs have been used to train the networks, design their architecture, and select feature subsets. However, most of these combinations have been tested on only a few data sets and many comparisons are done inappropriately measuring the performance in training data or without using proper statistical tests to support the conclusions. This paper presents an empirical evaluation of light combinations of EAs and NNs on 15 public-domain and artificial data sets. Our objective is to identify the methods that consistently produce accurate classifiers that generalize well. In most cases, the combinations of EAs and NNs perform equally well on the data sets we tried and were not more accurate than hand-designed neural networks trained with simple backpropagation.
引用
收藏
页码:915 / 927
页数:13
相关论文
共 65 条
[1]   Combined 5 x 2 cv F test for comparing supervised classification learning algorithms [J].
Alpaydin, E .
NEURAL COMPUTATION, 1999, 11 (08) :1885-1892
[2]   Selection bias in gene extraction on the basis of microarray gene-expression data [J].
Ambroise, C ;
McLachlan, GJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2002, 99 (10) :6562-6566
[3]  
[Anonymous], 1989, GENETIC ALGORITHM SE
[4]  
[Anonymous], THESIS KATHOLIEKE U
[5]  
[Anonymous], P 2 ART LIF C ADD
[6]  
Back T., 1996, EVOLUTIONARY ALGORIT
[7]  
Balashov YA, 1996, PETROLOGY, V4, P1
[8]  
Blake C.L., 1998, UCI repository of machine learning databases
[9]  
BOERS JW, 1992, BIOL METAPHORS DESIG
[10]  
Bransen J, 1995, PROCEEDINGS OF THE EIGHTH INTERNATIONAL KANT CONGRESS, VOL II, PT 1, SECT 1-9, P145