Multi-objective cooperative coevolution of artificial neural networks (multi-objective cooperative networks)

被引:76
作者
García-Pedrajas, N
Hervás-Martínez, C
Muñoz-Pérez, J
机构
[1] Univ Cordoba, Dept Comp & Numer Anal, Cordoba 14071, Spain
[2] Univ Malaga, Dept Languages & Comp Sci, Malaga 29071, Spain
关键词
evolutionary computation; multi-objective optimization; cooperative coevolution; topology evolution; automatic neural network design;
D O I
10.1016/S0893-6080(02)00095-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present a cooperative coevolutive model for the evolution of neural network topology and weights, called MOBNET. MOBNET evolves subcomponents that must be combined in order to form a network, instead of whole networks. The problem of assigning credit to the subcomponents is approached as a multi-objective optimization task. The subcomponents in a cooperative coevolutive model must fulfill different criteria to be useful, these criteria usually conflict with each other. The problem of evaluating the fitness on an individual based on many criteria that must be optimized together can be approached as a multi-criteria optimization problems, so the methods from multi-objective optimization offer the most natural way to solve the problem. In this work we show how using several objectives for every subcomponent and evaluating its fitness as a multi-objective optimization problem, the performance of the model is highly competitive. MOBNET is compared with several standard methods of classification and with other neural network models in solving four real-world problems, and it shows the best overall performance of all classification methods applied. It also produces smaller networks when compared to other models. The basic idea underlying MOBNET is extensible to a more general model of coevolutionary computation, as none of its features are exclusive of neural networks design. There are many applications of cooperative coevolution that could benefit from the multi-objective optimization approach proposed in this paper. (C) 2002 Elsevier Science Ltd. All fights reserved.
引用
收藏
页码:1259 / 1278
页数:20
相关论文
共 80 条
[51]  
Michalewicz Z., 1994, GENETIC ALGORITHMS P
[52]  
Moriarty D.E., 1997, THESIS U TEXAS AUSTI
[53]  
Moriarty DE, 1996, MACH LEARN, V22, P11, DOI 10.1007/BF00114722
[54]  
MORIARTY DE, 1998, EVOLUTIONARY COMPUTA, V4
[55]  
*NEUR, 1993, NEUR COMP TECHN HDB
[56]  
Paredis Jan, 1996, Artificial Life, V2, P355, DOI 10.1162/artl.1995.2.4.355
[57]   Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents [J].
Potter, Mitchell A. ;
De Jong, Kenneth A. .
EVOLUTIONARY COMPUTATION, 2000, 8 (01) :1-29
[58]   A quantitative study of experimental evaluations of neural network learning algorithms: Current research practice [J].
Prechelt, L .
NEURAL NETWORKS, 1996, 9 (03) :457-462
[59]  
PRECHELT L, 1994, 2194 U KARL
[60]   Shared memory based cooperative coevolution [J].
Puppala, N ;
Sen, S ;
Gordin, M .
1998 IEEE INTERNATIONAL CONFERENCE ON EVOLUTIONARY COMPUTATION - PROCEEDINGS, 1998, :570-574