Making use of population information in evolutionary artificial neural networks

被引:175
作者
Yao, X [1 ]
Liu, Y [1 ]
机构
[1] Univ New S Wales, Australian Def Force Acad, Univ Coll, Sch Comp Sci,Computat Intelligence Grp, Canberra, ACT 2600, Australia
来源
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS | 1998年 / 28卷 / 03期
基金
澳大利亚研究理事会;
关键词
behavioral evolution; evolutionary artificial neural networks; evolutionary programming; module combination; population-based learning;
D O I
10.1109/3477.678637
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper is concerned with the simultaneous evolution of artificial neural network (ANN) architectures and weights. The current practice in evolving ANN's is to choose the best ANN in the last generation as the final result. This paper proposes a different approach to form the final result by combining all the individuals in the last generation in order to make best use of all the information contained in the whole population, This approach regards a population of ANN's as an ensemble and uses a combination method to integrate them. Although there has been some work on integrating ANN modules [2], [3], Little has been done in evolutionary learning to make best use of its population information. Pour linear combination methods have been investigated in this paper to illustrate our ideas. Three real-world data sets have been used in our experimental studies, which show that the recursive least-square (RLS) algorithm always produces an integrated system that outperforms the best individual. The results confirm that a population contains more information than a single individual, Evolutionary learning should exploit such information to improve generalization of learned systems.
引用
收藏
页码:417 / 425
页数:9
相关论文
共 39 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]   AN EVOLUTIONARY ALGORITHM THAT CONSTRUCTS RECURRENT NEURAL NETWORKS [J].
ANGELINE, PJ ;
SAUNDERS, GM ;
POLLACK, JB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (01) :54-65
[3]  
[Anonymous], P IEEE SING INT C IN
[4]  
[Anonymous], ENCY COMPUTER SCI TE
[5]  
[Anonymous], P INT WORKSH COMB GE
[6]   LEARNING IN LINEAR NEURAL NETWORKS - A SURVEY [J].
BALDI, PF ;
HORNIK, K .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (04) :837-858
[7]  
BELEW RK, 1991, CS90174 U CAL COMP S
[8]  
DARWEN P, P 1996 IEEE INT C EV, P88
[9]  
DARWEN P, 1996, LECT NOTES COMPUTER, V1141, P398
[10]  
DARWEN P, P 1995 IEEE INT C EV, P166