Design of ensemble neural network using the Akaike information criterion

被引:45
作者
Zhao, Zhiye [1 ]
Zhang, Yun [1 ]
Liao, Hongjian [2 ]
机构
[1] Nanyang Technol Univ, Sch Civil & Environm Engn, Singapore 639798, Singapore
[2] Xian Jiaotong Univ, Dept Civil Engn, Xian 710049, Peoples R China
关键词
Ensemble neural network; Akaike information criterion; Mudstone modeling;
D O I
10.1016/j.engappai.2008.02.007
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 [计算机科学与技术];
摘要
Ensemble neural networks are commonly used networks in many engineering applications due to its better generalization property. In this paper, an ensemble neural network algorithm is proposed based on the Akaike information criterion (AIC). The AIC-based ensemble neural network searches the best weight configuration of each component network first, and uses the AIC as an automating tool to find the best combination weights of the ensemble neural network. Two analytical functions-the peak function and the Friedman function are used first to assess the accuracy of the proposed ensemble approach. The verified approach is then applied to a material modeling problem-the stress-strain-time relationship of mudstones. These computational experiments have verified that the AIC-based ensemble neural network outperforms both the simple averaging ensemble neural network and the single component neural network. (C) 2008 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1182 / 1188
页数:7
相关论文
共 39 条
[1]
A neural network face recognition system [J].
Aitkenhead, MJ ;
McDonald, AJS .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2003, 16 (03) :167-176
[2]
Akaike H, 1973, 2 INT S INFORM THEOR, P199, DOI 10.1007/978-1-4612-1694-0
[3]
[Anonymous], THESIS PURDUE U
[4]
[Anonymous], 1999, Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems
[5]
[Anonymous], J COMPUT SYST SCI, DOI DOI 10.1006/JCSS.1997.1504
[6]
[Anonymous], ARTIFICIAL NEURAL NE
[7]
Bagging predictors [J].
Breiman, L .
MACHINE LEARNING, 1996, 24 (02) :123-140
[8]
Burnham K.P., 2002, Model selection and multimodel inference: a practical information-theoretic approach, DOI 10.1007/978-1-4757-2917-7_3
[9]
Downscaling recent streamflow conditions in British Columbia, Canada using ensemble neural network models [J].
Cannon, AJ ;
Whitfield, PH .
JOURNAL OF HYDROLOGY, 2002, 259 (1-4) :136-151
[10]
CARNEY JG, 1999, P 7 EUR S ART NEUR N, P35