Ranking importance of input parameters of neural networks

被引:134
作者
Sung, AH [1 ]
机构
[1] New Mexico Inst Min & Technol, Dept Comp Sci, Socorro, NM 87801 USA
关键词
artificial neural networks; importance ranking; sensitivity analysis; fuzzy curves; change of MSE;
D O I
10.1016/S0957-4174(98)00041-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial neural networks have been used for simulation, modeling, and control purposes in many engineering applications as an alternative to conventional expert systems. Although neural networks usually do not reach the level of performance exhibited by expert systems, they do enjoy a tremendous advantage of very low construction costs. This paper addresses the issue of identifying important input parameters in building a multilayer, backpropagation network for a typical class of engineering problems. These problems are characterized by having a large number of input variables of varying degrees of importance; and identifying the important variables is a common issue since elimination of the unimportant inputs leads to a simplification of the problem and often a more accurate modeling or solution. We compare three different methods for ranking input importance: sensitivity analysis, fuzzy curves, and change of MSE (mean square error); and analyze their effectiveness. Simulation results based on experiments with simple mathematical functions as well as a real engineering problem are reported. Based on the analysis and our experience in building neural networks, we also propose a general methodology for building backpropagation networks for typical engineering applications. (C) 1998 Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:405 / 411
页数:7
相关论文
共 12 条
[1]  
[Anonymous], P IEEE INT S CIRC SY
[2]  
Bartlett E. B., 1994, Neural, Parallel & Scientific Computations, V2, P103
[3]  
DAGLI CH, 1997, INTELLIGENT ENG SYST, V7
[4]  
ENGELBRECHT AP, 1995, P INT WORKSH ART NEU, P382
[5]   Optimal linear combinations of neural networks [J].
Hashem, S .
NEURAL NETWORKS, 1997, 10 (04) :599-614
[6]  
He F., 1997, P IASTED INT C CONTR, P417
[7]  
HE F, 1996, USING NEURAL NETWORK
[8]  
Hertz J., 1991, Introduction to the Theory of Neural Computation
[9]   A NEW APPROACH TO FUZZY-NEURAL SYSTEM MODELING [J].
LIN, YH ;
CUNNINGHAM, GA .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 1995, 3 (02) :190-198
[10]   A SCALED CONJUGATE-GRADIENT ALGORITHM FOR FAST SUPERVISED LEARNING [J].
MOLLER, MF .
NEURAL NETWORKS, 1993, 6 (04) :525-533