Neural networks: A need for caution

被引:47
作者
Curry, B
Morgan, P
机构
[1] University of Wales, Cardiff
[2] Cardiff Business School, University of Wales, Cardiff, Aberconway Building, Cardiff CF1 3EU, Colum Drive
来源
OMEGA-INTERNATIONAL JOURNAL OF MANAGEMENT SCIENCE | 1997年 / 25卷 / 01期
关键词
neural network; backpropagation; polytope; gradient descent and direct optimization;
D O I
10.1016/S0305-0483(96)00052-7
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper deals with the computational aspects of neural networks. Specifically, it is suggested that the now traditional method of backpropagation (BP) may not be the most appropriate basis for learning. The argument is based on the known deficiencies of gradient descent methods, of which BP is an application. Simulation results also suggest that improved performance may be obtained by employing direct optimization procedures such as the polytope algorithm. The main reason for such performance differences appears to be that the root mean square function is subject to narrow 'valleys' and other anomalies. (C) 1997 Elsevier Science Ltd.
引用
收藏
页码:123 / 133
页数:11
相关论文
共 23 条
[1]  
ADBY PR, 1974, INTRO OPTIMISATION M, P76
[2]   CORPORATE DISTRESS DIAGNOSIS - COMPARISONS USING LINEAR DISCRIMINANT-ANALYSIS AND NEURAL NETWORKS (THE ITALIAN EXPERIENCE) [J].
ALTMAN, EI ;
MARCO, G ;
VARETTO, F .
JOURNAL OF BANKING & FINANCE, 1994, 18 (03) :505-529
[3]  
BENNETT KP, 1992, ADV OPTIMISATION PAR
[4]  
BLANCHARD D, 1994, INTELLIGENT SYSTEMS
[5]  
CARLEY AF, 1989, COMPUTATIONAL METHOD
[6]   A neural network approach to mutual fund net asset value forecasting [J].
Chiang, WC ;
Urban, TL ;
Baldridge, GW .
OMEGA-INTERNATIONAL JOURNAL OF MANAGEMENT SCIENCE, 1996, 24 (02) :205-215
[7]  
FAHLMAN SE, 1990, ADV NEURAL INFORMATI, P2
[8]  
GILL PE, 1974, NUMERICAL METHODS CO, P39
[9]   TRAINING NEURAL NETWORKS WITH THE GRG2 NONLINEAR OPTIMIZER [J].
HUNG, MS ;
DENTON, JW .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1993, 69 (01) :83-91
[10]   THE SELF-ORGANIZING MAP [J].
KOHONEN, T .
PROCEEDINGS OF THE IEEE, 1990, 78 (09) :1464-1480