Model selection in neural networks

被引：228

作者：

Anders, U ^{[1
]}

Korn, O ^{[1
]}

机构：

[1] ZEW, Ctr European Econ Res, D-68034 Mannheim, Germany

来源：

NEURAL NETWORKS | 1999年 / 12卷 / 02期

关键词：

neural networks; statistical inference; model selection; identification; information criteria; cross validation; pruning; Monte Carlo simulation;

D O I：

10.1016/S0893-6080(98)00117-8

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this article, we examine how model selection in neural networks can be guided by statistical procedures such as hypothesis tests, information criteria and cross validation. The application of these methods in neural network models is discussed, paying attention especially to the identification problems encountered. We then propose five specification strategies based on different statistical procedures and compare them in a simulation study. As the results of the study are promising, it is suggested that a statistical analysis should become an integral part of neural network modeling. (C) 1999 Elsevier Science Ltd. All rights reserved.

引用

页码：309 / 323

页数：15

共 37 条

[11] HYPOTHESIS-TESTING WHEN A NUISANCE PARAMETER IS PRESENT ONLY UNDER THE ALTERNATIVE
DAVIES, RB
[J]. BIOMETRIKA, 1987, 74 (01) : 33 - 43
[12] Efron B., 1994, INTRO BOOTSTRAP, V57, DOI DOI 10.1201/9780429246593
[13] Granger C.W. J., 1993, MODELING NONLINEAR E
[14] MULTILAYER FEEDFORWARD NETWORKS ARE UNIVERSAL APPROXIMATORS
HORNIK, K
STINCHCOMBE, M
WHITE, H
[J]. NEURAL NETWORKS, 1989, 2 (05) : 359 - 366
[15] Judge G. G., 1985, The Theory and Practice of Econometrics
[16] Kuan CM., 1994, ECONOMET REV, V13, P1, DOI [DOI 10.1080/07474939408800273, 10.1080/07474939408800273]
[17] TESTING FOR NEGLECTED NONLINEARITY IN TIME-SERIES MODELS - A COMPARISON OF NEURAL NETWORK METHODS AND ALTERNATIVE TESTS
LEE, TH
WHITE, H
GRANGER, CWJ
[J]. JOURNAL OF ECONOMETRICS, 1993, 56 (03) : 269 - 290
[18] MOODY JE, 1992, ADV NEUR IN, V4, P847
[19] Moody JE, 1997, ADV NEUR IN, V9, P585
[20] NETWORK INFORMATION CRITERION - DETERMINING THE NUMBER OF HIDDEN UNITS FOR AN ARTIFICIAL NEURAL-NETWORK MODEL
MURATA, N
YOSHIZAWA, S
AMARI, S
[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (06): : 865 - 872

← 1 2 3 4 →