Bootstrapping log likelihood and EIC, an extension of AIC

被引:82
作者
Ishiguro, M [1 ]
Sakamoto, Y [1 ]
Kitagawa, G [1 ]
机构
[1] INST STAT MATH,MINATO KU,MINATO KU,TOKYO 106,JAPAN
关键词
log likelihood; AIC; bootstrap; MLE; information criterion; model selection; estimator selection; bias correction; expected log likelihood; penalized log likelihood; predictive distribution;
D O I
10.1023/A:1003158526504
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Akaike (1973, 2nd International Symposium on Information Theory, 267-281, Akademiai Kiado, Budapest) proposed AIC as an estimate of the expected log likelihood to evaluate the goodness of models fitted to a given set of data. The introduction of AIC has greatly widened the range of application of statistical methods. However, its limit lies in the point that it can be applied only to the cases where the parameter estimation are performed by the maximum likelihood method. The derivation of AIC is based on the assessment of the effect of data fluctuation through the asymptotic normality of MLE. In this paper we propose a new information criterion EIC which is constructed by employing the bootstrap method to simulate the data fluctuation. The new information criterion, EIC, is regarded as an extension of AIC. The performance of EIC is demonstrated by some numerical examples.
引用
收藏
页码:411 / 434
页数:24
相关论文
共 13 条
[1]  
Akaike H., 1973, 2 INT S INFORM THEOR, P267, DOI [10.1007/978-1-4612-1694-0_15, DOI 10.1007/978-1-4612-1694-0_15]
[2]  
Akaike H., 1980, BAYESIAN STAT, P143, DOI [DOI 10.1007/BF02888350, DOI 10.1007/978-1-4612-1694-0_24]
[3]   1977 RIETZ LECTURE - BOOTSTRAP METHODS - ANOTHER LOOK AT THE JACKKNIFE [J].
EFRON, B .
ANNALS OF STATISTICS, 1979, 7 (01) :1-26
[4]  
HUBER PJ, 1967, 5TH P BERK S MATH ST, V1, P221
[5]   IMPROVED ESTIMATORS OF KULLBACK-LEIBLER INFORMATION FOR AUTOREGRESSIVE MODEL SELECTION IN SMALL SAMPLES [J].
HURVICH, CM ;
SHUMWAY, R ;
TSAI, CL .
BIOMETRIKA, 1990, 77 (04) :709-719
[6]  
HURVICH CM, 1989, BIOMETRIKA, V76, P297, DOI 10.2307/2336663
[7]  
ISHIGURO M, 1991, 410 I STAT MATH
[8]  
Sakamoto Y, 1991, CATEGORICAL DATA ANA
[9]  
Sakamoto Y., 1986, AKAIKE INFORM CRITER
[10]  
Shibata R., 1989, DATA MODEL, P215