A comparison of methods for testing differences in predictive ability

被引:43
作者
Cederkvist, HR
Aastveit, AH
Næs, T
机构
[1] Norwegian Univ Life Sci, N-1432 As, Norway
[2] Matforsk, N-1430 As, Norway
[3] Univ Oslo, Blindern, Norway
关键词
prediction; model comparison; parametric and non-parametric ANOVA; CVANOVA; power;
D O I
10.1002/cem.956
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper is devoted to the comparison of methods for testing difference in prediction ability of regression-based predictors. Focus is on both parametric and non-parametric methods. Comparisons are done using the bootstrap based on residuals from real data sets. The power of the methods for different alternatives is the main tool for evaluating the properties of the methods. The main conclusion from the bootstrap simulations is that the most suitable method seems to be two-way analysis of variance of the absolute values of the prediction errors. Copyright (c) 2006 John Wiley & Sons, Ltd.
引用
收藏
页码:500 / 509
页数:10
相关论文
共 20 条
[1]   Permutation tests for univariate or multivariate analysis of variance and regression [J].
Anderson, MJ .
CANADIAN JOURNAL OF FISHERIES AND AQUATIC SCIENCES, 2001, 58 (03) :626-639
[2]  
[Anonymous], 1988, Journal of Chemometrics
[3]  
[Anonymous], 1989, MULTIVARIATE CALIBRA
[4]  
BREIMAN L, 1995, TECHNOMETRICS, V37, P372
[5]  
Davidson A. C., 1998, BOOTSTRAP METHODS TH
[6]  
FREUOD JE, 1992, MATH STAT
[7]  
Glover T., 2002, INTRO BIOSTATISTICS
[8]  
Indahl UG, 1998, J CHEMOMETR, V12, P261, DOI 10.1002/(SICI)1099-128X(199807/08)12:4<261::AID-CEM513>3.0.CO
[9]  
2-Z
[10]  
Lehmann E. L., 1975, NONPARAMETRICS STAT