The performance of risk prediction models

被引:225
作者
Gerds, Thomas A.
Cai, Tianxi [1 ]
Schumacher, Martin [2 ]
机构
[1] Dept Biostat, Boston, MA 02115 USA
[2] Univ Freiburg, Inst Med Biometry & Med Informat, D-79104 Freiburg, Germany
关键词
AUC; Brier score; 0.632+bootstrap; cross validation; machine learning; model selection; R-2; risk prediction; ROC curve;
D O I
10.1002/bimj.200810443
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
For medical decision making and patient information, predictions of future status variables play an important role. Risk prediction models can be derived with many different statistical approaches. To compare them, measures of predictive performance are derived from ROC methodology and from probability forecasting theory. These tools can be applied to assess single markers, multivariable regression models and complex model selection algorithms. This article provides a systematic review of the modem way of assessing risk prediction models. Particular attention is put on proper benchmarks and resampling techniques that are important for the interpretation of measured performance. All methods are illustrated with data from a clinical study in head and neck cancer patients.
引用
收藏
页码:457 / 479
页数:23
相关论文
共 89 条
[1]  
ADLER W, 2007, BOOTSTRAP ESTIMATED
[2]   NEAREST-NEIGHBOR ESTIMATION OF A BIVARIATE DISTRIBUTION UNDER RANDOM CENSORING [J].
AKRITAS, MG .
ANNALS OF STATISTICS, 1994, 22 (03) :1299-1327
[3]   Comparing the predictive value of neural network models to logistic regression models on the risk of death for small-cell lung cancer patients [J].
Bartfay, E ;
Mackillop, WJ ;
Pater, JL .
EUROPEAN JOURNAL OF CANCER CARE, 2006, 15 (02) :115-124
[4]  
Bernardo J.M., 2000, Wiley Series in Probability and Statistics
[5]  
Binder H, 2008, STAT APPL GENET MOL, V7
[6]   SmcHD1, containing a structural-maintenance-of-chromosomes hinge domain, has a critical role in X inactivation [J].
Blewitt, Marnie E. ;
Gendrel, Anne-Valerie ;
Pang, Zhenyi ;
Sparrow, Duncan B. ;
Whitelaw, Nadia ;
Craig, Jeffrey M. ;
Apedaile, Anwyn ;
Hilton, Douglas J. ;
Dunwoodie, Sally L. ;
Brockdorff, Neil ;
Kay, Graham F. ;
Whitelaw, Emma .
NATURE GENETICS, 2008, 40 (05) :663-669
[7]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[8]   Statistical modeling: The two cultures [J].
Breiman, L .
STATISTICAL SCIENCE, 2001, 16 (03) :199-215
[9]  
Brier G. W., 1950, MON WEATHER REV, V78, P1, DOI [10.1175/1520-0493(1950)078%3C0001:VOFEIT%3E2.0.CO
[10]  
2, 10.1175/1520-0493(1950)0782.0.co