The performance of risk prediction models

被引:225
作者
Gerds, Thomas A.
Cai, Tianxi [1 ]
Schumacher, Martin [2 ]
机构
[1] Dept Biostat, Boston, MA 02115 USA
[2] Univ Freiburg, Inst Med Biometry & Med Informat, D-79104 Freiburg, Germany
关键词
AUC; Brier score; 0.632+bootstrap; cross validation; machine learning; model selection; R-2; risk prediction; ROC curve;
D O I
10.1002/bimj.200810443
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
For medical decision making and patient information, predictions of future status variables play an important role. Risk prediction models can be derived with many different statistical approaches. To compare them, measures of predictive performance are derived from ROC methodology and from probability forecasting theory. These tools can be applied to assess single markers, multivariable regression models and complex model selection algorithms. This article provides a systematic review of the modem way of assessing risk prediction models. Particular attention is put on proper benchmarks and resampling techniques that are important for the interpretation of measured performance. All methods are illustrated with data from a clinical study in head and neck cancer patients.
引用
收藏
页码:457 / 479
页数:23
相关论文
共 89 条
[21]   Strictly proper scoring rules, prediction, and estimation [J].
Gneiting, Tilmann ;
Raftery, Adrian E. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2007, 102 (477) :359-378
[22]  
Graf E, 1999, STAT MED, V18, P2529
[23]   An investigation on measures of explained variation in survival analysis [J].
Graf, E ;
Schumacher, M .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES D-THE STATISTICIAN, 1995, 44 (04) :497-507
[24]   Validation of the Kattan preoperative nomogram for prostate cancer recurrence using a community based cohort: Results from cancer of the prostate strategic urological research endeavor (CaPSURE) [J].
Greene, KL ;
Meng, MV ;
Elkin, EP ;
Cooperberg, MR ;
Pasta, DJ ;
Kattan, MW ;
Wallace, K ;
Carroll, WR .
JOURNAL OF UROLOGY, 2004, 171 (06) :2255-2259
[25]  
GREENHOUSE SW, 1950, CANCER-AM CANCER SOC, V3, P1097, DOI 10.1002/1097-0142(1950)3:6<1097::AID-CNCR2820030620>3.0.CO
[26]  
2-E
[27]   The need for reorientation toward cost-effective prediction:: Comments on 'Evaluating the added predictive ability of a new marker:: From area under the ROC curve to reclassification and beyond' by M. J.!Pencina et al., Statistics in Medicine [J].
Greenland, Sander .
STATISTICS IN MEDICINE, 2008, 27 (02) :199-206
[28]  
Guggenmoos-Holzmann I, 2000, STAT MED, V19, P1783, DOI 10.1002/1097-0258(20000715)19:13<1783::AID-SIM497>3.0.CO
[29]  
2-B
[30]  
HABBEMA JDF, 1981, METHOD INFORM MED, V20, P80