Forest and funnel plots illustrated the calibration of a prognostic model: a descriptive study

被引:20
作者
Ho, Kwok Ming [1 ]
机构
[1] Royal Perth Hosp, Dept Intens Care, Perth, WA 6000, Australia
[2] Univ Western Australia, Sch Populat Hlth, Perth, WA 6000, Australia
关键词
uniformity of fit; model calibration; standardized mortality ratio; critically ill; risk adjustment; outcome prediction;
D O I
10.1016/j.jclinepi.2006.10.017
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Objective: To describe the use of forest and funnel plots to assess the uniformity of fit in the calibration of a prognostic model for critically ill patients. Methods: This study used the administrative database of the Intensive Care Unit (ICU) at Royal Perth Hospital. This database contained 11,107 consecutive ICU admissions between 1 January 1993 and 31 December 2003. We used forest and funnel plots to assess the calibration of the Acute Physiology and Chronic Health Evaluation (APACHE) II prognostic model. Results: The Mantel-Haenszel weighted standardized mortality ratio (SMR) by pooling different risk or age strata and diagnostic subgroups together was 0.84 (95% Confidence Interval [Cl]: 0.80-0.88), 0.85 (95%CI: 0.80-0.90), and 0.88 (95%CI: 0.82-0.93), respectively. The chi-square for heterogeneity across different risk or age strata and diagnostic subgroups was 10.94 (P = 0.28), 8.92 (P = 0.06), and 24.60 (P < 0.0001), respectively. Funnel plot suggested that the APACHE II model had poor calibration for patients with multiple trauma. The estimates of the slope and intercept of the calibration curve confirmed that the model was poorly calibrated for this subgroup of patients. Conclusion: Forest and funnel plots could facilitate visual interpretation of the calibration of a prognostic model across different subgroups of critically ill patients. (c) 2007 Elsevier Inc. All rights reserved.
引用
收藏
页码:746 / 751
页数:6
相关论文
共 24 条
[21]   Validation and updating of predictive logistic regression models: a study on sample size and shrinkage [J].
Steyerberg, EW ;
Borsboom, GJJM ;
van Houwelingen, HC ;
Eijkemans, MJC ;
Habbema, JDF .
STATISTICS IN MEDICINE, 2004, 23 (16) :2567-2586
[22]   Substantial effective sample sizes were required for external validation studies of predictive logistic regression models [J].
Vergouwe, Y ;
Steyerberg, EW ;
Eijkemans, MJC ;
Habbema, JDF .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2005, 58 (05) :475-483
[23]   Factors affecting the performance of the models in the mortality probability model II system and strategies of customization: A simulation study [J].
Zhu, BP ;
Lemeshow, S ;
Hosmer, DW ;
Klar, J ;
Avrunin, J ;
Teres, D .
CRITICAL CARE MEDICINE, 1996, 24 (01) :57-63
[24]   IMPROVING INTENSIVE-CARE - OBSERVATIONS BASED ON ORGANIZATIONAL CASE-STUDIES IN 9 INTENSIVE-CARE UNITS - A PROSPECTIVE, MULTICENTER STUDY [J].
ZIMMERMAN, JE ;
SHORTELL, SM ;
ROUSSEAU, DM ;
DUFFY, J ;
GILLIES, RR ;
KNAUS, WA ;
DEVERS, K ;
WAGNER, DP ;
DRAPER, EA .
CRITICAL CARE MEDICINE, 1993, 21 (10) :1443-1451