Effect of mortality rate on the performance of the Acute Physiology and Chronic Health Evaluation II: A simulation study

被引:23
作者
Glance, LG [1 ]
Osler, TM [1 ]
Papadakos, P [1 ]
机构
[1] Univ Rochester, Med Ctr, Sch Med, Dept Anesthesiol, Rochester, NY 14642 USA
关键词
outcome assessment; Acute Physiology and Chronic Health Evaluation II; calibration; discrimination; receiver operating characteristic; Hosmer-Lemeshow statistic;
D O I
10.1097/00003246-200010000-00008
中图分类号
R4 [临床医学];
学科分类号
1002 ; 100602 ;
摘要
Objective: To evaluate the impact of case mix variation on the performance of the Acute Physiology and Chronic Health Evaluation (APACHE) II using measures of calibration and discrimination, Design: APACHE II data were collected prospectively at the surgical intensive care unit of the University of Vermont on all adult admissions over an 8-yr period (excluding cardiac surgical patients, burn patients, and patients <16 yrs of age), The original case mix was systematically varied to create 2,000 different case mixes ranging in mortality between 5% and 18% using a computer-intensive resampling algorithm. The area under the receiver operating characteristic curve and the Hosmer-Lemeshow C statistic were derived for each of the simulated case mixes with bootstrapping. Setting. The surgical intensive care unit at a 450-bed teaching hospital. Patients: A group of 6,806 adult surgical patients excluding cardiac surgical patients and burn patients. Measurements and Results: Simulated data sets were created from a database of patients treated at a single institution to test the hypothesis that the performance of APACHE II is stable across a clinically reasonable range of mortality rates, The discrimination and calibration of APACHE II varied with case mix, Conclusion:The discrimination of APACHE II is not independent of case mix. However, the variability of the Hosmer-Lemeshow statistic as a function of the case mix may simply reflect the limitations of this goodness of fit statistic to assess model calibration, Because the discrimination of APACHE II is a function of case mix, caution should be exercised when using APACHE II-based adjusted mortality rates to compare intensive care units with widely divergent case mixes.
引用
收藏
页码:3424 / 3428
页数:5
相关论文
共 18 条
[1]  
ASH AS, 1994, RISK ADJUSTMENT MEAS
[2]   Prediction of outcome from intensive care: A prospective cohort study comparing acute physiology and chronic health evaluation II and III prognostic systems in a United Kingdom intensive care unit [J].
Beck, DH ;
Taylor, BL ;
Millar, B ;
Smith, GB .
CRITICAL CARE MEDICINE, 1997, 25 (01) :9-15
[3]   A COMPARISON OF SEVERITY OF ILLNESS SCORING SYSTEMS FOR INTENSIVE-CARE UNIT PATIENTS - RESULTS OF A MULTICENTER, MULTINATIONAL STUDY [J].
CASTELLA, X ;
ARTIGAS, A ;
BION, J ;
KARI, A ;
BENZER, H ;
HUBER, C ;
ALEXANDER, JP ;
DELANDE, M ;
LEDOUX, D ;
CANIVET, JL ;
DAMAS, P ;
DEMEYER, I ;
VISSERS, K ;
DUGERNIER, T ;
HUYGHENS, L ;
DILTOUR, M ;
DEWIT, N ;
NAGLER, J ;
COOLS, F ;
NOLLET, G ;
VERBEKE, J ;
POELAERT, J ;
COLLARDYN, F ;
LATERRE, PF ;
DOUGNAC, A ;
REYNAERT, M ;
RUTSAERT, R ;
COLEMONT, L ;
SCHETZ, M ;
LAUWERS, P ;
HAMILTON, S ;
NORRIS, C ;
SHUSTACK, A ;
JOHNSTON, R ;
KONOPAD, E ;
HANNONEN, P ;
HERSIO, K ;
KAIRI, P ;
KLOSSNER, J ;
SAARELA, E ;
VAHAMURTO, M ;
ARICE, C ;
BEDOCQ, B ;
BLETTERY, B ;
MISSET, B ;
CARLET, J ;
MIER, L ;
DREYFUSS, D ;
FOSSE, JP ;
GARO, B .
CRITICAL CARE MEDICINE, 1995, 23 (08) :1327-1335
[4]  
Efron B., 1993, INTRO BOOTSTRAP, DOI 10.1007/978-1-4899-4541-9
[5]   THE MEANING AND USE OF THE AREA UNDER A RECEIVER OPERATING CHARACTERISTIC (ROC) CURVE [J].
HANLEY, JA ;
MCNEIL, BJ .
RADIOLOGY, 1982, 143 (01) :29-36
[6]  
Hosmer D. W., 1989, APPL LOGISTIC REGRES, DOI DOI 10.1097/00019514-200604000-00003
[7]   USES AND ABUSES OF STATISTICAL-MODELS FOR EVALUATING TRAUMA CARE [J].
JONES, JM ;
TEMPLETON, J ;
REDMOND, AD .
JOURNAL OF TRAUMA-INJURY INFECTION AND CRITICAL CARE, 1995, 38 (01) :89-93
[8]   APACHE-II - A SEVERITY OF DISEASE CLASSIFICATION-SYSTEM [J].
KNAUS, WA ;
DRAPER, EA ;
WAGNER, DP ;
ZIMMERMAN, JE .
CRITICAL CARE MEDICINE, 1985, 13 (10) :818-829
[9]   VARIATIONS IN MORTALITY AND LENGTH OF STAY IN INTENSIVE-CARE UNITS [J].
KNAUS, WA ;
WAGNER, DP ;
ZIMMERMAN, JE ;
DRAPER, EA .
ANNALS OF INTERNAL MEDICINE, 1993, 118 (10) :753-761
[10]   THE APACHE-III PROGNOSTIC SYSTEM - RISK PREDICTION OF HOSPITAL MORTALITY FOR CRITICALLY ILL HOSPITALIZED ADULTS [J].
KNAUS, WA ;
WAGNER, DP ;
DRAPER, EA ;
ZIMMERMAN, JE ;
BERGNER, M ;
BASTOS, PG ;
SIRIO, CA ;
MURPHY, DJ ;
LOTRING, T ;
DAMIANO, A ;
HARRELL, FE .
CHEST, 1991, 100 (06) :1619-1636