Evaluation of two outcome prediction models on an independent database

被引:83
作者
Moreno, R
Miranda, DR
Fidler, V
Van Schilfgaarde, R
机构
[1] Univ Groningen Hosp, Dept Surg, Intens Care Unit, NL-9700 RB Groningen, Netherlands
[2] Hosp Santo Antonio dos Capuchos, Intens Care Unit, Lisbon, Portugal
[3] Univ Groningen, Dept Hlth Sci, Fac Med, Groningen, Netherlands
关键词
severity of illness index; intensive care; critical care; mortality prediction; simplified acute physiology score; SAPS II; mortality prediction models; MPM0; EURICUS-I;
D O I
10.1097/00003246-199801000-00016
中图分类号
R4 [临床医学];
学科分类号
1002 ; 100602 ;
摘要
Objective: To evaluate the performance of the New Simplified Acute Physiology Score (SAPS II) and the admission Mortality Probability Model (MPM0) in a large independent database, using formal statistical assessment. Design: Analysis of the database of a multicenter, multinational, prospective cohort study, EURICUS-I. Setting: Eighty nine intensive care units (ICUs) from 13 European areas. Patients: Data of 16,060 patients consecutively admitted to the participating ICUs were collected during a period of 4 months. Following the original SAPS II and MPM0 criteria, the analysis excluded: patients < 18 ys of age; readmissions; patients admitted with acute myocardial infarction; burns; and patients in the postoperative period after coronary artery bypass surgery. All patients with a length of stay < 8 hrs were excluded from the study to keep comparability between both systems. A total of 10,027 patients were analyzed. Interventions: Collection of the first 24 hrs' admission data necessary for the calculation of SAPS II and MPM0 and basic demographic statistics. Vital status at discharge from the hospital was registered. Measurements and Main Results: Despite having a good discriminative capability, as measured by the area under the receiver operating characteristic (ROC) curves (SAPS II: ROC = 0.822 +/- 0.005 SEM; MPM0: ROC = 0.785 +/- 0.006 SEM), both models presented poor calibration, with significant differences between observed and predicted mortality (Hosmer-Lemeshow goodness-of-fit tests H and C, p < .0001). Both SAPS II (predicted risk > 40%) and MPM0 (predicted risk > 30%) overestimated the risk of death. The evaluation of the uniformity of fit of SAPS II and MPM0 demonstrated large variations across the various subgroups of patients. Conclusions: The original SAPS II and MPM0 models did not accurately predict mortality on an independent large international multicenter ICU patient database. Results of studies utilizing general outcome prediction models without previous validation in the target population should be interpreted with prudence.
引用
收藏
页码:50 / 61
页数:12
相关论文
共 55 条
[1]  
ABIZANDA CR, 1994, INTENS CARE MED, V20, pS1
[2]  
ABIZANDA R, 1994, MED CLIN-BARCELONA, V102, P527
[3]   The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs: Results from GiViTl [J].
Apolone, G ;
Bertolini, G ;
DAmico, R ;
Iapichino, G ;
Cattaneo, A ;
DeSalvo, G ;
Melotti, RM .
INTENSIVE CARE MEDICINE, 1996, 22 (12) :1368-1378
[4]   THE RATIO OF OBSERVED-TO-EXPECTED MORTALITY AS A QUALITY OF CARE INDICATOR IN NONSURGICAL VA PATIENTS [J].
BEST, WR ;
COWPER, DC .
MEDICAL CARE, 1994, 32 (04) :390-400
[5]   MORTALITY PREDICTION MODELS IN INTENSIVE-CARE - ACUTE PHYSIOLOGY AND CHRONIC HEALTH EVALUATION-II AND MORTALITY PREDICTION MODEL COMPARED [J].
CASTELLA, X ;
GILABERT, J ;
TORNER, F ;
TORRES, C .
CRITICAL CARE MEDICINE, 1991, 19 (02) :191-197
[6]   A COMPARISON OF SEVERITY OF ILLNESS SCORING SYSTEMS FOR INTENSIVE-CARE UNIT PATIENTS - RESULTS OF A MULTICENTER, MULTINATIONAL STUDY [J].
CASTELLA, X ;
ARTIGAS, A ;
BION, J ;
KARI, A ;
BENZER, H ;
HUBER, C ;
ALEXANDER, JP ;
DELANDE, M ;
LEDOUX, D ;
CANIVET, JL ;
DAMAS, P ;
DEMEYER, I ;
VISSERS, K ;
DUGERNIER, T ;
HUYGHENS, L ;
DILTOUR, M ;
DEWIT, N ;
NAGLER, J ;
COOLS, F ;
NOLLET, G ;
VERBEKE, J ;
POELAERT, J ;
COLLARDYN, F ;
LATERRE, PF ;
DOUGNAC, A ;
REYNAERT, M ;
RUTSAERT, R ;
COLEMONT, L ;
SCHETZ, M ;
LAUWERS, P ;
HAMILTON, S ;
NORRIS, C ;
SHUSTACK, A ;
JOHNSTON, R ;
KONOPAD, E ;
HANNONEN, P ;
HERSIO, K ;
KAIRI, P ;
KLOSSNER, J ;
SAARELA, E ;
VAHAMURTO, M ;
ARICE, C ;
BEDOCQ, B ;
BLETTERY, B ;
MISSET, B ;
CARLET, J ;
MIER, L ;
DREYFUSS, D ;
FOSSE, JP ;
GARO, B .
CRITICAL CARE MEDICINE, 1995, 23 (08) :1327-1335
[7]  
CHISAKUTA AM, 1990, ULSTER MED J, V59, P161
[8]   A COEFFICIENT OF AGREEMENT FOR NOMINAL SCALES [J].
COHEN, J .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20 (01) :37-46
[9]   PREDICTING HOSPITAL-ASSOCIATED MORTALITY FOR MEDICARE PATIENTS - A METHOD FOR PATIENTS WITH STROKE, PNEUMONIA, ACUTE MYOCARDIAL-INFARCTION, AND CONGESTIVE HEART-FAILURE [J].
DALEY, J ;
JENCKS, S ;
DRAPER, D ;
LENHART, G ;
THOMAS, N ;
WALKER, J .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1988, 260 (24) :3617-3624
[10]   EVALUATION OF SEVERITY SCORING SYSTEMS IN ICUS - TRANSLATION, CONVERSION AND DEFINITION AMBIGUITIES AS A SOURCE OF INTEROBSERVER VARIABILITY IN APACHE-II, SAPS AND OSF [J].
FERYLEMONNIER, E ;
LANDAIS, P ;
LOIRAT, P ;
KLEINKNECHT, D ;
BRIVET, F .
INTENSIVE CARE MEDICINE, 1995, 21 (04) :356-360