Reliability and validity of a new five-level triage instrument

Objectives: Triage is the initial clinical sorting process in hospital emergency departments (EDs). Because of poor reproducibility and validity of three-level triage, the authors developed and validated a new five-level triage instrument, the Emergency Severity Index (ESI). The study objectives were: 1) to validate the triage instrument against ED patients' clinical resource and hospitalization needs, and 2) to measure the interrater reliability (reproducibility) of the instrument. Methods: This was a prospective, observational cohort study of a population-based convenience sample of adult patients triaged during 100 hours at two urban referral hospitals. Validation by resource use and hospitalization (criterion standards) and reproducibility by blinded paired triage assignments compared with weighted kappa analysis were assessed. Results: Five hundred thirty-eight patients were enrolled; 45 were excluded due to incomplete evaluations. The resulting cohort of 493 patients was 52% female, was 26% nonwhite, and had a median age of 40 years (range 16-95); overall, 159 (32%) patients were hospitalized. Weighted kappa for triage assignment was 0.80 (95% Cl = 0.76 to 0.84). Resource use and hospitalization rates were strongly associated with triage level. For patients in category 5, only one-fourth (17/67) required any diagnostic test or procedure, and none were hospitalized (upper confidence limit, 5%). Conversely, in category 1, one of twelve patients was discharged (upper confidence limit, 25%), and none required fewer than two resources. Conclusions: This five-level triage instrument was shown to be both Valid and reliable in the authors' practice settings. It reproducibly triages patients into five distinct strata, from very high hospitalization/resource intensity to very low hospitalization/resource intensity.