Assessing Surgical Quality Using Administrative and Clinical Data Sets: A Direct Comparison of the University HealthSystem Consortium Clinical Database and the National Surgical Quality Improvement Program Data Set

The use of "clinical" versus "administrative" data sets for health care quality assessment continues to be debated. This study directly compares the University HealthSystem Consortium Clinical Database (UHC CDB) and the National Surgical Quality Improvement Program (NSQIP) in terms of their assessment of complications and death for 26 322 surgery patients using analyses of variance, correlation, and multivariable logistic regression. The NSQIP had more variables with significant correlation with outcomes. The NSQIP was better at predicting death (c-index 0.94 vs 0.90, P < .05) and complications (c-index 0.78 vs 0.76, P = .07), especially for higher risk patients. The UHC CDB missed and misclassified several major complications. The data sets are similar in their explanatory power relative to outcomes, but the clinical data set is better, particularly at identifying higher risk patients and specific complications. It should prove more useful for initiating and monitoring clinical process improvements because of more clinically relevant variables. (Am J Med Qual 2009;24:395-402)