No role for quality scores in systematic reviews of diagnostic accuracy studies

被引：238

作者：

Whiting P. ^{[1
]}

Harbord R. ^{[1
]}

Kleijnen J. ^{[2
]}

机构：

[1] MRC Health Services Research Collaboration, Department of Social Medicine, University of Bristol, Bristol

[2] Centre for Reviews and Dissemination, University of York, York

来源：

BMC Medical Research Methodology | / 5卷 / 1期

关键词：

Quality Score; High Quality Study; Diagnostic Odds Ratio; Quality Assessment Tool; Diagnostic Accuracy Study;

D O I：

10.1186/1471-2288-5-19

中图分类号：

学科分类号：

摘要：

Background: There is a lack of consensus regarding the use of quality scores in diagnostic systematic reviews. The objective of this study was to use different methods of weighting items included in a quality assessment tool for diagnostic accuracy studies (QUADAS) to produce an overall quality score, and to examine the effects of incorporating these into a systematic review. Methods: We developed five schemes for weighting QUADAS to produce quality scores. We used three methods to investigate the effects of quality scores on test performance. We used a set of 28 studies that assessed the accuracy of ultrasound for the diagnosis of vesico-ureteral reflux in children. Results: The different methods of weighting individual items from the same quality assessment tool produced different quality scores. The different scoring schemes ranked different studies in different orders; this was especially evident for the intermediate quality studies. Comparing the results of studies stratified as "high" and "low" quality based on quality scores resulted in different conclusions regarding the effects of quality on estimates of diagnostic accuracy depending on the method used to produce the quality score. A similar effect was observed when quality scores were included in meta-regression analysis as continuous variables, although the differences were less apparent. Conclusion: Quality scores should not be incorporated into diagnostic systematic reviews. Incorporation of the results of the quality assessment into the systematic review should involve investigation of the association of individual quality items with estimates of diagnostic accuracy, rather than using a combined quality score. © 2005 Whiting et al; licensee BioMed Central Ltd.

引用

共 49 条

[21]

Whiting P., Westwood M., Ginnelly L., Palmer S., Richardson G., Cooper J., Watt I., Glanville J., Sculpher M., Kleijnen J., A systematic review of tests for the diagnosis and evaluation of urinary tract infection (UTI) in children under five years, Health Technology Assessment, (2005)

[22]

Moses L.E., Shapiro D., Littenberg B., Combining independent studies of a diagnostic test into a summary ROC curve: Data-analystic approaches and some additional considerations, Stat Med, 12, pp. 1293-1316, (1993)

[23]

Bergius A.R., Niskanen K., Kekomaki M., Detection of significant vesico-ureteric reflux by ultrasound in infants and children, Z Kinderchir, 45, pp. 144-145, (1990)

[24]

Baronciani D., Bonora G., Andreoli A., Cambie M., Nedbal M., Dellagnola C.A., The Value of Ultrasound for Diagnosing the Uropathy in Children with Urinary-Tract Infections, Rivista Italiana di Pediatria-Italian Journal of Pediatrics, 12, pp. 214-220, (1986)

[25]

Dura T.T., Gonzalez M.R., Juste R.M., De Gonzalez D.J., Carratala M.F., Moya B.M., Verdu R.J., Caballero C.O., Usefulness of renal scintigraphy in the assessment of the first febrile urinary infection in children, An Esp Pediatr, 47, pp. 378-382, (1997)

[26]

Evans E.D., Meyer J.S., Harty M.P., Bellah R.D., Assessment of increase in renal pelvic size on post-void sonography as a predictor of vesicoureteral reflux, Pediatr Radiol, 29, pp. 291-294, (1999)

[27]

Foresman W.H., Hulbert W.C.J., Rabinowitz R., Does urinary tract ultrasonography at hospitalization for acute pyelonephritis predict vesicoureteral reflux?, J Urol, 165, pp. 2232-2234, (2001)

[28]

Mage K., Zoppardo P., Cohen R., Reinert P., Ponet M., Imaging and the first urinary infection in children. Respective role of each test during the initial evaluation apropos of 122 cases, J Radiol, 70, pp. 279-283, (1989)

[29]

Mahant S., Friedman J., MacArthur C., Renal ultrasound findings and vesicoureteral reflux in children hospitalised with urinary tract infection, Arch Dis Child, 86, pp. 419-420, (2002)

[30]

Morin D., Veyrac C., Kotzki P.O., Lopez C., Dalla V.F., Durand M.F., Astruc J., Dumas R., Comparison of ultrasound and dimercaptosuccinic acid scintigraphy changes in acute pyelonephritis, Pediatr Nephrol, 13, pp. 219-222, (1999)

← 1 2 3 4 5 →