Does a Level I Evidence" rating imply high quality of reporting in orthopaedic randomised controlled trials?"

被引：79

作者：

Poolman R.W. ^{[1
,4
]}

Struijs P.A.A. ^{[2
,3
]}

Krips R. ^{[2
,3
]}

Sierevelt I.N. ^{[2
]}

Lutz K.H. ^{[4
]}

Bhandari M. ^{[1
,4
]}

机构：

[1] Department Surgery, McMaster University, Hamilton General Hospital, Hamilton, Ont. L8L 2X2, 7 North

[2] OrthoTrauma Research Centre Amsterdam, Department of Orthopedic Surgery, University of Amsterdam, 1100 DD, Amsterdam, G4 Noord

[3] Department of Orthopaedic Surgery and Traumatology, Ziekenhuis Hilversum, 1201 DA, Hilversum

[4] Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton General Hospital, Hamilton, Ont. L8L 2X2, 7 North

来源：

BMC Medical Research Methodology | / 6卷 / 1期

关键词：

Intraclass Correlation Coefficient; Reporting Quality; Consort Statement; Orthopaedic Journal; High Quality Reporting;

D O I：

10.1186/1471-2288-6-44

中图分类号：

学科分类号：

摘要：

Background: The Levels of Evidence Rating System is widely believed to categorize studies by quality, with Level I studies representing the highest quality evidence. We aimed to determine the reporting quality of Randomised Controlled Trials (RCTs) published in the most frequently cited general orthopaedic journals. Methods: Two assessors identified orthopaedic journals that reported a level of evidence rating in their abstracts from January 2003 to December 2004 by searching the instructions for authors of the highest impact general orthopaedic journals. Based upon a priori eligibility criteria, two assessors hand searched all issues of the eligible journal from 2003-2004 for RCTs. The assessors extracted the demographic information and the evidence rating from each included RCT and scored the quality of reporting using the reporting quality assessment tool, which was developed by the Cochrane Bone, Joint and Muscle Trauma Group. Scores were conducted in duplicate, and we reached a consensus for any disagreements. We examined the correlation between the level of evidence rating and the Cochrane reporting quality score. Results: We found that only the Journal of Bone and Joint Surgery - American Volume (JBJS-A) used a level of evidence rating from 2003 to 2004. We identified 938 publications in the JBJS-A from January 2003 to December 2004. Of these publications, 32 (3.4%) were RCTs that fit the inclusion criteria. The 32 RCTs included a total of 3543 patients, with sample sizes ranging from 17 to 514 patients. Despite being labelled as the highest level of evidence (Level 1 and Level II evidence), these studies had low Cochrane reporting quality scores among individual methodological safeguards. The Cochrane reporting quality scores did not differ significantly between Level I and Level II studies. Correlations varied from 0.0 to 0.2 across the 12 items of the Cochrane reporting quality assessment tool (p > 0.05). Among items closely corresponding to the Levels of Evidence Rating System criteria assessors achieved substantial agreement (ICC = 0.80, 95%CI:0.60 to 0.90). Conclusion: Our findings suggest that readers should not assume that 1) studies labelled as Level I have high reporting quality and 2) Level I studies have better reporting quality than Level II studies. One should address methodological safeguards individually. © 2006 Poolman et al; licensee BioMed Central Ltd.

引用

共 22 条

[1]

Uniform Requirements for Manuscripts Submitted to Biomedical Journals, N Engl J Med, 336, pp. 309-316, (1997)

[2]

Brand R.A., Writing for Clinical Orthopaedics and Related Research, Clin Orthop Relat Res, pp. 1-7, (2003)

[3]

Bhandari M., Guyatt G.H., Lochner H., Sprague S., Tornetta III P., Application of the Consolidated Standards of Reporting Trials (CONSORT) in the Fracture Care Literature, J Bone Joint Surg Am, 84 A, pp. 485-489, (2002)

[4]

Bhandari M., Richards R.R., Sprague S., Schemitsch E.H., The quality of reporting of randomized trials in the Journal of Bone and Joint Surgery from 1988 through 2000, J Bone Joint Surg Am, 84 A, pp. 388-396, (2002)

[5]

Wright J.G., Swiontkowski M.F., Heckman J.D., Introducing Levels of Evidence to The Journal, J Bone Joint Surg Am, 85, pp. 1-3, (2003)

[6]

(2006)

[7]

Bhandari M., Swiontkowski M.F., Einhorn T.A., Tornetta III P., Schemitsch E.H., Leece P., Sprague S., Wright J.G., Interobserver Agreement in the Application of Levels of Evidence to Scientific Papers in the American Volume of The Journal of Bone and Joint Surgery, J Bone Joint Surg Am, 86, pp. 1717-1720, (2004)

[8]

Atkins D., Eccles M., Flottorp S., Guyatt G.H., Henry D., Hill S., Liberati A., O'Connell D., Oxman A.D., Phillips B., Schunemann H., Edejer T.T., Vist G.E., Williams J.W.J., Systems for grading the quality of evidence and the strength of recommendations I: Critical appraisal of existing approaches the GRADE Working Group, BMC Health Serv Res, 4, (2004)

[9]

Moja L.P., Telaro E., D'Amico R., Moschetti I., Coe L., Liberati A., Assessment of methodological quality of primary studies by systematic reviews: Results of the metaquality cross sectional study, BMJ, 330, (2005)

[10]

Juni P., Witschi A., Bloch R., Egger M., The hazards of scoring the quality of clinical trials for meta-analysis, JAMA, 282, pp. 1054-1060, (1999)

← 1 2 3 →