Reliability of Chalmers' scale to assess quality in meta-analyses on pharmacological treatments for osteoporosis

被引:14
作者
Bérard, A
Andreu, N
Tétrault, JP
Niyonsenga, T
Myhal, D
机构
[1] Harvard Univ, Brigham & Womens Hosp, Sch Med, Div Pharmacoepidemiol & Pharmacoecon, Boston, MA 02115 USA
[2] Hop Univ, Dept Clin Pharmacol, Toulouse, France
[3] Univ Sherbrooke, Fac Med, Sherbrooke, PQ, Canada
关键词
Chalmers' quality scale; inter-rater reliability; test-retest reliability; meta-analysis; quality; score;
D O I
10.1016/S1047-2797(00)00069-7
中图分类号
R1 [预防医学、卫生学];
学科分类号
1004 ; 120402 ;
摘要
PURPOSE: This study estimates the inter-rater and test-retest reliability of Chalmers' quality scare scale in the context of bone mass loss and fracture rate in postmenopausal women. METHODS: An exhaustive literature search was performed on Medline to locate clinical trials studying the effect of medication use on bone mass loss and fracture rate in postmenopausal women. Twenty articles were randomly selected and four raters independently assessed the quality of each article with Chalmers' scale. Among the 20 articles, 10 were blinded on authors' names, journal, year of publication and source of funding. Raters were also asked to assess all 20 articles one more time, two months after the first evaluation. Intraclass (ICC) and test-retest correlation coefficients were calculated. RESULTS: The overall inter-rater ICC was 0.66 [0.55, 0.79](95%). The overall test-retest reliability of Chalmers' scale was 0.81 [0.67, 0.98](95%) When ratings were stratified according to articles' blinding status, blinded assessments generated a smaller inter-rater ICC than non blinded assessments: 0.30 [0.17, 0.53](95%) VS. 0.80 [0.71, 0.90](95%) In addition, analyzing sub-scales separately generated different estimates of reliability. CONCLUSIONS: This study shows that the reliability of the quality scale developed by Chalmers substantially varies between sub-scales, and is highly dependent on articles' blinding status. The possibility of bias in rating non-blinded articles can not be ruled out. The reliability of the scale can also be dependent on the outcome studied. (C) 2000 Elsevier Science Inc. All rights reserved.
引用
收藏
页码:498 / 503
页数:6
相关论文
共 32 条
[1]   Meta-analysis of the effectiveness of physical activity for the prevention of bone loss in postmenopausal women [J].
Berard, A ;
Bravo, G ;
Gauthier, P .
OSTEOPOROSIS INTERNATIONAL, 1997, 7 (04) :331-337
[2]   Combining studies using effect sizes and quality scores:: Application to bone loss in postmenopausal women [J].
Bérard, A ;
Bravo, G .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 1998, 51 (10) :801-807
[3]   Does blinding of readers affect the results of meta-analyses? [J].
Berlin, JA .
LANCET, 1997, 350 (9072) :185-186
[4]   SELF-MANAGEMENT TEACHING PROGRAMS AND MORBIDITY OF PEDIATRIC ASTHMA - A METAANALYSIS [J].
BERNARDBONNIN, AC ;
STACHENKO, S ;
BONIN, D ;
CHARETTE, C ;
ROUSSEAU, E .
JOURNAL OF ALLERGY AND CLINICAL IMMUNOLOGY, 1995, 95 (01) :34-41
[5]   THE IMPACT OF RESEARCH QUALITY AND STUDY DESIGN ON EPIDEMIOLOGIC ESTIMATES OF THE EFFECT OF NONSTEROIDAL ANTIINFLAMMATORY DRUGS ON UPPER GASTROINTESTINAL-TRACT DISEASE [J].
BOLLINI, P ;
RODRIGUEZ, LAG ;
GUTTHANN, SP ;
WALKER, AM .
ARCHIVES OF INTERNAL MEDICINE, 1992, 152 (06) :1289-1295
[6]   ESTIMATING THE RELIABILITY OF CONTINUOUS MEASURES WITH CRONBACH ALPHA OR THE INTRACLASS CORRELATION-COEFFICIENT - TOWARD THE INTEGRATION OF 2 TRADITIONS [J].
BRAVO, G ;
POTVIN, L .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 1991, 44 (4-5) :381-390
[7]  
BROWN SA, 1991, NURS RES, V40, P352
[8]   A METHOD FOR ASSESSING THE QUALITY OF A RANDOMIZED CONTROL TRIAL [J].
CHALMERS, TC ;
SMITH, H ;
BLACKBURN, B ;
SILVERMAN, B ;
SCHROEDER, B ;
REITMAN, D ;
AMBROZ, A .
CONTROLLED CLINICAL TRIALS, 1981, 2 (01) :31-49
[9]   INSTRUMENTS FOR ASSESSING THE QUALITY OF DRUG STUDIES PUBLISHED IN THE MEDICAL LITERATURE [J].
CHO, MK ;
BERO, LA .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1994, 272 (02) :101-104
[10]  
Colton T, 1974, STAT MED