Direction and impact of language bias in meta-analyses of controlled trials:: empirical study

被引:641
作者
Jüni, P
Holenstein, F
Sterne, J
Bartlett, C
Egger, M
机构
[1] Univ Bristol, Dept Social Med, MRC, Hlth Serv Res Collaborat, Bristol BS8 2PR, Avon, England
[2] Univ Bern, Dept Social & Prevent Med, CH-3012 Bern, Switzerland
关键词
meta-analysis; randomized-controlled trials; publication bias; language bias; meta-regression;
D O I
10.1093/ije/31.1.115
中图分类号
R1 [预防医学、卫生学];
学科分类号
1004 ; 120402 ;
摘要
Background Excluding clinical trials reported in languages other than English from meta-analyses may introduce bias and reduce the precision of combined estimates of treatment effects. We examined the influence of trials published in languages other than English on combined estimates and conclusions of published meta-analyses. Methods We searched journals and the Cochrane Database of Systematic Reviews for meta-analyses of at least five trials with binary outcomes that were based on comprehensive literature searches without language restrictions. We compared estimates of treatment effects from trials published in languages other than English to those from trials published in English, and assessed the impact of restricting meta-analyses to trials published in English. Results We identified 303 meta-analyses: 159 (52.4%) employed comprehensive literature searches of which 50 included 485 English and 115 non-English language trials. Non-English language trials included fewer participants (median 88 versus 116, P = 0.006) and were more likely to produce significant results at P < 0.05 (41.7% versus 31.3%, P = 0.033). The methodological quality of non-English language trials tended to be lower than that of trials published in English. Estimates of treatment effects were on average 16% (95% CI: 3-26%) more beneficial in non-English-language trials than in English-language trials. In 29 (58.0%) meta-analyses the change in effect estimates after exclusion of non-English language trials was less than 5%. In the remaining meta-analyses, 5 (10.0%) showed more benefit and 16 (32.0%) less benefit after exclusion of non-English language trials. Conclusions This retrospective analysis suggests that excluding trials published in languages other than English has generally little effect on summary treatment effect estimates. The importance of non-English language trials is, however, difficult to predict for individual systematic reviews. Comprehensive literature searches followed by a careful assessment of trial quality are required to assess the contribution of all relevant trials, independent of language of publication.
引用
收藏
页码:115 / 123
页数:9
相关论文
共 35 条
[1]   The revised CONSORT statement for reporting randomized trials: Explanation and elaboration [J].
Altman, DG ;
Schulz, KF ;
Moher, D ;
Egger, M ;
Davidoff, F ;
Elbourne, D ;
Gotzsche, PC ;
Lang, T .
ANNALS OF INTERNAL MEDICINE, 2001, 134 (08) :663-694
[2]  
[Anonymous], 2001, UND SYST REV RES EFF
[3]  
[Anonymous], 2001, Systematic Reviews in Health Care, DOI [10.1002/9780470693926.ch2, DOI 10.1002/9780470693926.CH2]
[4]  
Clarke M., 2001, COCHRANE LIB
[5]  
*COCHR DAT SYST RE, 2001, COCHR LIB
[6]   METHODOLOGIC GUIDELINES FOR SYSTEMATIC REVIEWS OF RANDOMIZED CONTROL TRIALS IN HEALTH-CARE FROM THE POTSDAM CONSULTATION ON METAANALYSIS [J].
COOK, DJ ;
SACKETT, DL ;
SPITZER, WO .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 1995, 48 (01) :167-171
[7]  
*DARE, 2001, COCHR LIB
[8]   REPORTING ON METHODS IN CLINICAL-TRIALS [J].
DERSIMONIAN, R ;
CHARETTE, LJ ;
MCPEEK, B ;
MOSTELLER, F .
NEW ENGLAND JOURNAL OF MEDICINE, 1982, 306 (22) :1332-1337
[9]   PUBLICATION BIAS IN CLINICAL RESEARCH [J].
EASTERBROOK, PJ ;
BERLIN, JA ;
GOPALAN, R ;
MATTHEWS, DR .
LANCET, 1991, 337 (8746) :867-872
[10]   Meta-analysis - Bias in location and selection of studies [J].
Egger, M ;
Smith, GD .
BMJ-BRITISH MEDICAL JOURNAL, 1998, 316 (7124) :61-66