More Than Numbers: The Power of Graphs in Meta-Analysis

被引:131
作者
Bax, Leon [1 ,2 ,5 ]
Ikeda, Noriaki [2 ]
Fukui, Naohito [3 ]
Yaju, Yukari [4 ]
Tsuruta, Harukazu [2 ]
Moons, Karel G. M. [5 ]
机构
[1] Kitasato Univ, Kitasato Clin Res Ctr, Sagamihara, Kanagawa 2288555, Japan
[2] Kitasato Univ, Dept Med Informat, Sagamihara, Kanagawa 2288555, Japan
[3] Japan Clin Res Support Unit, Tokyo, Japan
[4] Univ Tokyo, Sch Hlth Sci & Nursing, Dept Epidemiol & Biostat, Tokyo, Japan
[5] Univ Med Ctr Utrecht, Julius Ctr Hlth Sci & Primary Care, Utrecht, Netherlands
关键词
PUBLICATION BIAS; FUNNEL-PLOT; EXPLORING HETEROGENEITY; FILL METHOD; TRIM;
D O I
10.1093/aje/kwn340
中图分类号
R1 [预防医学、卫生学];
学科分类号
1004 ; 120402 ;
摘要
In meta-analysis, the assessment of graphs is widely used in an attempt to identify or rule out heterogeneity and publication bias. A variety of graphs are available for this purpose. To date, however, there has been no comparative evaluation of the performance of these graphs. With the objective of assessing the reproducibility and validity of graph ratings, the authors simulated 100 meta-analyses from 4 scenarios that covered situations with and without heterogeneity and publication bias. From each meta-analysis, the authors produced 11 types of graphs (box plot, weighted box plot, standardized residual histogram, normal quantile plot, forest plot, 3 kinds of funnel plots, trim-and-fill plot, Galbraith plot, and L'Abbe plot), and 3 reviewers assessed the resulting 1,100 plots. The intraclass correlation coefficients (ICCs) for reproducibility of the graph ratings ranged from poor (ICC = 0.34) to high (ICC = 0.91). Ratings of the forest plot and the standardized residual histogram were best associated with parameter heterogeneity. Association between graph ratings and publication bias (censorship of studies) was poor. Meta-analysts should be selective in the graphs they choose for the exploration of their data.
引用
收藏
页码:249 / 255
页数:7
相关论文
共 43 条
[21]  
MATSUMOTO M, 2002, MERSENNE TWISTER HOM
[22]   Forming inferences about some intraclass correlation coefficients [J].
McGraw, KO ;
Wong, SP .
PSYCHOLOGICAL METHODS, 1996, 1 (01) :30-46
[23]   Understanding systematic reviews: the meta-analysis graph (also called 'forest plot') [J].
Moja, L. ;
Moschetti, I. ;
Liberati, A. ;
Gensini, G. F. ;
Gusinu, R. .
INTERNAL AND EMERGENCY MEDICINE, 2007, 2 (02) :140-142
[24]   Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity [J].
Peters, Jaime L. ;
Sutton, Alex J. ;
Jones, David R. ;
Abrams, Keith R. ;
Rushton, Lesley .
STATISTICS IN MEDICINE, 2007, 26 (25) :4544-4562
[25]  
Portney L.G., 1999, FDN CLIN RES APPL PR, V2
[26]  
Pournelle G. H., 1953, Journal of Mammalogy, V34, P133, DOI 10.1890/0012-9658(2002)083[1421:SDEOLC]2.0.CO
[27]  
2
[28]  
Ried Karin, 2006, Aust Fam Physician, V35, P635
[29]  
Rothstein H, 2005, PUBLICATION BIAS IN META-ANALYSIS: PREVENTION, ASSESSMENT AND ADJUSTMENTS, pIX
[30]  
Song F., 2000, Health Technology Assessment, V4, P1