Impact of missing participant data for dichotomous outcomes on pooled effect estimates in systematic reviews: A protocol for a methodological study

被引:20
作者
Akl E.A. [1 ,2 ]
Kahale L.A. [1 ]
Agarwal A. [2 ]
Al-Matari N. [1 ]
Ebrahim S. [2 ,5 ,8 ]
Alexander P.E. [2 ]
Briel M. [2 ,3 ]
Brignardello-Petersen R. [2 ,4 ]
Busse J.W. [2 ,5 ,6 ]
Diab B. [1 ]
Iorio A. [2 ,16 ]
Kwong J. [9 ]
Li L. [9 ]
Lopes L.C. [7 ]
Mustafa R. [2 ,10 ]
Neumann I. [2 ,11 ]
Tikkinen K.A.O. [12 ]
Vandvik P.O. [13 ,14 ]
Zhang Y. [2 ]
Alonso-Coello P. [15 ]
Guyatt G. [2 ,16 ]
机构
[1] Department of Internal Medicine, Clinical Epidemiology Unit, American University of Beirut Medical Center, PO Box: 11-0236, Riad-El-Solh, Beirut, 1107
[2] Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton
[3] Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Hebelstrasse 10, Basel
[4] Evidence Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Santiago
[5] Department of Anesthesia, McMaster University, Hamilton
[6] The Michael G. DeGroote Institute for Pain Research and Care, McMaster University, Hamilton
[7] Pharmaceutical Sciences Post graduate Course, University of Sorocaba, UNISO, Sorocaba, Sao Paulo
[8] Stanford Prevention Research Center, Department of Medicine, Stanford University, Stanford
[9] Clinical Research and Evaluation Unit, Chinese Evidence-based Medicine Center, West China Hospital, Sichuan University, Chengdu
[10] Departments of Medicine and Biomedical and Health Informatics, University of Missouri-Kansas City, Kansas
[11] Department of Internal Medicine, School of Medicine, Pontificia Universidad Católica de Chile, Santiago
[12] Departments of Urology and Public Health, Helsinki University Central Hospital and University of Helsinki, Helsinki
[13] Norwegian Knowledge Centre for the Health Services, Oslo
[14] Department of Medicine, Innlandet Hospital Trust, Gjøvik
[15] Iberoamerican Cochrane Centre, Institute of Biomedical Research (IIB Sant Pau), Barcelona
[16] Department of Medicine, McMaster University, Hamilton
关键词
Imputation; Meta-analysis; Missing participant data; Risk of bias; Systematic reviews; Trials;
D O I
10.1186/2046-4053-3-137
中图分类号
学科分类号
摘要
Background: There is no consensus on how authors conducting meta-analysis should deal with trial participants with missing outcome data. The objectives of this study are to assess in Cochrane and non-Cochrane systematic reviews: (1) which categories of trial participants the systematic review authors consider as having missing participant data (MPD), (2) how trialists reported on participants with missing outcome data in trials, (3) whether systematic reviewer authors actually dealt with MPD in their meta-analyses of dichotomous outcomes consistently with their reported methods, and (4) the impact of different methods of dealing with MPD on pooled effect estimates in meta-analyses of dichotomous outcomes. Methods/Design: We will conduct a methodological study of Cochrane and non-Cochrane systematic reviews. Eligible systematic reviews will include a group-level meta-analysis of a patient-important dichotomous efficacy outcome, with a statistically significant effect estimate. Teams of two reviewers will determine eligibility and subsequently extract information from each eligible systematic review in duplicate and independently, using standardized, pre-piloted forms. The teams will then use a similar process to extract information from the trials included in the meta-analyses of interest. We will assess first which categories of trial participants the systematic reviewers consider as having MPD. Second, we will assess how trialists reported on participants with missing outcome data in trials. Third, we will compare what systematic reviewers report having done, and what they actually did, in dealing with MPD in their meta-analysis. Fourth, we will conduct imputation studies to assess the effects of different methods of dealing with MPD on the pooled effect estimates of meta-analyses. We will specifically calculate for each method (1) the percentage of systematic reviews that lose statistical significance and (2) the mean change of effect estimates across systematic reviews. Discussion: The impact of different methods of dealing with MPD on pooled effect estimates will help judge the associated risk of bias in systematic reviews. Our findings will inform recommendations regarding what assumptions for MPD should be used to test the robustness of meta-analytical results. © 2014 Akl et al.
引用
收藏
相关论文
共 24 条
  • [1] Akl E.A., Briel M., You J.J., Sun X., Johnston B.C., Busse J.W., Mulla S., Lamontagne F., Bassler D., Vera C., Alshurafa M., Katsios C.M., Zhou Q., Cukierman-Yaffe T., Gangji A., Mills E.J., Walter S.D., Cook D.J., Schunemann H.J., Altman D.G., Guyatt G.H., Potential impact on estimated treatment effects of information lost to follow-up in randomised controlled trials (LOST-IT): systematic review, BMJ, 344, (2012)
  • [2] Alonso-Coello P., Carrasco-Labra A., Brignardello-Petersen R., Neumann I., Akl E.A., Sun X., Johnston B.C., Briel M., Busse J.W., Glujovsky D., Granados C.E., Iorio A., Irfan A., Garcia L.M., Mustafa R.A., Ramirez-Morera A., Sola I., Tikkinen K.A., Ebrahim S., Vandvik P.O., Zhang Y., Selva A., Sanabria A.J., Zazueta O.E., Vernooij R.W., Schunemann H.J., Guyatt G.H., A methodological survey of the analysis, reporting and interpretation of absolute risk reduction in systematic revieWs (ARROW): a
  • [3] Higgins J.P., Altman D.G., Gotzsche P.C., Juni P., Moher D., Oxman A.D., Savovic J., Schulz K.F., Weeks L., Sterne J.A., The Cochrane collaboration's tool for assessing risk of bias in randomised trials, BMJ, 343, (2011)
  • [4] Savovic J., Weeks L., Sterne J.A., Turner L., Altman D.G., Moher D., Higgins J.P., Evaluation of the Cochrane collaboration's tool for assessing the risk of bias in randomized trials: focus groups, online survey, proposed recommendations and their implementation, Syst Rev, 3, (2014)
  • [5] Akl E.A., Johnston B.C., Alonso-Coello P., Neumann I., Ebrahim S., Briel M., Cook D.J., Guyatt G.H., Addressing dichotomous data for participants excluded from trial analysis: a guide for systematic reviewers, PLoS One, 8, (2013)
  • [6] Ebrahim S., Akl E.A., Mustafa R.A., Sun X., Walter S.D., Heels-Ansdell D., Alonso-Coello P., Johnston B.C., Guyatt G.H., Addressing continuous data for participants excluded from trial analysis: a guide for systematic reviewers, Clin Epidemiol, 66, (2013)
  • [7] Ebrahim S., Johnston B.C., Akl E.A., Mustafa R.A., Sun X., Walter S.D., Heels-Ansdell D., Alonso-Coello P., Guyatt G.H., Addressing continuous data measured with different instruments for participants excluded from trial analysis: a guide for systematic reviewers, J Clin Epidemiol, 67, pp. 560-570, (2014)
  • [8] Akl E.A., Briel M., You J.J., Lamontagne F., Gangji A., Cukierman-Yaffe T., Alshurafa M., Sun X., Nerenberg K.A., Johnston B.C., Vera C., Mills E.J., Bassler D., Salazar A., Bhatnagar N., Busse J.W., Khalid Z., Walter S., Cook D.J., Schunemann H.J., Altman D.G., Guyatt G.H., LOST to follow-up information in trials (LOST-IT): a protocol on the potential impact, Trials, 10, (2009)
  • [9] Guyatt G., Oxman A.D., Akl E.A., Kunz R., Vist G., Brozek J., Norris S., Falck-Ytter Y., Glasziou P., DeBeer H., Jaeschke R., Rind D., Meerpohl J., Dahm P., Schunemann H.J., GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables, J Clin Epidemiol, 64, pp. 383-394, (2011)
  • [10] Cramer H., Mathematical Methods of Statistics, (1946)