Publication Bias in the Organizational Sciences

被引:331
作者
Kepes, Sven [1 ]
Banks, George C. [1 ]
McDaniel, Michael
Whetzel, Deborah L. [2 ]
机构
[1] Virginia Commonwealth Univ, Sch Business, Richmond, VA 23284 USA
[2] Human Resources Res Org HumRRO, Alexandria, VA USA
关键词
meta-analysis; quantitative research; missing data; publication bias; CLINICAL-TRIAL REGISTRATION; SELECTION BIAS; CUMULATIVE METAANALYSIS; PERSONNEL-SELECTION; EMPIRICAL-EVIDENCE; SAMPLE SELECTION; VALIDITY; IMPACT; OUTCOMES; FILL;
D O I
10.1177/1094428112452760
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
Publication bias poses multiple threats to the accuracy of meta-analytically derived effect sizes and related statistics. Unfortunately, a review of the literature indicates that unlike meta-analytic reviews in medicine, research in the organizational sciences tends to pay little attention to this issue. In this article, the authors introduce advances in meta-analytic techniques from the medical and related sciences for a comprehensive assessment and evaluation of publication bias. The authors illustrate their use on a data set on employment interview validities. Using multiple methods, including contour-enhanced funnel plots, trim and fill, Egger's test of the intercept, Begg and Mazumdar's rank correlation, meta-regression, cumulative meta-analysis, and selection models, the authors find limited evidence of publication bias in the studied data.
引用
收藏
页码:624 / 662
页数:39
相关论文
共 123 条
[1]   Organizational research methods yearly update [J].
Aguinis, Herman ;
Vandenberg, Robert J. .
ORGANIZATIONAL RESEARCH METHODS, 2008, 11 (01) :3-5
[2]   Debunking Myths and Urban Legends About Meta-Analysis [J].
Aguinis, Herman ;
Pierce, Charles A. ;
Bosco, Frank A. ;
Dalton, Dan R. ;
Dalton, Catherine M. .
ORGANIZATIONAL RESEARCH METHODS, 2011, 14 (02) :306-331
[3]   Customer-Centric Science: Reporting Significant Research Results With Rigor, Relevance, and Practical Impact in Mind [J].
Aguinis, Herman ;
Werner, Steve ;
Abbott, JeAnna Lanza ;
Angert, Cory ;
Park, Joon Hyung ;
Kohlhausen, Donna .
ORGANIZATIONAL RESEARCH METHODS, 2010, 13 (03) :515-539
[4]  
[Anonymous], 2010, J CITATION REPORTS
[5]  
[Anonymous], 2010, SURGERY, DOI DOI 10.1016/J.SURG.2009.06.030
[6]  
[Anonymous], 2010, PUBL MAN AM PSYCH AS
[7]  
[Anonymous], 1983, Journal of Educational Statistics, DOI [DOI 10.2307/1164923, DOI 10.3102/1076998600800215]
[8]   Revealed or Concealed? Transparency of Procedures, Decisions, and Judgment Calls in Meta-Analyses [J].
Aytug, Zeynep G. ;
Rothstein, Hannah R. ;
Zhou, Wencang ;
Kern, Mary C. .
ORGANIZATIONAL RESEARCH METHODS, 2012, 15 (01) :103-133
[9]   Publication Bias: The Antagonist of Meta-Analytic Reviews and Effective Policymaking [J].
Banks, George C. ;
Kepes, Sven ;
Banks, Karen P. .
EDUCATIONAL EVALUATION AND POLICY ANALYSIS, 2012, 34 (03) :259-277
[10]   Publication Bias: A call for improved meta-analytic practice in the organizational sciences [J].
Banks, George C. ;
Kepes, Sven ;
McDaniel, Michael A. .
INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, 2012, 20 (02) :182-196