How Trustworthy Is the Scientific Literature in Industrial and Organizational Psychology?

被引:100
作者
Kepes, Sven [1 ]
McDaniel, Michael A. [1 ]
机构
[1] Virginia Commonwealth Univ, Richmond, VA 23284 USA
来源
INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY-PERSPECTIVES ON SCIENCE AND PRACTICE | 2013年 / 6卷 / 03期
关键词
FILE DRAWER PROBLEM; PUBLICATION BIAS; METAANALYTIC REVIEWS; CLINICAL-TRIALS; JUDGMENT CALLS; LOOKING BACK; SCIENCE; REPLICATION; DECISIONS; TESTS;
D O I
10.1111/iops.12045
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
The trustworthiness of research findings has been questioned in many domains of science. This article calls for a review of the trustworthiness of the scientific literature in industrial-organizational (I-O) psychology and a reconsideration of common practices that may harm the credibility of our literature. We note that most hypotheses in I-O psychology journals are confirmed. Thus, we are either approaching omniscience or our journals are publishing an unrepresentative sample of completed research. We view the latter explanation as more likely. We review structural problems in the publication process and in the conduct of research that is likely to promote a distortion of scientific knowledge. We then offer recommendations to make the I-O literature more accurate and trustworthy.
引用
收藏
页码:252 / 268
页数:17
相关论文
共 128 条
[1]  
Academy of Management Journal, 2012, INF CONTR
[2]   Meta-Analytic Choices and Judgment Calls: Implications for Theory Building and Testing, Obtained Effect Sizes, and Scholarly Impact [J].
Aguinis, Herman ;
Dalton, Dan R. ;
Bosco, Frank A. ;
Pierce, Charles A. ;
Dalton, Catherine M. .
JOURNAL OF MANAGEMENT, 2011, 37 (01) :5-38
[3]   An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science [J].
Alexander, Anita ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Bosco, Frank A. ;
Brandt, Mark ;
Carp, Joshua ;
Chandler, Jesse J. ;
Clay, Russ ;
Cleary, Hayley ;
Cohn, Michael ;
Costantini, Giulio ;
DeCoster, Jamie ;
Dunn, Elizabeth ;
Eggleston, Casey ;
Estel, Vivien ;
Farach, Frank J. ;
Feather, Jenelle ;
Fiedler, Susann ;
Field, James G. ;
Foster, Joshua D. ;
Frank, Michael ;
Frazier, Rebecca S. ;
Fuchs, Heather M. ;
Galak, Jeff ;
Galliani, Elisa Maria ;
Garcia, Sara ;
Giammanco, Elise M. ;
Gilbert, Elizabeth A. ;
Giner-Sorolla, Roger ;
Goellner, Lars ;
Goh, Jin X. ;
Goss, R. Justin ;
Graham, Jesse ;
Grange, James A. ;
Gray, Jeremy R. ;
Gripshover, Sarah ;
Hartshorne, Joshua ;
Hayes, Timothy B. ;
Jahn, Georg ;
Johnson, Kate ;
Johnston, William ;
Joy-Gaba, Jennifer A. ;
Lai, Calvin K. ;
Lakens, Daniel ;
Lane, Kristin ;
LeBel, Etienne P. ;
Lee, Minha ;
Lemm, Kristi ;
Mackinnon, Sean ;
May, Michael .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2012, 7 (06) :657-660
[4]   MEASURES OF INEQUALITY [J].
ALLISON, PD .
AMERICAN SOCIOLOGICAL REVIEW, 1978, 43 (06) :865-880
[5]  
American Psychological Association, 2010, AM PSYCHOL
[6]  
[Anonymous], 2000, Practical intelligence in everyday life
[7]  
[Anonymous], 2010, PUBL MAN AM PSYCH AS
[8]  
[Anonymous], ANN M SOC IND ORG PS
[9]   Revealed or Concealed? Transparency of Procedures, Decisions, and Judgment Calls in Meta-Analyses [J].
Aytug, Zeynep G. ;
Rothstein, Hannah R. ;
Zhou, Wencang ;
Kern, Mary C. .
ORGANIZATIONAL RESEARCH METHODS, 2012, 15 (01) :103-133
[10]   Disclose all data in publications [J].
Baggerly, Keith .
NATURE, 2010, 467 (7314) :401-401