Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention

被引:305
作者
Ioannidis, John P. A. [1 ,2 ,3 ,4 ]
Munafo, Marcus R. [5 ,6 ]
Fusar-Poli, Paolo [7 ]
Nosek, Brian A. [8 ,9 ]
David, Sean P. [1 ]
机构
[1] Stanford Univ, Dept Med, Sch Med, Stanford, CA 94305 USA
[2] Stanford Univ, Sch Med, Dept Hlth Res & Policy, Stanford, CA 94305 USA
[3] Stanford Univ, Dept Stat, Sch Humanities & Sci, Stanford, CA 94305 USA
[4] Meta Res Innovat Ctr Stanford METRICS, Stanford, CA 94305 USA
[5] Univ Bristol, UK Ctr Tobacco & Alcohol Studies, MRC Integrat Epidemiol Unit, Bristol, Avon, England
[6] Univ Bristol, Sch Expt Psychol, Bristol, Avon, England
[7] Kings Coll London, Inst Psychiat, Dept Psychosis Studies, London WC2R 2LS, England
[8] Univ Virginia, Ctr Open Sci, Charlottesville, VA 22903 USA
[9] Univ Virginia, Dept Psychol, Charlottesville, VA 22903 USA
基金
英国医学研究理事会; 英国经济与社会研究理事会;
关键词
publication bias; reporting bias; cognitive sciences; neuroscience; bias; ANTIDEPRESSANT TRIALS; RANDOMIZED-TRIALS; METAANALYSIS; REPLICATION; PSYCHOLOGY; EFFICACY; IMPACT; FRAUD; REPLICABILITY; RELIABILITY;
D O I
10.1016/j.tics.2014.02.010
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Recent systematic reviews and empirical evaluations of the cognitive sciences literature suggest that publication and other reporting biases are prevalent across diverse domains of cognitive science. In this review, we summarize the various forms of publication and reporting biases and other questionable research practices, and overview the available methods for probing into their existence. We discuss the available empirical evidence for the presence of such biases across the neuroimaging, animal, other preclinical, psychological, clinical trials, and genetics literature in the cognitive sciences. We also highlight emerging solutions (from study design to data analyses and reporting) to prevent bias and improve the fidelity in the field of cognitive science research.
引用
收藏
页码:235 / 241
页数:7
相关论文
共 97 条
[1]   An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science [J].
Alexander, Anita ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Bosco, Frank A. ;
Brandt, Mark ;
Carp, Joshua ;
Chandler, Jesse J. ;
Clay, Russ ;
Cleary, Hayley ;
Cohn, Michael ;
Costantini, Giulio ;
DeCoster, Jamie ;
Dunn, Elizabeth ;
Eggleston, Casey ;
Estel, Vivien ;
Farach, Frank J. ;
Feather, Jenelle ;
Fiedler, Susann ;
Field, James G. ;
Foster, Joshua D. ;
Frank, Michael ;
Frazier, Rebecca S. ;
Fuchs, Heather M. ;
Galak, Jeff ;
Galliani, Elisa Maria ;
Garcia, Sara ;
Giammanco, Elise M. ;
Gilbert, Elizabeth A. ;
Giner-Sorolla, Roger ;
Goellner, Lars ;
Goh, Jin X. ;
Goss, R. Justin ;
Graham, Jesse ;
Grange, James A. ;
Gray, Jeremy R. ;
Gripshover, Sarah ;
Hartshorne, Joshua ;
Hayes, Timothy B. ;
Jahn, Georg ;
Johnson, Kate ;
Johnston, William ;
Joy-Gaba, Jennifer A. ;
Lai, Calvin K. ;
Lakens, Daniel ;
Lane, Kristin ;
LeBel, Etienne P. ;
Lee, Minha ;
Lemm, Kristi ;
Mackinnon, Sean ;
May, Michael .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2012, 7 (06) :657-660
[2]   Normative dissonance in science: Results from a national survey of US scientists [J].
Anderson, Melissa S. ;
Martinson, Brian C. ;
De Vries, Raymond .
JOURNAL OF EMPIRICAL RESEARCH ON HUMAN RESEARCH ETHICS, 2007, 2 (04) :3-14
[3]   World Medical Association Declaration of Helsinki Ethical Principles for Medical Research Involving Human Subjects [J].
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2013, 310 (20) :2191-2194
[4]  
[Anonymous], J EXP PSYCH IN PRESS
[5]  
[Anonymous], 2013, Social Psychology, DOI [10.1027/1864-9335/a000143, DOI 10.1027/1864-9335/A000143]
[6]  
[Anonymous], 1985, CHANGING ORDER
[7]  
[Anonymous], 2014, IMPLEMENTING REPRODU
[8]   Raise standards for preclinical cancer research [J].
Begley, C. Glenn ;
Ellis, Lee M. .
NATURE, 2012, 483 (7391) :531-533
[9]   Why are psychiatric imaging methods clinically unreliable? Conclusions and practical guidelines for authors, editors and reviewers [J].
Borgwardt, Stefan ;
Radua, Joaquim ;
Mechelli, Andrea ;
Fusar-Poli, Paolo .
BEHAVIORAL AND BRAIN FUNCTIONS, 2012, 8
[10]   Power failure: why small sample size undermines the reliability of neuroscience [J].
Button, Katherine S. ;
Ioannidis, John P. A. ;
Mokrysz, Claire ;
Nosek, Brian A. ;
Flint, Jonathan ;
Robinson, Emma S. J. ;
Munafo, Marcus R. .
NATURE REVIEWS NEUROSCIENCE, 2013, 14 (05) :365-376