An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science

被引：293

作者：

Alexander, Anita

Barnett-Cowan, Michael ^{[2
]}

Bartmess, Elizabeth ^{[3
]}

Bosco, Frank A. ^{[4
]}

Brandt, Mark ^{[5
]}

Carp, Joshua ^{[6
]}

Chandler, Jesse J. ^{[7
]}

Clay, Russ ^{[8
]}

Cleary, Hayley ^{[9
]}

Cohn, Michael ^{[3
]}

Costantini, Giulio ^{[10
]}

DeCoster, Jamie

Dunn, Elizabeth ^{[11
]}

Eggleston, Casey

Estel, Vivien ^{[12
]}

Farach, Frank J. ^{[13
]}

Feather, Jenelle ^{[14
]}

Fiedler, Susann ^{[15
]}

Field, James G. ^{[4
]}

Foster, Joshua D. ^{[16
]}

Frank, Michael

Frazier, Rebecca S.

Fuchs, Heather M. ^{[17
]}

Galak, Jeff

Galliani, Elisa Maria ^{[18
]}

Garcia, Sara

Giammanco, Elise M.

Gilbert, Elizabeth A.

Giner-Sorolla, Roger ^{[19
]}

Goellner, Lars ^{[12
]}

Goh, Jin X. ^{[20
]}

Goss, R. Justin ^{[21
]}

Graham, Jesse ^{[22
]}

Grange, James A. ^{[23
]}

Gray, Jeremy R. ^{[24
]}

Gripshover, Sarah ^{[25
]}

Hartshorne, Joshua ^{[14
]}

Hayes, Timothy B. ^{[22
]}

Jahn, Georg ^{[26
]}

Johnson, Kate ^{[22
]}

Johnston, William ^{[14
]}

Joy-Gaba, Jennifer A. ^{[9
]}

Lai, Calvin K.

Lakens, Daniel ^{[27
]}

Lane, Kristin ^{[28
]}

LeBel, Etienne P.

Lee, Minha

Lemm, Kristi ^{[29
]}

Mackinnon, Sean ^{[30
]}

May, Michael ^{[31
]}

机构：

[1] Univ Virginia, Dept Psychol, Charlottesville, VA 22904 USA

[2] Univ Western Ontario, Brain & Mind Inst, London, ON N6A 3K7, Canada

[3] Univ Calif San Francisco, San Francisco, CA 94143 USA

[4] Marshall Univ, Huntington, WV 25755 USA

[5] Tilburg Univ, Tilburg, Netherlands

[6] Univ Michigan, Ann Arbor, MI 48109 USA

[7] Princeton Univ, Princeton, NJ 08544 USA

[8] Univ Richmond, Richmond, VA 23173 USA

[9] Virginia Commonwealth Univ, Richmond, VA 23284 USA

[10] Univ Milano Bicocca, Milan, Italy

[11] Univ British Columbia, Vancouver, BC V5Z 1M9, Canada

[12] Univ Erfurt, Erfurt, Germany

[13] Univ Washington, Seattle, WA 98195 USA

[14] MIT, Cambridge, MA 02139 USA

[15] Max Planck Inst Res Collect Goods, Leipzig, Germany

[16] Univ S Alabama, Mobile, AL 36688 USA

[17] Univ Cologne, Cologne, Germany

[18] Univ Padua, I-35100 Padua, Italy

[19] Univ Kent, Canterbury CT2 7NZ, Kent, England

[20] Northeastern Univ, Boston, MA USA

[21] Univ Texas San Antonio, San Antonio, TX USA

[22] Univ So Calif, Los Angeles, CA 90089 USA

[23] Univ Keele, Keele ST5 5BG, Staffs, England

[24] Michigan State Univ, E Lansing, MI 48824 USA

[25] Stanford Univ, Stanford, CA 94305 USA

[26] Ernst Moritz Arndt Univ Greifswald, D-17487 Greifswald, Germany

[27] Eindhoven Univ Technol, NL-5600 MB Eindhoven, Netherlands

[28] Bard Coll, Annandale on Hudson, NY 12504 USA

[29] Western Washington Univ, Bellingham, WA 98225 USA

[30] Dalhousie Univ, Halifax, NS B3H 3J5, Canada

[31] Univ Bonn, Bonn, Germany

[32] Elmhurst Coll, Elmhurst, IL USA

[33] Univ Bristol, Bristol BS8 1TH, Avon, England

[34] Reed Coll, Portland, OR USA

[35] Univ Florida, Gainesville, FL 32611 USA

[36] Univ Maryland, College Pk, MD 20742 USA

[37] Calif State Univ Northridge, Northridge, CA 91330 USA

[38] Duke Univ, Durham, NC 27706 USA

来源：

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE | 2012年 / 7卷 / 06期

关键词：

methodology; replication; reproducibility; psychological science; open; REPLICATION; INCENTIVES; AGAIN; TRUTH;

D O I：

10.1177/1745691612462588

中图分类号：

B84 [心理学];

学科分类号：

04 ; 0402 ;

摘要：

Reproducibility is a defining feature of science. However, because of strong incentives for innovation and weak incentives for confirmation, direct replication is rarely practiced or published. The Reproducibility Project is an open, large-scale, collaborative effort to systematically examine the rate and predictors of reproducibility in psychological science. So far, 72 volunteer researchers from 41 institutions have organized to openly and transparently replicate studies published in three prominent psychological journals in 2008. Multiple methods will be used to evaluate the findings, calculate an empirical rate of replication, and investigate factors that predict reproducibility. Whatever the result, a better understanding of reproducibility will ultimately improve confidence in scientific methodology and findings.

引用

页码：657 / 660

页数：4

共 21 条

[1] [Anonymous], 1985, CHANGING ORDER
[2] [Anonymous], 1992, LOGIC SCI DISCOVERY
[3] [Anonymous], 1991, Replication Research in the Social Sciences
[4] Bacon Roger, 1859, R BACON OPERA QUAEDA, V1
[5] Raise standards for preclinical cancer research
Begley, C. Glenn
Ellis, Lee M.
[J]. NATURE, 2012, 483 (7391) : 531 - 533
[6] Bite-Size Science and Its Undesired Side Effects
Bertamini, Marco
Munafo, Marcus R.
[J]. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2012, 7 (01) : 67 - 71
[7] Braude S.E., 1979, ESP and Psychokinesis. A Philosophical Examination
[8] CONSEQUENCES OF PREJUDICE AGAINST NULL HYPOTHESIS
GREENWALD, AG
[J]. PSYCHOLOGICAL BULLETIN, 1975, 82 (01) : 1 - 19
[9] Tracking replicability as a method of post-publication open evaluation
Hartshorne, Joshua K.
Schachner, Adena
[J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2012, 6
[10] Why most published research findings are false
Ioannidis, JPA
[J]. PLOS MEDICINE, 2005, 2 (08) : 696 - 701

← 1 2 3 →