Redefine statistical significance

被引:1774
作者
Benjamin, Daniel J. [1 ,2 ]
Berger, James O. [3 ]
Johannesson, Magnus [4 ]
Nosek, Brian A. [5 ,6 ]
Wagenmakers, E. -J. [7 ]
Berk, Richard [8 ,9 ,12 ]
Bollen, Kenneth A. [10 ]
Brembs, Bjoern [11 ]
Brown, Lawrence [12 ]
Camerer, Colin [13 ]
Cesarini, David [14 ,15 ]
Chambers, Christopher D. [16 ]
Clyde, Merlise [3 ]
Cook, Thomas D. [17 ,18 ]
De Boeck, Paul [19 ]
Dienes, Zoltan [20 ]
Dreber, Anna [4 ]
Easwaran, Kenny [21 ]
Efferson, Charles [22 ]
Fehr, Ernst [23 ]
Fidler, Fiona [24 ,25 ]
Field, Andy P. [20 ]
Forster, Malcolm [26 ]
George, Edward I. [12 ]
Gonzalez, Richard [27 ]
Goodman, Steven [28 ]
Green, Edwin [29 ]
Green, Donald P. [30 ]
Greenwald, Anthony [31 ]
Hadfield, Jarrod D. [32 ]
Hedges, Larry V. [33 ]
Held, Leonhard [34 ]
Ho, Teck Hua [35 ]
Hoijtink, Herbert [36 ]
Hruschka, Daniel J. [37 ]
Imai, Kosuke [38 ,39 ]
Imbens, Guido [40 ]
Ioannidis, John P. A. [41 ,42 ,43 ,44 ,45 ]
Jeon, Minjeong [46 ]
Jones, James Holland [47 ,48 ]
Kirchler, Michael [49 ,50 ]
Laibson, David [51 ]
List, John [52 ]
Little, Roderick [53 ]
Lupia, Arthur [54 ]
Machery, Edouard [55 ]
Maxwell, Scott E. [56 ]
McCarthy, Michael [57 ]
Moore, Don [58 ]
Morgan, Stephen L. [59 ]
机构
[1] Univ Southern Calif, Ctr Econ & Social Res, Los Angeles, CA 90089 USA
[2] Univ Southern Calif, Dept Econ, Los Angeles, CA 90089 USA
[3] Duke Univ, Dept Stat Sci, Durham, NC 27708 USA
[4] Stockholm Sch Econ, Dept Econ, SE-11383 Stockholm, Sweden
[5] Univ Virginia, Charlottesville, VA 22908 USA
[6] Ctr Open Sci, Charlottesville, VA 22903 USA
[7] Univ Amsterdam, Dept Psychol, NL-1018 VZ Amsterdam, Netherlands
[8] Univ Penn, Sch Arts & Sci, Philadelphia, PA 19104 USA
[9] Univ Penn, Dept Criminol, Philadelphia, PA 19104 USA
[10] Univ North Carolina Chapel Hill, Dept Sociol, Dept Psychol & Neurosci, Chapel Hill, NC 27599 USA
[11] Univ Regensburg, Inst Zool Neurogenet, Univ Str 31, D-93040 Regensburg, Germany
[12] Univ Penn, Wharton Sch, Dept Stat, Philadelphia, PA 19104 USA
[13] CALTECH, Div Humanities & Social Sci, Pasadena, CA 91125 USA
[14] NYU, Dept Econ, 550 1St Ave, New York, NY 10012 USA
[15] Res Inst Ind Econ IFN, SE-10215 Stockholm, Sweden
[16] CUBRIC, Cardiff CF24 4HQ, S Glam, Wales
[17] Northwestern Univ, Evanston, IL 60208 USA
[18] Math Policy Res, Washington, DC 20002 USA
[19] Ohio State Univ, Dept Psychol, Quantitat Program, Columbus, OH 43210 USA
[20] Univ Sussex, Sch Psychol, Brighton BN1 9QH, E Sussex, England
[21] Texas A&M Univ, Dept Philosophy, College Stn, TX 77843 USA
[22] Royal Holloway Univ London, Dept Psychol, Egham TW20 0EX, Surrey, England
[23] Univ Zurich, Dept Econ, CH-8006 Zurich, Switzerland
[24] Univ Melbourne, Sch BioSci, Parkville, Vic 3010, Australia
[25] Univ Melbourne, Sch Hist & Philosoph Studies, Parkville, Vic 3010, Australia
[26] Univ Wisconsin Madison, Dept Philosophy, Madison, WI 53706 USA
[27] Univ Michigan, Dept Psychol, 580 Union Dr, Ann Arbor, MI 48109 USA
[28] Stanford Univ, Gen Med Disciplines, Stanford, CA 94305 USA
[29] Rutgers State Univ, Dept Ecol Evolut & Nat Resources SEBS, New Brunswick, NJ 08901 USA
[30] Columbia Univ City New York, Dept Polit Sci, New York, NY 10027 USA
[31] Univ Washington, Dept Psychol, Seattle, WA 98195 USA
[32] Univ Edinburgh, Sch Biol Sci, Inst Evolutionary Biol, Edinburgh EH9 3JT, Midlothian, Scotland
[33] Northwestern Univ, Dept Stat, Weinberg Coll Arts & Sci, Evanston, IL 60208 USA
[34] Univ Zurich, EBPI, CH-8001 Zurich, Switzerland
[35] Natl Univ Singapore, Singapore 119077, Singapore
[36] Univ Utrecht, Dept Methods & Stat, NL-3584 CH Utrecht, Netherlands
[37] Arizona State Univ, Sch Human Evolut & Social Change, Tempe, AZ 85287 USA
[38] Princeton Univ, Dept Polit, Princeton, NJ 08544 USA
[39] Princeton Univ, Ctr Stat & Machine Learning, Princeton, NJ 08544 USA
[40] Stanford Univ, Stanford, CA 94305 USA
[41] Stanford Univ, Dept Med, Stanford, CA 94305 USA
[42] Stanford Univ, Dept Hlth Res & Policy, Stanford, CA 94305 USA
[43] Stanford Univ, Dept Biomed Data Sci, Stanford, CA 94305 USA
[44] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[45] Stanford Univ, Meta Res Innovat Ctr Stanford METRICS, Stanford, CA 94305 USA
[46] Univ Calif Los Angeles, Grad Sch Educ & Informat Studies, Dept Educ, Adv Quantitat Methods,Social Res Methodol, Los Angeles, CA 90095 USA
[47] Imperial Coll London, Dept Life Sci, Ascot SL5 7PY, Berks, England
[48] Dept Earth Syst Sci, Stanford, CA 94305 USA
[49] Univ Innsbruck, Dept Banking & Finance, A-6020 Innsbruck, Austria
[50] Univ Gothenburg, A-6020 Innsbruck, Austria
来源
NATURE HUMAN BEHAVIOUR | 2018年 / 2卷 / 01期
基金
美国国家科学基金会;
关键词
P-VALUES; REPRODUCIBILITY;
D O I
10.1038/s41562-017-0189-z
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
[No abstract available]
引用
收藏
页码:6 / 10
页数:5
相关论文
共 15 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[2]   Reproducibility in Science Improving the Standard for Basic and Preclinical Research [J].
Begley, C. Glenn ;
Ioannidis, John P. A. .
CIRCULATION RESEARCH, 2015, 116 (01) :116-126
[3]   Evaluating replicability of laboratory experiments in economics [J].
Camerer, Colin F. ;
Dreber, Anna ;
Forsell, Eskil ;
Ho, Teck-Hua ;
Huber, Juergen ;
Johannesson, Magnus ;
Kirchler, Michael ;
Almenberg, Johan ;
Altmejd, Adam ;
Chan, Taizan ;
Heikensten, Emma ;
Holzmeister, Felix ;
Imai, Taisuke ;
Isaksson, Siri ;
Nave, Gideon ;
Pfeiffer, Thomas ;
Razen, Michael ;
Wu, Hang .
SCIENCE, 2016, 351 (6280) :1433-1436
[4]   Evolution of Reporting P Values in the Biomedical Literature, 1990-2015 [J].
Chavalarias, David ;
Wallach, Joshua David ;
Li, Alvin Ho Ting ;
Ioannidis, John P. A. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2016, 315 (11) :1141-1148
[5]   Using prediction markets to estimate the reproducibility of scientific research [J].
Dreber, Anna ;
Pfeiffer, Thomas ;
Almenberg, Johan ;
Isaksson, Siri ;
Wilson, Brad ;
Chen, Yiling ;
Nosek, Brian A. ;
Johannesson, Magnus .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2015, 112 (50) :15343-15347
[6]   Meta-assessment of bias in science [J].
Fanelli, Daniele ;
Costas, Rodrigo ;
Ioannidis, John P. A. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2017, 114 (14) :3714-3719
[7]  
Fisher R. A., 1946, Statistical methods for research workers.
[8]   Beyond Power Calculations: Assessing Type S (Sign) and Type M (Magnitude) Errors [J].
Gelman, Andrew ;
Carlin, John .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2014, 9 (06) :641-651
[9]   Effect sizes and p values: What should be reported and what should be replicated? [J].
Greenwald, AG ;
Gonzalez, R ;
Harris, RJ ;
Guthrie, D .
PSYCHOPHYSIOLOGY, 1996, 33 (02) :175-183
[10]   On the Reproducibility of Psychological Science [J].
Johnson, Valen E. ;
Payne, Richard D. ;
Wang, Tianying ;
Asher, Alex ;
Mandal, Soutrik .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (517) :1-10