The insignificance of statistical significance testing

被引:777
作者
Johnson, DH [1 ]
机构
[1] US Geol Survey, Biol Resources Div, No Prairie Wildlife Res Ctr, Jamestown, ND 58401 USA
关键词
Bayesian approaches; confidence interval; null hypothesis; P-value; power analysis; scientific hypothesis test; statistical hypothesis test;
D O I
10.2307/3802789
中图分类号
Q14 [生态学(生物生态学)];
学科分类号
071012 ; 0713 ;
摘要
Despite their wide use in scientific journals such as The Journal of Wildlife Management, statistical hypothesis tests add very little value to the products of research. Indeed, they frequently confuse the interpretation of data. This paper describes how statistical hypothesis tests are often viewed, and then contrasts that interpretation with the correct one. I discuss the arbitrariness of P-values, conclusions that the null hypothesis is true, Dower analysis, and distinctions between statistical and biological significance. Statistical hypothesis testing, in which the null hypothesis about the properties of a population is almost always known a priori to be false, is contrasted with scientific hypothesis testing, which examines a credible null hypothesis about phenomena in nature. More meaningful alternatives are brief-ly outlined, including estimation and confidence intervals for determining the importance of factors, decision theory for guiding actions in the face of uncertainty, and Bayesian approaches to hypothesis testing and other statistical practices.
引用
收藏
页码:763 / 772
页数:10
相关论文
共 65 条
[51]  
Schmitt S. A., 1969, MEASURING UNCERTAINT
[52]   WHAT STATISTICAL SIGNIFICANCE TESTING IS, AND WHAT IT IS NOT [J].
SHAVER, JP .
JOURNAL OF EXPERIMENTAL EDUCATION, 1993, 61 (04) :293-316
[53]  
SIMBERLOFF D, 1990, HERPETOLOGICA, V46, P351
[54]   Statistical power analysis in wildlife research [J].
Steidl, RJ ;
Hayes, JP ;
Schauber, E .
JOURNAL OF WILDLIFE MANAGEMENT, 1997, 61 (02) :270-279
[55]  
Steiger J. H., 1997, MULTIVAR APPL SER, P221, DOI https://doi.org/10.4324/9781315827353
[56]  
Thomas L., 1997, B ECOL SOC AM, V78, P126
[57]   DETECTING COMMUNITY-WIDE PATTERNS - ESTIMATING POWER STRENGTHENS STATISTICAL-INFERENCE [J].
TOFT, CA ;
SHEA, PJ .
AMERICAN NATURALIST, 1983, 122 (05) :618-625
[58]   ANALYZING DATA - SANCTIFICATION OR DETECTIVE WORK [J].
TUKEY, JW .
AMERICAN PSYCHOLOGIST, 1969, 24 (02) :83-&
[59]  
Underwood A., 1997, EXPT ECOLOGY THEIR L
[60]   Valuation of experimental management options for ecological systems [J].
Walters, CJ ;
Green, R .
JOURNAL OF WILDLIFE MANAGEMENT, 1997, 61 (04) :987-1006