The abuse of power: The pervasive fallacy of power calculations for data analysis

被引:1384
作者
Hoenig, JM [1 ]
Heisey, DM
机构
[1] Virginia Inst Marine Sci, Coll William & Mary, Gloucester Point, VA 23062 USA
[2] Univ Wisconsin, Dept Surg, Madison, WI 53792 USA
[3] Univ Wisconsin, Dept Biostat & Med Informat, Madison, WI 53792 USA
关键词
bioequivalence testing; burden of proof; observed power; retrospective power analysis; statistical power; type II error;
D O I
10.1198/000313001300339897
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
It is well known that statistical power calculations can be valuable in planning an experiment. There is also a large literature advocating that power calculations be made whenever one performs a statistical test of a hypothesis and one obtains a statistically nonsignificant result. Advocates of such post-experiment power calculations claim the calculations should be used to aid in the interpretation of the experimental results. This approach, which appears in various forms, is fundamentally flawed. We document that the problem is extensive and present arguments to demonstrate the flaw in the logic.
引用
收藏
页码:19 / 24
页数:6
相关论文
共 41 条
[11]   Toward evidence-based medical statistics.: 1:: The P value fallacy [J].
Goodman, SN .
ANNALS OF INTERNAL MEDICINE, 1999, 130 (12) :995-1004
[12]   Statistical power: Concepts, procedures, and applications [J].
Hallahan, M ;
Rosenthal, R .
BEHAVIOUR RESEARCH AND THERAPY, 1996, 34 (5-6) :489-499
[13]  
Hauck WW, 1996, STAT SCI, V11, P303
[14]   Statistical power analysis and amphibian population trends [J].
Hayes, JP ;
Steidl, RJ .
CONSERVATION BIOLOGY, 1997, 11 (01) :273-275
[15]   POWER ANALYSIS IN BIOLOGICAL ANTHROPOLOGY [J].
HODGES, DC ;
SCHELL, LM .
AMERICAN JOURNAL OF PHYSICAL ANTHROPOLOGY, 1988, 77 (02) :175-181
[16]   The behavior of the P-value when the alternative hypothesis is true [J].
Hung, HMJ ;
ONeill, RT ;
Bauer, P ;
Kohne, K .
BIOMETRICS, 1997, 53 (01) :11-22
[17]   THE POWER OF A STATISTICAL TEST - WHAT DOES INSIGNIFICANCE MEAN [J].
MARKEL, MD .
VETERINARY SURGERY, 1991, 20 (03) :209-214
[18]  
McAweeney MJ, 1997, REHABIL PSYCHOL, V42, P125
[19]   INCREASING SCIENTIFIC POWER WITH STATISTICAL POWER [J].
MULLER, KE ;
BENIGNUS, VA .
NEUROTOXICOLOGY AND TERATOLOGY, 1992, 14 (03) :211-219
[20]   THE IMPORTANCE OF REPORTING STATISTICAL POWER - THE FOREST DECLINE AND ACIDIC DEPOSITION EXAMPLE [J].
PETERMAN, RM .
ECOLOGY, 1990, 71 (05) :2024-2027