The abuse of power: The pervasive fallacy of power calculations for data analysis

被引:1384
作者
Hoenig, JM [1 ]
Heisey, DM
机构
[1] Virginia Inst Marine Sci, Coll William & Mary, Gloucester Point, VA 23062 USA
[2] Univ Wisconsin, Dept Surg, Madison, WI 53792 USA
[3] Univ Wisconsin, Dept Biostat & Med Informat, Madison, WI 53792 USA
关键词
bioequivalence testing; burden of proof; observed power; retrospective power analysis; statistical power; type II error;
D O I
10.1198/000313001300339897
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
It is well known that statistical power calculations can be valuable in planning an experiment. There is also a large literature advocating that power calculations be made whenever one performs a statistical test of a hypothesis and one obtains a statistically nonsignificant result. Advocates of such post-experiment power calculations claim the calculations should be used to aid in the interpretation of the experimental results. This approach, which appears in various forms, is fundamentally flawed. We document that the problem is extensive and present arguments to demonstrate the flaw in the logic.
引用
收藏
页码:19 / 24
页数:6
相关论文
共 41 条
[1]  
Berger RL, 1996, STAT SCI, V11, P283
[2]   A CASE FOR BAYESIANISM IN CLINICAL-TRIALS [J].
BERRY, DA .
STATISTICS IN MEDICINE, 1993, 12 (15-16) :1377-1393
[3]  
Cohen J., 1998, Statistical Power Analysis for the Behavioral Sciences, V2nd
[4]  
DALY JA, 1983, RES TEACH ENGL, V17, P157
[5]   Ecology - Reversal of the burden of proof in fisheries management [J].
Dayton, PK .
SCIENCE, 1998, 279 (5352) :821-822
[6]  
FAGLEY NS, 1985, J COUNS PSYCHOL, V32, P391
[7]   STATISTICAL POWER AND DESIGN REQUIREMENTS FOR ENVIRONMENTAL MONITORING [J].
FAIRWEATHER, PG .
AUSTRALIAN JOURNAL OF MARINE AND FRESHWATER RESEARCH, 1991, 42 (05) :555-567
[8]   THE ROLE OF P-VALUES IN ANALYZING TRIAL RESULTS [J].
FREEMAN, PR .
STATISTICS IN MEDICINE, 1993, 12 (15-16) :1443-1452
[9]   Limits of retrospective power analysis [J].
Gerard, PD ;
Smith, DR ;
Weerakkody, G .
JOURNAL OF WILDLIFE MANAGEMENT, 1998, 62 (02) :801-807
[10]   THE USE OF PREDICTED CONFIDENCE-INTERVALS WHEN PLANNING EXPERIMENTS AND THE MISUSE OF POWER WHEN INTERPRETING RESULTS [J].
GOODMAN, SN ;
BERLIN, JA .
ANNALS OF INTERNAL MEDICINE, 1994, 121 (03) :200-206