A practical solution to the pervasive problems of p values

被引:1845
作者
Wagenmakers, Eric-Jan [1 ]
机构
[1] Univ Amsterdam, Dept Psychol, Methodol Unit, NL-1018 WB Amsterdam, Netherlands
关键词
D O I
10.3758/BF03194105
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
In the field of psychology, the practice of p value null-hypothesis testing is as widespread as ever. Despite this popularity, or perhaps because of it, most psychologists are not aware of the statistical peculiarities of the p value procedure. In particular, p values are based on data that were never observed, and these hypothetical data are themselves influenced by subjective intentions. Moreover, p values do not quantify statistical evidence. This article reviews these p value problems and illustrates each problem with concrete examples. The three problems are familiar to statisticians but may be new to psychologists. A practical solution to these p value problems is to adopt a model selection perspective and use the Bayesian information criterion (BIC) for statistical inference (Raftery, 1995). The BIC provides an approximation to a Bayesian hypothesis test, does not require the specification of priors, and can be easily calculated from SPSS output.
引用
收藏
页码:779 / 804
页数:26
相关论文
共 165 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]  
[Anonymous], 2005, Scientific reasoning: The Bayesian approach
[3]  
[Anonymous], 1987, Statistical Science
[4]  
[Anonymous], 1974, THEORY PROBABILITY C
[5]  
[Anonymous], STEVENS HDB EXPT PSY, DOI DOI 10.1002/0471214426.PAS0409
[6]   FIXED-SAMPLE-SIZE ANALYSIS OF SEQUENTIAL OBSERVATIONS [J].
ANSCOMBE, FJ .
BIOMETRICS, 1954, 10 (01) :89-100
[7]   SEQUENTIAL MEDICAL TRIALS [J].
ANSCOMBE, FJ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1963, 58 (302) :365-&
[8]  
ARMITAGE P, 1957, BIOMETRIKA, V44, P9, DOI 10.2307/2333237
[9]   REPEATED SIGNIFICANCE TESTS ON ACCUMULATING DATA [J].
ARMITAGE, P ;
MCPHERSO.CK ;
ROWE, BC .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-GENERAL, 1969, 132 :235-&
[10]   TEST OF SIGNIFICANCE IN PSYCHOLOGICAL RESEARCH [J].
BAKAN, D .
PSYCHOLOGICAL BULLETIN, 1966, 66 (06) :423-&