Statistical significance and effect size in education research: Two sides of a coin

被引:128
作者
Fan, XT [1 ]
机构
[1] Univ Virginia, Curry Sch Educ, Charlottesville, VA 22904 USA
关键词
effect-size measures; research practice; statistical significance testing;
D O I
10.1080/00220670109598763
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
In education research, statistical significance and effect size are 2 sides of 1 coin; they complement each other but they do not substitute for each other. Good research practice requires that, to make sound research decisions, both sides should be considered. In a simulation study, the sampling variability of 2 popular effect-size measures (d and R-2) was examined. The variability showed that what is statistically significant may not he practically meaningful, and what appears to be practically meaningful could have been the result of sampling error, thus not trustworthy, Some practical guidelines are suggested for combining the 2 sources of information in research practice.
引用
收藏
页码:275 / 282
页数:8
相关论文
共 22 条
[1]  
American Psychological Association, 2016, ETH PRINC PSYCH COD
[2]   CASE AGAINST STATISTICAL SIGNIFICANCE TESTING [J].
CARVER, RP .
HARVARD EDUCATIONAL REVIEW, 1978, 48 (03) :378-399
[3]  
Cohen J., 1998, Statistical Power Analysis for the Behavioral Sciences, V2nd
[4]   SIGNIFICANCE TESTS DIE HARD - THE AMAZING PERSISTENCE OF A PROBABILISTIC MISCONCEPTION [J].
FALK, R ;
GREENBAUM, CW .
THEORY & PSYCHOLOGY, 1995, 5 (01) :75-98
[5]   POINT ESTIMATES AND CONFIDENCE-INTERVALS IN MEASURES OF ASSOCIATION [J].
FOWLER, RL .
PSYCHOLOGICAL BULLETIN, 1985, 98 (01) :160-165
[6]  
Glass G., 1976, ED RES, V6, P3, DOI [DOI 10.3102/0013189X005010003, 10.2307/1174772ISSN0536-1036]
[7]  
Glass G.V., 1996, Statistical methods in education and psychology, Vthird
[8]  
Hedges L. V., 1985, STAT METHODS METAANA, DOI DOI 10.1016/C2009-0-03396-0
[9]   SAMPLE AND POPULATION SCORE MATRICES AND SAMPLE CORRELATION-MATRICES FROM AN ARBITRARY POPULATION CORRELATION MATRIX [J].
KAISER, HF ;
DICKMAN, K .
PSYCHOMETRIKA, 1962, 27 (02) :179-182
[10]   Practical significance: A concept whose time has come [J].
Kirk, RE .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1996, 56 (05) :746-759