Statistical significance and effect size in education research: Two sides of a coin

被引:128
作者
Fan, XT [1 ]
机构
[1] Univ Virginia, Curry Sch Educ, Charlottesville, VA 22904 USA
关键词
effect-size measures; research practice; statistical significance testing;
D O I
10.1080/00220670109598763
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
In education research, statistical significance and effect size are 2 sides of 1 coin; they complement each other but they do not substitute for each other. Good research practice requires that, to make sound research decisions, both sides should be considered. In a simulation study, the sampling variability of 2 popular effect-size measures (d and R-2) was examined. The variability showed that what is statistically significant may not he practically meaningful, and what appears to be practically meaningful could have been the result of sampling error, thus not trustworthy, Some practical guidelines are suggested for combining the 2 sources of information in research practice.
引用
收藏
页码:275 / 282
页数:8
相关论文
共 22 条
[11]   STATISTICAL SIGNIFICANCE TESTING FROM 3 PERSPECTIVES [J].
LEVIN, JR .
JOURNAL OF EXPERIMENTAL EDUCATION, 1993, 61 (04) :378-382
[12]  
Maxwell S.E., 2018, DESIGNING EXPT ANAL
[14]   INTERPRETING STATISTICAL SIGNIFICANCE AND NONSIGNIFICANCE [J].
SCHAFER, WD .
JOURNAL OF EXPERIMENTAL EDUCATION, 1993, 61 (04) :383-387
[15]   WHAT STATISTICAL SIGNIFICANCE TESTING IS, AND WHAT IT IS NOT [J].
SHAVER, JP .
JOURNAL OF EXPERIMENTAL EDUCATION, 1993, 61 (04) :293-316
[16]   EVALUATING RESULTS USING CORRECTED AND UNCORRECTED EFFECT SIZE ESTIMATES [J].
SNYDER, P ;
LAWSON, S .
JOURNAL OF EXPERIMENTAL EDUCATION, 1993, 61 (04) :334-349
[17]  
Stevens J., 2002, Applied multivariate statistics for the social sciences
[18]   THE USE OF STATISTICAL SIGNIFICANCE TESTS IN RESEARCH - BOOTSTRAP AND OTHER ALTERNATIVES [J].
THOMPSON, B .
JOURNAL OF EXPERIMENTAL EDUCATION, 1993, 61 (04) :361-377
[19]   2-1/2 DECADES OF LEADERSHIP IN MEASUREMENT AND EVALUATION [J].
THOMPSON, B .
JOURNAL OF COUNSELING AND DEVELOPMENT, 1992, 70 (03) :434-438
[20]  
Thompson B., 1996, EDUC RESEARCHER, V25, P26, DOI DOI 10.3102/0013189X025002026