How interchangeable are different estimators of effect size?

被引:106
作者
Ray, JW [1 ]
Shadish, WR [1 ]
机构
[1] UNIV MEMPHIS, DEPT PSYCHOL, MEMPHIS, TN 38152 USA
关键词
D O I
10.1037/0022-006X.64.6.1316
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
The computation of effect sizes is a key feature of meta-analysis. In treatment outcome meta-analyses, the standardized mean difference statistic on posttest scores (d) is usually the effect size statistic used. Hoc-ever, when primary studies do not report the statistics needed to compute d, many methods for estimating d from other data have been developed. Little is known about the accuracy of these estimates, yet meta-analysts frequently use them on the assumption that they are estimating the same population parameter as d. This study investigates that assumption empirically. On a sample of 140 psychosocial treatment or prevention studies from a variety of areas, the present study shows that these estimates yield results that are often not equivalent to din either mean or variance. The frequent mixing of d and other estimates of din past meta-analyses. therefore, mag have led to biased effect size estimates and inaccurate significance tests.
引用
收藏
页码:1316 / 1325
页数:10
相关论文
共 43 条
  • [11] *DEPR GUID PAN, 1993, 930551 AHCPR US DEP
  • [12] Dickersin Kay, 1994, HDB RES SYNTHESIS, P71
  • [13] SEX-DIFFERENCES IN SELF-DISCLOSURE - A METAANALYSIS
    DINDIA, K
    ALLEN, M
    [J]. PSYCHOLOGICAL BULLETIN, 1992, 112 (01) : 106 - 124
  • [14] GENDER AND THE EVALUATION OF LEADERS - A METAANALYSIS
    EAGLY, AH
    MAKHIJANI, MG
    KLONSKY, BG
    [J]. PSYCHOLOGICAL BULLETIN, 1992, 111 (01) : 3 - 22
  • [15] Glass G.V., 1978, Review of Research in Education, V5, P351, DOI [10.2307/1167179, DOI 10.3102/0091732X005001351]
  • [16] Glass G.V., 1981, Meta-analysis in social research
  • [17] Glass G.V., 1976, Educational Researcher, V5, P3, DOI [10.3102/0013189X005010003, DOI 10.3102/0013189X005010003, 10.2307/1174772ISSN0536-1036]
  • [18] Haddock C. Keith, 1994, Annals of Behavioral Medicine, V16, P235
  • [19] Hedges L.V., 1985, STAT METHODS METAANA, P189
  • [20] Assignment methods in experimentation: When do nonrandomized experiments approximate answers from randomized experiments?
    Heinsman, DT
    Shadish, WR
    [J]. PSYCHOLOGICAL METHODS, 1996, 1 (02) : 154 - 169