Empirical bayes versus standard Mantel-Haenszel statistics for detecting differential item functioning under small sample conditions

被引:9
作者
Fidalgo, Angel M. [1 ]
Hashimoto, Kanako [1 ]
Bartram, Dave [1 ]
Muniz, Jose [1 ]
机构
[1] Univ Oviedo, Fac Psicol, E-33003 Oviedo, Spain
关键词
differential item functioning (DIF); empirical Bayes (EB) methods; loss functions; Mantel-Haenszel; small samples;
D O I
10.3200/JEXE.75.4.293-316
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
In this study, the authors assess several strategies created on the basis of the Mantel-Haenszel (MH) procedure for conducting differential item functioning (DIF) analysis with small samples. One of the analytical strategies is a loss function (LF) that uses empirical Bayes Mantel-Haenszel estimators, whereas the other strategies use the classical MH statistics (the MH chi-square statistic using high levels of significance [0.20] or empirical criteria on the basis of the magnitude of the MH-delta estimator). The authors conducted a series of computer simulations in which they manipulated different types of tests, sample sizes, and ability distributions. The results show that the loss function does not offer advantages, in terms of power and Type I error rate, over other analytical strategies that use the classical MH statistics.
引用
收藏
页码:293 / 314
页数:22
相关论文
共 34 条
[1]  
Agresti A., 1990, Analysis of categorical data
[2]   Differential item functioning in a Spanish translation of the Beck Depression Inventory [J].
Azocar, F ;
Areán, P ;
Miranda, J ;
Muñoz, RF .
JOURNAL OF CLINICAL PSYCHOLOGY, 2001, 57 (03) :355-365
[3]  
CAMILLI G, 1990, J EDUC STAT, V15, P53, DOI 10.2307/1164821
[4]   Assessment of the measurement equivalence of a Spanish translation of the 16PF questionnaire [J].
Ellis, BB ;
Mead, AD .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2000, 60 (05) :787-807
[6]  
Fidalgo A. M., 2005, ENCY STAT BEHAV SCI, V3, P1120, DOI DOI 10.1002/0470013192.BSA364
[7]   Utility of the Mantel-Haenszel procedure for detecting differential item functioning in small samples [J].
Fidalgo, AM ;
Ferreres, D ;
Muñiz, J .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2004, 64 (06) :925-936
[9]  
Gelman A, 2013, BAYESIAN DATA ANAL, DOI DOI 10.1201/9780429258411
[10]   Two-stage equating in differential item functioning detection under the graded response model with the Raju area measures and the Lord statistic [J].
Hidalgo-Montesinos, MD ;
Lopez-Pina, JA .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2002, 62 (01) :32-44