ONLINE CALIBRATION VIA VARIABLE LENGTH COMPUTERIZED ADAPTIVE TESTING

被引:20
作者
Chang, Yuan-chin Ivan [1 ]
Lu, Hung-Yi [2 ]
机构
[1] Acad Sinica, Taipei 115, Taiwan
[2] Fu Jen Catholic Univ, Hsinchuang, Taiwan
关键词
adaptive testing; item response theory; logistic regression; measurement error; nonlinear design; online calibration; stopping rule; GENERALIZED LINEAR-MODELS; SEQUENTIAL CONFIDENCE-REGIONS; MAXIMUM-LIKELIHOOD ESTIMATION; RESPONSE THEORY MODELS; LOGISTIC-REGRESSION; BINARY DATA; OPTIMAL DESIGNS; STRONG CONSISTENCY; ASYMPTOTIC THEORY; SAMPLING DESIGNS;
D O I
10.1007/s11336-009-9133-0
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Item calibration is an essential issue in modern item response theory based psychological or educational testing. Due to the popularity of computerized adaptive testing, methods to efficiently calibrate new items have become more important than that in the time when paper and pencil test administration is the norm. There are many calibration processes being proposed and discussed from both theoretical and practical perspectives. Among them, the online calibration may be one of the most cost effective processes. In this paper, under a variable length computerized adaptive testing scenario, we integrate the methods of adaptive design, sequential estimation, and measurement error models to solve online item calibration problems. The proposed sequential estimate of item parameters is shown to be strongly consistent and asymptotically normally distributed with a prechosen accuracy. Numerical results show that the proposed method is very promising in terms of both estimation accuracy and efficiency. The results of using calibrated items to estimate the latent trait levels are also reported.
引用
收藏
页码:140 / 157
页数:18
相关论文
共 40 条
[1]  
ABDELBASIT KM, 1983, J AM STAT ASSOC, V78, P90
[2]  
[Anonymous], 2000, COMPUTERIZED ADAPTIV, DOI DOI 10.4324/9781410605931
[3]  
[Anonymous], 2012, Applications of item response theory to practical testing problems
[4]  
Baker F., 1992, Item response theory: Parameter estimation techniques
[5]   SEQUENTIAL SAMPLING DESIGNS FOR THE 2-PARAMETER ITEM RESPONSE THEORY MODEL [J].
BERGER, MPF .
PSYCHOMETRIKA, 1992, 57 (04) :521-538
[6]  
BERGER MPF, 1994, J EDUC STAT, V19, P43, DOI 10.2307/1165176
[7]   Minimax D-optimal designs for item response theory models [J].
Berger, MPF ;
King, CYJ ;
Wong, WK .
PSYCHOMETRIKA, 2000, 65 (03) :377-390
[8]  
BOCK R, 1985, BILOG COMPUTER PROGR
[9]   MARGINAL MAXIMUM-LIKELIHOOD ESTIMATION OF ITEM PARAMETERS - APPLICATION OF AN EM ALGORITHM [J].
BOCK, RD ;
AITKIN, M .
PSYCHOMETRIKA, 1981, 46 (04) :443-459
[10]   FIXED SIZE CONFIDENCE-REGIONS FOR PARAMETERS OF A LOGISTIC-REGRESSION MODEL [J].
CHANG, YCI ;
MARTINSEK, AT .
ANNALS OF STATISTICS, 1992, 20 (04) :1953-1969