Monte Carlo test assembly for item pool analysis and extension

被引:22
作者
Belov, DI
Armstrong, RD
机构
[1] Law Sch Admiss Council, Psychometr Res Grp, Newtown, PA 18940 USA
[2] Rutgers State Univ, Piscataway, NJ 08855 USA
关键词
D O I
10.1177/0146621605275413
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 [法学]; 0303 [社会学]; 0701 [数学]; 070101 [基础数学];
摘要
A new test assembly algorithm based on a Monte Carlo random search is presented in this article. A major advantage of the Monte Carlo test assembly over other approaches (integer programming or enumerative heuristics) is that it performs a uniform sampling from the item pool, which provides every feasible item combination (test) with an equal chance of being built during an assembly. This allows the authors to address the following issues of pool analysis and extension: compare the strengths and weaknesses of different pools, identify the most restrictive constraint(s) for test assembly, and identify properties of the items that should be added to a pool to achieve greater usability of the pool. Computer experiments with operational pools are given.
引用
收藏
页码:239 / 261
页数:23
相关论文
共 24 条
[1]
Aho A. V., 1983, DATA STRUCTURES ALGO
[2]
Constructing rotating item pools for constrained adaptive testing [J].
Ariel, A ;
Veldkamp, BP ;
van der Linden, WJ .
JOURNAL OF EDUCATIONAL MEASUREMENT, 2004, 41 (04) :345-359
[3]
IRT test assembly using network-flow programming [J].
Armstrong, RD ;
Jones, DH .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1998, 22 (03) :237-247
[4]
ARMSTRONG RD, 2003, 0304 LAW SCH ADM COU
[5]
Boekkooi-Timminga E., 1991, ANN M PSYCH SOC PRIN
[6]
FLETCHER RB, 2000, 5 U AUCKL
[7]
Glover F., 1993, Annals of Operations Research, V41, P3
[8]
OPTIMIZATION BY SIMULATED ANNEALING [J].
KIRKPATRICK, S ;
GELATT, CD ;
VECCHI, MP .
SCIENCE, 1983, 220 (4598) :671-680
[9]
Liu J. S., 2001, Monte Carlo strategies in scientific computing
[10]
Lord F. M., 1980, APPL ITEM RESPONSE T