A review of strategies for validating computer-automated scoring

被引:58
作者
Yang, YW
Buckendahl, CW
Juszkiewicz, PJ
Bhola, DS
机构
[1] Gallup Org Inc, Lincoln, NE 68510 USA
[2] Univ Nebraska, Lincoln, NE 68583 USA
关键词
D O I
10.1207/S15324818AME1504_04
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Computer-automated scoring (CAS) is becoming a popular tool in assessment. Various studies have been conducted to assess the quality of CAS-system-generated scores. There is then a need for a systematic examination of these studies in the context of contemporary validity concepts and current practice. This article starts with a brief introduction to current CAS systems. Next, we review the current practice of validating CAS-system-generated scores. Finally, we present a conceptual framework and general recommendations for designing validation studies for CAS procedures.
引用
收藏
页码:391 / 412
页数:22
相关论文
共 46 条
[1]  
American Educational Research Association. American Psychological Association & N. C. on M. in E., 1999, STAND ED PSYCH TEST
[2]   EVOLVING CONCEPTS OF TEST VALIDATION .7. [J].
ANASTASI, A .
ANNUAL REVIEW OF PSYCHOLOGY, 1986, 37 :1-15
[3]  
[Anonymous], MACHINE MEDIATED LEA
[4]  
[Anonymous], CLASSROOM ASSESSMENT
[5]  
[Anonymous], P ANN M ASS COMP LIN
[6]  
*ASS TEST PUBL, 2002, GUID COMP BAS TEST
[7]  
BEJAR II, 1991, J APPL PSYCHOL, V76, P522
[8]   The accuracy of expert-system diagnoses of mathematical problem solutions [J].
Bennett, RE ;
Sebrechts, MM .
APPLIED MEASUREMENT IN EDUCATION, 1996, 9 (02) :133-150
[9]  
BENNETT RE, 1998, ED MEASUREMENT ISSUE, P9
[10]   SCORING CONSTRUCTED RESPONSES USING EXPERT SYSTEMS [J].
BRAUN, HI ;
BENNETT, RE ;
FRYE, D ;
SOLOWAY, E .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1990, 27 (02) :93-108