Developing a generalizable detector of when students game the system

被引:86
作者
Baker, Ryan S. J. d. [1 ,2 ]
Corbett, Albert T. [1 ,3 ]
Roll, Ido [1 ]
Koedinger, Kenneth R. [1 ]
机构
[1] Carnegie Mellon Univ, Human Comp Interact Inst, Pittsburgh, PA 15213 USA
[2] Carnegie Mellon Univ, Pittsburgh Sci Learning Ctr, Pittsburgh, PA 15213 USA
[3] Carnegie Mellon Univ, Sch Comp Sci, Pittsburgh, PA 15213 USA
关键词
gaming the system; latent response models; cognitive tutors; behavior detection; machine learning; generalizable models; student modeling; interactive learning environments;
D O I
10.1007/s11257-007-9045-6
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Some students, when working in interactive learning environments, attempt to "game the system", attempting to succeed in the environment by exploiting properties of the system rather than by learning the material and trying to use that knowledge to answer correctly. In this paper, we present a system that can accurately detect whether a student is gaming the system, within a Cognitive Tutor mathematics curricula. Our detector also distinguishes between two distinct types of gaming which are associated with different learning outcomes. We explore this detector's generalizability, and find that it transfers successfully to both new students and new tutor lessons.
引用
收藏
页码:287 / 314
页数:28
相关论文
共 40 条
[21]   Research on collaborative negotiation for e-commerce. [J].
Feng, YQ ;
Lei, Y ;
Li, Y ;
Cao, RZ .
2003 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-5, PROCEEDINGS, 2003, :2085-2088
[22]  
Greer J., 2007, P 13 INT C ART INT E, P238
[23]   THE MEANING AND USE OF THE AREA UNDER A RECEIVER OPERATING CHARACTERISTIC (ROC) CURVE [J].
HANLEY, JA ;
MCNEIL, BJ .
RADIOLOGY, 1982, 143 (01) :29-36
[24]   A nurse-driven system for improving patient quality outcomes [J].
Johnson, K ;
Hallsey, D ;
Meredith, RL ;
Warden, E .
JOURNAL OF NURSING CARE QUALITY, 2006, 21 (02) :168-175
[25]  
Liu HG, 2002, EIGHTEENTH NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE (AAAI-02)/FOURTEENTH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE (IAAI-02), PROCEEDINGS, P957
[26]  
MAGNUSSEN R, 2004, P OTH PLAYERS COP DE
[27]   PSYCHOMETRIC LATENT RESPONSE MODELS [J].
MARIS, E .
PSYCHOMETRIKA, 1995, 60 (04) :523-547
[28]  
MOSTOW J, 2002, P 6 INT C INT TUT SY, P320
[29]  
MURRAY RC, 2005, P 12 INT C ART INT E, P887
[30]  
Ramsey F, 1997, STAT SLEUTH COURSE M