Empirical evaluation of user models and user-adapted systems

被引:135
作者
Chin, DN [1 ]
机构
[1] Univ Hawaii, Dept Informat & Comp Sci, Honolulu, HI 96822 USA
关键词
empirical evaluation; experimental design; covariant variables; effect size; treatment magnitude; power; sensitivity;
D O I
10.1023/A:1011127315884
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Empirical evaluations are needed to determine which users are helped or hindered by user-adapted interaction in user modeling systems. A review of past UMUAI articles reveals insufficient empirical evaluations, but an encouraging upward trend. Rules of thumb for experimental design, useful tests for covariates, and common threats to experimental validity are presented. Reporting standards including effect size and power are proposed.
引用
收藏
页码:181 / 194
页数:14
相关论文
共 57 条
[51]   Human plausible reasoning for intelligent help [J].
Virvou, M ;
Du Boulay, B .
USER MODELING AND USER-ADAPTED INTERACTION, 1999, 9 (04) :321-375
[52]   Machine learning for user modeling [J].
Webb, GI ;
Pazzani, MJ ;
Billsus, D .
USER MODELING AND USER-ADAPTED INTERACTION, 2001, 11 (1-2) :19-29
[53]  
Webb GI, 1995, USER MODEL USER-ADAP, V5, P117, DOI 10.1007/BF01099758
[54]  
Weber RP, 1990, BASIC CONTENT ANAL, DOI 10.4135/9781412983488
[55]  
Yin R. K, 1994, Case Study Research: Design and Methods, V2nd, DOI DOI 10.1017/CBO9781107415324.004
[56]   Predictive statistical models for user modeling [J].
Zukerman, I ;
Albrecht, DW .
USER MODELING AND USER-ADAPTED INTERACTION, 2001, 11 (1-2) :5-18
[57]   Natural language processing and user modeling: Synergies and limitations [J].
Zukerman, I ;
Litman, D .
USER MODELING AND USER-ADAPTED INTERACTION, 2001, 11 (1-2) :129-158