Empirical evaluation of user models and user-adapted systems

被引:135
作者
Chin, DN [1 ]
机构
[1] Univ Hawaii, Dept Informat & Comp Sci, Honolulu, HI 96822 USA
关键词
empirical evaluation; experimental design; covariant variables; effect size; treatment magnitude; power; sensitivity;
D O I
10.1023/A:1011127315884
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Empirical evaluations are needed to determine which users are helped or hindered by user-adapted interaction in user modeling systems. A review of past UMUAI articles reveals insufficient empirical evaluations, but an encouraging upward trend. Rules of thumb for experimental design, useful tests for covariates, and common threats to experimental validity are presented. Reporting standards including effect size and power are proposed.
引用
收藏
页码:181 / 194
页数:14
相关论文
共 57 条
[31]  
Krause J., 1993, User Modeling and User-Adapted Interaction, V3, P249, DOI 10.1007/BF01257891
[32]  
LIPSHITZ SP, 1981, J AUDIO ENG SOC, V29, P482
[33]  
London R. V., 1992, User Modeling and User-Adapted Interaction, V2, P117, DOI 10.1007/BF01101861
[34]  
Marshall C., 2011, Designing Qualitative Research, V5th
[35]   User-centered indexing for adaptive information access [J].
Mathe, N ;
Chen, JR .
USER MODELING AND USER-ADAPTED INTERACTION, 1996, 6 (2-3) :225-261
[36]  
Miles M., 2014, Qualitative Data Analysis: An Expanded Sourcebook, V3rd
[37]   Development of a model of user attributes and its implementation within an adaptive tutoring system [J].
Milne, S ;
Shiu, E ;
Cook, J .
USER MODELING AND USER-ADAPTED INTERACTION, 1996, 6 (04) :303-335
[38]   INSTRUCT: Modeling students by asking questions [J].
Mitrovic, A ;
DjordjevicKajan, S ;
Stoimenov, L .
USER MODELING AND USER-ADAPTED INTERACTION, 1996, 6 (04) :273-302
[39]  
Neter J., 1996, Applied linear statistical models
[40]   User models and filtering agents for improved Internet information retrieval [J].
Newell, SC .
USER MODELING AND USER-ADAPTED INTERACTION, 1997, 7 (04) :223-237