User-centered evaluation of adaptive and adaptable systems: a literature review

被引:93
作者
Van Velsen, Lex [1 ]
Van Der Geest, Thea [1 ]
Klaassen, Rob [1 ]
Steehouder, Michael [1 ]
机构
[1] Univ Twente, Fac Behav Sci, Inst Behav Res, Dept Tech & Profess Commun, NL-7500 AE Enschede, Netherlands
关键词
D O I
10.1017/S0269888908001379
中图分类号
TP18 [人工智能理论];
学科分类号
081104 [模式识别与智能系统]; 0812 [计算机科学与技术]; 0835 [软件工程]; 1405 [智能科学与技术];
摘要
This literature review focuses on user-centered evaluation (UCE) studies of adaptive and adaptable systems. Usability, perceived usefulness and appropriateness of adaptation are the three most commonly assessed variables. Questionnaires appeared to be the most popular method, followed by interviews and data log analysis. The quality of most questionnaires was questionable, and the reporting of interviews and think-aloud protocols was found to be shallow. Furthermore, data logs need triangulation in order to be useful. The reports encountered lack empirical value. The article models the iterative design process for adaptive and adaptable systems, linked to the goals of UCE: supporting decisions, detecting problems and verifying quality. This model summarizes the variables to be assessed at each stage of the process and the relevant methods to assess them.
引用
收藏
页码:261 / 281
页数:21
相关论文
共 73 条
[1]
Akoumianakis D, 2001, HUM FAC ER, P339
[2]
ALPERT SR, 2007, HUMAN COMPUTER INTER, P257
[3]
Can evaluation studies benefit from triangulation? A case study [J].
Ammenwerth, E ;
Iller, C ;
Mansmann, U .
INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2003, 70 (2-3) :237-248
[4]
[Anonymous], 2001, UND SYST REV RES EFF
[5]
Using protocol analysis to evaluate the usability of a commercial web site [J].
Benbunan-Fich, R .
INFORMATION & MANAGEMENT, 2001, 39 (02) :151-163
[6]
ADAPTIVE SYSTEMS - FROM INTELLIGENT TUTORING TO AUTONOMOUS AGENTS [J].
BENYON, D ;
MURRAY, D .
KNOWLEDGE-BASED SYSTEMS, 1993, 6 (04) :197-219
[7]
Bohnenberger T, 2002, LECT NOTES COMPUT SC, V2411, P155
[8]
*BSI, 1998, 924111 ISO BSI
[9]
Mobilizing a health professional's workstation - results of an evaluation study [J].
Buchauer, A ;
Pohl, U ;
Kurzel, N ;
Haux, R .
INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 1999, 54 (02) :105-114
[10]
The evaluation of a personalised health information system for patients with cancer [J].
Cawsey, AJ ;
Jones, RB ;
Pearson, J .
USER MODELING AND USER-ADAPTED INTERACTION, 2000, 10 (01) :47-72