Toward a document evaluation methodology: What does research tell us about validity and reliability of evaluation methods?

被引:35
作者
De Jong, M [1 ]
Schellens, PJ [1 ]
机构
[1] Univ Twente, NL-7500 AE Enschede, Netherlands
关键词
congruent validity; expert judgments; formative evaluation; Human-Computer Interaction (HCI); methodology; predictive validity; reliability; revision; usability testing; validity;
D O I
10.1109/47.867941
中图分类号
G2 [信息与知识传播];
学科分类号
05 ; 0503 ;
摘要
Although the usefulness of evaluating documents has become generally accepted among communication professionals, the supporting research that puts evaluation practices empirically to the test is only beginning to emerge. This article presents an overview of the available research on troubleshooting evaluation methods. Four lines of research are distinguished concerning the validity of evaluation methods, sample composition, sample size, and the implementation of evaluation results during revision.
引用
收藏
页码:242 / 260
页数:19
相关论文
共 76 条
[41]  
LENTZ L, 1992, STUDIES FUNCTIONAL T, P101
[42]  
LENTZ L, 1996, TAALBEHEERSING, V18, P351
[43]  
LEWIS JR, 1994, HUM FACTORS, V36, P369
[44]  
MAAT HP, 1996, RES TECHNICAL DOCUME, P17
[45]   A COMPARISON OF STUDENT FEEDBACK OBTAINED FROM 3 METHODS OF FORMATIVE EVALUATION OF INSTRUCTIONAL-MATERIALS [J].
MEDLEYMARK, V ;
WESTON, CB .
INSTRUCTIONAL SCIENCE, 1988, 17 (01) :3-27
[46]  
MICKLOS D, 1982, ANN M ASS ED J MASS
[47]  
MOLICH R, 1999, COMP EVALUATION USAB
[48]  
NATHENSON M, 1980, USING STUDENT FEEDBA
[49]  
Nielsen, 1994, Usability inspection methods, V17, P25, DOI DOI 10.1089/TMJ.2010.0114
[50]   ESTIMATING THE NUMBER OF SUBJECTS NEEDED FOR A THINKING ALOUD TEST [J].
NIELSEN, J .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 1994, 41 (03) :385-397