EXPERIMENTS, QUASI-EXPERIMENTS, AND CASE-STUDIES - A REVIEW OF EMPIRICAL-METHODS FOR EVALUATING DECISION SUPPORT SYSTEMS

被引:50
作者
ADELMAN, L
机构
[1] GEORGE MASON UNIV,CTR EXCELLENCE COMMAND CONTROL COMMUN & INTELLIGENCE,FAIRFAX,VA 22030
[2] DECIS SCI CONSORTIUM INC,RESTON,VA
来源
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS | 1991年 / 21卷 / 02期
关键词
D O I
10.1109/21.87078
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Developers of decision support system (DSS) often fail to present empirical data supporting the claimed merits of their systems. Discussions with developers indicate that they often do not consider or know how to perform the required empirical evaluations. That problem is addressed by reviewing the issues inherent in using experiments, quasi-experiments, and case studies to evaluate DSSs. The paper is meant to be a tutuorial for graduate students and engineering professionals developing DSSs. The discussion revolves around the issues of reliability and four types of validity: internal, construct, statistical conclusion, and external. The DSSs are focused upon, including expert systems, but the discussion is appropriate for most interactive systems.
引用
收藏
页码:293 / 301
页数:9
相关论文
共 40 条
[21]  
KRAEMER HC, 1987, MANY SUBJECTS STATIS
[22]   A SCIENTIFIC METHODOLOGY FOR MIS CASE STUDIES [J].
LEE, AS .
MIS QUARTERLY, 1989, 13 (01) :33-50
[23]  
LEHNER PE, 1989, NOTE APPLICATION CLA
[24]  
MADAUS GF, 1983, EVALUATION MODELS VI
[25]  
Marcot B., 1987, AI EXPERT, V2, P42
[26]   STATISTICAL POWER IN CONTEMPORARY MANAGEMENT RESEARCH [J].
MAZEN, AM ;
GRAF, LA ;
KELLOGG, CE ;
HEMMASI, M .
ACADEMY OF MANAGEMENT JOURNAL, 1987, 30 (02) :369-380
[27]  
MCCAIN L, 1979, QUASI EXPT DESIGN AN
[28]   VALIDATING EXPERT SYSTEM PERFORMANCE [J].
OKEEFE, RM ;
BALCI, O ;
SMITH, EP .
IEEE EXPERT-INTELLIGENT SYSTEMS & THEIR APPLICATIONS, 1987, 2 (04) :81-90
[29]  
Patton M. Q., 1982, PRACTICAL EVALUATION
[30]  
REICHARDT CS, 1979, QUASI EXPT DESIGN AN