EXPERIMENTS, QUASI-EXPERIMENTS, AND CASE-STUDIES - A REVIEW OF EMPIRICAL-METHODS FOR EVALUATING DECISION SUPPORT SYSTEMS

被引:50
作者
ADELMAN, L
机构
[1] GEORGE MASON UNIV,CTR EXCELLENCE COMMAND CONTROL COMMUN & INTELLIGENCE,FAIRFAX,VA 22030
[2] DECIS SCI CONSORTIUM INC,RESTON,VA
来源
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS | 1991年 / 21卷 / 02期
关键词
D O I
10.1109/21.87078
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Developers of decision support system (DSS) often fail to present empirical data supporting the claimed merits of their systems. Discussions with developers indicate that they often do not consider or know how to perform the required empirical evaluations. That problem is addressed by reviewing the issues inherent in using experiments, quasi-experiments, and case studies to evaluate DSSs. The paper is meant to be a tutuorial for graduate students and engineering professionals developing DSSs. The discussion revolves around the issues of reliability and four types of validity: internal, construct, statistical conclusion, and external. The DSSs are focused upon, including expert systems, but the discussion is appropriate for most interactive systems.
引用
收藏
页码:293 / 301
页数:9
相关论文
共 40 条
[1]  
ADELMAN L, 1989, INFORM DECIS TECHNOL, V15, P227
[2]   AN ITERATIVE BAYESIAN DECISION AID - TOWARD IMPROVING THE USER-AID AND USER-ORGANIZATION INTERFACES [J].
ADELMAN, L ;
DONNELL, ML ;
PHELPS, RH ;
PATTERSON, JF .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1982, 12 (06) :733-743
[3]  
ADELMAN L, 1986, MICROCOMPUTER DECISI
[4]  
ANDRIOLE SJ, 1989, HDB DECISION SUPPORT
[5]  
BAILEY D, 1971, PROBABILITY STATISTI
[6]  
BAROUDI JJ, 1988, MIS Q, P87
[7]   STRATEGIC DECISION-PROCESSES IN HIGH-VELOCITY ENVIRONMENTS - 4 CASES IN THE MICROCOMPUTER INDUSTRY [J].
BOURGEOIS, LJ ;
EISENHARDT, KM .
MANAGEMENT SCIENCE, 1988, 34 (07) :816-835
[8]  
Campbell Donald T., 1984, CASE STUDY RES DESIG
[9]   CONVERGENT AND DISCRIMINANT VALIDATION BY THE MULTITRAIT-MULTIMETHOD MATRIX [J].
CAMPBELL, DT ;
FISKE, DW .
PSYCHOLOGICAL BULLETIN, 1959, 56 (02) :81-105
[10]  
CAMPBELL DT, 1966, EXPT QUASI-EXPT DESI