EVALUATING MEDICAL EXPERT SYSTEMS - WHAT TO TEST AND HOW

被引：132

作者：

WYATT, J

SPIEGELHALTER, D

机构：

[1] The National Heart and Lung Institute, London, SW3 6HP, Fulham Road

[2] MRC Biostatistics Unit, Cambridge, CB2 2BW

来源：

MEDICAL INFORMATICS | 1990年 / 15卷 / 03期

关键词：

Computer-assisted; Diagnosis; Evaluation; Expert systems; Software validation;

D O I：

10.3109/14639239009025268

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Many believe that medical expert systems have great potential to improve health care, but few of these systems have been rigorously evaluated, and even fewer are in routine use. We propose the evaluation of medical expert systems in two stages: laboratory and field testing. In the former, the perspectives of both prospective users and experts responsible for implementation are valuable. In the latter, the study must be designed to test, in an unbiased manner, whether the system is used in clinical practice, and if it is used, how it affects the structure, process and outcome of health care encounters. We conclude with proposals for encouraging the objective evaluation of these systems. © 1990 Informa UK Ltd All rights reserved: reproduction in whole or part not permitted.

引用

页码：205 / 217

页数：13

共 38 条

[1]

Long Range Plan, report 4: Medical Informatics, (1986)

[2]

Shortliffe E.H., Computer programs to support medical decisions, Journalof the American Medical Association, 258, pp. 61-66, (1987)

[3]

Brahams D., Wyatt J., Decision-aids and the law, Lancet, 2, pp. 632-634, (1989)

[4]

Lundsgaarde H.P., Evaluating medical expert system, Social Science and Medicine, 24, pp. 805-819, (1987)

[5]

Shortliffe E.H., Davis R., Some considerations for the implementation of knowledge-based expert systems, SIGART Newsletter, pp. 9-12, (1975)

[6]

Spiegelhalter D.J., Evaluation of clinical decision aids, with an application to a system for dyspepsia, Statistics in Medicine, 2, pp. 207-216, (1983)

[7]

Gaschnig J., Klahr P., Pople H., Shortliffe E., Terry A., Evaluation of expert systems: issues and case studies, Building Expert Systems, pp. 241-280, (1983)

[8]

Wasson J.H., Sox H.C., Neff R.K., Goldman L., Clinical prediction rules: applications and methodological standards, New England Journal of Medicine, 313, pp. 793-799, (1985)

[9]

Miller P.L., The evaluation of artificial intelligence systems in medicine, Computer Methods and Programs in Biomedicine, 22, pp. 5-11, (1986)

[10]

Wyatt J., The evaluation of clinical decision support systems: a discussion of the methodology used in the ACORN project, Lecture Notes in Medical Informatics, 33, pp. 15-24, (1987)

← 1 2 3 4 →