Procedures for establishing defensible absolute passing scores on performance examinations in health professions education

被引:179
作者
Downing, SM [1 ]
Tekian, A [1 ]
Yudkowsky, R [1 ]
机构
[1] Univ Illinois, Coll Med, Dept Med Educ, Chicago, IL 60612 USA
关键词
D O I
10.1207/s15328015tlm1801_11
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Background: Establishing credible, defensible, and acceptable passing scores for performance-type examinations in real-world settings is a challenge for health professions educators. Our purpose in this article is to provide step-by-step instructions with worked examples for 5 absolute standard-setting methods that can be used to establish acceptable passing scores for performance examinations such as Objective Structured Clinical Examinations or standardized patient encounters. Summary: All standards reflect the subjective opinions of experts. In this "how-to" article, we demonstrate procedures for systematically capturing these expert opinions using 5 research-based methods (Angoff, Ebel, Hofstee, Borderline Group, and Contrasting Groups). We discuss issues relating to selection of judges, use of performance data, and decision-making processes. Conclusions: Different standard-setting methods produce different passing scores; there is no "gold standard." The key to defensible standards lies in the choice of credible judges and in the use of a systematic approach to collecting their judgments. Ultimately, all standards are policy decisions.
引用
收藏
页码:50 / 57
页数:8
相关论文
共 17 条
[1]  
Angoff W.H., 1971, ED MEASUREMENT, V2nd, P508
[2]   A Modified Contrasting Groups Method Used for Setting the Passmark in a Small Scale Standardised Patient Examination [J].
Burrows, Peter J. ;
Bingham, Liz ;
Brailovsky, Carlos A. .
ADVANCES IN HEALTH SCIENCES EDUCATION, 1999, 4 (02) :145-154
[3]  
Cizek G. J., 2004, Educational Measurement: Issues and Practice, V23, P31
[4]  
Cizek GJ., 2001, Setting performance standards. Concepts, methods
[5]   A CONTRASTING-GROUPS APPROACH TO STANDARD-SETTING FOR PERFORMANCE ASSESSMENTS OF CLINICAL SKILLS [J].
CLAUSER, BE ;
CLYMAN, SG .
ACADEMIC MEDICINE, 1994, 69 (10) :S42-S44
[6]  
DEGRUIJTER DNM, 1985, J EDUC MEAS, V22, P263
[7]   Establishing passing standards for classroom achievement tests in medical education: A comparative study of four methods [J].
Downing, SM ;
Lieska, NG ;
Raible, MD .
ACADEMIC MEDICINE, 2003, 78 (10) :S85-S87
[8]  
Ebel R.L., 1972, ESSENTIALS ED MEASUR, V1st
[9]  
FRIEDMAN M, 2000, MED TEACH, V22, P120
[10]  
Hofstee WKB, 1983, ED TESTING, P107