Using borderline methods to compare passing standards for OSCEs at graduation across three medical schools

被引:45
作者
Boursicot, Katharine A. M. [1 ]
Roberts, Trudie E.
Pell, Godfrey
机构
[1] Univ London St Bartholomews Hosp Med Coll, Queen Marys Sch Med & Dent, Ctr Med Educ, London EC1A 7BE, England
[2] Univ Leeds, Sch Med, Med Educ Unit, Leeds LS2 9JT, W Yorkshire, England
关键词
multicentre study [publication type; clinical competence; standards; education; medical; undergraduate; schools; Great Britain; ANovA;
D O I
10.1111/j.1365-2923.2007.02857.x
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
CONTEXT Medical schools in the UK set their own graduating examinations and pass marks. In a previous study we examined the equivalence of passing standards using the Angoff standard-setting method. To address the limitation this imposed on that work, we undertook further research using a standard-setting method specifically designed for objective structured clinical examinations (OSCEs). METHODS Six OSCE stations were incorporated into the graduating examinations of 3 of the medical schools that took part in the previous study. The borderline group method (BGM) or borderline regression method (BRM) was used to derive the pass marks for all stations in the OSCE. We compared passing standards at the 3 schools. We also compared the results within the schools with their previously generated Angoff pass marks. RESULTS The pass marks derived using the BGM or BRM were consistent across 2 of the 3 schools, whereas the third school generated pass marks which were (with a single exception) much lower. Within-school comparisons of pass marks revealed that in 2 schools the pass marks generally did not significantly differ using either method, but for 1 school the Angoff mark was consistently and significantly lower than the BRM. DISCUSSION The pass marks set using the BGM or BRM were more consistent across 2 of the 3 medical schools than pass marks set using the Angoff method. However, 1 medical school set significantly different pass marks from the other 2 schools. Although this study is small, we conclude that passing standards at different medical schools cannot be guaranteed to be equivalent.
引用
收藏
页码:1024 / 1031
页数:8
相关论文
共 18 条
[1]  
Angoff W.H., 1971, ED MEASUREMENT, V2nd, P508
[2]  
[Anonymous], 1993, 100 Statistical Tests
[3]  
Boursicot K., 2006, Higher Education Quarterly, V60, P74, DOI DOI 10.1111/J.1468-2273.2006.00308.X
[4]   Standard setting for clinical competence at graduation from medical school: A comparison of passing scores across five medical schools [J].
Boursicot, KAM ;
Roberts, TE ;
Pell, G .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2006, 11 (02) :173-183
[5]   VALIDITY AND GENERALIZABILITY OF GLOBAL RATINGS IN AN OBJECTIVE STRUCTURED CLINICAL EXAMINATION [J].
COHEN, R ;
ROTHMAN, AI ;
POLDRE, P ;
ROSS, J .
ACADEMIC MEDICINE, 1991, 66 (09) :545-548
[6]   Using the Judgments of Physician Examiners in Setting the Standards for a National Multi-center High Stakes OSCE [J].
Dauphinee, W. Dale ;
Blackmore, David E. ;
Smee, Sydney ;
Rothman, Arthur I. ;
Reznick, Richard .
ADVANCES IN HEALTH SCIENCES EDUCATION, 1997, 2 (03) :201-211
[7]  
*GEN MED COUNC, 2006, GMC UND MED ED
[8]  
*GEN MED COUNC, 2006, GMC QUAL ASS ARR UND
[9]  
*GEN MED COUNC, 2002, TOM DOCT REC UND MED
[10]  
HARDEN RM, 1979, MED EDUC, V13, P41