Using borderline methods to compare passing standards for OSCEs at graduation across three medical schools

被引:45
作者
Boursicot, Katharine A. M. [1 ]
Roberts, Trudie E.
Pell, Godfrey
机构
[1] Univ London St Bartholomews Hosp Med Coll, Queen Marys Sch Med & Dent, Ctr Med Educ, London EC1A 7BE, England
[2] Univ Leeds, Sch Med, Med Educ Unit, Leeds LS2 9JT, W Yorkshire, England
关键词
multicentre study [publication type; clinical competence; standards; education; medical; undergraduate; schools; Great Britain; ANovA;
D O I
10.1111/j.1365-2923.2007.02857.x
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
CONTEXT Medical schools in the UK set their own graduating examinations and pass marks. In a previous study we examined the equivalence of passing standards using the Angoff standard-setting method. To address the limitation this imposed on that work, we undertook further research using a standard-setting method specifically designed for objective structured clinical examinations (OSCEs). METHODS Six OSCE stations were incorporated into the graduating examinations of 3 of the medical schools that took part in the previous study. The borderline group method (BGM) or borderline regression method (BRM) was used to derive the pass marks for all stations in the OSCE. We compared passing standards at the 3 schools. We also compared the results within the schools with their previously generated Angoff pass marks. RESULTS The pass marks derived using the BGM or BRM were consistent across 2 of the 3 schools, whereas the third school generated pass marks which were (with a single exception) much lower. Within-school comparisons of pass marks revealed that in 2 schools the pass marks generally did not significantly differ using either method, but for 1 school the Angoff mark was consistently and significantly lower than the BRM. DISCUSSION The pass marks set using the BGM or BRM were more consistent across 2 of the 3 medical schools than pass marks set using the Angoff method. However, 1 medical school set significantly different pass marks from the other 2 schools. Although this study is small, we conclude that passing standards at different medical schools cannot be guaranteed to be equivalent.
引用
收藏
页码:1024 / 1031
页数:8
相关论文
共 18 条
[11]   Comparison of a rational and an empirical standard setting procedure for an OSCE [J].
Kramer, A ;
Muijtjens, A ;
Jansen, K ;
Düsman, H ;
Tan, L ;
van der Vleuten, C .
MEDICAL EDUCATION, 2003, 37 (02) :132-139
[12]   Techniques for measuring clinical competence: objective structured clinical examinations [J].
Newble, D .
MEDICAL EDUCATION, 2004, 38 (02) :199-203
[13]   Setting standards on educational tests [J].
Norcini, JJ .
MEDICAL EDUCATION, 2003, 37 (05) :464-469
[14]  
*QUAL ASS AG HIGH, 2000, COD PRACT ASS AC QUA
[15]  
Reznick RK, 1996, ACAD MED S, V71, P19
[16]   The consistency and uncertainty in examiners' definitions of pass fail performance on OSCE stations [J].
Rothman, AI ;
Blackmore, D ;
Cohen, R ;
Reznick, R .
EVALUATION & THE HEALTH PROFESSIONS, 1996, 19 (01) :118-124
[17]   Setting standards for an objective structured clinical examination: the borderline group method gains ground on Angoff [J].
Smee, SM ;
Blackmore, DE .
MEDICAL EDUCATION, 2001, 35 (11) :1009-1010
[18]   Standard setting in a small scale OSCE: A comparison of the modified borderline-group method and the borderline regression method [J].
Wood, Timothy J. ;
Humphrey-Murto, Susan M. ;
Norman, Goeffrey R. .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2006, 11 (02) :115-122