Performance assessment of community-based physicians: Evaluating the reliability and validity of a tool for determining CME needs

被引:10
作者
Cohen, R
Amiel, GE
Tann, M
Shechter, A
Weingarten, M
Reis, S
机构
[1] Hebrew Univ Jerusalem, Fac Med, Ctr Med Educ, IL-91120 Jerusalem, Israel
[2] Technion Israel Inst Technol, Bruce Rappaport Fac Med, Dept Med Educ, IL-31096 Haifa, Israel
[3] Technion Israel Inst Technol, Bruce Rappaport Fac Med, Bnai Zion Med Ctr, Dept Urol, IL-31096 Haifa, Israel
[4] Technion Israel Inst Technol, Bruce Rappaport Fac Med, Bnai Zion Med Ctr, Dept Radiol, IL-31096 Haifa, Israel
[5] Technion Israel Inst Technol, Bruce Rappaport Fac Med, Dept Family Med, IL-31096 Haifa, Israel
[6] Tel Aviv Univ, Sackler Fac Med, Dept Behav Sci, IL-69978 Tel Aviv, Israel
关键词
D O I
10.1097/00001888-200212000-00022
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Purpose. To evaluate the reliability, validity, and feasibility of the Physician Assessment in Medical Practice (PAMP) as a means of determining the CME needs of practicing, community-based physicians. Method. A group of 45 randomly selected community-based physicians (19 certified family physicians and 26 general practitioners) affiliated with the Department of Family Medicine at Bruce Rappaport Faculty of Medicine, Technion Institute of Technology, Haifa, Israel, volunteered to participate in the study, conducted in 1997. All participants took a ten-station, performance-based examination designed to closely represent the physicians' work settings. At each station, a different medical problem was presented by a standardized patient. Physician-candidates' performances were assessed by physician-examiners using global ratings. The following performance domains were assessed: information gathering, diagnosis and management plan, and communication skills. A CME needs assessment scone was determined for each of the participants and a CME level to meet the needs of the physician was recommended. Results. Overall reliability of the examination was high (.87), with domain reliabilities ranging from .76 to .87. Reliability of the examiners' judgments of the physicians' competence was .66. All the stations' validity scores were significant, and differences in performances between family physicians and general practitioners demonstrated construct validity of the test results. Overall, the cost of running the examination was U.S. $250 per physician-candidate. Conclusions. Using the PAMP to determine CME needs of community-based physicians was found to reliable, valid, and feasible, and the cost per physician-candidate was not excessive. Performance results provided indepth information for use by both the individual physician and providers of CME programs.
引用
收藏
页码:1247 / 1254
页数:8
相关论文
共 37 条
[11]   EVIDENCE FOR THE EFFECTIVENESS OF CME - A REVIEW OF 50 RANDOMIZED CONTROLLED TRIALS [J].
DAVIS, DA ;
THOMSON, MA ;
OXMAN, AD ;
HAYNES, RB .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1992, 268 (09) :1111-1117
[12]  
Davis P, 1997, J RHEUMATOL, V24, P1995
[13]  
Evans P R, 1996, Postgrad Med J, V72 Suppl 1, pS27
[14]   Changing physicians practices: The effect of individual feedback [J].
Fidler, M ;
Lockyer, JM ;
Toews, J ;
Violato, C .
ACADEMIC MEDICINE, 1999, 74 (06) :702-714
[15]  
FREEMANTLE N, 2002, PRINTED ED MAT EFFEC
[16]  
GABB R, 1994, CERTIFICATION RECERT, P47
[17]  
HARDEN RM, 1979, MED EDUC, V13, P41
[18]  
Hewson A D, 1996, Postgrad Med J, V72 Suppl 1, pS43
[19]   OSCE checklists do not capture increasing levels of expertise [J].
Hodges, B ;
Regehr, G ;
McNaughton, N ;
Tiberius, R ;
Hanson, M .
ACADEMIC MEDICINE, 1999, 74 (10) :1129-1134
[20]  
KOTTEK SS, 1978, MED HIST, V22, P438, DOI 10.1017/S0025727300033469