Comparison of self, nurse, and physician assessment of residents rotating through an intensive care unit

被引:45
作者
Johnson, D [1 ]
Cujec, B [1 ]
机构
[1] Royal Univ Hosp, Dept Crit Care, Saskatoon, SK S7N 0W8, Canada
关键词
resident; evaluations; critical care; behaviorally anchored rating scale; global rating scale; medical education;
D O I
10.1097/00003246-199811000-00020
中图分类号
R4 [临床医学];
学科分类号
1002 ; 100602 ;
摘要
Objective: Compare resident evaluations by self, nurses, and attending physicians. Design: Prospective cohort. Setting: University intensive care unit. Subjects: Sixty residents. Interventions: End-rotational evaluation using a standardized, multiple choice examination and one of two subjective instruments, Global Rating Scale and Behaviorally Anchored Rating Scale. Measurements and Main Results: Means for overall competence, using both the Behaviorally Anchored Rating Scale and the Global Rating Scale clustered between 3 to 4 on a 5-point scale. Physicians' evaluations correlated with the multiple-choice test scores (Spearman's rho 0.3082, p = .005, n = 82), whereas neither self-evaluation (Spearman's rho 0.1124, p = .65, n = 42) nor nurses' evaluations (Spearman's rho 0.2060, p = .069, n = 79) had a significant correlation with test scores. Spearman's correlations were not significant for either overall competence or specific medical knowledge by any category of evaluator using the Global Rating Scale. Spearman's rho correlations and kappa statistic between the three types of evaluators (physicians, nurses, and self) for each criterion of the Behaviorally Anchored Rating Scale demonstrated significant correlations between the ratings of physicians and nurses, except for the assessment of humanistic qualities. Pooled clinical skills-history taking (b = 0.277, p < .009), humanistic qualities (b = 0.607, p < .000), and professional attitudes and behavior (b = 0.488, p < .000) systematically differed in ratings comparing self with nurse and physician (by analysis of variance). The explanatory power of the model of ratings (independent variables of year of residency, category of evaluator, evaluation criteria, and interaction terms) was 47.3% (r(adj)(2)). Conclusions: Self-rating by residents did not correlate to multiple-choice test scores and differed in some criteria with physicians' or nurses' evaluations. We found many similarities and some differences between physicians' and nurses' evaluations of residents. We speculate that different categories of evaluators assess different aspects of performance. Assessment by a varied group of evaluators should be used when attempts to predict future practice are made.
引用
收藏
页码:1811 / 1816
页数:6
相关论文
共 15 条
[1]  
*AM BOARD INT MED, 1995, EV CLIN COMP RES DOC
[2]   TECHNOLOGY-ASSESSMENT OF ANESTHESIA MONITORS - PROBLEMS AND FUTURE-DIRECTIONS [J].
BYRICK, RJ ;
COHEN, MM .
CANADIAN JOURNAL OF ANAESTHESIA-JOURNAL CANADIEN D ANESTHESIE, 1995, 42 (03) :234-239
[3]  
CRANTON PA, 1984, P ANN C RES MED ED, V23, P59
[4]  
CUJEC B, 1997, ANN ROY COLL PHYSIC, V30, P81
[5]  
DELLINGER RP, 1993, SELF ASSESSMENT MUTL, V2
[6]   SOURCES OF ASSESSMENT OF PHYSICIAN PERFORMANCE - A STUDY OF COMPARATIVE RELIABILITY AND PATTERNS OF INTERCORRELATION [J].
DIMATTEO, MR ;
DINICOLA, DD .
MEDICAL CARE, 1981, 19 (08) :829-842
[7]   A COMPREHENSIVE ANESTHESIA SIMULATION ENVIRONMENT - RECREATING THE OPERATING-ROOM FOR RESEARCH AND TRAINING [J].
GABA, DM ;
DEANDA, A .
ANESTHESIOLOGY, 1988, 69 (03) :387-394
[8]   Anesthesia crisis resource management: Real-life simulation training in operating room crises [J].
Holzman, RS ;
Cooper, JB ;
Gaba, DM ;
Philip, JH ;
Small, SD ;
Feinstein, D .
JOURNAL OF CLINICAL ANESTHESIA, 1995, 7 (08) :675-687
[9]  
HOWARD SK, 1992, AVIAT SPACE ENVIR MD, V63, P763
[10]  
Kleinbaum DG, 1988, APPLIED REGRESSION A, p[32, 198]