Assessments in evidence-based medicine workshops: loose connection between perception of knowledge and its objective assessment

The outcome of continuing education programs is often based on self-assessment. We evaluated the relationship of self-assessment of knowledge based on rating scales with scores obtained on objective validated tests in evidence-based medicine workshops. In the West Midlands region (1998), 55 participants attended three workshops in critical appraisal of the medical literature. They completed two self-assessment questionnaires: one used a rating scale to subjectively examine the level of knowledge of six different literature appraisal issues; the other objectively assessed participants' literature appraisal knowledge in those issues using validated multiple true-false questions. Comparison of subjective scores reflecting understanding of specific literature appraisal issues with corresponding objective test scores revealed a poor correlation (r(s) ranged from -0.29 to 0.60 for the different knowledge issues assessed). Perception of ones level of knowledge did not always correlate with correctly possessed knowledge. In some instances, those who thought they were knowledgeable actually possessed incorrect knowledge. Therefore, continuing medical education programs should focus on objective, not subjective rests to assess outcome.