Objective
To test efficacy of a student performance assessment tool in a simulated patient encounter and handoff.
Background
Patient handoffs are a common source of medical errors.We developed a simulation including patient interaction, treatment plan and handoff and an assessment tool with the categories used for clerkship grades. We hypothesized simulation performance would correlate with clinical communication skills and clerkship grades.
Study Design
This is a prospective, observational study to determine the reliability of a tool to assess student evaluation and management of a simulated patient encounter and handoff in a common obstetric emergency—incomplete abortion with significant blood loss. Two faculty independently rated students. Scores were evaluated for inter-rater reliability and compared to clerkship grades.
Results
Among 37 students analyzed, there was only moderate correlation between observers on history taking, fund of knowledge and interpersonal skills. There was no correlation for presentation skills, evaluation and management, professionalism, systems awareness and desire to learn. Students found the exercise useful: 88% agreed the simulation taught handoff skills, 78% agreed the exercise was realistic, and 72% agreed the simulation increased confidence in handoffs.
Conclusions
Our curriculum provides an opportunity for learning and practice of patient handoffs. Students found it relevant, realistic and effective. Although our tool was based on a clerkship grading tool currently used for students, we found only modest inter-rater reliability on 3 of 8 items. This suggests the clerkship grading tool may not provide objective assessment of clinical performance and further study of its inter-rater reliability is warranted.
Topics: 2014, Resident, Clerkship Director, Clerkship Coordinator, Patient Care, Systems-Based Practice & Improvement, Practice-Based Learning & Improvement, GME, Assessment, Simulation, Quality & Safety, General Ob-Gyn,
Date Presented
2014 ASL Abstract
Keywords
Assessment, Curriculum Development/Evaluation, Feedback & Evaluation, Instructional Materials/Methods, Patient Safety/Medical Errors, Simulation
Intended Audience
Resident, Clerkship Director, Residency Director
Copentencies Addressed
Patient Care, Systems-Based Practice & Improvement
Educational Continuum
GME, UME
Educational Focus
Assessment, Simulation, Quality & Safety
Primary Author
Celeste Royce, MD
