Précis: This study investigated the effect of self-evaluation on the improvement of surgical skills by comparing OSATS scores over a 4-month period to determine if the addition of a self-evaluation improved surgical skills more than instructor evaluation alone.
Purpose: To determine if self-evaluation improves surgical performance more than instructor evaluation alone.
Background: The OSATS score is a validated rating scale for the evaluation of surgical skills. Self-evaluation using OSATS has been compared to instructor evaluation to determine the correlation of the scores. Self-evaluation in combination with instructor evaluation to improve surgical skills has not been studied.
Methods: A RCT was performed in which learners, PGY 1-4, were randomized into either the control group who only received instructor OSATS evaluations or the experimental group who received instructor evaluations as well as self-evaluations. Everyone received the same instructions and performed the same simulation which was videotaped for review. The instructor was blinded to each arm and the simulation was repeated after four months. The primary outcome was the change in instructor OSATS score over the study period.
Results: Fifteen residents were enrolled and completed the study. There was no difference in the change in instructor OSATS score (p=0.726). There was a correlation in the learner and instructor score for time and motion (p= 0.02) and instrument handling (p=0.008). All participants reported that self-evaluation was a useful educational tool. Only participants from the experimental group reported practicing on their own time.
Discussion: The current study attempted to demonstrate the utility of self-evaluation on surgical education. The correlation between learner and instructor scores are consistent with the literature. Self-evaluation did not improve overall change in score; however, all participants found it useful and it did increase practice at home.
Topics: SES, 2020, Resident, Faculty, Clerkship Director, Residency Director, Practice-Based Learning & Improvement, GME, Assessment, Simulation, Independent Study,
