Objective: Design and implementation of a tool for resident evaluation that assesses integration of patient care, communication and technical skills using simulation and bench skills testing in an OSCE format.
Study Design: The Test of Integrated Professional Skills (TIPS) includes five stations with standardized patients (SPs) and complex scenarios involving ultrasound, procedural skills and evidence-based medicine. All were directly observed by faculty. SPs are trained as raters using behaviorally-anchored checklists, and faculty rated technical skills. Performance data from TIPS was analyzed and compared to standard faculty clinical evaluations utilizing Spearman’s rho.
Results: Twenty-four residents participated in the TIPS. Performance followed developmental trends, although there was a wide variation of performance, and outliers were identified. Internal consistency of ratings Cronbach’s alpha .69-.82. Standard faculty evaluations varied little internally, and did not correlate with TIPS performance.
Conclusions: A simulation-based OSCE facilitates observation of resident skill integration, and may differentiate resident performance more effectively than standard evaluation processes.
Topics: 2013, Resident, Residency Director, Patient Care, Professionalism, Systems-Based Practice & Improvement, Interpersonal & Communication Skills, Practice-Based Learning & Improvement, GME, Assessment, Virtual Patient, Simulation, General Ob-Gyn,
Date Presented
2013 ASL Abstract
Keywords
Assessment, Curriculum Development/Evaluation, Evidence Based Practice, Feedback & Evaluation, Instructional Materials/Methods, Milestones, Professionalism, Simulation
Intended Audience
Resident, Residency Director
Copentencies Addressed
Patient Care, Professionalism, Systems-Based Practice & Improvement, Interpersonal & Communication Skills, Practice-Based Learning & Improvement
Educational Continuum
GME
Educational Focus
Assessment, Virtual Patient, Simulation
Clinical Focus
General Ob-Gyn
Primary Author
Abigail Ford Winkel, MD
Alice Goepfert, MD,
Marissa Hiruma, MA
Colleen Gillespie, PhD
Sondra Zabar, MD
Demian Szyld, MD, MEd
