Purpose: To validate myTIPreport for surgical skill feedback and competence evaluation within a two-year fellowship.
Background: In 2017, all Complex Family Planning (CFP) fellowship sites implemented myTIPreport, a web-based trainee feedback platform. Previously validated for procedural feedback within 4-year OB/GYN residency and 3-year FPMRS fellowship programs, myTIPreport has not been validated within the context of a shorter, 2-year fellowship.
Methods: We obtained de-identified, pooled myTIPreport data on D&E procedure evaluations completed during 2017-2020 from all 27 CFP fellowship sites. We compared cumulative procedure ratings on a 5-point Dreyfus scale between first and second-year fellows through mixed effects linear regression.
Results: We included D&E evaluations from 84 unique fellows over 3 academic years. The range of individual D&E evaluations per fellow ranged from 1 to 27 with a total of 678 evaluations analyzed. The mean cumulative rating on D&E procedures was 3.9 and 4.6 for first-year and second-year fellows respectively. Mean cumulative ratings significantly differed between fellow training years (p< .001). The training year differences in cumulative ratings remained significant through all study years (year 1: p=.014, year 2: p< .01, year 3: p< .01).
Discussions: This study demonstrated that myTIPreport is able to differentiate skill level by training year for CFP fellows performing D&E procedures, which adds construct validity for this evaluation tool. It remains unclear whether myTIPreport is being optimally utilized for providing procedure feedback to fellows. A prospective study is underway to address whether addition of faculty development “frame-of-reference” video modules improves the process of rating fellows on D&Es using myTIPreport.
Topics: CREOG & APGO Annual Meeting, 2022, Faculty, Medical Knowledge, Systems-Based Practice & Improvement, Interpersonal & Communication Skills, Practice-Based Learning & Improvement, GME, Assessment, Contraception or Family Planning,
Mack Goldberg, MD, University of Pittsburgh Medical Center; Nicole Donnellan, MD; Beatrice Chen, MD, MPH; Leslie Meyn, PhD; Sharon Achilles, MD, PhD
