Home > Abstract Details > A Multicenter Study Of The Impact Of An Online Question Bank On OB/GYN Resident In-Service Examination Performance

« Back to Search

A Multicenter Study Of The Impact Of An Online Question Bank On OB/GYN Resident In-Service Examination Performance

Purpose: The objective was to assess the effect of implementing an online test bank on CREOG exam performance.

Background: Several vendors produce online question banks for self-assessment. Little data is available assessing the impact of use of these banks on inservice test performance.

Methods: 10 programs using the TrueLearn OB/GYN test bank (QB) participated. Each site provided de-identified CREOG exam results paired with QB usage for 2016 and 2017. Program mean CREOG scores were compared before and after the first year of TrueLearn use. Using resident-level data, we compared PGY-level and overall CREOG scores between users and persistent non-users of the QB.

Results: No significant difference was seen in the mean CREOG score per program before versus after implementation (mean increase 1.01, p=0.58). There was no significant difference in mean CREOG scores between resident users and non-users prior to the 2016 CREOG or prior to the 2017 exam. Among residents who did not use the QB prior to the 2016 CREOG, residents that switched to users of the QB (n=22) improved an average of 7.2 points between 2016 and 2017, compared to 4.8 points for persistent non-users (n=16), a non-significant difference (p=0.54).The percent of questions answered correctly on the QB practice tests positively correlated with CREOG scores in both 2016 and 2017.

Discussions: No significant changes were seen in mean CREOG scores on a program-level before versus after QB usage or between users and non-users on a per-resident level. Performance on the QB did correlate with CREOG performance, suggesting predictive validity of an online QB, and supporting utility in examination preparation.

Topics: CREOG & APGO Annual Meeting, 2020, Resident, Faculty, Residency Director, Residency Coordinator, Medical Knowledge, GME, Assessment, Independent Study,

General Information

Resident,Faculty,Residency Director,Residency Coordinator,
Medical Knowledge,
Assessment,Independent Study,
Clinical Focus

Author Information

Daniel Breitkopf, MD; Mayo Clinic College of Medicine; Isabel Green, MD; Rajiv Gala, MD; Amanda Flicker, MD; Gary Levy, MD; Robert Brady, MD

Additional Materials

Related Abstracts

Association of Professors of Gynecology and Obstetrics

2130 Priest Bridge Drive, Suite 7, Crofton, MD 21114


APGO logo

Follow Us

Association of Professors of
Gynecology and Obstetrics (APGO)