« Back to Search
A Multicenter Study Of The Impact Of An Online Question Bank On OB/GYN Resident In-Service Examination Performance
Purpose: The objective was to assess the effect of implementing
an online test bank on CREOG exam performance.
Background: Several vendors produce online question banks for
self-assessment. Little data is available assessing the impact of use of these
banks on inservice test performance.
Methods: 10 programs using the TrueLearn OB/GYN test bank (QB)
participated. Each site provided de-identified CREOG exam results paired
with QB usage for 2016 and 2017. Program mean CREOG scores were compared
before and after the first year of TrueLearn use. Using resident-level data, we
compared PGY-level and overall CREOG scores between users and persistent
non-users of the QB.
Results: No significant difference was seen in the mean CREOG
score per program before versus after implementation (mean increase 1.01,
p=0.58). There was no significant difference in mean CREOG scores between
resident users and non-users prior to the 2016 CREOG or prior to the 2017 exam.
Among residents who did not use the QB prior to the 2016 CREOG, residents that
switched to users of the QB (n=22) improved an average of 7.2 points between
2016 and 2017, compared to 4.8 points for persistent non-users (n=16), a
non-significant difference (p=0.54).The percent of questions answered correctly
on the QB practice tests positively correlated with CREOG scores in both 2016
Discussions: No significant changes were seen in mean CREOG scores
on a program-level before versus after QB usage or between users and non-users
on a per-resident level. Performance on the QB did correlate with CREOG
performance, suggesting predictive validity of an online QB, and supporting
utility in examination preparation.
CREOG & APGO Annual Meeting, 2020, Resident, Faculty, Residency Director, Residency Coordinator, Medical Knowledge, GME, Assessment, Independent Study,