Objective: OBGYN clerkships frequently include oral examinations that aim to assess students’ ability to critically analyze data and utilize clinical judgement during common OBGYN scenarios. While students must possess basic knowledge to answer the oral examination questions, a strength of this examination is that it primarily targets higher cognition of Bloom’s taxonomy: applies, analyses, and evaluates. Furthermore, oral examinations can provide an additional point of measure to the summative letter grade for the rotation while familiarizing and exposing students to the oral examination formats, and encouraging and stimulating learning. Because the validity and reliability of scores from the oral exams are often taken at face value, we aim to provide you with tools to critically evaluate an assessment and enable you to create more meaningful oral examinations.
Methods: In this presentation, we will review 1) a primer on reliability and validity of interpretation of scores from assessments, 2) the role, pros and cons of clerkship oral examinations, 3) the process of exam development in light of the validity and reliability principles discussed (highlighting how to overcome rater bias) and 4) the logistics of administration (including virtual) and grading.
Topics: Faculty Development Seminar, 2022, Faculty, Clerkship Director, Medical Knowledge, UME, Assessment, General Ob-Gyn,
Said S. Saab, MD, MPhil, FACOG; Staci Pollack, MD, MS, FACOG; Jorie Colbert-Getz, PhD, MS
