Skip to main content
ABMS Conference 2023 Main banner
Session Evaluation On-Demand Recording

Assessment

Opening the Black Box: Understanding the Psychometrics Behind Using Longitudinal Assessments for Continuing Certification

Tuesday, September 19, 2023
11:00 AM - 12:00 PM CT
Location: Guggenheim 1
Description: In 2024, the American Board of Medical Specialties will be implementing new “Standards for Continuing Certification.” While all Member Boards must comply with the new standards, each board has designed a longitudinal assessment with unique features. With three psychometricians representing different Member Boards, we will look at longitudinal assessments through a psychometric lens. Each participant will answer questions about how they supported their board in evaluating and scoring their distinct longitudinal assessments. We will discuss standard setting methodologies, specialized reliability indices that aim to balance the coinciding formative and summative components of these assessments, and best approaches for measuring performance when multiple attempts per item are allowed. Join us as we open the black box!

Citations and Literature References (if none, write n/a): n/a

Learning Objectives:

  • Understand important psychometric principles for evaluating and scoring longitudinal assessments
  • Describe various ways that pass points are determined for longitudinal assessments
  • Describe how psychometricians have handled the complications of longitudinal assessments that measure both core specialty knowledge and subspecialty knowledge