Context: As a proposed alternative to the traditional recertification examination, CATALYST is a longitudinal formative assessment platform created on cognitive learning principles. CATALYST was designed by the National Board of Osteopathic Medical Examiners to encourage more complex and durable practice-relevant learning and demonstration of ongoing competencies.

Objective: To investigate the value of the CATALYST platform using board diplomates’ subjective feedback and comparison of performance on CATALYST questions with performance on board examinations.

Methods: Diplomates from 3 osteopathic specialty boards (the American Osteopathic Board of Internal Medicine, the American Osteopathic Board of Pediatrics, and the American Osteopathic Board of Obstetricians and Gynecologists) participated in this pilot study. Over the course of 16 weeks, participants were provided 2 questions per week via the CATALYST platform. An evaluation survey was emailed at the end of the study period to collect participants’ feedback. Survey results and correlations of CATALYST performance with past or upcoming board examination scores were analyzed.

Results: A total of 196 diplomates completed the surveys, with 95% reporting that participation in the platform would help them stay current in their specialties and 91% reporting that participation would help them provide better care to their patients. For the AOBIM, a significant correlation was found between the number of CATALYST questions answered correctly and performance on the board examination (r=0.51, P<.001). The correlations found for the AOBP and AOBOG were not significant (r=0.197, P=.296, and r=0.370, P=.075, respectively).

Conclusion: The CATALYST platform could offer valuable contributions to the board recertification process and to patient safety. Further investigations are being conducted on a new user-friendly platform.