Abstract
Entrustable professional activities (EPAs) are measurable units of observable professional practice that can be entrusted to an unsupervised trainee. They were first introduced as a method of operationalizing competency-based medical education in graduate medical education. The American Association of Medical Colleges subsequently used EPAs to establish the core skills that medical students must be able to perform before they enter residency training. A recently published guide provides descriptions, guidelines, and rationale for implementing and assessing the core EPAs from an osteopathic approach. These osteopathically informed EPAs can allow schools to more appropriately assess a learner's whole-person approach to a patient, in alignment with the philosophy of the profession. As the single accreditation system for graduate medical education moves forward, it will be critical to integrate EPAs into osteopathic medical education to demonstrate entrustment of medical school graduates. The authors describe the collaborative process used to establish the osteopathic considerations added to EPAs and explores the challenges and opportunities for undergraduate osteopathic medical education.
In April 2016, the American Association of Colleges of Osteopathic Medicine (AACOM) published
Osteopathic Considerations for Core Entrustable Professional Activities (EPAs) for Entering Residency1 to serve as a guide for osteopathic medical schools. This publication describes the distinct clinical skills that osteopathic medical students must be able to competently perform when beginning their residency.
Entrustable professional activities, a concept introduced by ten Cate
2 in 2005, are defined as measurable units of observable professional practice that can be entrusted to an unsupervised trainee. In aggregate, the EPAs represent the essential professional competence expected of a practicing physician. The AACOM guide
1 provides descriptions, guidelines, and approaches for implementing and assessing the 13 core EPAs for undergraduate medical education (UME) and can be used as a roadmap for osteopathic medical schools. The current article describes the rationale and process used to develop the AACOM guide
1 and discusses the challenges that must be overcome to effectively assess the entrustment level of EPAs for osteopathic medical school graduates.
In 2003, as a result of the ailing US health care system and growing concerns for patient safety, the Board on Health Care Services called for reform in medical education.
3 Since that time, medical schools and residency programs have navigated the transition from a process-based delivery system (success measured by time to completion of medical training) to an outcome-based system (success measured by competency that leads to advancement).
4 Competencies for medical education were implemented in early 2000 and were an important first step in defining learning outcomes and advancing competency-based medical education (CBME).
5 The osteopathic core competencies
6 describe characteristics of a fully-qualified graduate in 7 core domains and establish end points for training. However, the core competencies fail to provide a pathway for assessing trainee development across the continuum of medical training. In 2010, the need for standardized educational outcomes across the full continuum of medical education for the successful implementation of CBME was addressed.
7 Developmental milestones and EPAs were introduced into GME residency training as a method for operationalizing CBME in residency training.
8 Despite residency director concerns about ill-prepared students, a parallel structure in UME performance assessment has been slow to emerge.
9,10 This gap in medical student preparation and expected performance at the initiation of residency led to an increased concern for patient safety and an urgent need for UME training standards.
11
In response to this need, the American Association of Medical Colleges (AAMC) convened a panel of national experts to define professional activities that every medical student should be able to complete without direct supervision on the first day of residency, regardless of specialty choice.
12 The committee used EPAs as the conceptual framework to define the essential skills required of medical students as they transition from undergraduate to graduate training.
12 Following a thorough review of the literature and model curricula, 21 EPAs were proposed and subsequently narrowed to 13 EPAs
(Figure 1) that residents must be able to perform without direct supervision on their first day of residency.
11
In February 2014, the Accreditation Council for Graduate Medical Education (ACGME), the American Osteopathic Association (AOA), and AACOM announced a collaborative 5-year plan to implement a single accreditation system for GME.
13 This single accreditation system would fully recognize and incorporate osteopathic distinctiveness and osteopathic milestones in competency-based assessment,
13 which established a need to review and modify existing assessment paradigms and develop innovative frameworks to address the progress of medical students toward competency and proficiency in clinical practice.
The ACGME core competencies did not address osteopathic principles and practice and were subsequently modified by AACOM and the National Board of Osteopathic Medical Examiners to provide educational alignment and relevance between osteopathic UME and GME. The EPAs put forth by the ACGME and AAMC posed a similar dilemma in that adaptations were required to address specific osteopathic training considerations.
In fall 2015, at the direction of the Board of Deans, AACOM established the AACOM EPA Steering Committee to evaluate the applicability of the 13 EPAs to osteopathic medical education, with the goal of advancing the implementation of EPAs into undergraduate osteopathic medical education.
1 The committee included medical education leaders and a student representative from the Council of Osteopathic Student Government Presidents. Deans from the osteopathic medical schools worked in collaboration with the committee and offered insight and feedback via direct communication and survey responses. The Educational Council on Osteopathic Principles carefully guided the deliberations and ensured consistency in the language and definitions used.
The committee deliberated on whether to create distinct osteopathic EPAs or to integrate osteopathic elements into the existing EPAs. With the emerging single accreditation system for GME, the committee felt it was imperative that osteopathic medical students were able to demonstrate the same entrustments as their allopathic counterparts, while maintaining osteopathic integrity.
1 Rather than listing all osteopathic elements of patient care into an additional EPA—and thus relegating osteopathic medicine to a separate professional activity—the committee advocated that osteopathic principles and practice were foundational to all aspects of patient care and should be represented by the addition of osteopathic considerations into the 13 existing EPAs.
1 The committee also felt that integration better aligned with national efforts to establish common standards for residency training and would best support the competitiveness of osteopathic medical students as they graduate and enter residency.
To integrate osteopathic considerations into the EPAs, the committee reviewed each of the EPAs with Q-methodology, a process by which each member ranked and sorted EPAs that required osteopathic adaptations.
14 With feedback from the school liaisons, osteopathic considerations were integrated into 6 of the 13 EPAs.
1 The osteopathic elements added to the EPAs involve the distinct skills of the osteopathic medical profession that are critical to entrustment decisions and are grounded in the tenets of osteopathic medicine, which recognizes the entirety of the body as an interdependent holistic system working to maintain homeostasis and promote healing (
Table). The EPAs with osteopathic considerations guide preceptors to more appropriately teach and entrust a learner's approach to a patient as a unit of mind, body, and spirit in alignment with the philosophical underpinnings of the osteopathic medical profession. The adaptations made to the EPAs will guide the GME-readiness assessment process and affect the implementation of EPAs into medical education in 2 ways. First, osteopathic medical students who successfully advance in entrustment, as defined by these revised EPAs, will demonstrate the understanding of the critical relationship between structure and function consistent with the tenets of osteopathic medicine. Second, because of the added osteopathic considerations, the EPAs will provide educators with the tools necessary to evaluate students in accordance with the tradition of the osteopathic medical practice.
The EPA Steering Committee also established 4 subcommittees (faculty development, curriculum, learner assessment, and resources) to support the implementation of EPAs within osteopathic medical schools.
1 The faculty development subcommittee was established to create standard resource materials on EPAs that could be used by schools to educate key stakeholders, including administrators, faculty, preceptors, and students. The curriculum subcommittee was developed to address instructional needs to support EPA implementation in each osteopathic medical school and to develop guides focused on best practices and research-based approaches to integrating EPAs into school curricula. The learner assessment subcommittee targeted the development of an inventory of vetted, validated assessment tools focusing on best practice approaches, and the goal of the resources subcommittee was to establish an online portal to house faculty development, curriculum, and assessment materials in a secure, searchable portal. The resources subcommittee was also tasked with developing a process of peer review for future EPA resources and projects.
Within each EPA, osteopathic competencies intersect with one another and are fundamental to assessing a trainee's level of entrustment and developmental progress across the milestones. ten Cate
15 defined
competence as trust in the learner, specifically asking, “Can this trainee be trusted to carry out this activity without your direct supervision?” This question became the foundation of assessing a trainee's developmental progress and milestones. When defining
milestone, the ACGME website states,
Milestones allow for a detailed description of knowledge, skills, attitudes, and performance that describe learner expectations and desired performance. Milestones have a developmental progression of competence that serves as a guide to the trainee and trainer.
Linking EPAs, competencies, and milestones provides a curricular map that can serve as the backbone of a medical school curriculum. An example of these links can be found in
Figure 2, which depicts EPA 1, gathering a history and performing a physical examination on a patient, and the way that various curricular milestones map from AACOM competencies. In the AACOM EPA guideline,
1 links connecting EPAs and competencies are provided, allowing individual institutions to tailor mapping exercises to competencies and learning activities specific to the curriculum at each institution.
Implementing EPAs in undergraduate osteopathic medical education has distinct challenges. Workplace-based assessment in patient care settings is essential to making entrustment decisions. However, valid and reliable assessment tools are sparse, and standards of reliability cannot easily be met.
17 Because the construct of entrustment is the synthesis of multiple complex factors, entrustment decisions require the use of a variety of instruments across time, in different contexts, and by different evaluators.
18 The capacity of a school to meet these expectations depend on available resources, an alignment of the school's clinical curriculum, adequate patient volume, and access to a range of care settings and trained preceptors.
18 As trainees move from one rotation or clinical setting to another, additional observations are often required to reconfirm the trainee's competency, especially given that skills can diminish over time if not practiced.
2 The volume of assessments may increase because EPAs and CBME, in general, focus not only on units of work, but also the work process itself. This focus can pose potential challenges, such as defining work that does not easily fit into the EPA framework, introducing additional assessments to better understand the process of work, and creating assessment methods that do not overcomplicate the evaluation process or overburden faculty. This increase in assessments required for entrustment can add stress to an already burdened system and requires a process for tracking over time.
19
Assessment of entrustment establishes an even greater layer of complexity. Within the notion of entrustment reside behaviors such as conscientiousness, honesty, and recognition of one's limitations.
20,21 Ultimately, a decision regarding student readiness to perform a given activity under appropriate supervision must be made. For students entering residency, the level of supervision required may vary by EPA. It may range from co-activity (performance with the aid of a trainer) to independent performance with immediate supervision.
22 These types of decisions are multifactorial and depend on complex interpersonal interactions and workplace-based factors. Residency-level entrustment and supervision scales are readily available for use.
23 However, in UME, much work is needed to create scales and tools for these types of assessments.
Entrustment decision making is most successful in an environment that allows for individualized learning trajectories and practice opportunities in the context of longitudinal relationships with preceptors.
24 Many institutions cannot fulfill these ideals given health care delivery constraints, patient-safety concerns, and competing demands to meet increasing resident training requirements, which often limit student opportunity to gain hands-on experience and receive valued feedback from mentors.
24 Moreover, osteopathic medical schools rely heavily on decentralized clinical education, rather than the more traditional academic health center model, which requires the engagement and trust of community-based preceptors to understand and reliably make entrustment decisions.
25 This concept of assumed responsibility for faculty can be daunting, and levels of comfort with this responsibility are still evolving.
25,26
Portfolios are a viable tool for collecting, organizing, and managing assessment data on learners and can be used to keep learners engaged in assessment, foster lifelong learning, and promote professional identity formation across time.
27 However, effective use of portfolios also requires a sustained mentoring capacity and the necessary time and resources for the implementation process, as well as for the mentor.
24 In addition, feedback mechanisms must be in place to enable improvement in abilities.
28 Mentors must be well trained to assess students, to serve in the mentoring role, and to provide feedback that will facilitate student progress. The purpose of the portfolio and the embedded assignments must be explicit to all stakeholders. Learners must understand the benefits of the portfolio to prevent them from perceiving learning as “busy work.”
24 For true progress over time, all stakeholders, including faculty, medical students, residents, and national licensure boards, must be invested in conversations regarding evidence supporting learner assessment and mechanisms to document achievement of agreed-upon competence. Without adequate resources, time, training for mentors and assessors, recognized purpose, and communication among all stakeholders, it will be hard to collect and complete a longitudinal snapshot of learner achievement toward EPAs across time and contexts. These conversations must occur at a national level if handoffs of learners from UME to GME are expected to succeed and progress toward entrustment.
Osteopathic Considerations for Core Entrustable Professional Activities (EPAs) for Entering Residency1 provides guidelines, approaches, and rationale for implementing and assessing the 13 EPAs using osteopathic approaches. As osteopathic GME continues to move forward with the single accreditation system, it is important that osteopathic medical schools adapt their curricula and assessment outcomes to include EPAs that can help demonstrate entrustment of their graduates as they enter residency training.
The authors acknowledge Stephen C. Shannon, DO, MPH, president of the American Association of Osteopathic Medicine, for his vision and support in advancing the EPA initiative; Elaine Soper, PhD, director of Faculty Development at the West Virginia School of Osteopathic Medicine, for her contributions as co-chair during the initial phase of the project; and Karin Esposito, MD, PhD, associate dean for Curriculum and Medical Education, Academic Affairs, and professor, Department of Psychiatry & Behavioral Health, Florida International University Herbert Wertheim College of Medicine, for her valuable guidance as an expert consultant.