Commitment to Action | Statement on enhanced flexibility for CBD program implementation

May 17, 2023 | Author: Royal College Staff
10 MIN READ

High level summary of key messages
Read the statement
FAQs

High level summary of key messages:

  • At the six-year mark, clear feedback from both formal program evaluation and stakeholders has outlined where we are today, with respect to the benefits and challenges of Competence by Design (CBD).
  • While we remain confident in the merits of CBD for our learners and our patients, this feedback has taught us that our approach to improving education and patient care through the introduction of CBD across Canada has had several unintended negative impacts that we would like to address.
  • We recognize there are unique obstacles and opportunities within each institution, discipline and program, and are committed to providing flexibility around the implementation of CBD, allowing it to be meaningful, efficient and authentic.
  • The Essential Requirements of CBD Implementation, a newly released document, is intended to give postgraduate institutions and programs more agency over how they implement specialty-specific standards and CBD document suites, with a distinct focus on easing the burden of assessment that many have experienced. (Bookmark the link.)
  • New enhanced flexibility has been introduced for program adherence to CBD principles, as reflected in the general and specialty-specific accreditation standards, as well as Royal College policies.
  • The path forward will involve a series of three Royal College National Summits with key leaders from our invested partner groups to co-create the evolution to CBD 2.0.
  • Planning is underway for a new Royal College CBD Consult Service.

High level summary of key action items indicating enhanced flexibility:

  • Royal College technical guides (e.g., #1 or #3) provide detailed advice for high fidelity CBD implementation that is compatible with accreditation standards – BUT – these are exemplar guidelines and should not be interpreted as minimum.
  • Programs have the flexibility to determine the evidence on which stage-promotion decisions are made and how it will be reviewed and assessed, based on individualized resident learning plans.
  • Residents can pursue EPAs in future stages if an opportunity presents itself.
  • Typically, a competence committee must ensure that each resident is entrusted with all EPAs within each stage before promotion to the next stage. However, a resident may be promoted to the next stage with a limited number of EPAs remaining in the previous stage at the discretion of a Competence Committee, providing there is a mechanism to ensure all EPAs are entrusted by the end of training.
  • Royal College assessment templates may be used, and/or institutions and programs may use other thoughtfully chosen assessment instruments of their choosing.
  • Each institution has the authority and mandate to adopt, develop and use the assessment tools that are best suited to their programs.
  • EPA entrustment data should not be the sole source of data around a resident’s performance.
  • Local programs can determine the number of entrusted observations required for each EPA and align this with the need to assess residents relative to all contextual variables.
  • A program, or its PGME office may determine which combination of EPA observation form components to include on the WBA, for example – which milestones, how many, which entrustment scale, etc.
  • Programs and competence committees have the authority to determine the appropriate amount and type of qualitative and quantitative evidence required to make assessment decisions, as long as both types of evidence are used.
  • Programs have the flexibility to determine the communication and decision-making processes between the Competence Committee and the RPC.
  • The Royal College commits to ensuring that everyone involved in accreditation has a clear and renewed understanding of the level of focus and the type and amount of information reviewed, as well as the importance of considering the wider context in which residency training takes place, including factors that impose limitations beyond a program’s control, such as hospital staffing shortages and challenges of poorly functioning electronic systems.
  • Frequently Asked Questions

Rationale for immediate change

As we approach year six of implementation of Competence by Design (CBD), clear signals about the benefits and challenges of the CBD model have emerged from both formal program evaluation and feedback from our invested partner groups. Important challenges include the burden of using Entrustable Professional Activities (EPAs) observations to both frame regular feedback to residents and to assemble data points for resident assessment, time and resources required to implement all aspects of CBD as designed, deploying an electronic learner portfolio, and associated impacts of CBD-related changes on resident and faculty wellness.

It is apparent that our approach to improving education and patient care through the introduction of CBD across Canada has had several unintended negative impacts. While we remain confident in the merits of competency-based medical education (CBME) and are committed to the implementation of related key principles across all specialties, we recognize that a “one size fits all” approach does not consider unique obstacles and opportunities within each local institution, discipline, and program. We also recognize that part of the solution involves addressing barriers of CBD that are at the systems level, outside of the control of individual programs. We trust that postgraduate education leaders will continue delivering quality medical education expected by society if given flexibility to best adapt CBD within the context of their programs.

It is time to refocus efforts on orienting the CBD model to the core principles of CBME intended to improve residency education, while respecting the resources available across institutions and incorporating lessons learned thus far. Multiple invested groups, including the CBD national stakeholder advisory board, have called for increased flexibility of implementation, along with enhanced opportunities for local institutional education leaders to deliver CBD in more efficient ways that match the desired intent of CBD principles with the clinical workflow processes and local context. This document outlines previously existing and new enhanced flexibility for CBD implementation in response to urgent requests for CBD reform. In providing this needed relief from what has been seen by some as an overly rigid system, we must accept that program curriculum design, examination eligibility and certification decisions are all predicated on CBD approaches working effectively in our residency programs. Programs, in partnership with their PGME offices and specialty committees, are encouraged to optimize implementation within their own contexts and resources while maintaining the spirit of the standards articulated by the specialty committees and program directors.

The Essential Requirements of CBD Implementation document is intended to give postgraduate institutions and programs more agency over how they implement specialty-specific standards and CBD document suites, with a distinct focus on easing the burden of assessment that many have experienced. Retaining the principles of increased regular meaningful feedback to learners and enabling confident promotion decisions will require thoughtful integration of EPA observations and other assessment modalities into a coherent system of assessment. With oversight by PGME offices over the implementation of CBD, enhanced flexibility is afforded to programs and their elements in how they reconcile specialty specific requirements within local contexts. Also, we wish to emphasize that Royal College technical guides (e.g., #1 and #3) provide detailed recommendations for high fidelity CBD implementation that are compatible with accreditation standards but are not intended to be absolute requirements.

The Committee on Specialty Education (CSE) has approved The Essential Requirements of CBD Implementation document, effective immediately, which outlines the essential requirements with new enhanced flexibility for program adherence to CBD principles, as reflected in the general and specialty-specific accreditation standards, as well as Royal College policies. Critical requirements for meeting accreditation standards will continue to include:

  • use of specialty-specific competencies and required educational experiences;
  • the need for deliberate promotion decisions by competence committees;
  • entrustment of each resident in the portfolio of specialty-specific EPAs in some manner;
  • evidence of regular, ongoing feedback and coaching.

The context of CBD within accreditation

Accreditation is a holistic evaluation of a program. It is not an evaluation of CBD implementation in isolation. Accreditation seeks to verify that residents have a safe learning environment with appropriate supervision, feedback & coaching, that there is a continuous quality improvement process in place and functioning, that programs are appropriately resourced, and that there are effective leadership and communication processes. The standards and evaluation process focus on the principles of sound educational design. Those involved in the accreditation review and decision-making (surveyors, specialty committees, accreditation committees) seek to verify that the essential requirements for CBD implementation, as outlined above and detailed in the general and specialty-specific standards of accreditation, are in place.

We recognize, however, that it can feel like accreditation puts an undue emphasis on certain components of CBD. We hope this statement helps to clarify for institutions and programs how CBD implementation is approached by surveyors within the accreditation process. In turn, we are committed to ensuring that both volunteers and staff involved in the accreditation process have a clear and renewed understanding of the level of focus and the type and amount of information reviewed, as well as the importance of considering the wider context in which residency training takes place, including factors that impose limitations beyond a program’s control, such as hospital staffing shortages and challenges of poorly functioning electronic systems.

The path forward

The purpose of this statement is to provide clarity on the enhanced degrees of flexibility in the system and leverages the tremendous efforts of educational champions across the country to build a stronger educational system for residents to thrive in throughout their training. We acknowledge that more formal design adaptations in the CBD model are required to achieve the intended impacts of competency-based medical education, improve the training experience, and address the impact on faculty and residents. With a renewed commitment to action, the Royal College will invest in a national collaborative process over the next 12-18 months to reimagine how CBD can enhance residency training across Canada.

This will involve a series of three Royal College National Summits with key leaders from our invested partner groups to co-create the path forward – the evolution to CBD 2.0.

graphic Summit Fall 2023 Summer 2024 Winter 2024

After extensive member checking and opportunities for review from the various invested groups across the country, this collaborative work will then be finalized based on further input and refinement. A final CBD Summit will be held to finalize the national consensus document before submission to the Royal College Committee on Specialty Education (CSE) for decision (Spring 2024). It is hoped initial modifications from the national summits on CBD can begin on July 1, 2024 – with the understanding that some changes to the CBD Framework will occur over a multi-year timeline.

Consultation Recognition

A special thank you to the many groups who contributed their time, expertise and guidance in the collaborative development of this material: the postgraduate deans, National CBME leads, Specialty Committees, Resident Doctors of Canada, Fédération des médecins résidents du Québec, and members of the CBD National Stakeholder Advisory Board, which includes program directors, Specialty Committee chairs, clinician educators, residents and others. We remain committed to the ongoing improvement of the residency training experience for all.

Please direct questions or comments to cbdsecretariat@royalcollege.ca.

Sincerely,

Glen Bandiera, MD, FRCPC, MEd, BASc(Engin)
Executive Director, Office of Standards and Assessment
Royal College

J. Damon Dagnone, MD, FRCPC, MSc, MMEd
Director, Standards and Accreditation
Royal College


Tags

Leave a comment. To reduce spam, comments are reviewed before they are visible on the post.

Your email address will not be published. Required fields are marked *

Submit

Charlene Lyndon | May 18, 2023
One aspect of CBD that I appreciate is that it deals with one of the dirty secrets of our training. The marginalization of some residents is reduced. We don’t like to discuss how there are “in club” residents and “not in the club” residents but this stratification does indeed occur. Female surgical residents often get fewer cases. LGBTQ residents get fewer cases. With CBD everyone gets enough cases to be skilled. Or at least, further progress is being made.
Hoshiar Abdollah | May 17, 2023
Please provide me and membership objective evidence that the work of last 6 years have resulted in any significant positive changes in post-graduate medical education in Canada compared to previous 6-10 years. Significant and costly efforts are spend both at the College and Medical Schools primarily on the process and nothing on outcome. After all we our patient care foundation is based on evidence.
James Wright | May 17, 2023
Nothing that is so fundamentally right, should be so fundamentally painful. We have really done nothing except introduce a tyranny of process. No clinical care pathway would have ever changed with the level of evidence available to support CBD as a framework for revamping education. But, I'll continue to plug my nose and move forward.
Competence by Design Innovator | May 18, 2023
Thank you for expressing your concerns about Competence by Design. We remain committed to improving the residency training experience for all. We will continue working together with the medical education community to identify and address challenges within the learning environment. Please consider providing any key discussion points for the upcoming CBD National Summits as discussed in today’s statement by mailing cbdsecretariat@royalcollege.ca
Katherine Kavanagh | May 17, 2023
As you go forward you, I would like to suggest need to make sure you listen to boots on the ground. Many specialty committee members, RPC faculty, faculty in general and trainees expressed significant / grave concerns about the CBD program as it was being rolled out. They for the most part do not feel they were heard and even more concerning that they were ignored. It incurred significant expenses for our institutions (for some more expenses as we now have to replace the Royal College Portfolio for documentation of EPAs as well as train stressed and overworked faculty on a new platform). As you already know, it markedly increased the workload and stress for trainees and faculty. They kept asking for data to support this massive change. This data was never provided. I think you need to consider these factors as you go forward if you wish to regain their support for future changes.
Royal College Staff | May 18, 2023
Thank you for your comments. We agree that now and moving forward we need to listen. The Royal College intends to ensure that all voices in the residency education community feel represented in the statement and action plan. We are working closely with Specialty Committee members, faculty, and trainees, as the solutions reflected here have been co-created with them along with postgraduate deans, CBME leads and resident organizations. While The Essential Requirements of CBD implementation is a first step, we acknowledge that more formal design adaptations in the CBD model are required. We are committed to achieving the intended benefits of competency-based medical education, improving the training experience, and addressing unintended negative impacts on faculty and residents. Please consider providing any key discussion points for the upcoming CBD National Summits as discussed in today’s statement by mailing cbdsecretariat@royalcollege.ca