Skip to main content
. 2024 Feb 6;13(1):56–67. doi: 10.5334/pme.961

Table 3.

Challenges and lessons learned in the large-scale implementation of competence committees.


CHALLENGES ROYAL COLLEGE RESPONSES TO CHALLENGES INSIGHTS AND LESSONS WE LEARNED ALONG THE WAY

1. Standardizing process and procedures while maintaining flexibility
  • Disseminated national terms of reference and policy documents

  • Articulated where there is flexibility in the process to allow adaptation to local structures and increased ownership through a technical guide

  • Created a community of practice model through the CC chairs forums to help identify and develop best practices among programs with similar contexts

  • Developed annual pulse surveys distributed to invested groups to identify whether processes were implemented as intended and to identify any unforeseen challenges

  • Provide clear guidance and simplified expectations to ensure consistent messaging and practices

  • Anticipate local adaptations as there is no one-size-fits-all approach

  • Anticipate tensions between flexibility and standardization of interventions

  • Use program evaluation as a key enabler to help identify and mitigate any divergence in practices and to maintain fidelity and integrity during implementation


2. Addressing the contextual variability within institutions, programs, and systems
  • Identified and recruited a national CBME Leads group with Leads within each university

  • Created a network of peers within each university and externally through individual specialties through the CC chairs forums

  • Developed ongoing two-way dialogue between the Royal College and invested groups

  • Organized multiple in-person and virtual CC chairs forums for clear communication, sharing of best practices, and identification of common challenges with implementation

  • Recognize that each university and individual program will have unique contexts that require adaptable implementation

  • Identify and group common elements related to context (e.g., size of programs, institutional policies, and resources) that can help provide direction on ways to adapt CC implementation

  • Be mindful that when new systems of assessment are applied too rigidly it can lead to frustration or overburdened assessment practices

  • Engage invested groups in the process to create a shared vision and build trust


3. Working with finite human and financial resources
  • Provided centralized investment through development of free key resources (e.g., electronic platform, assessment templates, e-modules, and adaptable slide decks for faculty development)

  • Provided a venue to share best practices and locally developed approaches that could be adapted by institutions via national CBME Leads group and the national CC chairs forum

  • Recognize and plan to accommodate the wide variations in financial and human resources among institutions and programs

  • Expect the need for and support additional faculty time for portfolio review and attendance at meetings as CCs are a new structure

  • Be mindful that individual institutions may feel more comfortable using existing or locally developed resources, which may increase the resource burden to that institution


4. Providing faculty development and ensuring engagement
  • Developed and maintained a curated repository of online faculty development resources (e-modules, workshops, webinars)

  • Created a national CC chairs forum to enable effective networking, innovation sharing, and movement of knowledge to those who need it to improve their CC practices

  • Plan for faculty development activities that involve longitudinal and multimodal offerings aimed at all invested groups (e.g., CC chairs, administrators, faculty, and trainees)

  • Develop faculty development strategies that emphasize interconnectedness and relationship building to help support insights on effective knowledge translation in complex systems


5. Changing the culture of assessment
  • Worked toward shared mental models among invested groups of intended CC implementation

  • Ensured alignment of national institutional policies and accreditation standards to avoid confusing or mixed messages

  • Provide guidance on the policies, processes, and procedures that guide CC functioning

  • Communicate the purpose and flow of CC work to all invested groups to build transparency in the assessment system

  • Acknowledge the dual purpose of assessment for developmental and summative progress purposes while providing rationale and strategies on how to manage this tension

  • Monitor for linear or reductionist approaches to programmatic assessment that can lead to negative assessment behaviors and practices


CBME competency based medical education; CC Competence Committee.