Skip to main content
BMJ Open logoLink to BMJ Open
. 2018 Apr 17;8(4):e019963. doi: 10.1136/bmjopen-2017-019963

Doctors on the move: a European case study on the key characteristics of national recertification systems

Carolin Sehlbach 1, Marjan J Govaerts 1, Sharon Mitchell 2, Gernot G U Rohde 3, Frank W J M Smeenk 1,4, Erik W Driessen 1
PMCID: PMC5905769  PMID: 29666131

Abstract

Objectives

With increased cross-border movement, ensuring safe and high-quality healthcare has gained primacy. The purpose of recertification is to ensure quality of care through periodically attesting doctors’ professional proficiency in their field. Professional migration and facilitated cross-border recognition of qualifications, however, make us question the fitness of national policies for safeguarding patient care and the international accountability of doctors.

Design and setting

We performed document analyses and conducted 19 semistructured interviews to identify and describe key characteristics and effective components of 10 different European recertification systems, each representing one case (collective case study). We subsequently compared these systems to explore similarities and differences in terms of assessment criteria used to determine process quality.

Results

Great variety existed between countries in terms and assessment formats used, targeting cognition, competence and performance (Miller’s assessment pyramid). Recertification procedures and requirements also varied significantly, ranging from voluntary participation in professional development modules to the mandatory collection of multiple performance data in a competency-based portfolio. Knowledge assessment was fundamental to recertification in most countries. Another difference concerned the stakeholders involved in the recertification process: while some systems exclusively relied on doctors’ self-assessment, others involved multiple stakeholders but rarely included patients in assessment of doctors’ professional competence. Differences between systems partly reflected different goals and primary purposes of recertification.

Conclusion

Recertification systems differ substantially internationally with regard to the criteria they apply to assess doctors’ competence, their aims, requirements, assessment formats and patient involvement. In the light of professional mobility and associated demands for accountability, we recommend that competence assessment includes patients’ perspectives, and recertification practices be shared internationally to enhance transparency. This can help facilitate cross-border movement, while guaranteeing high-quality patient care.

Keywords: recertification, continuing professional development, performance assessment, patient safety, quality assurance, professional mobility


Strengths and limitations of this study.

  • Our research provides a comprehensive comparison of 10 European recertification systems and their assessment criteria used to ensure quality of care delivered. It highlights how physicians’ knowledge and competence are assessed, which stakeholders are involved and how the processes are regulated.

  • Our research focuses on European countries only as free cross-border movement of professionals is unique to the European context.

  • We cannot exclude that inter-regional variations were missed because recertification systems were decentralised in some countries, and we explored the national level only.

  • The diversity and ambiguity in terminology (recertification, revalidation, continuing professional development) underline the challenge of comparing various recertification systems.

Introduction

Increased mobility of health professionals can pose potential threats to the quality of care. Suppose, for instance, a high performing, Romanian doctor moves to the Netherlands. There, this person will face a new work environment in a distinct healthcare system with specific quality guidelines and different morbidity patterns, and patient demands. As this new work setting requires specific knowledge, skills and values that differ from the Romanian context and culture, you may wonder: Will this doctor still be competent to deliver high-quality care?

While the problem of safeguarding quality of care across borders is omnipresent, it is particularly pertinent in Europe where the free movement of professionals has long historical and legal roots. Although a European Commission directive has facilitated mobility by providing for international recognition of professional qualifications, it fails to guarantee that doctors actually meet the minimum and context-specific quality standards. To safeguard quality of patient care, regulatory bodies around the world have implemented different systems,1 2 such as recertification systems. Recertification entails lifelong learning and periodic assessment of doctors’ competence and performance through various methods.3 It describes the process designed to promote and demonstrate continuous professional competence.4 More specifically, it requires a formal procedure of assessing and attesting quality of service provided ‘in accordance with established requirements or standards.’5 By renewing initial certification, recertification aims to address any decline in performance as well as to ensure trained doctors’ adaptation to advances in knowledge and technology.6 7 This is particularly important in times of increased publicity over individual failures of medical performance, demands for doctors’ accountability and concerns about patient safety.8

Despite its well-intended aim, recertification harbours two inherent problems. First, current national recertification practices fail to ensure quality of care internationally, as they assess doctors’ competence and performance in accordance with national quality standards. Differences in standards across countries and the absence of international recertification systems may complicate international quality assurance and quality improvement.7 This begs the question of whether such discrete practices can respond to repeated calls for international accountability and transparency.4 Second, although research on assessment of professional competence provided a set of guidelines for assessment criteria to ensure high-quality assessment,9 the question on how to assess doctors’ competence has often turned into a political rather than an educational one,10 potentially impacting on effectiveness of recertification systems.

‘Competence’ is defined as the ability to integrate knowledge, skills and attitudes into a certain context to ensure safe patient care.11 12 This definition suggests to pay balanced attention to multiple competency domains relevant to a doctor, when assessing professional competence.13 Indeed, many scholars and institutions advocate the assessment of medical knowledge, skills, and competencies, such as communication, collaboration and clinical judgement, as well as cultural competence or critical consciousness.14–16 Assessment measures must also be robust and focus on the healthcare system’s needs and outcomes, implying involvement of key stakeholders, particularly patients when evaluating quality of care.17–20 It is furthermore acknowledged that, for each of the competencies, outcomes of different assessment methods must be combined to ensure robust decision-making about professional competence.21 22

To conclude, cross-border quality of care will be promoted if countries share their recertification practices and are willing to critically reflect on quality of assessment processes embedded in recertification procedures.8 23 In the present study, we attempt taking a first step in this direction by identifying different national recertification approaches. The question of the present study, therefore, was what are the key characteristics of recertification systems for doctors of different countries? More specifically, we aimed at exploring use of assessment criteria in design of recertification procedures. We used a collective case study design to describe and compare different national systems. We were particularly interested in the assessment criteria used, if any, and how they were applied. Although recertification is sometimes also coined ‘revalidation’, ‘reaccreditation’ and ‘maintenance of certification’ or used interchangeably with ‘continuing professional development’ in other contexts, this article keeps to the former term. The article builds on previous work on certification but primarily focuses on recertification.

Methods

Study design and case selection

We described and analysed the recertification systems of 10 individual European countries. Each country’s national recertification system represented a single case. We selected our cases using purposeful sampling to reach maximum heterogeneity in terms of geographical spread across Europe, demographics, health professionals’ migration profile and type of healthcare system (table 1).24

Table 1.

Sampling criteria

Sampling criterion Specification of criterion
Geographical spread Include countries of different sizes, demographic make-up, with different cultures and from a range of geographical locations (Northern, Eastern, Southern, Western and Central Europe).
Migration profile and position Include countries that have different levels of health professional migration (inflow and outflow) and rely more or less on foreign doctors; include both ‘junior’ (EU12) and ‘senior’ EU member states (EU15) as indicated by the length of EU membership.
Different healthcare systems Include countries with different structures of healthcare services in terms of how they are financed and covered by the insurance system (publicly, privately or both).

EU2, countries which joined the EU in 2007: Bulgaria and Romania.

EU10, countries which joined the EU in 2004: Cyprus, Czech Republic, Estonia, Hungary, Latvia, Lithuania, Poland, Slovakia and Slovenia.

EU12, EU2 and EU10 countries: Cyprus, Czech Republic, Bulgaria, Estonia, Hungary, Latvia, Lithuania, Poland, Romania, Slovakia and Slovenia.

EU15, countries which were already EU member states in 2003: Austria, Belgium, Denmark, Finland, France, Germany, Greece, Ireland, Italy, Luxembourg, the Netherlands, Portugal, Spain, Sweden and the UK.

EU, European Union.

Based on these criteria, the final study sample included Denmark, Germany, Hungary, Ireland, Poland, Portugal, Spain, Switzerlandi, the Netherlands and the UK (table 2).

Table 2.

Overview of selected countries and their health insurance systems, their coverage and the existence of a gatekeeper system49–57

Country Geographical location Net migration rate (migrants/1000 inhabitants)58 % of foreign-trained doctors, latest yearavailable
24 59 60
Type of health insurance system Financing of healthcare
Denmark North 2.25 5.27 Decentralised, offers universal and nearly free access. Taxation.
Germany Central 1.06 10.26 Mix of compulsory public and voluntary private health insurance; highly decentralised. Statutory insurance, taxation, out-of-pocket payments and private health insurance.
Hungary East 1.34 7.79 National Health Insurance Fund is state owned and offers complete coverage, partly free of charge. Taxation and social health insurance contributions.
Ireland West 3.31 41.6 National Healthcare System, mix of public and voluntary private health insurance. Taxation and supported by copayments for specialist’s treatment from insurance providers.
Poland East −0.47 1.8 Decentralised, mandatory health insurance system. National Health Funds.
Portugal South 2.74 7.74 National Health Service
Private and public insurance schemes plus voluntary private insurances.
Taxation, public and private insurance schemes, and direct payment.
Spain South 7.24 9.4 National Health Service
Private and public insurance schemes.
Taxation and payroll contributions.
Switzerland Central 5.43 27.05 Obligatory, statutory, decentralised insurance system
Federal Office for Social Insurance monitors providers.
Compulsory health insurance premiums and out-of-pocket payments.
The Netherlands Central 1.97 2.13 Mixed model of compulsory social and voluntary private insurance. Health Insurance, taxation and direct payments.
UK West 2.56 28.07 Mix of public and voluntary private health insurance. National Health Service, taxation and national insurance contributions.

Data collection

We collected data on the respective recertification procedures by performing a document analysis for each case in addition to conducting semistructured interviews with one to three representatives from each country.

For the document analyses, we retrieved documents describing national recertification procedures for doctors from the websites of national certification organisations, and translated them into English if needed. The documents included national recertification schemes and regulations, rules and reports of medical education and training, user guidelines, laws and grey literature articles. We focused on documents that clarified rationale, form and procedure, as well as requirements and rewards of each recertification programme.

To validate and corroborate our interpretation of data from document analysis, we conducted one to three semistructured interviews with representatives of each national regulatory body responsible for postgraduate medical education and recertification or the recognition of professional qualifications (eg, international affairs offices) (n=19). These interviewees were directors of professional development and practice, heads of recertification departments, experts on continuing professional development and official secretaries or legal advisers to national medical education offices, medical or scientific societies, accreditation bodies, medical royal colleges, councils, or chambers (table 3).

Table 3.

Number and profile of respondents per country

Country investigated No of interviews
Netherlands 1
Switzerland 2
Germany 3
UK 2
Ireland 2
Denmark 2
Hungary 1
Poland 2
Portugal 2
Spain 2

The first author (CS) conducted all interviews via video or phone, based on an interview protocol adapted from a study on continuing professional development and lifelong learning for health professionals.25 The interview protocol was piloted in the Netherlands. Questions addressed competency frameworks as well as rules and regulations of recertification, asking about regulatory authorities involved, main objective(s), structure, requirements and consequences of compliance or non-compliance. Before the interview, we explained the research purposes to participants and asked them to give informed consent. Interviews were audio taped and lasted 50–90 min, during which notes were taken. Notes were subsequently presented to interviewees to approve or to add information.

Data collection took place from April to September 2016.

Patient involvement

No patients were involved in this research, given our specific aim.

Data analysis

Data analysis spanned a two-step process. First, we analysed the data from the document analyses and interviews to identify and describe key characteristics of each case. We asked at least one interviewee per country to comment on the accuracy and completeness of the described recertification system. We subsequently reanalysed the data, specifically focusing on the application of criteria for high-quality assessment: validity, reliability, educational and catalytic effect.9 14 26 For that purpose, we identified specific strategies used to ensure assessment quality in terms of validity, reliability and educational consequences, for each of the recertification system (table 4).

Table 4.

Strategies embedded in recertification, affecting assessment quality

Criterion Features
What is assessed?
 Programme of assessment Inclusion of competency domain(s) or domain(s) of professional practice (including lifelong learning)
Use of overarching framework (based on needs healthcare system; key domains professional practice)
Assessment and learning aligned with individual needs
Focus on process of care
Focus on patient outcome (including patient satisfaction)
When is it assessed?
 Frequency of recertification cycle Yearly
Every 2–3 years
Every 4–5 years
Every >5 years
No time frame
Who assesses?
 Stakeholders involved in the assessment Individual (self-assessment)
Peers
Employer
Patients
Others
How is it assessed?
 Assessment methods Competence level according to Miller’s assessment pyramid (cognition versus performance)
Self-assessment
Portfolios
Credit collection through course participation
Examinations (standardised)
Simulations
Clinical audits
Multisource feedback
 Regulations Voluntary versus mandatory
Legal versus professional obligation
What are the objectives?
 Assessment goal Quality of care and patient safety
Professional development
Maintenance of doctors’ knowledge and skills
 Consequences of non-compliance Loss of licence
Financial sanctions
Follow-up
Work under supervision
Feedback

These strategies included programme of assessment, assessment goals and methods (ie, authentic and suitable methods which aim at measuring day-to-day performance and professional competence), as well as frequency of assessment (ie, consistent outcomes across measurements and decisions). We also addressed the involvement of different stakeholders including patients, and consequences for learning and development. Self-assessment as tool for lifelong learning and assessment of practice performance were the two major components of recertification considered.27 Finally, we compared recertification systems across cases to identify similarities and differences with respect to use of the aforementioned assessment criteria.

Results

In the following paragraphs, we highlight differences and/or similarities across countries in terms of the purpose, focus, frequency and methods of recertification, and the stakeholders involved in the process. Exact details are provided in table 5, while table 6 outlines the bodies (Medical specialities, Ministries of Health or Medical Authorities) responsible for recertification. The final paragraph provides a synopsis of the most striking results.

Table 5.

Competence assessment in recertification systems of investigated cases

Case Purpose* Focus† Based on competency framework Frequency Assessment methods‡ Who decides on activities to be followed? Stakeholders involved in the assessment How is internal quality of assessment assured?
LLL PP Mandatory (yes/no) After … credits Every … year(s) Individual doctor Employers Doctor him/herself Colleagues Patients Employers
The Netherlands 1, 3 + + + + 200 5 1.4–1.7;
2; 3; 4; 5
+
Switzerland 1, 2 + + + N/A 150 3 1.1–1.7;
2; 3
+ + + N/A
Germany 1, 3 + + N/A 250 5 1.1–1.4; 1.6–1.8 + + Accreditation of CPD providers
UK 1, 2, 3 + + + + ~250 5 1.1–1.4; 1.6; 1.7;
2; 3; 4; 7
+ + + + + Independent assessors, information triangulation, audits
Ireland 3 + + + + 50 1 1.2–1.6;
2
+ + N/A
Denmark 1, 2 + N/A 1 1;
3; 4
+ + + + Local management
Hungary 2 + + N/A 250 5 1.1; 1.2; 1.6–1.8;
4; 5; 6
+ + More credits for CPD activities with examinations
Poland 3 + + N/A 200 4 1.1; 1.2; 1.4–1.7 + + Accreditation of CME providers
Portugal 4 + + N/A N/A 5 4 + + (+) N/A
Spain 4 + + + N/A 3 1.2;
4
+ + + + Organisation’ s quality control

*Recertification purpose: 1. Quality of care; 2. Patient safety; 3. Maintenance of doctors’ knowledge and skills; 4. Career.

†Focus of recertification: LLL, lifelong learning; PP, practice performance.

‡Assessment methods: 1. CPD (1.1 speciality-specific CPD course; 1.2 general CPD course (communication skills); 1.3 individual learning (reading); 1.4 conference attendance; 1.5 teaching; 1.6 research and scientific publications; 1.7 E-learning; 1.8 time spent as visiting professional); 2. clinical audit; 3. appraisal/peer reviews; 4. portfolio; 5. minimum hours of patient contact; 6. mandatory intensive course; 7. significant events.

−, no; +, yes; CPD, continuing professional development; N/A, not applicable.

Table 6.

Regulation of recertification process in the countries under scrutiny

Case Who sets rules for recertification? Potential consequences of non-compliance‡
Medical specialities Ministry of Health Medical Authority* Type of obligation†
The Netherlands Yes Yes Yes 1 (1), 2
Switzerland Yes No No 1, 2 3, 4
Germany No Yes Yes 1, 2 1, 3
UK No No Yes 1, 2 1, 2
Ireland Yes No Yes 1 4, 5
Denmark / / Yes 2 4
Hungary / Yes Yes 1 1
Poland / Yes Yes 1 4
Portugal / / / / 4
Spain Yes / Yes 1 4

*Medical Authority such as the General Medical Council.

†Type of obligation: 1. legal; 2. professional.

‡Potential consequences of non-compliance are: 1. work supervised or suspension of licence; 2. suspension of licence with possibility to restore licence; 3. financial sanctions; 4. no formal consequences/licence for lifetime; 5. follow-up.

All systems uncovered applied to all registered practising doctors, irrelevant of whether they were trained nationally or internationally, as they are automatically enrolled in the national scheme on registration.

Purpose of recertification

As shown in table 5, the purpose of recertification constituted a major source of variance. While several countries aimed to improve quality of care and patient safety, a minority (n=2), essentially those countries where recertification was not mandatory, upheld personal development and career advancement as their primary objective (table 5).

Participation in a recertification programme was voluntary in three countries only, Denmark, Spain and Portugal, though all countries imposed a professional or legal obligation to engage in lifelong learning. Consequences of non-compliance were non-existent in voluntary systems; in the mandatory systems (n=7), however, they varied from financial sanctions (Switzerland and Germany) or work under supervision to suspension of the licence to practice (Germany, the UK, Hungary and partly the Netherlands), with two countries allowing for licence recovery. Finally, one country conferred a lifelong registration on doctors, obviating the need to impose any sanctions in practice (table 6).

Information obtained from interviews confirmed information from documents with the exception of handling of non-compliance: compared with the rules laid down in official documents, interviewees reported a more lenient handling of non-compliance in practice.

Focus of the assessment

As regards focus, almost all recertification systems emphasised the lifelong learning of doctors. Likewise, most systems relied on the collection of a minimum number of credits per year, mostly 50 (n=5), where one credit typically represented 1 hour of learning activity. Although the three voluntary systems did not require credits to be earned for recertification, one did recommend it (Denmark). Such practice was often embedded in a continuing professional development framework as part of a voluntary recertification process. In Hungary, doctors must take a specific course followed by an examination. Generally, they received more credits for courses if these were concluded with an examination. Of the countries that assessed practice performance, only five did so through audits and appraisals or multisource feedback. Four countries evaluated doctors’ individual and team functioning focusing on communication and collaboration skills.

Frequency of recertification

The frequency of recertification and time frame within which requirements must be fulfilled varied widely: some countries had annual appraisals (n=2), others 3-year procedures (n=2), but most of the countries undertook quinquennial assessments (n=5).

Assessment methods

To demonstrate their knowledge and engagement in lifelong learning, doctors in most countries must earn credits, for instance by participating in workshops and national or international conferences, doing individual reading, teaching, writing scientific articles, spending time as visiting doctor and/or e-learning. Denmark assessed performance on the basis of a dialogue between employer and employee who jointly discussed learning needs. The UK counted reflection on significant events, that is, unintended critical events which potentially harmed the patient, to measure patient outcomes. Yet other countries (n=4) used clinical audits, number of complaints, reviews or appraisals and peer reviews to measure processes of healthcare delivery. Finally, some countries deployed portfolios (n=6), clinical audits (n=4) and multisource feedback (n=4) to reflect on individual and team functioning.

Stakeholder involvement

In most cases (n=9), doctors decided which learning activities to take based on their self-assessed learning needs. Several countries, however, also based the assessment of performance outcomes and the process of care on feedback from peers (n=5) or patients (n=2), yet only one country (the UK) demanded involving patients in the assessment regularly.

Synopsis

All things considered, what stood out was that most recertification systems relied heavily on doctors’ self-assessments, attached little weight to patient outcomes, patient involvement and the assessment of practice performance, as well as lacked an overarching competency framework. Only four countries seem to match the content of assessment programmes with evaluation of professional practice. These findings clearly contrast with the aim to ensure quality of care and patient safety most systems pursued. Evaluation of practice performance seems to be a sine qua non, an indispensable condition, for assessment of competence, that is, what doctors actually do in day-to-day practice. Two countries (the Netherlands and the UK), however, did use a more comprehensive system, covering both self-assessment and practice performance through multisource feedback, including patients’ feedback.

Three other countries deserve mention for their apparent distinctness from the rest. Denmark, though not formally requiring continuing professional development, assessed practice performance based on an annual dialogue between doctor and employer. This left little room for individual doctors to self-assess their performance and independently decide on activities to be taken, which was the case in all other countries where the individual doctor was responsible for high-quality patient care. The systems in Spain and Portugal stood out as being career focused: they did not require doctors to engage in lifelong learning and professional development for purposes of patient safety and quality patient care, but rather encouraged the use of a portfolio to enhance chances of promotion.

Discussion

The purpose of this study was to investigate how recertification is organised across different countries. We found substantial differences in recertification requirements and procedures. Moreover, these requirements in many respects seemed to conflict with aims to ensure quality of care and patient safety.

First, we observed that only a few systems included feedback from patients in the assessment. Involving patients in assessing quality of healthcare and doctors’ performance seems inevitable for accountability and transparency purposes.28 Although many patients are needed to obtain reliable evaluations, their involvement in recertification procedures can help respond to public calls for doctors’ accountability.9 Wright et al recommend including data from 34 patient questionnaires and 15 colleague questionnaires to obtain reliable performance evaluation for appraisal purposes.29 Despite the fact that the literature reports peers to give accurate, credible and valid assessments of performance, peer feedback was absent in most systems investigated but is for example employed in some Canadian provinces.9 14 30 31 Use of multisource feedback to assess practice performance, requires high quality and credible feedback to induce reflection on practice.32 Multisource feedback, including patients’ feedback, can be especially effective when the feedback received contrasts with individual perceptions and is facilitated by a mentor or coach.33 A mentor can help to deal with the emotional aspects of the multisource feedback and to structure individual reflection and follow-up.34 Use of multisource feedback and mentoring systems could thus help countries transitioning from a system based on self-assessments to ‘directed’ self-assessments as suggested by Sargeant et al.35

Second, most systems relied on self-assessments and lifelong learning activities doctors selected themselves without attending to external assessment of practice performance. More specifically, by relying on credit accumulation systems that allowed doctors to choose their learning activities,36 it was entirely at the doctors’ discretion to judge their performance and learning needs. There’s strong evidence, however, that several individual and social factors obscure the validity of self-assessments such as age and experience.36 37 Additionally, self-assessments tend to mirror self-confidence and self-efficacy which are not necessarily good measures of doctors’ competence.36 This evidence provides ample ground to question both the effectiveness of recertification systems that rely on doctors’ self-assessments and the autonomy granted to clinicians.17 38 Hence, assessments of competence will become more meaningful when they involve multiple assessors, including patients.

Another deviation from the purpose of recertification constituted the assessment methods used. Whereas activities such as reading written materials, and attending conferences or presentations have been shown to deepen specific knowledge, there is no evidence that such didactic and passive learning interventions alone improve performance and patient outcomes.39–41 A causal link between educational activities and improved patient health status yet remains to be established.42 This casts doubt on the impact of the recertification systems in our study on doctors’ performance. Consequently, our findings reinforce concerns about the validity of recertification procedures and emphasise the need to combine various assessment methods, likely resulting in greater accountability as previously been proven.43 As stated by Forsetlund et al, a combination of multiple media, multiple instructional techniques and multiple exposures can help to induce change in performance towards improved patient outcomes.44

Other non-European countries have experienced similar challenges in implementing adequate assessment methods for recertification purposes.4 31 45 46 Also Australia, the USA and Canada investigate new methods to evaluate competence and practice performance, cautiously moving away from self-assessment.4 31 46

Since medical specialists invest substantial time and money in their professional development, the feasibility, applicability and acceptability of recertification are topics worth exploring in the context of quality assurance. We, therefore, invite future studies into stakeholders’ perceptions of recertification and their effectiveness and impact,47 and also to bring into focus the content and formal aspects of learning activities which, by facilitating its design and implementation, may improve recertification. To shed light on the full picture, we would furthermore welcome studies investigating the feasibility and acceptability of involving patients in evaluating physicians’ competency.

Limitations

Since recertification systems were decentralised in some countries and we explored the national level only, we cannot exclude that inter-regional variations were missed. Moreover, although the interviewees ideally represented at least two different national organisations, interviews were mostly limited to two or three respondents per country. A final and possibly the most complex and intervening limitation constituted the diversity in terminology and language. This may have affected the translation of national concepts into English during the interviews and of written descriptions, potentially causing loss of detail during the analyses. These language differences and ambiguity in terms underline the challenge of comparing various recertification systems.

Practical implications for professional mobility

Defining universal criteria for assessing professional competence will be no easy feat, especially not when considering the differences between national recertification approaches and rising cross-border mobility. Since each system is customised to a specific context, culture and healthcare system, a universal recertification system may neither be desirable nor achievable, as doctors are required to consciously reflect on the local culture, and adapt to the unique features of their work setting and healthcare system.16 To our knowledge, currently there is no requirement or overarching effort in striving towards harmonising recertification processes across countries within the European Union (EU). Its member states have agreed that each individual country will remain responsible for national healthcare affairs, without European regulations interfering. Moving towards a standardised system would however require an EU-wide regulation, which is currently interrupted by those strong nationally regulatory powers. For transparency purposes, however, national bodies and medical societies could share their competency assessment procedures and quality standards, turning a political matter into an educational (and quality assurance) matter.8 Moreover, national bodies can incorporate performance evaluation, involve multiple stakeholders including patients and use other assessments besides clinicians’ self-assessments in their recertification procedures to enhance liability.48 Considering the increasing internationalisation of healthcare, doctors’ cultural competency should also be incorporated into recertification programmes.

Achieving an overarching quality assurance system being an unrealistic goal, we need to have a shared understanding of what are minimum standards for a doctor38 thereby creating a base for international comparison while allowing for local adaptations. This, however, asks for an increased collaboration between countries and understanding of differences inherent to each system and culture. Such standards of training content and certification directives could meet the challenges posed by the free, cross-border movement of professionals, improving patient safety, and enhancing accountability and transparency.

Conclusion

Recertification can help assess and improve knowledge, skills, professional performance and ultimately, patient outcomes. Yet, systems vary widely across countries in terms of being compulsory or not, requirements, patient involvement and consequences of compliance or non-compliance. A shift towards a broader programme of assessment focused on competence assessment and lifelong learning might create a more valid, credible and reliable basis for recertification, meeting growing demands for accountability and transparency.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

i

Although Switzerland is not a member of the European Union, it is part of the European Economic Area and characterised by a high migration rate, and high reliance on foreign-trained doctors, which made it relevant for our study.

Contributors: CS wrote the research plan, collected, cleaned and analysed the data, and drafted and revised the paper. She is the guarantor. All authors were involved in conceptualising the research. MJG analysed the data, and drafted and revised the paper. SM revised the paper. GGUR drafted and revised the paper. FWJMS drafted and revised the paper. EWD analysed the data, drafted and revised the draft paper.

Funding: CS is a PhD student at Maastricht University, on a project funded by the European Respiratory Society. The European Respiratory Society was however not involved in the design or in conducting this research.

Competing interests: None declared.

Patient consent: Not required.

Ethics approval: Ethical approval was obtained from the Netherlands Association for Medical Education (NVMO; file number 669).

Provenance and peer review: Not commissioned; externally peer reviewed.

Data sharing statement: The dataset(s) supporting the conclusions of this article is available from the author on request by emailing the corresponding author.

References

  • 1. Peck C, et al. Continuing medical education and continuing professional development: international comparisons. BMJ 2000;320:432–5. 10.1136/bmj.320.7232.432 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Horsley T, Grimshaw J, Campbell C. Maintaining the competence of Europe’s workforce. BMJ 2010;341:c4687 10.1136/bmj.c4687 [DOI] [PubMed] [Google Scholar]
  • 3. Ahmed K, Khan RS, Darzi A, et al. Recertification: What do specialists think about skill assessment? The Surgeon 2013;11:120–4. 10.1016/j.surge.2012.12.004 [DOI] [PubMed] [Google Scholar]
  • 4. Shaw K, Cassel CK, Black C, et al. Shared medical regulation in a time of increasing calls for accountability and transparency: comparison of recertification in the United States, Canada, and the United Kingdom. JAMA 2009;302:2008–14. 10.1001/jama.2009.1620 [DOI] [PubMed] [Google Scholar]
  • 5. Bach S. International migration of health workers: Labour and social issues. Geneva: International Labour Office, 2003. [Google Scholar]
  • 6. Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med 2005;142:260–73. 10.7326/0003-4819-142-4-200502150-00008 [DOI] [PubMed] [Google Scholar]
  • 7. Ahmed K, Wang TT, Ashrafian H, et al. The effectiveness of continuing medical education for specialist recertification. Can Urol Assoc J 2013;7:266–72. 10.5489/cuaj.378 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Boulet J, van Zanten M. Ensuring high-quality patient care: the role of accreditation, licensure, specialty certification and revalidation in medicine. Med Educ 2014;48:75–86. 10.1111/medu.12286 [DOI] [PubMed] [Google Scholar]
  • 9. Norcini J, Anderson B, Bollela V, et al. Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach 2011;33:206–14. 10.3109/0142159X.2011.551559 [DOI] [PubMed] [Google Scholar]
  • 10. Brightwell A, Grant J. Competency-based training: who benefits? Postgrad Med J 2013;89:107–10. 10.1136/postgradmedj-2012-130881 [DOI] [PubMed] [Google Scholar]
  • 11. Frank JR, Snell LS, Cate OT, et al. Competency-based medical education: theory to practice. Med Teach 2010;32:638–45. 10.3109/0142159X.2010.501190 [DOI] [PubMed] [Google Scholar]
  • 12. Iobst WF, Sherbino J, Cate OT, et al. Competency-based medical education in postgraduate medical education. Med Teach 2010;32:651–6. 10.3109/0142159X.2010.500709 [DOI] [PubMed] [Google Scholar]
  • 13. Mulder H, Cate OT, Daalder R, et al. Building a competency-based workplace curriculum around entrustable professional activities: The case of physician assistant training. Med Teach 2010;32:e453–9. 10.3109/0142159X.2010.513719 [DOI] [PubMed] [Google Scholar]
  • 14. Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA 2002;287:226–35. 10.1001/jama.287.2.226 [DOI] [PubMed] [Google Scholar]
  • 15. Frank JR, The CanMEDS 2005 physician competency framework: better standards, better physicians, better care. Ottawa: Royal College of Physicians and Surgeons of Canada, 2005. [Google Scholar]
  • 16. Kumagai AK, Lypson ML. Beyond cultural competence: critical consciousness, social justice, and multicultural education. Academic Medicine 2009;84:782–7. 10.1097/ACM.0b013e3181a42398 [DOI] [PubMed] [Google Scholar]
  • 17. Epstein RM. Assessment in Medical Education. N Engl J Med Overseas Ed 2007;356 387–96. 10.1056/NEJMra054784 [DOI] [PubMed] [Google Scholar]
  • 18. Horowitz SD. Invited Article: Maintenance of certification: the next phase in assessing and improving physician performance. Neurology 2008;71:605–9. 10.1212/01.wnl.0000323936.44568.a6 [DOI] [PubMed] [Google Scholar]
  • 19. Lipner RS, Hess BJ, Phillips RL. Specialty board certification in the United States: issues and evidence. J Contin Educ Health Prof 2013;33:S20–35. 10.1002/chp.21203 [DOI] [PubMed] [Google Scholar]
  • 20. Miller GE. The assessment of clinical skills/competence/performance. Academic Medicine 1990;65:S63–7. 10.1097/00001888-199009000-00045 [DOI] [PubMed] [Google Scholar]
  • 21. Jamtvedt G, Young JM, Kristoffersen DT, et al. Audit and feedback: effects on professional practice and health care outcomes (Review). Cochrane Libr 2006;4 10.1002/14651858.CD000259.pub2 [DOI] [PubMed] [Google Scholar]
  • 22. Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012;6:Cd000259 10.1002/14651858.CD000259.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Godlee F. European countries need to work together. BMJ 2010;341:c5395 10.1136/bmj.c5395 [DOI] [Google Scholar]
  • 24. Aiken L, Bidwell P, Brugha R, et al. In: Buchan J, Wismar M, Glinos IA, Bremner J. Health professional mobility in a changing Europe: new dynamics, mobile individuals and diverse responses: The European Observatory on Health Systems and Policies, 2014. [Google Scholar]
  • 25. European Commission. EHP Study concerning the review and mapping of continuous professional development and lifelong learning for health professionals in the EU : UK: European Commission, 2015:2008–13. [Google Scholar]
  • 26. Grimshaw JM, Shirran L, Thomas R, et al. Changing provider behavior: an overview of systematic reviews of interventions. Med Care 2001;39:Ii2–45. [PubMed] [Google Scholar]
  • 27. Iglehart JK, Baron RB. Ensuring physicians' competence — is maintenance of certification the answer? N Engl J Med Overseas Ed 2012;367:2543–9. 10.1056/NEJMhpr1211043 [DOI] [PubMed] [Google Scholar]
  • 28. Van Der Wees PJ, Nijhuis-Van Der Sanden MWG, Ayanian JZ, et al. Integrating the use of patient-reported outcomes for both clinical practice and performance measurement: views of experts from 3 Countries. Milbank Q 2014;92:754–75. 10.1111/1468-0009.12091 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Wright C, Richards SH, Hill JJ, et al. Multisource feedback in evaluating the performance of doctors: the example of the UK General Medical Council patient and colleague questionnaires. Acad Med 2012;87:1668–78. 10.1097/ACM.0b013e3182724cc0 [DOI] [PubMed] [Google Scholar]
  • 30. Cervero RM, Gaines JK. The Impact of CME on physician performance and patient health outcomes: an updated synthesis of systematic reviews. J Contin Educ Health Prof 2015;35:131–8. 10.1002/chp.21290 [DOI] [PubMed] [Google Scholar]
  • 31. Dauphinee WD. An International Review of the Recertification and Revalidation of Physicians : McGaghie WC, Suker JR, International best practices for evaluation in the health professions. London: Radcliffe Publishing, 2013:284–6. [Google Scholar]
  • 32. Ferguson J, Wakeling J, Bowie P. Factors influencing the effectiveness of multisource feedback in improving the professional practice of medical doctors: a systematic review. BMC Med Educ 2014;14:76 10.1186/1472-6920-14-76 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Sargeant JM, Mann KV, van der Vleuten CP, et al. Reflection: a link between receiving and using assessment feedback. Advances in Health Sciences Education 2009;14:399–410. 10.1007/s10459-008-9124-4 [DOI] [PubMed] [Google Scholar]
  • 34. Driessen EW, Overeem K, Walsh K, : Oxford textbook of medical education. London: Oxford University Press, 2013:265–84. [Google Scholar]
  • 35. Sargeant J, Mann K, van der Vleuten C, et al. ’Directed' self-assessment: Practice and feedback within a social context. J Contin Educ Health Prof 2008;28:47–54. 10.1002/chp.155 [DOI] [PubMed] [Google Scholar]
  • 36. Davis DA, Mazmanian PE, Fordis M, et al. Accuracy of physician self-assessment compared with observed measures of competence. JAMA 2006;296:1094–102. 10.1001/jama.296.9.1094 [DOI] [PubMed] [Google Scholar]
  • 37. Violato C, Lockyer J. Self and peer assessment of pediatricians, psychiatrists and medicine specialists: implications for self-directed learning. Advances in Health Sciences Education 2006;11:235–44. 10.1007/s10459-005-5639-0 [DOI] [PubMed] [Google Scholar]
  • 38. Schuwirth LWT, Southgate L, Page GG, et al. When enough is enough: a conceptual basis for fair and defensible practice performance assessment. Med Educ 2002;36:925–30. 10.1046/j.1365-2923.2002.01313.x [DOI] [PubMed] [Google Scholar]
  • 39. Davis D, O’Brien MA, Freemantle N, et al. Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? JAMA 1999;282:867–74. [DOI] [PubMed] [Google Scholar]
  • 40. Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine. BMC Med Educ 2006;6:59 10.1186/1472-6920-6-59 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Grant J. The good CPD guide in A practical guide to managed continuing professional development in medicine. 2nd ed London: New York Radcliffe Publishing, 2011. [Google Scholar]
  • 42. Moore DE, Green JS, Gallis HA. Achieving desired results and improved outcomes: integrating planning and assessment throughout learning activities. J Contin Educ Health Prof 2009;29:1–15. 10.1002/chp.20001 [DOI] [PubMed] [Google Scholar]
  • 43. Davis D, Galbraith R. Continuing medical education effect on practice performance: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. Chest 2009;135:42s–8. 10.1378/chest.08-2517 [DOI] [PubMed] [Google Scholar]
  • 44. Forsetlund L, Bjorndal A, Rashidian A, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2009;2:Cd003030. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Newble D, Paget N, McLaren B, et al. and New Zealand: approach of Royal Australasian College of Physicians. BMJ 1999;319:1185–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Drazen JM, Weinstein DF. Considering recertification. N Engl J Med 2010;362:946–7. 10.1056/NEJMe1000174 [DOI] [PubMed] [Google Scholar]
  • 47. Cook DA, Blachman MJ, West CP, et al. Physician Attitudes About Maintenance of Certification. Mayo Clinic Proceedings 2016;91:1336–45. 10.1016/j.mayocp.2016.07.004 [DOI] [PubMed] [Google Scholar]
  • 48. Irvine D. Patients, professionalism, and revalidation. BMJ 2005;330:1265–8. 10.1136/bmj.330.7502.1265 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Simões JAG, Fronteira I, Hernández-Quevedo C. Portugal: Health system review. Health Syst Transit. Belgium: The European Observatory on Health Systems and Policies, 2017. [PubMed] [Google Scholar]
  • 50. Jakubowski E, Busse R. Health Care Systems in the EU - a comparative study : Chambers GR, Luxembourg: European Parliament, 1998. [Google Scholar]
  • 51. Jacobs R, Goddard M. Social health insurance systems in European countries: the role of the insurer in the health care system: a comparative study of four European countries. 2000.
  • 52. Mossialos E, Wenzl M, Osborn R, et al. International profiles of health care systems, 2014. New York, NY: The Commonwealth Fund, 2015. [Google Scholar]
  • 53. Cylus JRE, Findley L, Longley M, et al. United Kingdom: Health system review In: Busse R, Figueras J, McKee M, eds Health Syst Transit: The European Observatory on Health Systems and Policies, 2015. [PubMed] [Google Scholar]
  • 54. McDaid DWM, Maresso A, Mossialos E. Ireland: Health system review In: Busse R, Figueras J, McKee M, eds The European Observatory on Health Systems and Policies. 2009. [Google Scholar]
  • 55. Sagan A, Panteli D, Borkowski W, et al. Poland: Health system review In: Busse R, Figueras J, McKee M, eds Health Syst Transit: The European Observatory on Health Systems and Policies. 2011:1–193. [PubMed] [Google Scholar]
  • 56. Garcıa-Armesto S, Abadıa-Taira M, Durán A, et al. Spain: Health system review In: Busse R, Figueras J, McKee M, eds Health Syst Transit: The European Observatory on Health Systems and Policies. 2010:1–295. [PubMed] [Google Scholar]
  • 57. Gaal P, Szigeti S, Csere M, et al. Hungary: Health system review : Busse R, Figueras J, McKee M, Health Syst Transit, 2011:1–266. [PubMed] [Google Scholar]
  • 58. Anon. Net migration rate: IndexMundi. 2014. http://www.indexmundi.com/g/r.aspx?v=27 (accessed 14 Jul 2016).
  • 59. Health Workforce Migration. Migration of doctors. 2017. http://stats.oecd.org/Index.aspx?QueryId=68336# (accessed 13 Dec 2017).
  • 60. Anon. Estatisticas por País de Formacao 2016. 2016. http://ordemdosmedicos.pt/wp-content/uploads/2017/09/Estatisticas_por_Pa%C3%ADs_de_Formacao_2016.pdf (accessed 13 Dec 2017).

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES