Abstract
Objective
To evaluate the link between the quantity and quality of continuing professional development (CPD) activities completed by family physicians in Quebec and the quality of their practice.
Design
Retrospective analysis of data collected during professional inspection visits (PIVs).
Setting
Quebec.
Participants
Three groups were created from among Quebec family physicians who had been subject to PIVs (peer evaluation) by the Collège des médecins du Québec between 1998 and 2005. Group 1 was composed of physicians who were members of the College of Family Physicians of Canada, which requires participation in 250 hours of CPD in every 5-year cycle. Group 2 was composed of family physicians who were not members of the College of Family Physicians of Canada but who had declared at least 50 hours a year of CPD on their Collège des médecins du Québec annual notice of assessment for the same period. Group 3 was composed of family physicians who had declared fewer than 10 hours of CPD a year.
Main outcome measures
During the PIV, the following characteristics were examined: record keeping, quality and number of hours of CPD activities, and quality of professional practice based on 3 components— clinical investigation, accuracy of diagnosis, and appropriateness of treatment plan and follow-up.
Results
The factors associated with a high quality of practice were privileges in a hospital or local community health centre (institution) and a substantial number of accredited CPD hours (Mainpro-M1, Credit I, or Mainpro-C). The factors associated with a poor quality of practice were advanced age of the physician, absence of privileges in an institution (hospital or local community health centre), and participation in CPD activities that were more informal, such as reading and non-accredited activities (Mainpro-M2).
Conclusion
This study supports earlier research showing that CPD activities of sufficient quality and quantity are correlated with a high quality of professional practice by family physicians.
Résumé
Objectif
Évaluer la relation qui existe entre la quantité et la qualité des activités de formation médicale continue (FMC) effectuées par des médecins de famille du Québec et la qualité de leur pratique.
Type d’étude
Analyse rétrospective des données recueillies au cours de visites d’inspection professionnelle (VIP).
Contexte
Le Québec.
Participants
On a créé 3 groupes parmi les médecins de famille québécois qui avaient subi des VIP (évaluation par des pairs) du Collège des médecins du Québec entre 1998 et 2005. Ceux du groupe 1 étaient membres du Collège des médecins de famille du Canada, lequel exige une participation à 250 heures de FMC durant chaque cycle de 5 ans. Le groupe 2 était composé de médecins qui n’étaient pas membres du Collège des médecins de famille du Canada mais qui avaient déclaré avoir fait au moins 50 heures de FMC par année durant les mêmes 5 années en réponse à l’avis annuel d’évaluation du Collège des médecins du Québec. Le groupe 3 était composé de médecins de famille qui avaient déclaré moins de 10 heures de FMC par année.
Principaux paramètres à l’étude
À l’occasion des VIP, les caractéristiques suivantes ont été évaluées : qualité de tenue des dossiers, qualité des activités de FMC et nombre d’heures consacrées à ces activités, et qualité de la pratique professionnelle évaluée à partir de trois composantes— investigation clinique, justesse des diagnostics, et opportunité du plan de traitement et de suivi.
Résultats
Les facteurs associés à une pratique de haut niveau étaient : le fait d’avoir des privilèges dans une institution (hôpital ou centre local de santé communautaire) et une quantité importante d’heures de FMC accréditées (Mainpro-M1, Crédit 1 ou Mainpro-C). Les facteurs associés à une pratique de bas niveau étaient l’âge avancé du médecin, l’absence de privilèges dans une institution (hôpital ou centre local de santé communautaire) et la participation à des activités de FMC de nature plus informelle, telles que des lectures et des activités non accréditées.
Conclusion
Cette étude confirme les études antérieures qui montrent qu’il existe chez les médecins de famille une corrélation entre des activités de FMC de qualité et en quantité suffisantes, et un haut niveau de qualité de la pratique professionnelle.
Continuing professional development (CPD) includes all of the means used by physicians to maintain and enhance their competencies in order to improve the health of patients.1
For nearly 25 years, educators and professional associations have taken an interest in the effects of CPD activities on clinical performance.2–8 Several studies have attempted to better understand the characteristics of CPD that are associated with better results in the clinical performance of physicians. Davis and colleagues and Mansouri and Lockyer identified a close link between the intensity of the strategies used and their effects on clinical performance.3–6 Thus, CPD centred on interaction and active participation (eg, case discussion, role-play, hands-on practice sessions) would effect changes in the performance of physicians. These changes were less marked for didactic CPD activities limited only to the transmission of knowledge (eg, lectures, seminars). On the other hand, McLeod and McLeod suggest that the ideal approach is a mixture of formal and informal CPD.9
Because it has been demonstrated that didactic-type interventions produce modest results, one would be inclined to believe that their use remains limited. But they are in fact the most used form of CPD.9–11 Given the limited scope of certain educational activities, one might question what motivates physicians and authorities to persist with this type of continuing education or its promotion. Unquestionably, their cost and the ease with which they can be organized are the most likely explanations.5,9 It is also well known that physicians continue to participate in these in order to collect information, to be reassured about the quality of their practice, and to network with colleagues. Although certain types of activities have failed to demonstrate positive results, a number of studies have shown the benefits of interactive and more personalized activities. Therefore, we can expect that physicians who accumulate a substantial number of varied CPD activities will be better practitioners.
The College of Family Physicians of Canada (CFPC) is a national voluntary organization of family physicians that makes CPD mandatory as a condition of membership.12 Considering that CPD is generally the key to maintaining competence, the CFPC resolved to impose a continuing education standard on its members. It holds that by encouraging physicians to perfect their knowledge and skills, Canadian patients will inevitably reap the benefits.
The CFPC has divided CPD activities into 3 broad categories. There are activities that are generally didactic in nature such as conferences, workshops, presentations, or teaching sessions (Mainpro-M1); activities involving reflection on the effects of an educational activity on practice and follow-up (Mainpro-C); and individual activities (no accreditation process needed) such as reading, discussions with colleagues, or the creation of forms to be integrated into patient records (Mainpro-M2). The value of CPD activities is expressed in the form of credits, and practitioners must report 250 hours over a period of 5 years to meet the requirements of the CFPC and keep their status as members. These 250 hours must include a minimum of 125 Mainpro-M1 or Mainpro-C credits, and a maximum of 125 Mainpro-M2 credits.13
Many studies have focused on the influence of CPD-type activities on the practice of physicians. Yet, the link between the type and intensity (number of hours) of CPD activities and the quality of medical practice has never been clearly established. It is estimated that most physicians already practise appropriately and in an up-to-date manner14,15; thus, the effect on practice of a single CPD activity is hard to measure because of what we call the ceiling effect. It is difficult to measure difference when the difference to be measured is very slight. Furthermore, most physicians continue to participate in CPD activities of all kinds so as to be reassured about the quality of their practice. Evaluating the effect of one CPD activity on clinical performance might therefore show no difference if the competence of the participating physicians is already satisfactory.14 Also, most of the instruments used to measure the effects of a single CPD activity on competence or clinical performance focus on changes in behaviour that relate specifically to the learning objectives established for the activity. Changes and improvements that do not relate to these objectives, or changes that result from informal discussions between peers attending the same activity, are often considered a side benefit of the CPD activity and are not formally evaluated.
The relationship between the quantity and quality of CPD activities and the quality of practice has already been addressed incidentally in an earlier article, but without any further analyses.14 The present study intends to examine more specifically the link between the number of hours and the quality (type and relevance) of CPD and the clinical performance of family physicians as measured during professional inspection visits (PIVs), which involve a peer-review process.
METHODS
Subjects
The project was approved by the ethics committee of the Cité-de-la-Santé de Laval in Quebec. The subjects studied were a non-random sample of registered family physicians who had been subject to PIVs between 1998 and 2005, inclusive. The PIV program is a peer-review process for evaluating professional practice based on the candidate’s patient records, as well as a structured chart-stimulated interview.15 The PIVs are included in the regular programs of the Professional Inspection Committee of the Collège des médecins du Québec (CMQ). In order to evaluate the link between CPD activities and quality of medical practice, 3 CPD groups were created. The first group was composed of physicians who were CFPC members who had participated for a 5-year period in the CPD program of the CFPC. All physicians who had received PIVs and who were members of the CFPC were included in the study. The 2 other groups were random samples of physicians paired according to the professional inspection program that had led to their PIVs. The second group was composed of physicians who were not members of the CFPC but who had declared a minimum of 50 CPD hours per year in the 5 years preceding their PIVs on their CMQ annual notice of assessment. This CPD could have consisted of participation in formal group activities (eg, symposia, courses, conferences, lectures, workshops) approved and accredited by the CFPC or by other Quebec accredited CPD organizations (Fédération des médecins omnipraticiens du Québec, Fédération des médecins spécialistes du Québec, Médecins francophones du Canada, Quebec medical schools, and the Royal College of Physicians and Surgeons of Canada) or informal individual or group activities (eg, reading, video learning, Internet learning). The third group included physicians who were not CFPC members and who had declared little (less than 10 hours annually) or no CPD activity for at least 1 year during the 5-year period preceding their PIVs.
Professional inspection visit programs
During the period studied, there were 6 main programs that led to PIVs. These were directed at physicians who were methadone prescribers; those who had graduated more than 35 years ago or who were older than 65 years of age; those who had been the subject of one or more complaints made to the Inquiries Division of the CMQ; those without privileges in hospitals or local community health centres; physicians who were chosen randomly by the Professional Inspection Committee or who had failed their licensing examinations more than twice; and physicians about whom information had been received raising concerns regarding the quality of their practice. A seventh program brought together physicians from different professional inspection programs with small numbers of physicians. This last group included physicians who had changed their professional address more than twice, those who had acted as replacement physicians in remote regions, those who had changed their field of practice, those who had renewed their restrictive licences, those referred by the review committee, those practising cosmetic medicine, and those practising psychotherapy more than 25% of the time, performing therapeutic acts more than 60% of the time, or practising outside of their specialties more than 30% of the time.
Evaluation of practice
During a PIV, particular aspects of medical practice were evaluated using a combination of explicit and implicit criteria to assess patient records and the content of a semistructured interview with the physician visited. The inspectors evaluated and assigned a CPD score to each physician based on the quantity and quality of CPD activities. The quality of CPD activities was assessed mainly in terms of their relevance to the physician’s practice and their potential for interaction or active participation.
The quality of medical record keeping and the physician’s overall quality of clinical practice were also assessed. Overall quality of practice was divided into 3 components: clinical investigation (history taking, physical examination, and investigation plan), accuracy of diagnosis, and pharmacologic and nonpharmacologic treatments as well as patient follow-up. These aspects were evaluated using simple scores (1 = satisfactory, 2 = unsatisfactory, 3 = not evaluated, 4 = not measurable). Recommendations were generally made to the physician after the PIV report was written. The tools used to assess physician performance in PIVs have been shown to be valid and reliable.14,15
Statistical analysis
The data were collected retrospectively from physicians’ files kept in the Practice Enhancement Division of the CMQ. Sociodemographic characteristics (ie, sex, age, country where the medical degree was obtained, year of graduation, and place of practice) and various aspects of the practice of physicians in the 3 groups were compared using χ2 tests or Fisher exact tests, as appropriate. Post hoc pairwise comparisons were also performed among the 3 groups.
The components of quality of clinical practice were also compared among groups using χ2 tests. In order to create a quality score that reflected the overall competence of physicians, a composite score was developed for which 1 point was assigned for each of the 3 components of quality of clinical practice that was evaluated as satisfactory. Accordingly, a physician whose overall clinical practice was judged satisfactory received the maximum of 3 points. A stepwise multiple regression model was applied to this composite score in order to identify the associated variables and their unique contributions. The following independent variables were used: CPD group, age group, sex, country of graduation, PIV program, principal place of practice, and completion of a residency in family medicine. The CPD groups and PIV programs were coded as dummy variables. An ANOVA (analysis of variance) test on main effects without interaction was used to estimate F and mean-square values.
All tests were bilateral and considered statistically significant at an α level of 5%. No correction was made for multiple comparisons.
Professional development activities
For members of the CFPC, CPD activities fall into 2 categories. Mainpro-M1 and Mainpro-C activities are group or individual activities that have been accredited by the CFPC or by one of its provincial chapters. The activities must follow an educational process that includes needs assessment, identification of educational objectives, a learning method adapted to the objectives, evaluation of the activity, and respect for a CPD code of ethics. The other category, Mainpro-M2 CPD activities, includes mainly individual activities that have not been accredited.
For non-members of the CFPC, various Quebec organizations that are authorized and accredited by the CMQ to provide CPD offer accredited activities (credits I). Organizations seeking such authorization must follow an educational process similar to that of the CFPC in order to grant credits for educational activities.
RESULTS
Sociodemographic data
The characteristics of the 3 CPD groups are presented in Table 1. With respect to the age distribution of physicians affiliated with each of the categories, the proportion of physicians younger than 50 years of age was 53% in the first group (CFPC members), 39% in the second group (non-members with CPD), and 26% in the third group (non-members with little or no CPD). The average (SD) age of the first group was 51.7 (13.6) years, compared with 53.9 (9.2) years for the second group, and 58.7 (12.8) years for the third group. The difference with respect to age distribution between the 3 groups was statistically significant (P < .01).
Table 1.
CHARACTERISTICS | GROUP 1, N (%) (N = 70) | GROUP 2, N (%) (N = 77) | GROUP 3, N (%) (N = 68) |
---|---|---|---|
Age group, y*†‡ | |||
• < 40 | 12 (17.1) | 4 (5.2) | 2 (2.9) |
• 40–49 | 25 (35.7) | 26 (33.8) | 16 (23.5) |
• 50–59 | 18 (25.7) | 23 (29.9) | 12 (17.6) |
• 60–69 | 7 (10.0) | 22 (28.6) | 28 (41.2) |
• ≥ 70 | 8 (11.4) | 2 (2.6) | 10 (14.7) |
Sex*† | |||
• Male | 49 (70.0) | 65 (84.4) | 58 (85.3) |
• Female | 21 (30.0) | 12 (15.6) | 10 (14.7) |
PIV program | |||
• Age > 65 y | 12 (17.1) | 13 (16.9) | 19 (27.9) |
• Subject of complaint | 15 (21.4) | 19 (24.7) | 16 (23.5) |
• Concerning information received | 8 (11.4) | 10 (13.0) | 12 (17.6) |
• Office practice (no privileges) | 4 (5.7) | 5 (6.5) | 8 (11.8) |
• Methadone | 16 (22.9) | 14 (18.2) | 2 (2.9) |
• Examination failures or randomly selected | 3 (4.3) | 3 (3.9) | 0 (0.0) |
• Other§ | 12 (17.1) | 13 (16.9) | 11 (16.2) |
Physician’s country of graduation | |||
• Canada | 50 (71.4) | 58 (75.3) | 57 (83.8) |
• Other | 20 (28.6) | 19 (24.7) | 11 (16.2) |
Principal place of practice*† | |||
• Institution | 38 (54.3) | 21 (27.3) | 17 (25.0) |
• Private practice | 32 (45.7) | 56 (72.7) | 51 (75.0) |
Residency in family medicine*†‡ | |||
• No | 17 (24.3) | 49 (63.6) | 57 (83.8) |
• Yes | 53 (75.7) | 28 (36.4) | 11 (16.2) |
CFPC—College of Family Physicians of Canada, CPD—continuing professional development, PIV—professional inspection visit.
Significant difference (P < .05) was observed between groups 1 and 2.
Significant difference (P < .05) was observed between groups 1 and 3.
Significant difference (P < .05) was observed between groups 2 and 3.
Other included physicians who had changed their professional addresses more than twice, those who had acted as replacement physicians in remote regions, those who had changed their fields of practice, those who had renewed their restrictive licences, those referred by the review committee, those practising cosmetic medicine, and those practising psychotherapy more than 25% of the time, performing therapeutic acts more than 60% of the time, or practising outside of their specialties more than 30% of the time.
Most physicians in the study were men (70% in group 1, 84% in group 2, and 85% in group 3). A significant sex difference was observed between groups 1 and 2 and between groups 1 and 3 (P = .03). As for country of graduation, the proportion of physicians who had obtained their medical degrees in Canada was 71% in group 1, 75% in group 2, and 84% in group 3. No significant differences were observed between the 3 groups. There was no statistically significant difference in the PIV program distribution between the 3 groups.
Predictably, most physicians in the first group had completed a residency in family medicine (76%), whereas a minority in the second (36%) and third (16%) groups had done so. This difference was significant between groups 1 and 2, groups 2 and 3, and groups 1 and 3 (P = .001). More physicians (P < .05) in group 1 practised mainly in health care institutions (54%) than in groups 2 and 3 (27% and 25%, respectively).
Quality of practice
Table 2 presents the findings of the evaluation of quality of practice in the 3 CPD groups. During their visits, the inspectors judged that the record keeping was satisfactory for 60% of physicians in the first group, 53% in the second group, and 25% in the third group. The proportion of satisfactory scores linked to the quality (relevance) and quantity of CPD was higher in group 1 (83%) and group 2 (76%), and was clearly absent in group 3 (0%). For these 2 evaluation criteria, a statistically significant difference was noted between group 1 and group 3, and between group 2 and group 3 (P ≤ .001).
Table 2.
CRITERIA | GROUP 1, N (%) (N = 70) | GROUP 2, N (%) (N = 77) | GROUP 3, N (%) (N = 68) |
---|---|---|---|
Quality and quantity of CPD†‡ | 58 (82.9) | 59 (76.6) | 0 (0) |
Record keeping†‡ | 42 (60.0) | 41 (53.2) | 17 (25.0) |
Investigation*†‡ | 54 (77.1) | 46 (59.7) | 27 (39.7) |
Diagnosis†‡ | 55 (78.6) | 54 (70.1) | 33 (48.5) |
Treatment*†‡ | 57 (81.4) | 58 (75.3) | 34 (50.0) |
CFPC—College of Family Physicians of Canada, CPD—continuing professional development.
Significant difference (P < .05) was observed between groups 1 and 2.
Significant difference (P < .05) was observed between groups 1 and 3.
Significant difference (P < .05) was observed between groups 2 and 3.
As for the physicians’ quality of clinical practice, 3 components were evaluated. First, the inspectors checked the quality of the clinical investigation plan (ie, history taking, physical examination, investigations). The investigation plan was considered satisfactory for 77% of physicians in group 1, 60% in group 2, and 40% in group 3. A significant difference was noted between the first and second groups (P = .03), between the first and third groups (P = .001), and between the second and third groups (P = .001). Next, inspectors evaluated the diagnoses that were made; a satisfactory score was given to 79% of the physicians in group 1, 70% in group 2, and 49% in group 3. The difference was statistically significant (P < .05) between groups 1 and 3, as well as between groups 2 and 3. Finally, the treatment plan appeared appropriate for 81% of physicians in group 1, 75% in group 2, and 50% in group 3. A significant difference appeared between the first and second groups (P = .04), between the first and third groups (P = .05), and between the second and third groups (P = .05).
As Table 3 shows, for the evaluation of quality of practice (record keeping, investigation plan, diagnosis, and treatment plan) there was no significant difference between the 3 groups with respect to sex and postgraduate training in family medicine. However, significant differences were observed in the various components of quality of clinical practice according to the physician’s age and principal place of practice.
Table 3.
A) |
SEX
|
|||||
QUALITY-OF-PRACTICE COMPONENT | MALE, N (%) | FEMALE, N (%) | P VALUE | |||
|
||||||
Record keeping | 74 (43.8) | 26 (60.5) | .06 | |||
Clinical investigation plan | 97 (60.2) | 30 (69.8) | .29 | |||
Diagnosis | 108 (73.0) | 34 (85.0) | .15 | |||
Treatment and follow-up | 115 (71.0) | 35 (85.4) | .07 | |||
B) |
RESIDENCY IN FAMILY MEDICINE
|
|||||
QUALITY-OF-PRACTICE COMPONENT | YES, N (%) | NO, N (%) | P VALUE | |||
|
||||||
Record keeping | 51 (42.9) | 48 (53.3) | .16 | |||
Clinical investigation plan | 67 (58.8) | 60 (69.0) | .14 | |||
Diagnosis | 75 (72.8) | 67 (81.7) | .17 | |||
Treatment and follow-up | 79 (69.3) | 70 (81.4) | .07 | |||
C) |
AGE GROUP, Y
|
|||||
QUALITY-OF-PRACTICE COMPONENT | < 40, N (%) | 40–49, N (%) | 50–59, N (%) | 60–69, N (%) | ≥ 70, N (%) | P VALUE |
| ||||||
Record keeping | 13 (72.2) | 42 (63.6) | 21 (40.4) | 17 (30.4) | 7 (35.0) | <.001 |
Clinical investigation plan | 15 (83.3) | 51 (76.1) | 28 (54.9) | 23 (44.2) | 10 (62.5) | .002 |
Diagnosis | 16 (88.9) | 56 (87.5) | 31 (66.0) | 29 (64.4) | 10 (71.4) | .02 |
Treatment and follow-up | 14 (82.4) | 57 (85.1) | 37 (72.5) | 30 (57.7) | 12 (75.0) | .02 |
D) |
PRINCIPAL PLACE OF PRACTICE
|
|||||
QUALITY-OF-PRACTICE COMPONENT | INSTITUTION, N (%) | PRIVATE, N (%) | P VALUE | |||
|
||||||
Record keeping | 47 (63.5) | 53 (38.4) | .001 | |||
Clinical investigation plan | 57 (76.0) | 70 (54.3) | .003 | |||
Diagnosis | 62 (87.3) | 80 (68.4) | .005 | |||
Treatment and follow-up | 64 (87.7) | 86 (66.2) | .001 |
As high-quality clinical practice generally integrates the 3 components of clinical practice, a composite score was obtained by adding 1 point for each of the 3 components of quality of clinical practice (investigation, diagnosis, and treatment plan) that was judged satisfactory. Physicians whose practice was judged unsatisfactory for all 3 criteria received a total of 0 points and those whose practice was satisfactory for all 3 criteria received the maximum allowed of 3 points. Table 4 presents the results of the composite score. Significant differences (P < .05) were observed between groups 1 and 3 and between groups 2 and 3.
Table 4.
GROUP |
PROPORTION ACHIEVING COMPOSITE SCORE,* N (%)
|
MEAN (SD)COMPOSITE SCORE* | MEDIAN COMPOSITE SCORE* | |||
---|---|---|---|---|---|---|
0 | 1 | 2 | 3 | |||
Group 1 (n = 70) | 8 (11.4) | 5 (7.1) | 3 (4.4) | 55 (78.6) | 2.5 (1.1) | 3 |
Group 2 (n = 77) | 16 (20.8) | 8 (10.4) | 10 (13.0) | 43 (55.8) | 2.0 (1.2) | 3 |
Group 3 (n = 68) | 28 (41.2) | 8 (11.8) | 9 (13.2) | 23 (33.8) | 1.4 (1.3) | 1 |
CFPC—College of Family Physicians of Canada, CPD—continuing professional development.
The composite score was obtained by adding 1 point for each of the 3 components of quality of clinical practice (investigation, diagnosis, and treatment plan) that was judged satisfactory.
Table 5 presents the results of a stepwise multiple linear regression analysis showing that little or no CPD activity (ie, being in group 3), private practice without institutional privileges, and age were the 3 most important factors negatively influencing the quality of clinical practice. Physicians who were selected for PIVs through the methadone program clearly demonstrated a better quality of clinical practice. The same regression model was rerun excluding them. The results were similar, showing being in group 3 (β = −0.21), private practice (β = −0.20), and older age (β = −0.18) as the only significant (P < .05) predictors of poor quality of practice.
Table 5.
VARIABLE* | β WEIGHT | P VALUE | F VALUE | MEAN SQUARE |
---|---|---|---|---|
Group 3† | −0.19 | .006 | 9.88 | 13.26 |
Principal place of practice | −0.17 | .01 | 6.15 | 8.25 |
Age of physician | −0.15 | .03 | 5.66 | 7.59 |
Methadone program | 0.14 | .05 | 4.24 | 5.69 |
The following variables were included in the regression model: group (dummy coding), age group, sex, country of graduation, professional inspection visit program (dummy coding), place of practice, residency in family medicine, number of continuing professional development credits or hours in a 5-year period, and methadone program.
Group 3 comprised physicians reporting little or no continuing professional development activity.
DISCUSSION
Our findings show that group 1, composed of CFPC members, had the highest proportion of physicians judged to be satisfactory in terms of the quality and quantity of CPD activities. This group performed better on all the components of quality of practice. Group 2, composed of family physicians who were not members of the CFPC but who had at least 50 hours a year of CPD activities, scored similarly to group 1 for record keeping and diagnosis, and groups 1 and 2 had the same median composite score. Group 3, composed of physicians with little or no CPD activity, had lower scores for all quality-of-practice components.
Group 2 had a CPD activity profile similar to that of group 1, even though physicians in group 2 were a little older. Groups 2 and 3 differed on the basis of their CPD scores, but were similar in terms of PIV program distribution, country of graduation, principal place of practice, and whether or not they completed a residency in family medicine.
Overall, physicians in group 2 obtained better scores than those in group 3 with respect to quality of practice; they were younger and more likely to have completed a residency in family medicine.
Caution is essential in interpreting these findings, as it was difficult to balance the groups perfectly in terms of sex, age, and completion of a family medicine residency. Group 1 was made up of younger physicians, and most practised at least part-time in health care institutions with privileges. They were also more likely to have competed family medicine residency. With respect to the program that led to the PIV, the 3 groups were very similar, except for the methadone program; very few physicians in the methadone PIV program had little or no CPD activity. For physicians in this particular PIV program, the overall quality of practice proved more likely to be satisfactory, but this did not affect the group results.
It seems reasonable to argue that younger physicians working in health care institutions have greater opportunities to be in closer contact with peers and that their CPD activities are complemented by other, more informal, educational and networking activities.
Three characteristics were associated with lower quality of clinical practice: belonging to CPD group 3 (little or no CPD), older physician age, and practising only in private practice without institutional privileges. The most important factor was belonging to group 3, characterized by a small number of hours and poor relevance of CPD activities.
As other authors have underlined, many factors influence quality of practice.16–22 Continuing professional development is an important one. Physicians certified by the CFPC generally work more in hospitals, and they have access to better structured and more relevant continuing education activities. McAuley and colleagues found 3 factors related to poor physician performance: older age, not being a member of the CFPC, and solo practice.19 Choudhry et al discussed the relationship between the number of years of experience and quality of practice.20 Turnbull et al21 and Williams22 reported also that a substantial number of dyscompetent physicians had cognitive difficulties. In the present study, no formal cognitive evaluation of the assessed physicians was done; cognitive impairment might be a confounding factor.
Since July 2007, the CMQ has emphasized CPD activities that are based on a process of self-reflection about one’s practice. Time will tell whether this process has an effect on the quality of medical practice.
This study, which employed an independent and objective evaluation of practice using an evaluation tool with recognized validity and reliability, allowed us to sketch a preliminary portrait of the link between the quantity and quality of CPD activities and the quality of practice of Quebec’s family physicians.
Conclusion
This study enabled us to objectively reaffirm that the quality and quantity of CPD have a positive influence on the quality of medical practice. Furthermore, the physician’s age and degree of professional isolation, particularly with reference to office practice only and not having privileges in a health care institution, are determining factors in the quality of practice.
Acknowledgments
The Collège des médecins du Québec, the College of Family Physicians of Canada, and the Federation of Medical Regulatory Authorities of Canada contributed generously to the funding of this research project.
EDITOR’S KEY POINTS
The College of Family Physicians of Canada requires that its members earn and report a minimum of 250 hours of continuing professional development (CPD) activities in the Mainpro® program over each period of 5 years. This study aimed to assess whether the amount of, and quality or relevance of, CPD was associated with the quality of practice.
Because most physicians already practise appropriately and in an up-to-date manner, it can be difficult to measure the effect on practice of a single CPD activity—it is difficult to measure difference when the difference is very slight. This study examined CPD completed during a 5-year period and assessed physician performance using professional inspection visits. These visits are generally intended for physicians whose quality of practice might be in question for various reasons.
The group of College of Family Physicians of Canada members had the highest proportion of physicians judged to be satisfactory in terms of the quality and quantity of CPD activities, and this group performed better on all the components of quality of practice. The group of physicians with little or no CPD activity had lower scores for all quality-of-practice components.
POINTS DE REPÈRE DU RÉDACTEUR
Le Collège des médecins de famille du Canada exige de ses membres qu’ils effectuent et déclarent un minimum de 250 heures d’activités de formation médicale continue (FMC) du programme Mainpro au cours de chaque période de 5 ans. Cette étude voulait déterminer s’il existe une relation entre la quantité et la qualité ou la pertinence de la FMC et la qualité de la pratique.
Parce que la plupart des médecins pratiquent déjà de façon adéquate et conforme aux données récentes, il peut être difficile d’évaluer l’effet sur la pratique d’une seule activité de FMC - il est en effet difficile de mesurer une très petite différence. Cette étude a examiné la FMC effectuée par des médecins au cours d’une période de 5 ans et évalué leur performance au moyen de visites d’inspection professionnelle. Ces visites visent généralement des médecins dont la qualité de pratique pourrait être remise en question pour diverses raisons.
C’est dans le groupe des membres du Collège des médecins de famille du Canada qu’on a observé la plus forte proportion de médecins pour lesquels la qualité et la quantité des activités de FMC était jugée satisfaisantes et c’est aussi dans ce groupe qu’on observait la meilleure performance dans toutes les composantes de la qualité de pratique. Le groupe de médecins qui avaient peu ou pas d’activités de FMC avaient des scores plus bas dans toutes les composantes de la qualité de pratique.
Footnotes
This article has been peer reviewed.
Cet article a fait l’objet d’une révision par des pairs.
Contributors
All authors contributed to the concept and design of the study; data gathering, analysis, and interpretation; and preparing the manuscript for submission.
Competing interests
Dr Lemire is Executive Director and Chief Executive Officer of the College of Family Physicians of Canada.
References
- 1.Conseil québécois de développement professionnel continu des médecins [website] Montreal, QC: Conseil québécois de développement professionnel continu des médecins; 2006. Available from: www.cemcq.qc.ca/fr/index.cfm. Accessed 2013 Apr 1. [Google Scholar]
- 2.Tamblyn R, Battista R. Changing clinical practice: which interventions work? J Contin Educ Health Prof. 1993;13(4):273–88. [Google Scholar]
- 3.Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. JAMA. 1992;268(9):1111–7. [PubMed] [Google Scholar]
- 4.Davis DA, Thomson MA, Oxman AD, Haynes RB. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995;274(9):700–5. doi: 10.1001/jama.274.9.700. [DOI] [PubMed] [Google Scholar]
- 5.Davis D, O’Brien MA, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A. Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? JAMA. 1999;282(9):867–74. doi: 10.1001/jama.282.9.867. [DOI] [PubMed] [Google Scholar]
- 6.Mansouri M, Lockyer J. A meta-analysis of continuing medical education effectiveness. J Contin Educ Health Prof. 2007;27(1):6–15. doi: 10.1002/chp.88. [DOI] [PubMed] [Google Scholar]
- 7.Marinopoulos SS, Dorman T, Ratanawongsa N, Wilson LM, Asher BH, Magaziner JL, et al. Effectiveness of continuing medical education. Evid Rep Technol Assess (Full Rep) 2007;1(149):1–69. [PMC free article] [PubMed] [Google Scholar]
- 8.Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009;(2):CD003030. doi: 10.1002/14651858.CD003030.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.McLeod PJ, McLeod AH. If formal CME is ineffective, why do physicians still participate? Med Teach. 2004;26(2):184–6. doi: 10.1080/01421590310001643136. [DOI] [PubMed] [Google Scholar]
- 10.Goulet F, Gagnon RJ, Desrosiers G, Jacques A, Sindon A. Participation in CME activities. Can Fam Physician. 1998;44:541–8. [PMC free article] [PubMed] [Google Scholar]
- 11.Harrison C, Hogg W. Why do doctors attend traditional CME events if they don’t change what they do in their surgeries? Evaluation of doctors’ reasons for attending a traditional CME programme. Med Educ. 2003;37(10):884–8. doi: 10.1046/j.1365-2923.2003.01626.x. [DOI] [PubMed] [Google Scholar]
- 12.College of Family Physicians of Canada [website] Mississauga, ON: College of Family Physicians of Canada; 2013. Available from: www.cfpc.ca. Accessed 2013 Apr 1. [Google Scholar]
- 13.College of Family Physicians of Canada [website] Introduction to MAINPRO (maintenance of proficiency) Mississauga, ON: College of Family Physicians of Canada; 2013. Available from: www.cfpc.ca/MAINPRO/. Accessed 2013 Apr 1. [Google Scholar]
- 14.Goulet F, Jacques A, Gagnon R, Bourbeau D, Laberge D, Melanson J, et al. Performance assessment. Family physicians in Montreal meet the mark! Can Fam Physician. 2002;48:1337–44. [PMC free article] [PubMed] [Google Scholar]
- 15.Goulet F, Jacques A, Gagnon R, Racette P, Sieber W. Assessment of family physicians’ performance using patient charts: interrater reliability and concordance with chart-stimulated recall interview. Eval Health Prof. 2007;30(4):376–92. doi: 10.1177/0163278707307924. [DOI] [PubMed] [Google Scholar]
- 16.Rethans JJ, Norcini JJ, Barón-Maldonado M, Blackmore D, Jolly BC, LaDuca T, et al. The relationship between competence and performance: implications for assessing practice performance. Med Educ. 2002;36(10):901–9. doi: 10.1046/j.1365-2923.2002.01316.x. [DOI] [PubMed] [Google Scholar]
- 17.Swanwick T, Chana N. Workplace-based assessment. Br J Hosp Med (Lond) 2009;70(5):290–3. doi: 10.12968/hmed.2009.70.5.42235. [DOI] [PubMed] [Google Scholar]
- 18.Durning SJ, Artino AR, Holmboe E, Beckman TJ, van der Vleuten C, Schuwirth L. Aging and cognitive performance: challenges and implications for physicians practicing in the 21st century. J Contin Educ Health Prof. 2010;30(3):153–60. doi: 10.1002/chp.20075. [DOI] [PubMed] [Google Scholar]
- 19.McAuley RG, Paul WM, Morrison GH, Beckett RF, Goldsmith CH. Five-year results of the peer assessment program of the College of Physicians and Surgeons of Ontario. CMAJ. 1990;143(11):1193–9. [PMC free article] [PubMed] [Google Scholar]
- 20.Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med. 2005;142(4):260–73. doi: 10.7326/0003-4819-142-4-200502150-00008. [DOI] [PubMed] [Google Scholar]
- 21.Turnbull J, Cunnington J, Unsal A, Norman G, Ferguson B. Competence and cognitive difficulty in physicians: a follow-up study. Acad Med. 2006;81(10):915–8. doi: 10.1097/01.ACM.0000238194.55648.b2. [DOI] [PubMed] [Google Scholar]
- 22.Williams BW. The prevalence and special educational requirements of dyscompetent physicians. J Contin Educ Health Prof. 2006;26(3):173–91. doi: 10.1002/chp.68. [DOI] [PubMed] [Google Scholar]