Abstract
BACKGROUND
Increasing the attractiveness of primary care careers is a key step in addressing the growing shortage of primary care physicians. The purpose of this review was to (1) identify interventions aimed at increasing the proportion of undergraduate medical students choosing a primary care specialty, (2) describe the characteristics of these interventions, (3) assess the quality of the studies, and (4) compare the findings to those of a previous literature review within a global context.
METHODS
We searched MEDLINE, EMBASE, ERIC, CINAHL, PsycINFO, The Cochrane Library, and Dissertations & Theses A&I for articles published between 1993 and February 20, 2015. We included quantitative and qualitative studies reporting on primary care specialty choice outcomes of interventions in the undergraduate medical curriculum, without geographic restrictions. Data extracted included study characteristics, intervention details, and relevant outcomes. Studies were assessed for quality and strength of findings using a five-point scale.
RESULTS
The review included 72 articles reporting on 66 different interventions. Longitudinal programs were the only intervention consistently associated with an increased proportion of students choosing primary care. Successful interventions were characterized by diverse teaching formats, student selection, and good-quality teaching. Study quality had not improved since recommendations were published in 1995. Many studies used cross-sectional designs and non-validated surveys, did not include control groups, and were not based on a theory or conceptual framework.
DISCUSSION
Our review supports the value of longitudinal, multifaceted, primary care programs to increase the proportion of students choosing primary care specialties. Isolated modules or clerkships did not appear to be effective. Our results are in line with the conclusions from previous reviews and add an international perspective, but the evidence is limited by the overall low methodological quality of the included studies. Future research should use more rigorous evaluation methods and include long-term outcomes.
Electronic supplementary material
The online version of this article (doi:10.1007/s11606-015-3372-9) contains supplementary material, which is available to authorized users.
KEY WORDS: Medical education-undergraduate, Primary care, Systematic reviews, Workforce
BACKGROUND
The field of primary care remains an unattractive career choice for many medical students. Medical schools have made efforts to increase student exposure in the area of primary care, but the proportion of graduates choosing a primary care career has not increased. Indeed, in the United States, the proportion of graduates choosing a primary care specialty fell from 60.7 % in 1997 to 42.1 % in 2006.1 Similarly, between 2005 and 2009, only 28 % of recent graduates in the United Kingdom planned to go into general practice.2 The primary care physician is defined as a specifically trained physician providing first-contact care, taking continuing responsibility for the patient’s care, and dealing with all health problems.3, 4 Depending on the country, this includes general practitioners or family physicians, and may also include general pediatricians and general internists.
Research has highlighted that health systems with a strong primary care base are associated with improved health outcomes and a more equitable health distribution among populations.5 However, generalists make up only about 30 % of all physicians in OECD (Organisation for Economic Co-operation and Development) countries,6 although proportions vary, from 50 % in Australia and Canada, to around 30 % in the United Kingdom, to 12 % in the United States (or approximately one-third if general internists and general pediatricians are counted as well7). General pediatricians make up a small proportion, ranging from under 2 % (Australia) to almost 10 % (United States).6 In order to address the shortage in primary care physicians, medical schools must provide motivation for students to choose a career in primary care.
Specialty choice is complex, influenced by gender, career motivation and life goals,8 as well as attitudes about social responsibility.1 In a review of the North American literature published through 1993, Bland, Meurer and Maldonado identified student- and curriculum-related determinants of primary care specialty choice as described in their paper published in 1995 (Appendix 1).9 In a separate paper in 1996, they published a detailed description of the quality of studies on this topic,10 concluding that “research in this area predominantly uses the weaker study designs and uses few instruments with known reliability or validity”. Based on these findings, the authors suggested strategies to increase the percentage of primary care physicians and to improve research in this field (Appendix 2).
Three other literature reviews have examined primary care specialty choice and have reached similar conclusions (Appendix 1),11–13 but were also limited to North American studies. Since Bland and colleagues’ comprehensive review, medical schools around the world have developed new initiatives in recognition of the need to increase students’ exposure to primary care. Nevertheless, the overall proportion of students choosing a primary care career has not risen. Therefore, we conducted a systematic review of the literature published within the last two decades, with the aim of providing an update of our knowledge about the effectiveness of curricular interventions on primary care specialty choice. We included studies from across the world in order to explore the impact of interventions in a global context.
We sought to answer the following questions:
Which interventions in undergraduate medical education can increase the proportion of students choosing a primary care specialty?
What are the characteristics of successful interventions, and which factors can explain their impact?
What is the state of the quality of the published literature in this area, and how has it evolved since the recommendations published in 1996?
METHODS
We used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement to guide the reporting of our review,14 and we registered our protocol in the PROSPERO (international prospective register of systematic reviews) database (record number CRD42014009422).15
Definitions
According to the most frequently used definitions of primary care, we included the specialties of family medicine, general practice, general internal medicine, and general pediatrics.
Search Strategy
We searched MEDLINE (PubMed), EMBASE, ERIC (EBSCO interface), CINAHL (EBSCO interface), PsycINFO (EBSCO interface), The Cochrane Library, and Dissertations & Theses A&I on February 20, 2015 for papers published since January 1, 1993. We developed a search strategy for each database by combining the key terms “undergraduate medical student”, “medical education”, “specialty choice”, and “primary care”, as well as numerous synonyms and subject headings. Our full search strategy for MEDLINE is presented in Appendix 3. Adjusted search strategies for the other databases are available on request. We also scanned the reference lists of included studies for relevant papers.
Eligibility Criteria
We included original research on interventions focusing on primary care and targeted at medical students, including curricular components, longitudinal interventions, special curriculum tracks, and extracurricular interventions. We only included studies reporting outcomes related to career choice (career intentions during medical school, specialty choice at graduation, and final practice choice). We included studies published in any language, provided they had an abstract in English. We excluded studies of osteopathic medical students, since osteopathy as practiced in the United States does not exist in other countries, where osteopathy is considered an allied health profession.16
Study Selection Process
One reviewer (EP) performed the search, imported the potentially relevant citations into a reference management program (EndNote version X5.0.1; Thomson Reuters, New York, NY, USA) and discarded duplicates. We used a two-stage process to select studies. All titles and abstracts were screened for exclusion criteria by two reviewers (EP and RT, see "Acknowledgements"), and were included for full-text review if chosen by at least one researcher. Two authors (EP and CC) then independently reviewed all available full-text articles for inclusion criteria. Discrepancies were resolved through discussion with another reviewer (DH).
Data Extraction
Two reviewers (EP and DH) developed a data extraction sheet and pilot-tested it on three articles. EP then extracted data from each article, including study, sample and intervention characteristics, and outcomes relevant for the review. DH independently extracted data from a random sample of six articles to confirm the reliability of the data extraction sheet.
Quality Assessment
All studies were assessed for quality using two scores (rated from 1 to 5) according to published recommendations,17 reflecting the methodological quality of the study and the quality of the information provided in the article. We also graded each article for strength of findings on a scale from 1 to 5 (see Table 1 for details of scores).18
Table 1.
Scale | Components of scale |
---|---|
Study quality 1 = low 5 = high |
Appropriate research design Attention to ethical concerns Adequate recruitment of participants Adequate data collection methods Appropriate analyses |
Quality of information provided in the published article 1 = low 5 = high |
Statement of study objectives and research questions Sufficient information on sampling, data collection and possible bias Detailed description of analysis |
Strength of findings | 1 = no clear conclusions can be drawn 2 = results are weak or ambiguous, but there appears to be a trend 3 = conclusions can probably be drawn from the results 4 = results are clear and very likely to be true 5 = results are unequivocal |
Overall quality rating | High quality = sum of the three scores ≥ 10 and no score < 3 Low quality = sum of the three scores < 10 or any score < 3 |
Five reviewers (EP, DH, HM, MN, and NJP) pilot-tested the quality scales on six articles. EP then graded all studies, and two authors (DH, HM) each graded half of the studies to ensure inter-coder reliability. Differences of opinion arose for six studies and were resolved by discussion. We did not exclude any articles from the review based on the quality grading, but we recorded the most common threats to quality.
Analysis and Synthesis of Included Studies
We could not identify sufficiently large and homogeneous groups of studies to permit quantitative synthesis given the variability in interventions and outcome measures. We therefore synthesized the results narratively, categorizing them into similar types of interventions.
RESULTS
Study Selection
Our search strategy yielded 2333 unique citations (Fig. 1), of which 68 articles met our inclusion criteria. We identified four additional articles from reference lists of included papers.
Characteristics of Included Studies
The 72 articles described 66 different initiatives.19–90 A summary of the interventions and their impact is provided in Appendix 4. A more extensive summary of outcomes is available in Appendix 5.
Table 2 provides a summary of the characteristics and methods of the included studies. All articles were written in English, with the exception of one article published in German.39 Only 12 % of studies published from 1993 through 1999 took place outside the United States, but this proportion increased to 52 % of studies published from 2000 through 2014. Most studies (n = 65) used quantitative methods. Surveys were the most common data collection method. None of the papers mentioned a conceptual framework or underlying theory for the study.
Table 2.
Characteristic | N (% of 72) |
---|---|
Location | |
United States | 41 (57) |
Europe | 11 (15) |
Australia and New Zealand | 11 (15) |
Canada | 4 (6) |
Asia | 5 (7) |
Single-/multi-institution | |
Single medical school | 61 (85) |
More than one medical school | 11 (15) |
Type of intervention | |
Compulsory clerkships | 28 (39) |
Longitudinal programs or special curricula | 26 (36) |
Electives | 10 (14) |
Interest groups | 3 (4) |
Student-run free clinic | 3 (4) |
Other* | 2 (3) |
Objective of intervention | |
Promotion of primary care | 35 (48) |
Promotion of rural practice | 18 (25) |
Promotion of primary care in a rural context | 7 (10) |
Promotion of care for underserved populations | 4 (6) |
Aim of intervention not specified | 8 (11) |
Timing of the evaluation† | |
Follow-up only | 29 (40) |
Pre and post | 12 (16) |
Pre, post and follow-up | 10 (14) |
Long-term repeated follow-up | 7 (10) |
Post and follow-up | 5 (7) |
Post | 4 (6) |
During | 3 (4) |
Pre and follow-up | 2 (3) |
Comparison | |
Studies using a control group | 30 (42) |
Random allocation of students to intervention | 4 (6) |
Data collection method | |
Survey, unvalidated (or validation not specified) | 39 (54) |
National Residency Matching Database | 19 (26) |
Other databases | 10 (14) |
Survey, validated (including state-wide questionnaires) | 8 (11) |
Physicians’ Associations’ databases | 7 (10) |
Focus groups | 5 (7) |
Semi-structured interviews | 4 (6) |
Essays | 1 (1) |
Studies using more than one data collection method | 15 (21) |
Methods of quantitative data analysis | N (% of 65) |
Inferential statistics, unadjusted | 31 (48) |
Descriptive statistics only | 21 (32) |
Inferential statistics, adjusted for more than 3 independent variables | 7 (11) |
Inferential statistics, adjusted for 1 to 3 independent variables | 6 (9 ) |
*Includes an integrated residency program and an intercalated research degree.
†Indicates when data were collected: follow-up (at a point beyond the immediate completion of the intervention); pre (before or at the beginning of the intervention); post (immediately following the end of the intervention); long-term repeated follow-up (longitudinal database follow-up of students and/or graduates over several years); during (during the course of the intervention)
Quality Ratings of Included Studies
Twenty-four studies achieved a high quality score (defined in Table 1). The most common threats to quality were the risk of confounding due to the absence of adjusted statistical analyses, risk of selection bias (through selective admission of students to the intervention), risk of recall bias (in surveys including retrospective items), small sample size, and the lack of a control group (see Appendix 5). The distribution of study quality by regions, intervention type and impact is presented in Table 3.
Table 3.
Intervention type | Impact* | United States | Europe‡ | Other§ | |||
---|---|---|---|---|---|---|---|
High quality studies† | Low quality studies | High-quality studies | Low-quality studies | High-quality studies | Low-quality studies | ||
Compulsory clerkships | Positive | ●●● | ○○○ | ● | ○○○○ | ○○○○○○○ | |
None, negative or unknown | ▲▲ | △△△ | ▲ | △ | ▲▲▲ | ||
Longitudinal programs | Positive | ●●●●●●●●● | ○○○○○○ | ● | ○ | ||
None, negative or unknown | ▲ | △△ | △△△△△△ | ||||
Electives | Positive | ● | ○○○○ | ○ | ○ | ||
None, negative or unknown | △△ | △ | |||||
Other interventions | Positive | ○○○ | ● | ○ | |||
None, negative or unknown | △△ | △ |
*Impact of the intervention on the relevant outcome (see Appendix 4, Outcome and Impact). For studies including more than one outcome, the most relevant was taken (order of relevancy: final career choice > career choice at graduation > career intention)
†Circles symbolize studies with a positive impact; triangles symbolize studies with no impact, unknown impact or negative impact on the most relevant outcome. ●/▲ = high-quality studies (as defined in Table 1), ○/△ = low-quality studies
‡Includes studies from The Netherlands, Spain, United Kingdom, and Germany
§Includes studies from Australia, New Zealand, Canada, Japan, Pakistan, and Hong Kong
Impact of Interventions on Primary Care Specialty Choice
Compulsory Primary Care Clerkships
The duration of the clerkships varied from a few days to 12 weeks. The majority (n = 23) took place in ambulatory settings; one clerkship took place in a hospital and four in mixed settings. The most frequently described outcomes were students’ career intentions immediately after the clerkship, with 17 studies reporting a positive effect (Table 3).19,23,28,30–33,36–39,41,45 One study surveying students after three different clerkships (general practice, internal medicine and surgery) suggested that the positive effect of clerkships may not be specific to primary care.23 The impact on students’ career choices at graduation varied across studies. Most interventions with a positive impact were clerkships in family medicine22,26,30,31,39 or general practice,19,32,34 as opposed to other types of clerkships (such as community placements). Only one study included a long-term outcome—8 years after a general practice placement, physicians’ attitudes were still positively influenced—but this was unrelated to final career choices.25 Outcomes did not differ according to the timing of the clerkship in the curriculum (preclinical versus clinical years, final versus penultimate year).
Some studies suggested that the impact of clerkships depended on their intrinsic qualities, such as student perception of educational value,22 student satisfaction with attending physicians and the quality of teaching,38 or the specialty of teaching physicians.28 In a small qualitative study, graduates stated that contact with family physician role models and the opportunity to see the diverse nature of work in family practice had been important experiences influencing their specialty choice.44
Longitudinal Programs
Of 21 different programs (described in 26 papers), 15 were primary care courses added to the conventional curriculum.49–53,55–59,63–66,68–72 The remaining six programs were special curricula or medical schools focusing on primary care and/or rural health.47,48,54,60–62, Contrary to the studies on clerkships, the most frequently studied outcomes of longitudinal programs were career choices after graduation (n = 15). Of these, seven programs had a higher proportion of graduates choosing primary care compared to traditional graduates.
All programs but one67 included clinical placements. With one exception,72 all high quality studies were from the United States, and most of them had a positive impact (Table 3). Components of these programs included longitudinal preclinical preceptorships,47,49,50 family medicine faculty advisors,52 clinical rotations at rural or regional sites,47,48,50,52,54 workshops or seminars on primary care,48–50 and community-based projects.50 Most of them also recruited students according to predictors of career choice previously described in the literature, including the students’ childhood community and interest in primary care.47,50,52,54
Most programs (n = 19) were offered to students on a voluntary basis, or used specific recruitment and admission procedures to select students interested in primary care, thus introducing a potential selection bias. The majority of studies comparing career choices of program participants to non-participants found that participants were more likely to choose primary care specialties. However, the effect of the selection process could not be separated from the impact of the program itself. Only two studies reduced selection bias by randomly choosing program participants among interested students. One found a significant association between program participation and residency choice,49 whereas the other suggested that the effect of preexisting interest was a stronger predictor of specialty choice.56 One study found an additive effect of a preclinical curriculum and a clinical longitudinal preceptorship on students’ choice of primary care specialty.47
Two qualitative studies explored student attitudes in community-based curricula. In the first, students commented on persistent negative preconceptions about general practice, but stated that good-quality attachments to general practitioners were able to reverse these negative attitudes.72 The quality of clerkships was rated highly when they offered opportunities to see a diverse mix of patients, to have interactive experiences, and to be in a practice team that made them feel welcome. The other study took place in the context of a state-mandated initiative.71 Students felt that primary care was imposed on the school by outside agencies, and that medical school faculty were censored and not allowed to promote subspecialty careers. They also felt unable to obtain unbiased career counseling.
Electives
The duration of electives varied from 3 days to 8 weeks, and most (n = 9) included clinical primary care experiences. Five studies compared participants to non-participants. Of these, three studies found participants more likely to choose a primary care specialty than non-participants.73,74,81 Only one study included a measure of pre-existing interest in primary care, for which the authors found no difference between the two groups.76 Five studies used before-and-after questionnaires to measure the impact of the elective, without using control groups. Three of these studies found that the elective had a positive influence on students’ attitudes towards a career in primary care.75,80,82
Interest Groups
Three papers described student-led interest groups, offering a range of activities for students interested in family medicine or primary care. One study found that students participating in an interprofessional primary care interest group were more likely than non-participants to choose a primary care residency.83 The other two studies suggested a positive influence of a family medicine interest group on student interest in family medicine, but could not ascertain that the group actively influenced career choice.84,85
Student-Run Free Clinics
Participation in a student-run free clinic was found to increase students’ interest in primary care,87 but did not influence specialty choice.86,88
Integrated Residency Program
One paper described an integrated residency in general internal medicine, combining the requirements of the last year of medical school and the first year of residency.89 Although a large proportion of participants chose to pursue general internal medicine, the study was too small to allow firm conclusions.
Participation in Primary Care Research
Jones and colleagues interviewed students undertaking a year-long intercalated research degree in primary care.90 The course did not change students’ career intentions, as most of them were already committed to general practice, but students perceived that the course extended their skills and reinforced their career choice.
DISCUSSION
Twenty years after the last comprehensive literature review, as reported by Bland and colleagues, our main conclusions are similar to those in their publication: longitudinal programs are the only strategy that significantly increases the proportion of medical school graduates choosing a primary care specialty, as illustrated by several studies in our review that reported on long-standing longitudinal programs. Most of these programs have been focused within a rural context in the United States and Australia, where primary care physician shortages are an important issue. We found no reports on similar interventions in Europe or other parts of the world (with the exception of one medical school for rural practice in a Japanese study21). Still, primary care physician shortages have developed in several European countries,91 and remain unresolved in emerging countries such as China, India and South Africa.6 Medical schools around the world, therefore, could be inspired by some of these enduring American and Australian programs.
We found conflicting evidence on the impact of compulsory clerkships. They often positively influenced students’ attitudes about primary care, but without affecting career choice. Interestingly, most clerkships with a positive impact were in family medicine or general practice, as opposed to those, for example, in general internal medicine or rural practice. This resonates with Bland and colleagues’ finding that family practice is the only primary care discipline in which a clerkship is correlated with specialty choice. The variety of clerkships in our review explains the fact that our findings are less clear-cut, although they suggest that clerkships can help students in clarifying the role and content of primary care practice, and may act to counterbalance negative preconceptions towards primary care. Electives may further strengthen the interests of individual students and help clarify future career pathways.92
The State of Quality of the Studies in Our Review
We found that the quality of the specialty choice literature had not improved during the last two decades. Our findings reaffirm some of the major threats to quality that had previously been noted, such as the frequent use of instruments without known reliability or validity and the use of study designs at greater risk of bias.10 Observational studies are rarely useful for evaluating initiatives, as the impact of other influences is difficult to estimate.93 Conceptual frameworks are helpful for formulating research questions and discussing generalizability,94 yet none of these were mentioned in any of the studies in our review. Only a minority of studies included several independent variables in their analyses, despite the fact that many influencing factors have been described in the literature, such as gender, background and parental income. The recommendations published in 1996 are therefore still relevant for medical education researchers today. Based on our findings, we suggest several additions to these recommendations (Table 4).
Table 4.
Recommendations of Meurer, Bland and Maldonado (see Appendix 2 for details)10 | Specific recommendations based on findings of the present review |
---|---|
1. Develop and/or identify reliable and valid instruments (…) | Whenever possible, use instruments with known validity. Reflect on possibilities to measure outcome variables related to career choice: - Objective vs. subjective measurements, - Career intentions vs. career choice at graduation vs. final career choice. |
2. Use consistent definitions of primary care and of specialty choice | Be aware of variability in definitions of primary care specialties across countries, and specify the definition used in the context of the study. |
3. Encourage researchers to use a model or theory (…). Researchers should include all the many variables they believe influence specialty choice (…). 6. Conduct further research on the Bland–Meurer model and alternative causal models. |
Using a model or framework that includes all known variables will help formulate research questions, justify the rationale for the study, and discuss generalizability. Assess these variables with valid instruments. Use appropriate statistical methods to adjust for as many of these variables as possible. |
4. Use experimental designs whenever possible. 5. (…) use a longitudinal rather than a retrospective approach. |
Consider using stronger study designs: - Use appropriate control groups, and randomization if possible. - Favor longitudinal approaches. - Consider building program-specific databases to evaluate long-term outcomes. - Avoid uncontrolled before-and-after surveys, as observed changes are often difficult to attribute to the intervention because of confounding by other influences. |
Strengths and Weaknesses of the Review
Our review adds a global perspective to the previous specialty choice reviews. Although a majority of studies are still produced in the United States, international publications have increased since 2000. These studies detail initiatives in diverse contexts but also introduce greater heterogeneity. The clerkships, for example, are varied in their duration, setting, and content. This limits their comparability, and may explain some of the contradictory findings across studies. Another explanation is the insufficient use of optimal study designs, threatening the internal and external validity of many of the included studies. The global perspective adds further difficulties, including the various definitions of primary care and variations in the duration of medical education. These issues highlight the difficulties that medical schools may encounter in implementing evidence-based interventions within their own specific context.
We preferred a general score over a strict point-based scoring system for evaluating the quality of the studies. Although this score could be viewed as more subjective, we limited this risk by pilot-testing the score within the review group and by having all articles graded by at least two authors, achieving good reliability. Contrary to previous reviews, we did not exclude studies based on their quality score, but preferred to critically present the full scope of the literature.
Our review has further limitations. It was limited to the pre-graduate medical curriculum, and therefore we cannot draw conclusions regarding the impact of political and other contextual influences. Although we searched several databases, including an educational resource, we did not search further for grey literature, and our search was limited to published papers. We excluded ten papers because we could not retrieve the full-text version. However, we read their abstracts and could not identify findings that would have added evidence.
Implications of the Review
Our findings suggest that longitudinal programs are the most effective for promoting primary care, yet clerkships remain the most frequently described intervention. Building on Bland and colleagues’ recommendations, and based on our findings, we provide updated recommendations for medical educators wishing to make changes to strengthen primary care in their curriculum (Table 5). The impact of any program depends on its quality, which is closely related to preceptors’ teaching behaviors. Good precepting includes actively involving students in patient assessment, giving feedback, and spending time teaching.95 We also encourage medical schools to discuss selection strategies and career support, which must remain unbiased despite our will to promote primary care.96 Although our review is limited to pre-graduate medical education, the broader context of cultural aspects, political influences and financial incentives must be considered. Educational efforts should not be expected to increase the number of primary care physicians if primary care practice is not encouraged within the medical system, as suggested by some of the studies in our review.21,35,41,43,46
Table 5.
Recommendations by Bland, Meurer and Maldonado (see Appendix 2 for details)9 | Recommendations based on the findings of the present literature review | Examples from the present review |
---|---|---|
7. Establish required longitudinal primary care experiences. 9. Establish a course on the health care needs of society and the physician’s role. |
Establish longitudinal primary care programs, combining diverse learning experiences. | Successful programs include the following components: - Preclinical preceptorship: repeated sessions in a primary care physician’s office - Lectures or seminars on population-based health - Clinical clerkships in family medicine or general practice - Community-based research or public health project work - Electives for interested students |
5. Use recruitment and selection processes that are most likely to attract students who will choose primary care careers. 3. Change admission policies to favour students who are interested in primary care and to give weight to student characteristics likely to predict future primary care career choices. 4. Change the composition of admission committees (…) |
Discuss and reflect on selection strategies and admission criteria. Consider including evidenced-based personal criteria in addition to academic performance. |
Personal characteristics known to increase the likelihood of students choosing primary care careers include: - Pre-existing interest in primary care and community-based health care - Type of community where students have been raised |
8. Establish required third-year family practice clerkships. | Establish high-quality clinical clerkships in general practice or family practice. Whenever possible, include the clerkship in a longitudinal program (see above). Be aware of the possible negative impact of low-quality clerkships. |
Elements defining high-quality clerkships include: - Active, hands-on experiences (as opposed to “sitting in the corner watching”) - A good relationship with the preceptor and the practice team (“feeling welcome”) - The opportunity to see a variety of patients and to be able to follow them over time - Structured teaching and good-quality feedback from preceptors |
10. Establish a career counseling program, including formal education on key characteristics of specialties. | Offer unbiased career counseling and support, helping students make their own choice. Be aware that too much political support for primary care may have negative effects if students feel that primary care is imposed on them. |
Primary care career support can be offered through formal or informal means: - Primary care faculty advisors or mentors - Family medicine or primary care student interest groups |
1. Develop academically credible departments of family practice, general internal medicine, and general pediatrics. 2. Systematically attend to changing medical schools’ culture to value primary care. 12. Request the federal government, state governments, and health care organizations to allocate significant dollars (…) |
Consider the broader context before implementing major curricular changes, including the political and cultural context, postgraduate education and financial incentives. | Successful primary care programs and special medical schools include a strong institutional mission for promoting primary care. |
11. Encourage medical schools to take an inquiry approach to education (…) | Use good-quality research to evaluate programs, and share the outcomes with others. | See recommendations for research in Table 4. |
Conclusions and Recommendations for Future Research
Our findings suggest a need to develop multifaceted strategies organized in coherent longitudinal programs in order to increase the proportion of students who wish to become primary care physicians. We confirm the main findings of a review published two decades ago, whilst adding a global perspective. We also note that the quality of the research has not improved since the last comprehensive review. However, some literature demonstrates that it is possible to conduct controlled experimental studies to evaluate initiatives. It is essential to conduct high-quality research to evaluate new programs and to share the outcomes so that others can replicate successful initiatives. We encourage medical educators to be inspired by Bland, Meurer and Maldonado’s recommendations, which remain highly relevant two decades after their publication, and which we have updated. Last but not least, we must not forget that even a well-designed primary care curriculum will only be successful if the broader context is favorable to primary care.
Electronic supplementary material
Below is the link to the electronic supplementary material.
ACKNOWLEDGMENTS
Contributors
This project was developed as part of the activities of SAFMed (Swiss Academy of Family Medicine). The authors thank Dr. Romain Teoli, research assistant, for his collaboration in the abstract selection process.
Funders
Eva Pfarrwaller and Christopher Chung were funded by the “Masterplan for family medicine”, as part of the activities of SAFMed, a program for the academic development of family medicine supported by the Swiss University Conference and the Swiss State Secretariat for Education, Research and Innovation.
Prior Presentations
Select results were presented at the 2014 Swiss Family Docs Conference (August 2014, Zurich, Switzerland).
Conflict of Interest
The authors declare that they do not have any conflicts of interest.
REFERENCES
- 1.Jeffe DB, Whelan AJ, Andriole DA. Primary care specialty choices of United States medical graduates, 1997–2006. Acad Med. 2010;85(6):947–58. doi: 10.1097/ACM.0b013e3181dbe77d. [DOI] [PubMed] [Google Scholar]
- 2.Svirko E, Goldacre MJ, Lambert T. Career choices of the United Kingdom medical graduates of 2005, 2008 and 2009: questionnaire surveys. Med Teach. 2013;35(5):365–75. doi: 10.3109/0142159X.2012.746450. [DOI] [PubMed] [Google Scholar]
- 3.American Academy of Family Physicians (AAFP). Policies: Primary Care. Available at: http://www.aafp.org/about/policies/all/primary-care.html. Accessed 28 March 2015.
- 4.Evans P. editor. The European Definition of General Practice/Family Medicine, Short Version. European Academy of Teachers in General Practice; 2005. Available from: http://woncaeurope.org/sites/default/files/documents/Definition%20EURACTshort%20version.pdf. Accessed 28 March 2015.
- 5.Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83(3):457–502. doi: 10.1111/j.1468-0009.2005.00409.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.OECD Directorate for Employment, Labour and Social Affaires. OECD Health Statistics 2014 Online Database. Available at: http://www.oecd.org/health/healthdata. Accessed 28 March 2015.
- 7.Agency for Healthcare Research and Quality. Fact Sheets: The Number of Practicing Primary Care Physicians in the United States. Available at: http://www.ahrq.gov/research/findings/factsheets/primary/pcwork1/index.html. Accessed 28 March 2015.
- 8.Buddeberg-Fischer B, Stamm M, Buddeberg C, et al. The impact of gender and parenthood on physicians’ careers–professional and personal situation seven years after graduation. BMC Health Serv Res. 2010;10:40. doi: 10.1186/1472-6963-10-40. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bland CJ, Meurer LN, Maldonado G. Determinants of primary care specialty choice: a non-statistical meta-analysis of the literature. Acad Med. 1995;70(7):620–41. doi: 10.1097/00001888-199507000-00013. [DOI] [PubMed] [Google Scholar]
- 10.Meurer LN, Bland CJ, Maldonado G. The state of the literature on primary care specialty choice: where do we go from here? Acad Med. 1996;71(1):68–77. doi: 10.1097/00001888-199601000-00020. [DOI] [PubMed] [Google Scholar]
- 11.Meurer LN. Influence of medical school curriculum on primary care specialty choice: analysis and synthesis of the literature. Acad Med. 1995;70(5):388–97. doi: 10.1097/00001888-199505000-00015. [DOI] [PubMed] [Google Scholar]
- 12.Campos-Outcalt D, Senf J, Watkins AJ, Bastacky S. The effects of medical school curricula, faculty role models, and biomedical research support on choice of generalist physician careers: a review and quality assessment of the literature. Acad Med. 1995;70(7):611–9. doi: 10.1097/00001888-199507000-00012. [DOI] [PubMed] [Google Scholar]
- 13.Senf JH, Campos-Outcalt D, Kutob R. Factors related to the choice of family medicine: a reassessment and literature review. J Am Board Fam Pract. 2003;16(6):502–12. doi: 10.3122/jabfm.16.6.502. [DOI] [PubMed] [Google Scholar]
- 14.Moher D, Liberati A, Tetzlaff J, Altman DG, for the PRISMA Group Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA Statement. BMJ. 2009;339:b2535. doi: 10.1136/bmj.b2535. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Booth A, Clarke M, Dooley G, et al. The Nuts and Bolts of PROSPERO: an International Prospective Register of Systematic Reviews. Syst Rev. 2012;1:2. doi: 10.1186/2046-4053-1-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Osteopathic International Alliance. Defining the Profession. Available at: http://wp.oialliance.org/about-us/osteopathic-medicine-and-osteopathy. Accessed 28 March 2015.
- 17.Huwiler-Muntener K, Juni P, Junker C, Egger M. Quality of reporting of randomized trials as a measure of methodologic quality. JAMA. 2002;287(21):2801–4. doi: 10.1001/jama.287.21.2801. [DOI] [PubMed] [Google Scholar]
- 18.Hammick M, Dornan T, Steinert Y. Conducting a best evidence systematic review. Part 1: from idea to data coding. BEME Guide No. 13. Med Teach. 2010;32(1):3–15. doi: 10.3109/01421590903414245. [DOI] [PubMed] [Google Scholar]
- 19.Maiorova T, Stevens F, van der Zee J, Boode B, Scherpbier A. Shortage in general practice despite the feminisation of the medical workforce: a seeming paradox? A cohort study. BMC Health Serv Res. 2008;8:262. doi: 10.1186/1472-6963-8-262. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Gazewood JD, Owen J, Rollins LK. Effect of generalist preceptor specialty in a third-year clerkship on career choice. Fam Med. 2002;34(9):673–7. [PubMed] [Google Scholar]
- 21.Takayashiki A, Inoue K, Okayama M, et al. Primary care education in Japan: is it enough to increase student interest in a career in primary care? Educ Prim Care. 2007;18(2):156–64. [Google Scholar]
- 22.Levy BT, Hartz A, Merchant ML, Schroeder BT. Quality of a family medicine preceptorship is significantly associated with matching into family practice. Fam Med. 2001;33(9):683–90. [PubMed] [Google Scholar]
- 23.Maiorova T, Stevens F, Scherpbier A, van der Zee J. The impact of clerkships on students’ specialty preferences: what do undergraduates learn for their profession? Med Educ. 2008;42(6):554–62. doi: 10.1111/j.1365-2923.2008.03008.x. [DOI] [PubMed] [Google Scholar]
- 24.Woloschuk W, Tarrant M. Does a rural educational experience influence students’ likelihood of rural practice? Impact of student background and gender. Med Educ. 2002;36(3):241–7. doi: 10.1046/j.1365-2923.2002.01143.x. [DOI] [PubMed] [Google Scholar]
- 25.Williamson MI, Wilson R, McKechnie R, Ross J. Does the positive influence of an undergraduate rural placement persist into postgraduate years? Rural Remote Health. 2012;12:2011. [PubMed] [Google Scholar]
- 26.Campos-Outcalt D, Senf J. A longitudinal, national study of the effect of implementing a required third-year family practice clerkship or a department of family medicine on the selection of family medicine by medical students. Acad Med. 1999;74(9):1016–20. doi: 10.1097/00001888-199909000-00016. [DOI] [PubMed] [Google Scholar]
- 27.Packer CD, Carnell RC, Tomcho PM, Scott JG. Development of a four-day service-learning rotation for third-year medical students. Teach Learn Med. 2010;22(3):224–8. doi: 10.1080/10401334.2010.488467. [DOI] [PubMed] [Google Scholar]
- 28.Henderson MC, Hunt DK, Williams JW., Jr General internists influence students to choose primary care careers: the power of role modeling. Am J Med. 1996;101(6):648–53. doi: 10.1016/S0002-9343(96)00334-8. [DOI] [PubMed] [Google Scholar]
- 29.Hunt DK, Badgett RG, Woodling AE, Pugh JA. Medical student career choice: do physical diagnosis preceptors influence decisions? Am J Med Sci. 1995;310(1):19–23. doi: 10.1097/00000441-199507000-00007. [DOI] [PubMed] [Google Scholar]
- 30.Rabadan FE, Hidalgo JL. Changes in the knowledge of and attitudes toward family medicine after completing a primary care course. Fam Med. 2010;42(1):35–40. [PubMed] [Google Scholar]
- 31.Geske JA, Hartman T, Goodman B, Paulman P. Influence of a rural family medicine rotation on residency selection: MS3 versus MS4. Fam Med. 2011;43(8):556–9. [PubMed] [Google Scholar]
- 32.Howe A, Ives G. Does community-based experience alter career preference? New evidence from a prospective longitudinal cohort study of undergraduate medical students. Med Educ. 2001;35(4):391–7. doi: 10.1046/j.1365-2923.2001.00866.x. [DOI] [PubMed] [Google Scholar]
- 33.Williamson M, Gormley A, Bills J, Farry P. The new rural health curriculum at Dunedin School of Medicine: how has it influenced the attitudes of medical students to a career in rural general practice? N Z Med J. 2003;116(1179):U537. [PubMed] [Google Scholar]
- 34.Hogg R, Spriggs B, Cook V. Do medical students want a career in general practice? A rich mix of influences! Educ Prim Care. 2008;19(1):54–64. [Google Scholar]
- 35.Tani K, Yamaguchi H, Tada S, et al. Community-based clinical education increases motivation of medical students to medicine of remote area -comparison between lecture and practice. J Med Investig. 2014;61(1–2):156–61. doi: 10.2152/jmi.61.156. [DOI] [PubMed] [Google Scholar]
- 36.Corbett EC, Jr, Owen JA, Hayden GF. Effect of a second-year primary care preceptorship on medical students’ career plans. South Med J. 2002;95(7):691–4. doi: 10.1097/00007611-200295070-00007. [DOI] [PubMed] [Google Scholar]
- 37.Morrison JM, Murray TS. Career preferences of medical students: influence of a new four-week attachment in general practice. Br J Gen Pract. 1996;46(413):721–5. [PMC free article] [PubMed] [Google Scholar]
- 38.Arora V, Wetterneck TB, Schnipper JL, et al. Effect of the inpatient general medicine rotation on student pursuit of a generalist career. J Gen Intern Med. 2006;21(5):471–5. doi: 10.1111/j.1525-1497.2006.00429.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Dunker-Schmidt C, Breetholt A, Gesenhues S. 15 Years of practical training for the medical students in periods of 2 weeks in general practice: experiences at the University of Duisburg-Essen [in German] ZFA (Stuttgart) 2009;85(4):171–5. [Google Scholar]
- 40.Senf JH, Campos-Outcalt D. The effect of a required third-year family medicine clerkship on medical students’ attitudes: value indoctrination and value clarification. Acad Med. 1995;70(2):142–8. doi: 10.1097/00001888-199502000-00019. [DOI] [PubMed] [Google Scholar]
- 41.Iqbal SP. Family medicine in undergraduate medical curriculum: a cost-effective approach to health care in Pakistan. J Ayub Med Coll Abbottabad. 2010;22(4):207–9. [PubMed] [Google Scholar]
- 42.Davidson RA, Harris JO, Schwartz MD. A simple ambulatory-care experience and students’ residency choices and attitudes toward general internal medicine. Acad Med. 1993;68(4):311–2. doi: 10.1097/00001888-199304000-00026. [DOI] [PubMed] [Google Scholar]
- 43.Tai-pong L. Medical graduates’ attitudes towards their undergraduate general practice teaching in Hong Kong. Med Teach. 1997;19(1):62–4. doi: 10.3109/01421599709019352. [DOI] [Google Scholar]
- 44.Jordan J, Brown JB, Russell G. Choosing family medicine. What influences medical students? Can Fam Physician. 2003;49:1131–7. [PMC free article] [PubMed] [Google Scholar]
- 45.Parker JE, Hudson B, Wilkinson TJ. Influences on final year medical students’ attitudes to general practice as a career. J Prim Health Care. 2014;6(1):56–63. [PubMed] [Google Scholar]
- 46.Dixon AS, Lam CL, Lam TP. Does a brief clerkship change Hong Kong medical students’ ideas about general practice? Med Educ. 2000;34(5):339–47. doi: 10.1046/j.1365-2923.2000.00554.x. [DOI] [PubMed] [Google Scholar]
- 47.Zink T, Center B, Finstad D, et al. Efforts to graduate more primary care physicians and physicians who will practice in rural areas: examining outcomes from the university of Minnesota-Duluth and the rural physician associate program. Acad Med. 2010;85(4):599–604. doi: 10.1097/ACM.0b013e3181d2b537. [DOI] [PubMed] [Google Scholar]
- 48.Phillips TJ, Rosenblatt RA, Schaad DC, Cullen TJ. The long-term effect of an innovative family physician curricular pathway on the specialty and location of graduates of the University of Washington. Acad Med. 1999;74(3):285–8. doi: 10.1097/00001888-199903000-00021. [DOI] [PubMed] [Google Scholar]
- 49.Grayson MS, Klein M, Franke KB. Impact of a first-year primary care experience on residency choice. J Gen Intern Med. 2001;16(12):860–3. doi: 10.1046/j.1525-1497.2001.10117.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Haq C, Stearns M, Brill J, et al. Training in Urban Medicine and Public Health: TRIUMPH. Acad Med. 2013;88(3):352–63. doi: 10.1097/ACM.0b013e3182811a75. [DOI] [PubMed] [Google Scholar]
- 51.Rabinowitz HK, Diamond JJ, Markham FW, Hazelwood CE. A program to increase the number of family physicians in rural and underserved areas: impact after 22 years. JAMA. 1999;281(3):255–60. doi: 10.1001/jama.281.3.255. [DOI] [PubMed] [Google Scholar]
- 52.Rabinowitz HK, Diamond JJ, Markham FW, Santana AJ. Increasing the supply of rural family physicians: recent outcomes from Jefferson Medical College’s Physician Shortage Area Program (PSAP) Acad Med. 2011;86(2):264–9. doi: 10.1097/ACM.0b013e31820469d6. [DOI] [PubMed] [Google Scholar]
- 53.Rabinowitz HK, Petterson S, Boulger JG, et al. Medical school rural programs: a comparison with international medical graduates in addressing state-level rural family physician and primary care supply. Acad Med. 2012;87(4):488–92. doi: 10.1097/ACM.0b013e3182488b19. [DOI] [PubMed] [Google Scholar]
- 54.Crump WJ, Fricker RS, Ziegler C, Wiegman DL, Rowland ML. Rural track training based at a small regional campus: equivalency of training, residency choice, and practice location of graduates. Acad Med. 2013;88(8):1122–8. doi: 10.1097/ACM.0b013e31829a3df0. [DOI] [PubMed] [Google Scholar]
- 55.Halaas GW, Zink T, Finstad D, Bolin K, Center B. Recruitment and retention of rural physicians: outcomes from the rural physician associate program of Minnesota. J Rural Health. 2008;24(4):345–52. doi: 10.1111/j.1748-0361.2008.00180.x. [DOI] [PubMed] [Google Scholar]
- 56.Herold AH, Woodard LJ, Pamies RJ, Roetzheim RG, van Durme DJ, Micceri T. Influence of longitudinal primary care training on medical students’ specialty choices. Acad Med : J Assoc Am Med Coll. 1993;68(4):281–4. doi: 10.1097/00001888-199304000-00015. [DOI] [PubMed] [Google Scholar]
- 57.Stearns J, Glasser M, Miller B, Flach D, Cowen J. A longitudinal ambulatory care clerkship: graduates’ reports on the effect of specialty choice and preparation for residency. Acad Med. 1993;68(suppl 10):S37–39. doi: 10.1097/00001888-199310000-00039. [DOI] [PubMed] [Google Scholar]
- 58.Florence JA, Goodrow B, Wachs J, Grover S, Olive KE. Rural health professions education at East Tennessee State University: survey of graduates from the first decade of the community partnership program. J Rural Health. 2007;23(1):77–83. doi: 10.1111/j.1748-0361.2006.00071.x. [DOI] [PubMed] [Google Scholar]
- 59.Stagg P, Greenhill J, Worley PS. A new model to understand the career choice and practice location decisions of medical graduates. Rural Remote Health. 2009;9(4):1245. [PubMed] [Google Scholar]
- 60.Mennin SP, Kalishman S, Friedman M, Pathak D, Snyder J. A survey of graduates in practice from the University of New Mexico’s conventional and community-oriented,problem-based tracks. Acad Med. 1996;71(10):1079–89. doi: 10.1097/00001888-199610000-00015. [DOI] [PubMed] [Google Scholar]
- 61.Sen Gupta T, Murray R, Hays R, Woolley T. James Cook University MBBS graduate intentions and intern destinations: a comparative study with other Queensland and Australian medical schools. Rural Remote Health. 2013;13(2):1–10. [PubMed] [Google Scholar]
- 62.Veitch C, Underhill A, Hays RB. The career aspirations and location intentions of James Cook University’s first cohort of medical students: a longitudinal study at course entry and graduation. Rural Remote Health. 2006;6(1):537. [PubMed] [Google Scholar]
- 63.Eley D, Baker P, Chater B. The Rural Clinical School Tracking Project: more IS better–confirming factors that influence early career entry into the rural medical workforce. Med Teach. 2009;31(10):e454–459. doi: 10.3109/01421590902850857. [DOI] [PubMed] [Google Scholar]
- 64.Glasser M, Hunsaker M, Sweet K, MacDowell M, Meurer M. A comprehensive medical education program response to rural primary care needs. Acad Med. 2008;83(10):952–61. doi: 10.1097/ACM.0b013e3181850a02. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Walker JH, DeWitt DE, Pallant JF, Cunningham CE. Rural origin plus a rural clinical school placement is a significant predictor of medical students’ intentions to practice rurally: a multi-university study. Rural Remote Health. 2012;12(1):1–9. [PubMed] [Google Scholar]
- 66.Wilkinson JE, Hoffman M, Pierce E, Wiecha J. FaMeS: an innovative pipeline program to foster student interest in family medicine. Fam Med. 2010;42(1):28–34. [PubMed] [Google Scholar]
- 67.Roman SA, Jr, McGanney ML. The Sophie Davis School of Biomedical Education: the first 20 years of a unique BS-MD program. Acad Med. 1994;69(3):224–30. doi: 10.1097/00001888-199403000-00018. [DOI] [PubMed] [Google Scholar]
- 68.Bland CJ, Starnaman S, Harris D, Henry R, Hembroff L. ‘No fear’ curricular change: monitoring curricular change in the W. K. Kellogg Foundation’s national initiative on community partnerships and health professions education. Acad Med. 2000;75(6):623–33. doi: 10.1097/00001888-200006000-00014. [DOI] [PubMed] [Google Scholar]
- 69.Young L, Kent L, Walters L. The John Flynn Placement Program: evidence for repeated rural exposure for medical students. Aust J Rural Health. 2011;19(3):147–53. doi: 10.1111/j.1440-1584.2011.01201.x. [DOI] [PubMed] [Google Scholar]
- 70.Eley DS, Synnott R, Baker PG, Chater AB. A decade of Australian Rural Clinical School graduates–where are they and why? Rural Remote Health. 2012;12:1937. [PubMed] [Google Scholar]
- 71.Kuzel AJ, Moore SS. Choosing a specialty during a generalist initiative: a focus group study. Fam Med. 1999;31(9):641–6. [PubMed] [Google Scholar]
- 72.Firth A, Wass V. Medical students’ perceptions of primary care: the influence of tutors, peers and the curriculum. Educ Prim Care. 2007;18(3):364–72. [Google Scholar]
- 73.Kane KY, Quinn KJ, Stevermer JJ, et al. Summer in the country: changes in medical students’ perceptions following an innovative rural community experience. Acad Med. 2013;88(8):1157–63. doi: 10.1097/ACM.0b013e318299fb5d. [DOI] [PubMed] [Google Scholar]
- 74.Nieman LZ, Foxhall LE, Chuang AZ, Cheng L, Prager TC. Evaluating the Texas statewide family practice preceptorship program, 1992–2000. Acad Med. 2004;79(1):62–8. doi: 10.1097/00001888-200401000-00014. [DOI] [PubMed] [Google Scholar]
- 75.Deutsch T, Honigschmid P, Frese T, Sandholzer H. Early community-based family practice elective positively influences medical students’ career considerations - a Pre-post-comparison. BMC Fam Pract. 2013;14:24. doi: 10.1186/1471-2296-14-24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Dobie SA, Carline JD, Laskowski MB. An early preceptorship and medical students’ beliefs, values, and career choices. Adv Health Sci Educ Theory Pract. 1996;2(1):35–47. doi: 10.1023/A:1009721425157. [DOI] [PubMed] [Google Scholar]
- 77.Davidson RA. Community-based education and problem-solving: the community health scholars program at the University of Florida. Teach Learn Med. 2002;14(3):178–81. doi: 10.1207/S15328015TLM1403_8. [DOI] [PubMed] [Google Scholar]
- 78.Seim HC. Rural family practice program for first-year students. Acad Med. 1997;72(9):735–6. doi: 10.1097/00001888-199709000-00004. [DOI] [PubMed] [Google Scholar]
- 79.Farmer J, Iversen L, Bond C, Duthie I. Medical students’ orientation towards rural general practice: results from an exploratory study of a Scottish cohort. Educ Prim Care. 2003;14(4):463–7. [Google Scholar]
- 80.Talbot J, Ward A. Alternative Curricular Options in Rural Networks (ACORNS): impact of early rural clinical exposure in the University of West Australia medical course. Aust J Rural Health. 2000;8(1):17–21. doi: 10.1046/j.1440-1584.2000.81237.x. [DOI] [PubMed] [Google Scholar]
- 81.Bruno DM, Imperato PJ, Szarek M. The correlation between global health experiences in low-income countries on choice of primary care residencies for graduates of an urban US medical school. J Urban Health. 2014;91(2):394–402. doi: 10.1007/s11524-013-9829-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Crosson J, Heaton CJ, Boyd L. The summer assistantship in patient education: a preclinical preceptorship. Fam Med. 2003;35(1):15–7. [PubMed] [Google Scholar]
- 83.Norris TE, House P, Schaad D, Mas J, Kelday JM. Student providers aspiring to rural and underserved experiences at the University of Washington: promoting team practice among the health care professions. Acad Med. 2003;78(12):1211–6. doi: 10.1097/00001888-200312000-00003. [DOI] [PubMed] [Google Scholar]
- 84.McKee ND, McKague MA, Ramsden VR, Poole RE. Cultivating interest in family medicine: family medicine interest group reaches undergraduate medical students. Can Fam Physician. 2007;53(4):661–5. [PMC free article] [PubMed] [Google Scholar]
- 85.Kerr JR, Seaton MB, Zimcik H, McCabe J, Feldman K. The impact of interest: how do family medicine interest groups influence medical students? Can Fam Physician. 2008;54:78–9. [PMC free article] [PubMed] [Google Scholar]
- 86.Tong ST, Phillips RL, Berman R. Is exposure to a student-run clinic associated with future primary care practice? Fam Med. 2012;44(8):579–81. [PubMed] [Google Scholar]
- 87.Smith SD, Yoon R, Johnson ML, Natarajan L, Beck E. The effect of involvement in a student-run free clinic project on attitudes toward the underserved and interest in primary care. J Health Care Poor Underserved. 2014;25(2):877–89. doi: 10.1353/hpu.2014.0083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Vaikunth SS, Cesari WA, Norwood KV, et al. Academic achievement and primary care specialty selection of volunteers at a student-run free clinic. Teach Learn Med. 2014;26(2):129–34. doi: 10.1080/10401334.2014.883980. [DOI] [PubMed] [Google Scholar]
- 89.Chang LL, Grayson MS, Patrick PA, Sivak SL. Incorporating the fourth year of medical school into an internal medicine residency: effect of an accelerated program on performance outcomes and career choice. Teach Learn Med. 2004;16(4):361–4. doi: 10.1207/s15328015tlm1604_9. [DOI] [PubMed] [Google Scholar]
- 90.Jones M, Singh S, Lloyd M. “It isn’t just consultants that need a BSc”: student experiences of an Intercalated BSc in primary health care. Med Teach. 2005;27(2):164–8. doi: 10.1080/01421590400019567. [DOI] [PubMed] [Google Scholar]
- 91.Simoens S, Hurst J. The supply of physician services in OECD countries. Paris, France: OECD, Directorate for Employment, Labour and Social Affairs Group on Health; January 2006. OECD Health Working Papers 21. Available at: http://www.oecd.org/health/health-systems/35987490.pdf. Accessed 28 March 2015.
- 92.Lumb A, Murdoch-Eaton D. Electives in undergraduate medical education: AMEE Guide No. 88. Med Teach. 2014;36(7):557–72. doi: 10.3109/0142159X.2014.907887. [DOI] [PubMed] [Google Scholar]
- 93.Grimshaw J, Campbell M, Eccles M, Steen N. Experimental and quasi-experimental designs for evaluating guideline implementation strategies. Fam Pract. 2000;17(suppl 1):S11–16. doi: 10.1093/fampra/17.suppl_1.S11. [DOI] [PubMed] [Google Scholar]
- 94.Ringsted C, Hodges B, Scherpbier A. ‘The research compass’: an introduction to research in medical education: AMEE Guide no. 56. Med Teach. 2011;33(9):695–709. doi: 10.3109/0142159X.2011.595436. [DOI] [PubMed] [Google Scholar]
- 95.Lie D, Boker J, Dow E, et al. Attributes of effective community preceptors for pre-clerkship medical students. Med Teach. 2009;31(3):251–9. doi: 10.1080/01421590802139765. [DOI] [PubMed] [Google Scholar]
- 96.Bradner M, Crossman SH, Vanderbilt AA, Gary J, Munson P. Career advising in family medicine: a theoretical framework for structuring the medical student/faculty advisor interview. Med Educ Online. 2013;18:21173. doi: 10.3402/meo.v18i0.21173. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.