Abstract
Community-based medical education (CBME) offers vital support to healthcare professionals in aging societies, which need medical trainees who understand comprehensive care. In teaching comprehensive care practices, CBME can involve citizens from the relevant community. This research synthesizes the impact of the involvement of communities on the learning of medical trainees in CBME. We conducted a systematic review, in which we searched ten databases from April 1990 to August 2020 for original articles in Japan regarding CBME involving citizens and descriptively analyzed them. The Kirkpatrick model was used to categorize the outcomes. Our search for studies following the protocol returned 1240 results; 21 articles were included in this systematic review. Medical trainees reported satisfaction with the content, teaching processes, and teachers’ qualities. Medical trainees’ attitudes toward community and rural medicine improved; they were motivated to become family physicians and work in communities and remote areas. This review clarified that citizen involvement in CBME had an effective impact on medical trainees, positively affecting perceptions of this type of education, as well as improving trainees’ knowledge about and attitude toward community and rural medicine.
Keywords: community-based medical education, Japanese medical education, comprehensive medical training
1. Introduction
Community-based medical education (CBME) is a practical educational method in which medical trainees learn primary healthcare and primary care in medical institutions outside of medical universities and tertiary hospitals [1,2,3]. CBME is vital for healthcare professionals to learn about aging societies. Through real experiences with CBME, medical students and residents can learn practical knowledge, expertise, and attitudes regarding clinical reasoning, interprofessional collaboration, and community medicine, which they cannot learn in medical universities [4,5,6,7]. Aging societies need medical trainees who understand comprehensive care [8,9,10,11]. Comprehensive care refers to an approach to care in which communities are able to address citizens’ healthcare comprehensively and in collaboration with specialized medics from outside those communities [12]. Older people lose access to medical care because of their loss of mobility, especially in rural areas where public transportation is minimal [11]. Comprehensive care can be important in enabling older people to access healthcare and maintain their health [13,14]. Furthermore, for effective, comprehensive care, medical trainees should be educated about comprehensive care, including the perspectives of citizens in communities.
To teach comprehensive care to medical trainees, CBME can actively involve citizens within communities. In administering comprehensive care, medical trainees have to deal with the various problems experienced by older people [15,16]. Elderly patients tend to experience numerous health problems leading to frailty, and these health problems need to be managed through multidisciplinary collaboration in the community [17,18,19]. Citizens in communities can modify the process of managing these health problems, and this can be learned through participation in such communities [20,21]. As citizen involvement in education, CBME, including active participation in community activities driven by citizens, is highly relevant in Japan, the world’s fastest-aging society [22,23,24]. Various educational approaches have emerged from the Japanese context offering medical trainees clinical experience to absorb clinical knowledge, apply it, and understand the community and rural medicine [23,24]. Japanese CBME includes various communities to facilitate medical trainees’ education regarding comprehensive care from hospitals to clinics and urban to rural settings [24]. CBME involving citizens’ activities can be beneficial for the training of medical students and residents in comprehensive care to support the super-aging population in Japanese society. As Japan has led among aging societies all over the world, with the rate of people over 65 years old exceeding 26% in 2015 [20], education in such communities can be specific, and this clarification of the present conditions is beneficial for informing and optimizing education programs in all countries that are preparing for aging populations.
Since the application of CBME in Japan, medical institutions have provided CBME in numerous contexts, which could constitute to evidence of different outcome levels, based on the Kirkpatrick model regarding medical trainees’ perceptions of patient outcomes [25]. Educational research can clarify the effectiveness of CBME and its challenges in Japan in an authentic way. Different contexts of CBME could produce different learning contexts for and perceptions of medical students because of the variation in communities [26,27]. The comprehensive effects of citizens’ involvement in CBME have not yet been clarified by scientific research. A systematic review of scientific evidence in the context of Japan can elucidate the effectiveness of citizens’ involvement in CBME for medical trainees and their concrete learning contents and perceptions. Thus, our research question is as follows:
“What effect(s) does citizens’ involvement in CBME have on medical students and residents?”
To date, no systematic review has focused on the effects of citizens’ involvement in CBME. The purpose of this research is to systematically review the impact of the involvement of communities on the learning of medical trainees in CBME.
2. Materials and Methods
2.1. Study Design
Systematic review.
2.2. Search Strategy
This study followed guidelines stipulated in the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement. We searched ten databases (PubMed, the Cochrane Library, Google Scholar, CINAHL, Web of Science, Scopus, Embase, Ichushi-Web, Jdrea-mIII, and CiNii) for original articles from Japan regarding CBME from April 1990 to August 2020. Regarding articles written in English, our search strategy was based on the following title/abstract keywords: (“community-based medical education” or “community-oriented medical education” or “CBME” or “COME”) AND (“Japan”). We searched Japanese articles based on the following title/abstract keywords: (“Chiiki-kibangata-igakukyouiku” or “Chiiki-shikousei-igakukyouiku” or “Chiiki-sankagata-igakukyouiku” or “Chiiki-iryozishyu”) and (“Japan”). The reference lists of relevant studies were also reviewed to identify research that might have been missed in the database search.
Ichushi-Web is an online Japanese literature search system provided by the non-profit Japan Medical Abstracts Society [28]. The Ichushi-Web database covers about 10 million medical papers from 6000 journals in Japan and is often used to search Japanese literature (Ichushi-Web). JDreamIII (Japan Science and Technology Agency Document Retrieval System for Academic and Medical Fields) is an online Japanese database for searching literature provided by the Japan Science and Technology Agency [29]. The database of JDreamIII contains roughly 60 million articles, including serial publications, reports, conference materials, public documents, and proceedings on science and technology (JDreamIII). CiNii is an online Japanese literature search system provided by the National Institute of Informatics [30]. The CiNii database contains about 18 million articles focusing on natural and cultural sciences (CiNii books).
2.3. Inclusion and Exclusion Criteria
Literature searches and data extraction were independently conducted by two investigators (RO and YR), and any discrepancies were resolved through discussion. In this study, databases were searched for empirical studies on CBME in Japan to evaluate the impact of CBME involving citizens on medical students and residents. Studies conducted without any clear description of aim, participants, or outcomes were excluded. Details of the inclusion criteria are shown in Table 1.
Table 1.
Inclusion and exclusion criteria.
Criteria | Inclusion | Exclusion |
---|---|---|
Population | Medical students, residents | Other health care professionals (nurses, pharmacists, dentists, rehabilitators, care managers) |
Intervention | Clinical experience focusing on community-based medical education including citizens in communities | Clinical experience only in healthcare facilities |
Type of Study | Qualitative, quantitative, mixed-method | Non-empirical studies (editorials, news) |
Other | Abstract available Year of publication >1990 Conducted in Japan Including outcome of the participants categorized according to the Kirkpatrick model Full text available in English or Japanese |
Abstract not available Full text not available in English or Japanese |
2.4. Data Extraction
One of the investigators (RO) extracted data from each original article using a purpose-designed data extraction form based on the best evidence medical education (BEME) coding form [31,32]. Next, investigators (YR and CS) checked the extracted data. Extracted data were categorized into settings (urban or rural, hospital or clinic, the duration of CBME, the purpose of CBME) and study methodology (qualitative, quantitative, or mixed, data source, outcomes).
2.5. Analysis
The quality of each study was assessed based on the BEME scale (1 to 5): Grade 1 indicated that no definite conclusions could be drawn, that is, the data were not significant; Grade 2 indicated that the results were ambiguous, but there appeared to be a trend; Grade 3 indicated that conclusions could probably be drawn based on the results; Grade 4 indicated that the results were clear and very likely to be true; Grade 5 indicated that the results were unequivocal [31,32]. The outcomes of the study were categorized based on the Kirkpatrick outcome evaluation (Level 1, 2A, 2B, 3, 4A, 4B): Level 1 indicated the reaction of the participants to the education; Level 2A indicated changes in learners’ attitudes; Level 2B indicated changes in learners’ knowledge and skills; Level 3 indicated changes in learners’ behaviors; Level 4A indicated changes in the system/organizational practice; Level 4B indicated changes in patient care outcomes [25]. The contents were the results, settings, learning purposes, year of publication, participants, evaluation methods, Kirkpatrick outcome evaluation levels, the quality of studies, and the main outcomes of CBME. As there were various grading systems at different medical schools around the world, participants’ grades were briefly categorized as first year, pre-clinical year, post-clinical year, or final year. As some studies contained participants from multiple categories, we calculated each category independently. For example, if one study contained first-year and pre-clinical-year students, we categorized the study in both categories. To describe the setting, population density (people/square kilometer) was used and classified based on the criteria of the OECD (less than 150 people/square kilometer) [33]. Where there were multiple educational sites across cities and prefectures, the population density was calculated as the average of the population densities involved in the research. The duration of training and training settings were collected for the CBME format. The training settings were categorized as hospitals, clinics, welfare facilities, home care settings, and other (rehabilitation, health promotion, and working experience in other professions). The CBME formats were compared with a nationwide survey on CBME in Japan regarding learning durations and settings [24]. The results were categorized, and the rate of statistically significant results in each category was calculated for each Kirkpatrick outcome evaluation level. When there was no statistical analysis or pre- and post-comparison, the scores above the middle (e.g., three on five-point Likert scales or 50 on the visual analog scale) were considered significant. The Unnan City Hospital Clinical Ethics Committee approved this study (Approval code: 20200020).
3. Results
3.1. Search Results
In searching for studies that followed the above-mentioned inclusion criteria, 1240 studies were detected. A total of 1188 studies were excluded because they were unrelated to the efficacy of CBME. After reviewing the full texts, 31 studies were excluded for the following reasons: Ten studies did not involve learning via citizens from communities, ten studies did not involve medical students, seven studies did not deal with the outcomes of CBME, and four studies were not original articles (Figure 1). Twenty-one studies were included in this systematic review.
Figure 1.
The flowchart of the study population.
3.2. Study Characteristics
Four studies were performed in areas with a population density of fewer than 50 people per square kilometer. Eight studies were performed in areas with a population density of 50 to 150 people per square kilometer. Eight studies were performed in areas with a population density of 150 to 1000 people per square kilometer. One study was performed in an area with a population density of more than 1000 people per square kilometer. Twelve studies were performed in rural areas. Seven studies included first-year medical students, three studies included medical students in their pre-clinical year, ten studies included medical students in their clinical year, seven studies included medical students in their final year, and two studies included medical residents (Table 2).
Table 2.
Distribution of the reviewed studies according to population density and participants’ backgrounds.
Variable | % | |
---|---|---|
Population Density | ||
Fewer than 50 | 4 | 19.0% |
50 to 150 | 8 | 38.1% |
150 to 1000 | 8 | 38.1% |
More than 1000 | 1 | 4.8% |
Rural (less than 150) | 12 | 57.1% |
Participants | ||
First year | 7 | 33.3% |
Pre-clinical years | 3 | 14.3% |
Clinical year | 10 | 47.6% |
Final year | 7 | 33.3% |
Medical Resident | 2 | 9.5% |
Eleven of the studies used quantitative methods, eight used qualitative methods, and two used mixed-methods. The quantitative studies’ respective methods comprised four cross-sectional designs, three descriptive designs, and six pre- and post- design studies. The qualitative studies’ respective methods comprised three descriptive analyses, four thematic analyses, two SCATs (Steps for Coding and Theorization), and one ethnography. The concrete data collection methods comprised one direct observation, one e-portfolio, nine interviews, two focus groups, and 11 questionnaires (Table 3).
Table 3.
Distribution of the reviewed studies according to design and data sources.
Variable | Number of Studies |
---|---|
Study Method | |
Quantitative method | 11 |
Qualitative method | 8 |
Mixed-method | 2 |
Study Design | |
Quantitative | |
Pre- and post-design | 6 |
Descriptive design | 3 |
Cross-sectional | 4 |
Qualitative | |
Descriptive analysis | 3 |
Thematic analysis | 4 |
SCAT (Steps for Coding and Theorization) | 2 |
Ethnography | 1 |
Data Resource | |
Quantitative | |
Questionnaire | 11 |
Qualitative | |
interview | 9 |
focus group | 2 |
direct observation | 1 |
e-portfolio | 1 |
3.3. CBME Format
Two studies were performed over the course of three days, nine studies were performed over one week, eight studies were performed over two weeks, one study was performed over four months, and one study was performed over two years. As the national survey showed that the median duration was one week [24], the studies included in this systematic review had a similar distribution to the national survey. Seventeen studies (80.9%) were set in hospitals, 15 studies (71.4%) were set in clinics, 17 studies (80.9%) were set in welfare facilities, 17 studies (80.9%) focused on home care, and 21 studies (57.6%) focused on community settings involving citizens’ activities (Table 4).
Table 4.
Distribution of the reviewed studies according to community-based medical education (CBME) format.
Variable | Number of Studies |
---|---|
Duration of CBME | |
Three days | 2 |
One week | 9 |
Two weeks | 8 |
Four months | 1 |
Two years | 1 |
Study Place | |
Hospital | 17 |
Clinic | 15 |
Welfare facility | 17 |
Home care | 17 |
Community | 21 |
3.4. Kirkpatrick Outcome Levels and the Strength of the Findings
Twelve studies were evaluated at Kirkpatrick level 1, fourteen at level 2A, and fifteen at level 2B. No study was assessed with level 3 or 4 Kirkpatrick outcomes. Among the reviewed quantitative studies, seven studies were assessed at level 1, eight studies at level 2A, and six studies at level 2B. Among the reviewed qualitative studies, three studies were assessed at Kirkpatrick level 1, four studies at level 2A, and seven studies at level 2B. Among the mixed-method studies that were reviewed, two studies were assessed at Kirkpatrick level 1, two studies at level 2A, and two studies at level 2B. Regarding the findings of the reviewed studies, one study was categorized as Grade 2, twelve studies as Grade 3, and seven studies as Grade 4 (Table 5).
Table 5.
Distribution of the reviewed studies according to Kirkpatrick outcome levels and the strength of the findings.
Variable | Number of Studies | |||
---|---|---|---|---|
Kirkpatrick Outcome Levels | Quantitative | Qualitative | Mixed | Total |
1: Reaction | 7 | 3 | 2 | 12 |
2A: Learning-change in attitudes | 8 | 4 | 2 | 14 |
2B: Learning-change in knowledge and skills | 6 | 7 | 2 | 15 |
3: Change in behaviors | 0 | 0 | 0 | 0 |
4A: Results-change in the system/organizational practice | 0 | 0 | 0 | 0 |
4B: Change in patient care outcomes | 0 | 0 | 0 | 0 |
Strength of Findings | ||||
Grade 1: No clear conclusions can be drawn; not practice | 0 | 0 | 0 | 0 |
Grade 2: Results ambiguous, but there appears to be a trend | 0 | 1 | 0 | 1 |
Grade 3: Conclusions can probably be drawn based on the results | 6 | 6 | 0 | 12 |
Grade 4: Results are clear and very likely to be true | 4 | 1 | 2 | 7 |
Grade 5: Results are unequivocal | 0 | 0 | 0 | 0 |
3.5. Synthesis of Findings on the Impact on Stakeholders in CBME
Table 6 describes the details of each study that evaluated the impact of Japanese CBME on medical trainees.
Table 6.
Studies reporting the impact of Japanese CBME on medical trainees.
CBME Setting, Participants/Duration/Population Density | Study’s Purpose | Findings | |
---|---|---|---|
Quantitative Method | |||
Okayama et al.(2004) [34] | Clinical and final grades/10 days/ 335 people/km2 |
To examine the effects of a standardized program for medical facilities and clerkship contents introduced in 2001. | The trainees were motivated and had the confidence to talk with citizens in communities regarding medical and social issues. |
Takayashiki et al.(2005) [35] | Final year/10 days/ 335 people/km2 |
To inquire as to the changes in medical students’ perceptions on the necessity of experience in community-based learning programs | The necessity of learning in communities was more likely to be recognized by students who had experienced CBME. |
Tani et al.(2009) [36] | Clinical year/5 days/ 66 people/km2 |
To inquire as to the efficacy of the primary care practice | CBME increased the intensity of students’ interest in and passion for collaborating with citizens in communities as opposed to lectures. |
Okayama et al.(2011) [37] | Clinical year/10 days/ 335 people/km2 |
To clarify which learning activities affect students’ attitudes toward community health care | Health education with citizens was associated with a positive change in both attitudes of “worthiness” (adjusted RR: 1.71, 95% CI: 1.10–2.66) and “confidence” (1.56, 1.08–2.25) for community medicine. |
Okayama et al.(2011) [38] | Clinical year/10 days/ 335 people/km2 |
To explore the association between students’ evaluations of their community- based clinical clerkship, their attitudes toward community health care, and their career preferences | Evaluations of the programs (p = 0.014) and students’ attitudes (p < 0.001) were strongly associated with an increased preference for a career as a primary care physician after the clinical clerkship. |
Hashiba et al.(2011) [39] | First and pre-clinical years/3 days/ 129 people/km2 |
To assess the impact of the student-led program on students’ notions about, appreciation of, and attitudes toward community- based medicine | The participants showed moderate-to-marked willingness to work in rural areas after their experiences interacting with citizens in communities. |
Iwasaki et al.(2011) [40] | Clinical and final years/5 days/ 108 people/km2 |
To examine the changes in students’ thinking about an affinity for community medicine | Community-based medical programs enhance medical students’ understanding of and affinity for community medicine. |
Tani et al.(2014) [41] | Clinical and final years/5 days/ 66 people/km2 |
To evaluate the effect of community-based clinical education on students’ attitudes toward community medicine and medicine in remote areas. | The intensity of students’ interest and their senses of fulfillment and passion for medicine in remote areas were significantly increased after CBME. |
Katsube et al.(2016) [42] | Clinical and final years/10 days/ 64.4 people/km2 |
To clarify the learning and revising points regarding CBME in rural community hospitals | Based on the questionnaires, the medical students were satisfied with CBME in rural community hospitals. |
Tani et al.(2017) [43] | Clinical year/5 days/ 66 people/km2 |
To examine the effect of community-based clinical practice on their attitudes toward remote medicine and their course after graduation. | Students demonstrated a significantly decreased desire to become general practitioners compared to becoming specialists; this was seen in the students that had a low intensity sense of fulfillment. |
Moriwaki et al.(2018) [44] | Clinical and final years/10 days/ 64.4 people/km2 |
To investigate the change in medical students’ motivation through community-based medical education by surgeons | The medical students’ perceptions regarding rural medicine changed positively regarding the importance of rural medicine. |
Qualitative Method | |||
Yamada et al. (2010) [45] | First year/5 days/ 26 people/km2 |
To inquire what medical students have actually learned from their involvement in communities | Medical students came to understand life on a remote island through their interactions with citizens. |
Nakada et al. (2010) [46] | First year/5 days/ 26 people/km2 |
To clarify what students learned on a rural island | Through CBME on a rural island, medical students felt and learned how closely nature and people relate in addition to learning about life on a remote island and the health conditions of the people on the island and recognizing the lack of study and self-realization. |
Uehara et al. (2011) [47] | First and pre-clinical years/5 days 184 people/km2 |
To discover what medical students learn and accomplish in CBME in rural Japan | The CBME not only can increase students’ understanding of community medicine, but also functions as a motivating force by exposing them to the expectations of community people. |
Takamura et al. (2015) [48] | Final year/4 months/ 281 people/km2 |
To clarify the challenges of the application of an integrated longitudinal clerkship in a rural community hospital | One of the most important outcomes of the LIC was an enhanced understanding of the community-based practice and the community itself, especially in a rural setting. |
Saiki et al. (2016) [49] | First year/5 days/ 1963 people/km2 |
To explore how a longitudinal interaction with citizens can develop medical students’ communication skills and understanding of themselves as social entities. | Medical students developed an understanding of citizen-centered communication and of the human relationship and capacity to expand one’s world via social existence. |
Ohta et al.(2018) [50] | Resident/1 week/ 43.1 people/km2 |
To clarify learning content in CBME on a rural island | A strong connection among the islanders, islander-centered care, and the differences between rural and hospital medicine were the main aspects remarked upon by those who had experienced deep relationships with the islanders. |
Yamada et al.(2018) [51] | First year/5 days/ 26 people/km2 |
To investigate medical students’ changes in perception regarding their living | Medical students changed their perception regarding rural medicine and their learning approach to medical science. |
Ohta et al.(2019) [52] | Clinical and final years/10 days/ 64.4 people/km2 |
To investigate the changes in perceptions of participants who completed a two-week CBME course. | The participants’ ratings regarding community care improved significantly from pre-to post-training. The participants realized the importance of community care and of having respect for individuals’ lifestyles. |
Mixed-Method | |||
Takamura et al. (2017) [53] | Resident/2 years/ 281.3 people/km2 |
To explore the effects of introducing community members to medical education as active teachers. | The participants scored higher regarding their views on the importance of and their preferences for working with communities. Important themes that emerged from the interns’ interviews were taking responsibility for shared understanding, community-oriented focus, valuing community nurses, and tension from competing demands. |
Ohta et al.(2019) [54] | First and pre-clinical years/3 days/ 126 people/km2 |
To clarify the short-term learning experienced by medical students on rural islands in Japan | By interacting with various islanders, students developed an understanding of the different cultural backgrounds in which rural physicians worked, in addition to establishing their own ability to adapt to each. This experience motivated them to pursue studies on rural medicine upon their return to the mainland. |
3.6. Kirkpatrick Outcome Level 1
3.6.1. Quantitative Assessment: Satisfaction with the Training, Overall Quality of the Training, Quality of the Teachers, Quality of the Contents, and Importance of the Training
The quantitative outcome contents at Kirkpatrick level 1 in this study consisted of five categories: Satisfaction with the training, overall quality of the training, quality of the teacher, quality of the contents, and importance of the training. Regarding respondents’ satisfaction with training, one study returned significantly high results [34]. Regarding the quality of the training, 5/5 of the studies returned significantly high results [34,42,44,46,48,52]. Regarding the quality of the teacher, 5/5 of the studies returned significant results [34,42,44,46,48,52]. Regarding the quality of the content, 3/4 of the studies returned significant results [42,44,48,52]. Regarding the importance of the training, 4/4 of the studies returned significant results [34,42,44,52,53].
3.6.2. Qualitative Assessment: Noteworthy Interaction with Citizens, the Distance between Medical Institutions, and the Motivation of Citizens and Professionals
Medical trainees have difficulty scheduling CBME given its typical distance from main hospitals, as well as a lack of support from main hospitals [46,48]. In addition, medical trainees hoped to train in CBME for a longer period of time [54]. Medical trainees had noteworthy experiences through their interactions with indigenous people and experienced satisfaction [46,48,52]. In contrast, the lack of motivation for education among rural people had a negative impact on medical trainees’ learning [48,54]. In the personal axis category, the establishment of effective relationships with healthcare professionals and citizens motivated respondents to work in rural and remote areas [48,52].
3.7. Kirkpatrick Outcome Level 2A
3.7.1. Quantitative Assessment: Interacting with Patients/Citizens, Motivation for General Practitioners, Motivation for Specialists, Motivation for Working in Community Medicine, and Motivation for Working in Remote Areas
The quantitative outcome contents at Kirkpatrick level 2A in this study consisted of five categories: Interacting with patients/citizens, motivation for general practitioners, motivation for specialists, motivation for working in community medicine, and motivation for working in remote areas. All assessments were conducted using a questionnaire. Regarding interacting with patients/citizens, 2/2 of the studies returned significant results [34,52]. Regarding motivation for general practitioners, 5/5 of the studies returned significant results [34,41,46,52,53]. Regarding motivation for specialists, 4/4 of the studies returned significant results [34,41,46,53]. Regarding motivation for working in community medicine, 4/4 of the studies returned significant results [36,46,48]. Regarding motivation for working in remote areas, 4/4 of the studies returned significant results [36,39,41,53].
3.7.2. Qualitative Assessment: The Relationship between Professionals and Citizens, Strong Connections between Citizens for Health, and Motivation for Learning Rooted in the Expectations of the Citizens
Medical trainees observed tension from the competing demands between healthcare professionals and citizens [53], as well as the importance of a strong sense of connection among the islanders [46,50,51]. Through interactions with citizens, medical trainees realized their lack of knowledge and were motivated to learn more by feeling the expectations of the community members [46,51,53,54]. Medical trainees also observed the need for a shift from physician-centered to citizen-centered perspectives through the observation of healthcare professionals’ interaction with citizens in their communities [46,51,53], which generated motivation for general physicians [52,54].
3.8. Kirkpatrick Outcome Level 2B
3.8.1. Quantitative Assessment: Community Medicine, Remote Medicine, Citizens’ Lives, and Preventative Medicine
The quantitative outcome contents at Kirkpatrick level 2B in this study consisted of four categories: Community medicine, remote medicine, citizens’ lives, and preventative medicine. All assessments were conducted using a questionnaire. Regarding community medicine, 4/4 of the studies returned significant results [34,36,39,41]. Regarding remote medicine, 2/2 of the studies returned significant results [36,41]. Regarding citizens’ lives, 2/2 of the studies returned significant results [40,52]. Regarding preventable medicine, 2/2 of the studies returned significant results [40,52].
3.8.2. Qualitative Assessment: The Significance of Citizens’ Characteristics, Humanistic Relationships, and Community-Oriented Primary Care
Through their interactions with citizens in communities, medical trainees came to understand the significance of local characteristics, such as culture [46,48,52], as well as the indigenous lives of community members, from children to older people, as related to their health conditions [46,48,52,54]; trainees additionally learned the value of human relationships [45,48,53], expansion of the world through social existence [53], and community-oriented primary care [53].
4. Discussion
This systematic review demonstrated the efficacy of and challenges faced by Japanese CBME with citizen participation based on the Kirkpatrick model framework. Based on the quantitative analysis, the present Japanese CBME can be understood to provide an excellent experience and effective learning for medical trainees from Kirkpatrick level 1 to 2B, lacking the assessment of Kirkpatrick level 3 to 4 outcomes due to the scarcity of long-term learning via Japanese CBME. In the qualitative analysis, various content was learned by medical trainees and evaluated at Kirkpatrick levels 1 to 2B. There are various suggestions regarding Japanese CBME systems for better quality regarding the schedule management and motivation of stakeholders involved in CBME.
Japanese CBME can provide satisfactory and practical education for medical trainees over various durations of training. Based on our quantitative analysis, the most common duration of CBME was one to two weeks, which is generally shorter than that in other countries, such as Australia and Canada [7,55]. This review shows that trainee satisfaction and the quality of the contents and teachers in CBME were all highly rated over a comparatively shorter duration of training. The issues of Japanese medical education surrounding university-centered education could have affected this. In Japanese medical education, medical trainees have few opportunities to learn in community-based settings [16,18]. Their learning in universities tends to be based on lectures and observation of their teachers in hospitals [56]. Medical trainees can experience and participate actively in various clinical situations by learning via CBME [6,57]. The educational gap between universities and CBME programs could render their perception of CBME fruitful [58]. In other countries, there is considerable evidence showing the improvement of medical trainees’ educational outcomes in CBME environments compared to medical universities’ education [1,4,7,59]. The present CBME can be promoted more actively to improve medical students’ and residents’ educational environments.
Training in CBME can also motivate trainees to work in communities and remote places [7,60], as shown by this review’s results. In Japan, as CBME has become prevalent, this improvement in the quality of education could serve to drive the allocation of medical doctors in communities, which could function to solve the problem of the localization of physicians in Japan [20,61]. As an effect of CBME, the increased allocation of physicians in rural areas can positively change rural people’s health conditions. The changes can be assessed by systems approaches or multimedia approaches, which can deal with multifactorial interventions in communities not only from medical institutions, but from whole communities as well, including citizens’ activities [62,63]. Future studies can investigate the comprehensive effects of CBME, including citizens’ activities, based on the new methods.
Furthermore, longitudinal integrated clerkship (LIC) can be applied in Japanese medical education, leading to an improvement of the lack of research evaluating Kirkpatrick level 3 and 4 outcomes as LIC is becoming popular in various developed countries to increase medical trainees’ educational outcomes, as well as the number of physicians available in remote areas [3,64,65]. In rural areas, medical teachers and medical professionals are lacking, so the performance of LIC should be strongly supported by local governments and medical universities. For LIC, multiple stakeholders from different institutions should collaborate effectively, which can lead to better education and outcomes regarding medical students’ and residents’ learning. Further research should investigate the LIC application process regarding multisectoral collaboration and the long-term outcomes of CBME, including citizens.
Based on the qualitative analysis, medical trainees can experience biomedical factors, psychosocial factors, and community issues in their interactions with physicians, other medical professionals, and citizens/patients. In addition, they experienced several difficulties, such as differences in educational methods between medical universities and community medical institutions and mentoring systems in medical universities. Furthermore, the low motivation of stakeholders in CBME can affect medical trainees’ motivation negatively. The educational methods may differ between medical universities and CBME because of the different range of diseases dealt with in each setting. In addition, the lack of medical resources in community medical institutions enables medical trainees to participate actively in-patient care, which can benefit medical trainees and medical institutions [66,67]. CBME, supported by a rigid safety system of medical trainees, can drive medical trainees’ learning, more in Japan [68]. In addition, stakeholders should be motivated to provide CBME adequately [69,70,71]. For their motivation, the benefits of CBME for their conditions should be emphasized, such as retention and recruitment of medical professionals, especially in rural areas. In Japanese contexts, there is emerging evidence to demonstrate CBME’s effect on the motivation of medical trainees and the increased number of medical professionals [72,73]. Therefore, subsequent studies should investigate this impact at Kirkpatrick level 3 to 4 outcomes. Currently, the new coronavirus is impinging on community-based medical education because of the risk and fear of spreading infection among trainees, stakeholders, and citizens. To overcome the challenges presented by the new coronavirus, stakeholders should discuss the advantages and disadvantages of CBME, including citizens, and appropriately apply this educational method with medical trainees [74,75,76].
5. Limitation
One of the limitations is that all of the quantitative assessments in research regarding CBME in Japan were performed using only questionnaires, not observations, which can inhibit the assessment of the behavior of medical trainees, as well as patient care quality at Kirkpatrick 3 and 4 level outcomes. Future studies should use longitudinal research designs to assess high-level outcomes, which could motivate more medical educators to begin using CBME. Additionally, for assessing CBME’s effects on citizens, patient-reported outcomes, such as quality of life and self-rated health, can be included as Kirkpatrick 3 and 4 level outcomes. Another limitation was the lack of meta-analysis in this systematic review. The lack of meta-analysis is one of the limitations of this systematic review due to the variety of study designs, participants, and outcome settings, and educational methods. The reviewers are Japanese and specialize in medical education, so this may have introduced bias in the analysis and synthesis of our results. Furthermore, owing to accessibility limitations, the review may have missed other studies published in this research area. To overcome this limitation, we employed all of the search engines privileged in Japan and all over the world. As CBME can be affected by context, there are difficulties in applying educational methods in different contexts. As the world is gradually aging, all countries can experience issues of aging societies, which require comprehensive care respecting each local citizen; the results of this study regarding Japanese CBME’s involvement of citizens can provide suggestions regarding the importance of CBME, including citizens for education to enable medical professionals to prepare for aging societies even in countries that are not currently experiencing aging societies. Future reviews can include CBME in other contexts around the world for specific focuses.
6. Conclusions
This systematic review clarified that Japanese CBME with citizen participation provided effective education for medical trainees, which can contribute to their effective understanding of comprehensive care and motivation to work in communities. Since the outcomes are limited to transient outcomes, such as the perception of the education, knowledge, and attitude toward community and rural medicine, future studies should examine the longitudinal effect of CBME, such as medical trainees’ behaviors and patients’ outcomes. The involvement of various stakeholders in CBME, as well as better collaboration, should be established to support effective CBME.
Acknowledgments
We would like to thank all the participants who took part in this study.
Author Contributions
R.O. designed, collected, and analyzed data and prepared and revised the manuscript. Y.R. designed, collected, and analyzed data and revised the manuscript. C.S. analyzed and revised the manuscript. All authors have read and agreed to the published version of the manuscript.
Funding
The authors declare that no external funding was received for this research.
Institutional Review Board Statement
The Unnan City Hospital Clinical Ethics Committee approved this study (Approval code: 20200020).
Informed Consent Statement
Not applicable.
Data Availability Statement
All relevant data sets in this study are described in the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Worley P., Esterman A., Prideaux D. Cohort Study of Examination Performance of Undergraduate Medical Students Learning in Community Settings. BMJ. 2004;328:207–209. doi: 10.1136/bmj.328.7433.207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Roberts C., Daly M., Kumar K., Perkins D., Richards D., Garne D. A Longitudinal Integrated Placement and Medical Students’ Intentions to Practise Rurally. Med. Educ. 2012;46:179–191. doi: 10.1111/j.1365-2923.2011.04102.x. [DOI] [PubMed] [Google Scholar]
- 3.Greenhill J.A., Walker J., Playford D. Outcomes of Australian Rural Clinical Schools: A Decade of Success Building the Rural Medical Workforce through the Education and Training Continuum. Rural Remote Health. 2015;15:2991. [PubMed] [Google Scholar]
- 4.Worley P., Silagy C., Prideaux D., Newble D., Jones A. The Parallel Rural Community Curriculum: An Integrated Clinical Curriculum Based in Rural General Practice. Med. Educ. 2000;34:558–565. doi: 10.1046/j.1365-2923.2000.00668.x. [DOI] [PubMed] [Google Scholar]
- 5.Worley P. Relationships: A New Way to Analyse Community-Based Medical Education? (Part One) Educ. Health. 2002;15:117–128. doi: 10.1080/13576280210133062. [DOI] [PubMed] [Google Scholar]
- 6.Maley M., Worley P., Dent J. Using Rural and Remote Settings in the Undergraduate Medical Curriculum: Amee Guide No. 47. Med. Teach. 2009;31:969–983. doi: 10.3109/01421590903111234. [DOI] [PubMed] [Google Scholar]
- 7.Worley P., Prideaux D., Strasser R., Magarey A., March R. Empirical Evidence for Symbiotic Medical Education: A Comparative Analysis of Community and Tertiary-Based Programmes. Med. Educ. 2006;40:109–116. doi: 10.1111/j.1365-2929.2005.02366.x. [DOI] [PubMed] [Google Scholar]
- 8.Bazemore A., Petterson S., Peterson L.E., Phillips R.L. More Comprehensive Care among Family Physicians is Associated with Lower Costs and Fewer Hospitalizations. Ann. Fam. Med. 2015;13:206–213. doi: 10.1370/afm.1787. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Fukuda Y., Nakamura H., Segawa M., Harada T., Taguchi A., Abe M. Introducing Comprehensive Community Health Care Clerkships in Depopulated Areas. Yamaguchi Med. J. 2015;64:25–34. doi: 10.2342/ymj.64.25. [DOI] [Google Scholar]
- 10.Sung N.J., Choi Y.J., Lee J.H. Primary Care Comprehensiveness Can Reduce Emergency Department Visits and Hospitalization in People with Hypertension in South Korea. Int. J. Environ. Res. Public Health. 2018;15:272. doi: 10.3390/ijerph15020272. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Cho H.Y., MacLachlan M., Clarke M., Mannan H. Accessible Home Environments for People with Functional Limitations: A Systematic Review. Int. J. Environ. Res. Public Health. 2016;13:826. doi: 10.3390/ijerph13080826. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Singh P., Orzol S., Peikes D., Oh E.G., Dale S. Participation in The Comprehensive Primary Care Plus Initiative. Ann. Fam. Med. 2020;18:309–317. doi: 10.1370/afm.2544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Enderlin C.A., McLeskey N., Rooker J.L., Steinhauser C., D’Avolio D., Gusewelle R., Ennen K.A. Review of Current Conceptual Models and Frameworks to Guide Transitions of Care in Older Adults. Geriatr. Nurs. 2013;34:47–52. doi: 10.1016/j.gerinurse.2012.08.003. [DOI] [PubMed] [Google Scholar]
- 14.Hatano Y., Matsumoto M., Okita M., Inoue K., Takeuchi K., Tsutsui T., Nishimura S., Hayashi T. The Vanguard of Community-Based Integrated Care in Japan: The Effect of A Rural Town on National Policy. Int. J. Integr. Care. 2017;17:2. doi: 10.5334/ijic.2451. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Chi W.C., Wolff J., Greer R., Dy S. Multimorbidity and Decision-Making Preferences among Older Adults. Ann. Fam. Med. 2017;15:546–551. doi: 10.1370/afm.2106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Kato D., Wakabayashi H., Takamura A., Takemura Y.C. Identifying the Learning Objectives of Clinical Clerkship in Community Health in Japan: Focus Group. J. Gen. Fam. Med. 2019;21:3–8. doi: 10.1002/jgf2.289. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Kozu T. Medical Education in Japan. Acad. Med. 2006;81:12. doi: 10.1097/01.ACM.0000246682.45610.dd. [DOI] [PubMed] [Google Scholar]
- 18.Jung H., Kim M., Lee Y., Won C.W. Prevalence of Physical Frailty and Its Multidimensional Risk Factors in Korean Community-Dwelling Older Adults: Findings from Korean Frailty and Aging Cohort Study. Int. J. Environ. Res. Public Health. 2020;17:7883. doi: 10.3390/ijerph17217883. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Klepacka M., Bakalarski P. Trust of Society Towards Selected Medical Professions—Doctors, Nurses, Paramedics. Crit. Care Innov. 2018;1:1–10. [Google Scholar]
- 20.Takamura A., Matsumoto M., Ishikawa S. Rural Health in Japan: Past and Future. Rural Remote Health. 2017;17:4521. doi: 10.22605/RRH4521. [DOI] [PubMed] [Google Scholar]
- 21.Mennin S., Petroni-Mennin R. Community-Based Medical Education. Clin. Teach. 2006;3:90–96. doi: 10.1111/j.1743-498X.2006.00093.x. [DOI] [Google Scholar]
- 22.Howe A. Twelve Tips for Community-Based Medical Education. Med. Teach. 2009;24:9–12. doi: 10.1080/00034980120103423. [DOI] [PubMed] [Google Scholar]
- 23.Okayama M. Community-Based Medical Education. Gen. Med. 2014;15:3–4. doi: 10.14442/general.15.3. [DOI] [Google Scholar]
- 24.Kataoka Y., Maeno T., Awatani T., Iguchi S., Inoue K., Owaki T., Okayama M., Kajii E., Takeuchi K., Tani K., et al. A National Survey of Community-Based Medical Education in Japanese Medical Schools (Second Report) Med. Educ. 2017;48:143–146. [Google Scholar]
- 25.Frye A.W., Hemmer P.A. Program Evaluation Models and Related Theories: Amee Guide No. 67. Med. Teach. 2012;34:288–299. doi: 10.3109/0142159X.2012.668637. [DOI] [PubMed] [Google Scholar]
- 26.Tessmer M., Richey R.C. The Role of Context in Learning and Instructional Design. Educ. Technol. Res. Dev. 1997;45:85–115. doi: 10.1007/BF02299526. [DOI] [Google Scholar]
- 27.Saiki T., Imafuku R., Suzuki Y., Ban N. The Truth Lies Somewhere in The Middle: Swinging between Globalization and Regionalization of Medical Education in Japan. Med. Teach. 2017;39:1016–1022. doi: 10.1080/0142159X.2017.1359407. [DOI] [PubMed] [Google Scholar]
- 28.Ichushi Web: About Ichushi. [(accessed on 3 August 2020)]; Available online: www.jamas.or.jp/service/ichu/about.html.
- 29.JDreamIII: About JDreamIII. [(accessed on 3 August 2020)]; Available online: www.jamas.or.jp/service/ichu/about.html.
- 30.CiNii Articles: About CiNii Articles. [(accessed on 3 August 2020)]; Available online: http://ci.nii.ac.jp/
- 31.Hammick M., Dornan T., Steinert Y. Conducting a Best Evidence Systematic Review. Part 1: From Idea to Data Coding. Beme Guide No. 13. Med. Teach. 2010;32:3–15. doi: 10.3109/01421590903414245. [DOI] [PubMed] [Google Scholar]
- 32.Buckley S., Coleman J., Davison I., Khan K.S., Zamora J., Malick S., Morley D., Pollard D., Ashcroft T., Popovic C., et al. The Educational Effects of Portfolios on Undergraduate Student Learning: A Best Evidence Medical Education (Beme) Systematic Review. Beme Guide No. 11. Med. Teach. 2009;31:282–298. doi: 10.1080/01421590902889897. [DOI] [PubMed] [Google Scholar]
- 33.Van Eupen M., Metzger M.J., Pérez-Soba M., Verburg P.H., van Doorn A., Bunce R.G.H. A Rural Typology for Strategic European Policies. Land Use Policy. 2012;29:473–482. doi: 10.1016/j.landusepol.2011.07.007. [DOI] [Google Scholar]
- 34.Okayama M., Kajiyama E. Educational Effects of a Standardized Program for Community-Based Clinical Clerkships. Med. Educ. Jpn. 2004;35:197–202. [Google Scholar]
- 35.Takayashiki A., Okayama M., Otaki J., Mise J., Nakamura Y., Kajii E. Opinions of Japanese Medical Students on the Necessity of Experience in Community-Based Learning Programs. Med. Educ. Jpn. 2005;36:47–54. [Google Scholar]
- 36.Tani K., Iwasaki T., Kawaminami S., Yuasa S., Saijo A. Evaluation of Primary Care Practice in the University of Tokushima. J. Med. Investig. 2009;56:81–87. doi: 10.2152/jmi.56.81. [DOI] [PubMed] [Google Scholar]
- 37.Okayama M., Kajii E. Does Community-Based Education Increase Students’ Motivation to Practice Community Health Care? —A Cross Sectional Study. BMC Med. Educ. 2011;11:1–6. doi: 10.1186/1472-6920-11-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Okayama M., Kajii E. Does the Instructional Quality of Community- Based Clinical Clerkships Influence Students’ Career Preferences? Int. J. Med. Educ. 2011;2:74–79. doi: 10.5116/ijme.4e4a.d171. [DOI] [Google Scholar]
- 39.Hashiba J., Kawaki E., Uehara S., Zamami T., Takemura K. Report of Student-Led Fieldwork in the Community. Ryukyu Med. J. 2011;30:61–67. [Google Scholar]
- 40.Iwasaki T., Takeyama Y., Iki M., Itoh H., Ohyanagi H., Shiozaki H., Matsuo O. The Changes in Students’ Consciousness about Community Medicine during Our Program. Med. Educ. Jpn. 2011;42:101–112. [Google Scholar]
- 41.Tani K., Yamaguchi H., Tada S., Kondo S., Tabata R., Yuasa S., Kawaminami S., Nakanishi Y., Ito J., Shimizu N., et al. Community-Based Clinical Education Increases Motivation of Medical Students to Medicine of Remote Area: Comparison between Lecture and Practice. J. Med. Investig. 2014;61:156–161. doi: 10.2152/jmi.61.156. [DOI] [PubMed] [Google Scholar]
- 42.Katsube T., Ono E., Moriwaki Y., Itamochi S., Okuda J., Nagase M., Ohta R. Analysis of Answers for Satisfaction Survey in Medical Students of Shimane University. Med. J. Unnan City Hosp. 2016;13:57–61. [Google Scholar]
- 43.Tani K., Okura Y., Tabata R., Yuasa S., Kawaminami S., Nakanishi Y., Kawahito K., Inaba K., Inaba K., Kageji T., et al. Characteristics of Medical Students Who Would Like to Be A Generalist Physician and Contribute to Remote Area Medicine. J. Med. Investig. 2017;64:210–216. doi: 10.2152/jmi.64.210. [DOI] [PubMed] [Google Scholar]
- 44.Moriwaki Y., Okuda J., Zotani H., Otani J., Nitta F., Katsube T. Community-Based Medical Education Performed by Surgeons in A Rural Area. Jpn. J. Clin. Exp. Med. 2018;95:905–909. [Google Scholar]
- 45.Yamada K., Takahashi N., Miyashita Y., Nakata M., Ishikawa A., Katakura Y., Tano E., Sahara H., Akashi H., Soma H., et al. “Community Health Care Practice on Rishiri Island” for Students in Their First Year in the School of Medicine and School of Health Sciences, Sapporo Medical University—Starting from Scratch. J. Cent. Med. Educ. 2010;12:37–43. [Google Scholar]
- 46.Nakada M., Yamada K., Takahashi N., Miyashita Y., Katakura Y., Ishikawa A., Tano E., Akashi H., Soma H. Students’ Learning in “Community Health Care Practice on Rishiri Island”—Analysis of Their Reports—. J. Cent. Med. Educ. Sapporo. 2010;12:27–35. [Google Scholar]
- 47.Uehara S., Zamami T., Takemura K. A Possibility of Community-Based Medical Education Provided by Student-Directed Fieldwork in the Community. Ryukyu Med. J. 2011;30:55–60. [Google Scholar]
- 48.Takamura A., Ie K., Takemura Y. Overcoming Challenges in Primary Care Education: A Trial of a Longitudinal Integrated Clerkship in a Rural Community Hospital Setting in Japan. Educ. Prim. Care. 2015;26:122–126. doi: 10.1080/14739879.2015.11494326. [DOI] [PubMed] [Google Scholar]
- 49.Saiki T., Abe K., Kawakami C., Fujisaki K., Suzuki Y. How Do Medical Students Develop the Self-Awareness as Social Entities During the Longitudinal Communication Experience with Citizens? J. Contemp. Med. Educ. 2016;4:89–96. doi: 10.5455/jcme.20160330021106. [DOI] [Google Scholar]
- 50.Ohta R., Son D. What Do Medical Residents Learn on a Rural Japanese Island? J. Rural Med. 2018;13:11–17. doi: 10.2185/jrm.2950. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Yamada K. Standard of Living Generated Though the Traning in Ural Islnand from the Analysis of Discourse of First Grade Students. J. Cent. Med. Educ. 2018;9:15–26. [Google Scholar]
- 52.Ohta R., Ryu Y., Katsube T., Moriwaki Y., Otani J. Students’ Perceptions of General Medicine Following Community-Based Medical Education in Rural Japan. J. Gen. Fam. Med. 2019;20:236–243. doi: 10.1002/jgf2.274. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Takamura A., Misaki H., Takemura Y. Community and Interns’ Perspectives on Community-Participatory Medical Education: From Passive to Active Participation. Fam. Med. 2017;49:507–513. [PubMed] [Google Scholar]
- 54.Ohta R., Kamiyama Y., Makishi T. Inquiry into Short-Term Learning on Japanese Rural Islands: A Qualitative Study. Educ. Prim. Care. 2019;30:1–8. doi: 10.1080/14739879.2019.1570350. [DOI] [PubMed] [Google Scholar]
- 55.Kelly L., Walters L., Rosenthal D. Community-Based Medical Education: Is Success A Result of Meaningful Personal Learning Experiences? Educ. Health. 2014;27:47–50. doi: 10.4103/1357-6283.134311. [DOI] [PubMed] [Google Scholar]
- 56.Shimizu T., Tsugawa Y., Tanoue Y., Konishi R., Nishizaki Y., Kishimoto M., Shiojiri T., Tokuda Y. The Hospital Educational Environment and Performance of Residents in the General Medicine in-Training Examination: A Multicenter Study in Japan. Int. J. Gen. Med. 2013;6:637–640. doi: 10.2147/IJGM.S45336. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Worley P., Murray R. Social Accountability in Medical Education—An Australian Rural and Remote Perspective. Med. Teach. 2011;33:654–658. doi: 10.3109/0142159X.2011.590254. [DOI] [PubMed] [Google Scholar]
- 58.Pagatpatan C.P., Jr., Valdezco J.A.T., Lauron J.D.C. Teaching the Affective Domain in Community-Based Medical Education: A Scoping Review. Med. Teach. 2020;42:507–514. doi: 10.1080/0142159X.2019.1707175. [DOI] [PubMed] [Google Scholar]
- 59.Cristobal F., Worley P. Can Medical Education in Poor Rural Areas Be Cost-Effective and Sustainable: The Case of The Ateneo De Zamboanga University School of Medicine. Rural Remote Health. 2012;12:1835. doi: 10.22605/RRH1835. [DOI] [PubMed] [Google Scholar]
- 60.Matsumoto M., Kimura K., Inoue K., Kashima S., Koike S., Tazuma S. Aging of Hospital Physicians in Rural Japan: A Longitudinal Study Based on National Census Data. PLoS ONE. 2018;13:e0198317. doi: 10.1371/journal.pone.0198317. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Stagg P., Prideaux D., Greenhill J., Sweet L. Are Medical Students Influenced by Preceptors in Making Career Choices, and If So How? A systematic review. Rural Remote Health. 2012;12:1832. [PubMed] [Google Scholar]
- 62.Amato F., Castiglione A., Mercorio F., Mezzanzanica M., Moscato V., Picariello A., Sperlì G. Multimedia Story Creation on Social Networks. Future Gener. Comput. Syst. 2018;86:412–420. doi: 10.1016/j.future.2018.04.006. [DOI] [Google Scholar]
- 63.Rutter H., Savona N., Glonti K., Bibby J., Cummins S., Finegood D.T., Greaves F., Harper L., Hawe P., Moore L., et al. The Need for a Complex Systems Model of Evidence for Public Health. Lancet. 2017;390:2602–2604. doi: 10.1016/S0140-6736(17)31267-9. [DOI] [PubMed] [Google Scholar]
- 64.Mahoney S., Sladek R.M., Neild T. A Longitudinal Study of Empathy in Pre-Clinical and Clinical Medical Students and Clinical Supervisors. BMC Med. Educ. 2016;16:270. doi: 10.1186/s12909-016-0777-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Bartlett M., Dowell J., Graham F., Knight K., Law S., Lockwood P., Muir F., Robson J., Watson E. Dundee’s Longitudinal Integrated Clerkship: Drivers, implementation and early evaluation. Educ. Prim. Care. 2019;30:72–79. doi: 10.1080/14739879.2018.1564889. [DOI] [PubMed] [Google Scholar]
- 66.Wheat J.R., Brandon J.E., Leeper J.D., Jackson J.R., Boulware D.W. Rural Health Leaders Pipeline, 1990–2005: Case Study of A Second-Generation Rural Medical Education Program. J. Agromed. 2007;12:51–61. doi: 10.1080/10599240801985951. [DOI] [PubMed] [Google Scholar]
- 67.Ohta R., Ryu Y., Katsube T., Otani J., Moriwaki Y. Strengths and Challenges for Medical Students and Residents in Rural Japan. Fam. Med. 2021;53:809–815. doi: 10.22454/FamMed.2021.308872. [DOI] [PubMed] [Google Scholar]
- 68.Cotton P., Sharp D., Howe A., Starkey C., Hibble A., Laue B., Benson J. Developing a Set of Quality Criteria for Community-Based Medical Education in the UK. Educ. Prim. Care. 2009;20:143–151. doi: 10.1080/14739879.2009.11493785. [DOI] [PubMed] [Google Scholar]
- 69.Somporn P., Ash J., Walters L. Stakeholder Views of Rural Community-Based Medical Education: A Narrative Review of The International Literature. Med. Educ. 2018;52:791–802. doi: 10.1111/medu.13580. [DOI] [PubMed] [Google Scholar]
- 70.Muller J.H., Jain S., Loeser H., Irby D.M. Lessons Learned about Integrating A Medical School Curriculum: Perceptions of Students, Faculty and Curriculum Leaders. Med. Educ. 2008;42:778–785. doi: 10.1111/j.1365-2923.2008.03110.x. [DOI] [PubMed] [Google Scholar]
- 71.Longenecker R.L., Schmitz D. Building A Community of Practice in Rural Medical Education: Growing Our Own Together. Rural Remote Health. 2017;17:4195. doi: 10.22605/RRH4195. [DOI] [PubMed] [Google Scholar]
- 72.Yahata S., Takeshima T., Kenzaka T., Okayama M. Long-Term Impact of Undergraduate Community-Based Clinical Training on Community Healthcare Practice in Japan: A Cross-Sectional Study. BMC Med. Educ. 2020;20:337. doi: 10.1186/s12909-020-02258-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Yahata S., Takeshima T., Kenzaka T., Okayama M. Fostering Student Motivation Towards Community Healthcare: A Qualitative Study. BMJ Open. 2021;11:e039344. doi: 10.1136/bmjopen-2020-039344. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Mitura K. The Impact of Covid-19 Pandemic on Critical Care and Surgical Services Availability. Crit. Care Innov. 2020;3:43–50. [Google Scholar]
- 75.Martin A., Lang E., Ramsauer B., Gröning T., Bedin G.L., Frank J. Continuing Medical and Student Education in Dermatology during The Coronavirus Pandemic—A Major Challenge. JDDG. 2020;18:835–840. doi: 10.1111/ddg.14190. [DOI] [PubMed] [Google Scholar]
- 76.Ohta R., Nishikura N., Sano C. Impact of COVID-19 on The Analytical Diagnosing Ability of Family Medicine Residents. J. Gen. Fam. Med. 2020 doi: 10.1002/jgf2.393. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All relevant data sets in this study are described in the manuscript.