Abstract
Background
Although burnout is viewed as a syndrome rooted in the working environment and organizational culture, the role of the learning environment in the development of resident burnout remains unclear. We aimed to evaluate the association between burnout and the learning environment in a cohort of Belgian residents.
Methods
We conducted a cross-sectional online survey among residents in a large university hospital in Belgium. We used the Dutch version of the Maslach Burnout Inventory (UBOS-C) to assess burnout and the Dutch Residency Educational Climate Test (D-RECT) to assess the learning environment.
Results
A total of 236 residents (29 specialties) completed the survey (response rate 34.6%), of which 98 (41.5%) met standard criteria for burnout. After multivariate regression analysis adjusting for hours worked per week, quality of life and satisfaction with work-life balance, we found an inverse association between D-RECT scores and the risk of burnout (adjusted odds ratio; 0.47 for each point increase in D-RECT score; 95% CI, 0.23 – 0.95; p = 0.01).
Conclusions
Resident burnout is highly prevalent in our cohort of Belgian residents. Our results suggest that the learning environment plays an important role in reducing the risk of burnout among residents.
Keywords: Resident burnout, Resident well-being, Quality of life, Learning environment, Competency-based education
Background
Burnout is a work-related syndrome that is primarily driven by workplace stressors [1]. Three dimensions define burnout: emotional exhaustion, depersonalization and a diminished sense of personal accomplishment [2]. Although individual traits might play a role in the development of physician burnout, a recent meta-analysis indicates that organization-directed approaches are more effective in reducing burnout compared to individual interventions [3]. This finding supports the hypothesis that burnout is rooted in issues related to working environment and organizational culture, instead of being an individual problem.
Burnout among medical residents is highly prevalent [4–6]. High educational demands, long working hours, lack of autonomy, a high level of work-home interference, a lack of reciprocity in professional relationships and uncertainty about the future are common explanations [7–10]. Rates between 25 and 60% have been reported in a wide spectrum of medical specialties [11]. These large ranges can be attributed to the use of different definitions, measurements and study designs [12]. Resident burnout is a major concern because it has serious consequences on patient outcomes and on the personal lives of residents. Importantly, burnout is linked with an increase in medical errors and reduced quality of patient care [7, 13, 14]. Furthermore, residents who suffer from burnout have an increased risk of substance abuse and suicidal ideation [15].
Burnout could be an obvious outcome of the context residents participate in during their day-to-day work as a doctor [16]. This context is also known as the learning environment, which is a complex construct that includes formal and informal aspects of the training program, as well as the overall atmosphere [17] and organizational aspects within the teaching hospital [18]. The way people in a particular department approach the process of learning is considered a reflection of the learning environment [19]. This learning environment is thought to play a key role in the development of residents towards independent practice [20]. It has been hypothesized that the learning environment could be an important driver of burnout [6, 17, 20, 21]. Although specific characteristics of the learning environment appear to be critically influencing medical student burnout [22], the role the learning environment plays in resident burnout is less clear. Furthermore it is unknown which characteristics of the learning environment are associated with symptoms of burnout in residents.
We aimed to assess how the perceived quality of the learning environment relates to burnout in a sample of Belgian residents from different specialties in a single academic hospital. Secondarily we set out to determine which characteristics of the learning environment are associated with resident burnout. Moreover, we aimed to determine the effect size of the learning environment by controlling for several demographic and occupational predictors of resident burnout. We hypothesized that a consistent and relevant association exists between the perceived quality of the learning environment and burnout.
Methods
All residents that were enrolled in one of the postgraduate medical training programs in the University Hospitals Leuven in Belgium on the 1st of December 2016 received an invitation by email to participate in the study and complete an online self-report survey. Residents were recruited from this single academic center because all specialty training programs share the same educational framework. The invitation was sent by the local association of residents to guarantee anonymity. Residents received a reminder after 2 weeks if the survey was not completed by that time. The local ethical board determined that the study was exempt from formal ethical review. This study was carried out according to the ethical principles for medical research involving human subjects of the WMA Declaration of Helsinki. No individual data were collected, anonymity was guaranteed, participation was voluntary, and informed consent was obtained.
Learning environment
To assess the quality of the learning environment we used the recently revised version of the Dutch Residency Educational Climate Test (D-RECT) [23]. The revised D-RECT is a validated 35-itemd questionnaire to assess 9 subscales of the learning environment. The 9 subscales that comprise the D-RECT are: educational atmosphere, teamwork, role of specialty tutor, coaching and assessment, formal education, resident peer collaboration, work is adapted to resident’s competence, accessibility of supervisors and patient sign-out. Respondents are asked to indicate their agreement on a scale ranging from 1 (totally disagree) to 5 (totally agree).
Burnout
We used the validated Dutch version (UBOS-C) [24] of the Maslach Burnout Inventory (MBI) to assess burnout. This instrument consists of 20 items covering the three dimensions of burnout: emotional exhaustion (8 items), depersonalization (5 items) and personal accomplishment (7 items). Items were scored on a 7-point Likert scale ranging from ‘never’ (0) to ‘always’ (6). Mean scores were calculated for each dimension. Cut-off scores were used for ascertainment of burnout, based on a reference group of 10,552 Dutch healthcare employees [23]. A resident was diagnosed with burnout if there was either a mean score ≥ 2.50 on emotional exhaustion and ≥ 1.80 (men) or ≥ 1.60 (women) on depersonalization, or a mean score ≥ 2.50 on emotional exhaustion and a mean score of ≤ 3.70 on personal accomplishment [25].
Demographic and training-related characteristics
Respondents provided information on: gender, age, type of medical specialty, year of postgraduate training, total number of hours spent working per week and the number of hours per week spent on clinical (patient related) activities, administrative (non-clinical) activities and activities related to training. Furthermore, we measured residents’ overall quality of life using a single-item linear analogue self-assessment (scale 1 to 5, with response options ranging from “As bad as it can be” to “As good as it can be”) and residents’ satisfaction with their work-life balance using a similar 5-point scale. These instruments are validated and widely used in quality of life research [2].
Statistical analysis
All analyses were done using SPSS version 17 (SPSS Inc., Chicago, Illinois, US). Standard descriptive summary statistics were used to characterize the sample. Evaluations that were missing more than 17 items (> 50% of total items) were excluded from further analysis. The remaining missing values were assumed to be missing at random and imputed by expectation maximization. Independent Student’s t tests (continuous variables) were computed to compare means. Multivariate logistic regression analysis was conducted to evaluate the association between learning environment (D-RECT scores) and resident burnout, adjusted for potential predictors of burnout. Predictors of burnout were determined in a univariate analysis. In the multivariate model, we adjusted factors that were independently associated with burnout. None of the included variables were associated with the D-RECT scores, thus the assumption of linearity was not violated. All tests used were two-tailed and p-values < 0.05 were considered significant.
Results
Sample descriptive statistics
Of the 682 residents who received an invitation, 252 participated. A total of 16 evaluations were excluded due to missing values, which gave us a sample of 236 (29 different specialties) evaluations (response rate 34.6%). A total of 98 (41.5%) residents fulfilled the standard criteria for burnout. One hundred twenty five residents (53.0%) scored high on the scale of emotional exhaustion, 125 (53.0%) scored high on the scale of depersonalization, and 60 (23.4%) scored low on the scale of personal accomplishment. The mean score (SD) of the D-RECT was 2.65 (0.43). The median age of the residents was 28 years (range 26 – 40). Residents spent an average of 60.9 (SD; 10.1) hours working per week. A total of 32.6 (SD; 14.9) hours per week were spent on clinical activities, 23.4 (SD; 14.2) on administrative activities and 4.3 (SD; 5.5) on training related activities. Residents with burnout spent an average of 2.61 working hours more per week compared to those without burnout (95% CI of difference; − 5.23 to 0.004, p = 0.05). We found no association between burnout and the total number of hours per week spent on clinical (patient related) activities (p = 0.60), training activities (p = 0.08) or non-training activities (e.g. administrative tasks) (p = 0.25). Table 1 shows the demographic and occupational characteristics of the responding residents and their association with burnout.
Table 1.
Demographic and occupational characteristics of participating residents and associations (Pearson’s chi squared tests) between demographic, occupational and quality of life characteristics and burnout
| Total number of participating residents (% of total) | Number of residents with burnout (% of total) | p-value of difference in burnout rate per characteristic | |
|---|---|---|---|
| Gender | |||
| Male | 96 (40.7) | 45 (46.9) | |
| Female | 140 (59,3) | 53 (37.9) | |
| 0.17 | |||
| Years in training | |||
| 1 | 52 (22.2) | 22 (42.3) | |
| 2 | 23 (9.7) | 11 (47.8) | |
| 3 | 31 (13.1) | 8 (25.8) | |
| 4 | 50 (21.2) | 24 (48.0) | |
| 5 | 45 (19.1) | 18 (40.0) | |
| 6 | 25 (10.6) | 11 (44.0) | |
| 7 | 8 (3.4) | 2 (25.0) | |
| 0.49 | |||
| Type of specialty | |||
| Surgical | 57 (24.2) | 26 (45.6) | |
| Medical | 144 (61.0) | 59 (41.0) | |
| Supportive | 34 (14.4) | 12 (35.3) | |
| missing | 1 (0.4) | ||
| 0.62 | |||
| Satisfaction with work/life balance | |||
| Very dissatisfied | 31 (13.1) | 21 (67.7) | |
| Dissatisfied | 4 (1.7) | 2 (50.0) | |
| Neutral | 69 (29.2) | 14 (20.3) | |
| Satisfied | 130 (55.1) | 61 (46.9) | |
| Very satisfied | 2 (0.8) | 0 (0.0) | |
| < 0.001 | |||
| Quality of life | |||
| As bad as it can be | 12 (5.1) | 10 (83.3) | |
| Bad | 59 (25.0) | 37 (62.7) | |
| Neutral | 79 (33.5) | 37 (46.8) | |
| Good | 77 (32.6) | 14 (18.2) | |
| As good as it can be | 9 (3.8) | 0 (0.0) | |
| < 0.001 | |||
| Burned outa | 98 (41.5) | ||
| Emotionally exhaustedb | 125 (53.0) | ||
| Depersonalizedb | 125 (53.0) | ||
| Reduced personal accomplishmentb | 60 (23.4) | ||
aRepresents a high score (>75th percentile of reference group, Schaufeli ea.) on emotional exhaustion, combined with a high score on depersonalization and/or a low score (<25th percentile of reference group) on personal accomplishment
bCut-off scores are determined as >75th percentile of the reference group (Schaufeli ea.) for emotional exhaustion and depersonalization and < 25th percentile of the reference group for reduced personal accomplishment
Multivariate analysis
We used univariate analyses to identify demographic and occupational predictors of burnout. We found that gender (p = 0.17), year of training (p = 0.49), type of specialty (p = 0.62) and age (p = 0.32) were not associated with burnout. However, we found that the true number of hours worked per week (p = 0.05), satisfaction with work-life balance (p < 0.001) and overall quality of life (p < 0.001) were associated with burnout. After controlling for these predictors of resident burnout in a multivariate regression analysis, we found an inverse relationship between the mean D-RECT score and the risk of burnout (adjusted odds ratio, 0.47 for 1-point increase in D-RECT score; 95% CI, 0.23 – 0.95; p = 0.01).
Bivariate analysis
We found that residents without burnout gave significantly higher D-RECT scores (mean, SD; 2.71, 0.39) than residents with burnout (mean, SD; 2.56, 0.46) (95% confidence interval for difference; 0.03 to 0.46, p = 0.006). The difference in D-RECT score between residents with and without burnout can be explained by a difference in D-RECT score for the dimension of emotional exhaustion and depersonalization (Table 2).
Table 2.
Association between the 3 dimensions of burnout and overall burnout and the mean overall D-RECT scores (learning environment) in Belgian residents
| Mean score D-RECT (SD) | 95% CI of difference | p-value | ||
|---|---|---|---|---|
| Emotional exhaustion | Exhausted | 2.57 (0.39) | 0.06 to 0.27 | 0.003 |
| Not exhausted | 2.74 (0.44) | |||
| Depersonalization | Depersonalization | 2.57 (0.41) | 0.06 to 0.27 | 0.003 |
| No depersonalization | 2.73 (0.42) | |||
| Reduced personal accomplishment | Not competent | 2.64 (0.36) | − 0.12 to 0.14 | 0.86 |
| Competent | 2.65 (0.45) | |||
| Overall burnout | Burnout | 2.56 (0.46) | 0.03 to 0.46 | 0.006 |
| No burnout | 2.71 (0.39) | |||
Subscales of the D-RECT
Regarding the subscales of the D-RECT, we found that the scores on the subscales ‘role of the specialty tutor’ and ‘coaching and assessment’ were significantly higher in residents without burnout compared to those who suffer from burnout (Table 3).
Table 3.
Comparison (Student’s t-tests) of overall D-RECT scores (learning environment) and D-RECT subscale scores in residents with and without burnout. To adjust for multiple comparisons p values < 0.01 were considered significant
| Subscale of the D-RECT | Mean score D-RECT in residents with burnout | Mean score D-RECT in residents without burnout | 95% CI for difference | p value |
|---|---|---|---|---|
| Educational atmosphere | 2.31 | 2.46 | −0.04 – 0.33 | 0.12 |
| Teamwork | 2.80 | 3.02 | −0,02 – 0.45 | 0.07 |
| Role of specialty tutor | 2.35a | 2.59a | 0.08 – 0.39 | 0.003a |
| Coaching and assessment | 2.06a | 2.53a | 0.26 – 0.66 | < 0.001a |
| Formal education | 2.78 | 2.99 | 0,03 – 0.39 | 0.02 |
| Resident peer collaboration | 2.78 | 2.72 | −0.35 – 0.22 | 0.64 |
| Work is adapted to resident’s competence | 3.00 | 3.06 | −0.16 – 0.27 | 0.61 |
| Accessibility of supervisors | 2.95 | 2.66 | −0.54 – − 0.02 | 0.03 |
| Patient sign-out | 2.86 | 2.85 | −0.26 – 0.25 | 0.91 |
| Overall D-RECT score | 2.56a | 2.71a | 0.05 – 0.26 | 0.006a |
aStatistically significant
Discussion
Main findings
In this study, we examined the association between the perceived quality of the learning environment and resident burnout. We found that, even after adjusting for predictors of burnout, there was a significant and relevant association between the learning environment and burnout in our sample of Belgian residents from 29 different specialties.
Environmental factors associated with burnout
Our multivariate analysis suggests that there is a significant and strong exposure-response relationship (OR 0.47) between the learning environment and burnout. Analysis of the subscales that comprise the D-RECT (learning environment) shows environmental factors that explain the association between learning environment and burnout are the subscales ‘role of the specialty tutor’ and ‘coaching and assessment’. The environmental factor role of the specialty tutor focuses on the behaviour of the supervisor. The amount of support from faculty members and the perception of being mistreated are strongly related to burnout among medical students [22]. Stressful relationships with supervisors [5] and insufficient autonomy [26] are in a similar way associated with burnout in residents. In contrast, residents who find their relationship with their supervisors mutually supportive and beneficial have fewer symptoms of burnout than trainees who feel under-appreciated by their supervisors [27]. Our results regarding the role of supervisory support in resident burnout are in agreement with these findings. The environmental factor ‘coaching and assessment’ is concerned with feedback, assessment of medical and general competencies and with supervisors evaluating whether a resident’s performance in patient care is in line with that resident’s level of training. Our results underline previous reports on the importance of regular feedback in the prevention of burnout [28]. When regular feedback regarding preparedness is lacking, residents might feel uncertain about whether they are prepared to perform a specific task [29], which could drive burnout.
Learning environment scores explained
A recent study found a considerably higher rating for the quality of the learning environment in a large cohort of Dutch residents compared to the rating we found in our study [30]. We were able to use the same instrument (D-RECT) to assess the learning environment because the residents participating in our study share the same language as their Dutch counterparts. We have to acknowledge that the D-RECT has not been validated in the Belgian context and minor language and culture differences might affect the interpretation of some of the items. Nevertheless, we think that these minor differences cannot explain the large difference in D-RECT scores between the two studies. Little is known about what a specific score in the D-RECT says about the underlying construct, but score differences between teaching hospitals could guide initiatives to improve the learning environment. Several educational differences exist that could partly explain this difference in the perceived quality of the learning environment between Belgian and Dutch residents. Educational programs in the Netherlands have been modernized to become competency-based [31]. These competency-based programs promote learner-centeredness and shift the focus away from what is taught, towards what is learnt. The Belgian curriculum is mainly time-based and, although initiatives have been taken to put more emphasis on the development of generic competencies, appraisal tools have yet to be introduced. Novel coaching and assessment tools, that have been introduced and are broadly used in the Netherlands [31], generate more attention to feedback, which is likely appreciated by residents and reflected in higher D-RECT scores. On the other hand, we have to note that based on our study results, we are unable to determine which environmental factors are responsible for a difference in D-RECT score between the Belgian and Dutch residents. Moreover, the learning environment is believed to form the center of educational change [17] and the effectiveness of competency-based innovations seems to benefit from a supportive learning environment [20]. Hence, more research is needed to understand the dynamics of the relationship between educational innovations and perceived quality of the learning environment.
Burnout prevalence
We found a burnout rate of 41%, which is much higher than the rate of 21% that was found in a national Dutch study [1], which used the same instrument and criteria for burnout as we did. This can be explained by the shorter workweek of 48 h of Dutch residents, which is reasonably lower than the workweek we found our cohort: 60.9 h per week. We have to state that the difference in work hours between residents with burnout and without burnout was relatively small in the current study (2.6 h), which makes it doubtful whether this difference is relevant. The effect of number of hours worked on the development of resident burnout remains controversial, but a recent study indicates that a higher number of work hours does increase the risk of resident burnout [7]. An earlier study conducted in Belgium, including residents from multiple teaching hospitals and using the same instrument to assess burnout (UBOS-C), found a rate of 33.5% resident burnout [3], which is still lower than the rate we found. This difference in burnout rate can be explained by the fact that our study was conducted in a single academic center, instead of including multiple hospitals.
Practical implications and future research
The results of a recent meta-analysis suggest that burnout among physicians, including residents, is driven by organizational factors rather than individual factors [15]. These results are in agreement with insights that burnout is not an indication of personal failing but rather of a failing working and social environment [32]. This environment includes aspects of the workload, schedule, communication, workflow and teamwork [15, 33]. Several training-related factors, like high educational demands and lack of autonomy, pose an additional risk to residents when compared to physicians that are not in training [1]. Moreover, some even state that burnout is the obvious outcome of the disconnect between medical training programs and the realities of the need to work with colleagues, hospital personnel and patients who have different visions of how the healthcare organization should operate [16]. We have to note however, that burnout is assumed to be the result of a chronic imbalance between job demands and job resources [13]. Hence, we cannot conclude that resident burnout is simply caused by a poor learning environment. Nevertheless, we do believe that the learning environment plays an important role in the motivational process of residents, because a healthy learning environment fosters growth, learning and development [17, 20, 22]. Initiatives to improve the learning environment and contribute to burnout prevention should preferably address the learning environment as a whole and focus in particular on improving supervisory support and improve the quality of coaching and assessment. This could be achieved by the implementation of faculty staff development, which provides faculty members with requisite pedagogic tools needed to enhance supervisory performance (e.g. giving feedback, application of coaching and assessment), establish an optimal learning environment and enable them to detect and respond to emotional distress [34]. Additional research is needed to explore causal relationships between the environmental factors associated with burnout and to determine which approach has the highest potential for minimising resident burnout. Future prospective studies could be designed that randomise residents to a training program that pays attention to more generic competencies, versus a more traditional program, because training generic competencies has shown to reduce the risk of burnout in junior medical specialists [35]. These study designs could also evaluate new assessment and appraisal tools, because they are thought to aid in better preparing residents for practice and improve their well-being in the end [20, 35].
Strengths and limitations
The current study is the first to describe a consistent association between the learning environment and burnout among residents using the complete MBI and D-RECT rather than abbreviated versions. We were able to adjust for work hours, quality of life and work life balance, which allowed a robust analysis of the quality of the learning environment and the development of burnout. This study has several limitations. The response rate of 34.5% was relatively low, although it is higher than most other survey studies using online questionnaires [1, 4]. The absolute difference in D-RECT (learning environment) scores we found when comparing residents with and without burnout was rather small. It could be possible that this difference, although significant, is too small to be relevant. What argues against this explanation is the fact that the D-RECT makes use of a 5-point Likert scale, which restricts residents in their ability to indicate improvement as they only have very few options to discriminate between levels of agreement with every item. Earlier work on learning environment using the same instrument has shown similar significant but small differences [18]. Our cross-sectional study design precludes determination of whether the learning environment is causally related to burnout. It could be possible that residents who suffer from burnout are simply more likely to give a lower rating for the learning environment. However, only specific aspects of the learning environment (role of the specialty tutor, coaching and assessment) were associated with burnout and other aspects were not, which argues against an overall lower rating of the learning environment by residents with burnout. Furthermore, we didn’t include an instrument to evaluate personality traits, which is thought to be a risk factor of resident burnout. Nevertheless, the extent to which personality relates to the development of resident burnout has yet to be determined and organizational factors are thought to play a more important role than individual factors [15]. Moreover, our study was conducted at a single institution, limiting the generalizability of our results. Finally, despite the high response rate our results are possibly limited by response bias. Residents with burnout could be more likely to complete questionnaires regarding burnout because the topic is relevant to them, but they could also be to apathetic to complete the questionnaire. The way resident burnout influences response rate is unknown.
Conclusions
We found a consistent association between the perceived quality of the learning environment and burnout in residents. Given the serious personal and professional ramifications of resident burnout, there is a need for interventions addressing factors of the learning environment that drive burnout. It is desirable that these include improvement of supervisory support and coaching and assessment. Future research should evaluate which organization-directed approaches are most effective in preventing resident burnout.
Acknowledgements
The authors would like to thank the residents of the University Hospitals of Leuven who completed the survey. Special thanks goes to the Leuven Resident Association (LVGA) for their assistance in distributing the survey.
Funding
Not applicable.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- D-RECT
Dutch residency educational climate test
- MBI
Maslach burnout inventory
- UBOS-C
Utrechtse burnout schaal voor contactuele beroepen
Authors’ contributions
SNV and HH initiated and designed the study. SNV and SAR were responsible for collecting the data for this study. SNV and LG were responsible for the data analysis. All authors contributed to the interpretation of the data. SNV, LG and HH were mainly responsible for writing the draft. PLPB and CCPMV provided input and contributed to several versions of the draft. All authors read and approved the final version of the manuscript.
Ethics approval and consent to participate
This study was carried out according to the ethical principles for medical research involving human subjects of the WMA Declaration of Helsinki. No individual data were collected, anonymity was guaranteed, participation was voluntary, and informed consent was obtained. The ethical board of the University Hospitals of Leuven determined that the study was exempt from formal ethical review.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Stefan N. van Vendeloo, Email: stefanvanvendeloo@gmail.com
Lode Godderis, Email: lode.godderis@kuleuven.be.
Paul L. P. Brand, Email: p.l.p.brand@isala.nl
Kees C. P. M. Verheyen, Email: c.c.p.m.verheyen@isala.nl
Suria A. Rowell, Email: suria.rowell@gmail.com
Harm Hoekstra, Email: harm.hoekstra@uzleuven.be.
References
- 1.Bakker AB, Demerouti E. Job demands-resources theory: taking stock and looking forward. J Occup Health Psychol. 2016;22(3):273–285. doi: 10.1037/ocp0000056. [DOI] [PubMed] [Google Scholar]
- 2.Maslach C, Jackson SE, Leiter MP. Maslach burnout inventory manual. 3. Palo Alto: Consulting Psychologist Press; 1996. [Google Scholar]
- 3.Panagioti M, Panagopoulou E, Bower P, Lewith G, Kontopantelis E, Chew-Graham C, et al. Controlled interventions to reduce burnout in physicians: a systematic review and meta-analysis. JAMA Intern Med. 2017;177:195–205. doi: 10.1001/jamainternmed.2016.7674. [DOI] [PubMed] [Google Scholar]
- 4.Prins JT, Hoekstra-Weebers JE, Gazendam-Donofrio SM, Dillingh GS, Bakker AB, Huisman M, et al. Burnout and engagement among resident doctors in the Netherlands: a national study. Med Educ. 2010;44:236–247. doi: 10.1111/j.1365-2923.2009.03590.x. [DOI] [PubMed] [Google Scholar]
- 5.West CP, Shanafelt TD, Kolars JC. Quality of life, burnout, educational debt, and medical knowledge among internal medicine residents. JAMA. 2011;306:952–960. doi: 10.1001/jama.2011.1247. [DOI] [PubMed] [Google Scholar]
- 6.Vandenbroeck S, Lambreghts C, De Witte H, Vanhaecht K, Godderis L. Burnout and work engagement in medical trainees and specialists. Tijdschr voor Geneskunde. 2017;73:9–16. [Google Scholar]
- 7.Shanafelt TD, Bradley KA, Wipf JE, Back AL. Burnout and self-reported patient care in an internal medicine residency program. Ann Intern Med. 2002;136:358–367. doi: 10.7326/0003-4819-136-5-200203050-00008. [DOI] [PubMed] [Google Scholar]
- 8.Prins JT, Gazendam-Donofrio SM, Tubben BJ, van der Heijden FM, van de Wiel HB, Hoekstra-Weebers JE. Burnout in medical residents: a review. Med Educ. 2007;41:788–800. doi: 10.1111/j.1365-2923.2007.02797.x. [DOI] [PubMed] [Google Scholar]
- 9.Dyrbye L, Shanafelt T. A narrative review on burnout experienced by medical students and residents. Med Educ. 2016;50:132–149. doi: 10.1111/medu.12927. [DOI] [PubMed] [Google Scholar]
- 10.Krug MF, Golob AL, Wander PL, Wipf JE. Changes in resident well-being at one institution across a decade of progressive work hours limitations. Acad Med. 2017;92(10):1480–1484. doi: 10.1097/ACM.0000000000001675. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Gazelle G, Liebschutz JM, Riess H. Physician burnout: coaching a way out. J Gen Int Med. 2015;30:508–513. doi: 10.1007/s11606-014-3144-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Squires A, Finlayson C, Gerchow L, Cimiotti JP, Matthews A, Schwendimann R, et al. Methodological considerations when translating “burnout”. Burn Res. 2014;1:59–68. doi: 10.1016/j.burn.2014.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Shanafelt TD, Balch CM, Bechamps G, Russell T, Dyrbye L, Satele D, et al. Burnout and medical errors among American surgeons. Ann Surg. 2010;251:995–1000. doi: 10.1097/SLA.0b013e3181bfdab3. [DOI] [PubMed] [Google Scholar]
- 14.Van Gerven E, Vander Elst T, Vandenbroeck S, Dierickx S, Euwema M, Sermeus W, et al. Increased risk of burnout for physicians and nurses involved in a patient safety incident. Med Care. 2016;54:937–943. doi: 10.1097/MLR.0000000000000582. [DOI] [PubMed] [Google Scholar]
- 15.van der Heijden F, Dillingh G, Bakker A, Prins J. Suicidal thoughts among medical residents with burnout. Arch Suicide Res. 2008;12:344–346. doi: 10.1080/13811110802325349. [DOI] [PubMed] [Google Scholar]
- 16.Montgomery A, Todorova I, Baban A, Panagopoulou E. Improving quality and safety in the hospital: the link between organizational culture, burnout, and quality of care. Br J Health Psychol. 2013;18:656–662. doi: 10.1111/bjhp.12045. [DOI] [PubMed] [Google Scholar]
- 17.Genn JM. AMEE medical education guide no. 23 (part 2): curriculum, environment, environment, quality and change in medical education—a unifying perspective. Med Teach. 2001;23:445–454. doi: 10.1080/01421590120075661. [DOI] [PubMed] [Google Scholar]
- 18.Lombarts KM, Heineman MJ, Scherpbier AJ, Arah OA. Effect of the learning climate of residency programs on Faculty’s teaching performance as evaluated by residents. PLoS One. 2014;9:e86512. doi: 10.1371/journal.pone.0086512. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Boor K, Van Der Vleuten C, Teunissen P, Scherpbier A, Scheele F. Development and analysis of D-RECT, an instrument measuring residents’ learning climate. Med Teach. 2011;33:820–827. doi: 10.3109/0142159X.2010.541533. [DOI] [PubMed] [Google Scholar]
- 20.Dijkstra IS, Pols J, Remmelts P, Rietzschel EF, Cohen-Schotanus J, Brand PL. How educational innovations and attention to competencies in postgraduate medical education relate to preparedness for practice: the key role of the learning environment. Perspect Med Educ. 2015;4:300–307. doi: 10.1007/s40037-015-0219-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.van Vendeloo SN, Brand PL, Verheyen CC. Burnout and quality of life among orthopedic trainees in a modern educational program: importance of the learning environment. Bone Joint J. 2014;96:1133–1138. doi: 10.1302/0301-620X.96B8.33609. [DOI] [PubMed] [Google Scholar]
- 22.Dyrbye LN, Thomas MR, Harper W, Massie FS, Jr, Power DV, Eacker A, Szydlo DW, Novotny PJ, Sloan JA, Shanafelt TD. The learning environment and medical student burnout: a multicentre study. Med Educ. 2009;43:274–282. doi: 10.1111/j.1365-2923.2008.03282.x. [DOI] [PubMed] [Google Scholar]
- 23.Silkens ME, Smirnova A, Stalmeijer RE, Arah OA, Scherpbier AJ, Van Der Vleuten CP, et al. Revisiting the D-RECT tool: validation of an instrument measuring residents’ learning climate perceptions. Med Teach. 2016;38:476–481. doi: 10.3109/0142159X.2015.1060300. [DOI] [PubMed] [Google Scholar]
- 24.Schaufeli WB, van Dierendonk D. Utrechtse burnout Schaal (UBOS) handleiding. (Utrecht burnout scale, manual) Utrecht: Swets & Zeitlinger; 2000. [Google Scholar]
- 25.Brenninkmeijer V, Van Yperen N. How to conduct research on burnout: advantages and disadvantages of a unidimensional approach in burnout research. Occup Environ Med. 2003;60:16–20. doi: 10.1136/oem.60.suppl_1.i16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Golub JS, Weiss PS, Ramesh AK, Ossoff RH, Johns MM., 3rd Burnout in residents of otolaryngology-head and neck surgery: a national inquiry into the health of residency training. Acad Med. 2007;82:596–601. doi: 10.1097/ACM.0b013e3180556825. [DOI] [PubMed] [Google Scholar]
- 27.Prins JT, Gazendam-Donofrio SM, Dillingh GS, van de Wiel HB, van der Heijden FM, Hoekstra-Weebers JE. The relationship between reciprocity and burnout in Dutch medical residents. Med Educ. 2008;42:721–728. doi: 10.1111/j.1365-2923.2008.03041.x. [DOI] [PubMed] [Google Scholar]
- 28.Ripp J, Babyatsky M, Fallar R, Bazari H, Bellini L, Kapadia C, et al. The incidence and predictors of job burnout in first-year internal medicine residents: a five-institution study. Acad Med. 2011;86:1304–1310. doi: 10.1097/ACM.0b013e31822c1236. [DOI] [PubMed] [Google Scholar]
- 29.McLeod PJ, Steinert Y, Meagher T, Schuwirth L, Tabatabai D, McLeod AH. The acquisition of tacit knowledge in medical education: learning by doing. Med Educ. 2006;40:146–149. doi: 10.1111/j.1365-2929.2005.02370.x. [DOI] [PubMed] [Google Scholar]
- 30.Silkens ME, Arah OA, Scherpbier AJ, Heineman MJ, Lombarts KM. Focus on quality: investigating Residents’ learning climate perceptions. PLoS One. 2016;11:e0147108. doi: 10.1371/journal.pone.0147108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Scheele F, Teunissen P, Van Luijk S, Heineman E, Fluit L, Mulder H, et al. Introducing competency-based postgraduate medical education in the Netherlands. Med Teach. 2008;30:248–253. doi: 10.1080/01421590801993022. [DOI] [PubMed] [Google Scholar]
- 32.Maslach C, Leiter MP. New insights into burnout and health care: strategies for improving civility and alleviating burnout. Med Teach. 2017;39:160–163. doi: 10.1080/0142159X.2016.1248918. [DOI] [PubMed] [Google Scholar]
- 33.West CP, Dyrbye LN, Erwin PJ, Shanafelt TD. Interventions to prevent and reduce physician burnout: a systematic review and meta-analysis. Lancet. 2016;388:2272–2281. doi: 10.1016/S0140-6736(16)31279-X. [DOI] [PubMed] [Google Scholar]
- 34.Steinert Y, Mann K, Anderson B, Barnett BM, Centeno A, Naismith L, et al. A systematic review of faculty development initiatives designed to enhance teaching effectiveness: a 10-year update: BEME guide no. 40. Med Teach. 2016;38:769–786. doi: 10.1080/0142159X.2016.1181851. [DOI] [PubMed] [Google Scholar]
- 35.Westerman M, Teunissen PW, Fokkema JP, van der Vleuten CP, Scherpbier AJ, Siegert CE, et al. The transition to hospital consultant and the influence of preparedness, social support, and perception: a structural equation modelling approach. Med Teach. 2013;35:320–327. doi: 10.3109/0142159X.2012.735381. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.