Abstract
Purpose
To assess whether organizational interventions are effective to prevent or reduce exhaustion, the core dimension of occupational burnout.
Methods
We searched in PubMed, EMBASE, PsycINFO, and Cochrane Library databases randomized and non-randomized controlled trials conducted among active workers and reporting the outcome as exhaustion score. We calculated the effect sizes using the pre-test–post-test control group design’s estimate. We used the random effects model in meta-analysis and Cochrane collaboration’s tool for interventions to assess the risk of bias. Overall quality of evidence was appraised using the GRADE.
Results
From the 2425 identified records, we assessed 228 full texts for eligibility and included 11 original articles describing 13 studies, 11 on organizational interventions, and 2 on combined inventions. The interventions were participatory (n = 9), focused on workload (n = 2), or on work schedule (n = 2). The overall effect size was − 0.30 ((95% CI = − 0.42; − 0.18), I2 = 62.28%), corresponding to a small reduction in exhaustion with a very low quality of evidence. Combined interventions had a larger effect (− 0.54 (95% CI = − 0.76; − 0.32)) than organizational interventions. When split by type of intervention, both participatory interventions and interventions focused on workload had a benefic effect of exhaustion reduction, with an estimated effect size of − 0.34 (95% CI = − 0.47; − 0.20) and − 0.44 (95% CI = − 0.68, − 0.20), respectively.
Conclusion
Interventions at combined level in workplaces could be helpful in preventing exhaustion. However, the evidence is still limited, due to a high heterogeneity between studies, bias potential, and small number of eligible studies. This calls for further research, using workload interventions at organizational level, especially in sectors with high risk of job stress and exhaustion.
Supplementary Information
The online version contains supplementary material available at 10.1007/s00420-023-02009-z.
Keywords: Work-related stress, Exhaustion, Participatory intervention, Combined intervention, Controlled trial
Introduction
Occupational burnout is an occupation-related phenomenon recognized by the World Health Organization (WHO) in its international classification of diseases, but currently, burnout is not a diagnosis. Most of the conducted burnout research focused on burnout as a state and not a process (De Hert 2020), although, in the beginning, Freudenberger depicted the development of burnout in a model consisting of 12 stages (Freudenberger 1982). On the other hand, Maslach and colleagues presented burnout as a process of gradual fatigue, cynicism, and loss of commitment among social care professionals (Maslach and Leiter 1976). The etiology of burnout remains debated. Edu-Valsania et al. summarized six main theories of burnout development (Edu-Valsania et al. 2022). For example, according to the Organizational Theory, burnout is an outcome of organizational and work stressors associated with insufficient individual coping skills (Cox et al. 1993). Burnout starts with emotional exhaustion as a result of work stressors and then depersonalization develops as a coping technique against emotional exhaustion and leads to a low personal fulfillment (Cox et al. 1993). Therefore, interventions can prevent the burnout development by reducing exhaustion. Recently some organizations implemented different types of interventions in order to reduce employee’s exhaustion and prevent burnout development (Panagioti et al. 2017a).
Considering the heterogeneity in describing the etiology of burnout, it is not clear whether it should be considered a medical condition or not. Some countries recognize burnout as an occupational disease and have established more or less standardized, criteria, for its detection and management. This is notably the case in Sweden, Belgium and the Netherlands (Guseva Canu et al. 2019). Whether it is recognized as a disease or not, untreated burnout often leads to morbidity and is accompanied by depressive and anxiety symptoms (Koutsimani et al. 2019). In the most advanced stage, called severe or clinical, burnout is often confused with depression and presents a suicidal risk (van der Heijden et al. 2008). Some researchers have suggested that burnout could reflect a depressive state and not a distinctive entity (Bianchi et al. 2021). Burnout correlates with depression, specifically the exhaustion component of burnout; however, the most recent meta-analysis (Koutsimani et al. 2019) concluded that burnout and depression are two different constructs. An early detection of burnout would allow avoiding its health, economic and social consequences such as loss of productivity, absenteeism, high turnover and disengagement from active life (Aumayr-Pintar et al. 2018). The cost of physicians and veterinarians’ burnout in the United States is estimated between $1 and 2 billion annually (Han et al. 2019; Neill et al. 2022). To counter this phenomenon, organizations have attempted to prevent burnout through different types of interventions. Individual-level interventions aim help workers to cope with stress at the workplace using mainly behavioral and cognitive approaches or target individual knowledge (Dijxhoorn et al. 2021; Hepburn et al. 2021; Kuster et al. 2017). Organization-directed interventions are targeting structural changes such as schedule, workload or increasing job control and resources (Awa et al. 2010). Combined interventions, employ both individual and organization-level approaches and capture the benefits of targeting the workplace stressors while also improving employee resilience and coping strategies (Awa et al. 2010).
All existent burnout measures are multidimensional (Shoman et al. submitted; Shoman et al. 2021) and only few of them allow calculating an overall burnout score such as Copenhagen Burnout Inventory (CBI) (Kristensen et al. 2005) and Burnout Assessment Tool (BAT) (Schaufeli et al. 2020). While CBI only considers exhaustion, BAT and other burnout measures such as the Maslach Burnout Inventory (MBI) and Oldenburg Burnout Inventory (OLBI) consider additional dimensions (e.g., cynicism, depersonalization, or disengagement). Nevertheless, these dimensions are usually considered secondary as opposite to exhaustion. Exhaustion is the first symptom to develop and stands in a central position in burnout natural course (Maslach and Leiter 2016). From a prevention perspective, it is more effective to focus on the early symptoms rather than the more advanced ones (Kisling 2023). Moreover, exhaustion (both physical and emotional) is the only consensual characteristic of occupational burnout in workers according to the recent harmonized definition (Guseva Canu et al. 2021). Thus, by preventing exhaustion, one may prevent the worker from developing the other burnout symptoms such as cynicism or disengagement. As exhaustion dimension is measured by virtually all burnout scales, for the sake of homogeneity, we focused on it while measuring the effect size of interventions in the present meta-analysis. Indeed, the major drawback of the previously published meta-analyses is their very broad spectrum of studies and outcomes included resulting in a high between-study heterogeneity, result imprecision and inconclusiveness.
For instance, two meta-analyses (De Simone et al. 2021; Panagioti et al. 2017b) included both individual and organizational level interventions with mixed study designs and plethora of outcomes, making interpretation of the quality of evidence challenging. Conversely, two other meta-analyses (Thomas Craig et al. 2021; West et al. 2016) reduced the selection criteria to specific occupational groups in healthcare sector and are not generalizable beyond this sector. Finally, meta-analyses that limited the selection criteria to one burnout measurement scale (e.g., MBI (De Simone et al. 2021; Salvado et al. 2021)) are hardly generalizable to burnout constructs measured with other scales, especially those proven as more valid (Shoman et al. 2021). All the previously mentioned meta-analyses measured burnout as a multifaceted construct (including the exhaustion component). However, following the harmonized definition of burnout that states: “In a worker, occupational burnout or occupational physical AND emotional exhaustion state is an exhaustion due to prolonged exposure to work-related problems”, we decided to focus on the exhaustion component of burnout as discussed above. This definition is the consensual definition of occupational burnout as a clinical term, based on a systematic review, semantic analysis and expert consensus obtained using the Delphi method (Guseva Canu et al. 2021). It is the only definition in line with the existent definition of burnout in Systematized Nomenclature of Medicine—Clinical Term (SNOMED-CT), the only official controlled vocabulary of clinical terms and medical procedures (Dell'Oro et al. 2023).
Our objective was to evaluate the effectiveness of organizational interventions on occupational burnout prevention regardless the occupational sector aimed at identifying interventions with the strongest effect.
Methods
Protocol and registration
We conducted a systematic review and meta-analysis and adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for reporting the results (Page et al. 2021). The study protocol was registered on the international prospective register of systematic reviews (PROSPERO RecordID CRD42022357406).
Literature searches
We designed a systematic search strategy and interrogated four databases: Medline (Pubmed), EMBASE, PsycINFO, and Cochrane Library for the period from journal inception and up to 12 September 2022. The full search strategy is available in details (Supplementary File S1). In PubMed, for instance, the search strategy comprised Medical Subject Heading Terms (MeSH) (e.g., “Burnout, Professional” [Mesh]), free text words (e.g., “emotional exhaust” [tiab]), Boolean terms (e.g., AND, OR) and truncations (e.g., work*) where necessary. In Embase, we used EMTREE terms, free text words, Boolean terms, proximity operators (e.g., Near/n), and truncations where necessary. Besides electronic searches, we manually searched reference lists of identified studies and prior systematic reviews and used the google search engine as well as the google scholar platform to identify additional eligible studies. There were no language or publication date restrictions.
Eligibility of studies
Original articles conducted in adult workers of any occupation, with an intervention delivered at workplace either at organizational or combined levels to reduce or minimize workers’ exhaustion were eligible. We included original studies that reported the scores of exhaustion pre- and post-intervention. Some of these studies reported the scores of other dimensions of burnout but we did not consider these dimensions in this meta-analysis. To be included, studies should be randomized or non-randomized controlled trials (RCT or non-RCT). The latter were considered because often in occupational settings it is unethical and/or practically impossible to allocate the intervention randomly and blindly. In addition, to be included into the meta-analysis, the eligible studies must have measured burnout exhaustion dimension by a validated scale (Shoman et al. 2021) before and after the intervention. We excluded studies that were either testing an individual-oriented intervention, or without control group or had not reported burnout scale used and resulting scores.
All steps of the systematic review (from the double screening to the risk of bias assessment) were conducted by two reviewers independently (IB and MA). A third reviewer (IGC) was consulted in case of discrepancies which were discussed and solved consensually.
Literature screening, study inclusion and data abstraction
After excluding duplicates, the identified articles were first examined based on the title and abstract for eligibility assessment. Eligible and potentially eligible (uncertain) articles were then examined based on the full text. Studies fulfilling the inclusion criteria were included into the systematic review and data extraction. Key descriptive characteristics of the included studies were extracted, including the study design, characteristics of the study sample, occupational sector, sample size, age, gender, intervention type and content, alternative intervention (control), burnout measures/scales, outcomes measured, and follow-up duration.
Risk of bias assessment and evidence appraisal
We performed the risk of bias assessment using the Review Manager 5.3 Cochrane’s software risk of bias (Sterne et al. 2014). This tool allows the appraisal of the quality of included studies by rating seven domains: random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data, selective reporting, and other bias. Each item in each domain was rated as low, unclear, or high risk of bias. Finally, each study was rated either as having an overall low, unclear, or high risk of bias, based on the overall judgment of the seven mentioned domains.
We assessed the overall quality of evidence following the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach (Guyatt et al. 2008). The GRADE consists of five domains: risk of bias, imprecision, inconsistency, indirectness, and publication bias. Following the GRADE, we started with the assumption that the level of evidence is high and downgraded it by one or two levels (e.g., from high to moderate) whenever necessary for each of the five domains of GRADE.
Missing data
We could not impute missing outcomes when they were not reported in the original studies. However, we contacted the corresponding authors of these studies to complete the extracted data and include the studies in the meta-analysis. In case we did not receive any answer from the authors, we had to exclude studies that did not report necessary data for the analysis. We calculated the standard deviations (SD) from the standard errors or confidence intervals, to estimate the SD differences.
Statistical analysis
We calculated the effect size for each study using Morris’s dppc2 formula (Morris 2008):
In his formula, cp is a correction factor equal to 1-(3/4(n I + n C -2)-1) where n I and n C are the numbers of participants in the intervention (I) and control (C) groups, respectively. The dppc2 is a standardized difference of the differences of the pre- and post-intervention means in the intervention and control groups, divided by the pooled pre-intervention SD. Standard errors were calculated from the variance formula given in Supplementary File S2, enabling us to calculate 95% confidence intervals (95% CI) in each study. Of note, this variance formula involves a correlation rho between pre- and post-intervention measurements, which was not always reported. In some studies, we could retrieve rho from regression coefficients. When not available, we imputed the average value from the other studies (rho = 0.64).
The interpretation of the dppc2 estimate is usually the same as of Cohen's d (Cohen 1988). However, this strictly numerical interpretation, separated from the context of the studies in a natural environment, is currently being questioned towards an interpretation in a discipline-specific manner (Cumming and Calin-Jageman 2016). Considering that organizational interventions are more in the realm of work and organizational psychology and use approaches that could be described as educational, dppc2 cutoffs of 0.2, 0.5, and 0.8 are interpreted as small, medium, and large effects, respectively (Fritz et al. 2012).
We meta-analyzed the dppc2 effect sizes and their 95% confidence intervals using a random effects model (DerSimonian and Laird 1986), which integrates an assumption that the different studies are estimating different, yet related, effects of the intervention. Heterogeneity among studies was measured via the I2 coefficient. We further performed subgroup analysis by the level of intervention (organizational vs combined), type of intervention (participatory, workload, and schedule), occupation of participants, the scale used in the study, and follow-up duration. We also performed sensitivity analysis by eliminating each study at a time from the analysis and assessing the effect by comparing the summary estimates (dppc2) and the heterogeneity (I2) before and after the elimination of each study (Sutton et al. 2000).
Publication bias was assessed using both funnel plot and Egger regression (Egger et al. 1997) and Begg’s tests (Begg and Mazumdar 1994). We performed meta-regression to investigate how the above-mentioned study characteristics are related with the intervention effects.
All statistical analyses were performed using Stata statistical software, version 16 (StataCorp LP, Texas).
Results
Study selection
We identified 2952 potentially relevant unique records from the literature search. We removed 527 duplicates and included 2425 records in the first screening based on titles and abstracts. In the second screening, we assessed 228 full-text records against inclusion criteria and excluded 215 studies for various reasons (e.g., reviews, individual interventions, wrong study design or no exhaustion estimate (Fig. 1)). The overall disagreement between the two reviewers was 16% and was solved by consensus between three reviewers. During the screening, we identified further 70 studies by hand search and from the screening of the reference list of the eligible articles.
Fig. 1.
Flowchart of the included studies
Finally, we included 11 original articles, 2 of which involved 2 study samples (Gordon et al. 2018; Shea et al. 2014). Thus, we had 13 studies of 13 different samples which were meta-analyzed.
Characteristics of included studies
The sample size of included studies ranged from 39 to 1173 workers with a median of 119. The participation of female workers ranged from 28 to 90% (Table 1). Twelve studies out of 13 included healthcare workers, such as nurses (Begg and Mazumdar 1994; Bourbonnais et al. 2011; Gordon et al. 2018; Melchior et al. 1996; van Weert et al. 2005), physicians (Adriaenssens et al. 2015; Gordon et al. 2018; Gregory et al. 2018; Shea et al. 2014) and other caregivers (Le Blanc et al. 2007; Leiter et al. 2011; Peterson et al. 2008). The remaining study was conducted on logistic workers (Demerouti et al. 2021). Burnout was measured at least twice, at baseline and at another measurement point after the end of intervention. Eight studies (62%) used the MBI in its original or translated version (Berg et al. 1994; Gregory et al. 2018; Leiter et al. 2011; Melchior et al. 1996; Shea et al. 2014; van Weert et al. 2005), four studies (31%) used OLBI (Demerouti et al. 2021; Gordon et al. 2018; Peterson et al. 2008) and one study used CBI (Bourbonnais et al. 2011), so we could extract the exhaustion score from all studies, to measure the outcome.
Table 1.
Description of the included studies (n = 13)
| Author, year | Design | Population | Sample size, mean age, % of women | Intervention (content and duration) | Intervention level | Intervention’s type | Exhaustion measure/scale | Exhaustion score baseline—control and intervention | Follow-up time points (months) | Intervention duration | Risk of bias | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Berg (1994) | Non-RCT | Nurses | 39;34;82 | Implementation of a systematic clinical supervision plan for 12 months | Organizational | Participatory interventions | MBI | 17 and 14 | Baseline, 6 and 12 months | 12 months | Unclear | |
| Bourbonnais (2011) | Non-RCT | Nurses | 613; NR; 82 | An intervention team composed of members from 3 hospital units who identify problems and solutions in the framework of a participative intervention | Organizational | Participatory interventions | CBI | 49.36 and 48.11 | Baseline and 12 months | 12 months | High | |
| Demerouti (2021) | Non-RCT | Logistics employees | 71;45; 43 | The intervention consisted of a workshop to identify the self-chosen job crafting followed by 4 weeks of implementation and an evaluation session | Organizational | Participatory interventions | OLBI | 2.03 and 2.21 | Baseline and 2 months | 4 weeks | Unclear | |
| Gordon 1 (2018) | Non-RCT | Physicians | 119; 51; 30 | Impact of a specific job constructing intervention on health care professionals’ well-being and job performance | Organizational | Participatory interventions | OLBI | 1.88 and 1.93 | Baseline and 1.5 month | 3 weeks | High | |
| Gordon 2 (2018) | Non-RCT | Nurses | 58; 36.2; 90 | Impact of a specific job constructing intervention on health care professionals’ well-being and job performance | Organizational | Participatory interventions | OLBI | 2.36 and 2.20 | Baseline and 1.5 month | 3 weeks | High | |
| Gregory (2018) | Non-RCT | Physicians | 69; NC; NC | Intervention’s focused on 4 clinics on workload by increasing human resources by 50% | Organizational | Workload | MBI | 24.38 and 24.41 | Baseline, 1, 2 and 3 months | 6 months | Unclear | |
| Le Blanc (2007) | Non-RCT | Healthcare workers | 664; 36.2; 28 | Take Care Intervention: a stress-management training; 6 monthly 3-h sessions where participants formed teams that collectively designed, implemented, evaluated, and reformulated plans of action to cope with most important stressors in their work situation | Organizational | Participatory interventions | MBI-HSS | 1.46 and 1.54 | Baseline, 6 and 12 months | 6 months | Unclear | |
| Leiter (2011) | Non-RCT | Healthcare workers | 1173; 42.5; 86 | Employees met with coworkers on their units on a weekly/biweekly basis to work on effective interpersonal interactions for 6 months | Organizational | Participatory Interventions | MBI-GS | 2.73 and 3.21 | Baseline and 6 months | 6 months | High | |
| Melchior (1996) | Non-RCT | Nurses | 161; 34.8; 72 | Nurses were assigned to patients as primary nurses with adequate feedback and support (advice on skills, support meeting between primary nurses and other health care specialists, training program and monthly evaluation) | Organizational | Participatory interventions | MBI | 16.96 and 14.47 | Baseline and 30 months | 12 months | Unclear | |
| Peterson (2008) | RCT | Healthcare workers | 131; 51.7; 90 | Reflecting peer-support group’s implementation: 2-h weekly working-group sessions, 10 times. All sessions started with a relaxation and was followed by a group meeting guided by an experienced group leader | Combined | Participatory interventions + individual | OLBI | 3 and 3.03 | Baseline and 12 months | 2.5 months | Low | |
| Shea 1 (2014) | RCT | Medical Interns | 106; 27.5; 52 | Effect of a 5-h period in which interns were expected to sleep during overnight call with rotation every 4 week in Philadelphia | Organizational | Schedule | MBI-HSS | 25.48 and 23.91 | Baseline and 1 month | 11 months | Low | |
| Shea 2 (2014) | RCT | Medical Interns | 79; 28; 48.5 | Effect of a 5-h period in which interns were expected to sleep during overnight call with rotation every 4 week in Pennsylvania | Organizational | Schedule | MBI-HSS | 26.60 and 24.24 | Baseline and 1 month | 11 months | Low | |
| Van Weert (2005) | Non-RCT | Nurses | 128; 35; 59 | Implementation of Snoezelen’s program for CNA: combined interventions to improve caregivers’ knowledge, skills | Combined | Workload + individual | MBI-NL | 10.35 and 10.75 | Baseline and 18 months | NC | Low | |
| Overall level of evidence following the GRADE approach | ||||||||||||
| Studies assessed | Risk of bias | Imprecision | Inconsistency | Indirectness | Publication bias | Level of evidence | ||||||
| All studies (13) | Yes | No | No | Yes | Yes | Very low | ||||||
*RCT randomized control trial, non-RCT non-randomized control trial, MBI Maslach Burnout Inventory, CBI Copenhagen Burnout Inventory, OLBI Oldenburg Burnout Inventory. NR not reported
Of the 13 included studies, 5 were classified to have an unclear risk of bias (Berg et al. 1994; Demerouti et al. 2021; Gregory et al. 2018; Le Blanc et al. 2007; Melchior et al. 1996), 4 had a high risk of bias (Bourbonnais et al. 2011; Gordon et al. 2018; Leiter et al. 2011), and 4 had a low risk of bias (Peterson et al. 2008; Shea et al. 2014; van Weert et al. 2005) (Table 1). The detailed results of the risk of bias assessment are presented in Supplementary Figure S1. Eleven studies were non-RCTs (Berg et al. 1994; Bourbonnais et al. 2011; Demerouti et al. 2021; Gordon et al. 2018; Gregory and Menser 2015; Le Blanc et al. 2007; Leiter et al. 2011; Melchior et al. 1996; van Weert et al. 2005) and 2 studies were RCTs (Peterson et al. 2008; Shea et al. 2014).
Characteristics of interventions
Interventions varied considerably in their characteristics. Variability was found in many aspects, including intervention type, duration, follow-up duration, and outcome measure used. Interventions were classified either as organizational or as combined, with only two studies (Peterson et al. 2008; van Weert et al. 2005) in the latter category. We further classified the interventions according to their content, in interventions focused on work schedule (Shea et al. 2014), on workload (Gregory et al. 2018; van Weert et al. 2005) and participatory intervention (Berg et al. 1994; Bourbonnais et al. 2011; Demerouti et al. 2021; Gordon et al. 2018; Gregory et al. 2018; Le Blanc et al. 2007; Leiter et al. 2011; Melchior et al. 1996; Peterson et al. 2008) (Table 1). Shea et al. implemented an intervention to improve physicians’ schedule and sleep recovery (Shea et al. 2014). As the study was conducted in two different hospitals with distinct samples, we counted it as two studies. Two other studies were classified in the workload category (Gregory et al. 2018; van Weert et al. 2005). While Gregory and al. focused on increasing human resources to decrease workload (Gregory et al. 2018), Van Weert and al. implemented a program to reduce workload by improving certified nursing assistants’ knowledge about dementia (van Weert et al. 2005). Nine studies were classified as participatory interventions (Berg et al. 1994; Bourbonnais et al. 2011; Demerouti et al. 2021; Gordon et al. 2018; Le Blanc et al. 2007; Leiter et al. 2011; Melchior et al. 1996; Peterson et al. 2008). The duration of the interventions ranged from 3 weeks to 12 months with a mean of 6.5 months. One study did not specify its duration (van Weert et al. 2005). Follow-up duration ranged from 4 weeks to 3 years after the intervention (Table 1).
Main meta-analysis results
An overall effect size was estimated at − 0.30 ((95% CI = − 0.42; − 0.18), I2 = 62.28%), corresponding to a moderate-weak effect on exhaustion reduction at the end of follow-up (Fig. 2). However, following the GRADE approach, the quality of evidence was very low.
Fig. 2.
Meta-analysis of overall effect sizes from pre-test–post-test-control design (dppc2) of organizational interventions to prevent exhaustion
Subgroup analyses
Comparing the interventions by level (Fig. 3), we observed that the combined intervention has a large effect on reducing exhaustion score (dppc2 = − 0.54 (95% CI = − 0.76; − 0.32)) based on 2 studies, while the organizational interventions have a rather small effect (dppc2 = − 0.25 (95% CI = − 0.37; − 0.13), I2 = 59.61%) based on 11 studies. The subgroup analysis by the type of interventions showed statistically significant beneficial effects in all subgroups analyzed except the scheduling interventions (Fig. 4). Interventions on workload showed a reduction in exhaustion score (dppc2 = − 0.44 (95% CI = − 0.68; − 0.20)) based on two studies. This effect appears to be similar when combined with individual interventions (dppc2 = − 0.44 (95% CI = − 0.74; − 0.14). The nine participatory interventions also reduced the exhaustion score overall (dppc2 = − 0.34 (95% CI = − 0.47; − 0.20), I2 = 63.92%). Moreover, the effect size of participatory intervention increased when combined with an individual intervention (dppc2 = − 0.65 (95% CI = − 0.97; − 0.33)).
Fig. 3.
Meta-analysis of effect sizes from pre-test–post-test control design (dppc2) of organizational interventions to prevent exhaustion, results of subgroup analysis by the level of intervention
Fig. 4.
Meta-analysis of effect sizes from pre-test–post-test control design (dppc2) of organizational interventions to prevent exhaustion, results of subgroup analysis by the type of intervention
In subgroup analysis based on follow-up duration, 1 month after the intervention, intervention impact was relatively small and only marginally significant. However, the analysis suggests a robust effect with a longer follow-up. Remarkably, the beneficial, though weak effect persisted after 12 months. (Supplementary Figure S2). Finally, the subgroup analysis by the scale used to measure exhaustion showed that interventions using the OLBI had a strong beneficial effect against exhaustion, whereas interventions using the MBI had a weak beneficial effect, less precise and more heterogeneous across studies (Supplementary Figure S3).
Sensitivity analysis, meta-regression, and publication bias
Based on a visual assessment of the funnel plot (Supplementary Figure S4) and the statistical tests results (Begg’s test p-value = 0.01, Egger’s test p-value = 0.19), we considered that potential for publication bias cannot be ruled out. The number of included studies being rather small, we kept meta-regression analysis univariate (Borenstein 2009). According to the results, some part of the heterogeneity can be explained by the level and type of intervention and participant’s occupation (Table 2). The results of sensitivity analyses changed neither the effect-size estimate, nor the heterogeneity.
Table 2.
Results of univariate meta-regression analyses
| Moderator | Beta coefficient | Standard error | P-value |
|---|---|---|---|
| Follow-up duration | 0.01 | 0.01 | 0.32 |
| Level of intervention | − 0.29 | 0.16 | 0.07 |
| Type of intervention | 0.14 | 0.08 | 0.07 |
| Occupation (Healthcare vs non-healthcare) | − 0.60 | 0.33 | 0.07 |
| Measurement scale | − 0.09 | 0.10 | 0.37 |
Discussion
Summary of main findings
This meta-analysis showed that organization-directed interventions and combined interventions were associated with moderate to small reductions in exhaustion score. Combined interventions were associated with higher reduction effects compared with organizational interventions. Interventions targeting workload were the most effective ones in reducing workers’ exhaustion, followed by participatory interventions. Interventions targeting work schedule had no effect on exhaustion and it seems unrelated to the risk of bias.
Examples of workload interventions are the one focusing on increasing the resources available to carry out the work and/or reducing the workload. Two studies replaced existing professionals dyads with more human resources (Gregory et al. 2018; Shaw et al. 2021); one study implemented remote access to more patients for 11 weeks (Romig et al. 2012) and another worked on improving employees’ knowledge to reduce their workload (van Weert et al. 2005). The success here seems to result from a better job resources balance. Participatory intervention’s category presented a high heterogeneity in its content. Employees are involved in five steps such as planning the intervention, identifying areas for improvement, developing action plans for improvement, implementing improvement initiatives, and evaluating the results in this type of interventions (Nielsen and Noblet 2018). This type of intervention recognizes that employees have the capacity to develop and implement their own solutions (Lavoie-Tremblay 2004). Employees’ sense of empowerment is strengthened, which in turn increases their sense of control and motivates them to engage in work (Quinn and Spreitzer 1997).
Interventions targeting workload could be effective in reducing exhaustion. One burnout development theory “i.e., Demands–Resources Theory” proposes that workers suffer from burnout if there is an imbalance between job demands and job resources (Bakker and Demerouti 2017). If the worker cannot recover from job demands (including but not limited to high workload), mental and physical exhaustion is prompted. Fatigue starts if demands exceed resources and if the imbalance between demands and resources is sustained over time, chronic fatigue occurs, followed by burnout. Hence, demands have a positive direct association with burnout, particularly exhaustion, while the presence of resources affects depersonalization by decreasing its use as a coping technique (Edu-Valsania et al. 2022).
Limitations and strengths
The main limitations of this comprehensive meta-analysis were a relatively small number of included studies, a moderate between-study heterogeneity, and potential publication bias. The heterogeneity may be attributed to the clinical and methodological differences of the included studies, related to the choice of study population, intervention, burnout scale used, study design, and duration of intervention or follow-up. According to the sensitivity analysis, the observed heterogeneity cannot be attributed to a particular study, but to the differences observed in all the included studies (Aho 2020). Subgroup analyses reduced heterogeneity for some subgroups. However, the small number of included studies limited the scope of the subgroup analyses, where some subgroups included only in one or two studies.
The strong methodological framework that we followed in this meta-analysis is an important strength to mention. Other strengths are a precise outcome definition and quantification using Morris’s dppc2. Indeed, exhaustion, retained as the main outcome in the meta-analysis, represents only one dimension of burnout but allowed us to harmonize the definition of the outcome. Most researchers agree that exhaustion is the core composing component of burnout (Schaufeli 2021). Exhaustion is cited in 12 of the 13 definitions that were included in the systematic review of burnout definitions (Guseva Canu et al. 2021). Although we recognize that exhaustion component of burnout can be emotional, physical, mental, or cognitive exhaustion (Schaufeli 2021), the original studies included in this meta-analysis did not differentiate these different types of exhaustion, which constitutes a limitation.
Comparison with previous systematic reviews
Several meta-analyses were performed to examine the effectiveness of individual, combined and organizational interventions on physicians (Ahola et al. 2017; De Simone et al. 2021; Dreison et al. 2018; Panagioti et al. 2017b; Thomas Craig et al. 2021; West et al. 2016). Our results are in line with a recent meta-analysis (Thomas Craig et al. 2021) showing that combined interventions are more effective than organizational interventions to reduce burnout.
Considering the burnout/exhaustion score before intervention, as requested in Morris’s dppc2 calculation, is also informative with respect to burnout/exhaustion severity. Moreover, it also comparing the studies according to their initial burnout level in study participants. For example, in four studies (Berg et al. 1994; Gregory et al. 2018; Shea et al. 2014), the measured scores corresponded to moderate exhaustion (with mean values of 17, 24, and 26, respectively) based on the MBI cutoffs (Maslach et al. 1997), while in two other studies (Melchior et al. 1996; van Weert et al. 2005), the scores corresponded to low exhaustion (14.30, 16.90, and 10.35, respectively). Among the studies that used the OLBI, two studies (Demerouti et al. 2021; Gordon et al. 2018) had low exhaustion scores. In contrast, a third study (Peterson et al. 2008) had a moderate score based on the authors’ threshold (Demerouti and Bakker 2008). To our knowledge, the burnout stage has been never considered in previous studies. Here, it might explain a part of between-study heterogeneity but can also present an interest for the intervention targeting and effect comparison between primary and secondary preventive intervention.
Implications for researchers, clinicians, and policymakers
As the overall quality of evidence in this meta-analysis was graded as very low following the GRADE approach, despite moderate and large effects of some types of intervention, no practical recommendation can be suggested at this stage of knowledge. Conversely, several recommendations for future research can be formulated. As suggested previously (Thomas Craig et al. 2021), the studies that combined individual and organizational interventions lead to a larger effect in reducing exhaustion domain in occupational burnout. To confirm this, future study should consider having three arms or groups, with an intervention on organizational level along, the same intervention coupled with one on individual level and no intervention (control group). Measuring the outcome (at least the exhaustion score) at baseline and provide its clinical interpretation in terms of severity) should be systematically done in all groups and all future studies to make them more informative with respect to the stage of burnout and type of intervention (i.e., primary versus secondary). A more systematic and harmonized definition of the time points for the effect assessment is recommended to reduce the heterogeneity when comparing the different interventions. It will also inform the duration of the intervention’s effect and if necessary, a buster planning. Primary interventions aim to preserve the employee's resources and avoid burnout, while secondary intervention aims to prevent worsening of burnout symptoms in employees already affected by burnout at a low or moderate stage (LaMontagne et al. 2007). Finally, it worth to remind that the prior registration of the interventional study protocol and result publication regardless the trial conclusion should be compulsory to prevent publication and selection bias resulting in a lacunary evidence assessment. We are aware that publication of non-RCTs is challenging since they are supposed to be more prone to bias compared to RCTs, however, when considering the occupational filed, we need to circumvent this obstacle and promote methodologically strong and sound research even if the study design is not an RCT. For this, guidelines and methods appropriate to quantitatively assess the direction and magnitude of bias due to the non-RCT design particularities (e.g., impossibility of allocation randomization and concealment, spillover effect) are necessary, in a similar way they were developed for observational studies (Schubauer-Berigan et al. 2023).
Conclusion
Interventions at combined level in workplaces could be helpful in preventing exhaustion, the first and core component of occupational burnout. However, the evidence is still very low, due to a moderate heterogeneity between the studies, bias potential, and moderate to small effect size. This calls for further studies and methodological efforts to make the non-RCTs valid and reliable, given their relevance to inform and improve occupational health research.
Supplementary Information
Below is the link to the electronic supplementary material.
Acknowledgements
The authors would like to acknowledge the contribution of the Unisanté librarian T. Brauchli for his help in the literature search.
Author contributions
IB and MA performed the literature search, screening and study review, description, and risk of bias assessment. YS and IB performed statistical analysis, GRADE assessment and drafted the manuscript. VR provided guidance on the data management and statistical methods. IGC supervised all steps of the research, manuscript drafting and its revision. All the authors have read the manuscript and agreed on the final version.
Funding
Open access funding provided by University of Lausanne. This work was funded by the General Directorate of Health of the Canton of Vaud (Switzerland) via the grant of the Commission for Health Promotion and the Fight against Addictions (Grant n° 8273/3636000000-801).
Data availability
All data are available in the manuscript and its supported files. Any more information can be requested from the corresponding author.
Declarations
Conflict of interest
All the authors declare no conflict of interest.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- Adriaenssens J, De Gucht V, Maes S. Determinants and prevalence of burnout in emergency nurses: a systematic review of 25 years of research. Int J Nurs Stud. 2015;52(2):649–661. doi: 10.1016/j.ijnurstu.2014.11.004. [DOI] [PubMed] [Google Scholar]
- Aho L-SA-GS. Méta-analyse: choisir une démarche appropriée, partie II. Hygiènes. 2020;28(6):393–399. [Google Scholar]
- Ahola K, Toppinen-Tanner S, Seppänen J. Interventions to alleviate burnout symptoms and to support return to work among employees with burnout: systematic review and meta-analysis. Burn Res. 2017;4:1–11. doi: 10.1016/j.burn.2017.02.001. [DOI] [Google Scholar]
- Aumayr-Pintar C, Cerf C, Parent-Thirion A (2018) Burnout in the workplace: a review of the data and policy responses in the EU.
- Awa WL, Plaumann M, Walter U. Burnout prevention: a review of intervention programs. Patient Educ Couns. 2010;78(2):184–190. doi: 10.1016/j.pec.2009.04.008. [DOI] [PubMed] [Google Scholar]
- Bakker AB, Demerouti E. Job demands–resources theory: taking stock and looking forward. J Occup Health Psychol. 2017;22(3):273–285. doi: 10.1037/ocp0000056. [DOI] [PubMed] [Google Scholar]
- Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;2:1088–1101. doi: 10.2307/2533446. [DOI] [PubMed] [Google Scholar]
- Berg A, Hansson UW, Hallberg IR. Nurses' creativity, tedium and burnout during 1 year of clinical supervision and implementation of individually planned nursing care: comparisons between a ward for severely demented patients and a similar control ward. J Adv Nurs. 1994;20(4):742–749. doi: 10.1046/j.1365-2648.1994.20040742.x. [DOI] [PubMed] [Google Scholar]
- Bianchi R, et al. Is burnout a depressive condition? A 14-sample meta-analytic and bifactor analytic study. Clin Psychol Sci. 2021;9(4):579–597. doi: 10.1177/2167702620979597. [DOI] [Google Scholar]
- Borenstein MV, Hedges L, Higgins PT, et al. Introduction to meta-analysis. Chichester: John Wiley & Sons; 2009. [Google Scholar]
- Bourbonnais R, Brisson C, Vézina M. Long-term effects of an intervention on psychosocial work factors among healthcare professionals in a hospital setting. Occup Environ Med. 2011;68(7):479. doi: 10.1136/oem.2010.055202. [DOI] [PubMed] [Google Scholar]
- Cohen J. Statistical power analysis for the behavioral sciences, 77–83. 2. Hillsdale: Lawrence Erlbaum Associates; 1988. [Google Scholar]
- Cox T, Kuk G, Leiter M. Burnout, health, work stress and organizational healthiness. In: Schaufeli WB, Maslach C, Marek T, editors. Professional burnout: recent developments in theory and research. Abingdone, UK: Taylor & Francis; 1993. pp. 177–193. [Google Scholar]
- Cumming G, Calin-Jageman R. Introduction to the new statistics: estimation, open science, and beyond. Routledge; 2016. [Google Scholar]
- De Hert S. Burnout in healthcare workers: prevalence, impact and preventative strategies. Local Reg Anesth. 2020;13:171–183. doi: 10.2147/lra.S240564. [DOI] [PMC free article] [PubMed] [Google Scholar]
- De Simone S, Vargas M, Servillo G. Organizational strategies to reduce physician burnout: a systematic review and meta-analysis. Aging Clin Exp Res. 2021;33(4):883–894. doi: 10.1007/s40520-019-01368-3. [DOI] [PubMed] [Google Scholar]
- Dell'Oro F, Marca SC, Guseva Canu I. Qualitative evaluation of content similarity in the context of clinical research: the case of the original reference definitions of 'burnout'. J Appl Linguist Profess Pract. 2023;17(1):26–49. doi: 10.1558/jalpp.21266. [DOI] [Google Scholar]
- Demerouti E, Bakker AB. The Oldenburg Burnout inventory: a good alternative to measure burnout and engagement. Handb Stress Burnout Health Care. 2008;65:7. [Google Scholar]
- Demerouti E, Soyer LM, Vakola M, Xanthopoulou D. The effects of a job crafting intervention on the success of an organizational change effort in a blue-collar work environment. J Occup Organ Psychol. 2021;94(2):374–399. doi: 10.1111/joop.12330. [DOI] [Google Scholar]
- DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177–188. doi: 10.1016/0197-2456(86)90046-2. [DOI] [PubMed] [Google Scholar]
- Dijxhoorn AQ, Brom L, van der Linden YM, Leget C, Raijmakers NJ. Prevalence of burnout in healthcare professionals providing palliative care and the effect of interventions to reduce symptoms: a systematic literature review. Palliat Med. 2021;35(1):6–26. doi: 10.1177/0269216320956825. [DOI] [PubMed] [Google Scholar]
- Dreison KC, Luther L, Bonfils KA, Sliter MT, McGrew JH, Salyers MP. Job burnout in mental health providers: a meta-analysis of 35 years of intervention research. J Occup Health Psychol. 2018;23(1):18–30. doi: 10.1037/ocp0000047. [DOI] [PubMed] [Google Scholar]
- Edu-Valsania S, Laguia A, Moriano JA. Burnout: a review of theory and measurement. Int J Environ Res Public Health. 2022 doi: 10.3390/ijerph19031780. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–634. doi: 10.1136/bmj.315.7109.629. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freudenberger H. Counseling and dynamics: treating the end-stageperson. In: Jones JW, editor. The burnout syndrome. London: London House Press Park Ridge III; 1982. [Google Scholar]
- Fritz CO, Morris PE, Richler JJ. Effect size estimates: current use, calculations, and interpretation. J Exp Psychol Gen. 2012;141(1):2. doi: 10.1037/a0024338. [DOI] [PubMed] [Google Scholar]
- Gordon HJ, Demerouti E, Le Blanc PM, Bakker AB, Bipp T, Verhagen MA. Individual job redesign: job crafting interventions in healthcare. J Vocat Behav. 2018;104:98–114. doi: 10.1016/j.jvb.2017.07.002. [DOI] [Google Scholar]
- Gregory ST, Menser T. Improving physician well-being. JAMA Intern Med. 2015;175(4):649–649. doi: 10.1001/jamainternmed.2014.7850. [DOI] [PubMed] [Google Scholar]
- Gregory ST, Menser T, Gregory BT. An organizational intervention to reduce physician burnout. J Healthc Manag. 2018;63(5):338–352. doi: 10.1097/JHM-D-16-00037. [DOI] [PubMed] [Google Scholar]
- Guseva Canu I, Mesot O, Györkös C, Mediouni Z, Mehlum IS, Bugge MD. Burnout syndrome in Europe: towards a harmonized approach in occupational health practice and research. Ind Health. 2019;2:2018–2159. doi: 10.2486/indhealth.2018-0159. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guseva Canu I, et al. Harmonized definition of occupational burnout: a systematic review, semantic analysis, and Delphi consensus in 29 countries. Scand J Work Environ Health. 2021;47(2):95–107. doi: 10.5271/sjweh.3935. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guyatt GH, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–926. doi: 10.1136/bmj.39489.470347.AD. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Han S, et al. Estimating the attributable cost of physician burnout in the United States. Ann Intern Med. 2019;170(11):784–790. doi: 10.7326/M18-1422. [DOI] [PubMed] [Google Scholar]
- Hepburn SJ, Carroll A, McCuaig-Holcroft L. A complementary intervention to promote wellbeing and stress management for early career teachers. Int J Environ Res Public Health. 2021;18:12. doi: 10.3390/ijerph18126320. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kisling LA (2023) Prevention strategies StatPearls. StatPearls Publishing Copyright © 2023, StatPearls Publishing LLC., Treasure Island (FL)
- Koutsimani P, Montgomery A, Georganta K. The relationship between burnout, depression, and anxiety: a systematic review and meta-analysis. Front Psychol. 2019 doi: 10.3389/fpsyg.2019.00284. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kristensen TS, Borritz M, Villadsen E, Christensen KB. The Copenhagen burnout inventory: a new tool for the assessment of burnout. Work Stress. 2005;19(3):192–207. doi: 10.1080/02678370500297720. [DOI] [Google Scholar]
- Kuster AT, Dalsbø TK, Luong Thanh BY, Agarwal A, Durand-Moreau QV, Kirkehei I. Computer-based versus in-person interventions for preventing and reducing stress in workers. Cochrane Database Syst Rev. 2017;8:2. doi: 10.1002/14651858.CD011899.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LaMontagne AD, Keegel T, Louie AM, Ostry A, Landsbergis PA. A systematic review of the job-stress intervention evaluation literature, 1990–2005. Int J Occup Environ Health. 2007;13(3):268–280. doi: 10.1179/oeh.2007.13.3.268. [DOI] [PubMed] [Google Scholar]
- Lavoie-Tremblay M. Creating a healthy workplace: a participatory organizational intervention. J Nurs Adm. 2004;34(10):469–474. doi: 10.1097/00005110-200410000-00008. [DOI] [PubMed] [Google Scholar]
- Le Blanc PM, Hox JJ, Schaufeli WB, Taris TW, Peeters MC. Take care! The evaluation of a team-based burnout intervention program for oncology care providers. J Appl Psychol. 2007;92(1):213–227. doi: 10.1037/0021-9010.92.1.213. [DOI] [PubMed] [Google Scholar]
- Leiter MP, Laschinger HKS, Day A, Oore DG. The impact of civility interventions on employee social behavior, distress, and attitudes. J Appl Psychol. 2011;96:1258–1274. doi: 10.1037/a0024442. [DOI] [PubMed] [Google Scholar]
- Maslach C, Jackson S, Leiter M (1997) The maslach burnout inventory manual, vol 3, p 191-218
- Maslach C, Leiter MP. Burnout. Hum Behav. 1976;5:16–22. [Google Scholar]
- Maslach C, Leiter MP. Understanding the burnout experience: recent research and its implications for psychiatry. World Psychiatry. 2016;15(2):103–111. doi: 10.1002/wps.20311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Melchior MEW, Phihpsen H, Abu-Saad HH, Halfens RJG, van de Berg AA, Gassman P. The effectiveness of primary nursing on burnout among psychiatric nurses in long-stay settings. J Adv Nurs. 1996;24(4):694–702. doi: 10.1046/j.1365-2648.1996.02457.x. [DOI] [PubMed] [Google Scholar]
- Morris SB. Estimating effect sizes from pretest-posttest-control group designs. Organ Res Methods. 2008;11(2):364–386. doi: 10.1177/1094428106291059. [DOI] [Google Scholar]
- Neill CL, Hansen CR, Salois M. The economic cost of burnout in veterinary medicine. Front Vet Sci. 2022;9:814104. doi: 10.3389/fvets.2022.814104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nielsen K, Noblet A. Organizational interventions for health and well-being: a handbook for evidence-based practice. New York: Taylor & Francis; 2018. [Google Scholar]
- Page MJ, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:71. doi: 10.1136/bmj.n71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Panagioti M, et al. Controlled interventions to reduce burnout in physicians: a systematic review and meta-analysis. JAMA Intern Med. 2017;177(2):195–205. doi: 10.1001/jamainternmed.2016.7674. [DOI] [PubMed] [Google Scholar]
- Peterson U, Bergström G, Samuelsson M, Asberg M, Nygren A. Reflecting peer-support groups in the prevention of stress and burnout: randomized controlled trial. J Adv Nurs. 2008;63(5):506–516. doi: 10.1111/j.1365-2648.2008.04743.x. [DOI] [PubMed] [Google Scholar]
- Quinn RE, Spreitzer GM. The road to empowerment: seven questions every leader should consider. Organ Dyn. 1997;26(2):37–49. doi: 10.1016/S0090-2616(97)90004-8. [DOI] [Google Scholar]
- Romig MC, Latif A, Gill RS, Pronovost PJ, Sapirstein A. Perceived benefit of a telemedicine consultative service in a highly staffed intensive care unit. J Crit Care. 2012;27(4):426.e9–426.e16. doi: 10.1016/j.jcrc.2011.12.007. [DOI] [PubMed] [Google Scholar]
- Salvado M, Marques DL, Pires IM, Silva NM. Mindfulness-based interventions to reduce burnout in primary healthcare professionals: a systematic review and meta-analysis. Healthcare. 2021;9(10):1342. doi: 10.3390/healthcare9101342. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schaufeli W. The burnout enigma solved? Scand J Work Environ Health. 2021;3:169–170. doi: 10.5271/sjweh.3950. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schaufeli WB, Desart S, De Witte H. Burnout assessment tool (BAT)-development, validity, and reliability. Int J Environ Res Public Health. 2020;17:24. doi: 10.3390/ijerph17249495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schubauer-Berigan MK, Richardson DB, Fox MP, Fritschi L, Guseva Canu I, Pearce N, Stayner L, Berrington de Gonzalez A. IARC-NCI workshop on an epidemiological toolkit to assess biases in human cancer studies for hazard identification: beyond the algorithm. Occup Environ Med. 2023;80(3):119–120. doi: 10.1136/oemed-2022-108724. [DOI] [PubMed] [Google Scholar]
- Shaw JG, et al. Primary care 2.0: a prospective evaluation of a novel model of advanced team care with expanded medical assistant support. Ann Fam Med. 2021;19(5):411–418. doi: 10.1370/afm.2714. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shea JA, et al. Impact of protected sleep period for internal medicine interns on overnight call on depression, burnout, and empathy. J Grad Med Educ. 2014;6(2):256–263. doi: 10.4300/jgme-d-13-00241.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shoman Y, Marca SC, Bianchi R, Godderis L, van der Molen HF, Guseva Canu I. Psychometric properties of burnout measures: a systematic review. Epidemiol Psychiatr Sci. 2021;30:e8. doi: 10.1017/s2045796020001134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shoman Y, Hostettler R, Guseva Canu I. Psychometric validity of two patient reported burnout measures: a systematic review. Psychiatr Res. 2021;30:e8. doi: 10.1017/S2045796020001134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sterne J, Higgins J, Reeves B. A Cochrane risk of bias assessment tool: for non-randomized studies of interventions (ACROBAT-NRSI) Version. 2014;1:24. [Google Scholar]
- Sutton AJ, Abrams KR, Jones DR, Jones DR, Sheldon TA, Song F. Methods for meta-analysis in medical research. New York: Wiley Chichester; 2000. [Google Scholar]
- Thomas Craig KJ, Willis VC, Gruen D, Rhee K, Jackson GP. The burden of the digital environment: a systematic review on organization-directed workplace interventions to mitigate physician burnout. J Am Med Inform Assoc JAMIA. 2021;28(5):985–997. doi: 10.1093/jamia/ocaa301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van der Heijden F, Dillingh G, Bakker A, Prins J. Suicidal thoughts among medical residents with burnout. Arch Suicide Res. 2008;12(4):344–346. doi: 10.1080/13811110802325349. [DOI] [PubMed] [Google Scholar]
- van Weert JC, van Dulmen AM, Spreeuwenberg PM, Bensing JM, Ribbe MW. The effects of the implementation of snoezelen on the quality of working life in psychogeriatric care. Int Psychogeriatr. 2005;17(3):407–427. doi: 10.1017/s1041610205002176. [DOI] [PubMed] [Google Scholar]
- West CP, Dyrbye L, Erwin PJ, Shanafelt T. Interventions to reduce physician burnout: systematic review and meta-analysis. J Gen Intern Med. 2016;31(2):S283–S284. doi: 10.1016/S0140-6736(16)31279-X. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All data are available in the manuscript and its supported files. Any more information can be requested from the corresponding author.




