Abstract
Objectives
Given the important role of the autonomic nervous system (ANS) in stress regulation, astonishingly little is known about ANS functioning in burnout, a condition arising after prolonged exposure to work-related stress. The current study sought to investigate ANS modulation, as indexed by vagally-mediated heart rate variability (HRV), in relation to burnout symptomatology to (i) distinguish associations between the three dimensions of burnout [emotional exhaustion (EE), cynicism, reduced personal accomplishment] and (ii) investigate overlap in associations with depressive symptomatology.
Methods
Assessments of vagally-mediated HRV (ie, root mean square of successive differences, RMSSD) were conducted in a large population-based sample from the Dresden Burnout Study [N=410, mean age 42.2, standard deviation (SD) 11.2 years; 33.4% male]. Vagally-mediated HRV was assessed for 90 seconds during an emotionally-arousing situation (venipuncture, recumbent), a 335-second recumbent recovery period, and a 335-second seated resting condition.
Results
Results from multiple linear regression analyses revealed that EE was negatively related to RMSSD during venipuncture (β= −0.11, P=0.03) and the seated rest (β= −0.09, P=0.04) even after accounting for established ANS modulators (eg, age, body mass index). This pattern was not observed for the other dimensions of burnout. Exploratory analyses of depressive symptomatology further revealed that RMSSD was significantly and inversely associated with burnout-related symptoms but not with the core criteria of depression (eg, depressed mood).
Conclusions
This study presents evidence for a link between exhaustion and reduced vagal function, both in burnout and depression, suggesting that ANS modulations may not be disorder-specific but rather a psychophysiological correlate of an underlying feature shared by both conditions.
Key terms: affective disorder, chronic work stress, heart rate variability, stress, vagal function, work stress
Burnout, a prolonged response to chronic work stress with a growing incidence in industrialized countries, is known to be a risk factor for cardiovascular disease (CVD) even when controlling for classical risk factors (1, 2). The exact physiological mechanism(s) underlying this association are, however, still unknown. Given that the autonomic nervous system (ANS) is primarily involved in both the regulation of the cardiovascular system and stress reactivity, this system is a promising starting point for further investigation of this mechanism(s).
The ANS controls numerous visceral functions allowing the body to adequately and flexibly react to environmental challenges. This flexibility is achieved by its two main branches: the sympathetic nervous system (SNS) and the parasympathetic nervous system (PNS), respectively. The two branches act in a complementary manner with SNS activity enabling energy mobilization whereas the PNS rather facilitates energy conservation. Among healthy individuals, the SNS and the PNS are in dynamic balance allowing fast energy mobilization when needed and a rapid decline to energy restoring status after mastering of the internal or external challenge. Chronic stress, however, has been associated with hypoactive parasympathetic modulation via the vagus nerve, resulting in excessive demands on the body and limiting the capacity for energy restoration (3). Given its well-known role as an independent risk factor in CVD (4, 5), vagal dysfunction could be the missing link in explaining burnout-associated deterioration of cardiovascular health.
Heart rate variability (HRV) is a well-established marker of vagal function (6). HRV is defined as variations in time between consecutive heart beats (ie, inter-beat intervals), caused by the interplay of the two ANS branches at the sinoatrial node (SA) with SNS activity accelerating and PNS activity decelerating heart rate (HR). Due to differences in chemical signaling at the SA node, the vagus nerve is able to modulate HR on a time scale of milliseconds, whereas SNS responses are much slower (7, 8) making high-frequency changes in HRV a relatively pure measure of vagal function (9).
Several studies have revealed associations between reduced vagally-mediated HRV and burnout-related concepts, such as work-stress (10, 11), stress-related fatigue (12, 13), and exhaustion (14, 15). Only five studies, however, have investigated vagally-mediated HRV in conjunction with burnout, conceptualized as work stress-related exhaustion. The results of these studies have been mixed, with one study finding lower basal HRV, but no difference in HRV reactivity to a psychosocial stressor, among individuals with burnout compared to a healthy control group (16). Another study showed increased vagally-mediated HRV after a simulated mentally demanding workday among individuals with burn-out compared to controls (17), while three studies failed to find any significant associations between burnout and vagally-mediated HRV (18–20).
There are a number of potential reasons for these inconsistent findings including small and selective samples with respect to sex, age, and professional subgroups. In addition, the lack of a universally-accepted definition of burnout may also contribute to these ambiguous findings. The vast majority of research on burnout relies on the unidimensional conceptualization of the Maslach Burnout Inventory (MBI) total score, which defines burnout as a dichotomous variable comprising the sum score of the sub-dimensions emotional exhaustion (EE), cynicism, and reduced personal accomplishment (21). However, several researchers have questioned the ecological validity of combining the three MBI subscores into a single categorical variable (22–24). Besides a loss of information and reduction in statistical power when converting continuous data into a categorical variable, the lack of reliable and valid cut-off values for the MBI total score suggests the need to separately analyze each of the three MBI sub scores in their continuous form.
The present study aimed to address these limitations by investigating ANS modulations, indexed by vagally-mediated HRV, in relation to burnout symptomatology, as well as to examine potential overlap in associations among vagally-mediated HRV, burnout and depressive symptomatology. This was done in a large, heterogeneous sample, using a continuous, multidimensional conceptualization of burnout.
Given the notion that certain dysregulations in biological systems become evident only under stressful conditions (25), we assessed vagally-mediated HRV during different measurement occasions, namely an emotionally-arousing situation, a recumbent recovery period, and a seated resting condition, respectively.
We predicted that greater burnout symptomatology would be associated with reduced vagally-mediated HRV, with possible differences in the magnitude of this relation depending on the respective measurement occasion. Additionally, given the ongoing controversy regarding potential overlap of burnout with depression (review: 26), we also conducted exploratory analyses to examine differences and similarities between depressive and burnout-related symptoms in relation to vagal function.
Methods
Study population
Participants were a subsample from the Dresdner Burnout Study (DBS), a large-scale longitudinal study designed to assess psychological, societal and biological risk factors of burnout systematically. Participants of the DBS were recruited in Germany, Austria, and Switzerland via public media with a particular focus on the Dresden area. To accrue a large professionally and socioeconomically diverse sample, age 18–68 years and German language skills were selected as the only inclusion criteria. In addition to an online assessment of a range of psychosocial factors via the official study homepage (www.dresdner-burnout-studie.de), the DBS also includes annual sampling of several biological variables. HRV data used in the current study were obtained during in-person biomarker assessments, conducted from September to October 2015. These biomarker assessments included an emotionally-arousing situation, a recumbent recovery period and a seated resting condition. Based on both, previous evidence showing that venipuncture induced psychological and physiological stress responses (27) as well as significant differences between HR during blood sampling (mean 71.5, SEM 0.54) and recovery (mean 70.9, SEM 0.47), both recumbently recorded in the current sample (t(389)=−2.23, P=0.03), venipuncture was used to operationalize this emotionally-arousing situation in the present study. Even though vagally-mediated HRV was reduced during venipuncture (mean 3.36, SEM 0.03) when compared to the recumbent recovery period (mean 3.38, SEM 0.03), the means did not differ significantly (t(389)=0.69, P=0.49).
Altogether, 446 participants accepted our invitation to participate in these biomarker assessments. The sub-sample for the present study was selected based on complete data on all demographical, health-related, and psychological variables resulting in a sample of N=416 participants for the recumbent venipuncture, N=402 for the recumbent recovery condition, and N=408 for the seated resting condition. All participants provided written informed consent to both the online assessment and the biomarker sampling procedure. The ethics committee of TU Dresden approved the study. The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. Participants received a monetary compensation of €15.
Study design and procedure
The full biomarker sampling procedure lasted approximately 50 minutes and was conducted between 08:00–19:00 hours. One week before the biomarker sampling, participants completed an online questionnaire assessing burnout symptomatology, depressive symptomatology, and provided information on demographic and health-related factors. After arriving at the laboratory, participants signed the consent forms and were provided with heart rate devices (Polar RS800TM, Polar Electro, Oy, Kempele, Finland). They were then brought to the blood sampling room, where they laid down on a stretcher. HRV was recorded during the blood draw and participants remained in supine position for 6 minutes, during which recordings of recumbent recovery HRV were obtained. Approximately 20 minutes after completion of the recovery, participants were led to a separate room, where 6 minutes of seated resting HRV was assessed.
Self-report measures
The following demographic and health-related characteristics previously shown to influence cardiac vagal tone (28–33) were assessed: age, sex, alcohol and caffeine consumption (yes/no), smoking (yes/no), and regular physical exercise (yes/no). In addition, body mass index (BMI) was calculated based on participants’ self-reported weight and height.
Burnout was assessed with the German version (MBI-GS-D; 34) of the Maslach Burnout Inventory-General Survey (MBI-GS; 35), which consists of 16 items forming three subscales (EE, cynicism, reduced personal efficacy). The items are rated on a 7-point Likert scale (0=never, 6=daily). The weighted MBI total score (0.4×EE + 0.3×cynicism + 0.3×reduced personal accomplishment) (36) and the three MBI subscores were considered as continuous variables and analyzed separately.
Depression was measured with the German version (PHQ-9-D; 37) of the Patient Health Questionnaire (PHQ-9; 38). The PHQ-9 consists of nine items, which quantify the frequency, over the last two weeks, of each of the nine diagnostic criteria for a depressive disorder of the Diagnostic and Statistical Manual of Mental Disorders (39). The items are scored on a 4-point ranking scale (0=not at all, 3=nearly every day) and summed up to a continuous variable (PHQ-9 sum score), with higher scores representing higher severity of depression. In order to allow for differentiation between burnout-related and not burnout-related depressive symptomatology, separate somatic and cognitive symptom scores were derived within the PHQ-9, accordingly to de Jonge et al (40). More specifically, 4 PHQ-9 items related to burnout symptomatology, namely exhaustion, sleeping problems, changes in appetite and psychomotor agitation/retardation were considered as somatic depressive symptoms, whereas lack of interest, depressed mood, negative feelings about self, concentration problems and suicidal intention were considered burnout atypical cognitive depressive problems.
Heart rate data
Inter-beat intervals (IBI) were recorded with a Polar RS800 CX system via the corresponding chest belt (Polar Electro OY, Kempele, Finland) during the whole bio-marker sampling procedure with a sampling frequency of 1000 hz. Of the complete IBI timeline, the following data were used: (i) for the emotionally-arousing situation (venipuncture), the 90-second interval after needle insertion for blood sampling, (ii) a 335-second recumbent recovery interval directly after the 90-second venipuncture, (iii) a 335-second seated resting condition approximately 20 minutes after completion of the venipuncture. An interval after the venipuncture was chosen to avoid distortion of resting HRV by anticipatory fears. The data were then transferred to the Polar Precision Performance Software (Polar Electro OY, Kempele, Finland) and exported as the raw IBI data for further analysis. The ECG raw data were artefact corrected and the root mean square of successive differences (RMSSD) was calculated by Neurocor Ltd. & Co. KG (Trier, Germany), according to the guidelines of the Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology (9) using the NEU-ROCOR precision HRV-Algorithm. After detection of R-spikes using a modified Pan-Thompkins-Algorithm, identified artefacts were corrected and HRV measures were calculated.
RMSSD was used to operationalize high frequency variation in heart rate because of its status as an approved short-term measure of HRV reflecting vagal cardiac influence and its robustness against breathing patterns (9, 41). Preliminary analyses revealed high positive correlations between RMSSD and frequency-based measures of vagally-mediated HRV, which are also commonly used (correlation coefficients between 0.91 and 0.92, P<0.001). Despite this, no results of frequency-based HF-HRV measures are presented. The overall pattern of results is identical (data not shown).
Statistical analysis and data exclusion
RMSSD values at the three measurement occasions were not normally distributed and log transformations were applied to reduce skewness. Furthermore, extreme values (interquartile range of log-transformed RMSSD values ± 3 SD) were excluded resulting in final samples of N=410 at venipuncture, N=397 at recumbent recovery, and N=403 at seated rest, respectively.
Associations between questionnaire scores and RMSSD values during the three measurement occasions were examined by simple linear regression analyses and subsequent hierarchical multiple regression analyses adjusted for potential confounders. Given the high multicollinearity among the MBI total score and its sub-scores [EE: r(408)=0.89, P<0.001; cynicism: r(408)=0.86, P<0.001; reduced personal accomplishment: r(408)=0.65, P<0.001], as well as among the sub-scores [EE and cynicism: r(408)=0.65, P<0.001; EE and reduced personal accomplishment: r(408)=0.36, P<0.001; cynicism and reduced personal accomplishment: r(408)=0.43, P<0.001] separate hierarchical regression analyses were conducted for these measures. In a first step, age, sex, BMI, alcohol consumption, smoking, caffeine consumption, and regular physical exercise were entered. Next, the respective MBI score was added to this baseline model to examine the additional predictive value beyond well-known HRV determinants. The significance level was set to 0.05. All analyses were performed using SPSS Statistics 22 (IBM, Armonk, NY, USA).
Results
Table 1 provides demographic and health-related characteristics for the sample at venipuncture. These descriptive characteristics were virtually identical for the samples of the recumbent recovery and the seated rest conditions and are, therefore, not depicted here.
Table 1.
Mean | SD | % | Range | Scale range | |
---|---|---|---|---|---|
|
|||||
Age (years) | 42.17 | 11.18 | 19–67 | .. | |
Sex (male) | . | . | 33.4 | .. | .. |
BMI (kg/m2) | 25.18 | 4.53 | . | 17.30–42.52 | .. |
Alcohol consumption (yes) | . | . | 86.1 | .. | .. |
Smoking (yes) | . | . | 13.9 | .. | .. |
Caffeine consumption (yes) | . | . | 93.2 | .. | .. |
Regular exercise (yes) | . | . | 67.8 | .. | .. |
MBI total score | 2.25 | 1.17 | 17.3 a | 0.00–5.38 | 0.00–6.00 |
Emotional exhaustion | 2.86 | 1.16 | 37.6 a | 0.00–6.00 | 0.00–6.00 |
Cynicism | 2.05 | 1.51 | 19.3 a | 0.00–6.00 | 0.00–6.00 |
Reduced personal accomplishment | 1.64 | 1.13 | 7.6 a | 0.00–6.00 | 0.00–6.00 |
PHQ-9 | 8.39 | 5.32 | . | 0.00–27.00 | 0.00–27.00 |
PHQ-9 somatic | 4.30 | 2.64 | . | 0.00–12.00 | 0.00–12.00 |
PHQ-9 cognitive | 4.10 | 3.04 | . | 0.00–14.00 | 0.00–15.00 |
RMSSD | |||||
At blood draw | 35.03 | 22.72 | . | .. | 1.50–183.80 |
At recovery | 33.82 | 18.80 | . | .. | 4.41–108.71 |
At rest | 35.78 | 22.12 | . | .. | 6.16–147.64 |
% of individuals with serious burnout symptomatic accordingly to cutoff value introduced by Kalimo et al (36).
Results of the simple linear regression analyses predicting RMSSD at the three measurement occasions based on the MBI total score and its subscales are presented in table 2. EE significantly predicted RMSSD during all three measurement occasions, whereas the MBI total score predicted RMSSD only during venipuncture and seated rest. None of the other two MBI sub-scores explained a significant amount of RMSSD variance in any measurement occasion.
Table 2.
ln_RMSSD | ||||||
---|---|---|---|---|---|---|
| ||||||
Venipuncture (N=410) | Recovery (N=397) | Rest (N=403) | ||||
|
|
|
||||
Simple | Multiple a | Simple | Multiple a | Simple | Multiple a | |
|
|
|
|
|
|
|
β | β | β | β | β | β | |
|
||||||
Model 1: MBI | −0.10 b | −0.08 | −0.08 | −0.05 | −0.10 b | −0.06 |
Model 2: EE | −0.15 c | −0.11 b | −0.12 b | −0.06 | −0.15 c | −0.09 b |
Model 3: CY | −0.06 | −0.05 | −0.05 | −0.04 | −0.03 | −0.01 |
Model 4: PER | −0.00 | −0.00 | −0.00 | −0.01 | −0.03 | −0.03 |
Model adjusted for age, sex, body mass index, smoking, caffeine consumption, regular exercise.
P<0.05.
P<0.01.
Next, two-step hierarchical regression analyses were performed to test for independent effects of the MBI total score and its sub-scores on RMSSD (table 2). During all three measurement occasions, the baseline model predicted the largest amount of total explained variance in RMSSD (venipuncture: R2 adjusted=0.06, F(7,402)=4.87, P<0.001; recumbent recovery: R2 adjusted=0.16, F(7,389)=11.39, P<0.001; seated rest: R2 adjusted=0.19, F(7,395)=14.37, P<0.001). Thereby, age was the only baseline model variable, which significantly predicted RMSSD during all measurement occasions (venipuncture: β=−0.25, t(402)=−4.89, P<0.001; recumbent recovery: β=−0.35, t(389)=−7.18, P<0.001; seated rest: β=−0.39, t(395)=−8.20, P<0.001). Beyond age, BMI at recumbent recovery (β=−0.11, t(389)=−2.28, P=0.02) and physical exercise at seated rest (β=−0.17, t(402)=3.65, P<0.001) were the only additional significant baseline-model predictors. This pattern did not change with adding the MBI total score or any of its subscale scores to the regression analyses.
The second step of regression analyses (table 1, model 2) provided partial confirmation of the research hypothesis by revealing a significant additional effect of EE on RMSSD at venipuncture (ΔR2 adjusted=0.01, F(8,401)=4.92, P<0.001) and seated rest (ΔR2 adjusted=0.01, F(8,388)=13.20, P<0.001) when entered after the baseline model. However, neither the MBI total score nor the other MBI sub-scores significantly contributed to RMSSD prediction beyond the baseline model at any measurement occasion.
Exploratory analyses on depressive symptomatology and HRV
Based on our results for EE as well as previous contentions that the association between burnout and other psychophysiological markers is primarily driven by comorbid depression (26), exploratory analyses were conducted to further examine the interrelations among EE, depression symptomatology and vagally-mediated HRV. As expected, depression symptoms, operationalized by the PHQ-9 sum score, were negatively associated with RMSSD during seated rest (r(401)=−0.15, P=0.003) and recumbent recovery (r(395)=−0.10, P=0.047). When decomposing the PHQ-9 sum score into a cognitive-affective and a somatic factor, as suggested by de Jonge et al (40), findings revealed that the PHQ-9 somatic symptoms were primarily responsible for this association. In particular, the somatic subscale was significantly inversely associated with RMSSD during all three measurement occasions (venipuncture: r(408)=−0.10, P=0.047; recumbent recovery: r(395)=−0.12, P=0.02; seated rest: r(401)=−0.17, P=0.001), whereas the cognitive symptom score showed associations only during seated rest (r(401)=−0.11, P=0.02). Consistent with this pattern, during all three measurement occasions reductions in associations between EE and RMSSD when controlling for depressive symptoms were strongest for the somatic factor and lowest for the cognitive-affective factor (figure 1).
Discussion
The goal of the present study was to examine the association between burnout and vagally-mediated HRV in a large, heterogeneous population-based sample. In partial support of our primary hypothesis, we found that the EE component of burnout was significantly and inversely associated with RMSSD during an emotionally-arousing situation (venipuncture) and a seated resting period, even after accounting for the effects of age, sex, BMI, alcohol and caffeine consumption, smoking, and regular physical exercise. However, neither the MBI total score nor the cynicism or reduced personal accomplishment subscales were associated with vagally-mediated HRV at any measurement occasion when controlling for the influence of covariates.
The current notion that exhaustion yields specific findings when examining associations with measures of parasympathetic function has also emerged from previous research not necessarily focusing on burnout (14, 15, 42). Previous studies have also reported EE as the primary burnout subscale showing associations with physiological stress markers such as allostatic load (43, 44), and HPA axis function (review: 45, 46). However, to our knowledge, our study is the first to demonstrate the effects of burnout-associated exhaustion with vagal function. Taken together with the well-established link between reduced vagally-mediated HRV and CVD (review: 5), as well as longitudinal evidence showing vital exhaustion to be predictive of CVD (47–50), our results indicate that EE may also be a psychological factor contributing to risk for CVD.
Contrary to our expectations, we did not find the MBI total score to be significantly associated with vagal activity at any measurement period. This is surprising, given that chronic work stress, the causal prerequisite of burnout, has been repeatedly associated with lower vagally-mediated HRV (10, 11). Nonetheless, this finding is in line with some previous investigations of burnout (18–20). Indeed, two other studies reported significant effects of burnout on vagally-mediated HRV, albeit in opposite directions, using unidimensional burnout scores. In particular, de Vente et al (16) found reduced baseline HF-HRV amongst individuals endorsing burnout symptoms when compared to a healthy control group. In contrast, Zanstra and colleagues (17) observed a significant increase in HF-HRV in a sample of individuals with burnout, after a simulated mentally-demanding workday. Interestingly, no such pattern was seen in a no-burnout control group. One explanation for these divergent findings are differences in the operationalization of burnout, whereby studies either used different burnout questionnaires with varying cut-off values (17–20) or determined burnout status using a clinical screening procedure (16). Additional methodological variance might be due to the use of categorical (16–18, 20) versus continuous (19) conceptualizations of burnout. Given these methodological differences, it may be premature to draw firm empirically validated conclusions regarding the association between burnout and vagal function. Nonetheless, our finding concerning the outstanding role of EE supports previous indications of considering the relationship between burnout and psychophysiological variables on a symptom level (51).
As a secondary, more exploratory question, we also investigated the overlap of associations between burnout and depression. In line with previous studies showing diminished effects of burnout on health outcomes when controlling for depressive symptomatology (43, 52), we found that the introduction of depression attenuated the association between EE and RMSSD. This is not surprising, given the large symptom overlap between burnout, and particularly the EE dimension, with depression, both cross-sectionally (26, 53) and longitudinally (54). However, employing the approach described by de Jonge et al (40), our results suggest that the depressive somatic factor, and not the core criteria of depression (namely depressive mood and lack of interest), was primarily responsible for reducing the associations between EE and RMSSD. This is in line with previous research showing that somatic, but not cognitive-affective symptoms mainly accounted for the association between depression and both vagally-mediated HRV (for review see 55, 56) as well as CVD (57–59). Thus, in contrast to previous claims that global depressive symptomatology accounts for the association between burnout and physiological processes, our results indicate that it is the exhaustion-related symptomatology, common to both burnout and depression, which appears to be driving the association with PNS dysregulation.
An advantage of the present study design was that associations between burnout and vagally-mediated HRV were examined at different measurement occasions, allowing for the possibility to observe how/whether the relationship between EE and HRV differs under differing modes of physiological regulation. In line with previous notions of differences between patients and controls being more accented during stressful conditions (25), we observed association between EE and vagal withdrawal being most pronounced during an emotionally-arousing situation (venipuncture). Keeping in mind the relatively small yet significant effect of venipuncture on HR (physiological index for arousal) in the present study, future research applying more stressful conditions are necessary to extend the knowledge about the contextual requirements for the observability of associations between burn-out and vagally-mediated HRV.
In addition, albeit to a lesser extent, we observed associations between EE and reductions in vagal cardiac control during a seated rest condition (ie, 20 minutes after the blood draw). Given the well-validated role of vagally-mediated resting HRV as a trait-like marker of self-regulation, reductions in resting vagally-mediated HRV are of special relevance reflecting an individual’s capacity to flexibly and appropriately respond and adapt, both physiologically and behaviorally, to changing environmental demands (60 64). The finding of reduced resting vagally-mediated HRV indicates that an increase in exhaustion symptoms may be accompanied by impairment in this dynamic regulatory ability, a condition which has previously been associated with increased risk for all-cause morbidity and mortality (5).
No EE-related decrease in RMSSD was found during a recumbent recovery period. Given that impaired recovery processes after acute stress have been suggested as an explanatory mechanism of burnout (65, 66), as well as the rather limited extent of emotional arousal induced in the present study, longitudinal studies with a specific focus on recovery processes may nevertheless be promising starting points for research on burnout etiology.
There are also some limitations to be considered. First, our assessment was cross-sectional in nature and does not allow any assertions about causality or directionality of the negative association between vagal function and burnout symptomatology. Furthermore, although we considered several confounding variables, we were unable to account for other factors (ie, previous history of psychiatric disorders, chronic disease and medication intake) that might potentially influence ANS function. Thus, longitudinal investigations incorporating valid and comprehensive medical and psychosocial examinations are necessary in order to illuminate the cause–effect relationship between burn-out and autonomic functioning. Second, using blood sampling to induce emotional arousal is not without controversy (27). Even though blood sampling as a naturally occurring stressor has a high ecological validity and our manipulation check using HR indicated that blood sampling induced arousal, future studies should use stronger and longer lasting stressors. Third, because we were unable to obtain resting HF-HRV temporally independently of the emotionally-arousing situation, it remains unclear what role individual differences in baseline vagally-mediated HRV may have played in our findings. Fourth, given the lack of universally accepted diagnostic criteria, we operationalized burnout using the MBI-GS, although we are aware that the MBI-GS has been criticized with regard to several methodological shortcomings (67–69). Nonetheless, taken together that the factorial validity of the MBI has been found to have a superior model fit than 1- or 2-factor burnout models (70–72), as well as the generally good internal consistencies for its subscales, the MBI-GS appears to be the most valid and reliable measure of burnout at the moment. Finally, due to limited data regarding the association of burnout with changes in autonomic function, we acknowledge the relatively high number of statistical tests in the present study to examine this relationship. Thus, our findings should be interpreted with caution, as additional research, including prospective studies, are needed to further validate the present results.
In conclusion, we found EE to be associated with reduced vagal function during an emotionally-arousing venipuncture and a seated resting condition even when controlling for well-known confounders, in a large population-based sample. The EE component of burn-out appears to be a promising starting point for future research attempts exploring the repeatedly documented association between burnout and CVD (1, 2). In view of the overlap between burnout and depression, our results suggest that a focus on symptom-based approaches rather than classic diagnostic categories might be particularly fruitful.
Acknowledgments
The TU Dresden’s Institutional Strategy (“The Synergetic University”), which is funded by the Excellence Initiative of the German Federal and State Governments, supported this study. The German Academic Scholarship Foundation supported MKK. The funders were not involved in the design, collection, analysis, interpretation and publication decisions of the data. We acknowledge the essential contributions of Professor Drs Nina Alexander, Angelika Buske-Kirschbaum, Jürgen Hoyer, and Katja Beesdo-Baum and Drs Robert Miller and Lars Pieper for their valuable help regarding the design and the conduction of the Dresdner Burnout Study. Furthermore, the authors express thanks to Elisabeth Altstadt, Marion Augustin, Lysann Kaden, Vera M. Ludwig, Rutger Nagel, Alexander Pauls, Rebekka Röndigs, Kelly Schaunsland, Carolin Scholl, and Sabrina Wallrabenstein for assistance during data collection.
The authors declare no conflicts of interest.
References
- 1.Melamed S, Shirom A, Toker S, Berliner S, Shapira I. Burnout and risk of cardiovascular disease: evidence, possible causal paths, and promising research directions. Psych Bull. 2006;132:327–53. doi: 10.1037/0033-2909.132.3.327. https://doi.org/10.1037/0033-2909.132.3.327. [DOI] [PubMed] [Google Scholar]
- 2.Toker S, Melamed S, Berliner S, Zeltser D, Shapira I. Burnout and risk of coronary heart disease: a prospective study of 8838 employees. Psychosom Med. 2012;74:840–7. doi: 10.1097/PSY.0b013e31826c3174. https://doi.org/10.1097/PSY.0b013e31826c3174. [DOI] [PubMed] [Google Scholar]
- 3.Thayer JF, Lane RD. Claude Bernard and the heart–brain connection: further elaboration of a model of neurovisceral integration. Neurosci Biobehav Reviews. 2009;33:81–8. doi: 10.1016/j.neubiorev.2008.08.004. https://doi.org/10.1016/j.neubiorev.2008.08.004. [DOI] [PubMed] [Google Scholar]
- 4.Thayer JF, Lane RD. The role of vagal function in the risk for cardiovascular disease and mortality. Biol Psych. 2007;74:224–42. doi: 10.1016/j.biopsycho.2005.11.013. https://doi.org/10.1016/j.biopsycho.2005.11.013. [DOI] [PubMed] [Google Scholar]
- 5.Thayer JF, Yamamoto SS, Brosschot JF. The relationship of autonomic imbalance, heart rate variability and cardiovascular disease risk factors. Int J Cardiol. 2009;141:122–31. doi: 10.1016/j.ijcard.2009.09.543. https://doi.org/10.1016/j.ijcard.2009.09.543. [DOI] [PubMed] [Google Scholar]
- 6.Kuo TB, Lai CJ, Huang YT, Yang CC. Regression analysis between heart rate variability and Baroreflex-related vagus nerve activity in rats. J Cardiovasc Electrophysiol. 2005;16:864–69. doi: 10.1111/j.1540-8167.2005.40656.x. https://doi.org/10.1111/j.1540-8167.2005.40656.x. [DOI] [PubMed] [Google Scholar]
- 7.Saul JP. Beat-to-beat variations of heart rate reflect modulation of cardiac autonomic outflow. Physiology. 1990;5:32–7. [Google Scholar]
- 8.Berntson GG, Bigger JT, Eckberg DL, Grossman P, Kaufmann PG, Malik M, et al. Heart rate variability: origins, methods, and interpretive caveats. Psychophysiology. 1997;34:623–48. doi: 10.1111/j.1469-8986.1997.tb02140.x. https://doi.org/10.1111/j.1469-8986.1997.tb02140.x. [DOI] [PubMed] [Google Scholar]
- 9.Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. Heart rate variability: standards of measurement, physiological interpretation and clinical use. Circulation. 1996;93:1043–65. https://doi.org/10.1161/01.CIR.93.5.1043. [PubMed] [Google Scholar]
- 10.Chandola T, Heraclides A, Kumari M. Psychophysiological biomarkers of workplace stressors. Neurosci Biobehav Reviews. 2010;35:51–7. doi: 10.1016/j.neubiorev.2009.11.005. https://doi.org/10.1016/j.neubiorev.2009.11.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Jarczok MN, Jarczok M, Mauss D, Koenig J, Li J, Herr RM, et al. Autonomic nervous system activity and workplace stressors—a systematic review. Neurosci Biobehav Reviews. 2013;37:1810–23. doi: 10.1016/j.neubiorev.2013.07.004. https://doi.org/10.1016/j.neubiorev.2013.07.004. [DOI] [PubMed] [Google Scholar]
- 12.Olsson EM, Roth WT, Melin L. Psychophysiological characteristics of women suffering from stress-related fatigue. Stress Health. 2010;26:113–26. https://doi.org/10.1002/smi.1271. [Google Scholar]
- 13.Beaumont A, Burton AR, Lemon J, Bennett BK, Lloyd A, Vollmer-Conna U. Reduced cardiac vagal modulation impacts on cognitive performance in chronic fatigue syndrome. PLoS One. 2012;7:e49518. doi: 10.1371/journal.pone.0049518. https://doi.org/10.1371/journal.pone.0049518. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Watanabe T, Sugiyama Y, Sumi Y, Watanabe M, Takeuchi K, Kobayashi F, et al. Effects of vital exhaustion on cardiac autonomic nervous functions assessed by heart rate variability at rest in middle-aged male workers. Int J Behav Med. 2002;9:68–75. doi: 10.1207/s15327558ijbm0901_05. https://doi.org/10.1207/S15327558IJBM0901_05. [DOI] [PubMed] [Google Scholar]
- 15.Collins S, Karasek R. Reduced vagal cardiac control variance in exhausted and high strain job subjects. Int J Occup Med Environ Health. 2010;23:267–78. doi: 10.2478/v10001-010-0023-6. https://doi.org/10.2478/v10001-010-0023-6. [DOI] [PubMed] [Google Scholar]
- 16.de Vente W, van Amsterdam JG, Olff M, Kamphuis JH, Emmelkamp PM. Burnout is associated with reduced parasympathetic activity and reduced HPA axis responsiveness, predominantly in males. Biomed Res Int. 2015:431725. doi: 10.1155/2015/431725. https://doi.org/10.1155/2015/431725. [DOI] [PMC free article] [PubMed]
- 17.Zanstra YJ, Schellekens JM, Schaap C, Kooistra L. Vagal and sympathetic activity in burnouts during a mentally demanding workday. Psychosom Med. 2006;68:583–90. doi: 10.1097/01.psy.0000228012.38884.49. https://doi.org/10.1097/01.psy.0000228012.38884.49. [DOI] [PubMed] [Google Scholar]
- 18.Van Doornen LJ, Houtveen JH, Langelaan S, Bakker AB, van Rhenen W, Schaufeli WB. Burnout versus work engagement in their effects on 24-hour ambulatory monitored cardiac autonomic function. Stress Health. 2009;25:323–31. https://doi.org/10.1002/smi.1279. [Google Scholar]
- 19.Henning MA, Sollers J, Strom JM, Hill AG, Lyndon MP, Cumin D, et al. Junior doctors in their first year: mental health, quality of life, burnout and heart rate variability. Perspect Med Educ. 2014;3:136–43. doi: 10.1007/s40037-013-0075-y. https://doi.org/10.1007/s40037-013-0075-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Jönsson P, Österberg K, Wallergård M, Hansen ÅM, Garde AH, Johansson G, et al. Exhaustion-related changes in cardiovascular and cortisol reactivity to acute psychosocial stress. Physiol Behav. 2015;151:327–37. doi: 10.1016/j.physbeh.2015.07.020. https://doi.org/10.1016/j.physbeh.2015.07.020. [DOI] [PubMed] [Google Scholar]
- 21.Maslach C, Jackson SE. The measurement of experienced burnout. J Organ Behav. 1981;2:99–113. https://doi.org/10.1002/job.4030020205. [Google Scholar]
- 22.Koeske GF, Koeske RD. Construct validity of the Maslach Burnout Inventory: a critical review and reconceptualization. J Appl Behav Sci. 1981;25:131–44. https://doi.org/10.1177/0021886389252004. [Google Scholar]
- 23.Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory manual. Mountain View (CA): CPP. Inc., and Davies-Black; 1996. [Google Scholar]
- 24.Brenninkmeijer V, vanYperen N. How to conduct research on burnout: advantages and disadvantages of a unidimensional approach in burnout research. J Occup Env Med. 2003;60:i16–i20. doi: 10.1136/oem.60.suppl_1.i16. https://doi.org/10.1136/oem.60.suppl_1.i16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Kudielka BM, Wüst S. Human models in acute and chronic stress: assessing determinants of individual hypothalamus–pituitary–adrenal axis activity and reactivity. Stress. 2010;13:1–14. doi: 10.3109/10253890902874913. https://doi.org/10.3109/10253890902874913. [DOI] [PubMed] [Google Scholar]
- 26.Bianchi R, Schonfeld IS, Laurent E. Burnout–depression overlap: a review. Clin Psychol Rev. 2015:3628–41. doi: 10.1016/j.cpr.2015.01.004. https://doi.org/10.1016/j.cpr.2015.01.004. [DOI] [PubMed]
- 27.Weckesser LJ, Plessow F, Pilhatsch M, Muehlhan M, Kirschbaum C, Miller R. Do venepuncture procedures induce cortisol responses? A review, study, and synthesis for stress research. Psychoneuroendocrinology. 2014;46:88–99. doi: 10.1016/j.psyneuen.2014.04.012. https://doi.org/10.1016/j.psyneuen.2014.04.012. [DOI] [PubMed] [Google Scholar]
- 28.Hayano J, Yamada M, Sakakibara Y, Fujinami T, Yokoyama K, Watanabe Y, et al. Short-and long-term effects of cigarette smoking on heart rate variability. Am J Cardiol. 1990;65:84–8. doi: 10.1016/0002-9149(90)90030-5. https://doi.org/10.1016/0002-9149(90)90030-5. [DOI] [PubMed] [Google Scholar]
- 29.Rossy LA, Thayer JF. Fitness and gender-related differences in heart period variability. Psychosom Med. 1998;60:773–81. doi: 10.1097/00006842-199811000-00022. https://doi.org/10.1097/00006842-199811000-00022. [DOI] [PubMed] [Google Scholar]
- 30.Karason K, Mølgaard H, Wikstrand J, Sjöström L. Heart rate variability in obesity and the effect of weight loss. Am J Cardiol. 1999;83:1242–47. doi: 10.1016/s0002-9149(99)00066-1. https://doi.org/10.1016/S0002-9149(99)00066-1. [DOI] [PubMed] [Google Scholar]
- 31.Bonnemeier H, Wiegand UK, Brandes A, Kluge N, Katus HA, Richardt G, et al. Circadian profile of cardiac autonomic nervous modulation in healthy subjects. J Cardiovasc Electrophysiol. 2003;14:791–99. doi: 10.1046/j.1540-8167.2003.03078.x. https://doi.org/10.1046/j.1540-8167.2003.03078.x. [DOI] [PubMed] [Google Scholar]
- 32.Thayer JF, Hall M, Sollers JJ, Fischer JE. Alcohol use, urinary cortisol, and heart rate variability in apparently healthy men: Evidence for impaired inhibitory control of the HPA axis in heavy drinkers. Int J Psychophysiol. 2006;59:244–50. doi: 10.1016/j.ijpsycho.2005.10.013. https://doi.org/10.1016/j.ijpsycho.2005.10.013. [DOI] [PubMed] [Google Scholar]
- 33.Koenig J, Jarczok MN, Kuhn W, Morsch K, Schäfer A, Hillecke TK, et al. Impact of caffeine on heart rate variability: a systematic review. J Caffeine Res. 2013;3:22–37. https://doi.org/10.1089/jcr.2013.0009. [Google Scholar]
- 34.Büssing A, Glaser J. Deutsche Fassung des Maslach Burnout Inventory–General Survey (MBI-GS-D) München: Technische Universität, Lehrstuhl für Psychologie; 1999. [Google Scholar]
- 35.Schaufeli WB, Leiter MP, Maslach C, Jackson SE. Maslach Burnout Inventory-General Survey. In: Maslach C, Jackson SE, Leiter MP, editors. The Maslach Burnout Inventory-Test Manual. 3. Palo Alto (CA): Consulting Psychologists Press; 1996. [Google Scholar]
- 36.Kalimo R, Pahkin K, Mutanen P, Topipinen-Tanner S. Staying well or burning out at work: work characteristics and personal resources as long-term predictors. Work Stress. 2003;17:109–22. https://doi.org/10.1080/0267837031000149919. [Google Scholar]
- 37.Löwe BLSR, Spitzer RL, Zipfel S, Herzog W. PRIME MD Patient Health Questionnaire (PHQ) - German version. 2. Karlsruhe; Pfitzer: 2002. Gesundheitsfragebogen für Patienten (PHQ-9). Manual und Testunterlagen. 2. Auflage. [Google Scholar]
- 38.Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–13. doi: 10.1046/j.1525-1497.2001.016009606.x. https://doi.org/10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 4. Washington (DC): American Psychiatric Association; 2000. [Google Scholar]
- 40.de Jonge P, Mangano D, Whooley MA. Differential association of cognitive and somatic depressive symptoms with heart rate variability in patients with stable coronary heart disease: findings from the Heart and Soul Study. Psychosom Med. 2007;69:735–9. doi: 10.1097/PSY.0b013e31815743ca. https://doi.org/10.1097/PSY.0b013e31815743ca. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Hill LK, Siebenbrock A, Sollers JJ, Thayer JF. Are all measures created equal? Heart rate variability and respiration. Biomed Sci Instrum. 2009;45:71–6. [PubMed] [Google Scholar]
- 42.Keltikangas-Järvinen L, Heponiemi T. Vital exhaustion, temperament, and cardiac reactivity in task-induced stress. Biol Psych. 2004;65:121–35. doi: 10.1016/s0301-0511(03)00112-1. https://doi.org/10.1016/S0301-0511(03)00112-1. [DOI] [PubMed] [Google Scholar]
- 43.Bellingrath S, Weigl T, Kudielka BM. Chronic work stress and exhaustion is associated with higher allostastic load in female school teachers: original Research Report. Stress. 2009;12:37–48. doi: 10.1080/10253890802042041. https://doi.org/10.1080/10253890802042041. [DOI] [PubMed] [Google Scholar]
- 44.Juster R-P, Sindi S, Marin M-F, Perna A, Hashemi A, Pruessner JC, et al. A clinical allostatic load index is associated with burnout symptoms and hypocortisolemic profiles workers. Psychoneuroendocrinology. 2011;36:797–805. doi: 10.1016/j.psyneuen.2010.11.001. https://doi.org/10.1016/j.psyneuen.2010.11.001. [DOI] [PubMed] [Google Scholar]
- 45.Kudielka BM, Bellingrath S, Hellhammer DH. Cortisol in burnout and vital exhaustion: an overview. G Ital Med Lav Ergon. 2006;28:34–42. [PubMed] [Google Scholar]
- 46.Chida Y, Steptoe A. Cortisol awakening response and psychosocial factors: a systematic review and meta-analysis. Biol Psych. 2009;80:265–78. doi: 10.1016/j.biopsycho.2008.10.004. https://doi.org/10.1016/j.biopsycho.2008.10.004. [DOI] [PubMed] [Google Scholar]
- 47.Cole SR, Kawachi I, Sesso HD, Paffenbarger RS, Lee IM. Sense of exhaustion and coronary heart disease among college alumni. Am J Cardiol. 1999;84:1401–5. doi: 10.1016/s0002-9149(99)00585-8. https://doi.org/10.1016/S0002-9149(99)00585-8. [DOI] [PubMed] [Google Scholar]
- 48.Prescott E, Holst C, Grønbæk M, Schnohr P, Jensen G, Barefoot J. Vital exhaustion as a risk factor for ischaemic heart disease and all-cause mortality in a community sample. A prospective study of 4084 men and 5479 women in the Copenhagen City Heart Study. Int J Epidemiol. 2003;32:990–7. doi: 10.1093/ije/dyg235. https://doi.org/10.1093/ije/dyg235. [DOI] [PubMed] [Google Scholar]
- 49.Lindeberg SI, Rosvall M, Östergren PO. Exhaustion predicts coronary heart disease independently of symptoms of depression and anxiety in men but not in women. J Psychosom Res. 2012;72:17–21. doi: 10.1016/j.jpsychores.2011.09.001. https://doi.org/10.1016/j.jpsychores.2011.09.001. [DOI] [PubMed] [Google Scholar]
- 50.Schnohr P, Marott JL, Kristensen TS, Gyntelberg F, Grønbæk M, Lange P, et al. Ranking of psychosocial and traditional risk factors by importance for coronary heart disease: the Copenhagen City Heart Study. Eur Heart J. 2015;36:1385–93. doi: 10.1093/eurheartj/ehv027. https://doi.org/10.1093/eurheartj/ehv027. [DOI] [PubMed] [Google Scholar]
- 51.Danhof-Pont MB, van Veen T, Zitman FG. Biomarkers in burnout: a systematic review. J Psychosom Res. 2011;70:505–24. doi: 10.1016/j.jpsychores.2010.10.012. https://doi.org/10.1016/j.jpsychores.2010.10.012. [DOI] [PubMed] [Google Scholar]
- 52.Hintsa T, Elovainio M, Jokela M, Ahola K, Virtanen M, Pirkola S. Is there an independent association between burnout and increased allostatic load? Testing the contribution of psychological distress and depression. J Health Psychol. 2014;21:1576–86. doi: 10.1177/1359105314559619. https://doi.org/10.1177/1359105314559619. [DOI] [PubMed] [Google Scholar]
- 53.Schaufeli W, Enzmann D. The burnout companion to study and practice: a critical analysis. London: Taylor and Francis; 1998. [Google Scholar]
- 54.Bianchi R, Schonfeld IS, Laurent E. Burnout does not help predict depression among French school teachers. Scand J Work Environ Health. 2005;41:565–8. doi: 10.5271/sjweh.3522. https://doi.org/10.5271/sjweh.3522. [DOI] [PubMed] [Google Scholar]
- 55.Kemp AH, Quintana DS, Gray MA, Felmingham KL, Brown K, Gatt JM. Impact of depression and antidepressant treatment on heart rate variability: a review and meta-analysis. Biol Psychiatry. 2010;67:1067–74. doi: 10.1016/j.biopsych.2009.12.012. https://doi.org/10.1016/j.biopsych.2009.12.012. [DOI] [PubMed] [Google Scholar]
- 56.Bassett D. A literature review of heart rate variability in depressive and bipolar disorders. Aust N Z J Psychiatry. 2015;50:793–804. doi: 10.1177/0004867415622689. https://doi.org/10.1177/0004867416652734. [DOI] [PubMed] [Google Scholar]
- 57.Schiffer AA, Pelle AJ, Smith OR, Widdershoven JW, Hendriks EH, Pedersen SS. Somatic versus cognitive symptoms of depression as predictors of all-cause mortality and health status in chronic heart failure. J Clin Psychiatry. 2009;70:1667–73. doi: 10.4088/JCP.08m04609. https://doi.org/10.4088/JCP.08m04609. [DOI] [PubMed] [Google Scholar]
- 58.Smolderen KG, Spertus JA, Reid KJ, Buchanan DM, Krumholz HM, Denollet J, et al. The association of cognitive and somatic depressive symptoms with depression recognition and outcomes after myocardial infarction. Circ Cardiovasc Qual Outcomes. 2009;2:328–37. doi: 10.1161/CIRCOUTCOMES.109.868588. https://doi.org/10.1161/CIRCOUTCOMES.109.868588. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Roest AM, Thombs BD, Grace SL, Stewart DE, Abbey SE, de Jonge Somatic/affective symptoms, but not cognitive/affective symptoms, of depression after acute coronary syndrome are associated with 12-month all-cause mortality. J Affect Disord. 2011;13:158–63. doi: 10.1016/j.jad.2010.11.018. https://doi.org/10.1016/j.jad.2010.11.018. [DOI] [PubMed] [Google Scholar]
- 60.Appelhans BM, Luecken LJ. Heart rate variability as an index of regulated emotional responding. Rev Gen Psychol. 2006;10:229–40. https://doi.org/10.1037/1089-2680.10.3.229. [Google Scholar]
- 61.Segerstrom SC, Nes LS. Heart rate variability reflects self-regulatory strength, effort, and fatigue. Psychol Sci. 2007;18:275–81. doi: 10.1111/j.1467-9280.2007.01888.x. https://doi.org/10.1111/j.1467-9280.2007.01888.x. [DOI] [PubMed] [Google Scholar]
- 62.Thayer JF, Åhs F, Fredrikson M, Sollers JJ, Wager TD. A meta-analysis of heart rate variability and neuroimaging studies: implications for heart rate variability as a marker of stress and health. Neurosci Biobehav Reviews. 2012;36:747–56. doi: 10.1016/j.neubiorev.2011.11.009. https://doi.org/10.1016/j.neubiorev.2011.11.009. [DOI] [PubMed] [Google Scholar]
- 63.Gillie BL, Vasey MW, Thayer JF. Heart rate variability predicts control over memory retrieval. Psychol Sci. 2014;25:458–65. doi: 10.1177/0956797613508789. https://doi.org/10.1177/0956797613508789. [DOI] [PubMed] [Google Scholar]
- 64.Williams DP, Cash C, Rankin C, Bernardi A, Koenig J, Thayer JF. Resting heart rate variability predicts self-reported difficulties in emotion regulation: a focus on different facets of emotion regulation. Front Psychol. 2015;6:261. doi: 10.3389/fpsyg.2015.00261. https://doi.org/10.3389/fpsyg.2015.00261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Geurts SA, Sonnentag S. Recovery as an explanatory mechanism in the relation between acute stress reactions and chronic health impairment. Scand J Work Environ Health. 2006;32:482–92. doi: 10.5271/sjweh.1053. https://doi.org/10.5271/sjweh.1053. [DOI] [PubMed] [Google Scholar]
- 66.Söderström M, Jeding K, Ekstedt M, Perski A, Åkerstedt T. Insufficient sleep predicts clinical burnout. J Occup Health Psychol. 2012;17:175–83. doi: 10.1037/a0027518. https://doi.org/10.1037/a0027518. [DOI] [PubMed] [Google Scholar]
- 67.Demerouti E, Bakker AB, Nachreiner F, Schaufeli WB. The job demands-resources model of burnout. J Appl Psychol. 2001;86:499–512. https://doi.org/10.1037/0021-9010.86.3.499. [PubMed] [Google Scholar]
- 68.Bouman AM, Te Brake H, Hoogstraten J. Significant effects due to rephrasing the Maslach Burnout Inventory’s personal accomplishment items [Electronic Version] Psychol Rep. 2002;91:825–6. doi: 10.2466/pr0.2002.91.3.825. https://doi.org/10.2466/pr0.2002.91.3.825. [DOI] [PubMed] [Google Scholar]
- 69.Shirom A. Job-related burnout: a review. In: Quick JC, Tetrick LE, editors. Handbook of occupational health psychology. Washington (DC): American Psychological Association; 2003. pp. 245–64. https://doi.org/10.1037/10474-012. [Google Scholar]
- 70.Schutte N, Toppinen S, Kalimo R, Schaufeli W. The factorial validity of the Maslach Burnout Inventory-General Survey (MBI-GS) across occupational groups and nations. J Occup Organ Psychol. 2000;73:53–66. https://doi.org/10.1348/096317900166877. [Google Scholar]
- 71.Schaufeli WB, Bakker AB, Hoogduin K, Schaap C, Kladler A. On the clinical validity of the Maslach Burnout Inventory and the Burnout Measure. Psychol Health. 2001;16:565–82. doi: 10.1080/08870440108405527. https://doi.org/10.1080/08870440108405527. [DOI] [PubMed] [Google Scholar]
- 72.Bakker AB, Demerouti E, Schaufeli WB. Validation of the Maslach burnout inventory-general survey: an internet study. Anxiety Stress Coping. 2002;15:245–60. https://doi.org/10.1080/1061580021000020716. [Google Scholar]