Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Nov 19;16(11):e0259858. doi: 10.1371/journal.pone.0259858

Healthcare providers’ perceived support from their organization is associated with lower burnout and anxiety amid the COVID-19 pandemic

Katherine M Reitz 1, Lauren Terhorst 2,3, Clair N Smith 4, Insiyah K Campwala 5, Maryanna S Owoc 5, Stephanie M Downs-Canner 6, Emilia J Diego 1, Galen E Switzer 3,7,8,9, Matthew R Rosengart 1,3, Sara P Myers 1,*
Editor: Forough Mortazavi10
PMCID: PMC8604356  PMID: 34797847

Abstract

Background

Professional burnout represents a significant threat to the American healthcare system. Organizational and individual factors may increase healthcare providers’ susceptibility or resistance to burnout. We hypothesized that during the COVID-19 pandemic, 1) higher levels of perceived organizational support (POS) are associated with lower risk for burnout and anxiety, and 2) anxiety mediates the association between POS and burnout.

Methods

In this longitudinal prospective study, we surveyed healthcare providers employed full-time at a large, multihospital healthcare system monthly over 6 months (April to November 2020). Participants were randomized using a 1:1 allocation stratified by provider type, gender, and academic hospital status to receive one of two versions of the survey instrument formulated with different ordering of the measures to minimize response bias due to context effects. The exposure of interest was POS measured using the validated 8-item Survey of POS (SPOS) scale. Primary outcomes of interest were anxiety and risk for burnout as measured by the validated 10-item Burnout scale from the Professional Quality (Pro-QOL) instrument and 4-item Emotional Distress-Anxiety short form of the Patient Reported Outcome Measurement Information System (PROMIS) scale, respectively. Linear mixed models evaluated the associations between POS and both burnout and anxiety. A mediation analysis evaluated whether anxiety mediated the POS-burnout association.

Results

Of the 538 participants recruited, 402 (75%) were included in the primary analysis. 55% of participants were physicians, 73% 25–44 years of age, 73% female, 83% White, and 44% had ≥1 dependent. Higher POS was significantly associated with a lower risk for burnout (-0.23; 95% CI -0.26, -0.21; p<0.001) and lower degree of anxiety (-0.07; 95% CI -0.09, -0.06; p = 0.010). Anxiety mediated the associated between POS and burnout (direct effect -0.17; 95% CI -0.21, -0.13; p<0.001; total effect -0.23; 95% CI -0.28, -0.19; p<0.001).

Conclusion

During a health crisis, increasing the organizational support perceived by healthcare employees may reduce the risk for burnout through a reduction in anxiety. Improving the relationship between healthcare organizations and the individuals they employ may reduce detrimental effects of psychological distress among healthcare providers and ultimately improve patient care.

Introduction

Frontline healthcare providers have been disproportionately affected by coronavirus disease 2019 (COVID-19) in their places of employment [1]. The global health crisis incited by COVID-19 has had detrimental consequences for mental health and, specifically, may potentiate provider burnout [1]. Professional burnout, characterized by emotional exhaustion, career de-prioritization, and loss of self-efficacy, represents a significant threat to the American healthcare system [1, 2].

Burnout among healthcare providers is a prevalent and well-documented phenomenon [3] and has been associated with adverse clinical outcomes [4], reduced productivity [5], and increased rate of medical errors [6]. Aside from the consequences to providers and their patients, burnout represents a serious financial burden; $4.6 billion lost annually is attributed to physician attrition and loss of clinical hours secondary to burnout [6]. Heavy workloads, changing clinical roles, reduced decision latitude (i.e., the ability to exercise control over work-related responsibilities), and lack of support from supervisors have been cited as causes of increased occupational stress [7], a key predictor of burnout [8]. During this pandemic additional stressors such as lack of personal protective equipment and fear of contagion have been shown to augment the risk for burnout [1, 3]. These issues have threatened the stability of our healthcare organizations and, therefore, the COVID-19 medical crisis has also functionally become an organizational crisis [9]. As a result, health-related performance and quality outcomes may, in part, depend on how a healthcare organization manages to allocate resources and human capital [10] and whether it effectively develops policies to protect and support its employees.

While burnout has been described as a reaction to organizational factors such as work-related stress [11], individual factors such as sociodemographic factors that may be associated with development of coping skills in response to stressful situations (e.g., age), availability of support systems (marital status), and type and degree of responsibility (e.g., occupation, parental/caretaker status, etc.) may increase susceptibility to burnout [12] and/or anxiety [13]. It is, however, unknown whether the degree to which an individual feels supported by his/her/their employer, i.e., perceived organizational support (POS), a key driver of job satisfaction and performance [6], influences anxiety and burnout under circumstances of crisis. In this longitudinal prospective study of healthcare providers, we aim to evaluate whether 1) POS is associated with anxiety or burnout, hypothesizing that during the COVID-19 pandemic higher levels of POS are associated with lower burnout and anxiety, and 2) anxiety mediates the association between POS and burnout. Understanding the relationship between these constructs is paramount to designing interventions that preserve the psychological wellbeing of healthcare providers, a requisite for maintaining a healthy and productive workforce [14], and delivering optimal patient care [15].

Methods

Participants, setting, study design

A longitudinal prospective survey study of healthcare providers from 20 community and academic hospitals within a single healthcare system in Pennsylvania was conducted to determine the association of POS with burnout and anxiety. In order to assess how pandemic-related changes in organizational dynamics and protocols may influence anxiety and risk for burnout over time, an online survey of previously validated measures was administered monthly for a six-month period (April 28 to October 11, 2020). This study was approved by the University of Pittsburgh Institutional Review Board (STUDY20040051).

Based on previous literature investigating burnout among healthcare providers during COVID-19, assuming 35% of providers experience burnout [1, 16], a minimum of 88 respondents were required to evaluate the association between POS and burnout, allowing for a 0.1 acceptable margin of error and alpha of 0.05 [1]. All full-time providers employed by the healthcare system were recruited for study participation via e-mail (S1 Appendix). E-mail addresses were abstracted by three study investigators (IS, MO, and SPM) from an internal employee electronic directory (April 1–14, 2020) which is available to all UPMC staff and is maintained by the institution’s Office of Human Resources. In order to better understand how healthcare workers with differing levels of patient-care responsibilities may have reacted to this organizational and global health crisis, we sampled a variety of providers; attending physicians, physicians in training (i.e., residents, fellows), advanced practice providers (i.e., nurse practitioners, physician assistants), nurses, and other providers (i.e., respiratory therapists, patient care technicians) employed by an UPMC-associated hospital in Pennsylvania with sufficient exposure to work-place and institutional culture (i.e., >12 months of employment) were eligible for inclusion. As this study aims to assess reactions associated with increased risk of patient-care related COVID-19 exposure, healthcare workers whose primary patient contact was via telehealth were excluded. Participants were asked to verify aforementioned inclusion/exclusion criteria, consent to participation, and provide baseline demographic data via electronic enrollment form (S2 and S3 Appendices). Participants were provided with study details, purpose of the investigation, and incentive information in the text of the recruitment e-mail and within the consent document. Participants were made aware that although the investigators did not anticipate that the study would cause adverse events, responding to survey items may evoke emotional responses such as stress. There were no direct benefits to the participant for completing the surveys. Participants were free to withdraw from the study at any point; in this circumstance, all contact and data collection would cease and any existing data would be deleted upon request. Based on data obtained from this form, participants were then randomized using a 1:1 allocation stratified by provider type, gender, and academic hospital status to receive one of two versions of the survey instrument formulated with different ordering of the measures to minimize response bias due to context effects [17].Participants received the same version at all six time points via an automated email providing a link to a University of Pittsburgh RedCap database. Alphanumeric codes were used to anonymize survey data for the purposes of blinding individuals conducting the study and statisticians. De-identified data from serial surveys were collected and stored for repeated measure. Each survey also assessed whether participants had experienced parameters that may be associated with COVID-19 and/or its detrimental emotional effects including yes/no questions regarding perceived illness, illness necessitating time off from work, and strain on personal relationships. As we speculated that providers’ degree of stress might correlate with COVID-19-related hospital admissions, we determined monthly per hospital caseload for each participant. Caseload was defined as the proportion of COVID-19 admissions per total hospital beds, abstracted from the healthcare system [18]. Survey participation to completion was incentivized by the random selection of two $250 and 20 $25 VISA® and Starbucks® gift cards.

Study measures

POS was assessed using the validated, unidimensional 8-item Survey of POS (SPOS) scale [19, 20]. Items appraise the degree to which an individual agreed with statements describing support or commitment from their employer organization in the 30 days prior using a 7-point Likert scale (0 = Strongly disagree, 6 = Strongly agree; scale minimum = 0, maximum = 42). Risk for burnout was evaluated using the 10-item Burnout scale from the Professional Quality (Pro-QOL) scale. This instrument is a validated, multidimensional metric that assesses consequences of stress a provider may experience from exposure to patients in emotional or physical distress [21, 22]. Participants reflect on the frequency with which they experience hopelessness or difficulty completing job-related tasks effectively in the prior 30-days using a 5-point Likert scale (1 = Never, 5 = Very often; scale minimum = 5, maximum = 30). General anxiety was assessed using the 4-item Emotional Distress-Anxiety short form of the validated, multidimensional Patient Reported Outcome Measurement Information System (PROMIS) [23] scale that evaluates the frequency to which anxiety-related symptoms were experienced in the prior 7-days using a 5-point Likert scale (1 = Never, 5 = Very often; scale minimum = 7, maximum = 35). Each individual scale quantifies the psychosocial construct by the summation of all responses to Likert items. For each scale, higher total scores represent more of the psychosocial construct. Internal consistency of each scale or subscale are as follows: 8-item SPOS = 0.93 [24], Burnout = 0.84 [25], and Anxiety = 0.97 [26].

Statistical analysis plan

Descriptive statistics were generated for demographics, summary scales, and additional variables of interest. As a means of managing missingness unlikely to be at random and due to loss to follow-up, we restricted our primary analysis to include survey time points with at least 75% participant retention [27]. Thus, participants who completed at least two of the three first surveys constituted the cohort included in the primary analysis. Demographic data and variables of interest were compared between participants receiving version A and B, and between cohorts included and excluded from the primary analysis.

The association of POS, burnout, and anxiety were examined using linear mixed models that included fixed effect of time and random effects for hospital and participant [28]. Multivariable models additionally adjusted for covariates that were significantly associated with burnout or anxiety on univariable analysis and COVID-19 caseload. Further exploratory analyses, agreed upon a priori, were performed to determine how demographic variables moderate associations between POS, anxiety, and burnout. Sensitivity analyses were performed to assess how associations in the primary analysis between POS and outcomes of interest may have differed when using data from all six survey administrations. We performed a mediation analysis for each of the first three survey administrations with 5000 bootstrapped samples to evaluate if anxiety was the mechanism through which POS transmits its effect on burnout [29].

Analysis, completed with SAS 9.4 (SAS Institute Inc.; PROCESS macro) or PRISM 7.0 (GraphPad), and data presentation were compliant with the Strengthening the Reporting of Observational Studies in Epidemiology guidelines (S3 Appendix) [30]. Statistical significance was considered below a threshold p-value of 0.05.

Results

538 individuals completed the enrollment form. 516 were eligible for study inclusion and participated in survey 1. Internal consistency calculated for subscales was as follows: SPOS = 0.91, Burnout = 0.85, and Anxiety = 0.89. The primary analysis included data from 402 participants who completed surveys 1–3 (Fig 1). Demographic data are presented in Table 1. Demographics did not differ based on survey version (S1 Table). Compared to participants whose data was excluded from the primary analysis, a greater proportion of participants included were married or living like married, White persons, and had income ≥$163,301 (S2 Table). Those included in the primary analysis reported more perceived illness and time off from work, but less relationship strain than participants excluded (S1 Fig). Study measures (i.e., POS, risk of burnout, and anxiety) did not differ overtime or between groups. Age, gender, occupation, income, having dependents, perceiving illness, experiencing illness necessitating time off of work, and endorsing relationship strain were associated with either burnout or anxiety on univariate analysis and included in the adjusted model (Table 2).

Fig 1. Cohort accrual.

Fig 1

1 Discrepancy between number excluded from primary analysis and number lost to follow-up stems from participants failing to complete consecutive surveys. As data from participants who completed two of the three initial surveys was included in the primary analysis, some individuals may have cursorily been considered lost to follow up after survey 1 but been included in the analysis if they returned to complete survey 3. 2 Within survey missingness.

Table 1. Enrollment questionnaire for participants included in primary analysis.

Variable Primary Cohort (N = 402)
n (%)
Age, years1
    <24 31 (7.7)
    25–44 292 (72.6)
    45–64 71 (17.7)
    65+ 8 (2.0)
Male 110 (27.4)
Married or living like married 263 (65.4)
Race1,2
    White American, European American, or Middle Eastern American 335 (83.3)
    Black or African American 9 (2.2)
    Asian American 39 (9.7)
    Native Hawaiian or Other Pacific Islander 1 (0.3)
    Other 8 (2.0)
    Declined to answer 10 (2.5)
Hispanic ethnicity 9 (2.2)
Occupation
    Attending physician 115 (28.6)
    Trainee (resident/fellow) 139 (34.6)
    Advanced practice provider 31 (7.7)
    Nursing staff 62 (15.4)
    Other staff3 55 (13.7)
Academic Hospital4 236 (58.7)
Income1,2
$0–14,000 5 (1.2)
$14,001–53,000 34 (8.5)
$53,001–85,500 102 (25.4)
$85,501–163,300 110 (27.4)
$163,301–207,350 26 (6.5)
$207351–518,400 94 (23.4)
$518,041+ 13 (3.2)
Declined to answer 18 (4.5)
Parent status1,5
    No dependents 225 (56.0)
    1 dependent 66 (16.4)
    2 dependents 57 (14.2)
    3 dependents 35 (8.7)
    4+ dependents 18 (4.5)
Primary caretaker status6 125 (31.1)

1 Categorization consistent with 2020 census.

2 Survey indicated categorical responses as optional, declining to answer was therefore not considered missing data.

3 Defined as respiratory therapist or patient care technician.

4 Defined as a tertiary care hospital that is organizationally integrates with a medical school and/or residency program.

5 Defined as having one or more child for whom the participant is a guardian.

6 Defined as serving as a primary caretaker for another individual.

Table 2. Univariate associations between variables and outcomes of interest in the primary cohort (N = 402).

Burnout1 Anxiety1
Variable Coefficient 95% CI p-value Coefficient 95% CI p-value
Age2, years 0.070 <0.001
≤24 1.87 (0.28, 3.45) 2.28 (1.41, 3.14)
25–44 0.55 (-0.38, 1.48) 0.87 0.36, 1.38)
45+ Ref Ref
Male sex -1.49 (-2.33, -0.65) 0.001 -1.67 (-2.13, -1.22) <0.001
Married/living like married -0.50 (-1.27, 0.27) 0.200 -0.31 (-0.73, 0.12) 0.150
Race2
White, European, Middle-Eastern 0.99 (-0.02, 2.00) 0.051 0.19 (-0.37, 0.75) 0.500
Hispanic Ethnicity -0.77 (-3.26, 1.71) 0.540 0.77 (-0.58, 2.12) 0.260
Income2 0.001 <0.001
$0–53,000 1.93 (0.57, 3.28) 2.29 (1.55, 3.02)
$53,701–85,500 1.82 (0.85, 2.79) 1.53 (1.00, 2.06)
$85,501–163,300 0.90 (-0.06, 1.86) 0.72 (0.19, 1.24)
$163,301+ Ref Ref Ref Ref
Occupation <0.001 <0.001
Attending -3.06 (-4.41, -1.72) -3.08 (-3.75, -2.40)
Resident/fellow -1.85 (-3.57, -0.13) -1.93 (-2.61, -1.25)
Advanced practice provider -1.76 (-3.44, -0.08) -1.51 (-2.39, -0.64)
Nursing staff 0.51 (-0.86, 1.88) -0.09 (-0.82, 0.64)
Other staff 3 Ref Ref Ref Ref
Parent status2,4 (Reference, Not parent) -1.20 (-1.94. -0.46) 0.002 -0.97 (-1.37, 0.56) <0.001
Primary caretaker5 (Reference, No primary caretaker) -0.05 (-0.85, 0.75) 0.900 -0.01 (-0.45, 0.43+ 0.960
Academic hospital6 (Reference, Not academic hospital) -0.39 (-0.54, 0.60) 0.600 0.33 (-0.76, 1.42) 0.550
Perceived illness1 (Reference, No perceived illness) 4.93 (4.00, 5.87) <0.001 2.47 (1.96, 2.99) <0.001
Time taken off for illness1 (Reference, No time off) 4.45 (2.95, 5.95) <0.001 2.48 (1.66, 3.31) <0.001
Relationship strain1 (Reference, No relationship strain) 5.47 (4.81, 6.14) <0.001 2.67 (2.29, 3.04) <0.001
COVID-19 Caseload1,7 -0.01 (-0.20,0.19) 0.186 0.03 (-0.12, 0.18) 0.176

1 Repeated measures evaluated at each survey timepoint. P-values correspond to the Wald Test for each correlation.

2Categorization consistent with 2020 census. Categories consolidated if reported by <5% of respondents.

3 Defined as respiratory therapist or patient care technician.

4 Defined as having one or more child for whom the participant is a guardian.

5 Defined as serving as a primary caretaker for another individual.

6 Defined as a tertiary care hospital that is organizationally integrates with a medical school and/or residency program.

7 Proportion of COVID-19 cases per maximal bed capacity at the identified hospital of employment by the participants.

Values are from linear mixed models with fixed effects accounting for time and the single variable of interest as well as random effects accounting for the hospital and participant.

Abbreviations: CI, confidence intervals.

Burnout

Higher POS was significantly associated with a lower risk for burnout (Table 3). Having dependents was associated with a lower risk of burn out. Perceiving illness, endorsing strain on personal relationships, and being nurse (as compared with respiratory therapists and patient care technicians as the reference category) were associated with a higher risk of burn out (Table 3). The association between higher POS and lower risk of burnout was consistently observed, both across all subgroups and in sensitivity analysis (S3 and S4 Tables). In addition to the variables that were significantly associated with burnout in the primary analysis, male gender was significantly associated with reduced risk of burnout in the sensitivity analysis (S4 Table).

Table 3. Adjusted analysis between variables and outcomes of interest in the primary cohort (N = 402).

Burnout1 Anxiety1
Coefficient 95% CI p-value Coefficient 95% CI p-value
Perceived organizational 1 -0.23 (-0.26, -0.21) < .0001 -0.07 (-0.09, -0.06) <0.001
Age2, years (Reference, 45+)
<25 -0.42 (-1.29, 0.46) 0.350 0.20 (-0.33, 0.73) 0.460
25–44 -1.28 (-2.84, 0.28) 0.109 -0.58 (-1.02, -0.14) 0.009
Male Sex -0.73 (-1.47, 0) 0.050 0.94 (0.50, 1.39) <0.001
Occupation (Reference, other staff3)
Attending -1.18 (-2.79, 0.44) 0.152 -2.08 (-3.06, -1.10) <0.001
Trainee (resident/fellow) -0.58 (-1.98, 0.82) 0.414 -1.44 (-2.28, -0.60) 0.001
Advanced practice provider -1.25 (-2.87, 0.37) 0.129 -0.94 (-1.92, 0.05) 0.063
Nursing staff -1.32 (-2.59, -0.04) 0.044 -0.74 (-1.51, 0.04) 0.063
Income (Reference, $163,301+)
$0–53,000 -0.07 (-1.67, 1.53) 0.931 -0.05 (-1.03, 0.92) 0.916
$53,701–85,500 0.07 (-1.11, 1.24) 0.913 0.08 (-0.63, 0.78) 0.832
$85,501–163,300 0.05 (-1.07, 1.16) 0.934 -0.48 (-1.15, 0.19) 0.161
Parent status4 (Reference, Not parent) -1.17 (-1.9, -0.44) 0.002 -0.58 (-1.02, -0.14) 0.009
Perceived illness1(Reference, No perceived illness) 2.55 (1.58, 3.52) < .0001 0.93 (0.35, 1.51) 0.002
Time taken off for illness1 (Reference, No time off) 0.47 (-0.95, 1.88) 0.521 0.61 (-0.24, 1.47) 0.159
Relationship strain1(Reference, No relationship strain) 3.87 (3.25, 4.48) < .0001 1.99 (1.62, 2.36) <0.001
Survey timeframe (Reference, April)
May -0.26 (-0.98, 0.46) 0.480 -0.42 (-0.9, 0.06) 0.087
June 0.24 (-0.47, 0.94) 0.507 -0.41 (-0.85, 0.03) 0.065
COVID-19 Caseload1,5 -0.04 (-0.46, 0.37) 0.421 0.443 (-0.10, 0.16) 0.623
Intercept 31.99 (30.02, 33.97) < .0001 -0.07 (-0.09, -0.06) <0.001

1 Repeated measures evaluated at each survey timepoint. P-values correspond to the Wald Test for each individual variable.

2 Categorization consistent with 2020 census. Categories consolidated if reported by <5% of respondents.

3 Defined as respiratory therapist or patient care technician.

4 Defined as having one or more child for whom the participant is a guardian.

5 Proportion of COVID-19 cases per maximal bed capacity at the identified hospital of employment by the participants.

Values are from linear mixed models with fixed effects accounting for time, POS, and all variables of interest that were significant in the univariate analysis, and with random effects accounting for the hospital and participant.

Abbreviations: CI, confidence intervals.

Anxiety

Higher POS was associated with lower anxiety (Table 3). Reporting perceived illness and endorsing circumstantial strain on personal relationships were associated with higher anxiety. Attending and trainee physician status were associated with lower anxiety. Having dependents and male sex were also associated with lower anxiety. The association between POS and anxiety was consistently observed across subgroups, but the effect was significantly moderated by occupation, relationship strain, and income. The magnitude of the inverse relationship was strongest among respiratory therapists and patient care technicians compared with other providers, those with relationship strain compared to those without, and those in lower compared to the highest income bracket (S3 Table). Higher POS remained associated with lower anxiety in sensitivity analysis (S4 Table).

Mediation analysis

Analysis of data from the first survey administration demonstrated that higher POS was associated with lower anxiety (Fig 2). Higher anxiety was associated with higher risk for burnout. Without adjusting for anxiety there was a significant direct effect of POS on burnout, such that higher POS was associated with lower risk for burnout. There was a negative indirect effect of POS on burnout through anxiety. The total of indirect and direct effects in the mediation analysis indicated that anxiety is a partial mediator of the association between POS and burnout. Mediation analysis of data from second and third survey administrations were similar (Fig 2; S5S7 Tables).

Fig 2. Anxiety mediates the association between perceived organizational support and burnout.

Fig 2

1 Full adjusted models for each study month are available in S5S7 Tables. Abbreviations: CI, confidence intervals.

Discussion

Burnout is characterized by emotional exhaustion, depersonalization, and loss of self-worth [31]. Up to 50% of doctors and nurses report symptoms of burnout [3234] with health care organizations cited as a leading cause [3540]. In this longitudinal prospective survey-based study of healthcare workers during the COVID-19 pandemic, higher POS was associated with lower anxiety and risk for burnout. Anxiety was found to partially mediate the association between POS and burnout, suggesting that in the context of crisis, strategies aimed at alleviating anxiety might reduce burnout.

In our study, we observed that higher POS reduced risk for burnout. We speculate that this inverse relationship may reflect consequences that result from how organizations behave in response to periods of crisis. The threat-rigidity effect postulates that organizations may centralize power and reduce communication in periods of crisis [41], which may, in turn, lead to reduced POS if the employee feels that his/her/their employer is not concerned about the employee’s well-being [42]. By the same token, as our data would indicate, if employees perceive support from their organizations, risk of burnout may decrease.

While previous studies have demonstrated that providers frequently cite organizational causes of burnout [3, 3640]; characteristics of the person may also contribute to burnout during periods of crisis [43]. We identified several individual factors that were associated with risk for burnout. Modifiable factors included strain on personal relationships. Our findings are consistent with data from others demonstrating that restrictions brought on by COVID-19 affect relationship quality and have consequences for mental health [44]. Other individual factors such as occupation and household income may also influence burnout [3]. Our finding that relative to respiratory therapists and patient care technicians, being a staff nurse is associated with increased risk of burnout reveals that provider-type may contribute to differences in pandemic-related burnout. We speculate that the degree to which individual factors influence burnout may vary depending on social support. The protective effect of having children that we and others have observed [45] and the aforementioned detrimental effect of COVID-19 related circumstances on personal relationships substantiate this theory. With respect to non-modifiable risk factors, the influence of gender on burnout in general remains unclear. In our study, male gender just reached the threshold of significance on primary analysis and was significantly associated with reduced burnout risk in the sensitivity analysis. Some studies have observed that the prevalence of burnout is higher in women [46], while others have shown that women have decreased risk of burnout [47]. These conflicting findings may indicate that confounders obfuscate whether gender is independently associated with burnout. One such issue, which is pertinent to our analysis, is the disparate gender composition among different provider-types. Although studies are inconsistent in their findings [48], lack of control over workplace practices, which is necessarily influenced by gender-based structural bias, may contributed to differences in anxiety and risk for burnout in specialties where women are underrepresented [48]. Additionally, it may be that women are at higher risk for certain facets, such as emotional exhaustion, whereas men are predisposed to others, such as depersonalization [49]. Furthermore, there is evidence that gender disparities in mental health may be exacerbated by the pandemic and that disproportionate distribution of domestic responsibilities may contribute [50]. Our observation that individual factors contribute to burnout risk echoes others’ work showing that effective interventions may be tailored based on high-risk characteristics, personalized based on occupation, and/or focus on strengthening social support systems [51].

Although various psychological conditions have been found to contribute to burnout, the effect of anxiety, especially in acute periods of threat, is relatively understudied [52]. Anxiety has both stable (i.e., trait) and dynamic (i.e., state) components. Trait anxiety describes the degree to which an individual may be prone to anxiety [53]. State anxiety, on the other hand, is a reaction to circumstances that are perceived as threatening [53] such as the COVID-19 pandemic [54]. Our finding that anxiety partially mediates the effect of POS on burnout has been alluded to by others, who have theorized that work situations may trigger heightened anxiety and lead to burnout [55]. Additionally, existing literature is consistent with our observation that individual factors such as gender, occupation, and income may influence response to work-related stress and increase vulnerability to anxiety [56]. Understanding these relationships is the first step in developing interventions that address the multifaceted nature of burnout.

There are several strengths and limitations worth addressing. Although several provider-types were recruited in an attempt to understand how individuals with different patient-care responsibilities may have been variably influenced by pandemic-related restrictions and we surveyed individuals from multiple hospitals, our data does represent a single healthcare system and geographical area, which may limit external validity. Efforts were made to reduce response bias by randomizing individuals to receiving one of two versions of our survey, which differed in the order of the constructs assessed. While conducting a prospective longitudinal study allowed for the ability to assess providers’ responses to changes in organizational support, anxiety, and risk for burnout over time, this methodology also likely contributed to high attrition rates at later survey administrations, presumably due to survey fatigue. Therefore, missingness may not be at random, forcing respondent exclusion from the primary analysis. Further, the racial/ethnic homogeneity of our sample likely compromised our ability to accurately assess how sociodemographic factors influence burnout and anxiety in the context of a multifaceted construct such as POS. As this study was executed during the early months of the pandemic, variability in diagnostic testing across the healthcare system may have contributed to underreporting of hospital-specific rates of COVID-19. Finally, survey response was adequately powered to evaluate the a priori hypotheses; however, exploratory moderation analyses were underpowered.

Conclusion

During a health crisis, increasing the organizational support perceived by healthcare employees may reduce the risk for burnout through a reduction in anxiety. Improving the relationship between healthcare organizations and the individuals they employ may reduce detrimental effects of psychological distress among healthcare providers and ultimately improve patient care. These data indicate that interventions aimed at increasing perceived organizational support, such as augmenting discretionary services and benefits (e.g., childcare, psychological-support services, etc.), or fostering transparency in the adoption and oversight of institutional policies in response to crisis, may promote provider well-being.

Supporting information

S1 Appendix. Recruitment E-mail.

(DOCX)

S2 Appendix. Consent form.

(DOCX)

S3 Appendix. Enrollment (baseline) survey.

(DOCX)

S4 Appendix. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE).

(DOCX)

S1 Table. Demographics of participants by randomization group (i.e., survey version A vs. survey version B).

(DOCX)

S2 Table. Demographics of participants included and excluded from primary analysis.

(DOCX)

S3 Table. Subgroup analyses investigating whether association between perceived organizational support and outcomes of interest (i.e., burnout, anxiety) differ over categories of covariates.

(DOCX)

S4 Table. Univariate associations between variables and outcomes of interest, sensitivity analysis using all time points.

(DOCX)

S5 Table. Meditation analysis, 1st survey (April 2020).

(DOCX)

S6 Table. Meditation analysis, 2nd survey (May 2020).

(DOCX)

S7 Table. Meditation analysis, 3rd survey (June 2020).

(DOCX)

S1 Fig. Repeated measure data and COVID-19 caseload over time.

(DOCX)

S1 Dataset

(XLSX)

Acknowledgments

We would like to acknowledge Brenda Diergaarde, PhD Associate Professor, Human Genetics for sharing her expertise in the creation and use of the RedCap database. We would also like to thank Drs. Robert Handzel, Kristina Nicholson, Ariel Shensa, and Kenneth Lee for their support throughout the early phases of project development.

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

Dr. Katherine Reitz was supported in part by the National Heart, Lung, and Blood Institute (5T32HL0098036) and National Institutes of Health (L30AG064730).

References

  • 1.Lai J, Ma S, Wang Y, Cai Zhongxiang, Hu Jianbo, Wei N, et al. Factors associated with mental health outcomes among health care workers exposed to Coronavirus Disease 2019. JAMA Netw Open. 2020; 3(3):e203976. doi: 10.1001/jamanetworkopen.2020.3976 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Shanafelt TD, Balch CM, Bechamps G, Russell T, Dyrbye L, Satele D, et al. Burnout and medical errors among American surgeons. Ann Surg. 2010; 251(6):995–1000. doi: 10.1097/SLA.0b013e3181bfdab3 [DOI] [PubMed] [Google Scholar]
  • 3.Shanafelt T, Boone S, Tan L, Dyrbye LN, Sotile W, Satele D, et al. Burnout and Satisfaction with Work-Life Balance Among US Physicians Relative to The General US Population. Arch Intern Med. 2012; 172(18): 1377–85. doi: 10.1001/archinternmed.2012.3199 [DOI] [PubMed] [Google Scholar]
  • 4.Wel A, Meier LL, Manser T. Emotional exhaustion and workload predict clinician-rated and objected patient safety. Front Psychol. 2014:5:1573. doi: 10.3389/fpsyg.2014.01573 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Dewa CS, Loong D, Bonato S, Thanh NX, Jacobs P. How does burnout affect physician productivity? A systematic literature review. BMC Health Serv Res. 2014; 14:325. doi: 10.1186/1472-6963-14-325 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Sun W, Fu J, Chang Y, Wang L. Epidemiological study on risk factors for anxiety disorder among Chinese doctors. Journal of Occupational Health. 2012; 54(1):1–8. doi: 10.1539/joh.11-0169-oa [DOI] [PubMed] [Google Scholar]
  • 7.Cocker F, Joss N. Compassion fatigue among healthcare, emergency and community service workers: A systematic review. Int J Environ Res Public Health. 2016;13(6):1–18. doi: 10.3390/ijerph13060618 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.van der Wal RAB, Wallage J, Bucx MJL. Occupational stress, burnout and personality in anesthesiologists. Curr Opin Anaesthesiol. 2018. Jun;31(3):351–356. doi: 10.1097/ACO.0000000000000587 [DOI] [PubMed] [Google Scholar]
  • 9.Mishra AK. Organizational responses to crisis: centrality of trust. Appears in: Kramer, Roderick M. and Thomas Tyler(eds.) Trust In Organizations. Newbury Park, CA; Sage: 1996. 261–287. [Google Scholar]
  • 10.Staw B, Sandelands L, Dutton J. Threat-rigidity effects in organizational behavior: A multilevel analysis. Administrative Science Quarterly. 1981; 26: 501–524. doi: 10.2307/2392337 [DOI] [Google Scholar]
  • 11.Han S, Shanafelt TD, Sinsky CA, Awad KM, Dyrbye LN, Fiscus LC, et al. Estimating the attributable cost of physician burnout in the United States. Ann Intern Med. 2019; 170(11): 784–790. doi: 10.7326/M18-1422 [DOI] [PubMed] [Google Scholar]
  • 12.Green AE, Albanese BJ, Shaprio NM, Aarons GA. The roles of individual and organizational factors in burnout among community-based mental health service providers. Psychol Serv. 2014; 11(1):41–49. doi: 10.1037/a0035299 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Hubbard G, den Daas C, Johnston M, Dixon D. Sociodemographic and psychological risk factors for anxiety and depression: Findings from the COVID-19 Health and Adherence research in Scotland on Mental Health (CHARIS-MH) cross-sectional survey. International Journal of Behavioral Medicine. 2021; open access. doi: 10.1007/s12529-021-09967-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Muse LA, Stamper CL. Perceived organizational support: Evidence for a mediated associated with work performance. Journal of Managerial Issues. 2007; 19(4):517–535. [Google Scholar]
  • 15.Halbesleben JR, Rathert C. Linking physician burnout and patient outcomes: exploring the dyadic relationship between physicians and patients. Health Care Manage Rec. 2008; 33:29–39. doi: 10.1097/01.HMR.0000304493.87898.72 [DOI] [PubMed] [Google Scholar]
  • 16.Lee AM, Wong JG, McAlonan GM, Cheung V, Cheung C, Sham PC, et al. Stress and psychological distress among SARS survivors 1 year after the outbreak. Can J Psychiatry. 2007;52(4):233–240. doi: 10.1177/070674370705200405 [DOI] [PubMed] [Google Scholar]
  • 17.Perreault WD Jr. Controlling Order-Effect Bias. The Public Opinion Quarterly. 1976; 39(4): 544–551. doi: 10.1086/268251 [DOI] [Google Scholar]
  • 18.COVID-19 updates on testing, treatment, and visitor information. UPMC latest updates on COVID-19 website. Updated February 15, 2021. Accessed March 7, 2021. https://www.upmc.com/coronavirus.
  • 19.Rhoades L, Eisenberger R. Perceived organizational support: A review of the literature. Journal of Applied Psychology. 2002; 87: 698–714. doi: 10.1037/0021-9010.87.4.698 [DOI] [PubMed] [Google Scholar]
  • 20.Eisenberger R, Huntington R, Hutchison S, Sowa D. Perceived organizational support. Journal of Applied Psychology. 1986; 71: 500–507. doi: 10.1037/0021-9010.71.3.500 [DOI] [Google Scholar]
  • 21.Professional Quality of Life Measure. ProQOL.org. Updated 2019. Accessed April 1, 2020. https://proqol.org/ProQol_Test.html
  • 22.Stamm BH. Professional Quality of Life Scale (PROQOL) Compassion satisfaction and compassion fatigue (PROQOL) Version 5. Updated 2009. Accessed April 1, 2020. https://www.proqol.org/uploads/ProQOL_5_English_Self-Score_3-2012.pdf [Google Scholar]
  • 23.Shensa A, Sidani JE, Dew MA, Escobar-Viera CG, Primack BA. Social media use and depression and anxiety symptoms: A Cluster Analysis. Am J Health Behav. 2018; 42(2):116–128. doi: 10.5993/AJHB.42.2.11 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Worley JA. A factor analytic study to evaluate the structure of the survey of perceived organizational support. [PhD thesis]. Oklahoma State University; 2006. [Google Scholar]
  • 25.Geoffrion S, Lamothe J, Morizot J, Giguere C. Construct validity of the Professional Quality of Life (ProQol) scale in a sample of child protection workers. Journal of Traumatic Stress. 2019; 32(4): 566–576. doi: 10.1002/jts.22410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Teresi JA, Ocepek-Welikson K, Kleinman M, Ramirex M, Kim G. Measurement equivalence of the Patient Reported Outcomes Measurement Information System (PROMIS) Anxiety short forms in ethnically diverse groups. Psychol Test Assess Model. 2016; 58(1):182–219. doi: 10.1037/t03589-000 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Little RA, Rubin DB. Statistical Analysis with Missing Data (3rd ed). New Jersey: John Wiley and Sons, Inc; 2020. [Google Scholar]
  • 28.Singer JD, Willett JB. Applied Longitudinal Data Analysis: Modeling Change and Event Outcomes. New York: Oxford University Press; 2003. [Google Scholar]
  • 29.Hayes AF. Partial, conditional, and moderated mediation: Quantification, inference, and interpretation. Communication Monographs. 2018; 85: 4–40. doi: 10.1080/03637751.2017.1352100 [DOI] [Google Scholar]
  • 30.STROBE Statement. Strobe-statement organization website. Updated 2009. Accessed March 7, 2021. https://www.strobe-statement.org/index.php?id=available-checklists.
  • 31.Okunogbe A, Meredith LS, Chang ET, Simon A, Stockdale SE, Rubenstein LV. Care coordination and provider stress in primary care management of high-risk patients. J Gen Intern Med. 2018;33(1):65–71. doi: 10.1007/s11606-017-4186-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Kane L. Medscape National Physician Burnout & Suicide Report 2020: The Generational Divide. Medscape. Published 2020. https://www.medscape.com/slideshow/2020-lifestyle-burnout-6012460#14 [Google Scholar]
  • 33.Van Mol MMC, Kompanje EJO, Benoit DD, Bakker J, Nijkamp MD, Seedat S. The prevalence of compassion fatigue and burnout among healthcare professionals in intensive care units: A systematic review. PLoS One. 2015;10(8):1–22. doi: 10.1371/journal.pone.0136955 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Shanafelt TD, Gorringe G, Menaker R, Storz KA, Reeves D, Buskirk SJ, et al. Impact of organizational leadership on physician burnout and satisfaction. Mayo Clin Proc. 2015;90(4):432–440. doi: 10.1016/j.mayocp.2015.01.012 [DOI] [PubMed] [Google Scholar]
  • 35.Brindley PG, Olusanya S, Wong A, Crowe L, Hawryluck L. Psychological ‘burnout’ in healthcare professionals: Updating our understanding, and not making it worse. J Intensive Care Soc. 2019;20(4):358–362. doi: 10.1177/1751143719842794 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Gates R, Workman A, Collier B. Job satisfaction and workplace stressors among surgical providers at a single institution. J Am Acad Physician Assist. 2019;32(11):42–47. doi: 10.1097/01.JAA.0000586332.19619.b6 [DOI] [PubMed] [Google Scholar]
  • 37.Labrague LJ, McEnroe-Petitte DM, Leocadio MC, Van Bogaert P, Cummings GG. Stress and ways of coping among nurse managers: An integrative review. J Clin Nurs. 2018;27(7–8):1346–1359. doi: 10.1111/jocn.14165 [DOI] [PubMed] [Google Scholar]
  • 38.Rosenstein AH. Hospital administration response to physician stress and burnout. Hosp Pract (1995). 2019;47(5):217–220. doi: 10.1080/21548331.2019.1688596 [DOI] [PubMed] [Google Scholar]
  • 39.Sehlen S, Vordermark D, Schäfer C, Herschbach P, Bayerl A, Pirgorsch S, et al. Job stress and job satisfaction of physicians, radiographers, nurses and physicists working in radiotherapy: A multicenter analysis by the DEGRO Quality of Life Work Group. Radiat Oncol. 2009;4:1–9. doi: 10.1186/1748-717X-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Stuijfzand S, Deforges C, Sandoz V, Sajin C, Jacques C, Elmers J, et al. Psychological impact of an epidemic/ pandemic on the mental health of healthcare professionals: a rapid review Suzannah. BMC Public Health. 2020;20(1):1230. doi: 10.1186/s12889-020-09322-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Staw B, Sandelands L, Dutton J. Threat-rigidity effects in organizational behavior: A multilevel analysis. Administrative Science Quarterly. 1981; 26: 501–524. doi: 10.2307/2392337 [DOI] [Google Scholar]
  • 42.Moorman C, Zaltman G, Deshpande R. Relationships between providers and users of market research: The dynamics of trust within and between organizations. Journal of Marketing Research. 1992; 29: 314–328. doi: 10.2307/3172742 [DOI] [Google Scholar]
  • 43.Kiesler S, Sproull L. Managerial response to changing environments: Perspectives on problem sensing from social cognition. Administrative Science Quarterly. 1982; 27: 548–570. doi: 10.2307/2392530 [DOI] [Google Scholar]
  • 44.Pieh C O Rourke T, Sudimir S, Probst T. Relationship quality and mental health during COVID-19 lockdown. PLoS One. 2020; 15(9):e0238906. doi: 10.1371/journal.pone.0238906 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Chuang CH, Tseng P, Lin C, Lin K, Chen Y. Burnout in the intensive care unit professionals. Medicine (Baltimore). 2016; 95(50):e5629. doi: 10.1097/MD.0000000000005629 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Embriaco N, Azoulay E, Barrau K, Kentish N, Pochard F, Loundou A, et al. High level of burnout in intensivists: prevalence and associated factors. Am J Respir Crit Care Med. 2007. Apr 1; 175(7):686–92. doi: 10.1164/rccm.200608-1184OC [DOI] [PubMed] [Google Scholar]
  • 47.Merlani P, Verdon M, Businger A, Domenighetti G, Pargger H, Ricou B, et al. Burnout in ICU caregivers: a multicenter study of factors associated to centers. Am J Respir Crit Care Med. 2011. Nov 15; 184(10):1140–6. doi: 10.1164/rccm.201101-0068OC [DOI] [PubMed] [Google Scholar]
  • 48.Purvanova RK, Muros JP. Gender differences in burnout: A meta-analysis. Journal of Vocational behavior. October 2010. 77(2):168–185. doi: 10/1016/j.jvb.2010.04.006 [Google Scholar]
  • 49.Raggio B, Malacarne P. Burnout in intensive care unit. Minerva Anestesiol. 2007. Apr; 73(4):195–200. doi: 10.1186/1471-2253-13-38 [DOI] [PubMed] [Google Scholar]
  • 50.Almeida M, Shrestha AD, Stojanac D, Liller LJ. The impact of the COVID-19 pandemic on women’s mental health. Arch Womens Ment Health. 2020; 23(6):741–748. doi: 10.1007/s00737-020-01092-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Schaufeli W, Dirk Enzmann. The burnout companion to study and practice: A critical analysis. CRC press; 1998. [Google Scholar]
  • 52.Koutsimani P, Montgomery A, Georganta K. The relationship between burnout, depression, and anxiety: A systematic review and meta-analysis. Front Psychol. 2019; 10(284): 1–19. doi: 10.3389/fpsyg.2019.00284 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Spielberger CD. Theory and research on anxiety. New York: Academic Press; 1966. [Google Scholar]
  • 54.Choi EPH, Hui BPH, Wan EYF. Depression and anxiety in Hong Kong during COVID-19. Int J Environ Res Public Health. 2020; 17 (10): 3740. doi: 10.3390/ijerph17103740 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Turnipseed DL. Anxiety and burnout in the health care work environment. Psychol Reports. 1998; 82: 627–642. doi: 10.2466/pr0.1998.82.2.627 [DOI] [PubMed] [Google Scholar]
  • 56.Vagg PR, Speilberger CD, Wasala CF. Effects of organizational level and gender on stress in the workplace. International Journal of Stress Management. 2002; 9: 243–261. doi: 10.1023/A:101996433134 [DOI] [Google Scholar]

Decision Letter 0

Forough Mortazavi

13 Jul 2021

PONE-D-21-19123

Healthcare providers’ perceived support from their organization is associated with lower burnout amid the COVID-19 pandemic

PLOS ONE

Dear Dr. Myers,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 12. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Forough Mortazavi

Academic Editor

PLOS ONE

Additional Editor Comments:

Dear authors,

Thank you for conducting this study on interesting topic. Here are the some criticisms from my evaluation:

1. The title does not cover all three significant variable.

2. The method of recruitment is not clearly described. Kindly explain why a prospective design was used for data gathering, because in research topics similar to yours, a cross-sectional study is much more common.

3. In the results section, PLS describe how the results were improved by your chosen method of data collection. Kindly explain the advantages of your method of recruitment.

4. PLS clarify if respondents received questionnaires several times.

5. Please mention the Max and Min total scores for all the scales and if there is a cut-off point for every scale. For all measures, kindly provide scale's validity and reliability indices.

6. PLS clarify the final sample size and describe how the final sample size was calculated.

7. Path analysis is usually used for examining relationships between three variables such as anxiety, POS, and burnout. Why didn’t you use path analysis?

8. PLS include the sample size for each table.

9. I noticed that some variables lack a reference value in tables 2 and 3. PLS check all variables and provide a reference value for each.

10. Kindly mention the statistical test conducted in footnote sections of the tables.

11. Please specify that in tables 2 and 3, analysis was done on which sample, 119, 402, or 516?

12. PLS mention which scales were filled out in each survey? Did each participant receive a different scale in each survey? For example, a group of participants received anxiety in survey 1, burnout in survey 2, and SOP in survey 3? If so, why did you run 6 surveys?

13. PLS mention the strong and weak points of the study as well as its novelty aspects.

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I want to thank you for the opportunity to review this manuscript. The time spent creating and shipping it is greatly appreciated. In my humble opinion, it offers interesting results that the scientific community and hospital managers can benefit from. The exhaustion, disorders and psychological symptoms caused by COVID-19 and what can be done to alleviate them in the most affected group par excellence is essential. Therefore, this work, correctly planned and approached, is one more addition to this international struggle. Therefore, first of all I would like to congratulate the authors.

In the other hand, I believe that there are some aspects that can be improved. Here are my recommendations. Hopefully they are useful:

In the introduction, no mention is made of many of the sociodemographic and labor variables that were evaluated at work. This section needs an extension to theoretically justify the selection and inclusion of these variables in the analyzes. A part of this information can be transferred from the discussion section, where a multitude of references of interest are collected.

Clearly state the objectives of the study at the end of the introduction.

In the method, he points out that, according to the previous literature, it is assumed that 35% of health care providers suffered from burnout. At this point, add the corresponding reference.

Clarify further how the sample was obtained. Do the email addresses of all employees and all hospitals appear in the directory? Were there any specific criteria for the selection of hospitals?

Indicate the reliability of the instruments found for your study.

I suggest the elimination of the appendices, since all the data necessary to understand the study are correctly established in the text. However, if the authors wish to keep them, at least it would be appropriate to have the consent of the authors of the three scales used mainly in the work for their reproduction. Or, if not, delete these from the annexes.

The information on the study participants (initial number, final number, figure 1…) would be preferable to be presented in the sub-section of participants of the method. These data do not respond to the objective of the work and, therefore, do not proceed in this section. In addition, I miss that data of interest on the participantes are indicated, such as the age range or the average by gender.

Review the titles provided in table 1. Specifically, it would be recommended that n and% appear on the numerical data (not on the left). On the other hand, review the data and include decimals where appropriate (the sum of the percentages provided is greater than 100% in some cases).

In Figure 1, you speak in ordinally numbers of the surveys. While the tables talk about the surveys in months. Please choose one of the two ways to improve consistency throughout the text. In my opinion, the most appropriate thing would be to point out, for example, "First survey (April)" ...

In relation to the data on gender, a possible variable implicated in the disparity of results is the job position. Since this is a study of healthcare providers with a wide variety of occupations, it would be advisable to mention this potential confounder or add it as a limitation.

In the conclusions of the work, add possible practical applications of the findings.

Thanks for your work.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-21-19123.pdf

PLoS One. 2021 Nov 19;16(11):e0259858. doi: 10.1371/journal.pone.0259858.r002

Author response to Decision Letter 0


20 Aug 2021

Response to reviewers:

PLOS One Additional Editor Comments:

1. The title does not cover all three significant variable.

Response: We thank the editor for his request that the title accurately reflect the objectives and findings of our study. The title now includes reference to all three variables considered.

Related revised text: Title: “Healthcare providers’ perceived support from their organization is associated with lower burnout and anxiety amid the COVID-19 pandemic”

2. The method of recruitment is not clearly described. Kindly explain why a prospective design was used for data gathering, because in research topics similar to yours, a cross-sectional study is much more common.

Response: We welcome the opportunity to elaborate on our a priori study design and method of recruitment and feel strongly that the prospective longitudinal nature of this study offers several advantages. First, risk of burnout evolves over time; career deprioritization and emotional exhaustion are responses to repetitive insults (Bakker AB, Costa PL. Chronic job burnout and daily functioning: A theoretical analysis. Burnout Research. 2014; 1(3):112-119). The protracted nature of this pandemic has been shown to have negative long-term psychosocial consequences, which can best be understood prospectively by a longitudinal study design (McBride O, Butter S, Murphy J, et al. Context, design and conduct of the longitudinal COVID-19 psychological research consortium study-wave 3. Psychiatric Research. 2021; e1880: 1-17. Second, a longitudinal design in this setting allows for understanding how individuals may react to changes in organizational dynamics, restrictions, and protocols that occurred in response to the COVID-19 crisis, especially during the early period of the pandemic when uncertainty about the disease, contagion, and healthcare resources was greatest. Third, we were especially interested in understanding how all levels of healthcare providers were influenced by these issues. Unlike existing studies, which have made important contributions to our knowledge of mental health during COVID-19 by focusing on specific types of providers (e.g., professional staff nurses, physicians, etc.) or all providers within a system without comparing occupation-types to each other, our study now sheds light on how frontline healthcare workers with different levels of patient-care responsibilities may react differently during times of organizational and global health crisis. This nuanced perspective will aid in our ability to improve healthcare team dynamics and optimize patient care. Despite these strengths, we acknowledge that the longitudinal study design contributed to participant attrition, which has consequences for study validity and the representativeness of our sample. We have revised the text, as indicated below, to discuss these issues and provide a more transparent rationale for our recruitment strategy.

Related revised text: Methods, Participants, Settings, Study Design subsection, page 6, paragraph 1: In order to assess how pandemic-related changes in organizational dynamics and protocols may influence anxiety and risk for burnout over time, an online survey of previously validated measures was administered monthly for a six-month period (April 28 to October 11, 2020).

Page 6-7, paragraph 2: In order to better understand how healthcare workers with differing levels of patient-care responsibilities may have reacted to this organizational and global health crisis, we sampled a variety of providers; attending physicians, physicians in training (i.e., residents, fellows), advanced practice providers (i.e., nurse practitioners, physician assistants), nurses, and other providers (i.e., respiratory therapists, patient care technicians) employed by an UPMC-associated hospital in Pennsylvania with sufficient exposure to work-place and institutional culture (i.e., >12 months of employment) were eligible for inclusion.

3. In the results section, PLS describe how the results were improved by your chosen method of data collection. Kindly explain the advantages of your method of recruitment.

Response: The authors thank this editor for his suggestion to describe the advantages of a longitudinal study design and our chosen method of data collection. We do, however, respectfully feel that this description is better suited for the discussion section, and, specifically, the subsection in which the study’s limitations and strengths are outlined. As this Editor has requested a more robust examination of the study’s strengths and weaknesses elsewhere (Comment# 13), we have expanded this subsection.

Related revised text: Discussion, page 18, paragraph 3: Although several provider-types were recruited in an attempt to understand how individuals with different patient-care responsibilities may have been variably influenced by pandemic-related restrictions and we surveyed individuals from multiple hospitals, our data does represent a single healthcare system and geographical area, which may limit external validity. While conducting a prospective longitudinal study allowed for the ability to assess providers’ responses to changes in organizational support, anxiety, and risk for burnout over time, this methodology also likely contributed to high attrition rates at later survey administrations, presumably due to survey fatigue.

4. PLS clarify if respondents received questionnaires several times.

Response: Participants were initially randomized to receiving one of two versions of the survey. Randomization was stratified based on gender, whether the participant was employed by a UPMC-affiliated academic vs. community practice, and occupation type. These stratification criteria were decided on a priori as factors that may influence anxiety/burnout as well as degree or organizational support. The rationale for randomization was to minimize response bias due to context effects, which may occur if an individual participant’s responses to survey items are influenced by the order in which they appear within the survey instrument (please see Methods, page 7 and associated reference). The exposure of interest, perceived organizational support, was the initial subscale in both survey versions. Survey versions A and B differed insofar as one presented the anxiety assessment scale second and the burnout assessment third while the alternate version had the reverse order of these two subscales. Randomization occurred at the beginning of the study, after which the participant received the same version of the survey for all six survey administrations. This methodology and study design was undertaken after consultation with our co-author, Dr. Galen Switzer, an expert in qualitative and psychometric research.

Related revised text: Methods, page 7, paragraph 1: Participants received the same version at all six time points via an automated email providing a link to a University of Pittsburgh RedCap database where de-identified data was collected, stored, and connected to the individuals’ email for repeated measure.

5. Please mention the Max and Min total scores for all the scales and if there is a cut-off point for every scale. For all measures, kindly provide scale's validity and reliability indices.

Response: The authors appreciate this request for clarification. The manuscript has been revised to include the maximum and minimum total scores for each scale (please see Methods, Study Measures). It is the authors’ practice to report the internal consistency of validated instruments (i.e., reliability) and to reference original manuscripts describing validation of the survey measures used for further details. We have referenced the reliability of the original 8-item Survey of Perceived Organizational Support, the 10-item Burnout scale from the Professional Quality (Pro-QOL) scale, and the 4-item Emotional Distress-Anxiety short form of the Patient Reported Outcome Measurement Information System (PROMIS) scale as the internal consistency, i.e., Cronbach’s alpha, for each of these instruments. This was stated in the original text in paragraph 1, page 7: “Internal consistency of each scale or subscale are as follows: 8-item SPOS=0.93,14 Burnout=0.84,15 and Anxiety= 0.97.16” The authors would be happy to include additional details about validation of the original survey instruments, but respectfully feel that this is out of the scope of our current manuscript.

Related revised text: Methods, Page 7, paragraph 2: POS was assessed using the validated, unidimensional 8-item Survey of POS (SPOS) scale.9,10 Items appraise the degree to which an individual agreed with statements describing support or commitment from their employer organization in the 30 days prior using a 7-point Likert scale (0=Strongly disagree, 6=Strongly agree; scale minimum=0, maximum=42).

Methods, Page 7, paragraph 2 through page 8, paragraph 1: Risk for burnout was evaluated using the 10-item Burnout scale from the Professional Quality (Pro-QOL) scale. This instrument is a validated, multidimensional metric that assesses consequences of stress a provider may experience from exposure to patients in emotional or physical distress.11,12 Participants reflect on the frequency with which they experience hopelessness or difficulty completing job-related tasks effectively in the prior 30-days using a 5-point Likert scale (1=Never, 5=Very often; scale minimum=5, maximum=30). General anxiety was assessed using the 4-item Emotional Distress-Anxiety short form of the validated, multidimensional Patient Reported Outcome Measurement Information System (PROMIS)13 scale that evaluates the frequency to which anxiety-related symptoms were experienced in the prior 7-days using a 5-point Likert scale (1=Never, 5=Very often; scale minimum=7, maximum=35).

6. PLS clarify the final sample size and describe how the final sample size was calculated.

Response: Thank you for the opportunity to clarify our data. We have updated the content within Figure 1 to improve the clarity of our primary cohort and those included in the sensitivity analysis.

Related revised text:

Figure 1. Cohort accrual

1 Discrepancy between number excluded from primary analysis and number lost to follow-up stems from participants failing to complete consecutive surveys. As data from participants who completed two of the three initial surveys was included in the primary analysis, some individuals may have cursorily been considered lost to follow up after survey 1 but been included in the analysis if they returned to complete survey 3.

2 Within survey missingness.

7. Path analysis is usually used for examining relationships between three variables such as anxiety, POS, and burnout. Why didn’t you use path analysis?

Response: A mediation analysis was used to demonstrate if anxiety was the mechanism through which perceived organizational support transmits its effect on burnout. Although we agree that path analysis is one way to test mediation, along with regression and structural equation models, our decision to use regression was based on our hypothesis that anxiety mediated the observed relationship between POS and burnout. If we were to expand the model to examine other potential mediators, a path analysis or structural equation model would be the more appropriate analysis. We do, however, respectfully maintain that the chosen analysis is fitting given our hypothesis.

Related revised text: Not applicable.

8. PLS include the sample size for each table.

Response: Each table has been updated in accordance with this suggestion.

Related revised text: Tables 1-3.

9. I noticed that some variables lack a reference value in tables 2 and 3. PLS check all variables and provide a reference value for each.

Response: Each table has been updated in accordance with this suggestion.

Related revised text: Tables 1-3.

10. Kindly mention the statistical test conducted in footnote sections of the tables.

Response: Each table has been updated in accordance with this suggestion.

Related revised text: Tables 1-3.

11. Please specify that in tables 2 and 3, analysis was done on which sample, 119, 402, or 516?

Response: Each table has been updated in accordance with this suggestion.

Related revised text: Tables 2, 3.

12. PLS mention which scales were filled out in each survey? Did each participant receive a different scale in each survey? For example, a group of participants received anxiety in survey 1, burnout in survey 2, and SOP in survey 3? If so, why did you run 6 surveys?

Response: Each survey administration included all three subscales: perceived organizational support, burnout, and anxiety. Participants all received the same subscales within the version of the survey that they were randomized to receive. Please see response to Editor’s comment#4.

Related revised text: Not applicable.

13. PLS mention the strong and weak points of the study as well as its novelty aspects.

Response: We have revised the text of the manuscript based on this and other recommendations based on the editor’s and reviewer’s feedback. While there are several investigations examining the psychological effects of the COVID-19 pandemic on healthcare providers, to our knowledge these studies rarely include analysis by provider subtype. We believe that this distinction is important and contributes to the novelty of this study because differences in type of patient-care responsibilities may impact the psychological ramifications of providing pandemic-related care. Additionally, the prospective and longitudinal nature of this study is unique. Unlike most survey-based research, which as this editor points out is cross-sectional, our prospective and longitudinal inquiry allows a more accurate understanding of the protracted nature of this pandemic may have influenced perceived organizational support, anxiety, and burnout over time. Additionally, as we recognize that responses to survey items may be influenced by preceding items, thereby serving as a source of bias, participants were randomized to receiving one of two versions of our survey after being stratified based on provider type, sex, and affiliated with an academic versus community hospital. As discussed elsewhere, these versions differed only in the order in which survey subscales appeared. Participants received the same designated version of the survey for each of the six survey administrations. Unfortunately, despite our best efforts, we acknowledge limitations of having surveyed providers within a single institution and the attrition and missingness of data that are inherent to longitudinal survey studies.

Related revised text: Discussion, page 18 paragraph 3- page 19 paragraph 1. There are several strengths and limitations worth addressing. Although several provider-types were recruited in an attempt to understand how individuals with different patient-care responsibilities may have been variably influenced by pandemic-related restrictions and we surveyed individuals from multiple hospitals, our data does represent a single healthcare system and geographical area, which may limit external validity. Efforts were made to reduce response bias by randomizing individuals to receiving one of two versions of our survey, which differed in the order of the constructs assessed. While conducting a prospective longitudinal study allowed for the ability to assess providers’ responses to changes in organizational support, anxiety, and risk for burnout over time, this methodology also likely contributed to high attrition rates at later survey administrations, presumably due to survey fatigue. Therefore, missingness may not be at random, forcing respondent exclusion from the primary analysis. Further, the racial/ethnic homogeneity of our sample likely compromised our ability to accurately assess how sociodemographic factors influence burnout and anxiety in the context of a multifaceted construct such as POS. As this study was executed during the early months of the pandemic, variability in diagnostic testing across the healthcare system may have contributed to underreporting of hospital-specific rates of COVID-19. Finally, survey response was adequately powered to evaluate the a priori hypotheses; however, exploratory moderation analyses were underpowered.

Reviewer comments:

Reviewer #1 (Remarks to the author): I want to thank you for the opportunity to review this manuscript. The time spent creating and shipping it is greatly appreciated. In my humble opinion, it offers interesting results that the scientific community and hospital managers can benefit from. The exhaustion, disorders and psychological symptoms caused by COVID-19 and what can be done to alleviate them in the most affected group par excellence is essential. Therefore, this work, correctly planned and approached, is one more addition to this international struggle. Therefore, first of all I would like to congratulate the authors. In the other hand, I believe that there are some aspects that can be improved. Here are my recommendations. Hopefully they are useful.

The authors very much appreciate this positive feedback. We have done our best to address the critiques of this reviewer and the comments provided by the Editor. It is our belief that the revised manuscript is markedly improved.

1. In the introduction, no mention is made of many of the sociodemographic and labor variables that were evaluated at work. This section needs an extension to theoretically justify the selection and inclusion of these variables in the analyzes. A part of this information can be transferred from the discussion section, where a multitude of references of interest are collected.

Response: The authors understand the need to clarify and justify the sociodemographic variables included in the study and analysis. These variables included age, gender, marital status, race/ethnicity, occupation, hospital type (academic vs. community), income, and dependent status. We now briefly state the importance of these variables in influencing the outcomes of interest (anxiety and burnout) and call attention to relevant references. In an effort to maintain a succinct and clear introduction, however, these variables and the key findings of this study are explored more fully in the discussion.

Related revised text: Introduction, page 5, paragraph 1: While burnout has been described as a reaction to organizational factors such as work-related stress,3 individual factors including sociodemographic variables associated with development of coping skills in response to stressful situations (e.g., age), availability of support systems (marital status), and type and degree of responsibility (e.g., occupation, parental/caretaker status, etc.) may increase susceptibility to burnout4 and/or anxiety.5

References associated with the above revised text are:

Green AE, Albanese BJ, Shaprio NM, Aarons GA. The roles of individual and organizational factors in burnout among community-based mental health service providers. Psychol Serv. 2014; 11(1):41-49.

Hubbard G, den Daas C, Johnston M, Dixon D. Sociodemographic and psychological risk factors for anxiety and depression: Findings from the COVID-19 Health and Adherence research in Scotland on Mental Health (CHARIS-MH) cross-sectional survey. International Journal of Behavioral Medicine. 2021; open access.

2. Clearly state the objectives of the study at the end of the introduction.

Response: The authors have revised the introduction to plainly state the aims of this study.

Related revised text: Introduction, page 5, paragraph 1: In this longitudinal prospective study of healthcare providers, we aim to evaluate whether 1) POS is associated with anxiety or burnout, hypothesizing that during the COVID-19 pandemic higher levels of POS are associated with lower burnout and anxiety, and 2) anxiety mediates the association between POS and burnout.

3. In the method, he points out that, according to the previous literature, it is assumed that 35% of health care providers suffered from burnout. At this point, add the corresponding reference.

Response: The text has been revised so that the references for the prevalence of burnout among healthcare providers is included. The target sample size calculation/formula was based on a recent study about mental health outcomes among frontline healthcare providers exposed to COVID-19. This reference, which was originally cited at the end of the sentence, is retained in the text.

Related revised text: Methods, page 6, paragraph 2: Reference added- Lee AM, Wong JG, McAlonan GM, et al. Stress and psychological distress among SARS survivors 1 year after the outbreak. Can J Psychiatry. 2007;52(4):233-240.

4. Clarify further how the sample was obtained. Do the email addresses of all employees and all hospitals appear in the directory? Were there any specific criteria for the selection of hospitals?

Response: The authors appreciate the request for a more detailed description of how participants were recruited. A request for participation (Appendix A) was e-mailed to all full-time providers employed by the UPMC healthcare system. E-mail addresses were obtained from an internal employee electronic directory that is available to and may be accessed by any UPMC staff. This directory is maintained by the institution’s Office of Human Resources such that the email addresses of all providers at all hospitals are included in the directory. Three study team members (SM, IS, and MO) reviewed the entire directory to abstract all providers who were listed as either attending physicians, residents/fellows, advanced practice providers, professional staff nurses, respiratory therapists, or patient care technicians. Not including expired/nonworking email addresses, 9,578 providers were emailed. As mentioned in the methods section, UPMC is a large, multihospital healthcare system that regularly acquires additional hospitals. All hospitals in Pennsylvania recognized as UPMC facilities as of January 1, 2020 were included in this study.

Related revised text: Methods, page 6, paragraph 2: All full-time providers employed by the healthcare system were recruited for study participation via e-mail (Appendix A). E-mail addresses were abstracted by three study investigators (IS, MO, and SPM) from an internal employee electronic directory (April 1-14, 2020) which is available to all UPMC staff and is maintained by the institution’s Office of Human Resources. Attending physicians, physicians in training (i.e., residents, fellows), advanced practice providers (i.e., nurse practitioners, physician assistants), nurses, and other providers (i.e., respiratory therapists, patient care technicians) employed by an UPMC-associated hospital in Pennsylvania with sufficient exposure to work-place and institutional culture (i.e., >12 months of employment) were eligible for inclusion.

5. Indicate the reliability of the instruments found for your study.

Response: While we recognize that there are various methods of assessing both reliability and validity of existing survey instruments, we have referenced the reliability of the original 8-item Survey of Perceived Organizational Support, the 10-item Burnout scale from the Professional Quality (Pro-QOL) scale, and the 4-item Emotional Distress-Anxiety short form of the Patient Reported Outcome Measurement Information System (PROMIS) scale as the internal consistency, i.e., Cronbach’s alpha, for each of these instruments. This was stated in the original text in paragraph 1, page 7: “Internal consistency of each scale or subscale are as follows: 8-item SPOS=0.93,14 Burnout=0.84,15 and Anxiety= 0.97.16” The authors would be happy to include additional details about validation of the original survey instruments, but respectfully feel that this is out of the scope of our current manuscript.

Related revised text: Not applicable.

6. I suggest the elimination of the appendices, since all the data necessary to understand the study are correctly established in the text. However, if the authors wish to keep them, at least it would be appropriate to have the consent of the authors of the three scales used mainly in the work for their reproduction. Or, if not, delete these from the annexes.

Response: While the authors have strived to include all the materials/data germane to comprehending the study and its analysis within the text of the manuscript, as this reviewer graciously acknowledges, we do feel there is benefit in including additional information in the appendices for the sake of completeness and transparency. Nevertheless, we fully appreciate the importance of requesting permission for the publication of the original three scales from the instruments’ authors. For this reason, as this reviewer has suggested, we have eliminated the text of these scales from the appendices.

Related revised text: Supplemental material.

7. The information on the study participants (initial number, final number, figure 1…) would be preferable to be presented in the sub-section of participants of the method. These data do not respond to the objective of the work and, therefore, do not proceed in this section. In addition, I miss that data of interest on the participantes are indicated, such as the age range or the average by gender.

Response: The authors thank this reviewer for the suggestion to improve the intelligibility of our manuscript. We feel, however, that this may be a stylistic issue and would like to, with the permission of both the reviewer and the editor, maintain Figure 1’s current location in the manuscript. After consideration, although we agree with this reviewer that the content of the figure is not necessarily related directly to the execution of study objectives and results, it does provide a description of cohort accrual and the participants included in primary/sensitivity analyses. In this sense, we feel that the information is more relevant to the results from the analysis rather than the methods and study design, which were conceived of a priori and before the study commenced.

To address this reviewer’s second request, to present the demographic data of interest for all the participants rather than for just those included in the primary analysis, we wish to call attention to eTable2 in the supplement. This table describes the demographic variables for participants included and excluded from the primary analysis and also compares whether there is a statistically significant difference between these participants on the basis of any given variable. Although we considered inserting this table into the manuscript text rather than including it in the supplemental material, we feel it would detract from the primary objectives and findings. For this reason, we have chosen to retain the supplemental material (please see our response to Reviewer comment #6 above) and include the requested information within eTable 2.

Related revised text: not applicable. Requested data, which was present in original manuscript and supplemental text, can be found in Figures 1 and eTable2.

8. Review the titles provided in table 1. Specifically, it would be recommended that n and% appear on the numerical data (not on the left). On the other hand, review the data and include decimals where appropriate (the sum of the percentages provided is greater than 100% in some cases).

Response: We have revised the table according to this reviewer’s comment. Both the titles and the sum of percentages have been edited.

Related revised text: Table 1

9. In Figure 1, you speak in ordinally numbers of the surveys. While the tables talk about the surveys in months. Please choose one of the two ways to improve consistency throughout the text. In my opinion, the most appropriate thing would be to point out, for example, "First survey (April)" ...

Response: The authors appreciate this suggestion and have revised both the Figures and Tables so that the survey iteration is indicated both by number and month administered (e.g., 1st Survey, April 2020).

Related revised text: Figure 1, eTable5, eTable6, eTable7.

10. In relation to the data on gender, a possible variable implicated in the disparity of results is the job position. Since this is a study of healthcare providers with a wide variety of occupations, it would be advisable to mention this potential confounder or add it as a limitation.

Response: The authors appreciate this nuanced reflection on our data and agree that disparate gender composition within each provider-type category may influence our conclusions about how men and women differ with respect to anxiety and risk for burnout. This may be especially true given that structural bias related to gender may impact the degree to which women and men feel they have control over workplace processes. As this reviewer recommends, the manuscript has been revised to include this in the discussion.

Related revised text: Discussion, page 17, paragraph 2. These conflicting findings may indicate that confounders obfuscate whether gender is independently associated with burnout. One such issue, which is pertinent to our analysis, is the disparate gender composition among different provider-types. Although studies are inconsistent in their findings, lack of control over workplace practices, which is necessarily influenced by gender-based structural bias, may contributed to differences in anxiety and risk for burnout in specialties where women are underrepresented.

The following reference has been added in association with the above revised text: Purvanova RK, Muros JP. Gender differences in burnout: A meta-analysis. Journal of Vocational behavior. October 2010. 77(2):168-185. DOI:10/1016/j.jvb.2010.04.006.

11. In the conclusions of the work, add possible practical applications of the findings.

Response: The authors agree that explicitly stating the practical applications of our findings will strengthen the manuscript. The association between perceived organizational support and anxiety and risk for burnout indicate that feeling supported by one’s employer can provide comfort during stressful circumstances, e.g., the COVID-19 pandemic. Implementing discretionary supportive services such as benefits and personalizing these services based on individual factors, some of which are highlighted in this manuscript, may increase the degree to which employees feel supported. Other methods may include those that improve communication between supervisors and their employees, especially with respect to transparency in the adoption and oversight of institutional policies in response to crisis.

Related revised text: Conclusion, page 19, paragraph 1. These data indicate that interventions aimed at increasing perceived organizational support, such as augmenting discretionary services and benefits (e.g., childcare, psychological-support services, etc.), or fostering transparency in the adoption and oversight of institutional policies in response to crisis, may promote provider well-being.

Attachment

Submitted filename: PLOS_burnout_response_to_reviewers SPM 8_18.docx

Decision Letter 1

Forough Mortazavi

27 Sep 2021

PONE-D-21-19123R1Healthcare providers’ perceived support from their organization is associated with lower burnout and anxiety amid the COVID-19 pandemicPLOS ONE

Dear Dr. Myers,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Nov 11 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Forough Mortazavi

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

Dear authors,

Thank you for revising the manuscript; however, a few points raised in my evaluation still remain:

1. Ethical considerations are missing from the methods section. PLS kindly add them.

2. PLS clarify if respondents received anonymous questionnaires.

3. Page 16, the highlighted lines are suitable for the introduction section. 4. The manuscript must be edited so that it follows scientific writing standards.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

********** 

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

********** 

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

********** 

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

********** 

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

********** 

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear authors,

I appreciate the work to attend to the previous suggestions. Although most of the questions have been approached or answered appropriately, I consider that some of the points made in the previous review have not been addressed or, at least, not in depth. For this reason, I reiterate two of the recommendations made previously:

-The introduction needs a theoretical justification of the study. Place special emphasis on clarifying why the analyzed variables are chosen, establishing where the work comes from and why it is important to address this. It may not have been analyzed how employer support affects burnout in workers during COVID-19, but what about other health crises or situations of high workload? Thus, I insist on the need to substantially improve the introduction. The discussion of the findings should be supported by a good initial introduction.

-Indicate the reliability of the instruments found in your study. It is understood that the reliability of the original scales is adequate, since otherwise they would not be valid instruments. However, what should be noted in the manuscript is the level of reliability of the scales for your sample.

Thank you for your work.

********** 

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-21-19123_R1.pdf

PLoS One. 2021 Nov 19;16(11):e0259858. doi: 10.1371/journal.pone.0259858.r004

Author response to Decision Letter 1


11 Oct 2021

PLOS One Additional Editor Comments:

1. Ethical considerations are missing from the methods section. PLS kindly add them.

Response: The authors appreciate the request for transparency with regard to ethical considerations in study design and execution. We have revised the text of the methods section to specifically address the following: confidentiality and anonymity, informed consent, adverse events and benefits, and ability to withdraw from the study. Ethical considerations that were previously mentioned, including IRB approval and incentives, have been retained. The text of the recruitment script and informed consent document are present in the supplemental material. We feel that the manuscript now completely addresses ethical considerations.

Related revised text:

Methods: page 8, paragraph 1: “Participants were provided with study details, purpose of the investigation, and incentive information in the text of the recruitment e-mail and within the consent document. Participants were made aware that although the investigators did not anticipate that the study would cause adverse events, responding to survey items may evoke emotional responses such as stress. There were no direct benefits to the participant for completing surveys. Participants were free to withdraw from the study at any point; in this circumstance, all contact and data collection would cease and any existing data would be deleted upon request.”

2. PLS clarify if respondents received anonymous questionnaires.

Response: As requested above, we have clarified anonymization of the data. The participants were originally contacted via their email address. These email addresses were used to assign participants an alphanumeric code so that their serial data could be collected and stored in an anonymous fashion. One of the study investigators (IC) had access to the document that linked the email addresses to the anonymized participant code. To blind her to participant data, she did not have access to the stored data and was not involved with the statistical analysis.

Related revised text: Please see response to Editor’s comment # 1 above.

3. Page 16, the highlighted lines are suitable for the introduction section.

Response: We thank the editor for this suggestion. The authors believe that revising the manuscript to include the highlighted lines in the introduction rather than the discussion addresses comment #1 of the reviewer. Specifically, the introduction now clearly describes the importance of studying burnout and anxiety. We relate the significance of burnout to reduced productivity, adverse clinical outcomes, increased rate of medical errors, and the financial strain on the US economy. As per the request of the reviewer, we describe how existing literature has described the role of heavy workloads, changing clinical rolls, etc. on stress and burnout. The role of anxiety on burnout and during periods of crisis is also introduced. Finally, we have contextualized the influence of perceived organizational support on these constructs during the COVID-19 pandemic.

Related revised text: Introduction, Page 5, Paragraphs 2. “Burnout among healthcare providers is a prevalent and well-documented phenomenon3 and has been associated with adverse clinical outcomes,4 reduced productivity,5 and increased rate of medical errors.6 Aside from the consequences to providers and their patients, burnout represents a serious financial burden; $4.6 billion lost annually is attributed to physician attrition and loss of clinical hours secondary to burnout.6 Heavy workloads, changing clinical roles, reduced decision latitude (i.e., the ability to exercise control over work-related responsibilities), and lack of support from supervisors have been cited as causes of increased occupational stress,7 a key predictor of burnout.8 During this pandemic additional stressors such as lack of personal protective equipment and fear of contagion have been shown to augment the risk for burnout.1,3 These issues have threatened the stability of our healthcare organizations and, therefore, the COVID-19 medical crisis has also functionally become an organizational crisis.9 As a result, health-related performance and quality outcomes may, in part, depend on how a healthcare organization manages to allocate resources and human capital10 and whether it effectively develops policies to protect and support its employees.”

4. The manuscript must be edited so that it follows scientific writing standards.

Response: We have reviewed the submission guidelines on the PLOS ONE webpage. We have added line numbers to the manuscript file using continuous numbering. We have ensured that all abbreviations were defined upon first appearance in the text and that non-standard abbreviations were used only when they appeared three or more times in the test. We have consulted the Vancouver style guidelines for citing references to ensure that the format is correct. We have removed the reference to the following article, which has been retracted: Panagioti M, Geraghty K, Johnson J, et al. Association between physician burnout and patient safety, professionalism, and patient satisfaction: a systematic- review and meta-analysis. JAMA Intern Med. 2018; 178:1317-1330. doi: 10.1001/jamainternmed.2018.3713. The manuscript organization has been revised so that the acknowledgements and references appear in the acceptable order at the end of the manuscript. The title page has been revised according to the sample provided on the PLOS ONE webpage. Titles/professional credentials have been removed.

Related revised text: Please see title page, reference list, and ending comments.

Reviewer comments:

Reviewer #1 (Remarks to the author): I appreciate the work to attend to the previous suggestions. Although most of the questions have been approached or answered appropriately, I consider that some of the points made in the previous review have not been addressed or, at least, not in depth. For this reason, I reiterate two of the recommendations made previously:

1. The introduction needs a theoretical justification of the study. Place special emphasis on clarifying why the analyzed variables are chosen, establishing where the work comes from and why it is important to address this. It may not have been analyzed how employer support affects burnout in workers during COVID-19, but what about other health crises or situations of high workload? Thus, I insist on the need to substantially improve the introduction. The discussion of the findings should be supported by a good initial introduction.

Response: We apologize for not sufficiently addressing this in the initial revisions. The authors agree with the suggestion from this reviewer. We have revised the manuscript text to incorporate these details. Specifically, the introduction now clearly describes the importance of studying burnout and anxiety. We relate the significance of burnout to reduced productivity, adverse clinical outcomes, increased rate of medical errors, and the financial strain on the US economy. As per the request of the reviewer, we describe how existing literature has described the role of heavy workloads, changing clinical rolls, etc. on stress and burnout. The role of anxiety on burnout and during periods of crisis is also introduced. Finally, we have contextualized the influence of perceived organizational support on these constructs during the COVID-19 pandemic.

Related revised text: Introduction, Page 5, Paragraphs 1-2.

2. Indicate the reliability of the instruments found in your study. It is understood that the reliability of the original scales is adequate, since otherwise they would not be valid instruments. However, what should be noted in the manuscript is the level of reliability of the scales for your sample.

Response: We thank this reviewer for their comment. The internal consistency of the subscales using participants’ data have been calculated and added to the results section.

Related revised text: Results, Page 11, Paragraph 1: “Internal consistency calculated for subscales was as follows: SPOS=0.91, Burnout=0.85, and Anxiety= 0.89.”

Attachment

Submitted filename: PLOS_burnout_response_to_reviewers SPM 10_11.docx

Decision Letter 2

Forough Mortazavi

28 Oct 2021

Healthcare providers’ perceived support from their organization is associated with lower burnout and anxiety amid the COVID-19 pandemic

PONE-D-21-19123R2

Dear Dr. Myers,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Forough Mortazavi

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I thank the authors for attend the recommendations. I believe that the manuscript has improved its quality and can be published. However, if possible, I would recommend that the authors include the reliability of the instruments in the instruments section (not in the results).

Beyond this recommendation, I can only congratulate the authors. Good job!

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Acceptance letter

Forough Mortazavi

11 Nov 2021

PONE-D-21-19123R2

Healthcare providers’ perceived support from their organization is associated with lower burnout and anxiety amid the COVID-19 pandemic

Dear Dr. Myers:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Forough Mortazavi

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Recruitment E-mail.

    (DOCX)

    S2 Appendix. Consent form.

    (DOCX)

    S3 Appendix. Enrollment (baseline) survey.

    (DOCX)

    S4 Appendix. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE).

    (DOCX)

    S1 Table. Demographics of participants by randomization group (i.e., survey version A vs. survey version B).

    (DOCX)

    S2 Table. Demographics of participants included and excluded from primary analysis.

    (DOCX)

    S3 Table. Subgroup analyses investigating whether association between perceived organizational support and outcomes of interest (i.e., burnout, anxiety) differ over categories of covariates.

    (DOCX)

    S4 Table. Univariate associations between variables and outcomes of interest, sensitivity analysis using all time points.

    (DOCX)

    S5 Table. Meditation analysis, 1st survey (April 2020).

    (DOCX)

    S6 Table. Meditation analysis, 2nd survey (May 2020).

    (DOCX)

    S7 Table. Meditation analysis, 3rd survey (June 2020).

    (DOCX)

    S1 Fig. Repeated measure data and COVID-19 caseload over time.

    (DOCX)

    S1 Dataset

    (XLSX)

    Attachment

    Submitted filename: PONE-D-21-19123.pdf

    Attachment

    Submitted filename: PLOS_burnout_response_to_reviewers SPM 8_18.docx

    Attachment

    Submitted filename: PONE-D-21-19123_R1.pdf

    Attachment

    Submitted filename: PLOS_burnout_response_to_reviewers SPM 10_11.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES