Abstract
Introduction
Emergency medicine (EM) physicians and trainees report high levels of burnout. Burnout negatively impacts physician well‐being and career satisfaction but it remains unclear how burnout may influence patient care. We examined the degree to which EM trainee burnout at one institution was associated with patients’ satisfaction with their emergency department (ED) care.
Methods
In this cross‐sectional, pilot study conducted at a single institution, we measured EM trainee burnout using the Maslach Burnout Inventory through a confidential, electronic survey. We subsequently linked individual trainee burnout results with their individual Press Ganey (PG) ED patient satisfaction scores. We compared burnout scores across sex and postgraduate year using chi‐square tests and PG results via analysis of variance.
Results
Twenty‐seven of 53 (50.9%) eligible EM trainees completed the burnout assessment. Trainees reported an overall burnout rate of 77.8% (95% confidence interval = 59.2%–89.4%). There were no significant differences in burnout based on sex (p = 0.888) or postgraduate year (p = 0.671). Trainee burnout was significantly associated with lower trainee‐specific PG scores, including patient ratings of resident physician courtesy (p = 0.011), taking the time to listen (p = 0.004), keeping informed of treatment (p = 0.014), and concern for patient comfort (p = 0.006). There was no significant association between trainee burnout and patients’ overall likelihood to recommend the ED to others (p = 0.364).
Conclusion
Emergency medicine trainee burnout is associated with lower trainee‐specific PG ED patient satisfaction scores across all four physician domains. In addition to its detrimental impact on physician wellness, burnout may play a significant adverse role in patients’ perceptions of their ED providers’ interpersonal and communication skills.
Burnout is a syndrome characterized by emotional exhaustion, depersonalization, and a sense of low personal accomplishment.1 Emergency medicine (EM) physicians and trainees report the highest levels of burnout (55%–65%) among all specialties.2, 3, 4, 5 Burnout negatively impacts physician health, productivity, and career satisfaction.6, 7, 8 There is evidence that physician burnout may also be associated with worse outcomes of care.9, 10 However, it remains unclear if physician burnout influences patients’ perceptions of and satisfaction with their care. Patient satisfaction is important because it contributes to a successful doctor–patient relationship. Studies have reported that patient satisfaction also serves as an indicator for a range of significant clinical outcomes11 and is associated with patients’ adherence to recommended treatment.12, 13 Furthermore, patient satisfaction surveys are increasingly used by payers, hospitals, and the public to assess healthcare quality and value.14 In this pilot study, we examined the degree to which EM trainee burnout at one institution was associated with patients’ satisfaction with their emergency department (ED) care.
Methods
Study Design
We conducted a standardized and validated burnout survey in a cross‐sectional sample of EM trainees. Results were linked to cumulative individual trainee Press Ganey (PG)15 ED patient satisfaction scores from the two previous quarters of the same fiscal year.
Study Setting and Population
Emergency medicine postgraduate year (PGY) 1–4 trainees from a single urban, academic, Level I trauma, Accreditation Council for Graduate Medical Education–accredited residency program (88,000 patients annually) were eligible to participate in the burnout survey conducted in May 2016. We excluded two trainees due to their involvement in the study design and knowledge of the study hypothesis. There were no other exclusion criteria.
Study Protocol
Eligible PGY 1–4 EM trainees received an e‐mail invitation to complete a confidential survey assessing their levels of wellness. Trainees were not informed the survey was specifically measuring burnout. Respondents consented to the voluntary study by completing the open survey on a secure and Web‐based application (Research Electronic Data Capture).16 Up to three reminder e‐mail invitations were sent to nonresponders.
Per institutional protocol, 30% of discharged ED patients were randomly selected to receive the PG patient satisfaction survey, a psychometrically valid instrument widely used to benchmark comparable institutions nationwide.15 Surveys were attributed to a trainee based on two sources from the electronic medical record. First, if a trainee wrote the “emergency department note” then that trainee was attributed to the encounter. If a trainee did not write the ED note, the encounter was attributed based on personnel assignment per the electronic medical record since another member of the team (i.e., the supervising physician) may have assumed responsibility for documentation while the trainee was involved in other aspects of the patient's care. If neither method identified a trainee, “unknown” was attributed to the encounter and that survey was not included in the study.
Burnout results were linked to PG results and subsequently de‐identified by a research assistant with no supervisory or evaluative role with any trainees to maintain confidentiality. Given the sensitive nature of examining burnout among trainees, we instituted a number of additional protections for study participants, the details of which have been published elsewhere.17 The Northwestern University Human Subjects Review Board approved the study.
Measurements
We assessed burnout using the Maslach Burnout Inventory (MBI), a widely used instrument that conceptualizes burnout across three domains: depersonalization, emotional exhaustion, and personal accomplishment.1 Consistent with prior work, burnout was dichotomized and defined by high scores in the depersonalization (>12) or emotional exhaustion (>26) subscales of the inventory.18
At this institution the PG ED patient satisfaction survey included four questions whereby patients were asked to evaluate the quality of care provided specifically by the resident physician, separate from the care provided by the supervising attending physician. The domains of care that patients evaluated for resident physicians were the same as those for attending physicians, and included: 1) “courtesy of the resident physician,” 2) “degree to which the resident physician took the time to listen to you,” 3) “resident physician's concern to keep you informed about your treatment,” and 4) “resident physician's concern for your comfort while treating you” (Data Supplement S1, available as supporting information in the online version of this paper, which is available at http://onlinelibrary.wiley.com/doi/10.1002/aet2.10094/full). We also examined patients’ overall assessment of their ED care with the final PG survey question asking patients’ “likelihood of recommending our emergency department to others.” Patients rated each PG question on a 1 to 5 Likert scale (1 = very poor, 5 = very good). Scores for each question were dichotomized and represent only the percentage of responses of “very good,” since these scores reflect top decile performance compared with similar institutions.15
Data Analysis
We calculated descriptive statistics for key variables. We compared burnout results to sex and postgraduate year using chi‐square tests and PG scores via univariate analysis of variance. Statistical significance was set at an alpha of less than 0.05. Analyses were performed using SPSS v23.0 (SPSS, Inc.).
Results
Twenty‐seven of 53 (50.9%) eligible EM trainees completed the burnout assessment. Mean trainee age was 28.6 years (95% confidence interval [CI] = 27.9–29.4 years) and most participants were male (70.4%, 95% CI = 51.5%–84.1%). The percentage of responding trainees who were male was not significantly different than the percentage of eligible male trainees in the program (66.7%, p = 0.736). Twenty‐one of 27 trainees met criteria for burnout, for an overall burnout rate of 77.8% (95% CI = 59.2%–89.4%). There were no significant differences in burnout by sex (p = 0.888) or postgraduate year (p = 0.671).
Between September 2015 and February 2016 an estimated 15,922 PG ED surveys were mailed, with 1,115 (7.0%) undeliverable. A total of 1,947 surveys were completed and returned for a response rate of 13.1%, which is consistent with PG ED survey response rates among urban academic EDs (15%).19 The mean number of returned PG ED surveys per trainee was 27.3 (95% CI = 24.4–30.2). The mean percentage of patients who rated as very good the resident physician's courtesy was 71.3% (95% CI = 69.2%–73.3%), took time to listen was 69.2% (95% CI = 67.1%–71.2%), kept informed of treatment was 65.4% (95% CI = 63.2%–67.5%), and concern for comfort was 65.9% (95% CI = 63.8%–68.0%). The mean percentage of patients who rated as very good their likelihood of recommending the ED to others was 56.9% (95% CI = 54.7%–59.1%).
Trainee burnout was significantly associated with lower trainee‐specific PG scores across all four physician domains, including courtesy (p = 0.011), took time to listen (p = 0.004), kept informed of treatment (p = 0.014), and concern for comfort (p = 0.006; Table 1). There was no significant association between trainee burnout and patients’ overall likelihood to recommend the ED to others (p = 0.364).
Table 1.
No Burnout | Burnout | p‐value | |
---|---|---|---|
Physician domains | |||
Courtesy of the resident physician | 77.0 | 65.9 | 0.011 |
Degree to which the resident physician took the time to listen to you | 76.6 | 61.0 | 0.004 |
Resident physician's concern to keep you informed about your treatment | 69.2 | 57.1 | 0.014 |
Resident physician's concern for your comfort while treating you | 72.1 | 56.2 | 0.006 |
Overall assessment | |||
Likelihood of recommending our ED to others | 60.9 | 55.8 | 0.364 |
Discussion
This exploratory study is the first to investigate the relationship between emergency physician burnout and patients’ perceptions of and satisfaction with their ED care. Although the use of patient satisfaction to assess quality of care is controversial,20 its inclusion as a marker of quality represents the growing importance of patient‐centered care models that take into account what is meaningful and valuable to the individual patient.21 We focused specifically on patients’ satisfaction with their ED physicians and our results demonstrated that trainee burnout was significantly associated with lower PG scores across all physician domains. This is consistent with studies in other health care settings that showed provider burnout is associated with lower patient satisfaction.22, 23, 24 Prior work on ED patient satisfaction demonstrated that the interpersonal and communication skills of ED providers, rather than their perceived technical skills and waiting times, were most influential in determining patient satisfaction.11 Our results suggest physician burnout may influence patients’ perception of their doctors’ verbal and nonverbal expressions of information and empathy.
Although trainee burnout was associated with lower PG scores in the physician domains, we did not find a significant relationship between trainee burnout and patients’ overall likelihood to recommend the ED to others. This may be due to the many other components of ED care that contribute to this final item in the PG survey, including the care of the supervising physician, nurses, ancillary staff, and other operational factors such as wait times and length of stay. Although trainee burnout appears to influence patients’ perceptions of the professionalism and communication skills of the resident physician, it was not significant enough to impact patients’ overall impression of their ED care.
Our study's rate of trainee burnout (78%) was higher than prior estimates among EM trainees (55%–65%).3, 4, 5 Recent work, however, demonstrates a trend of increasing burnout rates among EPs and trainees, with current estimates between 70 and 75%.25, 26 There are many speculated reasons for this phenomenon among all physicians, not just EPs, and our study did not seek to address this issue.25 Nevertheless our results add to growing literature that suggests an association between physician burnout and negative patient care experiences.3, 5, 10 Residency programs may need to identify and address trainee burnout not only to enhance the well‐being of individual residents but also to potentially improve the quality of care they provide to patients.
Limitations
There are several limitations to this exploratory study. First, our results from a small sample of EM trainees at a single site may not be generalizable to other environments. Second, the impact of our burnout survey response rate and institutional PG survey response rate on outcomes is unclear. Third, we recognize that our patient‐reported outcome of patient satisfaction via PG surveys are limited by the tool's many known drawbacks (e.g., selection, spectrum, reporting biases). Despite these shortcomings, PG scores are still regularly used by 40% of U.S. hospitals and remain highly relevant—including for reimbursement—for multiple stakeholders. Fourth, we were unable to compare burnout between responding and nonresponding trainees. Fifth, as each patient receives care from multiple ED providers over the course of their ED stay, we could not determine if patients who completed the PG surveys were able to correctly identify the primary resident physician responsible for their care. For example, we do not know if patients were able to distinguish resident from supervising ED physicians, consulting physicians from other specialties, or ED resident physicians who assumed responsibility for their care after initial evaluation by the primary ED physicians. Finally, even though burnout results via the MBI are considered stable for up to 1 year,1 our burnout survey was administered over 1 month and the results were compared to PG surveys from the preceding 6 months.
Conclusion
In this pilot study emergency medicine trainee burnout was associated with lower patient satisfaction scores across all physician domains. Future work involving multiple sites and larger samples are necessary to confirm these results. An improved understanding of the relationship between emergency medicine physician burnout and its impact on patients’ perception of care may meaningfully shape efforts under way to promote patient‐centered care.
Supporting information
AEM Education and Training 2018;2:86–90
This work was supported by the Northwestern University Feinberg School of Medicine Department of Emergency Medicine Davee Innovations Endowment Award.
The authors have no potential conflicts to disclose.
Author contributions: DWL was involved in study concept and design, data acquisition, data analysis and interpretation, drafting of the manuscript, critical manuscript revision, statistical expertise, and acquisition of funding; PLW was involved in study concept and design, data acquisition, and critical manuscript revision; CP was involved in study concept and design, data acquisition, and critical manuscript revision; and TDS was involved in data analysis and interpretation, critical manuscript revision, and statistical expertise.
References
- 1. Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory Manual, 3rd ed Palo Alto, CA: Consulting Psychologists Press, 1996. [Google Scholar]
- 2. Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work‐life balance among US physicians relative to the general US population. Arch Intern Med 2012;172:1377–85. [DOI] [PubMed] [Google Scholar]
- 3. Lu DW, Dresden S, McCloskey C, Branzetti J, Gisondi MA. Impact of burnout on self‐reported patient care among emergency physicians. West J Emerg Med 2015;16:996–1001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Kimo Takayesu J, Ramoska EA, Clark TR, et al. Factors associated with burnout during emergency medicine residency. Acad Emerg Med 2014;21:1031–5. [DOI] [PubMed] [Google Scholar]
- 5. Lu DW, Dresden SM, Courtney DM, Salzman DH. An investigation of the relationship between emergency medicine trainee burnout and clinical performance in a high‐fidelity simulation environment. AEM Educ Train 2017;1:55–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Shanafelt TD, Balch CM, Dyrbye L, et al. Special report: suicidal ideation among American surgeons. Arch Surg 2011;146:54–62. [DOI] [PubMed] [Google Scholar]
- 7. Dewa CS, Loong D, Bonato S, Thanh NX, Jacobs P. How does burnout affect physician productivity? A systematic literature review. BMC Health Serv Res 2014;14:325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Dewa CS, Jacobs P, Thanh NX, Loong D. An estimate of the cost of burnout on early retirement and reduction in clinical hours of practicing physicians in Canada. BMC Health Serv Res 2014;14:254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Welp A, Meier LL, Manser T. Emotional exhaustion and workload predict clinician‐rated and objective patient safety. Front Psychol 2014;5:1573. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Nelson KM, Helfrich C, Sun H, et al. Implementation of the patient‐centered medical home in the Veterans Health Administration: associations with patient satisfaction, quality of care, staff burnout, and hospital and emergency department use. JAMA Intern Med 2014;174:1350–8. [DOI] [PubMed] [Google Scholar]
- 11. Boudreaux ED, O'Hea EL. Patient satisfaction in the emergency department: a review of the literature and implications for practice. J Emerg Med 2004;26:13–26. [DOI] [PubMed] [Google Scholar]
- 12. Zolnierek KB, Dimatteo MR. Physician communication and patient adherence to treatment: a meta‐analysis. Med Care 2009;47:826–34. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Schneider J, Kaplan SH, Greenfield S, Li W, Wilson IB. Better physician‐patient relationships are associated with higher reported adherence to antiretroviral therapy in patients with HIV infection. J Gen Intern Med 2004;19:1096–103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Farley H, Enguidanos ER, Coletti CM, et al. Patient satisfaction surveys and quality of care: an information paper. Ann Emerg Med 2014;64:351–7. [DOI] [PubMed] [Google Scholar]
- 15. South Bend, IN: Press Ganey Associates Inc., 2017. [Google Scholar]
- 16. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)–a metadata‐driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Lu DW. Response to letter to the editor regarding, “Emergency Medicine Faculty are Poor at Predicting Burnout in Individual Trainees: An Exploratory Study”. AEM Educ Train 2018;2:000–00. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Dyrbye LN, West CP, Shanafelt TD. Defining burnout as a dichotomous variable. J Gen Intern Med 2009;24:440; author reply 1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Schwartz TM, Tai M, Babu KM, Merchant RC. Lack of association between Press Ganey emergency department patient satisfaction scores and emergency department administration of analgesic medications. Ann Emerg Med 2014;64:469–81. [DOI] [PubMed] [Google Scholar]
- 20. Kupfer JM, Bond EU. Patient satisfaction and patient‐centered care: necessary but not equal. JAMA 2012;308:139–40. [DOI] [PubMed] [Google Scholar]
- 21. Epstein RM, Street RL Jr. The values and value of patient‐centered care. Ann Fam Med 2011;9:100–3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Argentero P, Dell'Olivo B, Ferretti MS. Staff burnout and patient satisfaction with the quality of dialysis care. Am J Kidney Dis 2008;51:80–92. [DOI] [PubMed] [Google Scholar]
- 23. Halbesleben JR, Rathert C. Linking physician burnout and patient outcomes: exploring the dyadic relationship between physicians and patients. Health Care Manage Rev 2008;33:29–39. [DOI] [PubMed] [Google Scholar]
- 24. Garman AN, Corrigan PW, Morris S. Staff burnout and patient satisfaction: evidence of relationships at the care unit level. J Occup Health Psychol 2002;7:235–41. [PubMed] [Google Scholar]
- 25. Shanafelt TD, Hasan O, Dyrbye LN, et al. Changes in burnout and satisfaction with work‐life balance in physicians and the general us working population between 2011 and 2014. Mayo Clin Proc 2015;90:1600–13. [DOI] [PubMed] [Google Scholar]
- 26. Lu DW, Lank PM, Branzetti JB. Emergency medicine faculty are poor at predicting burnout in individual trainees: an exploratory study. AEM Educ Train 2017;1:75–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.