The burden of the digital environment: a systematic review on organization-directed workplace interventions to mitigate physician burnout

Kelly J Thomas Craig; Van C Willis; David Gruen; Kyu Rhee; Gretchen P Jackson

doi:10.1093/jamia/ocaa301

. 2021 Jan 19;28(5):985–997. doi: 10.1093/jamia/ocaa301

The burden of the digital environment: a systematic review on organization-directed workplace interventions to mitigate physician burnout

Kelly J Thomas Craig ^1,^✉, Van C Willis ¹, David Gruen ¹, Kyu Rhee ¹, Gretchen P Jackson ^1,²

PMCID: PMC8068437 PMID: 33463680

Abstract

Objective

To conduct a systematic review identifying workplace interventions that mitigate physician burnout related to the digital environment including health information technologies (eg, electronic health records) and decision support systems) with or without the application of advanced analytics for clinical care.

Materials and Methods

Literature published from January 1, 2007 to June 3, 2020 was systematically reviewed from multiple databases and hand searches. Subgroup analysis identified relevant physician burnout studies with interventions examining digital tool burden, related workflow inefficiencies, and measures of burnout, stress, or job satisfaction in all practice settings.

Results

The search strategy identified 4806 citations of which 81 met inclusion criteria. Thirty-eight studies reported interventions to decrease digital tool burden. Sixty-eight percent of these studies reported improvement in burnout and/or its proxy measures. Burnout was decreased by interventions that optimized technologies (primarily electronic health records), provided training, reduced documentation and task time, expanded the care team, and leveraged quality improvement processes in workflows.

Discussion

The contribution of digital tools to physician burnout can be mitigated by careful examination of usability, introducing technologies to save or optimize time, and applying quality improvement to workflows.

Conclusion

Physician burnout is not reduced by technology implementation but can be mitigated by technology and workflow optimization, training, team expansion, and careful consideration of factors affecting burnout, including specialty, practice setting, regulatory pressures, and how physicians spend their time.

Keywords: burnout, electronic health records, quality improvement, workflow, team-based care

INTRODUCTION

Clinician burnout was considered a global health crisis before coronavirus disease 2019 (COVID-19) with more than 60% of providers reporting at least 1 symptom of burnout.¹^,² However, the pandemic has compounded the emotional, physical, and mental exhaustion for healthcare providers as stressors within the healthcare system have been exacerbated. The mental health consequences, particularly for clinicians on the front line, may be significant. Acute increases in workplace stressors may increase the prevalence of post-traumatic stress disorder (PTSD); notably, the drivers of PTSD and burnout are similar with overlapping harmful impacts on provider health.³ In the current setting with COVID-19, resiliency techniques targeting the individual are important, but insufficient to overcome systemic challenges that give rise to burnout. Healthcare organizations, now more than ever, need to prioritize their employees’ health and address the drivers of burnout.

Arguably, the primary drivers of burnout for physicians have been related to electronic health records (EHRs) and overwhelming inefficiencies in clinical practice that significantly and negatively impact workflow and patient care.⁴^,⁵ Physicians experience high fatigue with short, continuous periods of EHR use, which is also associated with inefficiency of EHR use (ie, more clicks and more time) on subsequent cases.⁶ The association of burnout with EHR design and usability has been identified,⁷ in addition to the clerical burden of technology on workload (both cognitive and physical) and its associated workflows.⁸^,⁹ Despite the general acknowledgement that the evolving digital environment using health information technologies (eg, patient portals, clinical notes, computerized order-entry, electronic prescribing) for both regulatory and administrative purposes has altered physicians’ practice, interventions to lessen associated burnout have not been well characterized. To date, there is a gap in understanding whether physician burnout is improved by interventions designed to decrease the burden of their digital environment and improve related clinical workflow efficiency.

We conducted a systematic review in 2018 to identify workplace interventions to alleviate burnout;¹⁰ however given the COVID-19 climate, reducing burnout remains a high priority to safeguard healthcare providers and the patients and system they serve. The scope of published burnout-related interventions continues to exponentially grow, but the connection to the digital environment has not been synthesized. The objective of this study is to perform an update of our systematic review and conduct a subgroup analysis to identify interventions to mitigate digital tool burden and/or its related workflow inefficiencies.

MATERIALS AND METHODS

This study was conducted in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)¹¹ under an a priori protocol. This study is an update and subgroup analysis of our systematic review of workplace interventions to mitigate physician burnout.¹⁰ The objective of the subgroup analysis was to identify and summarize interventions used to address the burden of digital tools and their impact on workflow inefficiencies, whereas the original study results sought to identify any type of organization-directed workplace intervention to address burnout (Figure 1).

Figure 1. — Study overview, description of 4Ts framework, and subgroup analysis.

Search strategy

Literature was searched from multiple databases (MEDLINE, Embase, and Cochrane Library) on October 3, 2018; an updated search was performed on June 3, 2020 for relevant articles; and the Association for Computing Machinery (ACM) Digital Library was queried on August 17, 2020. Queries were designed to identify physician-specific burnout or burnout proxy (satisfaction and/or stress) outcomes following work, workplace, or workflow interventions. Search limits were set regarding time (2007–2020), English-language, and abstract availability. Within the protocol, the introduction of the Health Information Technology for Economic and Clinical Health (HiTECH) Act of 2009 was a distinguishing time point. Based upon the widespread implementation of HIT post-2009, evidence collected before this date was not of interest based on the assumption that burnout has increased dramatically as a result of organizational changes to accommodate the meaningful use of HIT in clinical care. Hand searches were also conducted to identify literature from key conferences, organization websites, and bibliographies of included studies. Details are provided in Supplementary Tables 1–10.

Screening process

One investigator (KJTC or VCW) screened all titles and abstracts for eligibility against a priori established inclusion criteria (Supplementary Table 11). Included studies examined physician-specific burnout or burnout proxy outcomes (satisfaction and/or stress) following an organization-directed intervention (ie, not individual interventions conducted outside of the workplace, sometimes referred to as physician-directed) whereby comparisons were provided to examine the effect of the intervention in all settings. Studies did not have to be designed to measure the effect of interventions on burnout or its proxy measures but had to capture burnout or burnout-related outcomes as a result of a workplace modification. Studies marked for inclusion were dually screened at the full-text level by 2 independent investigators (KJTC, VCW); any disagreements were resolved by adjudication, or a third reviewer (GPJ) (decision matrix provided in Supplementary Table 12). Additional inclusion criteria were applied to identify studies eligible for the subgroup analysis. Studies were eligible if the intervention specifically considered time management, leveraged team-based care, reexamined key transitions in care processes, and/or primarily, if health information technology (HIT) was adopted, implemented, or optimized with the intention to ease digital burden and/or its related workflow issues. All results were tracked in DistillerSR (Evidence Partners) and EndNote (Clarivate). Interrater reliability was determined by Cohen’s kappa.¹²

Data extraction and quality assessment

Included studies were extracted (form example in Supplementary Table 13) into a priori structured forms by 1 investigator (KJTC) and checked for accuracy and completeness by a second investigator (VCW). Additional data were abstracted for the subgroup analysis to identify study details related to the type of technologies (eg, EHRs, patient portals, decision support systems including any advanced analytics applied) used and associated informatics usability, effectiveness, and impact data, if reported. As with the original review,¹⁰ studies were categorized into 1 or multiple categories of the 4Ts framework: technology, time, teamwork, and transitions. Technology referred to the implementation or improvement of health information technology, namely EHRs. Time studies involved duty hour restrictions and changes to work schedules or use of time on duty (eg, a program for mindfulness during on-duty time). Teamwork regarded the examination of care team processes and the addition of scribes to the team. Transitions included process improvements and quality initiatives. The Centre for Evidence-Based Medicine derived Oxford Levels of Evidence¹³ were used to assess study quality based on reported study design using their standardized glossary of terms by 2 independent investigators (KJTC, VCW); any disagreements were resolved by adjudication, or a third reviewer (GPJ).

RESULTS

Literature searches yielded 4806 unique citations (Figure 2), of which 319 articles were eligible for full-text screening. Upon full-text screening, 81 articles¹⁰^,^14–93 were included of which 63 were full-length articles and 19 were conference abstracts.¹⁴^,¹⁵^,²⁰^,²⁶^,²⁹^,³⁶^,⁴⁹^,⁵¹^,⁵²^,⁶⁴^,⁶⁶^,⁶⁷^,⁷¹^,⁷⁶^,⁸¹^,⁸³^,⁸⁷^,⁹⁰^,⁹² Interrater reliability was 0.76 for full-text screening. As an update to the DeChant et al (2019) study,¹⁰ 31 additional articles were identified.¹⁰^,¹⁸^,¹⁹^,²¹^,^23–25^,³³^,³⁴^,^40–42^,⁴⁷^,⁴⁸^,⁵⁰^,⁵¹^,⁵⁴^,⁶¹^,⁶²^,⁶⁴^,⁶⁶^,^68–70^,⁷²^,⁷⁵^,⁸⁰^,⁸¹^,⁸⁵^,⁸⁷^,⁸⁹ Abstractions of included studies can be found in Supplementary Table 14. Thirty-eight studies about digital tool burden and/or related workflow inefficiencies were identified in the subgroup analysis and are the focus of the following synthesis (abstractions in Supplementary Table 15).¹⁰^,¹⁴^,¹⁷^,^20–22^,^27–30^,³²^,³⁵^,³⁹^,⁴¹^,^43–46^,⁴⁹^,⁵¹^,⁵³^,^56–59^,^62–67^,⁷⁰^,^75–77^,⁸³^,⁹²^,⁹³

Study and physician characteristics

Characteristics of the 38 studies included in the subgroup analysis are provided in Supplementary Table 15. Most studies (35 studies) were conducted in the US, 1 in the United Kingdom,¹⁷ and 2 were multinational as systematic reviews.¹⁰^,⁴³ Study designs included cross-sectional studies (4 studies),²⁷^,⁶⁵^,⁹²^,⁹³ pre-post-intervention surveys (21 studies),¹⁷^,²²^,^28–30^,³⁵^,^44–46^,⁴⁹^,⁵¹^,⁵⁶^,⁵⁷^,⁶³^,⁶⁴^,⁶⁶^,⁶⁷^,⁷⁶^,⁷⁷^,⁸³ prospective studies (5 studies),²⁰^,³²^,⁴¹^,⁶²^,⁷⁰ randomized controlled trials (RCTs) (4 studies),³⁹^,⁵⁸^,⁵⁹^,⁷⁵ 2 systematic reviews¹⁰^,⁴³ and other designs (2 studies).¹⁴^,⁵³ Comparators were a condition of study inclusion, and the majority of studies provided baseline or preintervention data. Other notable comparator groups included use of standard (eg, nonenhanced) technologies,²⁰^,⁴⁸^,⁶²^,⁷⁵ paper charting,⁶⁶ no intervention,⁵⁸^,⁵⁹ and crossover periods without intervention.³⁹^,⁷⁰ Interventions were conducted in multiple settings, but most evaluated primary care (22 studies) physicians and residents.²⁰^,²²^,^27–30^,³²^,³⁹^,⁴¹^,^44–46^,⁵⁶^,⁵⁸^,⁵⁹^,⁶⁴^,⁶⁵^,⁷⁰^,⁷⁷^,⁸³^,⁹²^,⁹³ Some studies examined specialists (7 studies),¹⁴^,³⁵^,⁵³^,⁵⁷^,⁶³^,⁶⁶^,⁷⁵ a mix of primary care physicians and specialists (4 studies),¹⁰^,²¹^,⁶²^,⁷⁶ and groups of physicians with unspecified specialties (5 studies).¹⁷^,⁴³^,⁴⁹^,⁵¹^,⁶⁷

Measures of burnout

The gold standard for identifying burnout, the Maslach Burnout Inventory (MBI),⁹⁴ which includes subscales related to depersonalization, emotional exhaustion, and personal accomplishment, was infrequently used (4 studies).²⁸^,³²^,⁴⁵^,⁹² Proxy measures of burnout, including satisfaction and stress, were also abstracted. Studies of satisfaction measured outcomes such as satisfaction, professional fulfillment, well-being, and joy of practice. Studies of stress included outcomes such as stress, psychological (including cognitive) strain, and job distress. Four studies did not report the instrument used to measure burnout-related outcomes.¹⁴^,²⁰^,⁶⁷^,⁷⁶ The majority (17 studies) of authors developed their own surveys,¹⁷^,²¹^,²²^,²⁷^,²⁹^,³⁵^,³⁹^,⁴⁶^,⁵³^,⁵⁶^,⁵⁷^,^63–66^,⁷⁷^,⁹³ and 2 studies provided only qualitative findings.⁴⁹^,⁸³ As systematic reviews, 2 studies had multiple types of burnout measures.¹⁰^,⁴³

Characteristics of organization-directed interventions

Based on the original review,¹⁰ interventions were stratified into teamwork, transitions, time, and/or technology (Table 1). Most interventions were assigned to multiple categories with the exception of 10 studies of exclusively technology-centric interventions.¹⁴^,²⁰^,²²^,³⁵^,⁴⁴^,^65–67^,⁷⁵^,⁹³ Twenty-six (68%) of the 38 studies provided evidence that burnout and its proxy measures of stress and/or satisfaction were improved by a workplace intervention to address workflow inefficiencies in clinical teams that use a digital environment (Table 2).¹⁰^,¹⁷^,²¹^,^27–29^,³²^,³⁹^,⁴¹^,⁴³^,⁴⁵^,⁴⁶^,⁴⁹^,⁵¹^,⁵³^,^56–59^,^63–65^,⁶⁷^,⁷⁰^,⁷⁶^,⁹² The scope of this work identified the digital environment including data entry and communication using EHRs (both standard issue and customized), patient portals, disease-management software, clinical decision support, physician order entry, EHR-integrated paging, and clinical task-management systems. The impact on burnout was similar among time, teamwork, and transitions interventions (Figure 3, range 85%–90% of studies with positive outcomes), and these types of interventions were commonly combined. Technology interventions were least effective with 41% of studies reporting improvement in burnout or its proxy measures (Figure 3).

Table 1.

Study characteristics by intervention type

		Intervention Type(s)
		Time ^a		Teamwork ^b		Transitions ^c		Technology ^d
NO.	Reference	Scheduling	Efficiency & productivity	Team-based care	HIT documentation	Process improvement	Workflow change	Adoption	Implementation	Optimization
1	Agha, 2010¹⁴
2	Amis, 2018¹⁷
3	Babbott, 2013²⁰
4	Baccei, 2020²¹
5	Beam, 2017²²
6	Chapman, 2017²⁷
7	Contratto, 2015²⁹
8	Contratto, 2017²⁸
9	Danila, 2018³⁰
10	DeChant, 2019¹⁰
11	Dunn, 2007³²
12	Ehrlich, 2016³⁵
13	Gidwani, 2017³⁹
14	Goyal, 2018⁴¹
15	Heaton, 2016⁴³
16	Heyworth, 2012⁴⁴
17	Hung, 2018⁴⁵
18	Imdieke, 2017⁴⁶
19	Joseph, 2017⁴⁹
20	Keefer, 2018⁵¹
21	Koshy, 2010⁵³
22	Lapointe, 2018⁵⁶
23	Lee, 2018⁵⁷
24	Linzer, 2015⁵⁹
25	Linzer, 2017⁵⁸
26	Mazur, 2019⁶²
27	McCormick, 2018⁶³
28	Mehta, 2018⁶⁴
29	Menachemi, 2009⁶⁵
30	Michelotti, 2013⁶⁶
31	Milenkiewicz, 2017⁶⁷
32	Mishra, 2018⁷⁰
33	Payne, 2018⁷⁵
34	Pierce, 2017⁷⁶
35	Pozdynakova, 2018⁷⁷
36	Shaw, 2017⁸³
37	Willard-Grace, 2017⁹²
38	Wylie, 2014⁹³
COUNTS		6	17	23	16	10	25	5	11	6

Open in a new tab

Note: Cell shading indicates if intervention contained 1 or more of the following 4Ts intervention categorizations:

Time: studies involved duty hour restrictions and changes to work schedules or use of time on duty (eg, a program for mindfulness during on-duty time). Scheduling included schedule modifications and flexibility; efficiency & productivity included productivity related interventions regarding efficiency, documentation time, task completion, work interruptions, or patient contact time.

Teamwork: studies examined care team processes and the addition of scribes to the team. Team-based care included any additional member of the care team including nurses, medical assistants/scribes, other physicians; HIT documentation was limited to studies that used a member of the care team to shift data entry away from the physician.

Transitions: studies of process improvements and quality initiatives. Process improvement included explicit use of lean methodologies or quality improvement initiatives; workflow change included any intervention that demonstrated a process change whereby a workflow was modified for improvement.

Technology: studies involved implementation or improvement of health information technology, namely electronic health records. Health information technology included adoption (ie, the sociological process of uptake in usage of a new technology), implementation (ie, installation of new technology and training to use it effectively), or optimization (ie, iterations or changes to technology for improvement).

Abbreviation: HIT, health information technology.

Table 2.

Study results stratified by outcome^a

Author, Year ^b	Study Design (Oxford Levels of Evidence)	Sample Size (n)	Population	Intervention (4Ts)	Outcomes
Author, Year ^b	Study Design (Oxford Levels of Evidence)	Sample Size (n)	Population	Intervention (4Ts)	Burnout ^c	Satisfaction ^d	Stress ^e
Agha, 2010¹⁴	NR (IV)	9	Specialists^f^,g,h	Technology	–	↓*	–
Amis, 2018¹⁷	Pre-post survey (IV)	13	First year residents	Time, Transitions	–	↑*	–
Babbott, 2013²⁰	Prospective (IV)	422	IM and FM physicians	Technology	NS	NS	↑+
Baccei, 2020²¹	Pre-post survey (IV)	6	Radiologists	Time, Teamwork, Transitions	-	↑*	-
Beam, 2017²²	Pre-post survey (IV)	158	Physicians	Technology	–	NS	–
Chapman, 2017²⁷	Cross-sectional (IV)	886	PC physicians	Teamwork, Transitions	–	↑*	–
Contratto, 2015²⁹	Pre-post survey (IV)	9	PC physicians	Time, Teamwork, Transitions	↓*	–	–
Contratto, 2017²⁸	Quasi-experimental mixed methods (IV)	7	IM physicians	Time, Teamwork, Transitions	↓*	–	–
Danila, 2018³⁰	Pre-post survey (IV)	6	Specialists^{g, h}	Teamwork, Transitions	–	NS	–
Dunn, 2007³²	Prospective study (IV)	22–32	Physicians	Time, Teamwork, Transitions	↓++	NS	–
Ehrlich, 2016³⁵	Pre-post survey (IV)	25	Ophthalmologists	Time	–	NS	–
Gidwani, 2017³⁹	RCT (IB)	4	Physicians	Time, Teamwork, Transitions	–	↑+++	–
Goyal, 2018⁴¹	Prospective cohort (IIB)	7	IM physicians (including residents)	Time, Teamwork, Transitions, Technology	–	↑+++	–
Heaton, 2016⁴³	Systematic review (IIA)	NA	NA	Time, Teamwork	–	↑*	–
Heyworth, 2012⁴⁴	Pre-post survey (IV)	163	PC and specialty	Technology	–	–	↑+
Hung, 2018⁴⁵ l	Pre-post survey (IV)	680	Physicians	Teamwork, Transitions	↑+++	↑+	↑+++
Imdieke, 2017⁴⁶	Quasi-experimental pre-post intervention study (IV)	2	IM physicians	Time, Teamwork, Transitions	–	↑+++	–
Joseph, 2017⁴⁹	Pre-post survey (IV)	NR	Providers	Time, Transitions Technology	–	↑*	–
Keefer, 2018⁵¹	Pre-post survey (IV)	NR	Physicians	Time, Teamwork, Transitions	-	-	↓*
Koshy, 2010⁵³	Static-group comparison study (IV)	5	Urologists, residents	Teamwork, Transitions	–	↑+++	–
Lapointe, 2018⁵⁶	Pre-post survey (IV)	25	IM residents	Time, Transitions, Technology	–	↑*	↓*
Lee, 2018⁵⁷	Pre-post survey (IV)	15	Neuroradiologists and fellows	Transitions	–	↑+++	↓+++
Linzer, 2015⁵⁹	Cluster RCT (IIB)	135	FM and IM physicians	Teamwork, Transitions	↓+	NS	NS
Linzer, 2017⁵⁸	Cluster RCT (IIB)	165	FM and IM physicians	Teamwork, Transitions	–	↑+++	↓+++
Mazur, 2019⁶²	Prospective cohort (IIB)	38	IM, FM, and specialist^{i, j, k} residents and fellows	Time, Transitions, Technology	-	NS	-
McCormick, 2018⁶³	Pre-post survey (IV)	6	Urologists	Time, Teamwork, Transitions	–	↑+	–
Mehta, 2018⁶⁴	Pre-post survey (IV)	NR	Hospitalists	Time, Teamwork, Transitions, Technology	-	↑*	-
Menachemi, 2009⁶⁵	Cross-sectional (IV)	4,203	PC physicians and clinical specialists	Technology	–	↑++	–
Michelotti, 2013⁶⁶	Pre-post survey (IV)	59	Faculty ophthalmologists	Technology	-	↓+++	-
Milenkiewicz, 2017⁶⁷	Pre-post survey (IV)	NR	Physicians	Time, Technology	–	↑*	–
Mishra, 2018⁷⁰	Crossover prospective cohort study (IIB)	18	PC providers	Time, Teamwork, Transitions	-	↑*	–
Payne, 2018⁷⁵	RCT (IIB)	31	IM residents and attending hospitalists	Technology	-	NS	–
Pierce, 2017⁷⁶	Pre-post survey (IV)	55	Physicians and advanced practice clinicians	Teamwork, Transitions	↓*	–	–
Pozdnyakova, 2018⁷⁷	Prospective, pre-post-pilot study (IV)	6	General IM faculty	Teamwork, Transitions, Technology	NS	–	–
Shaw, 2017⁸³	Pre-post survey (IV)	NR	Medical doctors	Teamwork, Transitions	–	NS	–
Willard-Grace, 2017⁹²	Cross-sectional (IV)	236	Clinicians	Time, Teamwork, Transitions	↓++	–	–
Wylie, 2014⁹³	Cross-sectional (IV)	2365	PC providers	Technology	–	↓+	–

Open in a new tab

Note: The arrows indicate the directionality of the intervention on the effect of burnout, satisfaction, and stress. Improvements are denoted by green color where the associations of the intervention on burnout or proxy measures were statistically significant (see below). Red color indicates the intervention did not improve the burnout or proxy measure (interpreted by a nonsignificant result or P values were not provided) or resulted in detractions whereby the outcome measure worsened with the intervention. White content with dashes indicates no data was reported. Levels of evidence: IB, Individual randomized controlled trial (RCT) (with narrow confidence interval); IIA, Systematic review with homogeneity; IIB, Individual cohort study (including low RCT; eg, < 80% follow-up); IV, Case-series, poor-quality cohort, case-control studies, and systematic review with heterogeneity.

Table adapted from DeChant et al (2019).¹⁰

DeChant et al. (2019) was not included in this table as the relevant interventions are already included in the table under the original author names.¹⁰

Burnout includes overall burnout, emotional exhaustion, depersonalization, personal accomplishment, and cynicism.

Satisfaction includes outcomes reported as satisfaction, professional fulfillment, well-being, and joy of practice.

Stress includes outcomes reported as stress, psychological strain, and job distress.

Pulmonology, ^grheumatology, ^hendocrinology, ⁱpediatrics, ^jsurgery, or ^kother specialists.

Hung et al. describe findings of increased engagement, teamwork, and stress suggesting that their work redesign improved physician experiences, but not sufficiently to overcome workflow challenges linked to stress and burnout.

Symbols: + = P < .05; ++ = P < .01; +++ = P < .001; NS = Not significant; * = No P value reported. FM = Family medicine; IM = Internal medicine; NA = Not applicable; NR = Not reported; NS = Not significant; PC = Primary care.

Figure 3. — Proportions of interventions with a positive impact on burnout, stratified by intervention type and quality of evidence.

Study quality

The evaluation of study quality using the Oxford Levels of Evidence¹³ is presented in Supplementary Table 15. The majority (30 studies) were categorized as level IV studies, which includes case series, cross-sectional, poor quality cohort, and pre-post-test single arm studies. Higher quality studies were limited to 1 IB (individual RCT with narrow confidence interval),³⁹ 1 IIA (systematic review with homogeneity and meta-analysis),¹⁰^,⁴³ and 6 IIB (individual cohort including low-quality RCTs with less than 80% follow-up, or systematic review with heterogeneity) categorizations.⁴¹^,⁵⁸^,⁵⁹^,⁶²^,⁷⁰^,⁷⁵ Overall, the levels of evidence identified indicate a preponderance of low-quality studies based on study design and corresponding low grades (eg, grade of C, as majority were level IV studies) of (perceived) recommendations.

Expansion of the care team to give time back to physicians

The most frequent interventions (27 studies) were those that regarded process improvements with the explicit use of lean methodologies or quality improvement (QI) initiatives, and/or workflow changes. QI and lean-based interventions were less successful than general workflow changes, as most QI studies had mixed results³²^,⁴⁵^,⁵⁹ or no significant impact.²¹^,⁵¹^,⁶² Three studies demonstrated that process improvements had overall good outcomes.⁴⁹^,⁵⁷^,⁵⁸ One high-quality study identified that burnout was more likely to improve when workflow redesign was part of a QI initiative that addressed physicians’ concerns; a significant reduction in burnout was seen following implementation of QIs around routine preventive screening processes and medication reconciliation in primary care settings.⁵⁹ Another QI intervention that examined the workplace environment of radiologists to reduce both workload and frequency of disruptions increased workplace satisfaction and reduced stress.⁵⁷ Lastly, to reboot the “joy in the practice of medicine,” a process improvement intervention to enhance EHR efficiency increased job satisfaction.⁴⁹ Other process improvement interventions were centered around operationalizing the care team that included: colocation of care teams,⁴⁵ consideration of communication practices,⁵⁸^,⁵⁹ redesign of responsibilities within the care team and its clinical workflows to improve efficiency,²¹^,³²^,⁴⁵^,⁵¹^,⁵⁸^,⁵⁹ and the evaluation of electronic data entry and its management.²¹^,⁴⁵^,⁵⁹^,⁶²

With the exception of 5 studies,¹⁷^,⁴⁹^,⁵⁶^,⁵⁷^,⁶² QI processes and workflow modifications were frequently combined with an intervention to expand the care team to primarily add clerical support by medical assistants/scribes (20 studies).¹⁰^,^27–30^,³⁹^,⁴¹^,⁴³^,⁴⁵^,⁴⁶^,⁵¹^,⁵³^,⁵⁸^,⁵⁹^,⁶³^,⁶⁴^,⁷⁰^,⁷⁷^,⁸³^,⁹² The expanded care team, namely scribes, facilitated electronic data entry for documentation during clinical encounters, such as previsit planning, visit notes (such as history, physical examination findings, laboratory, and/or imaging results), assessments and plans, instructions and education for patients, referrals, and nursing orders. Other team-based interventions improved team dynamics²¹^,³²^,⁴¹^,⁷⁶ or hired additional full-time faculty to support and supervise residents to ease their workload, reduced attending-to-patient ratios, and increased number of rounding teams.⁵¹ Generally, these combinatory interventions decreased burnout,¹⁰^,²⁸^,²⁹^,³²^,⁵⁹^,⁷⁶^,⁹² increased job satisfaction,¹⁰^,²⁷^,³⁹^,⁴¹^,⁴³^,⁴⁵^,⁴⁶^,⁴⁹^,⁵³^,⁵⁷^,⁵⁸^,⁶³^,⁶⁴ and/or decreased stress¹⁰^,^56–58 in physicians.

Many interventions had implicit connections to time (20 studies), mostly considering how clerical tasks within the digital environment could be shifted from the physician to the expanded care team. Modified workflows in expanded care teams improved clinical efficiency and/or productivity, and some studies explicitly measured these outcomes by conducting time and motion studies (17 studies, Table 2). Productivity and/or efficiency were generally improved using scribes for data entry,²⁸^,²⁹^,⁴³^,⁶³^,⁶⁴ and physicians’ task completion and/or documentation time during or after clinic hours and on weekends were decreased significantly.²⁸^,²⁹^,⁴³^,⁴⁶^,⁷⁰ Additionally, the use of scribes closed patient encounters on average 8.9 days sooner.⁶³ One study estimated that physician documentation time was reduced by 50% with scribe implementation, which was a time savings that could be reallocated to patient-facing interactions.⁴⁶ Similarly, improved documentation efficiency with scribe implementation provided “enough” face time with patients,³⁹ whereby greater than 75% of the clinical encounter was spent interacting with patients.⁷⁰ Time savings were also noted by interventions without the use of scribes; interventions to improve clinician documentation efficiency using standardized templates resulted in a reduction of 1500 keystrokes per day per provider⁴⁹ and decreased total documentation time 18%–35%.⁶⁷ Other successful time interventions without the use of scribes decreased the frequency of work interruptions⁴¹^,⁵⁶ (1 translated to 72.5 physician hours regained in a 3-month intervention period),⁵⁶ reduced number of prescribing tasks for residents listed in a computerized hospital management task system,¹⁷ and improved physician scheduling to convalesce clinical team interactions via enhanced work–life balance and decreased burnout.¹⁰^,³²^,⁹²

Leveraging technology to support clinical workflows and teams

Health information technology interventions were stratified into implementation (ie, installation of new technology and training provided to use it effectively) (11 studies), adoption (ie, uptake in usage of a new technology) (5 studies), and/or optimization (ie, iterations or changes to technology for improvement) (6 studies) as shown in Table 1. In addition to burnout outcomes, qualitative and quantitative analyses regarding usability metrics of performance and/or satisfaction (including physician, practice, patient, and IT) were captured in 14 of the 17 studies categorized as technology.¹⁴^,²⁰^,²²^,³⁵^,⁴¹^,⁴⁴^,⁴⁹^,⁵⁶^,⁶²^,^65–67^,⁷⁵^,⁹³ Technology adoption and implementation studies generally had no effect on or worsened burnout and its proxy measures,¹⁴^,²⁰^,²²^,³⁵^,⁴⁴^,⁶⁶^,⁷⁵^,⁹³ whereas interventions to optimize the use of technology by design improvement and/or provision of user training were generally effective at reducing burnout, albeit some only qualitatively.¹⁰^,⁴⁹^,⁵⁶^,⁶⁴^,⁶⁷ Examples of improvements included usability and agile methodologies to standardize documentation processes in workflows.⁴⁹^,⁶²^,⁷⁷ Tailored interventions to customize EHRs decreased data entry time by limiting keystrokes and/or mouse clicks through iteratively adjusting the tool’s performance based on user experience and feedback to the design team.⁶⁴^,⁶⁷ Pre-post-qualitative surveys examining usability of technology optimization and subsequent modified digitally related workflows improved personal, professional, or practice satisfaction.⁴⁹^,⁵⁶^,⁶⁴^,⁶⁷ Only 4 studies incorporated advanced analytics in technology interventions and none had statistically significant positive impacts on burnout. Two studies examined speech recognition algorithms for EHR documentation,⁴⁹^,⁷⁵ and 2 studies examined enhanced EHR usability with the addition of decision support systems.²²^,⁶²

DISCUSSION

This study is the first comprehensive systematic review of interventions to address clinician burnout with a focus on technologies and the digital environment. Many single-site studies have documented the effects of digital technologies on clinician burnout, but evidence about the effectiveness of mitigation strategies has not been synthesized. This systematic review and subgroup analysis summarized the evidence about both successful and ineffective strategies for addressing burnout, factors influencing technology-related burnout, and important scientific gaps in the evidence base. Burnout was decreased by interventions that optimized technology (primarily EHRs), reduced documentation and task time, expanded care teams, and leveraged quality improvement processes to enhance workflows during key transitions in patient care.

This systematic review elucidated several factors that significantly influence the effects of the digital environment on physician burnout, including clinical specialty, practice setting, requirements for compliance and reimbursement, and how physicians spend their time. The disproportionate use of digital tools by certain physician specialties and practice settings is one important consideration. Specialties such as cardiology, urology, and family practice have demonstrated higher EHR use as have practices owned by Health Maintenance Organizations.⁹⁵ Implementation of hospital-wide picture archiving and communication systems have shown improvements in information availability and reporting times while simultaneously isolating the radiologists who use them from interaction with consulting physicians.⁹⁶ Moreover, generic, commercial EHRs have inadequately responded to the needs and challenges that clinical specialties require, but stand-alone specialty EHR systems (without interoperability) have posed additional challenges for physicians and healthcare systems. An effective compromise will likely enable specialty-specific customizations while maintaining standards that support interoperability. Adoption of information and computer technologies for Meaningful Use and documentation required for billing may have perceived improvements in healthcare, but not without concomitant challenges including substantial, low-value digital documentation.

The impact of digital technologies on how physicians spend their time has been shown to affect multiple key domains including productivity and revenue,⁹⁷ job and patient satisfaction,³⁹ and personal well-being.⁹⁸ This review identified several interventions to decrease digital tool use and potentially redirect time for face-to-face patient contact and improvements in work-life balance; many of those studies performed time and motion analyses to understand the impact of workflow modification on physicians’ time by proxy of measuring duration of digital tool task completion. Scribe implementation decreased physician documentation hours,²⁸^,²⁹^,³⁹^,⁴³^,⁴⁶^,⁶³^,⁶⁴^,⁷⁰ including after-hours and weekends; however, schedule modifications were also leveraged in lean methodologies to provide flexibility for physicians to improve their personal well-being and prevent work overload by providing in-house evening and overnight resident supervision, reducing patient-to-attending ratio, and increasing number of rounding teams.⁵¹

Stressors in the workplace, particularly those related to the use of health information technologies (ie, “technostress”⁹⁹), are major sources of physician dissatisfaction and burnout, but they can often be mitigated by improvements in the quality and timing of training.¹⁰⁰ Technostress can increase as complex technologies are integrated into team-based workflows, and when compared to paper documentation, there is a steep learning curve for their effective use. A few studies identified in this review have used advanced training as a mechanism to improve the skill discrepancies that are essential for technology-user satisfaction. Comprehensive training is a generally applicable strategy for mitigating technology-related stress, and early deployment may offset anxiety that exacerbates burnout. Training gaps have been noted in the informatics literature, but have yet to be consistently addressed in practice.¹⁰¹^,¹⁰²

Optimization of HIT, namely EHRs, demonstrated burnout improvement (albeit, some only qualitatively) in all studies identified in this review,¹⁰^,⁴⁹^,⁵⁶^,⁶²^,⁶⁴^,⁶⁷ whereas the adoption and/or implementation of EHRs generally had no effect or worsened burnout outcomes.¹⁴^,²⁰^,²²^,³⁵^,⁴⁴^,⁶⁶^,⁷⁵^,⁹³ However, adoption of multiple technologies with interoperability⁶⁵ and the use of EHR-integrated communication⁵⁶ were all effective interventions to increase job satisfaction. Furthermore, based on the evidence obtained from agile methodologies to standardize documentation, there are strong justifications for organizations to tailor EHR usability for precise use cases.⁶⁷ Counterarguments suggest that EHR optimization will not be sufficient as the documentation burden for regulatory purposes (eg, billing and reimbursement) is the primary driver of US dissatisfaction with EHRs.¹⁰⁰ In consideration with value-based care initiatives, US regulatory changes could potentially lessen the documentation burden by nearly 4-fold.¹⁰⁰

Until the arrival of policy reform, practical and effective workflow interventions should be leveraged to reduce excessive data entry by the physician. For example, documentation efforts can be shifted from physicians to other members of a care team, which could subsequently improve efficiency. A large body of evidence identified from this review leveraged team-based care, primarily where scribes or medical assistants were added to care teams to document patient encounters in real-time under physician supervision. Expansion of care teams to include scribes has improved efficiency, productivity, quality of patient interactions, and physician satisfaction along with increased revenue and patient satisfaction.⁴³^,⁸⁶ Often coupled with expanded care teams to share documentation tasks, QI initiatives or “lean” methodologies were executed to improve productivity and workflow efficiency related to technologies, improving burnout and/or its proxy measures. The highest-quality study from this category observed a significant reduction in physician burnout following the implementation of QI initiatives that related to routine preventive screening processes and medication reconciliation for chronic disease management.⁵⁹ Notably, burnout was more likely to improve when workflow redesign was part of a QI project where physicians’ concerns were targeted.

An additional burden of the digital environment is the vast amount of information (eg, clerical, medical care, and communication) that physicians are required to handle effectively. Studies that leveraged the expansion of the care team, including scribes, could successfully manage and monitor inbox-related communication including patient portals, and refills and results management. Limited evidence was identified whereby advancements in artificial intelligence (AI), including machine learning, augmented the physician’s management of electronically generated information. Only four studies leveraged clinical decision support and speech recognition algorithms to augment the user and the tool’s performance.²²^,⁴⁹^,⁶²^,⁷⁵ These studies had mixed results on burnout improvement, but improved perceptions of workload²² and decreased cognitive workload.⁶² Since information overload is a ubiquitous challenge created by digital tool adoption, this study identifies a clear gap in evaluation of AI solutions—moving beyond accuracy to ascertain what impact, if any, they have on physician workflow, productivity, and burnout.

This study identified a large gap in informatics studies that assess the impact of advanced technologies on physician burnout. Advanced technology applications can support deeper insights, optimized processes, and increased engagement, which can enable greater scale and agility, improving healthcare delivery systems that put the right information, in the right hands, at the right time, with less stress on the care team. With the improved user-centered design by physicians, technology could become an additional member of the care team. Opportunities for automation exist to utilize digital scribing, an automated clinical documentation system that can capture and notate information from the patient–physician clinical encounter;¹⁰³ further integration and implementation of clinical decision support systems to provide information retrieval, evidence-based knowledge, summarizations, and recommendations; the utilization of chatbots, embodied conversational agents, or other virtual assistants to aid task management. In addition to advanced analytics, organizations can further improve interoperability at an operational level with application programming interfaces (APIs) and blockchain, as health data interoperability remains a problem. There remain challenges in patient information exchange between EHRs which further exacerbate physicians’ struggles with data management.

Strengths and limitations

This systematic review has several strengths. First, this study includes a recently updated systematic review of workplace interventions to tackle burnout with the first focused analysis of burnout specifically related to digital technologies. Secondly, an exhaustive literature search was conducted, including grey literature evaluation, that prioritized sensitivity over specificity. In this update spanning October 2018 to–June 2020, an additional 4173 articles were identified by our search query indicating the increased relevance and prioritization of this topic with 31 newly included studies. Thirdly, the limited evidence from the subset of literature identified gaps in adequately designed and reported studies to examine digital tool usability and its effect on physician burnout. Lastly, the findings from this systematic review support recommendations by the National Academy of Medicine, including the reduction of administration burden and technology optimization, for system-wide actions to reduce clinician burnout.¹⁰⁴

The results of this systematic review should be interpreted in the context of its limitations. Due to study heterogeneity, it is not possible to provide an assessment of comparative effectiveness across or among interventions (ie, meta-analysis was not possible), and the Oxford Levels of Evidence appraisal tool was used to compare the quality of the evidence provided within a wide variety of study designs. This study only addressed the interventions for burnout on physicians, while digital technologies also contribute to additional work and stress for a wide variety of clinicians, such as nurses and pharmacists. The volume of evidence identified was substantial for physicians alone, and it is likely that mitigation strategies for other healthcare personnel with different work tasks and workflows will vary significantly. This study examined the impact of organization-directed workplace interventions on physician burnout, but it also be must acknowledged that those physicians may be receiving concurrent individualized burnout reduction interventions. Notably, a minority of the studies targeted trainees and most (5 of 7)¹⁷^,⁴¹^,⁵³^,⁵⁶^,⁵⁷ interventions were successful;¹⁷^,⁴¹^,⁵³^,⁵⁶^,⁵⁷^,⁶²^,⁷⁵ however, these populations may have different needs to reduce burnout. Most studies were conducted in US primary care settings, which limits generalizability across specialties and globally. Additionally, most studies were of low quality with short duration of follow-up limiting the credibility of the evidence. In this revised protocol to include a subgroup analysis, more details were abstracted and, as a result, some of the 4Ts categorizations changed from the original study such that there were some instances where single categorizations changed to multiple in this update (eg, Contratto, 2016).²⁹ Eleven of the studies included in the subgroup analysis were conference abstracts and abstraction details were limited. When assessing the impact of the interventions, only 12 studies with statistical results should be used to compile summation of meaningful positive burnout outcomes—most studies did not conduct statistical analyses or only provided qualitative findings. Many lean methodologies were identified to examine the digital environment efficiency and impact on workflows, but few captured relevant burnout outcomes to meet inclusion criteria.

CONCLUSION

Interventions designed to optimize technologies, training, and workflows may shift physician burnout to resilience. Factors that contribute significantly to the burden of the digital environment in healthcare include clinical specialty, practice setting, requirements for compliance and reimbursement, and how physicians spend their time. EHR optimization is an effective strategy for mitigating physician burnout, but EHR implementations alone do not improve and may worsen burnout. Comprehensive and appropriately timed training can reduce the stress associated with the introduction of new technologies, including EHRs, but often is not provided. Improvements to address burnout also need to need to consider the larger ecosystem including the organization, the marketplace, and regulatory policies. Workflow redesign and lean methodologies can also be leveraged to reduce the time physicians spend using digital tools and to shift these responsibilities to other care team members. These interventions can improve efficiency and job satisfaction. This study has identified several strategies that can mitigate burnout for physicians; additional research is needed to address the impact of digital tools for other types of clinicians in healthcare settings.

This study is an updated systematic review and subgroup analysis of a previously published systematic review.¹⁰ From top to bottom description, the primary inclusion criteria required: 1) the study to provide examination of licensed physicians at any career level (eg, trainees and attendings), field (eg, primary, secondary, or mixed) and practice setting (eg, private, academic, government), and 2) study outcomes had to report at least 1 burnout or burnout-proxy measure. Burnout included overall burnout, emotional exhaustion, cynicism, depersonalization, and lack of personal accomplishment. Burnout-proxy measures included satisfaction (eg, physician satisfaction, job satisfaction, joy of practice, and well-being) and stress (eg, general stress, psychological strain, and job distress). Studies had to provide comparisons with no interventions, whereby interventions were limited to organization-directed interventions that related to work, the workplace, or workflow and were categorized into 1 or multiple categories of the 4Ts framework: technology, time, teamwork, and transitions. Technology referred to the implementation or improvement of health information technology, namely EHRs. Time studies involved duty hour restrictions and changes to work schedules or use of time on duty (eg, a program for mindfulness during on-duty time). Teamwork regarded the examination of care team processes and the addition of scribes to the team. Transitions included process improvements and quality initiatives. To identify studies that targeted electronic tool burden and/or its workflow inefficiencies, a subgroup analysis of the identified 4Ts interventions was conducted. The objective of this subgroup analysis was to determine successful interventions that lessened (ie, reduce burnout, improve satisfaction, or decrease stress for physicians) the burden of the digital environment.

Disposition of articles identified from database search queries, the grey literature, and hand searches of included studies, including tracking of articles through the screening phases with reasons provided for full-text exclusions and number of included studies.

The size of each bubble represents the number (n) of studies identified for each 4Ts intervention type—time (light blue), teamwork (medium blue), transitions (dark blue), and technology (navy). Notably, studies were commonly stratified to more than 1 intervention categorization. The x-axis represents the proportion of studies with a positive impact on burnout or 1 of its proxy measures of stress and/or satisfaction. The y-axis represents the proportion of studies designated as high-quality (IA, IIA, or IIB) by the Oxford Levels of Evidence.¹³

CONSENT FOR PUBLICATION

All authors have approved this manuscript content for submission.

FUNDING

This research study was supported by IBM Watson Health.

AUTHOR CONTRIBUTIONS

Conceptualization: KJTC, GPJ, KR. Formal analysis: KJTC, VCW. Methodology: KJTC. Project administration, supervision: KJTC. Validation: KJTC, VCW. Writing original draft: KJTC, VCW, DG, GPJ. Review and editing: all authors.

ETHICS APPROVAL

No human participants were involved in the study.

DATA AVAILABILITY

The data underlying this article are available in the article and in its online supplementary material.

SUPPLEMENTARY MATERIAL

Supplementary material is available at Journal of the American Medical Informatics Association online.

Supplementary Material

ocaa301_Supplementary_Data

Click here for additional data file.^{(515.6KB, docx)}

ACKNOWLEDGMENTS

We would like to thank Annabel Acs, Talia Boulanger, Jane Snowdon, Paul DeChant, Christine Sinsky, and Michael Tutty for their contributions to the original work that has been updated in this study.

CONFLICT OF INTEREST STATEMENT

All authors are employed by IBM Corporation. The authors have no conflicts germane to this study.

REFERENCES

1. Dyrbye LN, Shanafelt TD, Sinsky CA, et al. ; Mayo Clinic. Burnout among health care professionals: a call to explore and address this underrecognized threat to safe, high-quality care. NAM Perspect 2017; 7 (7). https://nam.edu/burnout-among-health-care-professionals-a-call-to-explore-and-address-this-underrecognized-threat-to-safe-high-quality-care/. Accessed November 12, 2020. [Google Scholar]
2. Jones GM, Roe NA, Louden L, et al. Factors associated with burnout among us hospital clinical pharmacy practitioners: results of a nationwide pilot survey. Hosp Pharm 2017; 52 (11): 742–51. [DOI] [PMC free article] [PubMed] [Google Scholar]
3. Restauri N, Sheridan AD.. Burnout and posttraumatic stress disorder in the coronavirus disease 2019 (COVID-19) pandemic: intersection, impact, and interventions. J Am Coll Radiol 2020; doi: 10.1016/j.jacr.2020.05.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
4. Tutty MA, Carlasare LE, Lloyd S, et al. The complex case of EHRs: examining the factors impacting the EHR user experience. J Am Med Inform Assoc 2019; 26 (7): 673–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
5. Walker JM, Carayon P, Leveson N, et al. EHR safety: the way forward to safe and effective systems. J Am Med Inform Assoc 2008; 15 (3): 272–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
6. Khairat S, Coleman C, Ottmar P, et al. Association of electronic health record use with physician fatigue and efficiency. JAMA Netw Open 2020; 3 (6): e207385. [DOI] [PMC free article] [PubMed] [Google Scholar]
7. Kroth PJ, Morioka-Douglas N, Veres S, et al. Association of electronic health record design and use factors with clinician stress and burnout. JAMA Netw Open 2019; 2 (8): e199609. [DOI] [PMC free article] [PubMed] [Google Scholar]
8. Holden RJ. Cognitive performance-altering effects of electronic medical records: An application of the human factors paradigm for patient safety. Cogn Tech Work 2011; 13 (1): 11–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
9. Sinsky CA, Privitera MR.. Creating a “Manageable Cockpit” for clinicians: a shared responsibility. JAMA Intern Med 2018; 178 (6): 741–2. [DOI] [PubMed] [Google Scholar]
10. DeChant PF, Acs A, Rhee KB, et al. Effect of organization-directed workplace interventions on physician burnout: a systematic review. Mayo Clin Proc Innov Qual Outcomes 2019; 3 (4): 384–408. [DOI] [PMC free article] [PubMed] [Google Scholar]
11. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009; 151 (4): 264–9. [DOI] [PubMed] [Google Scholar]
12. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med 2012; 22 (3): 276–82. [PMC free article] [PubMed] [Google Scholar]
13.Oxford Centre for Evidence-based Medicine: Levels of Evidence (March 2009). 2009. https://www.cebm.ox.ac.uk/resources/levels-of-evidence/oxford-centre-for-evidence-based-medicine-levels-of-evidence-march-2009 Accessed November 12, 2020.
14. Agha Z, Roter D, Laud P, et al. Patient-centered communication and physicians use of electronic medical records. J Gen Intern Med 2010; 25 (Suppl 3): S344. [Google Scholar]
15. Albadry AA, Sleem AN, Montasser NA, et al. Effect of quality improvement intervention on occupational burnout in Mansoura University Hospitals, Egypt. In: proceedings of the WELL-Med Conference May 28–June1, 2014; Alexandroupolis, Greece.
16. Ali NA, Wolf KM, Hammersley J, et al. ; on behalf of the Midwest Critical Care Consortium. Continuity of care in intensive care units: a cluster-randomized trial of intensivist staffing. Am J Respir Crit Care Med 2011; 184 (7): 803–8. [DOI] [PubMed] [Google Scholar]
17. Amis SM, Osicki THE.. Can patient safety be improved by reducing the volume of “inappropriate prescribing tasks” handed over to out-of-hours junior doctors? Int J Gen Med 2018; 11: 105–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
18. Amutio A, Martínez-Taboada C, Delgado LC, et al. Acceptability and effectiveness of a long-term educational intervention to reduce physicians' stress-related conditions. J Contin Educ Health Prof 2015; 35 (4): 255–60. [DOI] [PubMed] [Google Scholar]
19. Ares WJ, Maroon JC, Jankowitz BT.. In pursuit of balance: the UPMC neurosurgery wellness initiative. World Neurosurg 2019; 132: e704–9. [DOI] [PubMed] [Google Scholar]
20. Babbott S, Manwell LB, Brown R, et al. Electronic medical records and physician stress in primary care: results from the MEMO Study. J Am Med Inform Assoc 2014;21(e1):e100–e106. [DOI] [PMC free article] [PubMed] [Google Scholar]
21. Baccei SJ, Henderson SR, Lo HS, et al. Using quality improvement methodology to reduce costs while improving efficiency and provider satisfaction in a busy, academic musculoskeletal radiology division. J Med Syst 2020; 44 (6): 104. [DOI] [PubMed] [Google Scholar]
22. Beam KS, Cardoso M, Sweeney M, et al. Examining perceptions of computerized physician order entry in a neonatal intensive care unit. Appl Clin Inform 2017; 08 (02): 337–47. [DOI] [PMC free article] [PubMed] [Google Scholar]
23. Bragard I, Etienne AM, Merckaert I, et al. Efficacy of a communication and stress management training on medical residents’ self-efficacy, stress to communicate and burnout: a randomized controlled study. J Health Psychol 2010; 15 (7): 1075–81. [DOI] [PubMed] [Google Scholar]
24. Butow P, Brown R, Aldridge J, et al. Can consultation skills training change doctors’ behaviour to increase involvement of patients in making decisions about standard treatment and clinical trials: a randomized controlled trial. Health Expect 2015; 18 (6): 2570–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
25. Butow P, Cockburn J, Girgis A, et al. ; the CUES Team. Increasing oncologists’ skills in eliciting and responding to emotional cues: evaluation of a communication skills training program. Psycho-Oncol 2008; 17 (3): 209–18. [DOI] [PubMed] [Google Scholar]
26. Callahan S, Enfield KB, Sturek J, et al. An innovative, evidence-based, fellow-driven bundle to improve professional satisfaction and wellness. Am J Respir Crit Care Med 2018; 197: A4498. [Google Scholar]
27. Chapman SA, Blash LK.. New roles for medical assistants in innovative primary care practices. Health Serv Res 2017; 52 (Suppl 1): 383–406. [DOI] [PMC free article] [PubMed] [Google Scholar]
28. Contratto E, Romp K, Estrada CA, et al. Physician order entry clerical support improves physician satisfaction and productivity. South Med J 2017; 110 (5): 363–8. [DOI] [PubMed] [Google Scholar]
29. Contratto EC, Estrada C, Romp KG, et al. The impact of physician order entry clerical support on physician satisfaction and productivity. J Gen Intern Med 2016; 31 (2 Suppl 1): S912–3. [DOI] [PubMed] [Google Scholar]
30. Danila MI, Melnick JA, Curtis JR, et al. Use of scribes for documentation assistance in rheumatology and endocrinology clinics: impact on clinic workflow and patient and physician satisfaction. J Clin Rheumatol 2018; 24 (3): 116–21. [DOI] [PubMed] [Google Scholar]
31. Desai SV, Asch DA, Bellini LM, et al. Education outcomes in a duty-hour flexibility trial in internal medicine. N Engl J Med 2018; 378 (16): 1494–508. [DOI] [PMC free article] [PubMed] [Google Scholar]
32. Dunn PM, Arnetz BB, Christensen JF, et al. Meeting the imperative to improve physician well-being: assessment of an innovative program. J Gen Intern Med 2007; 22 (11): 1544–52. [DOI] [PMC free article] [PubMed] [Google Scholar]
33. Dyrbye LN, Shanafelt TD, Gill PR, et al. Effect of a professional coaching intervention on the well-being and distress of physicians: a pilot randomized clinical trial. JAMA Intern Med 2019; 179 (10): 1406. [DOI] [PMC free article] [PubMed] [Google Scholar]
34. Dyrbye LN, West CP, Richards ML, et al. A randomized, controlled study of an online intervention to promote job satisfaction and well-being among physicians. Burnout Res 2016; 3 (3): 69–75. [Google Scholar]
35. Ehrlich JR, Michelotti M, Blachley TS, et al. A two-year longitudinal assessment of ophthalmologists’ perceptions after implementing an electronic health record system. Appl Clin Inform 2016; 07 (04): 930–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
36. Fassiotto MA. A time banking system to support workplace flexibility. In: proceedings of the International Conference on Physician Health; September 18–20, 2016; Boston, MA.
37. Garland A, Roberts D, Graff L.. Twenty-four–hour intensivist presence: a pilot study of effects on intensive care unit patients, families, doctors, and nurses. Am J Respir Crit Care Med 2012; 185 (7): 738–43. [DOI] [PubMed] [Google Scholar]
38. Giannini A, Miccinesi G, Prandi E, et al. ; The ODIN Study Group. Partial liberalization of visiting policies and ICU staff: a before-and-after study. Intensive Care Med 2013; 39 (12): 2180–7. [DOI] [PubMed] [Google Scholar]
39. Gidwani R, Nguyen C, Kofoed A, et al. Impact of scribes on physician satisfaction, patient satisfaction, and charting efficiency: a randomized controlled trial. Ann Fam Med 2017; 15 (5): 427–33. [DOI] [PMC free article] [PubMed] [Google Scholar]
40. Goodman MJ, Schorling JB.. A mindfulness course decreases burnout and improves well-being among healthcare providers. Int J Psychiatry Med 2012; 43 (2): 119–28. [DOI] [PubMed] [Google Scholar]
41. Goyal P, Cohen-Mekelburg S, Egan C, et al. New uses of old technology: can nurse-pagers improve communication between resident-physicians and nurses. Appl Nurs Res 2018; 44: 1–5. [DOI] [PubMed] [Google Scholar]
42. Hart D, Paetow G, Zarzar R.. Does implementation of a corporate wellness initiative improve burnout? WestJEM 2018; 20 (1): 138–44. [DOI] [PMC free article] [PubMed] [Google Scholar]
43. Heaton HA, Castaneda-Guarderas A, Trotter ER, et al. Effect of scribes on patient throughput, revenue, and patient and provider satisfaction: a systematic review and meta-analysis. Am J Emerg Med 2016; 34 (10): 2018–28. [DOI] [PubMed] [Google Scholar]
44. Heyworth L, Zhang F, Jenter CA, et al. Physician satisfaction following electronic health record adoption in three Massachusetts communities. Interact J Med Res 2012; 1 (2): e12. [DOI] [PMC free article] [PubMed] [Google Scholar]
45. Hung DY, Harrison MI, Truong Q, et al. Experiences of primary care physicians and staff following lean workflow redesign. BMC Health Serv Res 2018; 18 (1): 274. [DOI] [PMC free article] [PubMed] [Google Scholar]
46. Imdieke BH, Martel ML.. Integration of medical scribes in the primary care setting: improving satisfaction. J Ambul Care Manage 2017; 40 (1): 17–25. [DOI] [PubMed] [Google Scholar]
47. Ireland MJ, Clough B, Gill K, et al. A randomized controlled trial of mindfulness to reduce stress and burnout among intern medical practitioners. Med Teach 2017; 39 (4): 409–14. [DOI] [PubMed] [Google Scholar]
48. Isaksson Ro KE, Tyssen R, Hoffart A, et al. A three-year cohort study of the relationships between coping, job stress and burnout after a counselling intervention for help-seeking physicians. BMC Public Health 2010; 10 (1): 213. [DOI] [PMC free article] [PubMed] [Google Scholar]
49. Joseph C. Rebooting the joy of practice = clinical/operational leadership + workflow standardization + technology. In: American Conference on Physician Health. San Francisco, CA; October 12–13, 2017: 29–30.
50. Kakarala R, Smith SJ, Barreto E, et al. When coaching meets mentoring: impact of incorporating coaching into an existing mentoring program at a community hospital. Cureus 2018; 10 (8): e3138. [DOI] [PMC free article] [PubMed] [Google Scholar]
51. Keefer L, Beck M., O’Hara C.. Lean in: Our secrets to decreasing provider stress, maximizing efficiency on a pediatric hospitalist service. J Hosp Med 2018; 13 (4). [Google Scholar]
52. Kim H, Wiedermann B.. Have Accreditation Council for Graduate Medical Education duty hour limits made a difference? A re-examination of resident sleep, mental health, education, and safety seven years later. J Invest Med 2011;59(3):630–1. [Google Scholar]
53. Koshy S, Feustel PJ, Hong M, et al. Scribes in an ambulatory urology practice: patient and physician satisfaction. J Urol 2010; 184 (1): 258–62. [DOI] [PubMed] [Google Scholar]
54. Krasner MS, Epstein RM, Beckman H, et al. Association of an educational program in mindful communication with burnout, empathy, and attitudes among primary care physicians. JAMA 2009; 302 (12): 1284–93. [DOI] [PubMed] [Google Scholar]
55. Landrigan CP, Fahrenkopf AM, Lewin D, et al. Effects of the accreditation council for graduate medical education duty hour limits on sleep, work hours, and safety. Pediatrics 2008; 122 (2): 250–8. [DOI] [PubMed] [Google Scholar]
56. Lapointe R, Bhesania S, Tanner T, et al. An innovative approach to improve communication and reduce physician stress and burnout in a university affiliated residency program. J Med Syst 2018; 42 (7): 117. [DOI] [PubMed] [Google Scholar]
57. Lee MH, Schemmel AJ, Pooler BD, et al. Radiology workflow dynamics: how workflow patterns impact radiologist perceptions of workplace satisfaction. Acad Radiol 2017; 24 (4): 483–7. [DOI] [PubMed] [Google Scholar]
58. Linzer M, Poplau S, Brown R, et al. Do work condition interventions affect quality and errors in primary care? Results from the healthy work place study. J Gen Intern Med 2017; 32 (1): 56–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
59. Linzer M, Poplau S, Grossman E, et al. A cluster randomized trial of interventions to improve work conditions and clinician burnout in primary care: results from the Healthy Work Place (HWP) study. J Gen Intern Med 2015; 30 (8): 1105–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
60. Lucas BP, Trick WE, Evans AT, et al. Effects of 2-vs 4-week attending physician inpatient rotations on unplanned patient revisits, evaluations by trainees, and attending physician burnout: a randomized trial. JAMA 2012; 308 (21): 2199–207. [DOI] [PubMed] [Google Scholar]
61. Martins AE, Davenport MC, Paz Del Valle M, et al. Impact of a brief intervention on the burnout levels of pediatric residents. J Pediatr (Rio J) 2011; 87 (6): 493–8. [DOI] [PubMed] [Google Scholar]
62. Mazur LM, Mosaly PR, Moore C, et al. Association of the usability of electronic health records with cognitive workload and performance levels among physicians. JAMA Netw Open 2019; 2 (4): e191709. [DOI] [PMC free article] [PubMed] [Google Scholar]
63. McCormick BJ, Deal A, Borawski KM, et al. Implementation of medical scribes in an academic urology practice: an analysis of productivity, revenue, and satisfaction. World J Urol 2018; 36 (10): 1691–7. [DOI] [PubMed] [Google Scholar]
64. Mehta S, Johnston R, Yadav S, et al. Scribes in hospital medicine-a powerful value-added resource! J Hosp Med 2018; 13 (4):Abstract 223. [Google Scholar]
65. Menachemi N, Powers TL, Brooks RG.. The role of information technology usage in physician practice satisfaction. Health Care Manage Rev 2009; 34 (4): 364–71. [DOI] [PubMed] [Google Scholar]
66. Michelotti M, Weizer J, Blachley T, et al. Ophthalmologists' attitudes on implementing an electronic health record system. Invest Ophthalmol Vis Sci 2013; 54 (15). [Google Scholar]
67. Milenkiewicz RV. The less clicks the better: Improving the documentation workflow process for physicians. In: proceedings of the American Conference on Physician Health; October 12–13, 2017; San Francisco, CA.
68. Milstein JM, Raingruber BJ, Bennett SH, et al. Burnout assessment in house officers: evaluation of an intervention to reduce stress. Med Teach 2009; 31 (4): 338–41. [DOI] [PubMed] [Google Scholar]
69. Minichiello V, Hayer S, Gillespie B, et al. Developing a Mindfulness Skills-Based Training Program for Resident Physicians. Fam Med 2020; 52 (1): 48–52. [DOI] [PubMed] [Google Scholar]
70. Mishra P, Kiang JC, Grant RW.. Association of medical scribes in primary care with physician workflow and patient experience. JAMA Intern Med 2018; 178 (11): 1467–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
71. Moeller MF. Practice Refresh: A 1-month intervention to rebuild physician efficiency and wellness. In: American Conference on Physician Health; October 12–13, 2017; San Francisco, CA.
72. Moffatt-Bruce SD, Nguyen MC, Steinberg B, et al. Interventions to reduce burnout and improve resilience: impact on a health system's outcomes. Clin Obstet Gynecol 2019; 62 (3): 432–43. [DOI] [PubMed] [Google Scholar]
73. Morrow G, Burford B, Carter M, et al. Have restricted working hours reduced junior doctors' experience of fatigue? A focus group and telephone interview study. BMJ Open 2014; 4 (3): e004222. [DOI] [PMC free article] [PubMed] [Google Scholar]
74. Parshuram CS, Amaral ACKB, Ferguson ND, et al. Patient safety, resident well-being and continuity of care with different resident duty schedules in the intensive care unit: a randomized trial. CMAJ 2015; 187 (5): 321–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
75. Payne TH, Alonso WD, Markiel JA, et al. Using voice to create inpatient progress notes: effects on note timeliness, quality, and physician satisfaction. JAMIA Open 2018; 1 (2): 218–26. [DOI] [PMC free article] [PubMed] [Google Scholar]
76. Pierce RG. A team-based and organizational framework for fostering resilience and well-being in academic hospital medicine. In: proceedings of the American Conference on Physician Health; October 12–13, 2017; San Francisco, CA.
77. Pozdnyakova A, Laiteerapong N, Volerman A, et al. Impact of medical scribes on physician and patient satisfaction in primary care. J Gen Intern Med 2018; 33 (7): 1109–15. [DOI] [PMC free article] [PubMed] [Google Scholar]
78. Quenot J-P, Rigaud J-P, Prin S, et al. Suffering among carers working in critical care can be reduced by an intensive communication strategy on end-of-life practices. Intensive Care Med 2012; 38 (1): 55–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
79. Ripp JA, Bellini L, Fallar R, et al. The impact of duty hours restrictions on job burnout in internal medicine residents: a three-institution comparison study. Acad Med 2015; 90 (4): 494–9. [DOI] [PubMed] [Google Scholar]
80. Runyan C, Savageau JA, Potts S, et al. Impact of a family medicine resident wellness curriculum: a feasibility study. Med Educ Online 2016; 21 (1): 30648. [DOI] [PMC free article] [PubMed] [Google Scholar]
81. Safavi A, Sienna J, Strang BK, et al. Characterizing the initiation, completion, and integration of entrustable professional activity assessments in radiation oncology residency training and clinical workflow: an institutional pilot of competence by design. Radiother Oncol 2019; 139: S85. [Google Scholar]
82. Schuh LA, Khan MA, Harle H, et al. Pilot trial of IOM duty hour recommendations in neurology residency programs Unintended consequences. Neurology 2011; 77 (9): 883–7. [DOI] [PubMed] [Google Scholar]
83. Shaw JG, Brown-Johnson C, Chan G, et al. Physician burnout and joy of practice: Early mixed methods findings from the implementation of Stanford primary care 2.0. J Gen Intern Med 2017; 32 (2 Suppl 1): S272. [Google Scholar]
84. Shea JA, Bellini LM, Dinges DF, et al. Impact of protected sleep period for internal medicine interns on overnight call on depression, burnout, and empathy. J Grad Med Educ 2014; 6 (2): 256–63. [DOI] [PMC free article] [PubMed] [Google Scholar]
85. Sherlock C, John C.. Adaptation Practice: Teaching doctors how to cope with stress, anxiety and depression by developing resilience. Br J Med Pract 2016; 9 (2): a916. [Google Scholar]
86. Shultz CG, Holmstrom HL.. The use of medical scribes in health care settings: a systematic review and future directions. J Am Board Fam Med 2015; 28 (3): 371–81. [DOI] [PubMed] [Google Scholar]
87. Sood A, Prasad K, Schroeder D, et al. Stress management and resilience training among Department of Medicine faculty: a pilot randomized clinical trial. J Gen Intern Med 2011; 26 (8): 858–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
88. Tucker P, Brown M, Dahlgren A, et al. The impact of junior doctors. Scand J Work Environ Health 2010; 36 (6): 458–65. [DOI] [PubMed] [Google Scholar]
89. Verweij H, Waumans RC, Smeijers D, et al. Mindfulness-based stress reduction for GPs: results of a controlled mixed methods pilot study in Dutch primary care. Br J Gen Pract 2016; 66 (643): e99–105. [DOI] [PMC free article] [PubMed] [Google Scholar]
90. Was A. The ideal gas lounge: boosting resident happiness with empowerment and common space improvements. In: proceedings of the International Conference on Physician Health; September 18–20, 2016; Boston, MA.
91. West CP, Dyrbye LN, Rabatin JT, et al. Intervention to promote physician well-being, job satisfaction, and professionalism: a randomized clinical trial. JAMA Intern Med 2014; 174 (4): 527–33. [DOI] [PubMed] [Google Scholar]
92. Willard-Grace R. Clinician perception of team support, burnout and “doability” of primary care. In: proceedings of the American Conference on Physician Health; October 12–13, 2017; San Francisco, CA.
93. Wylie MC, Baier RR, Gardner RL.. Perceptions of electronic health record implementation: a statewide survey of physicians in Rhode Island. Am J Med 2014; 127 (10): 1010.e21–27. [DOI] [PubMed] [Google Scholar]
94. Maslach C, Jackson SE.. The measurement of experienced burnout. J Organiz Behav 1981; 2 (2): 99–113. [Google Scholar]
95. Kokkonen EW, Davis SA, Lin HC, et al. Use of electronic medical records differs by specialty and office settings. J Am Med Inform Assoc 2013; 20 (e1): e33–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
96. Hayt DB, Alexander S.. The pros and cons of implementing PACS and speech recognition systems. J Digit Imaging 2001; 14 (3): 149–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
97. Fleming NS, Becker ER, Culler SD, et al. The impact of electronic health records on workflow and financial measures in primary care practices. Health Serv Res 2014; 49 (1, Pt 2): 405–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
98. Tai-Seale M, Dillon EC, Yang Y, et al. Physicians' well-being linked to in-basket messages generated by algorithms in electronic health records. Health Aff (Millwood) 2019; 38 (7): 1073–8. [DOI] [PubMed] [Google Scholar]
99. Tarafdar M, Tu Q, Ragu-Nathan BS, et al. The impact of technostress on role stress and productivity. J Manage Inf Syst 2007; 24 (1): 301–28. [Google Scholar]
100. Downing NL, Bates DW, Longhurst CA.. Physician burnout in the electronic health record era: are we ignoring the real cause? Ann Intern Med 2018; 169 (1): 50–1. [DOI] [PubMed] [Google Scholar]
101. Pirtle CJ, Reeder RR, Lehmann CU, et al. Physician perspectives on training for an EHR implementation. Stud Health Technol Inform 2019; 264: 1318–22. [DOI] [PubMed] [Google Scholar]
102. Ratwani R, Fairbanks T, Savage E, et al. Mind the gap. a systematic review to identify usability and safety challenges and practices during electronic health record implementation. Appl Clin Inform 2016; 07 (04): 1069–87. [DOI] [PMC free article] [PubMed] [Google Scholar]
103. Quiroz JC, Laranjo L, Kocaballi AB, et al. Challenges of developing a digital scribe to reduce clinical documentation burden. NPJ Digit Med 2019; 2: 114. [DOI] [PMC free article] [PubMed] [Google Scholar]
104.National Academies of Sciences, Engineering, and Medicine. Taking Action against Clinician Burnout: A Systems Approach to Professional Well-Being. Washington, DC: The National Academies Press; 2019. [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ocaa301_Supplementary_Data

Click here for additional data file.^{(515.6KB, docx)}

Data Availability Statement

The data underlying this article are available in the article and in its online supplementary material.

[ocaa301-B1] 1. Dyrbye LN, Shanafelt TD, Sinsky CA, et al. ; Mayo Clinic. Burnout among health care professionals: a call to explore and address this underrecognized threat to safe, high-quality care. NAM Perspect 2017; 7 (7). https://nam.edu/burnout-among-health-care-professionals-a-call-to-explore-and-address-this-underrecognized-threat-to-safe-high-quality-care/. Accessed November 12, 2020. [Google Scholar]

[ocaa301-B2] 2. Jones GM, Roe NA, Louden L, et al. Factors associated with burnout among us hospital clinical pharmacy practitioners: results of a nationwide pilot survey. Hosp Pharm 2017; 52 (11): 742–51. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B3] 3. Restauri N, Sheridan AD.. Burnout and posttraumatic stress disorder in the coronavirus disease 2019 (COVID-19) pandemic: intersection, impact, and interventions. J Am Coll Radiol 2020; doi: 10.1016/j.jacr.2020.05.021 [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B4] 4. Tutty MA, Carlasare LE, Lloyd S, et al. The complex case of EHRs: examining the factors impacting the EHR user experience. J Am Med Inform Assoc 2019; 26 (7): 673–7. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B5] 5. Walker JM, Carayon P, Leveson N, et al. EHR safety: the way forward to safe and effective systems. J Am Med Inform Assoc 2008; 15 (3): 272–7. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B6] 6. Khairat S, Coleman C, Ottmar P, et al. Association of electronic health record use with physician fatigue and efficiency. JAMA Netw Open 2020; 3 (6): e207385. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B7] 7. Kroth PJ, Morioka-Douglas N, Veres S, et al. Association of electronic health record design and use factors with clinician stress and burnout. JAMA Netw Open 2019; 2 (8): e199609. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B8] 8. Holden RJ. Cognitive performance-altering effects of electronic medical records: An application of the human factors paradigm for patient safety. Cogn Tech Work 2011; 13 (1): 11–29. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B9] 9. Sinsky CA, Privitera MR.. Creating a “Manageable Cockpit” for clinicians: a shared responsibility. JAMA Intern Med 2018; 178 (6): 741–2. [DOI] [PubMed] [Google Scholar]

[ocaa301-B10] 10. DeChant PF, Acs A, Rhee KB, et al. Effect of organization-directed workplace interventions on physician burnout: a systematic review. Mayo Clin Proc Innov Qual Outcomes 2019; 3 (4): 384–408. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B11] 11. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009; 151 (4): 264–9. [DOI] [PubMed] [Google Scholar]

[ocaa301-B12] 12. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med 2012; 22 (3): 276–82. [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B13] 13.Oxford Centre for Evidence-based Medicine: Levels of Evidence (March 2009). 2009. https://www.cebm.ox.ac.uk/resources/levels-of-evidence/oxford-centre-for-evidence-based-medicine-levels-of-evidence-march-2009 Accessed November 12, 2020.

[ocaa301-B14] 14. Agha Z, Roter D, Laud P, et al. Patient-centered communication and physicians use of electronic medical records. J Gen Intern Med 2010; 25 (Suppl 3): S344. [Google Scholar]

[ocaa301-B15] 15. Albadry AA, Sleem AN, Montasser NA, et al. Effect of quality improvement intervention on occupational burnout in Mansoura University Hospitals, Egypt. In: proceedings of the WELL-Med Conference May 28–June1, 2014; Alexandroupolis, Greece.

[ocaa301-B16] 16. Ali NA, Wolf KM, Hammersley J, et al. ; on behalf of the Midwest Critical Care Consortium. Continuity of care in intensive care units: a cluster-randomized trial of intensivist staffing. Am J Respir Crit Care Med 2011; 184 (7): 803–8. [DOI] [PubMed] [Google Scholar]

[ocaa301-B17] 17. Amis SM, Osicki THE.. Can patient safety be improved by reducing the volume of “inappropriate prescribing tasks” handed over to out-of-hours junior doctors? Int J Gen Med 2018; 11: 105–12. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B18] 18. Amutio A, Martínez-Taboada C, Delgado LC, et al. Acceptability and effectiveness of a long-term educational intervention to reduce physicians' stress-related conditions. J Contin Educ Health Prof 2015; 35 (4): 255–60. [DOI] [PubMed] [Google Scholar]

[ocaa301-B19] 19. Ares WJ, Maroon JC, Jankowitz BT.. In pursuit of balance: the UPMC neurosurgery wellness initiative. World Neurosurg 2019; 132: e704–9. [DOI] [PubMed] [Google Scholar]

[ocaa301-B20] 20. Babbott S, Manwell LB, Brown R, et al. Electronic medical records and physician stress in primary care: results from the MEMO Study. J Am Med Inform Assoc 2014;21(e1):e100–e106. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B21] 21. Baccei SJ, Henderson SR, Lo HS, et al. Using quality improvement methodology to reduce costs while improving efficiency and provider satisfaction in a busy, academic musculoskeletal radiology division. J Med Syst 2020; 44 (6): 104. [DOI] [PubMed] [Google Scholar]

[ocaa301-B22] 22. Beam KS, Cardoso M, Sweeney M, et al. Examining perceptions of computerized physician order entry in a neonatal intensive care unit. Appl Clin Inform 2017; 08 (02): 337–47. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B23] 23. Bragard I, Etienne AM, Merckaert I, et al. Efficacy of a communication and stress management training on medical residents’ self-efficacy, stress to communicate and burnout: a randomized controlled study. J Health Psychol 2010; 15 (7): 1075–81. [DOI] [PubMed] [Google Scholar]

[ocaa301-B24] 24. Butow P, Brown R, Aldridge J, et al. Can consultation skills training change doctors’ behaviour to increase involvement of patients in making decisions about standard treatment and clinical trials: a randomized controlled trial. Health Expect 2015; 18 (6): 2570–83. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B25] 25. Butow P, Cockburn J, Girgis A, et al. ; the CUES Team. Increasing oncologists’ skills in eliciting and responding to emotional cues: evaluation of a communication skills training program. Psycho-Oncol 2008; 17 (3): 209–18. [DOI] [PubMed] [Google Scholar]

[ocaa301-B26] 26. Callahan S, Enfield KB, Sturek J, et al. An innovative, evidence-based, fellow-driven bundle to improve professional satisfaction and wellness. Am J Respir Crit Care Med 2018; 197: A4498. [Google Scholar]

[ocaa301-B27] 27. Chapman SA, Blash LK.. New roles for medical assistants in innovative primary care practices. Health Serv Res 2017; 52 (Suppl 1): 383–406. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B28] 28. Contratto E, Romp K, Estrada CA, et al. Physician order entry clerical support improves physician satisfaction and productivity. South Med J 2017; 110 (5): 363–8. [DOI] [PubMed] [Google Scholar]

[ocaa301-B29] 29. Contratto EC, Estrada C, Romp KG, et al. The impact of physician order entry clerical support on physician satisfaction and productivity. J Gen Intern Med 2016; 31 (2 Suppl 1): S912–3. [DOI] [PubMed] [Google Scholar]

[ocaa301-B30] 30. Danila MI, Melnick JA, Curtis JR, et al. Use of scribes for documentation assistance in rheumatology and endocrinology clinics: impact on clinic workflow and patient and physician satisfaction. J Clin Rheumatol 2018; 24 (3): 116–21. [DOI] [PubMed] [Google Scholar]

[ocaa301-B31] 31. Desai SV, Asch DA, Bellini LM, et al. Education outcomes in a duty-hour flexibility trial in internal medicine. N Engl J Med 2018; 378 (16): 1494–508. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B32] 32. Dunn PM, Arnetz BB, Christensen JF, et al. Meeting the imperative to improve physician well-being: assessment of an innovative program. J Gen Intern Med 2007; 22 (11): 1544–52. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B33] 33. Dyrbye LN, Shanafelt TD, Gill PR, et al. Effect of a professional coaching intervention on the well-being and distress of physicians: a pilot randomized clinical trial. JAMA Intern Med 2019; 179 (10): 1406. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B34] 34. Dyrbye LN, West CP, Richards ML, et al. A randomized, controlled study of an online intervention to promote job satisfaction and well-being among physicians. Burnout Res 2016; 3 (3): 69–75. [Google Scholar]

[ocaa301-B35] 35. Ehrlich JR, Michelotti M, Blachley TS, et al. A two-year longitudinal assessment of ophthalmologists’ perceptions after implementing an electronic health record system. Appl Clin Inform 2016; 07 (04): 930–45. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B36] 36. Fassiotto MA. A time banking system to support workplace flexibility. In: proceedings of the International Conference on Physician Health; September 18–20, 2016; Boston, MA.

[ocaa301-B37] 37. Garland A, Roberts D, Graff L.. Twenty-four–hour intensivist presence: a pilot study of effects on intensive care unit patients, families, doctors, and nurses. Am J Respir Crit Care Med 2012; 185 (7): 738–43. [DOI] [PubMed] [Google Scholar]

[ocaa301-B38] 38. Giannini A, Miccinesi G, Prandi E, et al. ; The ODIN Study Group. Partial liberalization of visiting policies and ICU staff: a before-and-after study. Intensive Care Med 2013; 39 (12): 2180–7. [DOI] [PubMed] [Google Scholar]

[ocaa301-B39] 39. Gidwani R, Nguyen C, Kofoed A, et al. Impact of scribes on physician satisfaction, patient satisfaction, and charting efficiency: a randomized controlled trial. Ann Fam Med 2017; 15 (5): 427–33. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B40] 40. Goodman MJ, Schorling JB.. A mindfulness course decreases burnout and improves well-being among healthcare providers. Int J Psychiatry Med 2012; 43 (2): 119–28. [DOI] [PubMed] [Google Scholar]

[ocaa301-B41] 41. Goyal P, Cohen-Mekelburg S, Egan C, et al. New uses of old technology: can nurse-pagers improve communication between resident-physicians and nurses. Appl Nurs Res 2018; 44: 1–5. [DOI] [PubMed] [Google Scholar]

[ocaa301-B42] 42. Hart D, Paetow G, Zarzar R.. Does implementation of a corporate wellness initiative improve burnout? WestJEM 2018; 20 (1): 138–44. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B43] 43. Heaton HA, Castaneda-Guarderas A, Trotter ER, et al. Effect of scribes on patient throughput, revenue, and patient and provider satisfaction: a systematic review and meta-analysis. Am J Emerg Med 2016; 34 (10): 2018–28. [DOI] [PubMed] [Google Scholar]

[ocaa301-B44] 44. Heyworth L, Zhang F, Jenter CA, et al. Physician satisfaction following electronic health record adoption in three Massachusetts communities. Interact J Med Res 2012; 1 (2): e12. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B45] 45. Hung DY, Harrison MI, Truong Q, et al. Experiences of primary care physicians and staff following lean workflow redesign. BMC Health Serv Res 2018; 18 (1): 274. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B46] 46. Imdieke BH, Martel ML.. Integration of medical scribes in the primary care setting: improving satisfaction. J Ambul Care Manage 2017; 40 (1): 17–25. [DOI] [PubMed] [Google Scholar]

[ocaa301-B47] 47. Ireland MJ, Clough B, Gill K, et al. A randomized controlled trial of mindfulness to reduce stress and burnout among intern medical practitioners. Med Teach 2017; 39 (4): 409–14. [DOI] [PubMed] [Google Scholar]

[ocaa301-B48] 48. Isaksson Ro KE, Tyssen R, Hoffart A, et al. A three-year cohort study of the relationships between coping, job stress and burnout after a counselling intervention for help-seeking physicians. BMC Public Health 2010; 10 (1): 213. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B49] 49. Joseph C. Rebooting the joy of practice = clinical/operational leadership + workflow standardization + technology. In: American Conference on Physician Health. San Francisco, CA; October 12–13, 2017: 29–30.

[ocaa301-B50] 50. Kakarala R, Smith SJ, Barreto E, et al. When coaching meets mentoring: impact of incorporating coaching into an existing mentoring program at a community hospital. Cureus 2018; 10 (8): e3138. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B51] 51. Keefer L, Beck M., O’Hara C.. Lean in: Our secrets to decreasing provider stress, maximizing efficiency on a pediatric hospitalist service. J Hosp Med 2018; 13 (4). [Google Scholar]

[ocaa301-B52] 52. Kim H, Wiedermann B.. Have Accreditation Council for Graduate Medical Education duty hour limits made a difference? A re-examination of resident sleep, mental health, education, and safety seven years later. J Invest Med 2011;59(3):630–1. [Google Scholar]

[ocaa301-B53] 53. Koshy S, Feustel PJ, Hong M, et al. Scribes in an ambulatory urology practice: patient and physician satisfaction. J Urol 2010; 184 (1): 258–62. [DOI] [PubMed] [Google Scholar]

[ocaa301-B54] 54. Krasner MS, Epstein RM, Beckman H, et al. Association of an educational program in mindful communication with burnout, empathy, and attitudes among primary care physicians. JAMA 2009; 302 (12): 1284–93. [DOI] [PubMed] [Google Scholar]

[ocaa301-B55] 55. Landrigan CP, Fahrenkopf AM, Lewin D, et al. Effects of the accreditation council for graduate medical education duty hour limits on sleep, work hours, and safety. Pediatrics 2008; 122 (2): 250–8. [DOI] [PubMed] [Google Scholar]

[ocaa301-B56] 56. Lapointe R, Bhesania S, Tanner T, et al. An innovative approach to improve communication and reduce physician stress and burnout in a university affiliated residency program. J Med Syst 2018; 42 (7): 117. [DOI] [PubMed] [Google Scholar]

[ocaa301-B57] 57. Lee MH, Schemmel AJ, Pooler BD, et al. Radiology workflow dynamics: how workflow patterns impact radiologist perceptions of workplace satisfaction. Acad Radiol 2017; 24 (4): 483–7. [DOI] [PubMed] [Google Scholar]

[ocaa301-B58] 58. Linzer M, Poplau S, Brown R, et al. Do work condition interventions affect quality and errors in primary care? Results from the healthy work place study. J Gen Intern Med 2017; 32 (1): 56–61. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B59] 59. Linzer M, Poplau S, Grossman E, et al. A cluster randomized trial of interventions to improve work conditions and clinician burnout in primary care: results from the Healthy Work Place (HWP) study. J Gen Intern Med 2015; 30 (8): 1105–11. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B60] 60. Lucas BP, Trick WE, Evans AT, et al. Effects of 2-vs 4-week attending physician inpatient rotations on unplanned patient revisits, evaluations by trainees, and attending physician burnout: a randomized trial. JAMA 2012; 308 (21): 2199–207. [DOI] [PubMed] [Google Scholar]

[ocaa301-B61] 61. Martins AE, Davenport MC, Paz Del Valle M, et al. Impact of a brief intervention on the burnout levels of pediatric residents. J Pediatr (Rio J) 2011; 87 (6): 493–8. [DOI] [PubMed] [Google Scholar]

[ocaa301-B62] 62. Mazur LM, Mosaly PR, Moore C, et al. Association of the usability of electronic health records with cognitive workload and performance levels among physicians. JAMA Netw Open 2019; 2 (4): e191709. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B63] 63. McCormick BJ, Deal A, Borawski KM, et al. Implementation of medical scribes in an academic urology practice: an analysis of productivity, revenue, and satisfaction. World J Urol 2018; 36 (10): 1691–7. [DOI] [PubMed] [Google Scholar]

[ocaa301-B64] 64. Mehta S, Johnston R, Yadav S, et al. Scribes in hospital medicine-a powerful value-added resource! J Hosp Med 2018; 13 (4):Abstract 223. [Google Scholar]

[ocaa301-B65] 65. Menachemi N, Powers TL, Brooks RG.. The role of information technology usage in physician practice satisfaction. Health Care Manage Rev 2009; 34 (4): 364–71. [DOI] [PubMed] [Google Scholar]

[ocaa301-B66] 66. Michelotti M, Weizer J, Blachley T, et al. Ophthalmologists' attitudes on implementing an electronic health record system. Invest Ophthalmol Vis Sci 2013; 54 (15). [Google Scholar]

[ocaa301-B67] 67. Milenkiewicz RV. The less clicks the better: Improving the documentation workflow process for physicians. In: proceedings of the American Conference on Physician Health; October 12–13, 2017; San Francisco, CA.

[ocaa301-B68] 68. Milstein JM, Raingruber BJ, Bennett SH, et al. Burnout assessment in house officers: evaluation of an intervention to reduce stress. Med Teach 2009; 31 (4): 338–41. [DOI] [PubMed] [Google Scholar]

[ocaa301-B69] 69. Minichiello V, Hayer S, Gillespie B, et al. Developing a Mindfulness Skills-Based Training Program for Resident Physicians. Fam Med 2020; 52 (1): 48–52. [DOI] [PubMed] [Google Scholar]

[ocaa301-B70] 70. Mishra P, Kiang JC, Grant RW.. Association of medical scribes in primary care with physician workflow and patient experience. JAMA Intern Med 2018; 178 (11): 1467–72. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B71] 71. Moeller MF. Practice Refresh: A 1-month intervention to rebuild physician efficiency and wellness. In: American Conference on Physician Health; October 12–13, 2017; San Francisco, CA.

[ocaa301-B72] 72. Moffatt-Bruce SD, Nguyen MC, Steinberg B, et al. Interventions to reduce burnout and improve resilience: impact on a health system's outcomes. Clin Obstet Gynecol 2019; 62 (3): 432–43. [DOI] [PubMed] [Google Scholar]

[ocaa301-B73] 73. Morrow G, Burford B, Carter M, et al. Have restricted working hours reduced junior doctors' experience of fatigue? A focus group and telephone interview study. BMJ Open 2014; 4 (3): e004222. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B74] 74. Parshuram CS, Amaral ACKB, Ferguson ND, et al. Patient safety, resident well-being and continuity of care with different resident duty schedules in the intensive care unit: a randomized trial. CMAJ 2015; 187 (5): 321–9. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B75] 75. Payne TH, Alonso WD, Markiel JA, et al. Using voice to create inpatient progress notes: effects on note timeliness, quality, and physician satisfaction. JAMIA Open 2018; 1 (2): 218–26. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B76] 76. Pierce RG. A team-based and organizational framework for fostering resilience and well-being in academic hospital medicine. In: proceedings of the American Conference on Physician Health; October 12–13, 2017; San Francisco, CA.

[ocaa301-B77] 77. Pozdnyakova A, Laiteerapong N, Volerman A, et al. Impact of medical scribes on physician and patient satisfaction in primary care. J Gen Intern Med 2018; 33 (7): 1109–15. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B78] 78. Quenot J-P, Rigaud J-P, Prin S, et al. Suffering among carers working in critical care can be reduced by an intensive communication strategy on end-of-life practices. Intensive Care Med 2012; 38 (1): 55–61. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B79] 79. Ripp JA, Bellini L, Fallar R, et al. The impact of duty hours restrictions on job burnout in internal medicine residents: a three-institution comparison study. Acad Med 2015; 90 (4): 494–9. [DOI] [PubMed] [Google Scholar]

[ocaa301-B80] 80. Runyan C, Savageau JA, Potts S, et al. Impact of a family medicine resident wellness curriculum: a feasibility study. Med Educ Online 2016; 21 (1): 30648. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B81] 81. Safavi A, Sienna J, Strang BK, et al. Characterizing the initiation, completion, and integration of entrustable professional activity assessments in radiation oncology residency training and clinical workflow: an institutional pilot of competence by design. Radiother Oncol 2019; 139: S85. [Google Scholar]

[ocaa301-B82] 82. Schuh LA, Khan MA, Harle H, et al. Pilot trial of IOM duty hour recommendations in neurology residency programs Unintended consequences. Neurology 2011; 77 (9): 883–7. [DOI] [PubMed] [Google Scholar]

[ocaa301-B83] 83. Shaw JG, Brown-Johnson C, Chan G, et al. Physician burnout and joy of practice: Early mixed methods findings from the implementation of Stanford primary care 2.0. J Gen Intern Med 2017; 32 (2 Suppl 1): S272. [Google Scholar]

[ocaa301-B84] 84. Shea JA, Bellini LM, Dinges DF, et al. Impact of protected sleep period for internal medicine interns on overnight call on depression, burnout, and empathy. J Grad Med Educ 2014; 6 (2): 256–63. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B85] 85. Sherlock C, John C.. Adaptation Practice: Teaching doctors how to cope with stress, anxiety and depression by developing resilience. Br J Med Pract 2016; 9 (2): a916. [Google Scholar]

[ocaa301-B86] 86. Shultz CG, Holmstrom HL.. The use of medical scribes in health care settings: a systematic review and future directions. J Am Board Fam Med 2015; 28 (3): 371–81. [DOI] [PubMed] [Google Scholar]

[ocaa301-B87] 87. Sood A, Prasad K, Schroeder D, et al. Stress management and resilience training among Department of Medicine faculty: a pilot randomized clinical trial. J Gen Intern Med 2011; 26 (8): 858–61. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B88] 88. Tucker P, Brown M, Dahlgren A, et al. The impact of junior doctors. Scand J Work Environ Health 2010; 36 (6): 458–65. [DOI] [PubMed] [Google Scholar]

[ocaa301-B89] 89. Verweij H, Waumans RC, Smeijers D, et al. Mindfulness-based stress reduction for GPs: results of a controlled mixed methods pilot study in Dutch primary care. Br J Gen Pract 2016; 66 (643): e99–105. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B90] 90. Was A. The ideal gas lounge: boosting resident happiness with empowerment and common space improvements. In: proceedings of the International Conference on Physician Health; September 18–20, 2016; Boston, MA.

[ocaa301-B91] 91. West CP, Dyrbye LN, Rabatin JT, et al. Intervention to promote physician well-being, job satisfaction, and professionalism: a randomized clinical trial. JAMA Intern Med 2014; 174 (4): 527–33. [DOI] [PubMed] [Google Scholar]

[ocaa301-B92] 92. Willard-Grace R. Clinician perception of team support, burnout and “doability” of primary care. In: proceedings of the American Conference on Physician Health; October 12–13, 2017; San Francisco, CA.

[ocaa301-B93] 93. Wylie MC, Baier RR, Gardner RL.. Perceptions of electronic health record implementation: a statewide survey of physicians in Rhode Island. Am J Med 2014; 127 (10): 1010.e21–27. [DOI] [PubMed] [Google Scholar]

[ocaa301-B94] 94. Maslach C, Jackson SE.. The measurement of experienced burnout. J Organiz Behav 1981; 2 (2): 99–113. [Google Scholar]

[ocaa301-B95] 95. Kokkonen EW, Davis SA, Lin HC, et al. Use of electronic medical records differs by specialty and office settings. J Am Med Inform Assoc 2013; 20 (e1): e33–8. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B96] 96. Hayt DB, Alexander S.. The pros and cons of implementing PACS and speech recognition systems. J Digit Imaging 2001; 14 (3): 149–57. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B97] 97. Fleming NS, Becker ER, Culler SD, et al. The impact of electronic health records on workflow and financial measures in primary care practices. Health Serv Res 2014; 49 (1, Pt 2): 405–20. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B98] 98. Tai-Seale M, Dillon EC, Yang Y, et al. Physicians' well-being linked to in-basket messages generated by algorithms in electronic health records. Health Aff (Millwood) 2019; 38 (7): 1073–8. [DOI] [PubMed] [Google Scholar]

[ocaa301-B99] 99. Tarafdar M, Tu Q, Ragu-Nathan BS, et al. The impact of technostress on role stress and productivity. J Manage Inf Syst 2007; 24 (1): 301–28. [Google Scholar]

[ocaa301-B100] 100. Downing NL, Bates DW, Longhurst CA.. Physician burnout in the electronic health record era: are we ignoring the real cause? Ann Intern Med 2018; 169 (1): 50–1. [DOI] [PubMed] [Google Scholar]

[ocaa301-B101] 101. Pirtle CJ, Reeder RR, Lehmann CU, et al. Physician perspectives on training for an EHR implementation. Stud Health Technol Inform 2019; 264: 1318–22. [DOI] [PubMed] [Google Scholar]

[ocaa301-B102] 102. Ratwani R, Fairbanks T, Savage E, et al. Mind the gap. a systematic review to identify usability and safety challenges and practices during electronic health record implementation. Appl Clin Inform 2016; 07 (04): 1069–87. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B103] 103. Quiroz JC, Laranjo L, Kocaballi AB, et al. Challenges of developing a digital scribe to reduce clinical documentation burden. NPJ Digit Med 2019; 2: 114. [DOI] [PMC free article] [PubMed] [Google Scholar]

[ocaa301-B104] 104.National Academies of Sciences, Engineering, and Medicine. Taking Action against Clinician Burnout: A Systems Approach to Professional Well-Being. Washington, DC: The National Academies Press; 2019. [PubMed] [Google Scholar]

PERMALINK

The burden of the digital environment: a systematic review on organization-directed workplace interventions to mitigate physician burnout

Kelly J Thomas Craig

Van C Willis

David Gruen

Kyu Rhee

Gretchen P Jackson

Abstract

Objective

Materials and Methods

Results

Discussion

Conclusion

INTRODUCTION

MATERIALS AND METHODS

Figure 1.

Search strategy

Screening process

Data extraction and quality assessment

RESULTS

Figure 2.

Study and physician characteristics

Measures of burnout

Characteristics of organization-directed interventions

Table 1.

Table 2.

Figure 3.

Study quality

Expansion of the care team to give time back to physicians

Leveraging technology to support clinical workflows and teams

DISCUSSION

Strengths and limitations

CONCLUSION

CONSENT FOR PUBLICATION

FUNDING

AUTHOR CONTRIBUTIONS

ETHICS APPROVAL

DATA AVAILABILITY

SUPPLEMENTARY MATERIAL

Supplementary Material

ACKNOWLEDGMENTS

CONFLICT OF INTEREST STATEMENT

REFERENCES

Associated Data

Supplementary Materials

Data Availability Statement

ACTIONS

PERMALINK

RESOURCES

Similar articles

Cited by other articles

Links to NCBI Databases