Key Points
Question
How is the usability of different electronic health record (EHR) functions associated with physicians’ overall satisfaction with their EHR?
Findings
This survey study of 2067 family physicians found that there was significant variation in usability across EHR functions, with alerts receiving the lowest score. Greater usability was associated with higher EHR satisfaction, and efficiency strategies were associated with improved satisfaction only for physicians with highly usable EHRs.
Meaning
This study suggests that overall EHR usability and satisfaction vary greatly and that the benefits of EHR efficiency strategies are likely to be heterogenous across physicians depending on the usability of their EHR.
Abstract
Importance
Electronic health record (EHR) work has been associated with decreased physician well-being. Understanding the association between EHR usability and physician satisfaction and burnout, and whether team and technology strategies moderate this association, is critical to informing efforts to address EHR-associated physician burnout.
Objectives
To measure family physician satisfaction with their EHR and EHR usability across functions and evaluate the association of EHR usability with satisfaction and burnout, as well as the moderating association of 4 team and technology EHR efficiency strategies.
Design, Setting, and Participants
This study uses data from a cross-sectional survey conducted from December 12, 2021, to October 17, 2022, of all family physicians seeking American Board of Family Medicine recertification in 2022.
Exposure
Physicians perceived EHR usability across 6 domains, as well as adoption of 4 EHR efficiency strategies: scribes, support from other staff, templated text, and voice recognition or transcription.
Main Outcomes and Measures
Physician EHR satisfaction and frequency of experiencing burnout measured with a single survey item (“I feel burned out from my work”), with answers ranging from “never” to “every day.”
Results
Of the 2067 physicians (1246 [60.3%] younger than 50 years; 1051 men [50.9%]; and 1729 [86.0%] practicing in an urban area) who responded to the survey, 562 (27.2%) were very satisfied and 775 (37.5%) were somewhat satisfied, while 346 (16.7%) were somewhat dissatisfied and 198 (9.6%) were very dissatisfied with their EHR. Readability of information had the highest usability, with 543 physicians (26.3%) rating it as excellent, while usefulness of alerts had the lowest usability, with 262 physicians (12.7%) rating it as excellent. In multivariable models, good or excellent usability for entering data (β = 0.09 [95% CI, 0.05-0.14]; P < .001), alignment with workflow processes (β = 0.11 [95% CI, 0.06-0.16]; P < .001), ease of finding information (β = 0.14 [95% CI, 0.09-0.19]; P < .001), and usefulness of alerts (β = 0.11 [95% CI, 0.06-0.16]; P < .001) were associated with physicians being very satisfied with their EHR. In addition, being very satisfied with the EHR was associated with reduced frequency of burnout (β = −0.64 [95% CI, −1.06 to −0.22]; P < .001). In moderation analysis, only physicians with highly usable EHRs saw improvements in satisfaction from adopting efficiency strategies.
Conclusions and Relevance
In this survey study of physician EHR usability and satisfaction, approximately one-fourth of family physicians reported being very satisfied with their EHR, while another one-fourth reported being somewhat or very dissatisfied, a concerning finding amplified by the inverse association between EHR satisfaction and burnout. Electronic health record–based alerts had the lowest reported usability, suggesting EHR vendors should focus their efforts on improving alerts. Electronic health record efficiency strategies were broadly adopted, but only physicians with highly usable EHRs realized gains in EHR satisfaction from using these strategies, suggesting that EHR burden-reduction interventions are likely to have heterogenous associations across physicians with different EHRs.
This survey study measures physician satisfaction with their electronic health record and its usability and evaluates the association of electronic health record usability with satisfaction and burnout, as well as the moderating association of electronic health record efficiency strategies.
Introduction
Perhaps the most dramatic change to primary care over the past decade is the proportion of work mediated by electronic health records (EHRs).1,2 This “desktop medicine” includes patient history review, documentation, quality measure management, and responding to inbox messages—consuming nearly 50% of clinic time3 and frequently extending outside of clinic hours.4 Primary care physicians (PCPs) face the highest EHR burden, as they spend the most time using the EHR, receive the most inbox messages, and spend the most amount of after-hours time using the EHR,5,6 which contributes to burnout, turnover, and lower-quality care.7,8,9,10 Reducing EHR burden is a national policy priority as well as a key target for care delivery organizations across the country.11,12
Electronic health record system vendors, health systems, and PCPs have responded with an array of potential solutions. Vendors have focused on improving the usability of their software, including documentation, information presentation, and alerts.13,14,15,16,17 However, these efforts have not been guided by a robust understanding of which specific aspects of EHRs are associated with poor satisfaction for physicians. Evidence also suggests that poor usability is not the sole factor associated with EHR burden—notably, US physicians spend more time working in the EHR and write longer notes compared with their non-US peers using the same software, suggesting that sociotechnical factors, such as workflows, policy, reimbursement, and organizational support, are associated with EHR burden.18,19 To that end, care delivery organizations have deployed a number of EHR efficiency strategies, such as templated text documentation tools and team-based documentation workflows using scribes or other staff members. To date, there is limited generalizable evidence regarding the ability of these efficiency strategies to improve physician satisfaction with their EHR or overcome dissatisfaction with poor usability,20,21,22,23 making it difficult to assess what role these strategies should play in efforts to reduce EHR burden. It may be that physicians with significant support from teams or who are able to overcome usability challenges feel more satisfied with their EHR. If not, it suggests the need to develop new strategies to reduce EHR burden.
To inform national efforts to reduce EHR burden being pursued by multiple stakeholders, we used a national survey of US family physicians to address 3 research questions. First, to inform vendor efforts, how do PCPs rate satisfaction with their EHR and usability across different EHR functions, and what functions are rated as having the worst usability? Second, to inform health systems and practicing physicians, what team-based or technology-based efficiency strategies do PCPs use to optimize their EHR work, and how do they rate the effectiveness of those interventions at reducing EHR time? Third, how do those team-based and technology-based efficiency strategies moderate the association between usability and physician well-being outcomes, including EHR satisfaction and burnout? Results from our study have implications for policymakers, vendors, health systems, and physicians interested in addressing EHR burden, physician well-being, and burnout.
Methods
Survey and Data
We used data from the American Board of Family Medicine (ABFM) Continuous Certification Questionnaire, a mandatory part of extending certification as a family physician for those who sought recertification in 2022 and reported providing direct patient care. This ensured the survey had a 100% response rate among physicians who were continuing their certification in 2022, and questions could not be skipped. This study was approved by the institutional review board at the University of California, San Francisco with a waiver for informed consent due to the use of secondary data for research. This study followed the American Association for Public Opinion Research (AAPOR) reporting guideline for survey-based research by reporting the sample size and population being sampled, response rate, verbatim text of survey questions, and steps taken for pretesting and validation.
For more than a decade the ABFM has assessed EHR adoption and meaningful use requirements, and in 2022, the survey added questions regarding physician experience with the EHR. These new questions were extensively pretested with family physicians for content validity, including ten 1-hour semistructured interviews with physicians to ensure that questions were relevant and clear. Each physician answers a set of mandatory questions, then is sequentially randomized into 2 sets of different modules. The section on EHR satisfaction used in this study was 1 of 2 modules in the first set and included 50% of the respondents. In the second set of modules, physicians are randomized to 1 of 5 modules with 20% probability, 1 of which included the burnout questions also included in this study. The survey became available December 12, 2021, and closed October 17, 2022.
Measures
EHR Satisfaction
We measured overall EHR satisfaction using responses to the question “Overall, how satisfied are you with your current primary, outpatient EHR system?” Responses on a 5-point Likert scale ranged from 1 (very dissatisfied) to 5 (very satisfied.)
EHR Function Usability
We measured PCP perceptions of usability across EHR functions using responses to the question “How would you assess the following usability dimensions of your current primary EHR system?” across the following 6 functions: entering information, readability of information, amount of information presented on each screen, alignment with the PCP’s workflow or cognitive process, ease of finding relevant information, and usefulness of alerts, all using a 4-point scale with responses options of poor (scored as 1), fair (scored as 2), good (scored as 3), and excellent (scored as 4), as well as not applicable. We constructed dichotomous measures of usability, classifying each domain as having good usability if the respondent selected good or excellent. We then constructed a usability index for each respondent by assigning each value a score of 1 (for poor) through 4 (for excellent). We scored responses of not applicable as 0, with the logic that respondents chose not to use that function of the EHR (eg, disabling alerts completely). We then took the summation of all 6 domains of functionality to create a composite measure of overall usability, based on a Cronbach α of 0.92 indicating strong internal consistency across the scale. Finally, we created a standardized version of our usability index to a mean of 0 and an SD of 1 to facilitate interpretation in multivariable models.
EHR Efficiency Strategies
We measured adoption and effectiveness of 4 common strategies meant to optimize EHR documentation efficiency: scribes, support from other staff (eg, medical assistants or nurses), templated text (eg, SmartPhrases or dot-phrases), and voice recognition or transcription, using responses to the question “Please indicate whether you use any of the following resources to help reduce time that you spend documenting in the EHR” with the response options including “yes, and it leads to reduced time,” “yes, but it does not reduce time,” and “no.” Because strategies may be duplicative, we classified physicians as those using no strategies, 1 strategy, and 2 or more strategies.
Burnout
We measured burnout using responses to the question “I feel burned out from my work,” with response options never, a few times a year or less, once a month or less, a few times a month, once a week, a few times per week, or every day. This single-item measure has been validated as consistent with the full Maslach Burnout Inventory for PCPs.24 We operationalized this item by scoring respondents from 0 (for never) to 6 (for every day.)
Robustness
We conducted a variety of tests to ensure that our results were robust to model specification and variable construction. First, we created a model with our usability index as a 25-level factor variable to flexibly estimate the association between EHR satisfaction and overall usability across the distribution of the usability index. Second, for multivariable models with EHR satisfaction as the dependent variable, we created models specifying our dependent variable as physicians responding either very satisfied or somewhat satisfied, to ensure our results were not due to the subset of very satisfied respondents. We also used this alternative construction in models using burnout as the dependent variable and EHR satisfaction as the independent variable of interest. Third, for all measures using a dichotomous dependent variable, we also used logistic regression, and for models using burnout as a dependent variable, we also used an ordinal logistic regression, to ensure our results were robust across different estimators. Fourth, we conducted a robustness test dropping all responses of not applicable to our function usability measures rather than coding them as zero.
Statistical Analysis
We used descriptive statistics to assess sample demographics as well as physician overall EHR satisfaction. We then characterized perceptions of usability across our 6 domains and the use of 4 EHR efficiency strategies.
We then created several multivariable linear models using ordinary least-squares regression to evaluate the association between EHR usability, satisfaction, and documentation efficiency tool use. We chose ordinary least-squares models over logistic regression to facilitate interpretability of the results, as coefficients can be interpreted simply as the marginal association of the independent variable with the outcome.25 First, we evaluated the association between a dichotomous measure of whether a PCP responded that they were very satisfied with their EHR as the dependent variable and each functionality domain of EHR usability defined as a binary variable with respondents who selected good or excellent usability for that function compared with any other response as our independent variables of interest, including controls for EHR vendor, rurality, practice size, organization type, physician gender, value-based payment participation, and efficiency tool use with heteroskedasticity robust SEs.
Then, to evaluate the moderating association of strategies to optimize documentation efficiency with EHR satisfaction, we used another multivariable linear regression model with the same dichotomous dependent variable of physicians very satisfied with their EHR, while our independent variable of interest was an interaction term between the standardized usability index and the number of documentation efficiency strategies the physician responded that they had adopted and had saved them time (either 0, 1, or ≥2), in addition to the main associations of usability and efficiency strategies. We once again included controls for EHR vendor, rurality, practice size, organization type, physician gender, value-based payment participation, and each individual efficiency tool with heteroskedasticity-robust SEs. Then, to assess how the association between EHR satisfaction and efficiency strategy adoption varies across high-usability and low-usability EHRs, we used postestimation margins to compare associations between high (1 SD above the mean) and low (1 SD below the mean) usability across no, 1, and 2 or more efficiency strategies.
Finally, we evaluated the association between physician burnout and EHR satisfaction with a multivariable linear model with physician burnout frequency, scored as 0 through 6, as our dependent variable and a dichotomous measure of PCPs who reported they were very satisfied with their EHR as our independent variable of interest, again including controls for EHR vendor, rurality, practice size, organization type, physician gender, and value-based payment participation. All analyses were conducted using Stata, version 17.0 (StataCorp LLC), with 2-sided tests indicating statistical significance at P < .05.
Results
Sample Characteristics
Our analytic sample included 2067 family physicians in 2022; 431 (20.9%) were also administered the module on burnout. Physicians included 1051 men (50.9%) and 1016 women (49.2%), with 1246 (60.3%) younger than 50 years of age; 695 (34.3%) were located in the South, 570 (28.1%) in the West, 467 (23.0%) in the Midwest, and 297 (14.6%) in the Northeast (eTable 1 in Supplement 1). They practiced primarily in urban areas (1729 [86.0%]), at practice types including health systems (744 [36.0%]), independent practices (564 [27.3%]), federally qualified health centers or rural health centers (203 [9.8%]), academic centers (154 [7.5%]), and federal health systems such as the Veterans Health Administration (82 [4.0%]), with 320 (15.5%) responding that they practiced in another setting not listed. Most respondents worked in a practice with 2 to 5 clinicians (675 [32.7%]), followed by 6 to 20 clinicians (649 [31.4%]), more than 20 clinicians (558 [27.0%]), and finally solo practice (185 [9.0%]). A total of 1648 respondents (77.9%) practiced in a primary care clinic only, with 467 (22.1%) in a multispecialty practice. The most common EHR vendor was Epic (801 [38.8%]), followed by eClinical Works (209 [10.1%]), athenahealth (19 [9.3%]), and Cerner (163 [7.9%]). A total of 1386 respondents (67.1%) participated in some form of value-based care program.
EHR Satisfaction and Usability
Most physicians were somewhat satisfied (775 [37.5%]) or very satisfied (562 [27.2%]) with their EHR, followed by somewhat dissatisfied (346 [16.7%]), very dissatisfied (198 [9.6%]), and neither satisfied nor dissatisfied (165 [8.0%]), with 21 (1.0%) selecting not applicable (Figure 1).
Figure 1. Physician Satisfaction With Their Electronic Health Record (EHR).
NA indicates not applicable.
For all domains of usability, the most common response was “good.” For readability of information, 976 physicians (47.2%) rated good while 543 (26.3%) rated excellent. For ease of entering information, 942 (45.6%) rated good and 429 (20.8%) reported excellent, while for usefulness of alerts, 702 (34.0%) rated good and 262 (12.7%) rated excellent (Figure 2).
Figure 2. Electronic Health Record Usability by Function.
NA indicates not applicable.
EHR Documentation Efficiency Strategy
A total of 229 physicians (11.1%) in our sample reported using scribes and that they reduced EHR time, while 52 (2.5%) reported using scribes but said they did not reduce time in the EHR; 733 physicians (35.5%) reported using other staff for documentation and that this reduced EHR time, while 603 (29.2%) reported using other staff members but said they did not reduce EHR time. A total of 1289 physicians (62.4%) used EHR documentation templates and said they reduced EHR time, while 542 (26.2%) used templates but said they did not reduce EHR time. Finally, 771 physicians (37.3%) used voice recognition or transcription and said they reduced EHR time, while 236 (11.4%) reported using it but without a reduction in EHR time (Figure 3). Scribes were therefore perceived as the most effective at reducing EHR time (229 physicians [81.5%] who reported using scribes found they reduced EHR time), followed by voice recognition or transcription (771 [76.6%]), templated text (1289 [70.4%]), and finally other staff members (733 [54.9%]).
Figure 3. Physician Use of Efficiency Strategies and Team-Based Support to Reduce Electronic Health Record Burden.
Association Between EHR Satisfaction, Usability, and Burnout
In multivariable models, we found that that having good or excellent usability for entering data was associated with a 9–percentage point increase in the probability of a physician being very satisfied with their EHR (β = 0.09 [95% CI, 0.05-0.14]; P < .001). Alignment with workflow or cognitive processes (β = 0.11 [95% CI, 0.06-0.16]; P < .001), ease of finding relevant information (β = 0.14 [95% CI, 0.09-0.19]; P < .001), and usefulness of alerts (β = 0.11 [95% CI, 0.06-0.16]; P < .001) were all significantly associated with increased likelihood of EHR satisfaction, while usability of functions relating to how physicians consume information from the EHR, such as readability of information and amount of information presented on each screen, were not associated with EHR satisfaction (Table). We found similar results in our robustness tests (eTables 2-6 and the eFigure in Supplement 1).
Table. Associations of EHR Function Usability With EHR Satisfaction and Burnout.
| Modela | Coefficient (95% CI) | P value |
|---|---|---|
| Model 1. Dependent variable: EHR satisfaction | ||
| Usability rating | ||
| Entering data | 0.09 (0.05 to 0.14) | <.001 |
| Readability of information | 0.01 (−0.03 to 0.06) | .56 |
| Amount of information presented on each screen | −0.02 (−0.06 to 0.03) | .45 |
| Alignment with your workflow or cognitive process | 0.11 (0.06 to 0.16) | <.001 |
| Relevant information is easy to find | 0.14 (0.09 to 0.19) | <.001 |
| Usefulness of alerts | 0.11 (0.06 to 0.16) | <.001 |
| Model 2. Dependent variable: frequency of physician burnout | ||
| Overall EHR satisfaction | ||
| Very dissatisfied, somewhat dissatisfied, neutral, or somewhat satisfied | [Reference] | |
| Very satisfied | −0.64 (−1.06 to −0.22) | <.001 |
Abbreviation: EHR, electronic health record.
Dependent variable for model 1 is a dichotomous measure of EHR satisfaction comparing physicians who respond that they are very satisfied with all other responses. Dependent variable for model 2 is burnout frequency scored from never (0) to every day (6), where a negative coefficient corresponds to less-frequent burnout. All models include controls for EHR vendor, rurality, practice size, organization type, physician gender, and value-based payment participation (not shown). Model 1 includes controls for efficiency of tool use (not shown).
In our multivariable models examining the association between our measure of EHR satisfaction and burnout, we found that being very satisfied with the EHR was associated with reduced burnout compared with physicians with any other level of EHR satisfaction (β = −0.64 [95% CI, −1.06 to −0.22]; P < .001) (Table). This corresponds to a roughly 18.8% lower burnout score. We found similar results in our robustness test using ordinal logistic regression (eTable 7 in Supplement 1).
Moderation Analysis
In moderation analysis using our standardized usability index, we found that usability alone remained associated with EHR satisfaction, with physicians with highly usable EHRs (1 SD above the mean) 14.7 percentage points (95% CI, 11.0-18.4 percentage points) more likely to be very satisfied with their EHR (P < .001), while physicians using 1 (β = 0.02 [95% CI, –0.03 to 0.07]; P = .37) or 2 or more (β = 0.04 [95% CI, –0.01 to 0.09]; P = .10) efficiency strategies were not significantly more likely to report being very satisfied compared with physicians using no strategies. In our estimated margins comparing physicians with highly usable to low-usability EHRs across the use of 0, 1, or 2 or more efficiency strategies, we found that physicians with highly usable EHRs (1 SD above the mean, equivalent to a score of 21 on our 24-point usability scale) who used no efficiency strategies had a 38.5% chance (95% CI, 31.4%-45.5%) of being very satisfied with their EHR, those who used 1 efficiency strategy had a 47.4% chance (95% CI, 42.2%-52.6%), and those who used 2 or more efficiency strategies had a 51.4% chance (95% CI, 47.6%-55.2%) (Figure 4). However, the trend ran in the opposite direction for low-usability EHRs (1 SD below the mean, equivalent to a score of 11 on our 24-point usability scale)—physicians using no efficiency strategies had a 9.1% probability (95% CI, 5.7%-12.4%) of being very satisfied with their EHR, while those using 1 efficiency strategy (4.7% [95% CI, 10.4%-8.0%]) and 2 or more efficiency strategies (4.2% [95% CI, 0.8%-7.5%]) had a lower probability of being very satisfied with their EHR, showing that only physicians with highly usable EHRs realized gains in EHR satisfaction from efficiency strategies.
Figure 4. Moderation Analysis Between Usability, Burden-Reduction Strategies, and Satisfaction.
Results from multivariable regression model including controls for electronic health record (EHR) vendor, rurality, organization type, value-based payment participation, organization size, physician age, and physician gender. High usability indicates the respondent is 1 SD above the mean, while low usability indicates 1 SD below the mean in our standardized usability index. Error bars indicate 95% CIs from regression postestimation calculations.
Discussion
In a national survey with a 100% response rate, fewer than 30% of family physicians were very satisfied with their EHR, and more than one-fourth reported dissatisfaction. There was significant variation in usability across domains of the EHR, where most respondents reported that the ease of entering information and readability of information was good or excellent, while usefulness of EHR-based alerts was rated much lower. A small majority of family physicians used EHR templates to improve efficiency, but most do not have access to other efficiency strategies—fewer than 15% used scribes, which was rated as the most effective strategy to reduce documentation time. Although greater usability of most EHR functions, especially alignment with the physicians’ workflow or cognitive processes, usefulness of alerts, and ease of finding relevant information, were associated with greater EHR satisfaction, the use of EHR efficiency strategies improved satisfaction only for physicians with highly usable EHRs. Finally, we found physicians who responded that they were very satisfied with their EHR also reported significantly lower burnout.
We found that only one-fourth of family physicians were very satisfied with their EHR, while another one-fourth reported being somewhat dissatisfied or very dissatisfied, numbers consistent with other national surveys of physician EHR satisfaction.4 This finding is notable given the study’s 100% survey response rate, compared with much lower response rates to voluntary surveys, suggesting that physician dissatisfaction with the EHR is not due to response bias. Our results specifically suggest starting with addressing alerts, as they received the lowest usability scores. Although alerts have been shown to have important benefits (particularly reducing medication errors),26,27 research suggests that they are often poorly configured, have high dismissal rates, and have been associated with “alert fatigue” that harms physician well-being and patient outcomes.16,17,28,29 The focus of most alert-based research has been in the inpatient setting, where studies often find poor performance and a high level of “nuisance” alerts.30,31 Office-based physician alerts are relatively understudied and less sophisticated in comparison.32 A growing literature suggests that alerts can be improved through collaborative efforts between clinicians and informaticists,33 and recent policy action has added requirements for EHR vendors to support a feedback loop for decision support alert functionality.34 Although documentation makes up the plurality of time spent in the EHR and is the focus of several burden-reduction initiatives,5,12 fewer than 7% of physicians reported that the ease of entering information was poor, suggesting that it may not be usability challenges that are associated with documentation burden.
Many family physicians used at least 1 EHR documentation efficiency strategy, with the most common being documentation templates, which are low cost and may be included in default EHR builds. Templates, despite being broadly adopted, were far from the most effective strategies, adding evidence to research suggesting that while some use of templated text reduces documentation time, overreliance may increase EHR burden as physicians document to the template, rather than each patient’s specific needs.21,22 Although scribes were reported as the most effective documentation efficiency strategy among physicians who reported using them, documentation by other staff members was the least effective. It may be that while offloading documentation to staff reduces EHR burden, effective implementation requires a dedicated role and accompanying workflow adaptations, rather than relying on other staff on an ad hoc basis.
Despite many physicians using at least 1 effective efficiency strategy, our moderation analysis found that while usability was associated with overall EHR satisfaction, the benefits of these efficiency strategies were realized only by physicians with highly usable EHRs. Understanding this association is critical to informing future efforts to address EHR burden. It may simply be that at low levels, usability dominates physician perception of their EHR so strongly that effective team-based or technology-based efficiency strategies are not able to overcome poor software usability. If this is the case, resources to improve documentation efficiency are unlikely to help physicians with low-usability EHRs. Given that the usability of entering information is frequently rated higher than functions such as finding information or alerts, it is likely that documentation-focused efficiency strategies such as scribes or templated text are unable to address the salient pain points of low-usability EHRs. Instead, technology tools that may be on the horizon, such as artificial intelligence that summarizes bloated notes or improved data standards to ensure patient information is available in a standardized format, may be necessary to improve EHR satisfaction for these physicians. Conversely, for physicians with highly usable EHRs, strategies to reduce documentation time are associated with EHR satisfaction, suggesting that investments in these team and technology interventions are worthwhile. Our results therefore suggest that the effects of popular EHR burden-reduction interventions are likely to be heterogenous across users with different levels of EHR usability. Physicians, EHR vendors, and health system leaders should design burden-reduction efforts with these results in mind. The association between high EHR satisfaction and burnout highlights the potential for renewed policymaker and vendor attention to EHR optimization to contribute to broader efforts to address persistent and increasing rates of physician burnout in primary care.35
Limitations
Our study has some limitations, including that results from our cross-sectional descriptive analysis precludes causal inference. Second, our survey does not assess granular details, such as the intensity of documentation efficiency strategies. For example, there is likely variation across physicians using staff for documentation (ie, the staff member performing the task and the degree of training they receive) that we do not observe. To address this concern, our measure of efficiency strategy use included only physicians who reported that those efficiency strategies reduced EHR documentation time, but there is likely variation in implementation of each strategy. Future research should explore what specific team, technology, and contextual factors facilitate successful implementation of each EHR documentation efficiency strategy. Our study assesses only the association between EHR satisfaction and burnout, but many other factors, including work environment and feeling valued, are known to be associated with burnout, and we were unable to fully capture the spectrum of possible antecedents to burnout. Finally, the survey-based nature of our study relied on family physicians’ self-reported data that we were unable to independently verify. However, our high-level results are similar to other survey-based estimates of PCP EHR use.4
Conclusions
This unique national survey with a 100% response rate found that only one-fourth of physicians were very satisfied with their EHR, while a substantial minority were dissatisfied, and usability was correlated with overall EHR satisfaction. Although most physicians reported using some type of efficiency strategy, such as scribes, templated text, or voice recognition to reduce EHR documentation time, gains in EHR satisfaction were realized only by physicians with high-usability EHRs, suggesting that addressing physician EHR burden requires a targeted approach to address the EHR needs of the specific physician.
eTable 1. Sample Demographic Characteristics
eTable 2. Multivariable Models Using Usability Index Factor Variable as Independent Variable of Interest
eTable 3. Multivariable Models on Association Between EHR Function Usability and EHR Satisfaction Using a “Very” or “Somewhat” Satisfied Dependent Variable
eTable 4. Multivariable Model on Association Between EHR Satisfaction and Burnout Using a “Very” or “Somewhat” Satisfied With EHR Independent Variable
eTable 5. Multivariable Models on Association Between EHR Function Usability and EHR Satisfaction Using Logistic Regression
eTable 6. Associations of EHR Function Usability With EHR Satisfaction and Burnout Without “Not Applicable” Respondents
eFigure. Moderation Analysis Between Usability, Burden Reduction Strategies, and Satisfaction Without “Not Applicable” Responses
eTable 7. Ordinal Logistic Regression of the Relationship Between Burnout and EHR Satisfaction
Data Sharing Statement
References
- 1.Adler-Milstein J, Jha AK. HITECH Act drove large gains in hospital electronic health record adoption. Health Aff (Millwood). 2017;36(8):1416-1422. doi: 10.1377/hlthaff.2016.1651 [DOI] [PubMed] [Google Scholar]
- 2.Apathy NC, Holmgren AJ, Adler-Milstein J. A decade post-HITECH: critical access hospitals have electronic health records but struggle to keep up with other advanced functions. J Am Med Inform Assoc. 2021;28(9):1947-1954. doi: 10.1093/jamia/ocab102 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Tai-Seale M, Olson CW, Li J, et al. Electronic health record logs indicate that physicians split time evenly between seeing patients and desktop medicine. Health Aff (Millwood). 2017;36(4):655-662. doi: 10.1377/hlthaff.2016.0811 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Gaffney A, Woolhandler S, Cai C, et al. Medical documentation burden among US office-based physicians in 2019: a national study. JAMA Intern Med. 2022;182(5):564-566. doi: 10.1001/jamainternmed.2022.0372 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Rotenstein LS, Holmgren AJ, Downing NL, Bates DW. Differences in total and after-hours electronic health record time across ambulatory specialties. JAMA Intern Med. 2021;181(6):863-865. doi: 10.1001/jamainternmed.2021.0256 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Overhage JM, McCallie D Jr. Physician time spent using the electronic health record during outpatient encounters: a descriptive study. Ann Intern Med. 2020;172(3):169-174. doi: 10.7326/M18-3684 [DOI] [PubMed] [Google Scholar]
- 7.Adler-Milstein J, Zhao W, Willard-Grace R, Knox M, Grumbach K. Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc. 2020;27(4):531-538. doi: 10.1093/jamia/ocz220 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Gardner RL, Cooper E, Haskell J, et al. Physician stress and burnout: the impact of health information technology. J Am Med Inform Assoc. 2019;26(2):106-114. doi: 10.1093/jamia/ocy145 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Han S, Shanafelt TD, Sinsky CA, et al. Estimating the attributable cost of physician burnout in the United States. Ann Intern Med. 2019;170(11):784-790. doi: 10.7326/M18-1422 [DOI] [PubMed] [Google Scholar]
- 10.Shanafelt TD, Hasan O, Dyrbye LN, et al. Changes in Burnout and Satisfaction With Work-Life Balance in Physicians and the General US Working Population Between 2011 and 2014. Vol 90. 12th ed. Elsevier; 2015:1600-1613. [DOI] [PubMed] [Google Scholar]
- 11.Apathy NC, Hare AJ, Fendrich S, Cross DA. Early changes in billing and notes after evaluation and management guideline change. Ann Intern Med. 2022;175(4):499-504. doi: 10.7326/M21-4402 [DOI] [PubMed] [Google Scholar]
- 12.American Medical Informatics Association. AMIA 25x5: reducing documentation burden to 25% of current state in five years. Accessed October 10, 2022. https://amia.org/about-amia/amia-25x5
- 13.Melnick ER, Dyrbye LN, Sinsky CA, et al. The association between perceived electronic health record usability and professional burnout among US physicians. Mayo Clin Proc. 2020;95(3):476-487. doi: 10.1016/j.mayocp.2019.09.024 [DOI] [PubMed] [Google Scholar]
- 14.Melnick ER, Sinsky CA, Dyrbye LN, et al. Association of perceived electronic health record usability with patient interactions and work-life integration among US physicians. JAMA Netw Open. 2020;3(6):e207374. doi: 10.1001/jamanetworkopen.2020.7374 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Ratwani RM, Benda NC, Hettinger AZ, Fairbanks RJ. Electronic health record vendor adherence to usability certification requirements and testing standards. JAMA. 2015;314(10):1070-1071. doi: 10.1001/jama.2015.8372 [DOI] [PubMed] [Google Scholar]
- 16.Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R; with the HITEC Investigators . Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decis Mak. 2017;17(1):36. doi: 10.1186/s12911-017-0430-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Co Z, Holmgren AJ, Classen DC, et al. The tradeoffs between safety and alert fatigue: data from a national evaluation of hospital medication–related clinical decision support. J Am Med Inform Assoc. 2020;27(8):1252-1258. doi: 10.1093/jamia/ocaa098 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Holmgren AJ, Downing NL, Bates DW, et al. Assessment of Electronic Health Record Use Between US and Non-US Health Systems. JAMA Intern Med. 2021;181(2):251-259. doi: 10.1001/jamainternmed.2020.7071 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Downing NL, Bates DW, Longhurst CA. Physician burnout in the electronic health record era: are we ignoring the real cause? Ann Intern Med. 2018;169(1):50-51. doi: 10.7326/M18-0139 [DOI] [PubMed] [Google Scholar]
- 20.Mishra P, Kiang JC, Grant RW. Association of medical scribes in primary care with physician workflow and patient experience. JAMA Intern Med. 2018;178(11):1467-1472. doi: 10.1001/jamainternmed.2018.3956 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Apathy NC, Rotenstein L, Bates DW, Holmgren AJ. Documentation dynamics: note composition, burden, and physician efficiency. Health Serv Res. 2023;58(3):674-685. doi: 10.1111/1475-6773.14097 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Rotenstein LS, Apathy N, Holmgren AJ, Bates DW. Physician note composition patterns and time on the EHR across specialty types: a national, cross-sectional study. J Gen Intern Med. 2023;38(5):1119-1126. doi: 10.1007/s11606-022-07834-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Gidwani R, Nguyen C, Kofoed A, et al. Impact of scribes on physician satisfaction, patient satisfaction, and charting efficiency: a randomized controlled trial. Ann Fam Med. 2017;15(5):427-433. doi: 10.1370/afm.2122 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.West CP, Dyrbye LN, Satele DV, Sloan JA, Shanafelt TD. Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. J Gen Intern Med. 2012;27(11):1445-1452. doi: 10.1007/s11606-012-2015-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Norton EC, Dowd BE, Garrido MM, Maciejewski ML. Requiem for odds ratios. Health Serv Res. 2024;59(4):e14337. doi: 10.1111/1475-6773.14337 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Bates DW, Singh H. Two decades since To Err Is Human: an assessment of progress and emerging priorities in patient safety. Health Aff (Millwood). 2018;37(11):1736-1743. doi: 10.1377/hlthaff.2018.0738 [DOI] [PubMed] [Google Scholar]
- 27.Kuperman GJ, Bobb A, Payne TH, et al. Medication-related clinical decision support in computerized provider order entry systems: a review. J Am Med Inform Assoc. 2007;14(1):29-40. doi: 10.1197/jamia.M2170 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Khuntia J, Tanniru M, Weiner J. Juggling digitization and technostress: the case of alert fatigues in the patient care system implementation. Health Policy Technol. 2015;4(4):364-377. doi: 10.1016/j.hlpt.2015.08.005 [DOI] [Google Scholar]
- 29.Carspecken CW, Sharek PJ, Longhurst C, Pageler NM. A clinical case of electronic health record drug alert fatigue: consequences for patient outcome. Pediatrics. 2013;131(6):e1970-e1973. doi: 10.1542/peds.2012-3252 [DOI] [PubMed] [Google Scholar]
- 30.Holmgren AJ, Co Z, Newmark L, Danforth M, Classen D, Bates D. Assessing the safety of electronic health records: a national longitudinal study of medication-related decision support. BMJ Qual Saf. 2020;29(1):52-59. doi: 10.1136/bmjqs-2019-009609 [DOI] [PubMed] [Google Scholar]
- 31.Classen DC, Holmgren AJ, Co Z, et al. National Trends in the Safety Performance of Electronic Health Record Systems From 2009 to 2018. JAMA Netw Open. 2020;3(5):e205547. doi: 10.1001/jamanetworkopen.2020.5547 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Co Z, Holmgren AJ, Classen DC, et al. The development and piloting of the ambulatory electronic health record evaluation tool: lessons learned. Appl Clin Inform. 2021;12(1):153-163. doi: 10.1055/s-0041-1722917 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.McCoy AB, Russo EM, Johnson KB, et al. Clinician collaboration to improve clinical decision support: the Clickbusters initiative. J Am Med Inform Assoc. 2022;29(6):1050-1059. doi: 10.1093/jamia/ocac027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Health data, technology, and interoperability: certification program updates, algorithm transparency, and information sharing. Federal Register. Published January 9, 2024. Accessed February 25, 2024. https://www.federalregister.gov/documents/2024/01/09/2023-28857/health-data-technology-and-interoperability-certification-program-updates-algorithm-transparency-and
- 35.Doe S, Coutinho AJ, Weidner A, et al. Prevalence and predictors of burnout among resident family physicians. Fam Med. 2024;56(3):148-155. doi: 10.22454/FamMed.2024.875388 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
eTable 1. Sample Demographic Characteristics
eTable 2. Multivariable Models Using Usability Index Factor Variable as Independent Variable of Interest
eTable 3. Multivariable Models on Association Between EHR Function Usability and EHR Satisfaction Using a “Very” or “Somewhat” Satisfied Dependent Variable
eTable 4. Multivariable Model on Association Between EHR Satisfaction and Burnout Using a “Very” or “Somewhat” Satisfied With EHR Independent Variable
eTable 5. Multivariable Models on Association Between EHR Function Usability and EHR Satisfaction Using Logistic Regression
eTable 6. Associations of EHR Function Usability With EHR Satisfaction and Burnout Without “Not Applicable” Respondents
eFigure. Moderation Analysis Between Usability, Burden Reduction Strategies, and Satisfaction Without “Not Applicable” Responses
eTable 7. Ordinal Logistic Regression of the Relationship Between Burnout and EHR Satisfaction
Data Sharing Statement




