Skip to main content
Annals of Family Medicine logoLink to Annals of Family Medicine
. 2021 Mar-Apr;19(2):171–177. doi: 10.1370/afm.2654

Standardization vs Customization: Finding the Right Balance

Christine A Sinsky 1,, Hessam Bavafa 2,3, Richard G Roberts 3, John W Beasley 3
PMCID: PMC7939702  PMID: 33685879

Abstract

There is an inherent tension between standardization and customization of care delivery processes. The challenge for health care systems is to achieve the right balance. At its best, standardized work can create efficiencies that generate the additional time needed for personalized care. Similarly, at its best, customization allows the people within a system to accommodate the needs, preferences, and circumstances of the unique individuals and local communities they serve. We provide examples and offer principles to decide when standardization offers the most successful path and when customization may be preferred. We believe that, in sum, the balance has shifted too far toward standardization and that a rebalancing toward customization will benefit patients, clinicians, and the health care system.

Key words: customization, standardization, burnout, administrative burden, quality measurement, transactional, primary care issues, clinician-patient communication/relationship, teamwork, leadership

INTRODUCTION

There is an inherent tension between standardization and customization of care delivery processes. Too much customization can be chaotic, time-consuming, and result in suboptimal outcomes. On the other hand, excessive or inappropriate standardization can oppress, disempower, and restrict clinicians from adjusting to their patients’ and their own circumstances, also risking adverse outcomes. The challenge for health care systems is to achieve the right balance. Determining the optimal point along the continuum between these 2 approaches for any given processes requires careful consideration and should be a paramount goal of organizational leadership, standard setters, and regulators.

In this commentary, we posit that in most situations, patients receive better care when physicians and their teams have the ability to exercise professional judgment about workflow and task distribution supported by best practices of systems engineering, rather than when they are expected to perform a rigid sequence of transactions mandated by a series of well-intentioned, but distant designers. We also hypothesize that overall costs will be lower when the system is designed so that there is sufficient time for the deep work of understanding the patient, their context and preferences, and for careful medical decision making. We provide examples of when standardization will be the most successful strategy and when customization will be preferred. Finally, we offer principles to guide the optimal approach.

Historical Context

Concerns about the balance of standardization and customization are not new. In 1966, Donabedian wrote, “One must also consider whether, with increasing standardization, so much loss of the ability to account for unforeseen elements in the clinical situation occurs that one obtains reliability at the cost of validity.”1 The evidence-based medicine and guidelines movement beginning in the last 2 decades of the 20th century offered the promise of standardized treatments to improve patient outcomes.2 Over time, the push for standardization extended to how clinical care would be organized and delivered across practice sites. As an example, the Future of Family Medicine project promoted standardization by advocating that practices provide a prescribed set of core services, use electronic record systems, and employ team-based care.3 The aim was to reduce unwanted variation in care processes and thereby improve outcomes, efficiency, and satisfaction. But have we gone too far?

Transactional vs Relational Conceptualization of Health Care

Have we risked reducing health care to a series of transactions that can be delivered by any clinician, ticked off in an electronic health record (EHR), counted by administrators, reported to external regulators and standard setters, and in doing so, have we unwittingly deprioritized the relational aspects of health care?

Recent trends have shifted the health care system toward a centrally designed, transactional model,4-8 and away from a locally influenced relational model of care9 (Table 1). These trends include consolidation of smaller practices into larger health systems, an industrial approach to care processes (eg, “standard work”), and the rapid development and deployment of health information technology, with associated expectations for greater mandates, measuring, and monitoring (eg, audits of record activity by role type, meaningful use measures which required specific team workflows, requirements for universal documentation of patients’ pain levels and learning styles). Many of these trends are not intrinsically detrimental and some degree of resultant standardization can be useful.

Table 1.

Contrast Between Standardization and Customization in Health Care

Standardization Customization
Conception of health care Transactional Relational
Conception of clinicians Clinicians will perform better with clear standards and regulations. Clinicians are the interpreters between the guideline and the individual circumstance and can be trusted to use good judgment in working for patient’s best interests.
Organizational approach The approach is one of management: to regulate systems and direct individuals. The approach is one of leadership: to optimize systems and to guide individuals.
Change management strategy The strategy is command/control; design and deploy. The strategy is to empower and encourage.
Management approach Management makes top-down decisions, ideally with local input. Management encourages local engagement; promotes agency for the teams.
Resultant culture Culture may have elements of security as clinicians don’t have to exert judgment over standard processes, yet culture also has elements of learned helplessness, along with fear or moral distress when the standard processes don’t match the needs of the patients. Culture is possibility-based; clinicians are empowered to embrace responsibility and creativity, and yet this requires additional cognitive work and accountability for outcomes beyond that of simply following a process.
At its worst Oppressive; flawed standards and metrics may harm people and cause burn-out. Chaotic, unreliable, poor quality, difficult to measure.
At its best Improves the chance that routine and required tasks will be performed, freeing clinicians for deep thinking and relationship building. Allows modification of care processes for people’s individual needs. Builds trust. Encourages innovation.
Example of care at its best System-wide initiative to reduce cardiovascular events by promoting medication adherence at every opportunity (office consult, flu shot, pharmacy visit, etc). Primary care team at satellite clinic develops a workflow that includes co-location of reception staff with nurses and MAs, allowing greater sharing of care under the supervision of the local site leadership.
Contrary to hospital rules, a husband was allowed in bed with his dying wife and to bring extended family members into the ICU.10

ICU = intensive care unit; MA = medical assistant.

And yet we also believe that health care, at its core, is fundamentally a relational endeavor—that diagnoses are more accurate, adherence is greater, costs less, when care is delivered on the foundation of a continuous, well-supported patient-physician relationship. Likewise, we believe that stable relationships between physicians and other care team members contribute to Quadruple Aim11 outcomes of better care, better health, lower costs, and greater clinician satisfaction.12 If we only measure transactional aspects of care and drive toward standardization to meet these measures, we believe we risk undermining one of the core drivers of quality, cost containment, and satisfaction—relationship-centered care.

Standardization

Consistency across clinical sites offers advantages to an organization: it provides guidance during emerging health threats, facilitates the training and cross coverage of staff, allows for a more predictable patient experience, and can promote the wider adoption of efficient workflows. Improved outcomes have resulted from standardized approaches to medication administration,4 use of ventilator bundles to avoid pneumonia,13 protocols during an emerging epidemic, and other interventions. Similarly, patient confidence in care may increase when standards are followed.14

Practices such as lean design, adapted from manufacturing, and workflow efficiency,15-21 as outlined in the American Medical Association’s Steps Forward program, may guide organizational standardization with the goals of improving patient flow, scheduling, and efficiency, and with the potential of improving staff satisfaction.22,23 Being explicit about care processes and task distribution ensures that standard, predictable work happens reliably, freeing up physicians and other team members to devote more of their cognitive bandwidth and energy to the unique needs of individual patients. For example, standard rooming tasks,18 in-box management,21 computerized order entry,24 care gap closure,18 and components of documentation16 can be entrusted to upskilled team members, affording physicians the time needed to attend to more complex medical needs and to strengthening patient trust and relationships.12,25

On the other hand, the challenges with standardization are multiple. The standard may have been established without sufficient input from those who are directly impacted by it; no matter how the standard was derived, it may still not best serve the needs of the individual patient or clinician, or the standard may not have been necessary at all. For these reasons, judgment is needed. For example, in some clinics the exact scheduled hours are set centrally by administration, in others the total number of patient contact hours per physician are prescribed with individual choice as to how to distribute across the week, and in still others, individual physicians set their own number of patient contact hours and schedule, within bounds, with corresponding financial consequences.

Customization

Standards are designed with the average or even worst case in mind. Yet patients, practices, and communities vary. The physician may be caught as the mediator between the standard use case that drove the design and the unique individual who presents for care. For those on the front lines of patient care, the challenge of serving both the standards and the needs of unique individuals can cause harm and dissatisfaction among patients and contribute to moral distress and burnout among professionals.26

Customization is important for the increasing number of patients with multiple comorbidities where the medical evidence does not provide sufficient tailored insights and where the patient may be far from the average case that drove the standards. Customization is also a key component of patient preference-based care,27 an approach which has been shown to reduce surgical procedures, hospitalizations, and overall costs.28

There are aspects of clinic operations for which both customized and standardized approaches are appropriate. For example, with respect to scheduling, wise standardization can achieve both fairness (“A full-time nurse works 40 hours per week”) while allowing for customization (“This team can meet the needs of their patients by establishing earlier start and end times 2 days per week.”).

On the other hand, too much customization in clinical and workflow decisions can increase the cognitive workload for clinicians who are left to design their own individual care pathways and workflows from scratch.

Principles

We propose 4 principles to employ when deciding between standardization and customization.

Collaboration

Processes and policies developed in collaboration with end users are more likely to improve compliance, promote agency, increase professional satisfaction, and achieve higher care quality. Perhaps as important as the standards themselves is the way they are developed and disseminated. Large hierarchical organizations often use top-down design and deploy strategies for standards development, implementation, and enforcement. Such an approach can leave physicians feeling like “cogs in machines,” exacerbating burnout.29 Actual examples of system-wide standards that thwart overall system goals can be found in Table 2. (Note that Table 2 highlights only problems that occur when the balance is too far in the direction of standardization; as discussed above, we recognize that there are many benefits to standardization when the balance is more appropriate.)

Table 2.

Examples of Hazards of Standardized Operations

Organization Standard Organizational Goals Actual Outcome Better Strategy
All nurse practitioners and physician assistants must work the same patient care hours, 8:00am to 4:30pm. Provide dependable access to care.
Treat all NPs and PAs the same.
Personal circumstances (eg, childcare) may prevent some individuals from working specified hours resulting in lower morale, difficulty with recruitment and retention, and worse access to care. Clinical sites allowed to work out coverage for specified hours and held accountable for access, resulting in greater individual flexibility, better team cohesion and morale.
On entering the exam room, the first task for physicians and staff must always be to log in to the computer. Provide time stamp of staff activities. Disrupts the “golden minute” at the start of the interaction, with less eye contact and lower patient and staff satisfaction. Promote routine of “patient first, computer second.”
If needed, track staff activities in other ways (eg, radiofrequency fob).
All emergency (“crash”) carts must have the same equipment and medication; no more or less. Better manage inventory. Prevent improper use. A woman at a rural site died after precipitous birth with uncontrolled uterine bleeding due to atonic uterus that did not respond to fundal massage. Transport time was at least 60 minutes to a hospital and there was no oxytocin or other tonic agents stocked in cart. Identify required items for all carts, and then allow additional items based on site needs.
Assure adequate training in the proper use of crash cart items (eg, ACLS, ALSO).
Medical assistants are not allowed to perform orthostatic blood pressures. Assure quality of care. Protect the clinical domain of one role type. Orthostatic blood pressures are not done as frequently as clinically useful; patients have reduced access to the unique skill set of their physicians (who are spending time doing orthostatic blood pressures on other patients). Uptrain the staff; allow the supervising clinical staff to determine medical assistant competency to perform orthostatic blood pressure.
All incoming patient calls are sent to a centralized call center. Efficiency
Reduce call volume for staff at clinic sites.
Continuity is disrupted and care is less personalized when patient speaks with a nurse with whom they have no relationship; patients may be routed to someone other than their personal physician even when that physician would have seen them for their need. Allow individual units to determine how best to handle calls for their unit—locally or via a back-up central call center.

ACLS = advanced cardiovascular life support; ALSO = advanced life support in obstetrics; NP = nurse practitioner; PA = physician assistant.

An alternative approach is exemplified by lean design, which is based on the principle that the work should be designed in collaboration with those who do the work.30 For example, advanced models of team-based care have been developed by the clinicians and their teams in collaboration with health system administrators.25,31-33 In addition to clinical staff, practices must also consider how to engage patients so that their perspectives and preferences are heard and respected.

System managers can look to implementation science for guidance in developing standards, as that literature discusses the need for a participatory process that builds on evidence-based best practices.34 An approach in which health care managers and clinical staff collaborate to determine which processes and standards are best left to individual practice sites and which benefit from uniformity across an organization will be better for patients, clinical teams, and organizations. Some questions to be addressed when standardization is considered appear in Table 3. Health care leaders should endeavor to standardize clinical processes with humility, respect, and ample end-user input, and push only those standards that are evidence-based and/or have stakeholder endorsement.35-38

Table 3.

Questions to Address Before Disseminating Organization-Wide Practice Standards

Domain Question Sub-Questions
Problem clarification What problem are we trying to solve with our standard? How important is it to address this issue?
What are the root causes of this problem?
Are the problems localized or generalized?
What is the evidence that the proposed standard is effective?
Collaboration Have we included front-line clinicians in the development of the standard? Has there been sufficient input from each clinical unit that will be impacted by the standard?
How are the various units working to improve this issue—what innovative ideas do they have?
What do individual sites or teams see as potentially beneficial improvements?
Has the standard been pilot tested with input from those impacted?
Is there agreement that a system-wide set of standards is needed?
How will we encourage local customization and evaluate its impact?
Consequences Have we considered unintended consequences? What are the potential harms to patients, teams and the organization from implementing the standards?
Resources Do we have sufficient resources to design, implement, and evaluate the impact of the standard? How difficult will it be to gather the evidence to design the standard?
Does the organization have the capacity to implement it?
Do we have valid metrics for subjective as well as objective outcomes?
Does the organization have the capacity to evaluate the full range of benefits and harms of implementing the standard?

Decision Authority

Empower the professionals closest to the patients with authority over the resources and processes in order to achieve the desired outcomes. An “empowering leadership” style that seeks frontline worker input and distributes authority may take more time in the short-run, but it can outperform a “directive leadership” approach in the long-run because it improves organizational learning, team morale, and collective problem solving.39 Likewise, moving authority for clinical oversight of staff functions locally will reduce waste. For example, central decision making at one practice prevents medical assistants from performing orthostatic blood pressure measurements, leaving this task to the physician. Yet, when oversight is moved closer to the practice, appropriate adjustments can be made based on demonstrated abilities of local staff.

Measurement

Seek measures of customization in addition to those of standardization, and strive for measurement parsimony.

It is widely agreed that current quality measures are excessive, with calls from within both the measurement and the broader health care communities for harmonization and parsimony. The National Academy of Medicine Vital Signs40 initiative identified thousands of measures used in the United States to oversee clinicians—contributing to work overload, clinical distraction, and burnout—and recommended a sharpened focus on just 15 core measures.

Measurement has traditionally relied on compliance with standardization (often reflecting a transactional conceptualization of health care). It is important to include measures that also account for customization (thereby reflecting a relational conceptualization of health care). The American Board of Family Medicine has proposed a reduction in the myriad of primary care measures to a single instrument, the Person-Centered Primary Care Measure, which assesses care across 11 domains including access, continuity, comprehensiveness, coordination, advocacy, and context. Representative questions from that instrument include: “In caring for me, my doctor considers all factors that affect my health” and “The care I get takes into account knowledge of my family.”41

One of the largest initiatives to standardize and measure quality is the Quality and Outcomes Framework (QOF) launched by the United Kingdom’s National Health Service in 2004. Focused on primary care, the QOF established 165 metrics against which the performances of the practices were audited and financially rewarded or punished. After 15 years, the QOF showed improvements in data collection and disease management strategies, but it had no effect on premature mortality42 and it disrupted therapeutic relationships. After billions of pounds invested, Northern Ireland, Scotland, and Wales have dropped the QOF; England has scaled it back substantially.

Likewise, in the United States after several decades of experience, pay for performance has not lived up to initial expectations of improved health outcomes and lower costs.43

For clinicians and staff, the added burden of such documentation44-47 contributes to decreased job satisfaction,48,49 with clinicians reducing work hours or considering a change in career in response.50 Increased documentation requirements tempt clinicians to multitask and to complete documentation during patient encounters,51 which can significantly decrease the quality of both the documentation and the care provided. Meaningful Use measures for electronic health record adoption contained many measures requiring documentation (eg, “implement one trackable clinical decision support rule”) that clinicians found to be of little use.52

Variation

Not all variation is bad. Variation in process measures can signal the need for greater standardization or alternatively, be a sign of appropriate customization.

Some variation in process measures will identify opportunities for improvement. For example, if one primary care site has thrice the number of prescription refill requests per chronic illness medication than another site, this may represent an opportunity to educate the clinicians and staff about the value of a systems approach to prescription renewal (ie, standard process of providing 90 days plus 4 refills for stable chronic illness medications)17 and offer support to the team in this process improvement implementation.

At other times variation in care will identify appropriate customization. For example, a practice with a high percentage of office workers who commute to work past the clinic site may find that early morning hours are popular with their patients, whereas a practice with a high percentage of teachers may find the need to have more late afternoon appointments.

CONCLUSION

A recent trend, particularly in large health care organizations, is toward standardization of clinical policies and care delivery. The hope is that such standardization will result in greater reliability, improved efficiency, and better outcomes. Yet, standardization can come into conflict with customization, and the values of individual agency, professional autonomy, and relationship-based care. At its best, standardized work can create efficiencies that generate additional time for more personalized care. Likewise, at its best, customization allows the people within a system to accommodate the needs, preferences, and circumstances of the unique individuals and local communities they serve. In summary, we believe that over the past 2 decades the balance has shifted too far toward standardization and that finding a right balance with customization will benefit patients, clinicians, and the health care system.

Footnotes

Conflicts of interest: authors report none.

To read or post commentaries in response to this article, go to https://www.AnnFamMed.org/content/19/2/171/tab-e-letters.

References

  • 1.Donabedian A. Evaluating the quality of medical care. 1966. Milbank Q. 2005; 83(4): 691-729. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Timmermans S, Mauck A. The promises and pitfalls of evidence-based medicine. Health Aff (Millwood). 2005; 24(1): 18-28. [DOI] [PubMed] [Google Scholar]
  • 3.Martin JC, Avant RF, Bowman MA, et al. The Future of Family Medicine: a collaborative project of the family medicine community. Ann Family Med. 2004; 2(Suppl 1): S3-S32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Bates DW. Preventing medication errors: a summary. Am J Health Syst Pharm. 2007; 64(14)(Suppl 9): S3-S9, quiz S24-S26. [DOI] [PubMed] [Google Scholar]
  • 5.Miller RR III, Dong L, Nelson NC, et al. ; Intermountain Healthcare Intensive Medicine Clinical Program . Multicenter implementation of a severe sepsis and septic shock treatment bundle. Am J Respir Crit Care Med. 2013; 188(1): 77-82. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.How Intermountain Trimmed health care costs through robust quality improvement efforts. Health Aff (Millwood). 2011; 30(6): 1185-1191. [DOI] [PubMed] [Google Scholar]
  • 7.Laffel G, Blumenthal D. The case for using industrial quality management science in health care organizations. JAMA. 1989; 262(20): 2869-2873. [PubMed] [Google Scholar]
  • 8.Song H, Tucker A. Performance improvement in health care organizations. Foundations and Trends in Technology, Information and Operations Management. 2016; 9(3–4): 153-309. [Google Scholar]
  • 9.Reuben DB, Sinsky CA. From transactional tasks to personalized care: a new vision of physicians’ roles. Ann Fam Med. 2018; 16(2): 168-169. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.DeMarco P. A letter to the doctors and nurses who cared for my wife. The New York Times. October 6, 2016. https://www.nytimes.com/2016/10/06/well/live/a-letter-to-the-doctors-and-nurses-who-cared-for-my-wife.html
  • 11.Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014; 12(6): 573-576. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Sinsky CA, Willard-Grace R, Schutzbank AM, Sinsky TA, Margolius D, Bodenheimer T. In search of joy in practice: a report of 23 high-functioning primary care practices. Ann Fam Med. 2013; 11(3): 272-278. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Klompas M, Li L, Kleinman K, Szumita PM, Massaro AF. Associations between ventilator bundle components and outcomes. JAMA Intern Med. 2016; 176(9): 1277-1283. [DOI] [PubMed] [Google Scholar]
  • 14.Finney Rutten LJ, Vieux SN, St Sauver JL, et al. Patient perceptions of electronic medical records use and ratings of care quality. Patient Relat Outcome Meas. 2014; 5: 17-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Sinsky CA. Pre-Visit laboratory testing. American Medical Association Steps Forward. Published March 29, 2015. https://edhub.ama-assn.org/steps-forward/module/2702697
  • 16.Sinsky CA. Team documentation. American Medical Association Steps Forward. Published October 23, 2014. https://edhub.ama-assn.org/steps-forward/module/2702598
  • 17.Sinsky CA. Annual prescription renewal. American Medical Association Steps Forward. Published October 23, 2014. https://edhub.ama-assn.org/steps-forward/module/2702751
  • 18.Sinsky CA. Expanded rooming and discharge protocols. American Medical Association Steps Forward. Published October 23, 2014. https://edhub.ama-assn.org/steps-forward/module/2702600
  • 19.Sinsky CA. Pre-Visit planning. American Medical Association Steps Forward. Published October 23, 2014. https://edhub.ama-assn.org/steps-forward/module/2702514
  • 20.Ashton M. Getting rid of stupid stuff. American Medical Association Steps Forward. Published December 19, 2019. https://edhub.ama-assn.org/steps-forward/module/2757858
  • 21.Jerzak J, Sinsky CA. EHR in-basket restructuring for improved efficiency. American Medical Association Steps Forward. Published June 29, 2017. https://edhub.ama-assn.org/steps-forward/module/2702694
  • 22.Kaltenbrunner M, Bengtsson L, Mathiassen SE, Högberg H, Engström M. Staff perception of Lean, care-giving, thriving and exhaustion: a longitudinal study in primary care. BMC Health Serv Res. 2019; 19(1): 652. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Puterman ML, Zhang Y, Aydede SK, et al. “If you’re not keeping score, you’re just practising”: a lean healthcare program evaluation framework. Healthc Q. 2013; 16(2): 23-30. [PubMed] [Google Scholar]
  • 24.Sinsky CA, Rajcevich E. Team-Based care. American Medical Association Steps Forward. Published October 7, 2015. https://edhub.ama-assn.org/steps-forward/module/2702513
  • 25.Sinsky CA, Bodenheimer T. Powering-Up primary care teams: advanced team care with in-room support. Ann Fam Med. 2019; 17(4): 367-371. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Whitehead PB, Herbertson RK, Hamric AB, Epstein EG, Fisher JM. Moral distress among healthcare professionals: report of an institution-wide survey. J Nurs Scholarsh. 2015; 47(2): 117-125. [DOI] [PubMed] [Google Scholar]
  • 27.Van Haitsma K, Abbott KM, Arbogast A, et al. A preference-based model of care: an integrative theoretical model of the role of preferences in person-centered care. Gerontologist. 2020; 60(3): 376-384. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Veroff D, Marr A, Wennberg DE. Enhanced support for shared decision making reduced costs of care for patients with preference-sensitive conditions. Health Aff (Millwood). 2013; 32(2): 285-293. [DOI] [PubMed] [Google Scholar]
  • 29.Southwick FS, Southwick SM. The loss of a sense of control as a major contributor to physician burnout: a neuropsychiatric pathway to prevention and recovery. JAMA Psychiatry. 2018; 75(7): 665-666. [DOI] [PubMed] [Google Scholar]
  • 30.Womack JPBA, Fiume OJ, Kaplan GS, Toussaint J. Going lean in health care. Institute for Healthcare Improvement 2005. Published 2005. https://www.ihi.org/resources/Pages/IHIWhitePapers/GoingLeaninHealthCare.aspx
  • 31.Jerzak J, Siddiqui G, Sinsky CA. Advanced team-based care: how we made it work. J Fam Pract. 2019; 68(7): E1-E8. [PubMed] [Google Scholar]
  • 32.Linzer M, Manwell LB, Williams ES, et al. Working conditions in primary care: physician reactions and care quality. Ann Intern Med. 2009; 151(1): 28-36, W26-29. [DOI] [PubMed] [Google Scholar]
  • 33.Hopkins K, Sinsky CA. Team-Based care: saving time and improving efficiency. Fam Pract Manag. 2014; 21(6): 23-29. [PubMed] [Google Scholar]
  • 34.Miller WL, Rubinstein EB, Howard J, Crabtree BF. Shifting implementation science theory to empower primary care practices. Ann Fam Med. 2019; 17(3): 250-256. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Shekelle PG. Clinical practice guidelines: what’s next? JAMA. 2018; 320(8): 757-758. [DOI] [PubMed] [Google Scholar]
  • 36.Stiles MM, Barrett B, Beasley JW. METRICS for metrics. WMJ. 2018; 117(3): 104-105. [PubMed] [Google Scholar]
  • 37.MacLean CH, Kerr EA, Qaseem A. Time Out - charting a path for improving performance measurement. N Engl J Med. 2018; 378(19): 1757-1761. [DOI] [PubMed] [Google Scholar]
  • 38.Chandra A, Staiger DO. Identifying sources of inefficiency in health-care. Q J Econ. 2020; 135(2): 785-843. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Lorinkova NM, Pearsall MJ, Sims HP. Examining the differential longitudinal performance of directive versus empowering leadership in teams. Acad Manage J. 2013; 56(2): 573-596. [Google Scholar]
  • 40.National Academies of Sciences, Engineering, and Medicine . Vital signs: core metrics for health and health care progress. Published 2015. Accessed May 25, 2020. https://www.nap.edu/catalog/19402/vital-signs-core-metrics-for-health-and-health-care-progress
  • 41.Etz RS, Zyzanski SJ, Gonzalez MM, Reves SR, O’Neal JP, Stange KC. A new comprehensive measure of high-value aspects of primary care. Ann Fam Med. 2019; 17(3): 221-230. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Kontopantelis E, Springate DA, Ashworth M, Webb RT, Buchan IE, Doran T. Investigating the relationship between quality of primary care and premature mortality in England: a spatial whole-population study. BMJ. 2015; 350: h904. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Mendelson A, Kondo K, Damberg C, et al. The effects of pay-for-performance programs on health, health care use, and processes of care: a systematic review. Ann Intern Med. 2017; 166(5): 341-353. [DOI] [PubMed] [Google Scholar]
  • 44.Arndt BG, Beasley JW, Watkinson MD, et al. Tethered to the EHR: primary care physician workload assessment using ehr event log data and time-motion observations. Ann Fam Med. 2017; 15(5): 419-426. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Young RA, Burge SK, Kumar KA, Wilson JM, Ortiz DF. A time-motion study of primary care physicians’ work in the electronic health record era. Fam Med. 2018; 50(2): 91-99. [DOI] [PubMed] [Google Scholar]
  • 46.Sinsky C, Colligan L, Li L, et al. Allocation of physician time in ambulatory practice: a time and motion study in 4 specialties. Ann Intern Med. 2016; 165(11): 753-760. [DOI] [PubMed] [Google Scholar]
  • 47.Downing NL, Bates DW, Longhurst CA. Physician burnout in the electronic health record era: are we ignoring the real cause? Ann Intern Med. 2018; 169(1): 50-51. [DOI] [PubMed] [Google Scholar]
  • 48.Shanafelt TD, Dyrbye LN, Sinsky C, et al. Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction. Mayo Clin Proc. 2016; 91(7): 836-848. [DOI] [PubMed] [Google Scholar]
  • 49.Adler-Milstein J, Zhao W, Willard-Grace R, Knox M, Grumbach K. Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc. 2020; 27(4): 531-538. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Sinsky CA, Dyrbye LN, West CP, Satele D, Tutty M, Shanafelt TD. Professional satisfaction and the career plans of us physicians. Mayo Clin Proc. 2017; 92(11): 1625-1635. [DOI] [PubMed] [Google Scholar]
  • 51.Sinsky CA, Beasley JW. Texting while doctoring: a patient safety hazard. Ann Intern Med. 2013; 159(11): 782-783. [DOI] [PubMed] [Google Scholar]
  • 52.Holman GT, Waldren SE, Beasley JW, et al. Meaningful use’s benefits and burdens for US family physicians. J Am Med Inform Assoc. 2018; 25(6): 694-701. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Annals of Family Medicine are provided here courtesy of Annals of Family Medicine, Inc.

RESOURCES