Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Jun 15.
Published in final edited form as: Ann Emerg Med. 2019 Dec 23;75(6):715–720. doi: 10.1016/j.annemergmed.2019.10.015

Tolerance of Uncertainty and the Practice of Emergency Medicine

Timothy F Platts-Mills 1,*, Justine M Nagurney 2, Edward R Melnick 3
PMCID: PMC7294596  NIHMSID: NIHMS1591192  PMID: 31874767

Medicine is a science of uncertainty and an art of probability.

—William Osler1

Reduction of uncertainty is essential to the practice of medicine, but elimination of uncertainty is impossible.

—Benjamin Djulbegovic and Sander Greenland2

Uncertainty is inherent in the practice of medicine. Dermatologists can never be completely certain that a benign-appearing skin lesion is not a skin cancer; radiologists cannot be certain that changes on a chest radiograph are the result of pneumonia. No diagnostic test is 100% accurate, and even with additional testing such as a biopsy or a computed tomography (CT) scan, some degree of uncertainty remains. Until recently, physicians have had little choice but to tolerate uncertainty. Clinical radiography and electrocardiography did not become available until the end of the 19th century, and many other diagnostic tests have become part of routine clinical practice only in the past few decades. Uncertainty has always been a reality, but increased availability of diagnostic options means that the physician’s response to uncertainty is now an important factor in clinical care.

In caring for patients with undifferentiated acute symptoms, emergency physicians face uncertainty more frequently and with greater consequence than most other physicians. Since the inception of our specialty, most US emergency physicians have practiced under a fee-for-service reimbursement model with significant litigation risk. This practice environment has distorted incentives for decisionmaking toward overtesting. The shift to value-based or capitated payment models is bringing increased attention to emergency department (ED) testing and admission decisions. Electronic health records allow those decisions to be routinely examined at the level of the individual physician. An essential determinant of success in the face of new payment models and increased scrutiny will be the tolerance of uncertainty,3 which allows us to avoid tests that are unlikely to inform management and that have risks and costs for the patient being tested, cause delayed care for other patients, and add to the societal burden of health care costs. Excess testing also increases the number of false-positive test results, which leads to further testing. In this article, we review sources of uncertainty in emergency medicine, present evidence of wide variance in emergency physician test use, describe the psychological trait underlying tolerance of uncertainty and other factors that influence the physician response to uncertainty, and introduce a strategy for better accommodating uncertainty in the practice of emergency medicine.

There are multiple sources of uncertainty in emergency medicine. Patients come to emergency physicians as unknowns. There is uncertainty in regard to a patient’s history, particularly the nature and timing of symptoms preceding the ED visit. There is uncertainty in what we currently understand about the manifestations and causes of disease. There is uncertainty in that diagnostic tests are not perfectly accurate. And there is uncertainty in regard to the benefits and harms of treatments for an individual patient. Research can help improve our understanding of how diseases present, clarify the diagnostic accuracy of tests, and define the potential benefits and harms of a given treatment, but some uncertainty will always remain.

A common emergency physician approach to decisionmaking in the face of uncertainty, particularly in busy practice environments in which physician time is a limiting factor, is a liberal approach to diagnostic testing and hospital admission. This approach manifests itself in protocol-driven triage orders, a tactic that makes sense for many testing decisions (eg, ECGs for chest pain, urinalysis and urine pregnancy testing for women with abdominal symptoms). Such an approach makes less sense for decisions that have greater potential for harm, are more expensive, or have poor specificity. Data from our own practices suggest a large range of test use and admission rates among attending emergency physicians: per-patient rates of advanced imaging among attending physicians range from 40% to 110% (ie, >1 study per patient); hospital admission rates range from 34% to 52%. For the use of head CT for minor head trauma, rates of CT ordering among emergency providers in Alberta, Canada, ranged from 4% to 100%.4 Within these wide ranges of use, the high testing and hospital admission approach has little or no benefit to patients and can be dangerous.5-7 Estimates for the total cost of unnecessary care in the United States range from $760 to $935 billion,8 and many of the studies examining the relationship between health spending and outcomes have found a negative relationship.9,10 Not all of this unnecessary care is driven by emergency physicians, but some of it is.

A number of factors have been identified that may influence physician decisionmaking in the face of uncertainty. The most fundamental of these is our own personalities. Although there are likely numerous personality traits that influence clinical decisionmaking, the trait of particular interest here is ambiguity tolerance-intolerance, a construct that was developed as part of examinations of ethnocentric and authoritarian personalities in children, but has since been studied in medical students and physicians. A 16-item scale developed by Budner11 provides a formal assessment of this construct. An example item statement with which one might agree or disagree is, “An expert who doesn’t come up with a definite answer probably doesn’t know too much.” (Agreement with this statement suggests a low tolerance for uncertainty.) Although the trait uses the term ambiguity, we will return to the word uncertainty; for the purposes of this article, we consider tolerance of ambiguity and tolerance of uncertainty the same concepts. Within the context of medical care, we interpret tolerance of uncertainty as a description of the approach to decisions about diagnostic testing and treatment, not a description of the patient assessment. Emergency physicians should always take a careful history, perform a thorough directed physical examination, and review relevant medical records; having tolerance of uncertainty does not give one license to skip the rigorous collection of relevant data to inform medical decisionmaking. Available data suggest that medical students who are men, those who are white, and those who are younger when they begin medical school all tend to have less tolerance of uncertainty.12 Tolerance of uncertainty also varies according to the prospective specialty of the student, with students pursuing surgery residency having lower tolerance of uncertainty than those in the other specialties studied.12 Variance in tolerance for uncertainty by medical specialty may be appropriate, but some tolerance of uncertainty is probably a virtue regardless of medical specialty because low tolerance for uncertainty has been linked to increased test ordering, failure to follow evidence-based guidelines, and fear of medical malpractice.13

Proposals have been made to use tolerance for uncertainty as a criterion during the medical student selection process or teach it in medical school.14-17 But whether tolerance for uncertainty can be taught is a mostly unanswered question. A single study of an educational curriculum to increase tolerance of ambiguity provided to residents as part of a 4-week outpatient family medicine rotation had a sustained effect on the perceived threat of ambiguity but little or no effect on other outcomes.18 We were also unable to find studies assessing tolerance for uncertainty among emergency physicians. A pragmatist might believe that individuals who choose emergency medicine as a career have a high tolerance for uncertainty in order to be able to conduct the work. However, a psychologist might argue the opposite, that physicians choose emergency medicine as a way of getting control of their intolerance of uncertainty. Regardless, a greater tolerance for uncertainty might lead to lower rates of test ordering and greater career satisfaction, but this is not known. Regardless of one’s personality type, we think all emergency physicians can benefit from contemplating their strengths and weaknesses vis-à-vis tolerance of uncertainty. We might not be able to change who we are, but we can at least be aware.

A number of other factors interact with our personalities to influence emergency physician decisionmaking. One challenge is a cognitive one: we tend to give excess weight to the benefits of diagnosis and intervention while underemphasizing potential harms.19 One reason for this is that the adverse consequences from overtesting and hospitalization generally occur on a much longer timeline than the consequences of a missed diagnosis. A CT scan may increase a patient’s lifetime risk of cancer, but if cancer develops, it may not show up for 20 years or more. In contrast, when we miss a consequential diagnosis, we are usually immediately informed of the error through informal or formal pathways such as the morbidity and mortality conference. Even if the discussion about a missed diagnosis covers the potential harms of overtesting, the take-home message is usually that one should have been more careful and ordered the test. A second explanation for why physicians fail to give consideration to potential harms is the black swan theory,20 which posits that people have difficulty conceptualizing the importance of low-probability but consequential events. For example, because contrast-induced anaphylaxis is rare, emergency physicians may simply ignore this risk when making clinical decisions in regard to contrast studies. Ideally, however, this risk would be given some weight. In addition to physical harms, emergency physicians should also consider emotional harms to the patient as well as the opportunity costs to patients waiting to be treated and to society from the unnecessary use of expensive health care resources.21 Of course, either testing or not testing could generate emotional harm, but evidence indicates that physician conversations with patients are as effective as or more effective than testing in reducing anxiety.22,23

A second cognitive error that can influence decisionmaking is incorrect assumptions about patient preferences.24-26 The literature on pediatrician antibiotic prescribing reveals that physicians often incorrectly assume parents want antibiotics for their children.27 Emergency physicians probably make similar incorrect assumptions favoring more intensive testing and treatment. Among an unselected population of ED patients presented with a hypothetical scenario of hospital admission for serial troponin levels, 25% of patients stated they were willing to accept a high risk of adverse outcomes, defined as a rate of 5% or higher, to avoid further testing.28 Similarly, among ED patients with chest pain, hospitalization was judged to be necessary only when the risk of acute coronary syndrome was at least 6.5%. In contrast, physicians place the risk threshold for admission at or below 1%.29,30 These discrepancies suggest that physicians and patients often see the world differently, and we need to avoid assuming that we know the risk tolerance of our patients.31,32 A related incorrect assumption sometimes made by physicians is that patients want a “unilateral directive approach” in which the physician makes the decisions.33 This is true for some patients, but the majority of ED patients wish to have some involvement in medical decisions, especially in the case of more serious medical problems.34,35

Our ability to manage uncertainty is also influenced by our training. Medical training has traditionally emphasized declarative knowledge conveying assurance over acknowledging and managing uncertainty. The use of multiple-choice tests as the basis for medical education and licensure likely reduces critical thinking36 and reinforces the idea that there is a single correct answer for any given clinical scenario, a perspective that is both inconsistent with reality and antithetical to the tolerance of uncertainty. Part of the solution to this is to increase awareness of the importance of critical thinking and, specifically, to teach medical trainees to examine how their cognitive biases can contribute to diagnostic errors and patient harm.37 Rather than expecting medical students to memorize a long list of concepts and “facts,” educators should spend more time emphasizing the importance of critical inquiry and discussing strategies for weighing the risks, benefits, and alternatives to various diagnostic and treatment options, as well as teaching students how to understand and factor in an individual patient’s preferences, values, and goals.31 Presumably, this would better prepare physicians for wrestling with uncertainty when it inevitably arises. Medical training also often cultivates a hierarchic approach, with the physician being the confident, all-knowing leader, despite that strong hierarchies increase medical errors and physician overconfidence decreases patient trust.24,38 Training of emergency physicians also often follows a “rule out the worst-case scenario” approach to clinical decisionmaking, which tends to be more resource intensive than a hypotheticodeductive approach in which the physician makes and tests a series of diagnostic hypotheses.39 Consideration of the worst-case scenario likely ought to remain a central part of how emergency physicians approach a case because this approach reflects our primary responsibility. But the differential diagnosis should be used to help physicians think about a variety of serious conditions, not imply that testing is required for each of them.

Practice setting, culture, and policies also influence how we manage uncertainty. For many clinical conditions, a period of observation is a safe and cost-effective diagnostic tool (“tincture of time”). ED crowding and pressure to make decisions quickly to minimize ED length of stay make this approach less feasible. Expectations of referring, consulting, and admitting physicians can also put pressure on us to answer questions that sometimes don’t have to be answered. We might be comfortable admitting a patient without a definitive explanation for his or her symptoms, but the admitting physician might not. Physicians should also be aware of the concept of decision fatigue, the decline in the quality of decisions that occurs after a sustained period of decisionmaking. The literature on decision fatigue indicates that when fatigue sets in, people tend to resort to more conservative behaviors. Although the most widely publicized study of decision fatigue described the decline in parole offers for inmates during the course of the day,40 this phenomenon has also been described for antibiotic prescribing (more during the course of a day),41 influenza vaccinations and cancer screening orders (fewer),42,43 hand hygiene compliance (less),44 and adenoma detection during colonoscopies (less).45 In emergency medicine, decision fatigue may manifest itself as lower thresholds for diagnostic testing and admission. Strategies to protect against or allow recovery from decision fatigue may serve to preserve tolerance of uncertainty during the course of a shift.

We suggest strategies that individual physicians (Table 1) and physician groups, departments, or professional societies (Table 2) can undertake to strengthen the tolerance of uncertainty in emergency medicine decisionmaking. Individual steps are by no means required for all encounters, but may prove particularly useful in situations in which the value of a test or admission is unclear. These steps are rooted in shared decisionmaking46,47 but informed by the considerations listed earlier in regard to the role of uncertainty in emergency care.

Table 1.

Strategy for an individual physician to integrate uncertainty into emergency medicine decisionmaking.

Step Justification and Considerations
Identify and acknowledge uncertainty Almost all cases contain some area of uncertainty in regard to optimal diagnostic approach or treatment.
Identifying and acknowledging this can help you accept uncertainty as part of the practice of emergency medicine.
In some cases, discussing this explicitly with patients can help normalize uncertainty and help patients consider treatment options.
Explain options In cases for which there is substantial uncertainty, serious potential consequences, more than one option available, and adequate time to do so, presenting options to the patient is appropriate.
Observation may be considered a diagnostic strategy.
Limitations of more intensive testing or treatment should be described.
Clinical decisions aids and narratives appropriate to the patient’s literacy and numeracy can be helpful.
Assess risk tolerance Assessing a patient’s values and preferences may help to determine the approach that is most appropriate for him or her.
Consider asking patients what they think is wrong, what they think their risk of a serious condition is, and whether they think they need a specific test (ideas, concerns, and expectations).
Reassure the patient For low-risk patients, empathic care may reduce anxiety more than additional testing.
Counseling and reassurance should be accompanied by a description of how a missed diagnosis might subsequently manifest and by clear return precautions.

Table 2.

Physician group, department, and professional-society-level processes and procedures to support physician tolerance of uncertainty.

Domain Justification and Considerations
Quality improvement/peer review Include cases in morbidity and mortality conferences with adverse outcomes or unnecessary admissions caused by overtesting.
Administrators advocate and support physicians who tolerate uncertainty when decisionmaking is challenged by consultants and admitting physicians (eg, formal endorsement of Choosing Wisely recommendations by department/hospital leadership and risk management).
Promote a culture in which ED decisions are not criticized retrospectively according to information that becomes available after the ED visit.
Patient care metrics Assess adequacy of shared decisionmaking as part of patient satisfaction surveys.
Use audit and feedback physician resources, particularly for advanced imaging and admissions, including Choosing Wisely measures.
Eliminate ED returns as an adverse event metric, or qualify this metric according to whether the decisionmaking for the initial visit was within the standard of care.
Work flows Support alternative care pathways for patients who would likely benefit from observation rather than additional testing.
Facilitate efficient physician access to evidence-based clinical decision support.
Use joint education of physician and nursing staff in regard to thresholds for testing and admission to reduce occurrences of inconsistent and discrepant patient communication on these issues.
Professional societies Emergency medicine organizations advocate didactic sessions and training on tolerance of uncertainty.
Participate in an annual conference about preventing overdiagnosis.
Prioritize additional research on acceptable risk thresholds for both patients and physicians.
Disseminate guidelines that identify clinical scenarios in which there are multiple acceptable approaches because of uncertain risks/benefits.
Work with lawyers and judges to better define the liability of physicians who miss a diagnosis as a result of a decision not to perform a diagnostic test that, at the time, was considered to have a very low likelihood of having a positive result.

CONCLUSION

Emergency medicine is changing. Diagnostic and treatment options continue to expand. Fee-for-service payment structures are being replaced with payment mechanisms that make health care providers accountable for costs. With these changes comes pressure to reduce testing and hospitalizations. In response to these changes and to optimize care, emergency physicians will benefit from a greater awareness of their own tolerance of uncertainty and from cultivating the ability to discuss uncertainty with their patients. Doing so has the potential to make our patients safer, better informed, and more satisfied, thus increasing the value of emergency care.

Acknowledgments

The authors acknowledge Jane Brice, MD, MPH, and Chris Jones, MD, for their comments on this work.

Funding and support: By Annals policy, all authors are required to disclose any and all commercial, financial, and other relationships in any way related to the subject of this article as per ICMJE conflict of interest guidelines (see www.icmje.org). The authors have stated that no such relationships exist. Dr. Nagurney is supported by the National Institute on Aging of the National Institutes of Health under award 5T32AG023480-12.

Footnotes

Supervising editor: David L. Schriger, MD, MPH. Specific detailed information about possible conflict of interest for individual editors is available at https://www.annemergmed.com/editors.

Contributor Information

Timothy F. Platts-Mills, Department of Emergency Medicine, University of North Carolina, Chapel Hill, NC.

Justine M. Nagurney, Department of Emergency Medicine, Beth Israel Deaconess Medical Center, and the Institute for Aging Research, Hebrew Senior Life, Boston, MA.

Edward R. Melnick, Department of Emergency Medicine, Yale–New Haven Hospital, New Haven, CT.

REFERENCES

  • 1.Osler W, Bean WB. Sir William Osler: Aphorisms From His Bedside Teachings and Writing. Springfield, IL: Charles C. Thomas; 1961. [Google Scholar]
  • 2.Djulbegovic B, Greenland S. Uncertainly in clinical medicine In: Gifford F, ed. Philosophy of Medicine. Oxford, United Kingdom: Elsevier; 2011:16–299. [Google Scholar]
  • 3.Simpkin AL, Schwartzstein RM. Tolerating uncertainty—the next medical revolution? N Engl J Med. 2016;375:1713–1715. [DOI] [PubMed] [Google Scholar]
  • 4.Grigat D, Innes G, Andruchow J, et al. In support of Choosing Wisely: variation in CT ordering for patients presenting to emergency with minor head injury. CJEM. 2016;18:S38. [Google Scholar]
  • 5.Lessler AL, Isserman JA, Agarwal R, et al. Testing low-risk patients for suspected pulmonary embolism: a decision analysis. Ann Emerg Med. 2010;55:316–326.e1. [DOI] [PubMed] [Google Scholar]
  • 6.Melnick ER, Keegan J, Taylor RA. Redefining overuse to include costs: a decision analysis for computed tomography in minor head injury. Jt Comm J Qual Patient Saf. 2015;41; 313–AP2. [DOI] [PubMed] [Google Scholar]
  • 7.Taylor RA, Singh Gill H, Marcolini EG, et al. Determination of a testing threshold for lumbar puncture in the diagnosis of subarachnoid hemorrhage after a negative head computed tomography: a decision analysis. Acad Emerg Med. 2016;23:1119–1127. [DOI] [PubMed] [Google Scholar]
  • 8.Berwick DM. Elusive waste: the Fermi paradox in US health care. JAMA. 2019;322:1501–1509. [DOI] [PubMed] [Google Scholar]
  • 9.Hussey PS, Wertheimer S, Mehrotra A. The association between health care quality and cost: a systematic review. Ann Intern Med. 2013;158:27–34. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Grady D, Redberg RF. Less is more: how less health care can result in better health. JAMA Intern Med. 2010;170:749–750. [DOI] [PubMed] [Google Scholar]
  • 11.Budner S Intolerance of ambiguity as a personality variable. J Pers Soc Psychol. 1962;30:29–50. [DOI] [PubMed] [Google Scholar]
  • 12.Geller G, Faden RR, Levine DM. Tolerance for ambiguity among medical students: implications for their selection, training and practice. Soc Sci Med. 1990;31:619–624. [DOI] [PubMed] [Google Scholar]
  • 13.Geller G Tolerance for ambiguity: an ethics-based criterion for medical student selection. Acad Med. 2013;88:581–584. [DOI] [PubMed] [Google Scholar]
  • 14.Kozlowski D, Hutchinson M, Hurley J, et al. The role of emotion in clinical decision making: an integrative literature review. BMC Med Educ. 2017;17:255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kahneman D Thinking, Fast and Slow. New York, NY: Farrar, Straus & Giroux; 2011. [Google Scholar]
  • 16.Damásio A Descartes’ Error: Emotion, Reason, and the Human Brain. New York, NY: GP Putnam; 1994. [Google Scholar]
  • 17.Kanzaria HK, Hoffman JR, Probst MA, et al. Emergency physician perceptions of medically unnecessary advanced diagnostic imaging. J Acad Emerg Med. 2015;22:390–398. [DOI] [PubMed] [Google Scholar]
  • 18.Taylor D, Picker B, Woolever D, et al. A pilot study to address tolerance of uncertainty among family medicine residents. Fam Med. 2018;50:531–538. [DOI] [PubMed] [Google Scholar]
  • 19.Hoffmann TC, Del Mar C. Clinicians’ expectations of the benefits and harms of treatments, screening, and tests: a systematic review. JAMA Intern Med. 2017;177:407–419. [DOI] [PubMed] [Google Scholar]
  • 20.Taleb NN. The Black Swan: The Impact of the Highly Improbable. New York, NY: Random House Trade Paperbacks; 2010. [Google Scholar]
  • 21.Kilo CM, Larson EB. Exploring the harmful effects of health care. JAMA. 2009;302:89–91. [DOI] [PubMed] [Google Scholar]
  • 22.Melnick ER. How to make less more: empathy can fill the gap left by reducing unnecessary care. BMJ. 2015;351:h5831. [DOI] [PubMed] [Google Scholar]
  • 23.Melnick E, Shafer K, Rodulfo N, et al. Understanding Overuse of Computed Tomography for Minor Head Injury in the Emergency Department: A Triangulated Qualitative Study. Acad Emerg Med. 2015;22:1474–1483. [DOI] [PubMed] [Google Scholar]
  • 24.Salmon P, Ring A, Dowrick CF, et al. What do general practice patients want when they present medically unexplained symptoms, and why do their doctors feel pressurized? J Psychosom Res. 2005;59:255–260. [DOI] [PubMed] [Google Scholar]
  • 25.Little P, Dorward M, Warner G, et al. Importance of patient pressure and perceived pressure and perceived medical need for investigations, referral, and prescribing in primary care: nested observational study. BMJ. 2004;328:444. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Rolfe A, Burton C. Reassurance after diagnostic testing with a low pretest probability of serious disease: systematic review and meta-analysis. JAMA Intern Med. 2013;173:407–416. [DOI] [PubMed] [Google Scholar]
  • 27.Mangione-Smith R, McGlynn EA, Elliott MN, et al. The relationship between perceived parental expectations and pediatrician antimicrobial prescribing behavior. Pediatrics. 1999;103:711–718. [DOI] [PubMed] [Google Scholar]
  • 28.Padalecki J, Xu KT, Smith C, et al. How much risk are emergency department patients willing to accept to avoid diagnostic testing? Turk J Emerg Med. 2017;17:16–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Brown TB, Cofield SS, Iyer A, et al. Assessment of risk tolerance for adverse events in emergency department chest pain patients: a pilot study. J Emerg Med. 2010;39:247–252. [DOI] [PubMed] [Google Scholar]
  • 30.Schriger DL, Menchine M, Wiechmann W, et al. Emergency physician risk estimates and admission decisions for chest pain: a Web-based scenario study. Ann Emerg Med. 2018;72:511–522. [DOI] [PubMed] [Google Scholar]
  • 31.Katz JN. The Silent World of Doctor and Patient. Baltimore, MD: Johns Hopkins University Press; 1984. [Google Scholar]
  • 32.Chen JC, Cooper RJ, Lopez-O’Sullivan A, et al. Measuring patient tolerance for future adverse events in low-risk emergency department chest pain patients. Ann Emerg Med. 2014;64:137–139. [DOI] [PubMed] [Google Scholar]
  • 33.Kanzaria HK, Brook RH, Probst MA, et al. Emergency physician perceptions of shared decision-making. J Acad Emerg Med. 2015;22:399–405. [DOI] [PubMed] [Google Scholar]
  • 34.Schoenfeld EM, Goff SL, Downs G, et al. A qualitative analysis of patients’ perceptions of shared decision making in the emergency department: “let me know I have a choice.” J Acad Emerg Med. 2018;25:716–727. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Schoenfeld EM, Kanzaria HK, Quigley DD, et al. Patient preferences regarding shared decision making in the emergency department: findings from a multisite survey. J Acad Emerg Med. 2018;25:1118–1128. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Stanger-Hall KF. Multiple-choice exams: an obstacle for higher-level thinking in introductory science classes. CBE Life Sci Educ. 2012;11:294–306. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Royce CS, Hayes MM, Schwartzstein RM. Teaching critical thinking: a case for instruction in cognitive biases to reduce diagnostic errors and improve patient safety. Acad Med. 2019;94:187–194. [DOI] [PubMed] [Google Scholar]
  • 38.Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care. 2004;13:i85–i90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Sandhu H, Carpenter C, Freeman K, et al. Clinical decisionmaking: opening the black box of cognitive reasoning. Ann Emerg Med. 2006;48:713–719. [DOI] [PubMed] [Google Scholar]
  • 40.Danziger S, Levav J, Avnaim-Pesso L. Extraneous factors in judicial decisions. Proc Natl Acad Sci U S A. 2011;108:6889–6892. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Linder JA, Doctor JN, Friedberg MW, et al. Time of day and the decision to prescribe antibiotics. JAMA Intern Med. 2014;174:2029–2031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Kim RH, Day SC, Small DS, et al. Variations in influenza vaccination by clinic appointment time and an active choice intervention in the electronic health record to increase influenza vaccination. JAMA Netw Open. 2018;1:e181770–e181770. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Hsiang EY, Mehta SJ, Small DS, et al. Association of primary care clinic appointment time with clinician ordering and patient completion of breast and colorectal cancer screening. JAMA Netw Open. 2019;2: e193403. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Dai H, Milkman KL, Hofmann DA, et al. The impact of time at work and time off from work on rule compliance: the case of hand hygiene in health care. J Appl Psychol. 2015;100:846–862. [DOI] [PubMed] [Google Scholar]
  • 45.Chan MY, Cohen H, Spiegel BMR. Fewer polyps detected by colonoscopy as the day progresses at a Veteran’s Administration teaching hospital. Clin Gastroenterol Hepatol. 2009;7:1217–1223. [DOI] [PubMed] [Google Scholar]
  • 46.Charles C, Gafni A, Whelan T. Shared decision-making in the medical encounter: what does it mean? (or it takes at least two to tango). Soc Sci Med. 1997;44:681–692. [DOI] [PubMed] [Google Scholar]
  • 47.Hess EP, Grudzen CR, Thomson R, et al. Shared decision-making in the emergency department: respecting patient autonomy when seconds count. J Acad Emerg Med. 2015;22:856–864. [DOI] [PubMed] [Google Scholar]

RESOURCES