Abstract
Consultations entail transitions in care between referrers and consultants, as patients visit different clinicians and care sites. This complex process has been consistently prone to communication breakdowns. Despite expectations and benefits of electronic health records (EHRs), incomplete, vague, or inappropriate referrals continue to hinder consultations; referrals can be sent to the wrong specialty service; and consultation findings frequently fail to reach referrers. Due to the inadequate support of interpersonal communication afforded by EHRs, these issues persist. Important aspects of ergonomics and human factors engineering frequently appear overlooked during the design and implementation of EHRs. Usability issues have contributed to delays in medical diagnosis, treatment, and follow-up. Some of these delays contribute to patient harms. Our multidisciplinary team of clinicians and ergonomics professionals reflects on referral and consultation. We describe how computerization in healthcare should benefit from approaches informed and developed through applied ergonomics and human factors.
Keywords: Referral and Consultation, Human Factors and Ergonomics, Electronic Health Records
1. Introduction
More than one-third of patients are referred to a specialist each year in the U.S.1 In our current era of electronic health record (EHR) systems, these clinical handoffs among clinicians are accompanied by care transitions among patients, requiring not only clinical evaluation and management, but completion and transmission of electronic documents1 Unfortunately, important aspects of ergonomics and human factors engineering (HFE) are not evident in EHR designs and implementation strategies that we have seen. These aspects are needed to provide acceptable usability, minimize risk, aid efficiency, and improve outcomes.2 As a result, an important consultation can be hindered by a referral that is incomplete, too vague to be useful, or inappropriate. In other cases, referrals are sent to the wrong specialty service, or the consultation findings that eventually emerge do not reach the referring clinician.3 Although interoperability is a goal, standards for exchanging health information about referrals and consultations have been slow to develop. Needed interpersonal communication surrounding referrals has also suffered. These socio-technical barriers have decreased the efficiency and effectiveness of the referral process. Furthermore, patients and clinicians have experienced adverse outcomes as a result of systems that process referrals and consultations.4,5 Based on the clinical experiences of and research conducted by our team and others, we describe how the process of integrating health information technology into referrals and consultations via EHRs has led to certain gains as well as losses and uncertainties, and how sociotechnical approaches for design and implementation could be leveraged to improve the process of referral and consultation.
2. Anatomy of a referral: the clinical perspective
Although the term "consultation" is broadly used to mean the entire process of both referral and consultation, we refer to "referral" separately from "consultation", because these are different activities that occur in sequence.2 Referral is a process whereby a referring clinician formally requests that a consultant evaluate a patient, after deciding that the patient should undergo such an evaluation. Effective referrals provide all pertinent medical history, potentially including medication listings, findings upon physical examination, and diagnostic test results. The consultation is what the consultant does after accepting the referral and arranging to meet with the patient. Consultation includes evaluation, findings, recommendations, and any procedures that may also be directly conducted by the consultant. A primary-care response process occurs following consultation. Steps are shown in the Figure.
Figure. Steps in referral and consultation.
The process is characterized, sequentially, by primary-care initiation, consultant activation, and primary-care response.
EHRs did not alter the importance of transmitting the key details of referral and consultation, and communicating, person to person, about the transmitted information. Pre-EHR reports indicated that referrers should always identify a question to be answered, and establish the urgency of the issue; consultants should address contingency plans for anticipated clinical problems, and include a teaching function so that referrers can engage in continuous learning .3 The required communication surrounding the multitude of steps in referral and consultation (Figure) requires more time and planning than often occur. The EHR, however, seems to have altered actual practice: there now appears to be a habit whereby transmission of information replaces, instead of supports, communication. Some differences observed before and after the advent of EHR systems are described below.
Before EHRs.
Aside from communicating with the patient about a referral, a referrer would often speak with a consultant before the referral, to discuss the patient, clarify the clinical question, and reach agreement about next steps. Similarly, consultants would often contact referrers following consultation, to review findings, recommendations, and follow-up plans directly. These discussions were based on a relationship between a referrer and a consultant. In addition, “curbside consultations”—informal discussions outside medical records and without a referral—were frequent. The curbside discussion could address a straightforward question or an issue that a potential referrer could handle directly, provided that the consultant could provide some timely and concise advice without evaluating the patient. Thus, curbside questions have often referred to medical knowledge at large, or a hypothetical patient who is like the real patient.
After EHRs.
The term “consultation order” became a synonymous term for referrals, because an electronic referral is typically created in the form of an order in the EHR system. With an EHR in a "closed system" (typically a single institution) that includes both referrer and consultant, “transmitting” (conveying) the information is handled by the EHR system itself: it sends the information, or a link to it, to the appropriate target, such as the consulting service in the case of the referral, or the referring service in the case of the consultation. A helpful consultation variant emerged in the form of e-consultation.6 Although some use this term to refer to real-time technologies such as live videoconferencing, we instead refer to asynchronous activities of reading and writing, whereby the consultant responds to a referral by reviewing the medical record and documenting an opinion without evaluating the patient directly. This formal medical-record review and documentation does not occur with curbside consultations, which persist as an informal but useful mechanism for providing interprofessional advice. E-consultations can be useful to answer questions about indications for medications, diagnostic testing, or therapeutic procedures (for example), based on medical history but not physical examination. In “open systems” where referrals are made to other institutions, transmission requires electronic interoperability or some degree of manual work, to get the information from its source to its target. Curbsides and e-consultations tend to be less common in these settings. Despite certain benefits of EHRs, such as the facilitation of e-consultations, many patients continue to experience delays in care, and periodic harms as a result.7
3. Gains and Losses
The computerization of referrals and consultations through the dissemination and adoption of EHR products has led to many improvements in care and outcomes. Unfortunately, the things that could go wrong often do, at any step of the entire process. Thus, EHRs have led to certain gains, losses, and unrealized potential. Categorized examples are provided below.
Electronic documentation and automation.
Potential has been created to integrate, automatically, information from the medical record into a referral or consultation. This might pertain to symptoms, prescribed medications, vital signs, medical orders, or procedures. Targets of electronic routing could be changed dynamically according to any number of work schedules, teams, shifts, and sites of care. In short, the work of routing and tracking information as it flows across sites and points of care can now be handled more quickly, efficiently, and safely. Despite the potential, these forms of automation are currently rudimentary or uncommon, partly because the surrounding workflows and presentation of data have been insufficiently investigated and detailed. In many cases, documentation of care simply occurs too slowly or superficially8 to be considered a promoter of safe and effective care.9 Berg and colleagues pointed out that the EHR needs to use empirical knowledge of clinical practice to produce needed but not excessive structure, and that free text—as opposed to EHR templates—is a core element of clinical documentation.10 Templates for referral and consultation need refinements consistent with these recommendations.11,12
Electronic transmission of documents.
This speeds delivery of information and so has the potential to decrease time to diagnosis and time to treatment. Steps in the processes of referral and consultation can now be tracked electronically,13 leading to the capability to generate automated signals to multiple recipients regarding the initial request, questions requiring answers, interruptions in the timeliness of the stepwise activities, and availability of results. New challenges that accompany such systems include timeliness of responding to tracked events, such as scheduling or requests for additional information; and efficiently coordinating the electronic information flows with the corresponding conversations.8 Both referrers and consultants have reported a frequent lack of information needed from each other.14
Usability.
Professional care managers have cited usability as an important technological barrier to coordinating the care of chronically ill patients.15 Although attention to usability of EHR systems appears to be increasing, physicians still overwhelmingly assign poor ratings to EHR usability, which is also associated with professional burnout.16 Many referrals are incomplete or even target the wrong consulting service, often based on inadequate understanding, as gained from the EHR, about differences among consulting services and the clinical issues that they handle. This leads not only to backtracking and duplication of work to correct the problem, but delays in diagnosis or treatment, and prolonged waiting times relating to inefficiencies and errors in referral.9 Urgency of issues can be miscommunicated. Checkboxes and text fields in user interfaces can be easily missed, or can be so numerous as to overburden the user or obscure the most important information. Information can fail to arrive at its destination, or can fail to be addressed, tracked, and followed up properly. Paper-based workarounds have persisted even in the past decade.17
Interpersonal communication.
EHRs have provided a more robust communication network, with more opportunities and methods to connect to others. Whether the potential is being realized in the most useful ways is uncertain. Of paramount importance is the finding that the interpersonal communication activities that accompany the steps have suffered too much: Gandhi and colleagues, for example, described shortcomings of both timeliness and content of communication surrounding referrals.14 Interpersonal communication has especially concerned primary care providers and influenced their choices of referral partners.18 The availability of electronic ordering and documentation seemingly (but not really) obviates any absolute need for referrer and consultant to talk directly. Instead, thoughts, findings, and recommendations tend to flow, now with the EHR, only through the electronic documentation. Conversations that might have preceded or accompanied the activities in pre-EHR days have often been abandoned. This frequently leads to misunderstandings, uncertainty about how to proceed, and even medical errors when electronic documentation may be inadequate to convey all of the important dimensions of a case that are needed to provide the most appropriate care.
4. Uncertainties and ongoing research needs
Clinical interpersonal communication.
Although EHR systems and communications technologies have multiplied and evolved rapidly, leading to certain technical changes in procedures as well as consequences, our fundamental need for interpersonal communication in formulating and answering questions about referrals and consultations, and troubleshooting them, has remained constant since the first referral ever occurred.
Nonetheless, medical practices and institutions have not kept pace with those needs. EHR vendors have done too little to integrate and accommodate the social and technical needs relating to referrals and consultations. In turn, medical institutions' increased need to focus on implementation and adoption of EHR systems has detracted from their attention to bringing clinicians together in the productive dialogue that needs to occur during the key clinical activities. “Service agreements” between specialties do often exist, but dialogue surrounding them tends to be sporadic, and these agreements cannot replace individual conversations about specific patients. Some consensus has been generated through conferences and public reports, but far more action is needed. Furthermore, roles and responsibilities require clarification and discussion.19 We agree with Eason and colleagues when they asserted that, although standards of care and technology may be established at a national level, maximally supporting the sharing of information will require most systems development to occur at the level of local communities and institutions.20
In many of today’s medical institutions, we need sociotechnical frameworks to guide research that addresses uncertainties related to referrals in academic settings or large practices.21,22 In many of today’s medical institutions, especially in academic settings or large practices, referrers and consultants do not know each other, shifts lead to frequent changes of work schedules, and increasing distance and dispersion among clinicians lowers the chance that people will connect with each other through unplanned but useful interactions. Insufficient evidence is available to inform the best ways to overcome these challenges. Even the task of remotely determining whether a clinician is available or unavailable to discuss a patient at a particular moment is difficult. As economics drive shorter visits and larger patient loads, fostering the human connection is more difficult and needs more help than ever. The decrease in flexibility and predictability of available time heightens the need, currently unfulfilled, for technology to assist in building interpersonal networks, as well as better methods of real-time communication. The need to identify communication opportunities while minimizing disruptions might be met by creative uses of contextual cues, information from daily schedules, and perhaps wearable devices. Even the selection of a consulting specialty service is problematic in itself: a recent survey of one of our local medical centers revealed that referrers could choose from more than 500 consulting services, all without any robust method to search for a service by name or key word, or to understand easily what specific services were provided by any given specialty, as opposed to the others. With many individual clinicians practicing in multiple settings and being required to use multiple EHR systems, relying on memory alone to recall all of the needed information about referrals in every setting is no longer a reasonable approach.
Health information technology leveraging interoperability.
Many of today's mobile smartphone applications provide examples of technologies, tools, and solutions that have yet to be applied to EHR systems. These apps connect people and information, together. They allow users to access documents and each other at the same time, even through live human conversations via the phones. They provide efficient means of processing and submitting forms and requests. EHR vendors and other developers should improve agility and innovation in their products, in building upon what other industries have already learned and implemented. In medical settings, privacy laws, regulations, and policies sometimes stand in the way of progress, but these are frequently misunderstood, and are not insurmountable. Additional research is needed to measure and understand communication, technical development, efficiency, implementation, usability, workflow, optimization, and outcomes.
The rise of cross-institutional or “open” systems promotes transitions of care for patients but also raises the bar for effective transmission and communication of referrals and consultations. Progress in coordinating cross-institutional consultations has not kept up with the demand. The U.S. Department of Veterans Affairs is a prime example: although the Maintaining Internal Systems and Strengthening Integrated Outside Networks (MISSION) Act enables Veterans to receive many health services outside the network, workflow, data formats, and data exchange procedures do not fully support coordination or assessment of care. Electronic consultation systems have begun to be developed and studied with greater attention to details13,23. Our work has yielded knowledge about cognitive requirements and potential usability and usefulness of new HFE-informed approaches to referrals,24 but much more science and engineering are needed to expand and apply such knowledge.
Patient-oriented Metrics.
The genesis of the "pathologies" presented here began at the moment when the EHR captured its first piece of health care data. There was no easy way to organize consultations until we started capturing them in digitized form. There was no easy way to count consultations until we started capturing them as electronic documents. We couldn't establish metrics for evaluating them until we started counting them. There were no competing pressures from performance expectations and metrics until we started tracking metrics more systematically. When we were working on referrals and consultations face to face, there were few templates to misconstrue. We could not misunderstand prerequisites on the referring end or misunderstand the information on the consulting end. There were no canceled consultations to puzzle providers until we were canceling them electronically and without discussions. Thus, our innovations have also created new potential to measure failures, but we can likely manage these and prevent harms if we use ergonomics and HFE to attend to many of the contributing factors.
We have created immense potential for improvement, but we still need to attend to the most basic and constant needs. In 2008, Abraham Verghese referred to the “iPatient” as the electronic representation of the patient inside the EHR.25 The iPatient requires attention but competes with the real patient, for the clinician’s time. He asserted that the patient is the center of attention, but “more as an icon for another entity clothed in binary garments”. We consider what we view as an EHR-fostered depersonalization of sociotechnical processes to represent "passive segregation", the result of current but often dysfunctional human-computer interactions. The problem, as Verghese pointed out, is that the real patient needs the bulk of the attention and dialogue. In studying referrals and consultation, we have observed a gap between the introduction of new technology and the development of social systems to handle their unintended consequences. We call this phenomenon culture lag. The need to bring people together in focusing on patients’ needs has amplified the opportunities for ergonomics and HFE. For example, EHRs should embed into their referral systems functions that synchronously connect the involved healthcare professionals—think of an enhanced form of instant messaging—and patients, too. We must reduce, rather than increase, social distance among patients, clinicians, and other types of caregivers.
Training.
As noted by Liran Levin, "referral practice is a learned skill".26 We need to identify the best ways to train all clinicians about how to generate referrals and conduct consultations effectively. Research has identified education’s effects on satisfaction and frequency of referral27, but the extent to which the referral and consultation processes themselves are working has received inadequate attention. At the same time, we must balance the need for basic consultation training with the need to avoid extensive time requirements, while accommodating the reality that the clinical work force changes every day, and clinicians work with multiple health systems and information systems. Training must be able to adapt to these changes, including evolution in professional roles, patients’ health status, and new medical procedures.
5. Conclusion
In summary, the computerization of referrals and consultations has led to many gains and capacities to improve quality and outcomes of care, but adverse effects have occurred, and too much potential remains unrealized. The good news is that there is little disagreement about whether the system is broken (it is). Comparing to the pre-EHR socio-technical environment yields lessons, but the main work ahead is bringing people together and applying ergonomics and HFE to overcome passive segregation and improve the environment, products, and work system. We especially need ergonomics and HFE to decrease time requirements, increase accessibility of clinical information, and improve interoperability, reliability, and interpersonal communication in delivering care.
HIGHLIGHTS.
Specialty consultation corresponds to a transition in care for a patient.
Inadequate usability of user interfaces can lead to harms and delays in care.
Ergonomic change could help efficiency, information accessibility, and communication.
6. Acknowledgements
The research reported here was supported by the U.S. Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service CIN 13-416 and IIR 12-102. Dr. Weiner is Chief of Health Services Research and Development at the Richard L. Roudebush Veterans Affairs Medical Center in Indianapolis, Indiana. The views expressed in this article are those of the authors and do not necessarily represent the views of the U.S. Department of Veterans Affairs. Dr. Savoy is supported in part by the following grants KL2TR002530 (A Carroll, PI), and UL1TR002529 (A. Shekhar, PI) from the National Institutes of Health, National Center for Advancing Translational Sciences, Clinical and Translational Sciences Award.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Declaration of interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
REFERENCES
- 1.Mehrotra A, Forrest CB, Lin CY. Dropping the baton: specialty referrals in the United States. Milbank Quarterly. 2011;89(1):39–68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Institute for Healthcare Improvement. Closing the Loop: A Guide to Safer Ambulatory Referrals in the EHR Era. http://www.ihi.org/resources/Pages/Publications/Closing-the-Loop-A-Guide-to-Safer-Ambulatory-Referrals.aspx. Accessed June 15, 2019.
- 3.Goldman L, Lee T, Rudd P. Ten commandments for effective consultations. Archives of internal medicine. 1983;143(9):1753. [PubMed] [Google Scholar]
- 4.Lee CT, Madii R, Daignault S, et al. Cystectomy Delay More Than 3 Months From Initial Bladder Cancer Diagnosis Results in Decreased Disease Specific and Overall Survival. Journal of Urology. 2006;175(4):1262–1267. doi: 10.1016/S0022-5347(05)00644-0. [DOI] [PubMed] [Google Scholar]
- 5.Gandhi TK, Kachalia A, Thomas EJ, et al. Missed and delayed diagnoses in the ambulatory setting: a study of closed malpractice claims. Ann Intern Med. 2006;145(7):488–496. doi: 10.7326/0003-4819-145-7-200610030-00006. [DOI] [PubMed] [Google Scholar]
- 6.Vimalananda VG, Gupte G, Seraj SM, et al. Electronic consultations (e-consults) to improve access to specialty care: a systematic review and narrative synthesis. J Telemed Telecare. 2015;21(6):323–330. doi: 10.1177/1357633X15582108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Patterson ES, Su G, Sarkar U. Reducing delays to diagnosis in ambulatory care settings: A macrocognition perspective. Appl Ergon. 2020;82:102965. doi: 10.1016/j.apergo.2019.102965. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Lowry SZ, Ramaiah M, Patterson ES, et al. Integrating Electronic Health Records into Clinical Workflow. Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care. 2014;3(1):170–177. doi: 10.1177/2327857914031028. [DOI] [Google Scholar]
- 9.GAO. VA Health Care: Management and Oversight of Consult Process Need Improvement to Help Ensure Veterans Receive Timely Outpatient Specialty Care. 2014;GAO-14-808. Accessed July 7, 2016.
- 10.Berg M, Langenberg C, vd Berg I, Kwakkernaat J. Considerations for sociotechnical design: experiences with an electronic patient record in a clinical context. International journal of medical informatics. 1998;52(1-3):243–251. doi: 10.1016/s1386-5056(98)00143-9. [DOI] [PubMed] [Google Scholar]
- 11.Savoy A, Patel H, Flanagan ME, Daggy JK, Russ AL, Weiner M. Comparative usability evaluation of consultation order templates in a simulated primary care environment. Appl Ergon. 2018;73:22–32. doi: 10.1016/j.apergo.2018.05.013. [DOI] [PubMed] [Google Scholar]
- 12.Esquivel A, Sittig DF, Murphy DR, Singh H. Improving the Effectiveness of Electronic Health Record-Based Referral Processes. BMC Medical Informatics and Decision Making. 2012;12(1):1–8. doi: 10.1186/1472-6947-12-107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Weiner M, El Hoyek G, Wang L, et al. A web-based generalist-specialist system to improve scheduling of outpatient specialty consultations in an academic center. Journal of general internal medicine. 2009;24(6):710–715. doi: 10.1007/s11606-009-0971-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Gandhi TK, Sittig DF, Franklin M, Sussman AJ, Fairchild DG, Bates DW. Communication breakdown in the outpatient referral process. Journal of general internal medicine. 2000;15(9):626–631. doi: 10.1046/j.1525-1497.2000.91119.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Carayon P, Hundt AS, Hoonakker P. Technology barriers and strategies in coordinating care for chronically ill patients. Appl Ergon. 2019;78:240–247. doi: 10.1016/j.apergo.2019.03.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Melnick ER, Dyrbye LN, Sinsky CA, et al. The Association Between Perceived Electronic Health Record Usability and Professional Burnout Among US Physicians. Mayo Clin Proc. 2019. doi: 10.1016/j.mayocp.2019.09.024. [DOI] [PubMed] [Google Scholar]
- 17.Saleem JJ, Russ AL, Neddo A, Blades PT, Doebbeling BN, Foresman BH. Paper persistence, workarounds, and communication breakdowns in computerized consultation management. International journal of medical informatics. 2011;80(7):466–479. [DOI] [PubMed] [Google Scholar]
- 18.Barnett ML, Keating NL, Christakis NA, O’Malley AJ, Landon BE. Reasons for choice of referral physician among primary care and specialist physicians. Journal of general internal medicine. 2012;27(5):506–512. doi: 10.1007/s11606-011-1861-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Hysong SJ, Esquivel A, Sittig DF, et al. Towards successful coordination of electronic health record based-referrals: a qualitative analysis. Implement Sci. 2011;6:84. doi: 10.1186/1748-5908-6-84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Eason K, Dent M, Waterson P, Tutt D, Thornett A. Bottom-up and middle-out approaches to electronic patient information systems: a focus on healthcare pathways. Inform Prim Care. 2012;20(1):51–56. doi: 10.14236/jhi.v20i1.47. [DOI] [PubMed] [Google Scholar]
- 21.Carayon P, Wetterneck TB, Rivera-Rodriguez AJ, et al. Human factors systems approach to healthcare quality and patient safety. Appl Ergon. 2014;45(1):14–25. doi: 10.1016/j.apergo.2013.04.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Quality and Safety in Health Care. 2010;19(Suppl 3):i68–i74. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Weinberg ST, Kaiser AB, Waitman LR, Webb T. Experience with ConsultWiz—the simultaneous electronic notification, documentation, and tracking of inpatient consult requests. AMIA Annu Symp Proc. 2006:1139. [PMC free article] [PubMed] [Google Scholar]
- 24.Savoy A, Militello LG, Patel H, et al. A cognitive systems engineering design approach to improve the usability of electronic order forms for medical consultation. J Biomed Inform. 2018;85:138–148. doi: 10.1016/j.jbi.2018.07.021. [DOI] [PubMed] [Google Scholar]
- 25.Verghese A Culture shock—patient as icon, icon as patient. N Engl J Med. 2008;359(26):2748–2751. doi: 10.1056/NEJMp0807461. [DOI] [PubMed] [Google Scholar]
- 26.Levin L Editorial: Education for lifelong learning and referrals in practice. Quintessence International (Berlin, Germany: 1985). 2016;47(9):723. doi: 10.3290/j.qi.a36883. [DOI] [PubMed] [Google Scholar]
- 27.Dahhan A, Maddox WR, Krothapalli S, et al. Education of Physicians and Implementation of a Formal Referral System Can Improve Cardiac Rehabilitation Referral and Participation Rates after Percutaneous Coronary Intervention. Heart Lung Circ. 2015;24(8):806–816. doi: 10.1016/j.hlc.2015.02.006. [DOI] [PubMed] [Google Scholar]