Abstract
Over the next decade, many health care organizations (HCOs) will transition from one electronic health record (EHR) to another; some forced by hospital acquisition and others by choice in search of better EHRs. Herein, we apply principles of Requisite Imagination, or the ability to imagine key aspects of the future one is planning, to offer 6 recommendations on how to proactively safeguard these transitions. First, HCOs should implement a proactive leadership structure that values communication. Second, HCOs should implement proactive risk assessment and testing processes. Third, HCOs should anticipate and reduce unwarranted variation in their EHR and clinical processes. Fourth, HCOs should establish a culture of conscious inquiry with routine system monitoring. Fifth, HCOs should foresee and reduce information access problems. Sixth, HCOs should support their workforce through difficult EHR transitions. Proactive approaches using Requisite Imagination principles outlined here can help ensure safe, effective, and economically sound EHR transitions.
Keywords: electronic health records, Requisite Imagination, patient safety, change management
INTRODUCTION
Over the past decade, health care organizations (HCOs) have been transitioning from one electronic health record (EHR) to another. Selecting a new, presumably better, EHR offers hope to HCOs struggling to keep up with evolving EHR-related regulations and clinicians frustrated with their current EHRs.1 For example, a study using the HIMSS Analytics database found that in 2012 and 2013, 434 and 305 hospitals, respectively, switched EHRs.2 Many EHR transitions also occur following an organizational acquisition or merger; of 88 hospitals acquired between 2012 and 2014, 31 (35%) switched EHRs by 2016.3 Since 2015, when the Office of the National Coordinator for Health Information Technology (ONC) estimated that 96% of nonfederal acute care hospitals had adopted a certified EHR,4 the number of HCOs transitioning from one EHR to another has been considerably greater than the number of HCOs transitioning from paper-based medical records to EHRs. Recent high-profile HCOs that have switched EHRs include Virginia Common University Health System,5 Mayo Clinic,6 Advocate Health Care,7 and AdventHealth.8 Similar transitions will likely continue. These EHR transitions are notoriously difficult, costly, and disruptive for organizations and clinicians.9 For example, a 2020 review of EHR transitions based on “scant literature concerning EHR-to-EHR transitions, [i]dentified challenges include[ing] financial burdens, personnel resources, patient safety threats from limited access to legacy records, data integrity during migration, cybersecurity, and semantic interoperability.”10
EHR transitions could involve a small clinic or a large HCO in multiple geographic locations with different EHRs.11 For example, the Department of Veterans Affairs with 171 medical centers and 1112 outpatient clinics is transitioning from a well-established, self-developed, open-source EHR, CPRS/Vista12 to a commercially available, ONC-certified, product developed by Cerner (Kansas City, Missouri).13 Reported problems at the VA’s first transition site led to a temporary halt of the VA’s entire nationwide EHR transition schedule.14,15 Other institutions have experienced similar challenges. At Vanderbilt, for example, there were still over 4000 unresolved helpdesk tickets 3 months after their transition, even after significant efforts were made to close all tickets.16 Organizational challenges also occurred at Brigham and Women’s Hospital in 2016 which led to their first budget shortfall ($53 million) in 15 years.17
While EHR transitions solve certain problems, they impact not just the technology for delivering health care but also the clinical work processes and culture of an organization.18 EHR transitions hence lead to unexpected sociotechnical consequences for clinicians, patients, and the HCO.19 Thus, health care leaders and clinical staff who may not be as familiar with lessons learned from other EHR transitions, nor experts in health IT and informatics, often play a leading role in EHR transitions. Moreover, use of an unfamiliar EHR or an unstable relationship with the new EHR developer may lead to quality and safety concerns and excessive costs that HCOs will need to manage.20 This is not surprising as the EHR is only one component within the larger complex, adaptive sociotechnical health care system.21 We posit that a more proactive, deliberate, and comprehensive approach should be used to safeguard EHR transitions.
In the study of human–machine system design and organizational culture, the concept of Requisite Imagination, defined as the ability to imagine key aspects of the future one is planning, has been used to anticipate what might go wrong and how to identify potential ways to test the new system.22 This concept could also be applied to new health information technology implementations or transitions, especially in areas where prior safety problems have been well documented. For example, before transitioning to a new automated system for communicating abnormal laboratory test results,23 one should consider how results sent to clinicians who are on vacation or have left practice will be managed such that patients do not “fall through the cracks.”24 In this paper, we apply principles of Requisite Imagination to offer 6 recommendations on how HCOs can safeguard their EHR transitions proactively. These principles can help create organizational ownership, resilience, and trust needed to overcome several universal challenges of EHR transitions.
Implement a proactive leadership structure that values communication
Requisite Imagination requires leaders to create a culture of open and transparent communication that prepares everyone (eg, physicians, nurses, pharmacists, clinical laboratory, and diagnostic imaging representatives), to think about the potential consequences of making the proposed changes and prepare for them. Because many things can go wrong with any health IT transition, leaders should create a governance structure that includes experts with technical and operational expertise in planning and monitoring activities to oversee the EHR transition and intervene as issues arise. Organizational leaders should encourage EHR users to speak up if they perceive something is wrong and ensure that management takes them seriously. Leadership should also encourage probing diagnostic questions and multidisciplinary investigations when the answers to questions indicate deeper problems may exist. Despite well-known benefits of open communication and user input to inform change management processes,25 they are often a neglected component of EHR transitions.26
Leaders can ensure representative clinicians are engaged in transition planning and EHR configuration and are compensated for their time accordingly.27 Clinicians are used to their daily workflows based on specific screens and content within the user interface of their existing EHR, but many of these workflow processes will be disrupted by the new EHR user interface displays, content, and navigation pathways as well as variations in adoption rates for these new workflows by the larger care team. Dedicated clinician engagement (eg, protected time) could help build new EHR content that facilitates safe medication ordering (eg, order sentences, order sets, and default doses),28 clinical decision support (eg, health maintenance reminders and medication–condition interaction checks),29 and better visual displays of clinical data (eg, screen layouts and graphs).30 This helps ensure that the EHR content better meets user needs, thus improving clinician experience and the efficiency of their new workflows.
Implement proactive risk assessment and testing
Transitions often lead to clinicians performing tasks previously handled by others and frequent workarounds (ie, omission of process steps, process steps performed out of sequence, or unauthorized process steps)31 that by-pass safety procedures. Existing clinical alerting mechanisms,32,33 for example, may need to be modified or redesigned to accommodate differences in EHR design or outright limitations. Proactive risk assessment, that is, identification of potential risks before they occur with a goal of either mitigating their impact or preventing them from occurring, is thus essential. The best assessment strategy would include conducting a self-assessment using SAFER (Safety Assurance Factors for EHR Resilience) Guides available from the ONC.34 SAFER Guides are a suite of checklists that proactively identify safety and effectiveness concerns related to both EHR technology infrastructure and clinical processes.35 Recently the Center for Medicare and Medicaid Services required their use by eligible HCOs beginning in 2022.36
Additionally, implementation of proactive testing procedures across the entire EHR-enabled healthcare delivery system can evaluate both technical and organizational components related to the forthcoming change. Technical components include not just individual modules of the EHR but also the planned system-to-system interfaces between the EHR and ancillary components such as laboratory and radiology. Proactive testing must include end-users of these systems and involve end-to-end clinical workflows in both the “test” and “production” environment (ie, with test patients).37 Rigorous testing conducted prior to go-live and before major system upgrades can identify problems for resolution and prevent clinician frustration or patient harm.
Anticipate and reduce unwarranted variation
Deming, a pioneer in continuous quality improvement, said, “Uncontrolled variation is the enemy of quality”38 but in reality, unexplained variation is the norm in clinical practice. For example, some HCOs allow clinicians to create their own “personal” order sets, but this introduces significant practice variation, reduces the evidence-based character of the order sets, and introduces significant long-term maintenance issues.39 Organizations should anticipate similar unwarranted variations related to EHR design, development, configuration, and use. These variations worsen quality and increase cost. To address these variations, they can standardize certain EHR features, functions, nomenclature, and workflows, as well as testing, training, and maintenance activities across users, departments, and locations.40 Furthermore, by reducing unwarranted variation in how certain clinical data (eg, vital signs, weight, and laboratory results) are defined, collected, coded, and stored, organizations can increase interoperability with EHRs from other HCOs.
HCOs should also identify the necessary variations or gaps between current workflows, roles, and responsibilities and the new EHR's functionality and capabilities. This could help engage operational leaders in configuring the new EHR and in reenvisioning and redesigning activities to mitigate problems and prepare for the transition. Both of these anticipatory activities can reduce patient risk, clinician training requirements, and administrative costs.
Establish a culture of conscious inquiry with routine monitoring
Conscious inquiry encourages observation, questioning, and presentation of findings and conclusions. But it is difficult to know if the new EHR is working as designed, being used as expected, or leading to unintended adverse consequences.41 This is because transitions involve complex and widely dispersed events over time where clinicians interact with a new EHR in different ways while trying to accomplish important, time-critical tasks with a high cognitive load. Thus, measuring, and monitoring clinical and administrative operations through multiple methods, such as adverse event reports,42 help-desk tickets,16 audit logs,43 and key clinical,44 operational,45 financial,46 and patient satisfaction,47 performance indicators is critical to identify signals of problems. This may entail development of new classification taxonomies to help identify key problem areas and allow leaders to “drill-down” and identify potential root causes.48 In addition, one can develop anomaly detection algorithms49 to monitor system usage logs (eg, laboratory result routing error logs or alert firing/override logs) to identify bugs and glitches before they affect patients. All of these data should be analyzed and reviewed expeditiously for anomalies and unsafe system behaviors by scientists, engineers, and clinicians, who can then help inform corrective actions. Additional experts could be brought in for advice as specific issues are identified through monitoring. EHR developers, clinicians, and administrative leadership all have a shared responsibility to implement a culture of conscious inquiry.
Foresee and reduce information access problems
To ensure uninterrupted patient care, easy, fast, and complete access to historical patient data is essential.50 First, anticipating that information access problems will inevitably occur, HCOs should import as much valid coded data (eg, patient demographics along with clinical problems, allergies, medications, laboratory test results, and immunizations) and free text data (eg, ambulatory visit, hospital discharge, and procedure notes) as possible from their old EHR.40 It may not be possible to automate all data migration tasks, therefore, HCOs should invest in resources to manually migrate or “curate and prep” each patient’s chart to reduce the cognitive burden associated with data reconciliation for each patient’s first visit with the new EHR. HCOs should also review and test their data migrations to ensure they are complete, correct, and commensurate with newly collected data.51 If all necessary data cannot be migrated to the new system, read-only access to the old EHR needs to be maintained. This parallel system maintenance has significant costs concerning clinician time and attention as well as financial and personnel costs for the HCO.
Even in large, comprehensive, well-integrated care delivery systems, many patients will receive some care from external providers. Failure to consider a patient’s past medical history in current clinical decision making52 or quality measurements53 can lead to errors of omission and commission, along with inaccurate measurements. Thus, organizations should participate in external health information exchanges to improve care continuity. They should also participate in regional and/or national consortia to facilitate sharing of information on key EHR pain points and solutions learned by others.54
Support the EHR user workforce
In EHR transitions, change is difficult for the workforce to navigate. While the workforce may initially hope that the new EHR will be easy to use and even “intuitive,” the reality is that inevitable changes in screen design, layout, and workflows between the new EHR and the old EHR, coupled with new procedures for finding, entering, and reviewing information must be managed carefully to prevent negative impacts on organizational finances,9 user frustration,55 and staff morale.56 The entire workforce should always be aware of what changes are forthcoming, how high-quality care will be maintained, and how they will be supported.57 Tight coordination among the IT analysts, informatics specialists, and the EHR training team along with operational and clinical leader support is required to perform ongoing monitoring, outreach, and training updates for the workforce. Preparatory activities could include rigorous workflow specific training before go-live, providing users with dedicated “protected time” away from clinical duties to attend this training, encouraging clinicians to practice using the system before go-live, and providing additional 1-on-1 support to clinicians who continue to struggle.58 Organizations may decide to hire external staff who are experienced using the new EHR to provide additional support to clinicians for 2 to 4 weeks following go-live. In addition, leadership should plan on reducing the number of patients seen in clinics or treated in the hospital for the first few weeks following go-live while the inevitable “kinks” in the system are worked out.
CONCLUSION
The next decade will be dominated by transitions from one EHR to another; some forced by hospital acquisition and others by choice in search of a better EHR. EHR transitions cause major health care delivery disruptions and can lead to positive transformations. Minimizing risk and associated disruptions during transitions are essential to safeguard patient safety, the well-being of clinicians using these systems, and the financial futures of organizations making these transitions. Organizations that use Requisite Imagination principles to help them prioritize investments in robust governance, transparent communication, process and EHR standardization, realistic expectation management, extensive user training and system testing, access to historic data, continuous monitoring of EHR transition processes, and ongoing end-user support should be able to develop the organizational resilience and teamwork necessary to ensure safe, effective, and economically sound EHR transitions.
FUNDING
Dr Singh is funded by the Veterans Administration (VA) Health Services Research and Development (HSR&D) Service (IIR17-127 and the Presidential Early Career Award for Scientists and Engineers USA 14-274), the Center for Innovations in Quality, Effectiveness, and Safety (CIN13-413), the Agency for Healthcare Research and Quality (R01HS27363), and the Gordon and Betty Moore Foundation.
AUTHOR CONTRIBUTIONS
DFS wrote the first draft of the manuscript; PL and HS made many substantial edits and contributions and approved the final version of the manuscript.
ACKNOWLEDGMENTS
The authors thank John Glaser, PhD, FHIMSS, FACMI, and Tonya Hongsermeier, MD, MBA, Chief Clinical Innovation Officer at Elimu Informatics for their thoughtful review and suggestions on an early draft of this manuscript.
CONFLICT OF INTEREST STATEMENT
Dr Lakhani was formerly the Executive Director, Quality, Safety and Value in the Office of Electronic Health Record Modernization at the Department of Veterans Affairs. Drs Sittig and Singh were previously funded by the Office of the National Coordinator (ONC) to develop the SAFER guides, although they do not receive additional compensation for their continued distribution or use.
DATA AVAILABILITY
No new data were generated or analyzed in support of this research.
Contributor Information
Dean F Sittig, University of Texas/Memorial Hermann Center for Healthcare Quality & Safety, School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX, USA.
Priti Lakhani, Formerly at Office of Electronic Health Record Modernization, U.S. Department of Veterans Affairs, Washington, DC, USA.
Hardeep Singh, Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey Veterans Affairs Medical Center and Baylor College of Medicine, Houston, TX, USA.
REFERENCES
- 1. Tutty MA, Carlasare LE, Lloyd S, Sinsky CA. The complex case of EHRs: examining the factors impacting the EHR user experience. J Am Med Inform Assoc 2019; 26 (7): 673–7. Erratum in: J Am Med Inform Assoc 2019; 26 (11): 1424. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Slabodkin G. Making the EHR switch. Health Data Manag 2015; 23 (2): 24–6. https://www.healthdatamanagement.com/articles/making-the-ehr-switch. Accessed January 1, 2022. [Google Scholar]
- 3. Holmgren AJ, Adler-Milstein J. Does electronic health record consolidation follow hospital consolidation? Health Affairs Blog, March 7, 2019. https://www.healthaffairs.org/do/10.1377/hblog20190304.998205/full/. Accessed January 1, 2022.
- 4.Office of the National Coordinator for Health Information Technology. Non-federal acute care hospital electronic health record adoption. Health IT Quick-Stat #47, September 2017. https://www.healthit.gov/data/quickstats/non-federal-acute-care-hospital-electronic-health-record-adoption. Accessed January 1, 2022.
- 5. Drees J. VCU health switches from Cerner to Epic EHR. Becker’s Hospital Review. December 3, 2021. https://www.beckershospitalreview.com/ehrs/vcu-health-switches-from-cerner-to-epic-ehr.html. Accessed January 1, 2022.
- 6. Milliard M. Mayo Clinic completes Epic EHR rollout with final go-lives. Healthcare IT News. October 9, 2018. https://www.healthcareitnews.com/news/mayo-clinic-completes-epic-ehr-rollout-final-go-lives. Accessed January 1, 2022.
- 7. Arndt RZ. Advocate will move to a single Epic EHR. Modern Healthcare. February 1, 2018. https://www.modernhealthcare.com/article/20180201/NEWS/180209992/advocate-will-move-to-a-single-epic-ehr. Accessed January 1, 2022.
- 8. Drees J. AdventHealth halfway through its $660M Epic install: 6 things to know. Becker’s Hospital Review. January 13, 2021. https://www.beckershospitalreview.com/ehrs/adventhealth-halfway-through-its-660m-epic-install-6-things-to-know.html. Accessed January 1, 2022.
- 9. McEvoy D, Barnett ML, Sittig DF, Aaron S, Mehrotra A, Wright A. Changes in hospital bond ratings after the transition to a new electronic health record. J Am Med Inform Assoc 2018; 25 (5): 572–4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Huang C, Koppel R, McGreevey JD 3rd, Craven CK, Schreiber R. Transitions from one electronic health record to another: challenges, pitfalls, and recommendations. Appl Clin Inform 2020; 11 (5): 742–54. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Penrod LE. Electronic health record transition considerations. Phys Med Rehabil 2017; 9 (5S): S13–8. [DOI] [PubMed] [Google Scholar]
- 12.History of IT at VA. 2020. https://www.oit.va.gov/about/history.cfm. Accessed January 1, 2022.
- 13. Philipps D. Hidden costs and flawed training plague the V.A.’s Huge Software Upgrade. New York Times. July 9, 2021. https://www.nytimes.com/2021/07/09/us/va-health-software-problems.html. Accessed January 1, 2022.
- 14.Veterans Affairs Office of Inspector General. Training deficiencies with VA’s new electronic health record system at the Mann-Grandstaff VA Medical Center in Spokane, Washington. Report #20-01930-183. July 8, 2021. https://www.va.gov/oig/pubs/VAOIG-20-01930-183.pdf. Accessed January 1, 2022.
- 15.Veterans Affairs EHR Strategic Review Team. Electronic health record comprehensive lessons learned. July 2021. https://federalnewsnetwork.com/wp-content/uploads/2021/07/071421_va_ehr_lessonslearned_FNN.pdf. Accessed January 1, 2022.
- 16. Johnson KB, Sternberg P Jr, Dubree M. An EPIC switch: observations and opportunities after go-live. J Med Syst 2018; 42 (9): 174. [DOI] [PubMed] [Google Scholar]
- 17. Flanagan N. Partners healthcare reports lower earnings after epic EHR implementation. February 17, 2016. https://www.healthcaredive.com/news/partners-healthcare-reports-lower-earnings-after-epic-ehr-implementation/413955/. Accessed January 1, 2022.
- 18. Businger AC, Fuller TE, Schnipper JL, et al. Lessons learned implementing a complex and innovative patient safety learning laboratory project in a large academic medical center. J Am Med Inform Assoc 2020; 27 (2): 301–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Healthc 2010; 19 (Suppl 3): i68–74. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Sittig DF, Ash JS, Wright A, et al. How can we partner with electronic health record vendors on the complex journey to safer health care? J Healthc Risk Manag 2020; 40 (2): 34–43. [DOI] [PubMed] [Google Scholar]
- 21. Rouse WB. Health care as a complex adaptive system: implications for design and management. The Bridge 2008; 38(1): 17–25. [Google Scholar]
- 22. Adamski AJ, Westrum R. Requisite imagination: the fine art of anticipating what might go wrong. In: Hollnagel E, ed. Handbook of Cognitive Task Design. London: Lawrence Erlbaum Associates; 2003: 193–220. [Google Scholar]
- 23. Bornstein S. An integrated EHR at Northern California Kaiser Permanente: pitfalls, challenges, and benefits experienced in transitioning. Appl Clin Inform 2012; 3 (3): 318–25. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Rogith D, Satterly T, Singh H, et al. Application of human factors methods to understand missed follow-up of abnormal test results. Appl Clin Inform 2020; 11 (5): 692–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Lorenzi NM, Riley RT. Managing change: an overview. J Am Med Inform Assoc 2000; 7 (2): 116–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Reynolds TL, Clay B, Rudkin SE, et al. Migrating from one comprehensive commercial EHR to another: perceptions of front-line clinicians and staff. AMIA Annu Symp Proc 2020; 2019: 765–773. [PMC free article] [PubMed] [Google Scholar]
- 27. Ash JS, Singh H, Wright A, Chase D, Sittig DF. Essential activities for electronic health record safety: a qualitative study. Health Informatics J 2020; 26 (4): 3140–51. [DOI] [PubMed] [Google Scholar]
- 28. Wright A, Feblowitz JC, Pang JE, et al. Use of order sets in inpatient computerized provider order entry systems: a comparative analysis of usage patterns at seven sites. Int J Med Inform 2012; 81 (11): 733–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Wright A, Sittig DF, Ash JS, et al. Development and evaluation of a comprehensive clinical decision support taxonomy: comparison of front-end tools in commercial and internally developed electronic health record systems. J Am Med Inform Assoc 2011; 18 (3): 232–42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Sittig DF, Murphy DR, Smith MW, Russo E, Wright A, Singh H. Graphical display of diagnostic test results in electronic health records: a comparison of 8 systems. J Am Med Inform Assoc 2015; 22 (4): 900–4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Koppel R, Wetterneck T, Telles JL, Karsh BT. Workarounds to barcode medication administration systems: their occurrences, causes, and threats to patient safety. J Am Med Inform Assoc 2008; 15 (4): 408–23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Friebe MP, LeGrand JR, Shepherd BE, Breeden EA, Nelson SD. Reducing inappropriate outpatient medication prescribing in older adults across electronic health record systems. Appl Clin Inform 2020; 11 (5): 865–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Wong A, Wright A, Seger DL, Amato MG, Fiskio JM, Bates D. Comparison of overridden medication-related clinical decision support in the intensive care unit between a commercial system and a legacy system. Appl Clin Inform 2017; 08 (03): 866–79. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Office of the National Coordinator for Health Information Technology (ONC). SAFER Guides. 2018. https://www.healthit.gov/topic/safety/safer-guides. Accessed January 1, 2022.
- 35. Sittig DF, Singh H. Toward more proactive approaches to safety in the Electronic Health Record Era. Jt Comm J Qual Patient Saf 2017; 43 (10): 540–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Sittig DF, Singh H. Policies to promote shared responsibility for safer electronic health records. JAMA 2021; 326 (15): 1477. [DOI] [PubMed] [Google Scholar]
- 37. Wright A, Aaron S, Sittig DF. Testing electronic health records in the “production” environment: an essential step in the journey to a safe and effective health care system. J Am Med Inform Assoc 2017; 24 (1): 188–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Kvam PH, Kang CW. Basic Statistical Tools for Improving Quality. Hoboken, NJ: John Wiley, 2011. [Google Scholar]
- 39. Bobb AM, Payne TH, Gross PA. Controversies surrounding use of order sets for clinical decision support in computerized provider order entry. J Am Med Inform Assoc 2007; 14 (1): 41–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Johnson KB, Ehrenfeld JM. An EPIC switch: preparing for an electronic health record transition at Vanderbilt University Medical Center. J Med Syst 2017; 42 (1): 6. [DOI] [PubMed] [Google Scholar]
- 41. Campbell EM, Sittig DF, Ash JS, Guappone KP, Dykstra RH. Types of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2006; 13 (5): 547–56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Meeks DW, Smith MW, Taylor L, Sittig DF, Scott JM, Singh H. An analysis of electronic health record-related patient safety concerns. J Am Med Inform Assoc 2014; 21 (6): 1053–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Adler-Milstein J, Adelman JS, Tai-Seale M, Patel VL, Dymek C. EHR audit logs: a new goldmine for health services research? J Biomed Inform 2020; 101: 103343. [DOI] [PubMed] [Google Scholar]
- 44. Han YY, Carcillo JA, Venkataraman ST, et al. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics 2005; 116 (6): 1506–12. Erratum in: Pediatrics 2006; 117 (2): 594. [DOI] [PubMed] [Google Scholar]
- 45. Ward MJ, Froehle CM, Hart KW, Collins SP, Lindsell CJ. Transient and sustained changes in operational performance, patient evaluation, and medication administration during electronic health record implementation in the emergency department. Ann Emerg Med 2014; 63 (3): 320–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Becker’s CFO Hospital Report. MD Anderson points to Epic implementation for 77% drop in adjusted income. August 30, 2016. https://www.beckershospitalreview.com/finance/md-anderson-points-to-epic-implementation-for-77-drop-in-adjusted-income.html. Accessed January 1, 2022.
- 47. North F, Pecina JL, Tulledge-Scheitel SM, Chaudhry R, Matulis JC, Ebbert JO. Is a switch to a different electronic health record associated with a change in patient satisfaction? J Am Med Inform Assoc 2020; 27 (6): 867–76. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Menon S, Singh H, Giardina TD, et al. Safety huddles to proactively identify and address electronic health record safety. J Am Med Inform Assoc 2017; 24 (2): 261–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Ray S, McEvoy DS, Aaron S, Hickman TT, Wright A. Using statistical anomaly detection models to find clinical decision support malfunctions. J Am Med Inform Assoc 2018; 25 (7): 862–71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50. MacKenzie B, Anaya G, Hu J, Brickman A, Elkin PL, Panesar M. Defining data migration across multidisciplinary ambulatory clinics using participatory design. Appl Clin Inform 2021; 12 (2): 251–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Pageler NM, Grazier G'Sell MJ, Chandler W, Mailes E, Yang C, Longhurst CA. A rational approach to legacy data validation when transitioning between electronic health record systems. J Am Med Inform Assoc 2016; 23 (5): 991–4. [DOI] [PubMed] [Google Scholar]
- 52. Gandhi TK, Zuccotti G, Lee TH. Incomplete care – on the trail of flaws in the system. N Engl J Med 2011; 365 (6): 486–8. [DOI] [PubMed] [Google Scholar]
- 53. D'Amore JD, McCrary LK, Denson J, et al. Clinical data sharing improves quality measurement and patient safety. J Am Med Inform Assoc 2021; 28 (7): 1534–42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54. Sittig DF, Classen DC, Singh H. Patient safety goals for the proposed Federal Health Information Technology Safety Center. J Am Med Inform Assoc 2015; 22 (2): 472–8. [DOI] [PubMed] [Google Scholar]
- 55. Donovan-Smith O, Dreher A. ‘Veterans here are tired of being guinea pigs’: after more than a year, new health record system still causing problems at Spokane VA hospital. The Spokesman-Review. December 5, 2021. https://www.spokesman.com/stories/2021/dec/05/veterans-here-are-tired-of-being-guinea-pigs-after/. Accessed January 1, 2022.
- 56. Krousel-Wood M, McCoy AB, Ahia C, et al. Implementing electronic health records (EHRs): health care provider perceptions before and after transition from a local basic EHR to a commercial comprehensive EHR. J Am Med Inform Assoc 2018; 25 (6): 618–26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57. Abramson EL, Patel V, Pfoh ER, Kaushal R. How physician perspectives on e-prescribing evolve over time. A case study following the transition between EHRs in an outpatient clinic. Appl Clin Inform 2016; 7 (4): 994–1006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58. Wright A, Ash JS, Erickson JL, et al. A qualitative study of the activities performed by people involved in clinical decision support: recommended practices for success. J Am Med Inform Assoc 2014; 21 (3): 464–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
No new data were generated or analyzed in support of this research.