Abstract
Objectives
Well-designed electronic health records (EHRs) training programs for clinical practice are known to be valuable. Training programs should be role-specific and there is a need to identify key implementation factors of EHR training programs for nurses. This scoping review (1) characterizes the EHR training programs used and (2) identifies their implementation facilitators and barriers.
Materials and Methods
We searched MEDLINE, CINAHL, PsycINFO, and Web of Science on September 3, 2023, for peer-reviewed articles that described EHR training program implementation or delivery to nurses in inpatient settings without any date restrictions. We mapped implementation factors to the Consolidated Framework for Implementation Research. Additional themes were inductively identified by reviewing these findings.
Results
This review included 30 articles. Healthcare systems’ approaches to implementing and delivering EHR training programs were highly varied. For implementation factors, we observed themes in innovation (eg, ability to practice EHR skills after training is over, personalizing training, training pace), inner setting (eg, availability of computers, clear documentation requirements and expectations), individual (eg, computer literacy, learning preferences), and implementation process (eg, trainers and support staff hold nursing backgrounds, establishing process for dissemination of EHR updates). No themes in the outer setting were observed.
Discussion
We found that multilevel factors can influence the implementation and delivery of EHR training programs for inpatient nurses. Several areas for future research were identified, such as evaluating nurse preceptorship models and developing training programs for ongoing EHR training (eg, in response to new EHR workflows or features).
Conclusions
This scoping review highlighted numerous factors pertaining to training interventions, healthcare systems, and implementation approaches. Meanwhile, it is unclear how external factors outside of a healthcare system influence EHR training programs. Additional studies are needed that focus on EHR retraining programs, comparing outcomes of different training models, and how to effectively disseminate updates with the EHR to nurses.
Keywords: nurses, electronic health records, computer user training, implementation
Introduction
Healthcare systems have adopted electronic health records (EHRs) systems to facilitate healthcare delivery and the potential benefits of EHRs have been well-documented in the literature.1–3 As the adoption rate of EHRs is reportedly high in some countries,4–8 healthcare system leaders are transitioning to optimizing the use of EHRs to best support clinicians’ decision-making. There are several consequences of suboptimal EHR design and inefficient EHR use, including patient safety concerns,9–12 increased cognitive burden among clinicians,13,14 and increased time spent in the EHR.15 Higher EHR use and poor perceptions of EHR performance may lead to several adverse outcomes, such as perceived burnout,9,16–18 intentions of leaving the healthcare organization,9,19 and turnover.20 In light of these adverse outcomes, healthcare systems are implementing interventions to improve EHR use. EHR training programs represent one particular intervention that has been increasingly explored to improve the overall use of EHRs.21–25
Training programs are a key component of implementation strategies in several implementation science frameworks,26–28 including among studies describing and assessing EHR implementation.29–31 Evaluations of training-related outcomes after undergoing EHR training programs designed for clinical practice have also been favorable.21–24,32–36 There is also emerging evidence that EHR training programs may lead to reduced burnout.22,24 These promising results support the need to understand how to design and implement EHR training programs. Notably, since EHR workflows and modules may differ based on the role of the healthcare worker, the content included in the EHR user training program may need to be tailored based on the learner’s role type (eg, nurse vs clerical staff). Globally, in 2020, there were approximately 29.1 million nurses and they accounted for the most prevalent type of healthcare worker.37 This suggests that nurses also represent a considerable number of EHR end-users in a healthcare system. Consequently, it is worthwhile to examine current approaches to EHR training programs that have been developed and implemented specifically for nurses.
Despite the value of EHR training programs, not all healthcare systems provide these to their nurses.38–42 Furthermore, completing EHR training programs may not always translate to improved perceived self-efficacy and optimal EHR use patterns among healthcare workers. For instance, researchers have highlighted how a considerable number of nurses perceived their EHR training programs did not prepare them well for the EHR workflows they needed to use as part of daily nursing care.13,38,40,41,43,44 Nurses also may have unique constraints that may affect the design and implementation decisions of EHR training programs. For instance, traveling and floater nurses rotate through different floors and specialties, creating challenges for orienting these nurses to floor-specific EHR workflows. Consequently, it is important to identify facilitators contributing to the design and implementation of effective EHR training programs and barriers that potentially inhibit the delivery of EHR training programs. Although reviews have been published to summarize the impact of EHR training programs and their training content,32,45 to our knowledge, there is no review to date that examines the facilitators and barriers on implementing and delivering EHR training programs to nurses working in inpatient settings and how they may influence the effectiveness of the EHR training program.
To address this gap, this scoping review’s objective was to characterize the available literature’s implementation and delivery of EHR training programs to nurses in the inpatient setting. We also summarized implementation facilitators and barriers for EHR training programs to nurses from studies that offered information on whether the EHR training program was effective. These findings may benefit healthcare system and informatics leaders who are designing or optimizing training efforts to improve EHR users’ proficiency.
Methods
This scoping review followed the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) extension for scoping reviews (PRISMA-ScR) checklist.46 A completed reporting checklist is available in File S1. This protocol was not previously registered in any repository. This study used publicly available data and was exempt from institutional review board approval at the University of Florida.
Data sources and search
We developed a search strategy with a medical sciences librarian that included search terms and headings for nurses, EHRs, and training program delivery (File S2). Our inclusion criteria were: (1) details on EHR training programs were described, (2) training programs were targeting EHR skills and behaviors as opposed to other competencies (eg, clinical decision-making, delivering clinical trial interventions), (3) training programs were delivered to nurses working in inpatient settings, (4) articles were peer-reviewed, and (5) articles were written in English. Since EHR training programs may be influenced by clinician roles, we excluded articles that targeted nurse practitioners (eg, their training programs may also include how to place and sign orders) and student nurses. We also did not include gray literature since conference abstracts are unlikely to provide enough details on EHR training programs and we did not expect to find any white reports that focused on EHR training programs. On September 5, 2023, we ran the search strategy in MEDLINE (PubMed), Web of Science, PsycINFO, and CINAHL without any date restrictions. We also hand-searched the bibliographies of included articles for other relevant studies to review.
Study selection
Three members of our study team (O.T.N., S.D.V., and T.L.) participated in the title and abstract screening as well as the full-text screening processes. Each article’s title and abstract were independently screened by a pair of reviewers. Similarly, for full-text reviews, a pair of reviewers independently assessed each article for final eligibility. Conflicts were reconciled by a third reviewer (H.C.). All review decisions were recorded using Covidence, a web-based application that facilitates review workflows.47 Inter-rater reliability was assessed.
Data extraction, synthesis, and analysis
Three members of the study team (O.T.N., S.D.V., and T.L.) participated in the data abstraction process. For each included study, a pair of reviewers abstracted the following information: (1) location (country), (2) study design, (3) unit of inpatient care, (4) hospital characteristics, (5) main training context (eg, onboarding vs implementation), (6) content areas of training, (7) entity that developed the training program, (8) entity that delivered the training program, (9) length of time period spent on training a nurse, (10) training modalities used (eg, classroom training, online modules), (11) whether the study reported effectiveness results of the EHR training program, and (12) facilitators and barriers of training program implementation and/or delivery. To help identify patterns in commonly encountered facilitators and barriers, we mapped these identified factors from the included studies to the updated Consolidated Framework for Implementation Research (CFIR).48 The CFIR provides an extensive list on the types of facilitators and barriers that can influence implementation of interventions. This framework also suggests that multilevel factors contribute to the success of an implementation. The levels include: (1) the innovation being implemented, (2) the outer setting that encompasses the social, economic, and political factors that affect the immediate work setting studied, (3) the inner setting that characterizes the immediate work setting studied, (4) individuals affected, and (5) aspects of the implementation process.48 We inductively created additional sub-themes for each of the domains based on the consensus of the study team. Discrepancies in the mapping process were resolved by a third reviewer (H.C.).
Results
Study characteristics
Our search strategy resulted in 3765 de-duplicated articles for review. After title and abstract screening, 63 articles remained for full-text review. We ultimately included 30 studies in this review (Figure 1).30,38,43,44,49–74 The authors had high agreement when making review decisions (Cohen’s k = 0.84). Studies used either a cohort design (n = 16, 53.3%) or a descriptive design (n = 14, 46.7%). Most studies (n = 20, 66.7%) were conducted in the United States. Other countries represented include Canada (n = 2, 6.7%), Australia (n = 1, 3.3%), and those in Asia (n = 4, 13.3%) and Africa (n = 2, 6.7%). Hospital characteristics were varied in size (ie, number of beds), teaching status, and rurality. Although most studies (56.7%) did not further specify what type of inpatient service was targeted in their studies, the remaining studies’ settings included intensive care units as well as psychiatry, medical, oncology, labor and delivery, and surgical units (File S3).
Figure 1.
PRISMA flowchart illustrating the study selection process.
Seventeen studies (56.7%) reported on implementation-related factors of EHR training programs (Table 1). Overall, we identified factors from the included studies that were associated with innovation, inner setting (ie, internal to the hospital), individuals, and implementation process. No factors were found pertaining to the outer setting (ie, external to the hospital).
Table 1.
Implementation factors of EHR training programs to nurses.
| Domain | Theme | Type of implementation factor | Identified factor | Study |
|---|---|---|---|---|
| Innovation | Ability to practice EHR skills after training is over | Facilitator | Letting nurses practice in EHR after training | Chao and Goldbort, 2012 |
| Facilitator | Training room open for practice | Jung et al., 2021 | ||
| Barrier | Not being able to practice in sandbox | Smailes, 2020 | ||
| Personalizing training | Facilitator | Offering one-on-one support sessions to individuals who need further training | Shala et al., 2021 | |
| Barrier | Using role-based training rather than delivering training based on skill level of learner | Colligan et al., 2015 | ||
| Barrier | Not being able to test out of content if nurse had EHR experience already | Smailes et al., 2019 | ||
| Barrier | Not being able to test out of content | Smailes, 2020 | ||
| Barrier | Not splitting up training sessions by role type | Stromberg, 2011 | ||
| Engaging learners | Facilitator | Training was done in a concise and interactive format | Topaz et al., 2013 | |
| Barrier | Lack of visual cues to assess if employees are struggling | Brown et al., 2022 | ||
| Barrier | Unable to physically point out information on screen | Brown et al., 2022 | ||
| Barrier | Students being unable to ask questions if muted | Brown et al., 2022 | ||
| Training pace | Facilitator | Breaking up training into several days | Stromberg, 2011 | |
| Barrier | Placing too much training content in a short period of time | Stromberg, 2011 | ||
| Barrier | Loss of attention from consecutive training length | Stromberg, 2011 | ||
| Barrier | Too much training content in a short period of time | Whittaker et al., 2009 | ||
| Barrier | Perceived fragmentation of training | Schenk et al., 2016 | ||
| Facilitator | Self-paced speed | Smailes, 2020 | ||
| Accessible training platform | Facilitator | Web deployment of training | Keenan et al., 2012 | |
| Training covers EHR workflows | Barrier | Training was focused on how to use the computer rather than how to integrate the EHR into nursing practice | Furlong, 2016 | |
| Avoiding continuous use of examples that learners cannot relate to | Barrier | Trainer using centric verbiage, such as “on my unit” or “at my hospital” | Malane et al., 2019 | |
| Inner Setting | Training budget | Barrier | Costs of hiring trainers | Kumar et al., 2013 |
| Barrier | Limited budget | Kumar et al., 2013 | ||
| Availability of computers for training | Facilitator | Conference room with computers available | Sockolow et al., 2014 | |
| Barrier | Limited number of computers | Harton et al., 2009 | ||
| Barrier | Not enough space in computer labs to train | Kumar et al., 2013 | ||
| Server uptime | Barrier | Overloaded Skype server that led to connection issues | Brown et al., 2022 | |
| Barrier | Downtime of the online training system | Shala et al., 2021 | ||
| Stakeholder involvement | Facilitator | Collaborating with nurse educators, hospital leaders, and unit leaders | Topaz et al., 2013 | |
| Facilitator | Having a nursing professional development group involved | Malane et al., 2019 | ||
| Accessibility of training | Barrier | Different work shifts | Kumar et al., 2013 | |
| Clear documentation requirements and expectations | Barrier | Lack of documentation standards | Sockolow et al., 2014 | |
| Individuals | Computer literacy | Barrier | Nurses’ lack of experience with computers | Harton et al., 2009 |
| Learning preferences | Barrier | Personal preferences for instructor-led formats | Smailes et al., 2019 | |
| Trust in trainers | Barrier | Interpersonal issues with proctor | Smailes et al., 2019 | |
| Implementation Process | Trainers and support staff hold nursing backgrounds | Facilitator | Super-users | Sockolow et al., 2014 |
| Facilitator | Early adopters served as educational champions | Topaz et al., 2013 | ||
| Facilitator | Super-users | Whittaker et al., 2009 | ||
| Reminders to complete training | Facilitator | Emails sent twice | Topaz et al., 2013 | |
| Facilitator | Printed emails at nursing stations | Topaz et al., 2013 | ||
| Motivation to complete training | Facilitator | Required training to be done | Topaz et al., 2013 | |
| Barrier | Not everyone completed training | Sockolow et al., 2014 | ||
| Barrier | Lack of incentives to complete training | Topaz et al., 2013 | ||
| Dissemination of EHR updates | Facilitator | EHR updates had to be done through a familiar format and through established channels | Topaz et al., 2013 | |
| Barrier | No process to distribute important educational updates post-training that affect EHR documentation | Malane et al., 2019 | ||
| Barrier | Changes to the system were not communicated | Sockolow et al., 2014 | ||
| Time allotted to complete training | Barrier | Limited time to train | Kumar et al., 2013 | |
| Barrier | Not enough time to complete modules | Smailes et al., 2019 | ||
| Barrier | Lack of dedicated time to complete training | Topaz et al., 2013 | ||
| Conducting training close to date of implementation | Barrier | Long time between training and EHR implementation | Chao and Goldbort, 2012 | |
| Barrier | Training dates were much earlier than implementation | Whittaker et al., 2009 | ||
| Avoiding the need to be proficient in 2 EHRs at once | Barrier | The old EHR system was still being used | Malane et al., 2019 | |
| Barrier | Required EHR ambassadors to be educated to new system while still teaching the old one | Malane et al., 2019 | ||
| Trainers inventory and adjust to learners’ needs | Facilitator | Trainers adapted to training needs | Jung et al., 2021 | |
| Offering training at multiple times | Facilitator | Training sessions held throughout study | Keenan et al., 2012 | |
| Having training in area free of distractions and interruptions | Barrier | Having training on patient floors | Chao and Goldbort, 2012 |
Abbreviation: EHR = electronic health record.
EHR training program characteristics
Overall, training programs generally supported onboarding processes or the implementation of an EHR system or a new feature within an existing EHR system. Most studies (n = 17, 56.7%) did not provide details on training content. Of the remaining studies that did, training content was highly varied and generally focused on EHR workflows. Some studies also focused on the familiarization of specific EHR features, such as templates, electronic medication administration systems, care plans, and calculators.
Across the 14 studies that reported who developed the training program, all but one indicated that the EHR training program was internally developed within the academic medical center by nursing faculty, internal information technology education teams, or nursing informaticians; or clinical nurse specialists. Similar to the development of training programs, most studies reported that training programs were delivered by someone in the academic medical center as opposed to the EHR vendor. These types of individuals included the same types of individuals who developed the training programs as well as charge nurses and staff nurses.
Training program length ranged from a few hours in the same day to several days or weeks. Longer periods were chosen to allow nurses time to process the information and practice taught skills. Some EHR training programs were delivered synchronously to nurses in the form of classroom training or virtual lectures delivered in real-time. Other programs used asynchronous methods, including emailed information and online modules. The use of simulations and sandbox EHR environments were also identified as a core component of several studies’ training approaches (File S2).
Facilitators and barriers to EHR training program implementation and delivery
Fifteen studies identified 7 innovation factors that may be related to the effectiveness of their EHR training program implementation and delivery.30,43,51,53,54,59,61,64,65,67,68,71–74 These included the ability to practice EHR skills after training was over, personalizing training, engaging learners, training pace, accessible training platforms, training covering EHR workflows, and avoiding continuous use of examples that learners cannot relate to.
Seven studies revealed 6 factors of the inner setting that may contribute to EHR training programs’ effectiveness.51,57,60,61,65,69,72 These included training budgets, availability of computers for training purposes, server uptime, stakeholder involvement, accessibility of training, and clear documentation requirements and expectations.
Two studies highlighted 3 individual-level factors that may contribute to EHR training programs’ effectiveness.57,67 These included computer literacy, learning preferences, and trust in trainers.
Ten studies reported on implementation-related factors that may contribute to EHR training programs’ effectiveness.30,53,59–61,67,69,72–74 These included trainers and support staff holding nursing backgrounds, super-users (ie, nurses who were highly proficient with the EHR), reminders to complete training, incentives and mandates to complete training, dissemination of EHR updates, time allotted to complete training, conducting training close to the date of implementation, avoiding the need to be proficient in 2 EHRs at once, trainers assessing and adjusting to learners’ needs, offering training at multiple times, and having training in areas free of distractions and interruptions (Table 1).
Discussion
Primary findings
This scoping review summarized the characteristics, facilitators, and barriers of EHR training program implementation and delivery for nurses working in inpatient settings. Overall, EHR training approaches used by healthcare systems varied in several characteristics, such as training contexts, who developed the training program, who delivered the training program, and types of modalities used. The studies also identified numerous categories of facilitators and barriers of implementing and delivering EHR training programs for nurses, including factors associated with innovations, inner setting, individuals, and implementation process, which highlight the importance of considering multilevel factors when implementing and delivering EHR training programs to nurses. Our review did not restrict included studies by publication year. Although some factors, such as having a limited number of computers for training or low computer literacy skills among nurses, may be less of an issue for contemporary EHR training programs, most factors continue to be relevant for health systems in current times. We discuss the implications for clinical practice and research below.
Implications of identified innovation factors
We noted numerous innovation-related factors in our review that emphasize different learning curves and needs among nurses. For instance, some healthcare systems allowed nurses to practice their EHR skills and workflows in a dedicated computer lab or a sandbox (ie, testing environment). Others supplemented class training with one-on-one training. These findings underscore the importance of recognizing varied levels of comfort and proficiency that nurses have with the EHR. Consequently, designing an EHR training curriculum that simultaneously meets the training needs and expectations of nurses with low, moderate, and high baseline EHR proficiency levels may be infeasible. In response to this, some studies in this review attempted to address this by providing supplemental training for nurses who were struggling or had created mechanisms for experienced nurses to “test out” of content if they can demonstrate that they already know the content or have received the EHR training elsewhere.67,68 These represent promising aspects for healthcare systems to adopt. Notably, healthcare systems with asynchronous online training also were able to offer nurses the ability to complete training at a pace they were comfortable with. However, these training models may be more suitable for onboarding nurses than for providing re-training or disseminating new workflows associated with upgrades in the EHR. In the latter cases, nurses often do not have dedicated time to complete training when they are working on patient floors. Consequently, the differential value of asynchronous training in these cases may be limited. Additional research is needed on effective ways to structure training content for working nurses. There also remains questions on how different EHR training models (eg, in-person only vs online only vs hybrid) compare among one another in terms of downstream EHR proficiency and efficiency.
Implications of implementation process factors
Several aspects of implementation are also worth highlighting. First, several studies in our review suggest that the use of trainers or super-users who are both proficient with the EHR and have a nursing background can facilitate EHR training programs for nurses.69,72–74 Similar sentiments have also been reported for physician learners.75 This may stem from enhanced abilities to contextualize EHR workflows in broader cognitive processes to support clinical evaluation and decision-making. Second, our review also found that not all nurses were able to complete EHR training programs especially in the contexts of implementation as opposed to onboarding. Some studies in this review also found that requiring training programs to be completed still did not result in full compliance. The reasons for this are unclear. Some possible explanations offered in this review include EHR training programs occurring in a place with distractions and the healthcare system not permitting sufficient time for nurses to complete EHR training programs or to thoroughly review how EHR updates impact their workflows. This suggests that simply enforcing the completion of training programs without providing supportive resources may inhibit training program reach and effectiveness.
Paucity of known outer setting factors
Our review also found a surprising absence of outer setting factors in the literature. This may suggest that outer settings have a minimal role in EHR training program implementation and delivery but this is unlikely. Outer settings include external forces that can influence organizational behavior and implementation strategies of the institution of interest.26,48 Several studies examining external accreditation and policies have demonstrated their roles in influencing internal organizational changes that impact nurses, such as legislation to spur the adoption of EHR systems and achieving Magnet status can improve organizational culture and adoption of practices to minimize patient safety issues.76,77 Furthermore, nursing school programs that provide didactic and/or experiential learning opportunities involving the EHR have been suggested to affect nurses’ EHR skills.78 Put together, there is a need for additional research to examine how accreditation criteria, insurance and government policies, and nursing school preparation can influence EHR training program design and implementation in hospital settings.
Paucity of EHR re-training programs and EHR updates
Another important finding was the included articles’ general focus of EHR training programs on supporting the initial implementation of a brand-new EHR. Meanwhile, fewer studies have been published that describe approaches to delivering periodic EHR retraining. We know that EHRs are dynamic, evolving over time, as new features are developed and integrated into the existing system or when interfaces and workflows are redesigned.79,80 Consequently, the training content used to support initial EHR implementation should differ from the training content used to sustain EHR use as time goes on.
The literature also predominantly focused on EHR training programs in the context of onboarding new nurses to the healthcare system. Although this suggests that nurses complete formalized EHR training programs only once, other studies in the literature have shown the beneficial outcomes of offering periodic or supplemental EHR retraining sessions to clinicians. These benefits include improved EHR proficiency and perceived EHR self-efficacy.23,24 Notably, these studies generally targeted physicians, physician assistants, and nurse practitioners.23,24 Given the potential value of EHR retraining, similar approaches should be explored in future research within the constraints specific to nurses working in inpatient settings. For instance, although most types of clinicians can receive this training during times when they are not scheduled to see patients, nurses generally have direct patient care contact during most or all of their shifts.
Limitations
This review comes with several limitations. First, most studies examined training program delivery for staff nurses, which may not generalize to other types of nurses (eg, travel nurses, floaters) in inpatient settings. Furthermore, most studies were conducted in non-rural and non-safety net hospitals. However, rural and safety net hospitals may have relatively fewer resources to devote to training program efforts.81 Consequently, they may require different approaches to implementing and delivering EHR training programs to their nurses. This represents an area in need of further research. Second, similar to other reviews, our review was limited by relatively sparse details from several studies on training program implementation and delivery. This points toward a need for more consistent reporting of training program characteristics to enable other healthcare systems to identify key components of effective training programs that they need to integrate into their own approaches. Third, as discussed previously, this review found a paucity of studies describing and evaluating EHR retraining programs and there will be a growing need for additional research in this area. Fourth, no study in this review examined how nurse preceptorships support EHR training.82 Since these training models rely on nurse preceptors imparting their personal EHR knowledge and practices to newer nurses, this can propagate both effective and ineffective EHR practices. Consequently, this represents another area for future inquiry. Notwithstanding these limitations, our review adds to the literature a summary of facilitators and barriers to help guide the delivery of EHR training programs for nurses and identifies several areas for future inquiry. Additional research is needed on how to build up and sustain some of these factors, such as approaches for disseminating news on EHR updates, mechanisms for experienced nurses to test out of training content and balancing the logistical conflicts of dividing training into multiple days or weeks versus reducing onboarding time to get nurses on to the floor quicker.
Conclusions
EHR training programs can help improve EHR proficiency among nurses and healthcare systems’ approaches to implementing and delivering these programs are highly varied. The findings from this scoping review highlighted the numerous factors pertaining to training interventions, healthcare systems, and implementation approaches. Meanwhile, it is less clear how external factors outside of a healthcare system influences EHR training programs. Additional studies are needed that focus on EHR retraining, comparing outcomes of different training models, and how to effectively disseminate updates with the EHR to nurses.
Supplementary Material
Acknowledgments
We wish to thank our health sciences librarian, Margaret Ansell, for her review and feedback on our initial search strategy. We also thank undergraduate students Jakyra McCloud and Lianny Propest for assisting with collecting the data.
Contributor Information
Oliver T Nguyen, Department of Family, Community and Health System Science, College of Nursing, University of Florida, Gainesville, FL 32611, United States; Department of Industrial and Systems Engineering, University of Wisconsin at Madison, Madison, WI 53706, United States.
Steven D Vo, Department of Epidemiology & Biostatistics, University of South Florida, Tampa, FL 33612, United States.
Taeheon Lee, Department of Biotechnology, Ghent University Global Campus, Incheon 21985, South Korea.
Kenrick D Cato, Department of Family and Community Health, School of Nursing, University of Pennsylvania, Philadelphia, PA 19104, United States; Department of Pediatric Data and Analytics, Children’s Hospital of Philadelphia, Philadelphia, PA 19104, United States.
Hwayoung Cho, Department of Family, Community and Health System Science, College of Nursing, University of Florida, Gainesville, FL 32611, United States.
Author contributions
Oliver T. Nguyen and Hwayoung Cho conceptualized the study. Oliver T. Nguyen, Steven D. Vo, and Taeheon Lee collected and analyzed the data. All authors interpreted the data. Oliver T. Nguyen drafted the manuscript. Steven D. Vo, Taeheon Lee, Kenrick D. Cato, and Hwayoung Cho provided critical revisions to the manuscript. All authors approved the submission.
Supplementary material
Supplementary material is available at Journal of the American Medical Informatics Association online.
Funding
This study was supported by the University of Florida College of Nursing Internal Pilot Project Award (to H.C.). The funder had no role in the collection, analysis, or interpretation of the data.
Conflicts of interest
None declared.
Data availability
Studies used in this review are publicly available. All data extracted as part of this review have been presented in this article.
Prior presentations
Portions of this work have been presented as a poster presentation at the 2024 Nursing Research Summit and Malasanos Lectureship.
References
- 1. Campanella P, Lovato E, Marone C, et al. The impact of electronic health records on healthcare quality: a systematic review and meta-analysis. Eur J Public Health. 2016;26(1):60-64. [DOI] [PubMed] [Google Scholar]
- 2. Wang SJ, Middleton B, Prosser LA, et al. A cost-benefit analysis of electronic medical records in primary care. Am J Med. 2003;114(5):397-403. [DOI] [PubMed] [Google Scholar]
- 3. Howley MJ, Chou EY, Hansen N, et al. The long-term financial impact of electronic health record implementation. J Am Med Inform Assoc. 2015;22(2):443-452. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Henry J, Pylypchuk Y, Searcy T, Patel V. Adoption of electronic health record systems among U.S. non-federal acute care hospitals: 2008-2015. Accessed February 18, 2019. https://dashboard.healthit.gov/evaluations/data-briefs/non-federal-acute-care-hospital-ehr-adoption-2008-2015.php
- 5. Jiang J, Qi K, Bai G, et al. Pre-pandemic assessment: a decade of progress in electronic health record adoption among U.S. hospitals. Health Aff Sch. 2023;1(5):qxad056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Stewart C. Share of adoption rates of health digital technologies in the UK in 2020, by type. 2022. Accessed January 28, 2024. https://www.statista.com/statistics/1255634/adoption-rates-of-health-digital-technologies-in-the-uk/
- 7. Liang J, Li Y, Zhang Z, et al. Adoption of electronic health records (EHRs) in China during the past 10 years: consecutive survey data analysis and comparison of Sino-American challenges and experiences. J Med Internet Res. 2021;23(2):e24813. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Kim Y-G, Jung K, Park Y-T, et al. Rate of electronic health record adoption in South Korea: a nation-wide survey. Int J Med Inform. 2017;101:100-107. [DOI] [PubMed] [Google Scholar]
- 9. Kutney-Lee A, Brooks Carthon M, Sloane DM, et al. Electronic health record usability: associations with nurse and patient outcomes in hospitals. Med Care. 2021;59(7):625-631. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Nijor S, Rallis G, Lad N, et al. Patient safety issues from information overload in electronic medical records. J Patient Saf. 2022;18(6):e999-e1003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Classen DC, Longhurst CA, Davis T, et al. Inpatient EHR user experience and hospital EHR safety performance. JAMA Netw Open. 2023;6(9):e2333152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Classen DC, Holmgren AJ, Co Z, et al. National trends in the safety performance of electronic health record systems from 2009 to 2018. JAMA Netw Open. 2020;3(5):e205547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Heponiemi T, Gluschkoff K, Vehko T, et al. Electronic health record implementations and insufficient training endanger nurses’ well-being: cross-sectional survey study. J Med Internet Res. 2021;23(12):e27096. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Mazur LM, Mosaly PR, Moore C, et al. Association of the usability of electronic health records with cognitive workload and performance levels among physicians. JAMA Netw Open. 2019;2(4):e191709. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Poissant L, Pereira J, Tamblyn R, et al. The impact of electronic health records on time efficiency of physicians and nurses: a systematic review. J Am Med Inform Assoc. 2005;12(5):505-516. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Nguyen OT, Shah S, Gartland AJ, et al. Factors associated with nurse well-being in relation to electronic health record use: a systematic review. J Am Med Inform Assoc. 2020;28(6):1288-1297. 10.1093/jamia/ocaa289 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Nguyen OT, Jenkins NJ, Khanna N, et al. A systematic review of contributing factors of and solutions to electronic health record-related impacts on physician well-being. J Am Med Inform Assoc. 2021;28(5):974-984. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Melnick ER, West CP, Nath B, et al. The association between perceived electronic health record usability and professional burnout among US nurses. J Am Med Inform Assoc. 2021;28(8):1632-1641. 10.1093/jamia/ocab059 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Ligibel JA, Goularte N, Berliner JI, et al. Well-being parameters and intention to leave current institution among academic physicians. JAMA Netw Open. 2023;6(12):e2347894. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Melnick ER, Fong A, Nath B, et al. Analysis of electronic health record use and clinical productivity and their association with physician turnover. JAMA Netw Open. 2021;4(10):e2128790. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. English EF, Holmstrom H, Kwan BW, et al. Virtual sprint outpatient electronic health record training and optimization effect on provider burnout. Appl Clin Inform. 2022;13(1):10-18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Johnson E, Roth E.. Improving physician wellness through electronic health record education. Int J Psychiatry Med. 2021;56(5):327-333. [DOI] [PubMed] [Google Scholar]
- 23. Gordon JE, Belford SM, Aranguren DL, et al. Outcomes of Mayo Clinic reBoot camps for postimplementation training in the electronic health record. J Am Med Inform Assoc. 2022;29(9):1518-1524. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Lourie EM, Utidjian LH, Ricci MF, et al. Reducing electronic health record-related burnout in providers through a personalized efficiency improvement program. J Am Med Inform Assoc. 2021;28(5):931-937. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Longhurst CA, Davis T, Maneker A, et al. ; Arch Collaborative. Local investment in training drives electronic health record user satisfaction. Appl Clin Inform. 2019;10(2):331-335. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Harvey G, Kitson A.. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11:33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Aarons GA, Hurlburt M, Horwitz SM.. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Pantaleoni JL, Stevens LA, Mailes ES, et al. Successful physician training program for large scale EMR implementation. Appl Clin Inform. 2015;6(1):80-95. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Jung SY, Hwang H, Lee K, et al. User perspectives on barriers and facilitators to the implementation of electronic health records in behavioral hospitals: qualitative study. JMIR Form Res. 2021;5(4):e18764. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. McGinn CA, Grenier S, Duplantie J, et al. Comparison of user groups’ perspectives of barriers and facilitators to implementing electronic health records: a systematic review. BMC Med. 2011;9:46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Ting J, Garnett A, Donelle L.. Nursing education and training on electronic health record systems: an integrative review. Nurse Educ Pract. 2021;55:103168. [DOI] [PubMed] [Google Scholar]
- 33. Robinson KE, Kersey JA.. Novel electronic health record (EHR) education intervention in large healthcare organization improves quality, efficiency, time, and impact on burnout. Medicine (Baltimore). 2018;97(38):e12319. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Mohan V, Garrison C, Gold JA.. Using a new model of electronic health record training to reduce physician burnout: a plan for action. JMIR Med Inform. 2021;9(9):e29374. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Stroup K, Sanders B, Bernstein B, et al. A new EHR training curriculum and assessment for pediatric residents. Appl Clin Inform. 2017;8(4):994-1002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Pereira AG, Kim M, Seywerd M, et al. ; Minnesota Epic101 Collaborative. Collaborating for competency—a model for single electronic health record onboarding for medical students rotating among separate health systems. Appl Clin Inform. 2018;9(1):199-204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Boniol M, Kunjumen T, Nair TS, et al. The global health workforce stock and distribution in 2020 and 2030: a threat to equity and ‘universal’ health coverage? BMJ Glob Health. 2022;7(6):e009316. 10.1136/bmjgh-2022-009316 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Tilahun B, Fritz F.. Comprehensive evaluation of electronic medical record system use and user satisfaction at five low-resource setting hospitals in Ethiopia. JMIR Med Inform. 2015;3(2):e22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Ramoo V, Kamaruddin A, Wan Nawawi WNF, et al. Nurses’ perception and satisfaction toward electronic medical record system. Florence Nightingale J Nurs. 2023;31(1):2-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Whalen K, Grella P, Snydeman C, et al. Nursing attitudes and practices in code documentation employing a new electronic health record. Appl Clin Inform. 2021;12(3):589-596. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. De Leeuw JA, Woltjer H, Kool RB.. Identification of factors influencing the adoption of health information technology by nurses who are digitally lagging: in-depth interview study. J Med Internet Res. 2020;22(8):e15630. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Top M, Gider O.. Nurses’ views on electronic medical records (EMR) in Turkey: an analysis according to use, quality and user satisfaction. J Med Syst. 2012;36(3):1979-1988. [DOI] [PubMed] [Google Scholar]
- 43. Furlong KE. EHR learning—it’s about nursing, leadership and long-term commitments. Nurs Leadersh (Tor Ont). 2016;28(4):38-47. [DOI] [PubMed] [Google Scholar]
- 44. Ramukumba MM, El Amouri S.. Nurses’ level of computer literacy and responses regarding the electronic health record system in the United Arab Emirates. Afr J Nurs Midwifery. 2018;19(2):14. [Google Scholar]
- 45. Samadbeik M, Fatehi F, Braunstein M, et al. Education and training on electronic medical records (EMRs) for health care professionals and students: a scoping review. Int J Med Inform. 2020;142:104238. [DOI] [PubMed] [Google Scholar]
- 46. Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467-473. [DOI] [PubMed] [Google Scholar]
- 47.Covidence. Covidence. Accessed March 26, 2024. https://www.covidence.org/
- 48. Damschroder LJ, Reardon CM, Widerquist MAO, et al. The updated Consolidated Framework for Implementation Research based on user feedback. Implement Sci. 2022;17(1):75. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Adereti CS, Olaogun AA.. Use of electronic and paper-based standardized nursing care plans to improve nurses’ documentation quality in a Nigerian teaching hospital. Int J Nurs Knowl. 2019;30(4):219-227. [DOI] [PubMed] [Google Scholar]
- 50. AlQahtani M, AlShaibani W, AlAmri E, et al. Electronic health record-related stress among nurses: determinants and solutions. Telemed J E Health. 2021;27(5):544-550. [DOI] [PubMed] [Google Scholar]
- 51. Brown A, Patel R, Edmister K, et al. An innovative approach to remote electronic health onboarding record education amid a global pandemic. Comput Inform Nurs. 2022;40(10):711-717. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. Chang C-P, Lee T-T, Liu C-H, et al. Nurses’ experiences of an initial and reimplemented electronic health record use. Comput Inform Nurs. 2016;34(4):183-190. [DOI] [PubMed] [Google Scholar]
- 53. Chao C-A, Goldbort J.. Lessons learned from implementation of a perinatal documentation system. J Obstet Gynecol Neonatal Nurs. 2012;41(5):599-608. [DOI] [PubMed] [Google Scholar]
- 54. Colligan L, Potts HWW, Finn CT, et al. Cognitive workload changes for nurses transitioning from a legacy system with paper documentation to a commercial electronic health record. Int J Med Inform. 2015;84(7):469-476. [DOI] [PubMed] [Google Scholar]
- 55. Evatt M, Ren D, Tuite P, et al. Development and implementation of an educational support process for electronic nursing admission assessment documentation. Medsurg Nurs. 2014;23(2):89-95, 100. [PubMed] [Google Scholar]
- 56. Gray C, Bee S, Bertka K.. Nurses and computerized systems: is ‘hands-on’ most helpful? Nurs Manage. 2010;41(1):35-38. [DOI] [PubMed] [Google Scholar]
- 57. Harton BB, Borrelli L, Knupp A, et al. Integrating traditional nursing service orientation content with electronic medical record orientation. J Nurses Staff Dev. 2009;25(5):229-235. [DOI] [PubMed] [Google Scholar]
- 58. Howarth M, Bhatt M, Benterud E, et al. Development and initial implementation of electronic clinical decision supports for recognition and management of hospital-acquired acute kidney injury. BMC Med Inform Decis Mak. 2020;20(1):287. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59. Keenan GM, Yakel E, Yao Y, et al. Maintaining a consistent big picture: meaningful use of a Web-based POC EHR system. Int J Nurs Knowl. 2012;23(3):119-133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60. Kumar A, Bhatia S, Chiang I-J.. Deployment of an in-house designed training process in a quaternary care hospital. Technol Health Care. 2013;21(5):469-478. [DOI] [PubMed] [Google Scholar]
- 61. Malane EA, Richardson C, Burke KG.. A novel approach to electronic nursing documentation education: ambassador of learning program. J Nurses Prof Dev. 2019;35(6):324-329. [DOI] [PubMed] [Google Scholar]
- 62. Misto K, Padula C, Dame L, et al. Interprofessional evidence-based strategies to enhance provider and patient interactions during electronic health record use. J Nurses Prof Dev. 2020;36(3):134-140. [DOI] [PubMed] [Google Scholar]
- 63. Rungvivatjarus T, Kuelbs CL, Miller L, et al. Medication reconciliation improvement utilizing process redesign and clinical decision support. Jt Comm J Qual Patient Saf. 2020;46(1):27-36. [DOI] [PubMed] [Google Scholar]
- 64. Schenk EC, Mayer DM, Ward-Barney E, et al. RN perceptions of a newly adopted electronic health record. J Nurs Adm. 2016;46(3):139-145. [DOI] [PubMed] [Google Scholar]
- 65. Shala DR, Jones A, Alexander N, et al. Responding to the challenge of a pandemic: the rapid conversion of electronic medical record training for nurses from classroom-based instructional learning to a blended learning approach in a large multisite organization. Comput Inform Nurs. 2021;39(4):171-175. [DOI] [PubMed] [Google Scholar]
- 66. Shelden D, Ateya M, Jensen A, et al. Improving hospital glucometrics, workflow, and outcomes with a computerized intravenous insulin dose calculator built into the electronic health record. J Diabetes Sci Technol. 2021;15(2):271-278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67. Smailes PS, Zurmehly J, Schubert C, Loversridge JM, et al. An electronic medical record training conversion for onboarding inpatient nurses. Comput Inform Nurs. 2019;37(8):437-438. [DOI] [PubMed] [Google Scholar]
- 68. Smailes P. Competency evaluation and satisfaction of an inpatient nursing electronic medical record curriculum conversion from classroom to e-learning. Online J Nurs Inform OJNI Chicago. 2020;37(8):405-412. [Google Scholar]
- 69. Sockolow PS, Rogers M, Bowles KH, et al. Challenges and facilitators to nurse use of a guideline-based nursing information system: recommendations for nurse executives. Appl Nurs Res. 2014;27(1):25-32. [DOI] [PubMed] [Google Scholar]
- 70. Steward DJ, Mullinix C, Wu Q.. Written versus simulation-based evaluation methods to assess competency and confidence in the use of electronic medical records. J Contin Educ Nurs. 2018;49(6):262-268. [DOI] [PubMed] [Google Scholar]
- 71. Stromberg SC. A training model for orienting newly hired nurses to an organization’s electronic health record. Comput Inform Nurs. 2011;29(6):321-325. [DOI] [PubMed] [Google Scholar]
- 72. Topaz M, Rao A, Masterson CR, et al. Educating clinicians on new elements incorporated into the electronic health record: theories, evidence, and one educational project. Comput Inform Nurs. 2013;31(8):375-379; quiz 380-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73. Whittaker AA, Aufdenkamp M, Tinley S.. Barriers and facilitators to electronic documentation in a rural hospital. J Nurs Scholarsh. 2009;41(3):293-300. [DOI] [PubMed] [Google Scholar]
- 74. Yates C. Implementing a bar-coded bedside medication administration system. Crit Care Nurs Q. 2007;30(2):189-195. [DOI] [PubMed] [Google Scholar]
- 75. Gui X, Chen Y, Zhou X, et al. Physician champions’ perspectives and practices on electronic health records implementation: challenges and strategies. JAMIA Open. 2020;3(1):53-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76. Anderson VL, Johnston ANB, Massey D, et al. Impact of MAGNET hospital designation on nursing culture: an integrative review. Contemp Nurse. 2018;54(4-5):483-510. [DOI] [PubMed] [Google Scholar]
- 77. Adler-Milstein J, Jha AK.. HITECH act drove large gains in hospital electronic health record adoption. Health Aff (Millwood). 2017;36(8):1416-1422. [DOI] [PubMed] [Google Scholar]
- 78. Velez K, John J.. Preparing nurses to use electronic health records. Am J Nurs. 2023;123(4):13. [DOI] [PubMed] [Google Scholar]
- 79. Landi H. Epic plans to launch AI validation software for healthcare organizations to test, monitor models. Accessed July 20, 2024. 2024. https://www.fiercehealthcare.com/ai-and-machine-learning/epic-plans-launch-ai-validation-software-healthcare-organizations-test
- 80. Adler-Milstein J, Holmgren AJ, Kralovec P, et al. Electronic health record adoption in US hospitals: the emergence of a digital ‘advanced use’ divide. J Am Med Inform Assoc. 2017;24(6):1142-1148. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81. van Zyl C, Badenhorst M, Hanekom S, et al. Unravelling ‘low-resource settings’: a systematic scoping review with qualitative content analysis. BMJ Glob Health. 2021;6(6):e005190. 10.1136/bmjgh-2021-005190 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82. Pagulayan J, Eltair S, Faber K. Nurse documentation and the electronic health record. Accessed January 28, 2024. 2018. https://www.myamericannurse.com/documentation-electronic-health-record/
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Studies used in this review are publicly available. All data extracted as part of this review have been presented in this article.

