Skip to main content
Journal of the American Medical Informatics Association: JAMIA logoLink to Journal of the American Medical Informatics Association: JAMIA
. 2023 Feb 7;30(4):761–774. doi: 10.1093/jamia/ocad011

Clinical information system (CIS) implementation in developing countries: requirements, success factors, and recommendations

Soe Ye Yint Tun 1, Samaneh Madanian 2,
PMCID: PMC10018272  PMID: 36749093

Abstract

Objective

Clinical Information System (CIS) usage can reduce healthcare costs over time, improve the quality of medical care and safety, and enhance clinical efficiency. However, CIS implementation in developing countries poses additional, different challenges from the developed countries. Therefore, this research aimed to systematically review the literature, gathering and integrating research findings on Success Factors (SFs) in CIS implementation for developing countries. This helps to integrate past knowledge and develop a set of recommendations, presented as a framework, for implementing CIS in developing countries.

Materials and Methods

A systematic literature review was conducted, followed by qualitative data analysis on the published articles related to requirements and SF for CIS implementation. Eighty-three articles met the inclusion criteria and were included in the data analysis. Thematic analysis and cross-case analysis were applied to identify and categorize the requirements and SF for CIS implementation in developing countries.

Results

Six major requirement categories were identified including project management, financial resources, government involvement and support, human resources, organizational, and technical requirements. Subcategories related to SF are classified under each major requirement. A set of recommendations is provided, presented in a framework, based on the project management lifecycle approach.

Conclusion

The proposed framework could support CIS implementations in developing countries while enhancing their rate of success. Future studies should focus on identifying barriers to CIS implementation in developing countries. The country-specific empirical studies should also be conducted based on this research’s findings to match the local context.

Keywords: clinical information systems, developing countries, implementation, CIS, requirements, critical success factors, low-resource settings, digital health

INTRODUCTION

Many low- and middle-income countries struggle to deliver comprehensive healthcare services because of budget limitations, poor policy, or technical and human resources inadequacy.1 To address these issues and improve care quality, structural reforms and increasing the number of healthcare workers have been implemented.2 However, these have not completely addressed the issues, and major challenges remain in fulfilling the population’s healthcare requirements. Coronavirus disease 2019 (COVID-190 caused unprecedented disruption to the healthcare system in general, and in low- and middle-income countries in particular, this has aggravated the situation.3 Clinical information system (CIS) implementations are perceived as solutions to address the increasing issues of demand and supply,4 and especially after COVID-19, healthcare has been witnessing the benefits of digital health tools and solutions.5

CIS is a computer-supported system for collecting, storing, managing, and making important clinical information available for the healthcare delivery process.6 In this research, CIS encompasses electronic information systems used in healthcare, ranging from improving quality of health and patient safety to enhancing clinical efficiency. A specific type of CIS, Electronic Medical Record (EMR), is used extensively in Europe and the United States.4,7 Other sub-component technologies in CIS, such as order entry systems and decision support systems, are also playing an important role in reducing medical errors, improving the efficiency and quality of healthcare.7 CIS supports medical staff by providing easy and systematic access to patients’ data.2

However, CIS implementation is challenging with relatively high uncertainty of success, even for developed countries.7 Despite several attempts on adopting CIS to facilitate medical information recording, only a few have successfully implemented.8,9 Many IT projects have failed in healthcare,10 with CIS failure rates of up to 70%.11 This situation is more complex in developing countries because of resource constraints.

To minimize CIS failure and reduce financial loss, especially in developing countries, it is essential to raise the success rates of implementations.12 This can be achieved through continuous knowledge enhancement,13 careful requirement gathering, analysis, understanding, and considering the fundamental “success or failure” causes in CIS implementation.14

This research attempts to gather and integrate the available knowledge on CIS implementation requirements and Success Factors (SFs). By comparing and contrasting the findings for both developing and developed countries, this study could have important contributions to broadening the understanding of the requirements and SF for CIS implementation in developing countries. The integrated knowledge was classified into requirements and their related SF and presented as considerations in a framework specific to developing countries.

CIS helps physicians with analyzing patients’ conditions, choosing treatment options, and monitoring wellness activities.6 CIS scope can be limited to a single area, eg, ICU Information System (IS), or can encompass all aspects of the clinical care process, such as EMR and laboratory IS.6,15 The core components of CIS are categorized as Electronic Healthcare Records (EHR), clinical decision support,6 computerized provider order entry, digital sources of medical evidence and decision-support tools,16 speciality systems such as oncology, and ancillary ISs (eg, pharmacy, laboratory, or radiology ISs). CIS also can be accessed for physicians’ and researchers’ training or research.6

CIS implementation is expensive and complex with extreme disruption to the conventional workflow. To optimize CIS benefits, careful planning and harmonizing with the healthcare service delivery process is necessary. Successful implementation involves a long continuous process, from planning, designing, and piloting to intermittent use, changing for acceptance, and incorporating into the routine process.17 CIS success is a dynamic concept ranging from finishing projects within the estimated budget and time, meeting the target outcomes, or getting users’ satisfaction.18 This success can be measured using evaluation models19–22 or traditional project management (PM) concepts, such as delivering CIS within the approved budget, timeframe, and promised quality and benefits of CIS.23 User satisfaction, perceived usefulness, and quality are also associated with IS success.24,25

Various strategies for successful CIS implementations have been suggested26,27; some of them can be generalized irrespective of the settings, while others might be very specific depending on the cultural factors, computer skills, and organizational and user requirements.28 Different studies have been conducted to identify the SF to reduce CIS implementation failure which investigated the contributed SF from different perspectives, such as user acceptance,29 user expectations and CIS functionality,30 or the differences in implementation in 2 countries.31 Some studies have identified and categorized SF for different types of IS used in various healthcare disciplines. Research was conducted for oncology-related CIS,32 while another study identified the SFs and barriers to the implementation of CIS in an integrated care setting.33 Ten factors were proposed for the successful implementation of EHR (a type of CIS),34 while another study identified 26 critical SFs for EHR adoption.35 These studies have different sample sizes of 1636 and 35 articles.37

These examples demonstrate a lack of consistency and comprehensiveness in CIS implementation requirements and SF. Furthermore, most research studies considered CIS in developed countries, with a limited focus on developing countries.38–41 The majority of the studies about CIS implementation were conducted in North America (69.45%) followed by Europe (19.45%).42 As implementation requirements for developing countries is different from that of developed countries,7,43,44 different sets of requirements and SFs might contribute to the CIS’s successful implementation. Therefore, this study aims to integrate the available knowledge to address specific requirements of developing counties, and extract knowledge to apply in developing countries. This can be presented as considerations in a framework specific to developing countries.

MATERIALS AND METHODS

A Systematic Literature Review (SLR) was conducted, followed by a qualitative thematic and cross-case analysis of selected published literature. SLR was selected to aggregate and synthesize past information on the topic to provide a comprehensive presentation of the available knowledge.45

Given the multi-disciplinary nature of the research, 5 databases were selected: PubMed, ScienceDirect, IEEEXplore, Scopus, and Google Scholar databases. To gather articles from these databases, the keywords (Supplementary Appendix SA) and their possible synonyms and acronyms were included to construct search strings (Supplementary Appendix SB). The publication date was set to include the published articles between 2000 and 2020. This gave us 254 articles. After removing 72 duplicates and adding 2 more relevant articles from the literature review process, 184 articles remained for the full-text assessment. Abstracts and full-text were skimmed based on the inclusion/exclusion criteria (Supplementary Appendix SC) that excluded further 101 articles. A total of 83 articles were included in the qualitative analysis. The process of systematic article selection followed Staples and Niazi’s SLR guidlines46 and presented using the PRISMA diagram47 (Figure 1).

Figure 1.

Figure 1.

PRISMA diagram.

Using 83 articles, a dataset in NVivo48 was created for thematic and cross-case analyses. An in-depth reading of articles was performed to extract data related to requirements, their SF, and barriers to CIS implementation. The extracted data were grouped into relevant themes/categories which were created based on deductive and inductive reasoning.49,50 The deductive method was used to pre-define the main categories based on our research objectives, including developing countries, developed countries and general. The general category is added as some articles did not specify whether the research was for developing or developed countries.

For the rest of the analysis, the inductive method was used to explore all the possible requirements and their SF. The combined reasoning method allowed us to classify the requirements and SF for developing countries and developed countries. It also helped in the identification of the emerging SF and requirements in the latter stage with the inductive method.51

After thematic analysis, the stacking method was used to organize and compare52 the requirements and SF of 3 cases: (1) developing countries, (2) general, and (3) developed countries. The stacking technique is a method of displaying a series of cases in a meta-matrix by fields of interest.52 Each case was organized in a comparable frame that enabled a systematic visualization and contrasting of all cases together at the same time. As case-2 data represented both developing and developed countries, case-2 was recognized as a general (common) case. Data from case-1 and case-3 were moved and merged into case-2 if there were similar requirements and SF (Figure 2). The data unique to case-1 or case-3 were marked separately during the merge, to keep track of requirements and SF for developing countries and developed countries. After stacking the 3 cases, a comprehensive framework was created for requirements and their SF for implementing CIS in both developing and developed countries.

Figure 2.

Figure 2.

Cross-case analysis: stacking method.

RESULTS

Most articles in this study were from high-income countries (60.2%), followed by low- and middle-income countries (20.5%) and not specified (19.3%). Supplementary Appendices SD and SE provide the detailed characteristics of these articles.

We identify a set of requirements necessary for CIS’s successful implementation, which helps to define a benchmark for successful CIS implementation. Our analysis reveals 6 major requirements with their related sub-categories and SFs (Figure 3).

Figure 3.

Figure 3.

CIS implementation requirements.

For each requirement, its SF(s) were identified. The SF is defined as a vital element in addressing the identified requirements and the overall CIS project’s success.26 For example, change management (CM) is a part of PM,53,54 and “feedback-dialogue” is identified as its SF.44 Similarly, in “Communication”, “trust and reliability” is recognized as effective communication SF.55 See Supplementary Appendix SF for the list of requirements and SFs.

Project management

PM is “the application of knowledge, skills, tools, and techniques to project activities to meet the project requirements”.56 PM is a strong factor in CIS’s successful implementation,57 which is classified into subcategories (Table 1).

Table 1.

PM requirements and number of articles included

Requirements No. of articles (developing countries) No. of articles (developed countries) No. of articles (not specified) Total no. of articles % of total articles (n = 3)
R1 Project management 0 0 0 0 0.00
 R1.1 Change management 13 4 5 22 26.51
 R1.2 Creating a detailed roadmap 3 1 2 6 7.23
 R1.3 Evidence-based implementation strategy 2 0 1 3 3.61
 R1.4 Planning 10 2 2 14 16.87
 R1.5 Testing and troubleshooting 0 3 4 7 8.43

Financial resources requirement

Financial resources (FR) are the foundation of projects. Although FR cannot guarantee projects’ success,2,58,59 neglecting them is a significant barrier to the CIS’s success.60 A significant positive relationship between FR and CIS success has been reported.61,62 FR is the major requirement mentioned in the studies related to developing countries (see Table 2 for related SFs).

Table 2.

FR, SF, and number of articles included

Requirements and success factors No. of articles (developing countries) No. of articles (developed countries) No. of articles (not specified) Total no. of articles % of total articles (n = 3)
R2 Financial resources requirements 0 3 0 3 3.61
 Adequate funding 6 2 3 11 13.25
 Budgeting methods 0 1 0 1 1.20
 Resource allocation 4 0 3 7 8.43
 R2.1 Sufficient resources 8 0 2 10 12.05
  Long-term commitment of resources 2 0 0 2 2.41
   Annual budget for IT 2 0 0 2 2.41
   Sufficient budget for continued operation and maintenance 0 1 0 1 1.20

Government involvement and support

National and local governments’ support directly affects the success of CIS implementations, despite healthcare organization management having no control over the government policy.53 Political factors such as a change in government, their willingness for CIS investment, policy, flexible bureaucracy, and quality control tools can influence the success of CIS.61 Government organizations may establish requirements which aim to increase effectiveness and efficiency, such as patient safety, quality improvement, and patient rights. The CIS should be designed to fulfil the requirements set by the government to get support from the government.53 The related SFs of this category are shown in Table 3.

Table 3.

Government’s involvement and support requirements, SF and number of articles included

Requirements and success factors No. of articles (developing countries) No. of articles (developed countries) No. of articles (not specified) Total no. of articles % of total articles (n = 3)
R3 Government’s involvement and support 4 4 3 11 13.25
 Allocating separate budgets for CIS projects 0 2 0 2 2.41
 Developing and implementing legislation for data ownership, privacy and security 0 1 0 1 1.20
 Industry support 1 0 0 1 1.20
 Government policy 0 2 0 2 2.41
  Political willingness 4 1 2 7 8.43
 Incentives for implementers 0 0 1 1 1.20
  Interest-free loan 1 0 0 1 1.20
 Strategic IT planning 0 2 0 2 2.41
  Investigate and invest in alternative infrastructure facilities 0 1 0 1 1.20

Human resources

Human resources (HR) plays a critical role in CIS implementation success.2,26 Our results indicate among all HR requirements (Table 4), “project champions” has a major contribution to CIS implementation success.4,42,63 To raise success, having clinical champions with IT and PM knowledge as project leaders is a “must”.64–66 Clinical champions can represent end-users, and by providing training and technical support, help to overcome clinician resistance, bridge gaps between different groups of stakeholders, and resolve communication issues between IT and clinical teams.40,66–69

Table 4.

HR requirements, SF, and number of articles included

Requirements and success factors No. of articles (developing countries) No. of articles (developed countries) No. of articles (not specified) Total no. of articles % of total articles (n = 3)
R4 Human resources requirements 1 3 2 6 7.23
 R4.1 IT teams 1 0 0 1 1.20
  R4.1.1 Developers 1 0 0 1 1.20
  R4.1.2 Project champions 27 2 9 38 45.78
 R4.2 Project manager 6 0 2 8 9.64%
 R4.3 Vendors 0 0 0 0 0.00%
 R4.4 Skilled staff 0 5 0 5 6.02%

Organizational requirement

Organization requirements (Table 5) should be considered for CIS implementation.17 Compared with other requirements, they have limited influence on the success of CIS implementation.70 Nevertheless, they are interrelated with other SFs with “communication” being one of the most cited requirements. Having different communication approaches at different levels is critical for the successful implementation of CIS.17 Constant communication, project updates, and clear information flow among all stakeholders facilitate individual commitment and reduce resistance to change. Communication is the foundation that holds teams together.71 “Knowledge transfer” and “trust & reliability” are the associated SFs for achieving effective communication. Other studies describe “Trust & reliability” as SF not limited to proper communication but also for the CIS implementation.55,72

Table 5.

Organizational requirements and number of articles included

Requirements No. of articles (developing countries) No. of articles (developed countries) No. of articles (not specified) Total no. of articles % of total articles (n = 3)
R5 Organizational requirement 1 4 1 6 7.23%
 R5.1 Organizational culture 6 2 3 11 13.25%
  R5.1.1 Change readiness 0 0 1 1 1.20%
 R5.2 Communication 12 5 6 23 27.71
 R5.3 Organization strategy 7 1 2 10 12.05
 R5.4 Organizational structure, size, and stability 2 3 1 6 7.23
 R5.5 Organizational support 0 2 1 3 3.61

Technical requirement

Technical requirements (Table 6) have less influence on the success of CIS than human factors such as healthcare professionals’ attitudes and involvement.70,73 However, they are closely linked with HR and organizational requirements.17 Therefore, due to the high inter-dependencies, technical requirements are as important as other requirements.

Table 6.

Technical requirements and number of articles included

Requirements No. of articles (developing countries) No. of articles (developed countries) No. of articles (not specified) Total no. of articles % of total articles (n = 3)
R6 Technical requirement 2 3 1 6 7.23
 R6.1 Hardware requirements 0 0 0 0 0.00
 R6.2 Infrastructure requirements 0 0 0 0 0.00
  R6.2.1 Electricity 0 2 0 2 2.41
  R6.2.2 Infrastructure support 0 2 0 2 2.41
 R6.3 Network requirements 0 0 0 0 0.00
  R6.3.1 Internet availability 0 3 0 3 3.61
 R6.4 Service Requirements 0 1 0 1 1.20
  R6.4.1 Regular maintenance and quality improvement 5 0 2 7 8.43
  R6.4.2 Training and technical support 28 11 11 50 60.24
   R6.4.2.1 Adequate technical assistance 6 4 4 14 16.87
 R6.5 Software requirements 0 0 0 0 0.00
  R6.5.1 Appropriate software package 9 6 3 18 21.69
  R6.5.2 System, services and information quality 3 4 4 11 13.25
  R6.5.3 Workflow understanding and co-development 17 2 8 27 32.53
 R6.6 Data management 0 0 0 2 2.41
  R6.6.1 Data security, privacy and confidentiality 6 5 5 16 19.28
  R6.6.2 Data quality and interoperability 3 1 6 19 22.89
  R6.6.3 System backup 1 0 1 2 2.41

Software package

Instead of in-house development, selecting from the available CIS products and their customization is recommended. To minimize customizations, selecting appropriate software and system architecture that fits the desired organization’s CIS is essential.18,71 Cost, user-friendliness, interoperability, and vendor are among important factors for CIS selection. A well-defined selection process and criteria can increase implementation success.44,74,75 “Ease of Use” is associated with supporting the clinical workflow37 so users use the system with a minimum time.76,77 The presence of clearly written processes can help the users with effective usage and time-saving while preventing workarounds.78

Open-source systems are popular for CIS implementation in developing countries.7,79–81 They have lower installation costs and availability of source codes makes customization possible.7 For system sustainability and gaining ownership,2 upskilling is necessary. Starting with relatively comprehensive open-source software with a large network of supporting communities such as the OpenMRS platform can facilitate adoption.82 Open-source software and customization bring huge advantages to resource-constrained situations that are considered SF.2

Designing the system

The system also should be customized to match the requirements of the organization and stakeholders. Understanding the workflow and co-development of the system with IT, clinicians, and project teams become essential in this step. To increase user acceptance, CIS should be designed to fit the clinical work tasks and information flows, and match the paper-based system and electronic system.17,42,53,83 The customization process could increase costs and times, error susceptibility, and limit the advantage of updates and upgrades.71,84 The Workflow Analysis Task Force, including clinical staff, can be created to seek and choose an approach best fit for the practice.65,85

Identifying CIS data types is another crucial task. This identification can be undertaken using end-user requirement analysis, and the clinical staff.18 The clinicians should actively participate and identify data types and their definitive source for each data item.17,64 Thus, standard data quality can be achieved with the approval of the end-users which motivates them to become involved in the data entry process.77 Having quality data can also enhance decision-making quality, and promote long-term advantages such as enabling the discovery of new treatments, improving current treatments, and shortening drug development duration.35,83

Data management

Implementing CIS comes with several workflows, information collection, and storage changes including converting paper records into the CIS system in developing countries.18,44,71 A data standardization process is necessary to improve data quality and where required interoperability.35,86 While ensuring interoperability can be achieved following standards, a broader long collaboration between end-users and data managers is essential to ensure their consistency.83 All stakeholders’ involvement, especially end-users, is crucial for CIS implementation.17,53,87 A skilled data manager can monitor data quality regularly using survey tools and feedback meetings.7

Data security, privacy, and confidentiality in healthcare are of prime importance. Healthcare data contain sensitive and personal information, when breached, it can have negative consequences on patients, the worst case being the patient’s identity theft.88 Therefore, the government’s role is critical to establish legislation for confidentiality, data privacy, and security.89 Additionally, valuable medical data needs to be backed up with a disaster recovery plan to prevent the loss of data from various conditions such as external attacks, or any natural disasters.66,90

DISCUSSION

We reviewed and integrated the available knowledge for successful CIS implementations in developing countries. The findings were presented as a list of requirements, SFs, and recommendations; “Training and Technical Support” having the highest contribution. This implies long-term plans for local workforce training considerably improves CIS success rates in developing countries. This training addresses other important implementation requirements including “project management” and “human resources”, and their SFs including “effective project management”, “change management”, and “project champions”.

Supplementary Appendix SF provides a detailed comparison of requirements and SFs for developing and developed countries. Although the identified requirements and SFs can be considered for a general CIS project implementation, our results suggest that priority should be given to the list, unique to the developing countries (Figure 4).

Figure 4.

Figure 4.

Requirements and SF related to developing countries.

Figure 5.

Figure 5.

CIS project lifecycle for developing countries.

Based on Figure 4 and a comparative analysis of the requirements in Supplementary Appendix SF, a framework is proposed, structured based on the PM lifecycle.91 This framework (Figure 5) is customized and identified different tasks and activities in project lifecycle phases . Based on the significant role of CM in CIS success, we proposed this area as a separate phase. This framework also considers the Principles for Digital Development (PFDD).92

CIS project life cycle

Project initiation and planning

To guide the implementation, manage expectations, and allocate roles and responsibilities, project planning is required.93 It starts with a clear business case with measurable objectives54 and covers long-term plans with clear long-term perspectives, and endurance.36,67,81 For realistic implementation plans, project initiation is crucial. For example, rigorous research before CIS implementation is suggested94 to identify best practices, prerequisites, and minimum hardware and software requirements.

Strong organizational vision and strategy17 should clearly articulated and clinically focused planned activities40,95 to achieve organizational goals following the overall strategy.86 Proper understanding of the organization’s IT ecosystem and workflow,53 and scalable or expandable design with sustainability elements are also described as important factors in both this study and PFDD.92 The presence of context-relevant e-health implementation strategies and frameworks89 is an important SF.

Organizational and technical readiness assessments help the project team to have realistic planning for implementation. Almost 50% of the SFs under technical requirements, unique for developing countries, are infrastructure related. Electricity and Internet availability are obvious requirements mentioned by several researchers.2,61,82,96 Investment in alternative infrastructure facilities (eg, electricity) as a part of strategic IT planning is recommended, such as alternative power sources, solar, diesel-fuelled electricity generators, or small-scale hydropower generators for remote areas.89

Some network and server requirements can be addressed using cloud technology97 with attention to the existing hardware capabilities within the organization. Software compatibility is another consideration which has been impacted by rapid technological advancement, the turnover rate of hardware such as PCs and mobile devices. Regular hardware upgrades and software updates improve overall efficiency.7,61

In many developing countries, healthcare services are largely provided by government-funded public systems,98 while other funds (eg, donor funds or private fees) should seek the government’s approval. This makes the success of CIS implementations directly dependent on government involvement and support.53 Government supports, involvement, and actions are also required in other areas such as developing legislation for data ownership, privacy, and security.89 These can only be fulfilled at the government level. Infrastructure requirements (eg, electricity and network) also heavily depend on the government’s support. The existence of government policy for CIS implementation and political willingness to invest in CIS is crucial for its success.14,26,36 Therefore, healthcare organizations should seek governments’ support and interest in the CIS by initiating policy briefings.

To maximize the success of CIS implementation, allocating a dedicated budget from governments is recommended to support the capital investment for CIS implementation, continuing operation, and maintenance.89,96 Furthermore, allocating annual budget for IT is suggested99 due to the huge potential limitations in technology and infrastructure requirements in low-resource settings. To keep governments’ support, setting small wins or milestones, with measurable goals, is recommended to monitor the return on investments. These goals can be set based on CIS financial and non-financial benefits such as improved patient care and outcomes, cost savings, or increased efficiency.18,40,64 These could facilitate access to donor funding as a financial source for healthcare in developing countries. Criteria to secure these funds are having a clear link between the fund and the results,100,101 which might be challenging in CIS projects, as these projects normally have mid or long-term benefits.

Project CM

CM is critical in dealing with required organizational, technical and process changes, and human factors to obtain the desired benefits of CIS implementation.102 CM is also interrelated to other requirements and SFs and should be approached from all stakeholders’ perspectives to be successful. For a successful implementation, preparing the foundation for change through some activities has been suggested including creating demand for CIS, selling the benefits of CIS, promoting successful efforts, setting regulations and incentives, making customer-focused services, and achieving quick wins for stakeholders.69,78,99,103,104

Users should be prepared for changes and be introduced to the new systems and their related benefits. This reduces resistance to change, improves the attitudes toward the system, and includes activities such as stakeholders’ involvement, feedback sessions, and providing support groups to alleviate the effects of change and resistance.105 At this stage is important to have more organizations manage these activities and systematically apply knowledge and use tools, models, and strategies for CM.

Promoting the benefits of CIS, facilitating knowledge sharing among the peer groups, and involving the stakeholders in the system design and development reduce change resistance.61,96 Our findings also reveal that “involvement of all stakeholders”, “top management support” besides building a “multidisciplinary team” are other important criteria for consideration. These also have a close relationship with “workflow understanding and co-development”, which all require effective communication. Staff commitments and efforts are also important for these radical changes or digital transformations in operational and clinical processes.106 Similarly, PFDD suggested involving users in all stages of implementation starting with developing clear, common vision and goals in “Design with the users”.92

Project execution

Appropriate planning and CM strategy could improve project implementation and execution, especially in healthcare.107 For an implementation strategy, first, a manageable CIS scope is required35 followed by realistic expectations and time-frame.18,30 A detailed roadmap for CIS implementation is needed40 including policies and procedures, legal and ethical requirements, clear responsibilities and reporting hierarchy, and new practice standards or routines.36,64,66,108

CIS projects can be implemented as a rapid expansion of the system, common in developed countries, or phased-based, for developing countries. To avoid the co-existence of old and new systems, phased-based implementation is suggested109–111 including timelines and milestones for each phase.74 Therefore, following agile implementation approaches could increase the rate of success. As agile methods are based on iterative processes with high stakeholders’ involvement in implementation, the satisfaction rate and consequently stakeholders’ attitudes and commitment toward CIS could be enhanced.36,57,112 Governments can also assign professional bodies to explore the most suitable implementation strategies in the local context.89 Therefore the following general phases, set in collaboration with users and stakeholders, are suggested:92

Phase-1: The minimum viable CIS and its features can be implemented. This simple system design and release are suggested by Standing and Cripps31 for developing countries. With this phase, the project team could involve clinical staff as suggested by Leatt et al66 and Narattharaksa et al96 and get their feedback as users. The feedback could be addressed in the iterations of CIS development which makes the final product more appealing to users, although using others’ experiences and pilot-testing are helpful in the planning process.64,65

Phase-2: Dual-option system with optional usage could be made available for users.109 Allowing the optional usage of the system is found to be an SF in developing countries,81,109 therefore the studies recommended a step-by-step transition from one system to another, in developing countries. This phase also allows less technically savvy staff and respects everyone’s rhythm111 to start the transition. Also, testing the system in working condition could help developers to identify any potential hardware and software compatibility.

Phase-3: After all system testing and considering the factors such as usability33 and accessibility35 of the system for users, we can have the full transition to CIS.

Project controlling and monitoring

Quality control and progress monitoring against the defined criteria in the planning stage should start and end with the project. The quality control aspect needs to be given enough attention so that the sustainability of the system is guaranteed.2,26,81 This sustainability is critical for the system’s future expansion and the incorporation of additional features, comparable with PFDD “Design for Scale”.

Identifying change resistance should be considered from the early stages. This makes people and organizations ready for new CIS implementation and transition. Accordingly, PFDD emphasizes sharing success and failure experiences, expert opinions, and open resources92 to build good long-term relationships with involved stakeholders.

Having enough “skilled staff” can facilitate implementation and address SF in the technical requirement of “prompt attendance to system maintenance”.61 Capacity and capability building and continued staff upskilling have considerable effects on CIS projects’ success. This can be deducted by referring to different requirements and SFs including skilled staff such as project and clinical champions,40,42 software developers,31 and managers with IT knowledge.61 This assures enough expertise to operate the system61 are available.

The inclusion of health informaticians is increasingly prevalent for CIS success.65 Health informaticians and their involvement are necessary in each implementation phase. These professionals can act as project champions and participate in providing training and technical support for users. Therefore, governments should focus on enabling the development of health informaticians and creating proper career pathways within the countries to develop a culture of working with data.89

Project closure

Training and education are required to cover CIS logic and concepts, its features, and hands-on training to managers and employees. This helps users to understand the reasons for CIS implementation and gain necessary skills to use the system through functional training.18 Hands-on training for medical staff is more effective than classroom-style; as technical education and behavioral changes are required for user acceptance. Effective ways of training include shadowing the clinicians and answering the questions spontaneously.113

Providing adequate technical support to the users is an important requirement that influences the success of CIS.66 The users should have enough on-site technical and training support to address their issues quickly, especially in the first week of implementation.85 Clinicians are under pressure during patient care and require immediate support with CIS to keep up with the lag of time.18 Developing a plan is required to assist clinicians at the point of care besides training, especially within the first few weeks of implementation.40

Training and supports are important for improving user acceptance to facilitate the success of CIS. CM deals with user behavior, stakeholders’ perspectives, and organizational culture, while training and support deal with the users’ requirements. Training and support, if provided in line with the CM approaches, may have a synergistic effect on increasing the chances of CIS implementation success.

Considering CIS sustainability would help at this stage to identify future features for the system (eg, automatic data conversion and analysis114 or office automation). Including automation in the software system is also a good approach to convincing the stakeholders.26,94,114

PFDD focuses mainly on 2 major themes: (1) users’ involvement, feedback, and collaboration; and (2) proper documentation of the project plan, implementation process, and challenges faced. Some areas in PFDD match with our findings, including “Design with users”, “Understand the existing ecosystem”, “Design for scale”, “Build for sustainability”, “Data-driven”, and “Privacy & security”. The other areas that can also further improve the CIS's success include: “Use open standards”; “open-data, open-source, and open innovation”; “Reuse and improve”; and “Be collaborative”.92

CONCLUSION

The findings of this research offer a comprehensive set of requirements, SF, and recommendations in a PM lifecycle approach for CIS implementation in developing countries. Moreover, the results are contrasted with the PFDD to gain additional insights. The results of this research can be helpful to guide CIS projects in developing countries with limited resources, and the success of CIS is critical.

This study was limited to investigating the requirements and SF for CIS implementation. Future studies should focus on identifying barriers to CIS implementation in developing countries and match with the requirements and SF to gain better insights and improve the chance of CIS success. It is recommended that projects in developing countries include the findings of this research based on the user attitude, infrastructure conditions, budget availability, political willingness, and many other factors to assess readiness for a project and key requirements for success. Future research and evaluation studies in developing countries could be designed to measure the effect of the requirements and SF from this research on the success of CIS implementation.

Supplementary Material

ocad011_Supplementary_Data

Contributor Information

Soe Ye Yint Tun, Department of Computer Science and Software Engineering, School of Engineering, Computer and Mathematical Science, Auckland University of Technology (AUT), Auckland 1010, New Zealand.

Samaneh Madanian, Department of Computer Science and Software Engineering, School of Engineering, Computer and Mathematical Science, Auckland University of Technology (AUT), Auckland 1010, New Zealand.

FUNDING

The original work of this research was a Master’s Dissertation for the Master of Health Informatics program at AUT. This study was funded by the New Zealand Aid scholarship program (NZAID), Ministry of Foreign Affairs and Trade, New Zealand.

AUTHOR CONTRIBUTIONS

SYYT was responsible for data collection and data analysis. These tasks undertook under SMs’ supervision and guidance. SM proposed the CIS Implementation framework and contributed to the research method, reflection on research results, and data interpretation. SYYT prepared the first draft of the research report and the manuscript. Both documents were reviewed and commented on and their clarities were enhanced by SM. Both authors agreed on the final revision.

SUPPLEMENTARY MATERIAL

Supplementary material is available at Journal of the American Medical Informatics Association online.

CONFLICT OF INTEREST STATEMENT

None declared.

DATA AVAILABILITY

Data are available in a public, open access repository. The data underlying this article are available in the article and in Supplementary Appendices SD and SF.

REFERENCES

  • 1. Syzdykova A, Malta A, Zolfo M, Diro E, Oliveira JL.. Open-source electronic health record systems for low-resource settings: systematic review. JMIR Med Inform 2017; 5 (4): e44. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Fritz F, Tilahun B, Dugas M.. Success criteria for electronic medical record implementations in low-resource settings: a systematic review. J Am Med Inform Assoc 2015; 22 (2): 479–88. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Blanchet K, Alwan A, Antoine C, et al. Protecting essential health services in low-income and middle-income countries and humanitarian settings while responding to the COVID-19 pandemic. BMJ Global Health 2020; 5 (10): e003675. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Ludwick DA, Doucette J.. Adopting electronic medical records in primary care: lessons learned from health information systems implementation experience in seven countries. Int J Med Inform 2009; 78 (1): 22–31. [DOI] [PubMed] [Google Scholar]
  • 5. Baumgart DC. Digital advantage in the COVID-19 response: perspective from Canada’s largest integrated digitalized healthcare system. NPJ Digit Med 2020; 3 (1): 114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Donte. Clinical Information Systems. Secondary Clinical Information Systems. 2018. http://www.biohealthmatics.com/technologies/hospital-information-systems/clinical-information-systems/ Accessed May 30, 2020.
  • 7. Fraser HS, Biondich P, Moodley D, Choi S, Mamlin BW, Szolovits P.. Implementing electronic medical record systems in developing countries. J Innov Health Inform 2005; 13 (2): 83–95. [DOI] [PubMed] [Google Scholar]
  • 8. Gesulga JM, Berjame A, Moquiala KS, Galido A.. Barriers to electronic health record system implementation and information systems resources: a structured review. Procedia Comput Sci 2017; 124 (2017): 544–51. [Google Scholar]
  • 9. Hasanain RA, Cooper H.. Solutions to overcome technical and social barriers to electronic health records implementation in Saudi public and private hospitals. J Health Inform Dev Ctries 2014; 8 (1): 46–63. [Google Scholar]
  • 10.Gomes J, Romão M. The success of IS/IT projects in the healthcare sector: stakeholders’ perceptions. In: 10th Iberian conference on information systems and technologies (CISTI); June 17–20, 2015: 1–7; Aveiro, Portugal.
  • 11. Leviss J. HIT or miss – studying failures to enable success. Appl Clin Inform 2011; 2 (3): 345–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Kaplan B, Harris-Salamone KD.. Health IT success and failure: recommendations from literature and an AMIA workshop. J Am Med Inform Assoc 2009; 16 (3): 291–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Martikainen S, Viitanen J, Korpela M, Lääveri T.. Physicians’ experiences of participation in healthcare IT development in Finland: willing but not able. Int J Med Inform 2012; 81 (2): 98–113. [DOI] [PubMed] [Google Scholar]
  • 14. Brender J, Ammenwerth E, Nykänen P, Talmon J.. Factors influencing success and failure of health informatics systems. Methods Inf Med 2006; 45 (1): 125–36. [PubMed] [Google Scholar]
  • 15. eHealth Network. Clinical information systems an overview: Dr Pramod D. Jacob consultant clinical information systems/EMR. Secondary Clinical information systems an overview: Dr Pramod D. Jacob consultant clinical Information systems/EMR 2008. https://ehealth.eletsonline.com/2008/07/clinical-information-systems-an-overview-dr-pramod-d-jacob-consultant-clinical-information-systems-emr/. Accessed May 30, 2020.
  • 16. National Academy of Engineering (US) and Institute of Medicine (US) Committee on Engineering and the Health Care System. Information and Communications Systems: The Backbone of the Health Care Delivery System. In: Reid PP, Compton WD, Grossman JH, Fanjiang G, eds. Building a Better Delivery System: A New Engineering/Health Care Partnership. Washington, DC: National Academies Press; 2005. [PubMed] [Google Scholar]
  • 17. Sligo J, Gauld R, Roberts V, Villa L.. A literature review for large-scale health information system project planning, implementation and evaluation. Int J Med Inform 2017; 97: 86–97. [DOI] [PubMed] [Google Scholar]
  • 18. Sánchez JL, Savin S, Vasileva V.. Key Success Factors in Implementing Electronic Medical Records in University Hospital of Rennes. Rennes, France: L’Ecole Nationale de la Santé Publique (National School of Public Health; ); 2005: 1–59. [Google Scholar]
  • 19. Delone WH, McLean ER.. The DeLone and McLean model of information systems success: a ten-year update. J Manag Inf Syst 2003; 19 (4): 9–30. [Google Scholar]
  • 20. Kaplan RS, Norton DP.. Linking the balanced scorecard to strategy. Calif Manage Rev 1996; 39 (1): 53–79. [Google Scholar]
  • 21. Kaplan RS, Norton DP.. Using the balanced scorecard as a strategic management system. Harv Bus Rev 1996; 74: 75–85. [Google Scholar]
  • 22. Heeks R. Information systems and developing countries: failure, success, and local improvisations. Inf Soc 2002; 18 (2): 101–12. [Google Scholar]
  • 23. Hikmet N, Bhattacherjee A, Menachemi N, Kayhan VO, Brooks RG.. The role of organizational factors in the adoption of healthcare information technology in Florida hospitals. Health Care Manag Sci 2008; 11 (1): 1–9. [DOI] [PubMed] [Google Scholar]
  • 24. Hung S-Y, Chen C, Wang K-H.. Critical success factors for the implementation of integrated healthcare information systems projects: an organizational fit perspective. Commun Assoc Inf Syst 2014; 34 (1): 39. [Google Scholar]
  • 25. Sabherwal R, Jeyaraj A, Chowa C.. Information system success: individual and organizational determinants. Manag Sci 2006; 52 (12): 1849–64. [Google Scholar]
  • 26. Handayani PW, Sandhyaduhita PI, Hidayanto AN, Pinem AA, Fajrina HR.. Synthesising hospital information system critical success factors in Indonesia. Int J Manage Enterp Dev 2014; 13 (3–4): 261–77. [Google Scholar]
  • 27. Cripps H, Standing C.. The implementation of electronic health records: a case study of bush computing the Ngaanyatjarra lands. Int J Med Inform 2011; 80 (12): 841–8. [DOI] [PubMed] [Google Scholar]
  • 28. Ngugi P, Were MC, Babic A.. Facilitators and barriers of electronic medical records systems implementation in low resource settings: a holistic view. Stud Health Technol Inform 2018; 251: 187–90. [PubMed] [Google Scholar]
  • 29. Page CK. Critical success factors for implementing a clinical information system. Nurs Econ 2000; 18 (5): 255. [Google Scholar]
  • 30. Miranda D, Fields W, Lund K.. Lessons learned during 15 years of clinical information system experience. Comput Nurs 2001; 19 (4): 147–51. [PubMed] [Google Scholar]
  • 31. Standing C, Cripps H.. Critical success factors in the implementation of electronic health records: a two-case comparison. Syst Res Behav Sci 2015; 32 (1): 75–85. [Google Scholar]
  • 32. Yazdanian A, Ayatollahi H, Nahvijou A.. A review of oncology clinical information systems – what are the critical success factors and reasons for system failure? J Evol Med Dent Sci 2018; 7 (47): 5118–27. [Google Scholar]
  • 33. Hoerbst A, Schweitzer M.. A systematic investigation on barriers and critical success factors for clinical information systems in integrated care settings. Yearb Med Inform 2015; 24 (01): 79–89. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Glaser J. Implementing electronic health records: 10 factors for success. Healthc Financ Manage 2009; 63 (1): 50–2, 54. [PubMed] [Google Scholar]
  • 35. Ben-Zion R, Pliskin N, Fink L.. Critical success factors for adoption of electronic health record systems: literature review and perspective analysis. Inf Syst Manage 2014; 31 (4): 296–312. [Google Scholar]
  • 36. Sadoughi F, Kimiafar K, Ahmadi M, Shakeri MT.. Determining of factors influencing the success and failure of hospital information system and their evaluation methods: a systematic review. Iran Red Crescent Med J 2013; 15 (12): e11716. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Garavand A, Mohseni M, Asadi H, Etemadi M, Moradi-Joo M, Moosavi A.. Factors influencing the adoption of health information technologies: a systematic review. Electron Physician 2016; 8 (8): 2713–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Paterson GI, Shaw N, Grant AM, et al. Cross-Canada EMR case studies: analysis of physicians’ perspectives on benefits and barriers. Electron J Health Inf 2011; 6 (4): 1–8. [Google Scholar]
  • 39. Protti D. What can the American electronic health record (EHR) pioneers tell us about what it takes to be successful? Healthc Manage Forum 2002; 15 (2): 33–5. [DOI] [PubMed] [Google Scholar]
  • 40. Scott IA, Sullivan C, Staib A.. Going digital: a checklist in preparing for hospital-wide electronic medical record implementation and digital transformation. Aust Health Rev 2018; 43 (3): 302–13. [DOI] [PubMed] [Google Scholar]
  • 41. Palvia P, Lowe K, Nemati H, Jacks T.. Information technology issues in healthcare: hospital CEO and CIO perspectives. Commun Assoc Inf Syst 2012; 30 (1): 19. [Google Scholar]
  • 42.Nguyen TTH, Saranto K, Tapanainen T, Ishmatova D. A review of health information technology implementation success factors: importance of regulation and finance. In: 47th Hawaii international conference on system sciences; IEEE; Jan. 6–9, 2014: 2693–705; Waikoloa, HI.
  • 43. Martinez A, Villarroel V, Seoane J, del PF.. Analysis of information and communication needs in rural primary health care in developing countries. IEEE Trans Inf Technol Biomed 2005; 9 (1): 66–72. [DOI] [PubMed] [Google Scholar]
  • 44. Keshavjee K, Bosomworth J, Copen J, et al. Best practices in EMR implementation: a systematic review. AMIA Annu Symp Proc 2006; 2006: 982. [PMC free article] [PubMed] [Google Scholar]
  • 45. Grant MJ, Booth A.. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J 2009; 26 (2): 91–108. [DOI] [PubMed] [Google Scholar]
  • 46. Staples M, Niazi M.. Experiences using systematic review guidelines. J Syst Softw 2007; 80 (9): 1425–37. [Google Scholar]
  • 47. Moher D, Liberati A, Tetzlaff J, Altman DG;. PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009; 151 (4): 264–9, W64. [DOI] [PubMed] [Google Scholar]
  • 48.NVivo (Version 11 Plus) [program]; 2015.
  • 49. Yi E. Themes don’t just emerge—coding the qualitative data. Secondary themes don’t just emerge—coding the qualitative data. 2018. https://medium.com/@projectux/themes-dont-just-emerge-coding-the-qualitative-data-95aff874fdce. Accessed January 21, 2022.
  • 50. Braun V, Clarke V.. Thematic analysis. In: Cooper H, Camic PM, Long DL, Panter AT, Rindskopf D, Sher KJ, eds. APA Handbook of Research Methods in Psychology Vol 2: Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological. Washington, DC: American Psychological Association; 2012: 57–71. [Google Scholar]
  • 51. Tun SYY, Madanian S, Mirza F.. Internet of things (IoT) applications for elderly care: a reflective review. Aging Clin Exp Res 2021; 33: 855–67. [DOI] [PubMed] [Google Scholar]
  • 52. Khan S, Van Wynsberghe R. Cultivating the under-mined: cross-case analysis as knowledge mobilization. Forum Qual Soc Res 2008; 9 (1): 34. [Google Scholar]
  • 53. Hai NTT, Tapanainen T, Ishmatova D.. Critical success factors in health information technology implementation: the perspective of Finnish IT managers. Int J Healthc Inf Syst Inform 2015; 10 (1): 9–24. [Google Scholar]
  • 54. MacKinnon W, Wasserman M.. Implementing electronic medical record systems. IT Prof 2009; 11 (6): 50–3. [Google Scholar]
  • 55. Lluch M. Healthcare professionals’ organisational barriers to health information technologies—a literature review. Int J Med Inform 2011; 80 (12): 849–62. [DOI] [PubMed] [Google Scholar]
  • 56. Project Management Institute. What is project management? 2020. https://www.pmi.org/about/learn-about-pmi/what-is-project-management. Accessed June 4, 2020.
  • 57. Safdari R, Ghazisaeidi M, Jebraeily M.. Electronic health records: critical success factors in implementation. Acta Inform Med 2015; 23 (2): 102–4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Raymond L. Organizational context and information systems success: a contingency approach. J Manag Inf Syst 1990; 6 (4): 5–20. [Google Scholar]
  • 59. Paré G, Trudel M-C.. Knowledge barriers to PACS adoption and implementation in hospitals. Int J Med Inform 2007; 76 (1): 22–33. [DOI] [PubMed] [Google Scholar]
  • 60. Ajami S, Arab-Chadegani R.. Barriers to implement electronic health records (EHRs). Mater Sociomed 2013; 25 (3): 213–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Ojo AI, Popoola SO.. Some correlates of electronic health information management system success in Nigerian teaching hospitals. Biomed Inform Insights 2015; 7: 1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62. Yoon D, Chang B-C, Kang SW, Bae H, Park RW.. Adoption of electronic health records in Korean tertiary teaching and general hospitals. Int J Med Inform 2012; 81 (3): 196–203. [DOI] [PubMed] [Google Scholar]
  • 63. Wolf DM, Greenhouse PK, Diamond JN, Fera W, McCormick DL.. Community hospital successfully implements eRecord and CPOE. Comput Inform Nurs 2006; 24 (6): 307–16. [DOI] [PubMed] [Google Scholar]
  • 64. Lorenzi NM, Kouroubali A, Detmer DE, Bloomrosen M.. How to successfully select and implement electronic health records (EHR) in small ambulatory practice settings. BMC Med Inform Decis Mak 2009; 9 (1): 15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65. Walji MF, Taylor D, Langabeer JR, Valenza JA.. Factors influencing implementation and outcomes of a dental electronic patient record system. J Dent Educ 2009; 73 (5): 589–600. [PubMed] [Google Scholar]
  • 66. Leatt P, Shea C, Studer M, Wang V.. IT solutions for patient safety—best practices for successful implementation in healthcare. Healthc Q 2006; 9 (1): 94–104. [PubMed] [Google Scholar]
  • 67. Irizarry T, Barton AJ.. A sociotechnical approach to successful electronic health record implementation: five best practices for clinical nurse specialists. Clin Nurse Spec 2013; 27 (6): 283–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68. Macdonald A, Riahi S.. EHR implementation: one organization’s road to success. NI 2012 (2012) 2012; 2012: 258. [PMC free article] [PubMed] [Google Scholar]
  • 69. Verbeke F, Karara G, Nyssen M.. Human factors predicting failure and success in hospital information system implementations in Sub-Saharan Africa. Stud Health Technol Inform 2015; 216: 482–6. [PubMed] [Google Scholar]
  • 70. Farzandipur M, Jeddi FR, Azimi E.. Factors affecting successful implementation of hospital information systems. Acta Inform Med 2016; 24 (1): 51–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71. Merhi MI. A process model leading to successful implementation of electronic health record systems. Int J Electron Healthc 2015; 8 (2–4): 185–201. [Google Scholar]
  • 72.Rezaian S, Salamat HB, Malekzadeh R, Yusoff RC, Zare N. Factors affecting the successful implementation of hospital information system: A preliminary pilot study of Iranian nurses. In: 2018 20th international conference on advanced communication technology (ICACT); IEEE; February 2018: 647–51; Chuncheon, Korea (South).
  • 73. Baus A. Literature Review: Barriers to the Successful Implementation of Healthcare Information Systems. Morgantown, WV: Office of Health Services Research, West Virginia University Department of Community Medicine; 2004. [Google Scholar]
  • 74.Wan Y, Perry W. Lessons from method: a successful electronic medical record (EMR) system implementation. In: proceedings of 2011 IEEE international conference on intelligence and security informatics; IEEE; July 10–12, 2011: 248–51; Beijing, China.
  • 75. Priestman W, Sridharan S, Vigne H, Collins R, Seamer L, Sebire NJ.. What to expect from electronic patient record system implementation: lessons learned from published evidence. J Innov Health Inform 2018; 25 (2): 92–104. [DOI] [PubMed] [Google Scholar]
  • 76. Agno CF, Guo KL.. Electronic health systems: challenges faced by hospital-based providers. Health Care Manag (Frederick) 2013; 32 (3): 246–52. [DOI] [PubMed] [Google Scholar]
  • 77. Ash JS, Fournier L, Stavri PZ, Dykstra R.. Principles for a successful computerized physician order entry implementation. AMIA Annu Symp Proc 2003; 2003: 36–40. [PMC free article] [PubMed] [Google Scholar]
  • 78. Laramee AS, Bosek M, Kasprisin CA, Powers-Phaneuf T.. Learning from within to ensure a successful implementation of an electronic health record. Comput Inform Nurs 2011; 29 (8): 468–77. [DOI] [PubMed] [Google Scholar]
  • 79. Fraser HS, Blaya J.. Implementing medical information systems in developing countries, what works and what doesn’t. AMIA Annu Symp Proc 2010; 2010: 232–6. [PMC free article] [PubMed] [Google Scholar]
  • 80. Tierney WM, Kanter AS, Fraser HS, Bailey C.. A toolkit for e-health partnerships in low-income nations. Health Affairs 2010; 29 (2): 268–73. [DOI] [PubMed] [Google Scholar]
  • 81. Deriel E, Puttkammer N, Hyppolite N, et al. Success factors for implementing and sustaining a mature electronic medical record in a low-resource setting: a case study of iSanté in Haiti. Health Policy Plan 2018; 33 (2): 237–46. [DOI] [PubMed] [Google Scholar]
  • 82. Mohammed-Rajput NA, Smith DC, Mamlin B, Biondich P, Doebbeling BN; Open MRS Collaborative Investigators. OpenMRS, a global medical records system collaborative: Factors influencing successful implementation. AMIA Annu Symp Proc 2011; 2011: 960–8. [PMC free article] [PubMed] [Google Scholar]
  • 83. Gruber D, Cummings GG, LeBlanc L, Smith DL.. Factors influencing outcomes of clinical information systems implementation: a systematic review. Comput Inform Nurs 2009; 27 (3): 151–63; quiz 64–5. [DOI] [PubMed] [Google Scholar]
  • 84. Boonstra A, Broekhuis M.. Barriers to the acceptance of electronic medical records by physicians from systematic review to taxonomy and interventions. BMC Health Serv Res 2010; 10: 231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85. Fullerton C, Aponte P, Hopkins R, Bragg D, Ballard DJ.. Lessons learned from pilot site implementation of an ambulatory electronic health record. Proc (Bayl Univ Med Cent) 2006; 19 (4): 303–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86. Carnicero J, Rojas D.. Lessons learned from implementation of information and communication technologies in Spain’s healthcare services. Appl Clin Inform 2010; 1 (4): 363–76. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Nguyen TTH, Eikebrokk TR, Moe CE, Medaglia R, Larsson H, Tapanainen T. A cross-country comparison of success factor priorities for health information technology managers: evidence of convergence in the Nordic countries. In: 2015 48th Hawaii international conference on system sciences; IEEE; January 5–8, 2015: 2824–33; Kauai, HI.
  • 88.Institute of Medicine (IoM). In: Nass SJ, Levit LA, Gostin LO, eds.Beyond the HIPAA Privacy Rule: enhancing Privacy, Improving Health through Research. Washington, DC: National Academies Press; 2009. [PubMed] [Google Scholar]
  • 89. Katurura MC, Cilliers L.. Electronic health record system in the public health care sector of South Africa: a systematic literature review. Afr J Prim Health Care Fam Med 2018; 10 (1): e1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90. Regan EA, Wang J.. Realizing the value of EHR systems critical success factors. Int J Healthc Inf Syst Inform 2016; 11 (3): 1–18. [Google Scholar]
  • 91. Westland J. The Project Management Life Cycle: A Complete Step-by-Step Methodology for Initiating, Planning, Executing, and Closing the Project. London and Philadelphia, England and USA: Kogan Page Publishers; 2007. [Google Scholar]
  • 92. Principles for Digital Development. Principles. Secondary Principles. https://digitalprinciples.org/principles/. Accessed June 15, 2022.
  • 93. Kumar S, Aldrich K.. Overcoming barriers to electronic medical record (EMR) implementation in the US healthcare system: a comparative study. Health Informatics J 2010; 16 (4): 306–18. [DOI] [PubMed] [Google Scholar]
  • 94. Gasch A. Ten tips for successful electronic health records deployment. J Med Pract Manage 2012; 28 (3): 210–3. [PubMed] [Google Scholar]
  • 95. Meadows G. Implementing clinical IT in critical care: keys to success. Nurs Econ 2003; 21 (2): 89–90, 93. [PubMed] [Google Scholar]
  • 96. Narattharaksa K, Speece M, Newton C, Bulyalert D.. Key success factors behind electronic medical record adoption in Thailand. J Health Organ Manag 2016; 30 (6): 985–1008. [DOI] [PubMed] [Google Scholar]
  • 97. Saleh S, El Arnaout N, Abdouni L, Jammoul Z, Hachach N, Dasgupta A.. Sijilli: a scalable model of cloud-based electronic health records for migrating populations in low-resource settings. J Med Internet Res 2020; 22 (8): e18183. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 98. Doherty J, Kirigia D, Okoli C, et al. Does expanding fiscal space lead to improved funding of the health sector in developing countries? Lessons from Kenya, Lagos State (Nigeria) and South Africa. Glob Health Action 2018; 11 (1): 1461338. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Vagelatos A, Sarivougioukas J. Critical success factors for the introduction of a clinical information system. In: Proceedings of IX Mediterranean conference on medical and biological engineering and computing; 2001: 1055–8.
  • 100.Nyella E. Challenges in health information systems integration: Zanzibar experience. In: 2009 International conference on information and communication technologies and development (ICTD); IEEE; 2009: 243–51; Doha, Qatar.
  • 101. Smith M, Madon S, Anifalaje A, Lazarro‐Malecela M, Michael E.. Integrated health information systems in Tanzania: experience and challenges. Electron J Inf Syst Dev Ctries 2008; 33 (1): 1–21. [Google Scholar]
  • 102. McCarthy C, Eastman D.. Change Management Strategies for an Effective EMR Implementation. New York, NY: HIMSS; 2013.
  • 103. Amatayakul M. Keys to successful EHR implementation. Healthc Financ Manage 2010; 64 (12): 104, 106. [PubMed] [Google Scholar]
  • 104. Wilkinson S, Borycki E, Kushniruk A.. Best practices for EHR implementation: a BC First Nations community’s experience. Healthc Manage Forum 2020; 33 (1): 39–46. [DOI] [PubMed] [Google Scholar]
  • 105.Mahdavian M, Nazarian H, Mahdavian M, Wattanapongsakorn N. An investigation of the success of hospital information systems implementation: a case study. In: 2014 international computer science and engineering conference (ICSEC); July 30–August 1, 2014: 329–33; Khon Kaen, Thailand.
  • 106. Glaser J. Success factors for clinical information system implementation. Hospital and Health Network’s Most Wired Magazine. June 2005. [Google Scholar]
  • 107. Kerzner H. Chapter 2: Applying project management in humanitarian and social initiatives. In: Zeitoun A, Viana Vargas R, eds. Project Management Next Generation: The Pillars for Organizational Excellence. Newark: Wiley; 2022. [Google Scholar]
  • 108. Maust D. Implementation of an electronic medical record in a health system: lessons learned. J Nurses Staff Dev 2012; 28 (1): E11–5. [DOI] [PubMed] [Google Scholar]
  • 109. Scholl J, Syed-Abdul S, Ahmed LA.. A case study of an EMR system at a large hospital in India: challenges and strategies for successful adoption. J Biomed Inform 2011; 44 (6): 958–67. [DOI] [PubMed] [Google Scholar]
  • 110. Fragidis LL, Chatzoglou PD.. Implementation of a nationwide electronic health record (EHR): The international experience in 13 countries. Int J Health Care Qual Assur 2018; 31 (2): 116–30. [DOI] [PubMed] [Google Scholar]
  • 111. Gagnon MP, Desmartis M, Labrecque M, et al. Implementation of an electronic medical record in family practice: a case study. Inform Prim Care 2010; 18 (1): 31–40. [DOI] [PubMed] [Google Scholar]
  • 112. Tilahun B, Fritz F.. Modeling antecedents of electronic medical record system implementation success in low-resource setting hospitals. BMC Med Inform Decis Mak 2015; 15: 61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113. DeVore SD, Figlioli K.. Lessons premier hospitals learned about implementing electronic health records. Health Aff (Millwood) 2010; 29 (4): 664–7. [DOI] [PubMed] [Google Scholar]
  • 114. Bajwa NK, Singh H, Kumar De K.. Critical success factors in electronic health records (EHR) implementation: an exploratory study in north India. Int J Healthc Inf Syst Inform 2017; 12 (2): 1–17. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ocad011_Supplementary_Data

Data Availability Statement

Data are available in a public, open access repository. The data underlying this article are available in the article and in Supplementary Appendices SD and SF.


Articles from Journal of the American Medical Informatics Association : JAMIA are provided here courtesy of Oxford University Press

RESOURCES