Abstract
Background
In the past 2 decades, many countries have recognized the use of electronic systems for disease surveillance and outbreak response as an important strategy for disease control and prevention. In low- and middle-income countries, the adoption of these electronic systems remains a priority and has attracted the support of global health players. However, the successful implementation and institutionalization of electronic systems in low- and middle-income countries have been challenged by the local capacity to absorb technologies, decisiveness and strength of leadership, implementation costs, workforce attitudes toward innovation, and organizational factors. In November 2019, Ghana piloted the Surveillance Outbreak Response Management and Analysis System (SORMAS) for routine surveillance and subsequently used it for the national COVID-19 response.
Objective
This study aims to identify the facilitators of and barriers to the sustainable implementation and operation of SORMAS in Ghana.
Methods
Between November 2021 and March 2022, we conducted a qualitative study among 22 resource persons representing different stakeholders involved in the implementation of SORMAS in Ghana. We interviewed study participants via telephone using in-depth interview guides developed consistent with the model of diffusion of innovations in health service organizations. We transcribed the interviews verbatim and performed independent validation of transcripts and pseudonymization. We performed deductive coding using 7 a priori categories: innovation, adopting health system, adoption and assimilation, diffusion and dissemination, outer context, institutionalization, and linkages among the aspects of implementation. We used MAXQDA Analytics Pro for transcription, coding, and analysis.
Results
The facilitators of SORMAS implementation included its coherent design consistent with the Integrated Disease Surveillance and Response system, adaptability to evolving local needs, relative advantages for task performance (eg, real-time reporting, generation of case-base data, improved data quality, mobile offline capability, and integration of laboratory procedures), intrinsic motivation of users, and a smartphone-savvy workforce. Other facilitators were its alignment with health system goals, dedicated national leadership, political endorsement, availability of in-country IT capacities, and financial and technical support from inventors and international development partners. The main barriers were unstable technical interoperability between SORMAS and existing health information systems, reliance on a private IT company for data hosting, unreliable internet connectivity, unstable national power supply, inadequate numbers and poor quality of data collection devices, and substantial dependence on external funding.
Conclusions
The facilitators of and barriers to SORMAS implementation are multiple and interdependent. Important success conditions for implementation include enhanced scope and efficiency of task performance, strong technical and political stewardship, and a self-motivated workforce. Inadequate funding, limited IT infrastructure, and lack of software development expertise are mutually reinforcing barriers to implementation and progress to country ownership. Some barriers are external, relate to the overall national infrastructural development, and are not amenable even to unlimited project funding.
Keywords: implementation, Surveillance Outbreak Response Management and Analysis System, SORMAS, barriers, facilitators, digital disease surveillance, outbreak response, COVID-19, pandemic, Ghana, mobile phone
Introduction
Background
In the advent of affordable and robust IT tools in the 1990s, high-income countries began to switch from paper-based to electronic disease surveillance [1]. The pace of digitalization in public health surveillance and outbreak response has since gained momentum and spread to low- and middle-income countries (LMICs) [2]. This transition is, in part, a result of digital penetration, consolidated by the demonstrated utility of digital tools in public health practice [3-5]. Well-established electronic disease surveillance systems have many benefits. Some of these benefits are improved data quality (completeness, detail, and validity), timeliness of reporting, data standardization, automation of data analysis and visualization, prompt identification of public health events, and timely information sharing for public health action [6,7]. Thus, the benefits of digitalization in public health practice are many but so are the challenges. Frequently reported challenges of adopting electronic health systems include the technical challenges of technology, absence of basic necessary infrastructure such as electricity, implementation costs, workforce capacities and attitudes, and organizational factors [8-10]. These challenges are dynamic and vary in scope and complexity across geopolitical, socioeconomic, cultural, and organizational settings [10-12]. Therefore, some electronic systems have not made it beyond pilots to sustained nationwide institutionalization, especially in LMICs [10,13-18].
The cross-border geographical spread of outbreaks and the multidisciplinary response requirements made it more apparent than ever that conventional paper-based systems were simply inadequate to keep pace with the evolution of outbreaks [3,19-21]. Furthermore, most digital systems are designed for 1 or a limited set of response tasks, such as contact tracing, case management, data collection and transmission, data collation and analysis, communication, and coordination [22]. These limitations require public health systems to use multiple systems to accomplish the complete set of public health emergency response tasks—a detraction from the expected workload alleviation and efficiency of task performance. These challenges notwithstanding, the introduction of digital innovations for surveillance in LMICs has typically been welcomed by public health actors to bridge the service delivery gaps for which such innovations hold great promise. In particular, the occurrence of recent major outbreaks, namely, the West African Ebola Virus Disease outbreak and the COVID-19 pandemic, spurred an astounding transformation of electronic public health surveillance and outbreak response tools in Africa—one of which is the Surveillance Outbreak Response Management and Analysis System (SORMAS) [20,23-27].
The 2014 to 2016 West African Ebola Virus Disease outbreak motivated the invention of SORMAS. Beyond coordination, SORMAS integrates the business process management of disease control measures with the surveillance and detection of epidemics within 1 tool. However, compatibility with the existing Integrated Disease Surveillance and Response (IDSR) system of the World Health Organization (WHO)–Africa region was a prerequisite for adoption to maintain established work processes and offer a possibility of regional integration [28]. SORMAS is an open-source, mobile eHealth system. It is accessed via a web version by administrators and supervisors and via a mobile app version on tablets by field users. There exists a bidirectional communication between the web and mobile app versions for data synchronization. Functionally, it is a laboratory-integrated, case-based management system for routine surveillance and overall coordination of public health emergencies. It has disease process modules for notifiable diseases and nonspecific modules that are easily adaptable for emerging infectious diseases. The workflow is organized into interactive directories for the management of tasks, cases, contacts, events, laboratory samples, immunizations, points of entry, campaigns, statistics, reports, and users. SORMAS supports both indicator-based and event-based surveillance, real-time epidemiological analysis and data visualization, field coordination and response process management, bidirectional data transfer, and mobile offline functionality. It attained the global good maturity 4 years after its first deployment in Nigeria [23,26,29], where it was subsequently deployed for mpox (monkey pox) and other concurrent disease outbreaks [30,31].
In November 2019, the Ghana Health Service (GHS) started the pilot implementation of SORMAS for routine surveillance [31]. Then, 4 months into the pilot implementation phase, the COVID-19 pandemic spread to Ghana. As a consequence, the planned pilot implementation and progress evaluations that were aimed to improve strategies for a stepwise nationwide scale-up were interrupted. Nonetheless, given its demonstrated utility in the early phase of the pilot, Ghana adopted SORMAS for the COVID-19 pandemic response and, further, as the national eSurveillance and outbreak response management system for all its notifiable diseases. Thus, apart from the anticipated challenges of the implementation of digital innovations in normal times, the opportunity for a rapid nationwide scale-up of SORMAS during pandemic came with additional challenges.
Objectives
Our study aimed to identify the facilitators of and barriers to the sustainable implementation of SORMAS in Ghana from the perspectives of stakeholders.
Methods
Study Design
We conducted a qualitative study among resource persons involved in the use and management of SORMAS in Ghana. These individuals represented GHS at the district, regional, and national levels; teaching hospitals; research laboratories; public health experts; and software developers for SORMAS (Table 1). We conducted the study in 16 districts across 2 administrative regions between November 2021 and March 2022. We purposively selected the Greater Accra and Ashanti regions for being the 2 most populous regions and COVID-19 epicenters of Ghana, where the use of SORMAS was most intensive. The Greater Accra Region was 1 of 2 pilot regions for SORMAS before the COVID-19 pandemic (2019), whereas the Ashanti Region started using SORMAS when the pandemic spread to Ghana.
Table 1.
Category of study participant | Role in SORMAS implementation |
National public health officers—GHSa |
|
Software developers |
|
Regional surveillance supervisors |
|
Frontline field users (district surveillance, contact, and health information officers) |
|
Laboratory supervisors |
|
Laboratory officers |
|
Public health experts (workforce training institutions) |
|
aGHS: Ghana Health Service.
We adapted the model of diffusion of innovations in health service organizations by Greenhalgh et al [32] to assess the implementation process. The model describes the dynamic interactions of factors, namely, the nature and value of the innovation, relevant health system antecedents and readiness for the innovation, method of adoption and assimilation, process diffusion and dissemination, implementation and consequences thereof, and relevant external influences on implementation and sustainability. Thus, the model provides a comprehensive and systematic approach to evaluating all aspects of the implementation of SORMAS from the innovation, the health system adopting it, its users, and the influence of local and international partners. We used these constructs to identify stakeholder perspectives about the barriers, facilitators, and sustainability strategies for system integration and institutionalization of SORMAS in Ghana.
Context of SORMAS Implementation in Ghana
The Helmholtz-Zentrum für infektionsforschung (HZI; the Helmholtz Centre for Infection Research) Braunschweig–Germany, in collaboration with the African Field Epidemiology Network and the Nigeria Centre for Disease Control, developed and piloted the first version of SORMAS in 2015. With funding from the Deutsche gesellschaft für internationale Zusammenarbeit (GIZ; German Corporation for International Cooperation), HZI adapted the open-source version of SORMAS in 2016. On the basis of specifications of multinational team of epidemiologists and IDSR experts, the software developers integrated all change requests and lessons learned from the pilot to release an upgraded and first open version [31].
In 2017, a multistakeholder workshop was conducted in Ghana to consider the suitability of SORMAS as a national eSurveillance and outbreak response tool. Following a decision in 2018 to adopt SORMAS, a tripartite public-private partnership business model was adopted. In this model, GHS was the implementing public institution, Ghana Community Network System provided in-country IT service, and HZI was responsible for SORMAS development and maintenance. These 3 partners signed a memorandum of understanding, and the pilot implementation started in November 2019 in the Greater Accra and Upper West regions of Ghana. On January 29, 2020—a day before WHO declared COVID-19 as a public health emergency of international concern, HZI rolled out a COVID-19–specific module [33,34]. Ghana adopted this module and subsequently adapted it based on national response needs.
Study Participants
We recruited 22 study participants, distributed across the abovementioned 7 broad professional categories. These included officers at the national, regional, and district surveillance units and COVID-19–testing laboratories (Figure 1). All the users of SORMAS in the 2 study regions were invited to participate. We randomly selected equal numbers of frontline users based on region and distributed them equally between the urban and rural districts within each region. We purposively selected national officers, surveillance supervisors, and software developers based on their leading roles in implementation.
Data Collection and Management
We designed a reference in-depth interview guide based on the model by Greenhalgh et al [32] such that some questions were the same for all study participants, and others were specific to their professional groups to match their roles and responsibilities in the implementation. We piloted the interview guides with a pretest for surveillance supervisors and frontline users in the Upper West Region, which had a mix of users from the pilot phase and users recruited for the pandemic response. Following this pilot, we revised the interview guides to improve their completeness in scope and the clarity of questions. We did not pilot the interview guides for the remaining 3 professional groups as their availability was limited by their roles and numbers. However, the research team discussed and reached consensus on the usability and soundness of their interview guides.
For each region, we grouped the frontline users who had previously given written informed consent based on the classification of their district of work as rural or urban. Each list was assigned random numbers generated using Excel (Microsoft Corporation). BBK then called the users from each list in ascending order of the magnitude of their assigned random numbers. He conducted the interviews via a direct telephone line and audio recorded them. He called each user twice within a span of 30 minutes by appointments. If there was no response, he called the next user in line from the list.
We transcribed the interviews verbatim with time stamps using MAXQDA Analytic Pro developed by Verbi GmbH. A research assistant listened to the audio recordings of all the interviews, validated the accuracy of the transcripts, and performed spell checks while maintaining the verbatim transcription. We performed proofreading and pseudonymization of the transcripts. We imported the validated and pseudonymized transcripts back into MAXQDA Analytic Pro (version 22.2.1) for analysis.
Data Analysis
We coded the data deductively with a priori parent codes and subcodes consistent with the constructs of the model by Greenhalgh et al [32]. Our approach for coding was flexible to include emerging subcodes that related to some parent codes but were not explicitly outlined in the model. We assigned descriptive memos to all subcodes consistent with the constructs of the model, to ensure consistency of coding. BBK and FL performed the coding separately. CJK-T reviewed the coding performed by BBK and FL. BBK, FL, CW, and CJK-T compared and discussed the differences, built consensus where possible, and merged codes where the data did not make a practical difference to keep them separate. For example, we merged adoption and assimilation, diffusion and dissemination of the innovation, and system antecedents and system readiness for adopting the innovation to generate 1 composite parent code each. We also included access to the system, motivation, and trust as subcodes of diffusion and dissemination. We calculated the crude percentage agreements and Cohen κ coefficients at 95% confidence level to estimate the intercoder reliability for 7 final parent codes (Multimedia Appendix 1). We used the guidelines by Landis and Kock [35] to interpret intercoder agreement as follows: poor (κ≤0), slight (κ=0.01-0.20), fair (κ=0.21-0.40), moderate (κ=0.41-0.60), substantial (κ=0.61-0.80), and almost perfect (κ=0.81-1). We exported the coded segments as Excel sheets. We paraphrased the coded segments to obtain descriptive summaries. Next, we performed interpretative analysis on the descriptive summaries to identify key messages related to barriers and facilitators and how they influenced the implementation of SORMAS. We identified user recommendations for sustainability of implementation and categorized them according to their targeted stakeholders. GK reviewed and challenged the exhaustiveness of some of the interpretations we assigned to segments of the transcripts. We discussed further and refined the clarity and scope of some interpretations.
Ethical Considerations
The study was approved by the GHS Ethics Committee (GHS-ERC: 016/03/21) and the Ethics Committee of the Hannover Medical School (Nr.9514_BO_S_2020). Through email correspondences and support of local coinvestigators, we obtained written informed consent (scanned copies) from all participants for interviews, audio recording, and publication of findings. We pseudonymized the data before analysis and ensured overall data protection, consistent with existing institutional and European General Data Protection Regulations—the basis of an approved data protection protocol for the study.
Results
General Results
Our study participants represented 7 categories of resource persons involved in the implementation of SORMAS in Ghana—73% (16/22) of whom were men. The median duration of the interviews was 59 (range 37-175) minutes. The intercoder reliability was almost perfect for adoption and assimilation (crude agreement=92.9%; κ=0.86, 95% CI 0.76-0.96), and substantial for the other 6 codes (crude agreement range 80%-87.5%; κ range 0.62-0.75; Multimedia Appendix 1).
Facilitators and Barriers
Overview
We considered the barriers to and facilitators of implementation under 7 broad themes, each organized into subthemes consistent with the adapted model of diffusion of innovations in health service organizations (Multimedia Appendix 2). Overall, the identified barriers to and facilitators of implementation were similar across the 2 regions. The main facilitators resulting from the COVID-19 pandemic included the political support at the level of the presidency for the national scale-up, creation of Ghana-specific SORMAS development branch for national pandemic response needs, introduction of sample barcodes and scanners to speed up the workflow, and adoption of SORMAS by non-GHS facilities including private and state-owned research laboratories. In contrast, the main barriers to implementation occasioned by the pandemic included reduced quality of user trainings, shortage of tablets and other logistics arising from increased demand, and truncation of planned evaluation of the pilot implementation (Multimedia Appendix 2).
Innovation
The innovation referred to the technical aspects and work process of the object of implementation—SORMAS. The study participants identified barriers and facilitators that related to 6 subthemes, namely, suitability for task performance, nature of knowledge required for use, organizational compatibility, level of reinvention, trialability, and availability of technical support.
Compared with the conventional paper-based system, users named several relative advantages that SORMAS brings to their routine practice as managers, supervisors, and frontline field officers. These included its design for case-base data collection, real-time reporting, offline data collection capability of the mobile app, efficiency of work enabled by the integration of laboratory and surveillance procedures via the laboratory module, inbuilt data validation checks, and uniformity of data collection and reporting templates across the country each time the software is updated. In particular, the public health experts described the new possibility to generate and test hypotheses using the case-based data as the solution to a long-standing challenge in making optimum use of the data for research and project evaluations.
Barriers to the implementation of the innovation included user right restrictions that limit the scope of duties of supervisors, occasional slow system performance, and synchronization failures at peak data collection times. The national administrators and supervisors deemed the unavailability of an offline mode of the web version as a barrier to their work, especially when they are out in the field with poor internet connectivity.
Regarding how SORMAS compares with existing health information systems for task performance, a study participant explained that the innovations of SORMAS confer many relative advantages that made it easy for users to accept but also expressed concern about how unstable interoperability with existing systems could limit its expected benefits:
The tools that were being used for surveillance purposes – and of course, there was resistance to change like every normal...emmmm. When a new thing comes, there is that kind of thing. But I think that, the SORMAS came to complement the gaps that were already in existence because after several years of using these tools, there were gaps identified. And once SORMAS came in handy and was largely addressing most of the gaps that previously had been identified, the decision and getting people to use SORMAS did not become an issue. The other thing was that, if we were able to link the other soft-wares with SORMAS, we could allow data sharing with some of the soft-wares that we were already using. But like I said, there have been some challenges but they are being addressed.
PH_EX_NAT_42_QA_PT_240712_bka_ pan; Pos. 37
The Health System Antecedents and Readiness for the Innovation
System antecedents and readiness considered approaches to the conduct of surveillances and outbreak responses of GHS before the adoption of SORMAS. It also considered how its existing structures, resources, and work culture influenced the implementation of the innovation.
Study participants considered the introduction of SORMAS timely for 3 main reasons. First, there were advanced plans about transitioning from computer-assisted and paper-based IDSR system to an electronic IDSR. Second, the design of SORMAS was based on the content and workflow of the IDSR version already in use. Third, SORMAS is open to adaptations to the national context. This was demonstrated during the initial evaluation for adoption and further successful adaptations following deployment.
They identified 2 major health system barriers. First, there were challenges with the stability of interoperability of SORMAS with the main existing health data management system—District Health Information System–version 2 (DHIS2) used for routine health service delivery monitoring. Second, GHS lacked an internal IT infrastructural capacity for data hosting. This necessitated partnership with a local IT company to kick-start the implementation, for which a study participant expressed relief:
I believe if we did not have [name of the company] IT company by then, it would have been a very big problem for us. I’m sure it would have been like a stillbirth.
NA_DS_ADM_51_QA_PT_220606 _bka_pan; Pos. 30
Adoption and Assimilation
In this category, the study participants identified factors that related to early use of SORMAS by individual staff (adoption) and by the organization as a whole (assimilation). They identified facilitators and barriers under 3 subthemes, namely, approach to decision-making, evaluation of the system before and after adoption, and efforts at sustaining implementation.
The study participants identified the active participation of local developers on an internet hosting service for software development and version control (GitHub), biweekly development and innovation meetings among the 3 implementing partners, and software upgrade review meetings as facilitators that sustained the initial pilot deployment. In particular, the field users stated that the ability of SORMAS to include their request boosted their confidence in the system and facilitated assimilation.
They named 2 main barriers to this phase of implementation. First, the diversity of electronic tools and, second, the mass trainings of users (up to approximately 200/cohort compared with approximately 30 before the COVID-19 pandemic). They explained that there was wide diversity of electronic data collection tools in public, private, and quasi-government health facilities, for which managers would prefer interoperability instead of a total switch to SORMAS. The mass trainings were occasioned by the need to boost the number of contact tracers for COVID-19 response. They reported that this approach of introducing the system to them was ineffective for lack of adequate hands-on practice before deployment to the field.
Diffusion and Dissemination
Diffusion and dissemination assessed the factors that influence the time span needed to administer SORMAS and spread its use among individual officers and at all levels of the health system after adoption and assimilation. All categories of study participants identified the mutually reinforcing approaches of training as the most important facilitator of the spread of SORMAS. These included formal in-person workshops using real data for hands-on practice, internet-based remote support from regional and national teams, and peer-to-peer trainings on the job. The familiarity of users with smartphone apps and adequate computer skills emerged as another facilitator of gaining speedy competence on the use of SORMAS. The overarching facilitator was the intrinsic motivation of frontline users. They stated that their motivation was sustained by the efficiency that SORMAS brought to their work routines and their trust in the vision of leadership to transform public health practice. The use of intuitive graphic illustrations as a training aid that described the unique advantages of SORMAS facilitated user understanding and diffusion of the system, as expressed by a frontline user and peer trainer:
As I’m speaking with you, a brochure given to me at training is in front of me and I’m still holding my SORMAS small handbook with me here. As I speak with you, all the connections: how the arrows and those things, SORMAS users, technical issues, inter role operations, SORMAS features – everything is in front of me here. I love SORMAS so much and I believe that those who have engineered it have done a very good job for the country. So, I’m ever ready whenever I’m called upon, I will be able to help.
GA_AS_DCS_03_QA_PT_220811_bka_pan; Pos. 216
In addition, frontline users were sufficiently self-motivated to support the implementation efforts by using their personal income to buy internet data bundles to access the system when there were challenges in supply from supervisors:
We buy our own data, with our own personal money.
GA_MT_DMA_72_PT_220809_bka_pan; Pos. 80
The main barriers to the rate of diffusion and dissemination were identified as inadequate supply of tablets—some of which were of inferior quality. Short battery life, poor touchscreen quality and low random-access memory sizes of 1 MB led to frequent crashes of the mobile app and data loss. A frontline user expressed disappointment in these devices:
I don’t know whether the tablets were donated to us or they were bought. I don’t know where they actually got them from. But I don’t think they are for this kind of technical jobs. Maybe they are for children.
GA_MT_LAB_14_QA_PT_220819_bka_pan; Pos. 99
The inconsistency of internet data bundle supply to users tested the motivation of some supervisors who took the initiative to buy internet data for their teams on some occasions. A supervisor expressed his fears about the risk of demotivation among his frontline users if this challenge persisted:
Here, if I don’t show interest, as an intrinsic motivation, that is that!! Because if I’ve used my data all this while, or if somebody says he doesn’t have data, that is it!! The person cannot access the SORMAS system, and you cannot blame the person unless you give the person data.
AS_MT_SUP_32_QA_PT_220710_bka_pan; Pos. 288
Outer Context
The outer context bordered on the prevailing national and international socioeconomic and political happenings that influenced any aspect of the implementation. Factors that facilitated the implementation included the financial and technical support from international partners, especially HZI and GIZ. Locally, the implementation benefited from the collaboration and technical support from the academia and public health training institutions, notably, the University of Ghana, Ghana Field Epidemiology and the Laboratory Training Program, Noguchi Memorial Institute for Medical Research, Kumasi Centre for Collaborative Research in Tropical Medicine, and Biomedical and Public Health Laboratory of the Council for Scientific and Industrial Research. The search for a national electronic tool for the COVID-19 pandemic response led to political involvement in the implementation of SORMAS. At a multidisciplinary national stakeholder evaluation of competing candidate electronic tools, SORMAS was adjudged the most ideal for both pandemic response and long-term public health surveillance and outbreak response. This was largely based on its compatibility with IDSR and adaptability and the satisfaction of GHS with its performance. The transparent evaluation and subsequent open political endorsement and directives from the level of the presidency for the nationwide deployment of SORMAS was cited as the most significant event that cut short its pilot in 2 regions for a switch to a nationwide scale-up, as narrated by one of the national public health officers:
So, we got to the presidency with several others [advocates of competing electronic tools] as I’ve mentioned, and then the meeting was chaired by the vice president himself. Then also present was the presidential advisor on health, and then other key people, and the vice president advisor on IT and digitalisation, yes, he was also there; and then some key other government people. So, at the beginning, I think [name of the person] was invited to brief them. So, we were all given opportunity to make a presentation, a 10-minute presentation each for our systems. And then based on that, then the decision as to what we were going to use nationally will be made.
IN_NA_EPI_52_QA_PT_220712_bka_pan; Pos. 68
Regarding the influence of political and business climate, they stated that partnering with private companies that depend largely on government contracts proved to be a risk. A change of government resulted in loss of contract and immediate closure of the first private partner. This in turn required the transfer of local software development and data hosting to another private IT company.
Linkage in Design and Implementation
This set of factors bordered on the existence and maintenance of a shared meaning and mission among public health actors for the adoption of SORMAS and how professional and human relations influenced the use of the system.
The study participants identified the prioritization of user-led design and development of task performance improvement requests as facilitators. Other named facilitators included the continual technical support from a broad participation of software developers (outside the SORMAS project) on GitHub discussions and collaborations and the existence of close and positive working relationship between developers and users. Good human and working relationships facilitated the implementation, as recounted by a participant:
In our particular case, it’s a very close working relationship between the users and the developers. And this is probably something...emmm, I don’t know. I’m not sure that this is happening everywhere but for sure, in Ghana, yes.
NA_GN_DV_61_QA_PT_ 220818_bka_pan; Pos. 51
And because we were working closely together, there weren’t hiccups. So, everybody knew themselves on the formal and informal level.
NA_GN_DV_61_QA_PT_220818_bka_pan; Pos. 57
However, they raised concerns about a risk of waning commitments in collaborations on skill and knowledge exchange between the local and international developers over time and how it could adversely affect sustainable use of the Ghana-specific SORMAS branch.
Prospects of Institutionalization
Regarding institutionalization, we assessed factors related to the sustained implementation and complete routinization of the use of SORMAS. These included the level of decentralization responsibilities of implementation shifted from the national to the regional and district levels. Key facilitators included the existence of a well-structured organogram with clear command and reporting lines—an all-inclusive management style, the modus operandi of which was collective brainstorming and consensus building. Other cited facilitators were the conduct of implementation review workshops and technical and financial support of major collaborators, namely, GIZ, HZI, WHO, US Centers for Disease Control and Prevention, and Nigeria Centre for Disease Control and Prevention.
The study participants identified factors that threatened the speed and eventual success of institutionalization that include a yet unestablished dedicated funding stream for eSurveillance, a substantial dependence on international partner funding, inadequate engagement of local government authorities and businesses for funding support, unevaluated maintenance cost of the system, and delays in transfer of data hosting expertise from the local IT partners to GHS. Another barrier was that some public health actors still perceive SORMAS as a project instead of an evolution of the surveillance system—a perception that could encourage retrogressive workforce attitudes and hinder efforts toward sustainability. When asked about the fate of SORMAS in Ghana beyond the support to implementation occasioned by the COVID-19 pandemic response, a study participant expressed the justification for and optimism mixed with anxiety about the prospects of institutionalization of SORMAS in Ghana:
Oooo emmm, since the tool is a surveillance and outbreak management and analysis system, any form of outbreak response, the tool is ready to accommodate that. Because, now looking at the outbreaks, emmm how do you call it...the epidemic-prone diseases that we have, and if on any of the days, tomorrow we wake up and then it is meningitis, SORMAS is there, if it is cholera, SORMAS is there. If any novel virus comes up like COVID-19 is doing now, SORMAS will really support. It is a matter of the developers incorporating the new disease into the system and it will be able to accommodate it. So, I’m sure it has come to stay. It has come to stay. Yes, it has come to stay. I’m praying that if today the developers in Germany say they are leaving it to Ghana and Nigeria, we will be able to get the skilled manpower to be able to handle the server so that it will be there and we can be able to continue to have a tool that can help us manage our surveillance system in the country.
NA_DS_ADM_51_QA_PT_220606_bka_pan; Pos. 38
Discussion
Principal Findings
We assessed the implementation of SORMAS in Ghana and identified facilitators, barriers, and sustainability strategies from the perspectives of public health actors actively involved in all aspects of the implementation.
The study identified 5 major strategic facilitators of the implementation of SORMAS in Ghana, namely, its design based on the IDSR workflow, adaptability to new tasks, well-established GHS organizational structure, good alignment with GHS medium-term and long-term goals for public health practice, and political endorsement. There were also operational facilitators including a strong national leadership, intrinsic motivation of frontline users, availability of in-country IT expertise, financial and technical support from inventors and international partners, demonstrated efficiency of SORMAS as both a surveillance and outbreak response process management tool, and relative advantages compared with existing systems for task performance (eg, real-time reporting, generation of case-base data, improved data quality, mobile offline capability, and integration of laboratory procedures).
Perhaps, the most important facilitator of the diffusion and dissemination of the system was the frontline users’ intrinsic motivation to use it. Consistent with the concept of balance of the “pains” and “gains” of adopting digital health innovations as espoused by Shaw et al [36], although some users were dissatisfied with delays in receiving internet data bundles, they took up the cost themselves—convinced that the benefits (gains) of using the system are worth their sacrifices (pains). Such levels of user altruism informed by their passion to use digital health innovations have also been reported from experiences of implementing mobile health tools in Ghana; Malawi [37]; Kenya [38]; Myanmar [39]; Brazil [40]; Los Angeles County, California [41]; Texas [42]; and the Netherlands [43]. However, this form of altruism is unsustainable, as aptly expressed by one of the frontline health workers:
Here, if I don’t show interest, as an intrinsic motivation, that is that!! Because if I’ve used my data all this while, or if somebody says he doesn’t have data, that is it!! The person cannot access the SORMAS system, and you cannot blame the person unless you give the person data.
AS_MT_SUP_32_QA_PT_220710_bka_pan; Pos. 288
The committed leadership of the health service managers and political endorsement at the level of the presidency translated to a boost in the commitment and confidence of the workforce. They had the assurance that their use of the system was appreciated by the highest office of the country. Users also considered themselves as being on a national assignment in the transition from paper-based surveillance and outbreak response to an electronic system. The positive user attitude derived from the high level of stewardship is consistent with user behaviors in the implementation of innovations in public health systems, as reported by Ginsburg et al [44] in their feasibility study of a digital innovation (mPneumonia) for pneumonia treatment in Ghana and an acceptability and usability study of a mobile health intervention for eye care in Kenya [45]. In addition, the all-inclusive management style of the GHS leadership on the implementation process, effective internal communication among supervisors and frontline users, trust of users in their leadership and the system, and field support by enthusiastic peer champions of SORMAS all contributed to sustaining the optimism for success in the face of operational challenges. Rightly so, this style of leadership and the support of champions have been recognized by digital health system implementers as important success conditions in Swaziland [46], Kenya [38], and Norway [47].
Major technical implementation barriers that our study identified include delays in completing the developments of technical interoperability between SORMAS and existing major data management systems, reliance on a private IT company for data hosting, and challenges with data synchronization. Operational barriers include the limited supply of quality data collection devices, substantial dependence on external funding, and unestablished estimates for full cost of implementation and medium-term to long-term maintenance.
One of the key benefits of adopting SORMAS is to improve the overall efficiency of task performance and reduce the workload. DHIS2 serves as the repository for all health data in Ghana, into which surveillance and outbreak data collected with SORMAS should be fed. However, the delays in achieving stable interoperability between these 2 systems undermine the expected efficiency of data transfer, as users are required to manually enter summary data already captured in SORMAS onto DHIS2. This challenge of system interoperability in the adoption of digital innovations in health care settings is rather common in both high-income countries and LMICs [9,42,43,48]. In the current case of Ghana, it poses a threat to a speedy completion of health system integration and institutionalization of SORMAS. A closely related barrier to long-term sustainability of the system is the yet inadequate technical expertise and infrastructural capacity of GHS to host the data collected with SORMAS. The availability of a private local partner to fill this gap is helpful, but its downside is that it deprives GHS of full control of its data. The external service also comes at an extra recurrent cost and competes for already stretched resources.
The challenge of synchronization undermines the real-time reporting and communication—the very properties of the system that make it a good management tool. Delayed or failed synchronizations were mostly a result of poor internet connectivity. Although the challenge of internet connectivity was more common in the rural districts, some of the study participants from urban districts experienced frequent episodes of poor connection. The challenge of reliable internet has improved over the years in LMICs but still poses a threat to the implementation of digital health tools in many settings, as corroborated by health worker experiences in Ghana [37,49], Kenya [38,45], Tanzania [50], Bangladesh [51], Myanmar [39], Brazil [40], India [52,53], and Ireland [54]. We recognize that the challenge of internet connectivity rests largely with the telecommunication industry in most countries and is not within the control of the health systems, even if they have unlimited funding to procure the best service subscriptions. Furthermore, the investments in national communication infrastructure are capital intensive, are consumer driven, and require good collaborations between the private and public sectors. In the past 2 decades, the leading internet providers in Ghana (Vodafone, Mobile Telecommunication Network, Expresso, Globacom, Airtel, and Tigo) have been largely privately owned and hence profit driven. As part of strategies to improve the penetration and quality of information and communications technology services, there have been calls for infrastructure sharing to contain the cost of investments and harness synergies among these service providers [55]. However, there have been challenges with mergers epitomized by the postmerger tensions between Airtel and Tigo that forced the government of Ghana to intervene and take over this merger [56]. This government takeover does not provide guarantee for better services because there is mixed evidence regarding the question of who provides more effective telecommunication services—the state or the private sector [57-59].
Cognizant of this multilayer of prerequisites for attaining the ideal quality of internet service vis-à-vis the ever-increasing need for real-time reporting in surveillance and outbreak response, the invention of Low-Bandwidth Database Synchronization by HZI offers a pragmatic solution, especially for LMICs [60]. Its implementation would overcome this challenge because it provides 3 alternate low-bandwidth options in 1 tool for data transmission and synchronization between mobile devices and central databases.
So far, given the level of technical and political stakeholder support, ongoing consolidation of system integration, and enthusiasm of frontline users, what remains as a serious threat to institutionalization and sustainability is a reliable national funding. There is good political support and appreciation of the utility of SORMAS. However, these have not translated to commensurate funding. The immediate reason is that the political support for the rapid nationwide scale-up of the implementation came owing to the need to respond to the COVID-19 pandemic. Thus, resources are unplanned and fragmented. A more systemic reason may simply be that health systems in LMICs, similar to most other sectors, are substantially dependent on external support, for which, new initiatives such as SORMAS do not become exceptions [61,62]. Although the rapid nationwide scale-up caused an increased demand on logistics, resulting in shortages, the continued support from the external partners, private sector, and government abated the logistics crisis over the course of the pandemic. This experience constitutes a reminder for governments and their national health institutes to maintain emergency funds and stockpiles as part of their emergency preparedness strategies [63-66]. Thus, to achieve this, our findings suggest 3 complimentary and mutually reinforcing approaches, namely, the commitment of central and local governments, broad national participation involving active financial and technical support from the private sector, and resource pooling from programs within GHS and among all health agencies in the country. Regarding the approaches to national ownership of health care financing in low-income countries, Kiendrébéogo and Meessen [67] also proposed a similar model, which they describe as “a journey with more than one pathway”—requiring broad stakeholder support including central governments, parliaments, health institutions, and the private sector. The private sector has also been identified as a key potential player in complementing the efforts of governments in health care financing in Nigeria [68,69]; Zimbabwe [70]; South Africa [71,72]; and more generally, for the African setting [73,74].
However, the timing of the introduction of SORMAS in Ghana could benefit from the national digitalization agenda that seeks to digitalize the operations of all public sectors, critical among which is health. This digitalization agenda is already receiving technical and funding support from in-country United Nations agencies and the World Bank for upgrading the overall national digital infrastructure [75-77]. We anticipate that the private telecommunication sector will remain a key player in realizing this goal, while also benefiting from a close public-private partnership. Furthermore, we anticipate that a joint stewardship of the United Nations, World Bank, private telecommunication sector, and government of Ghana could increase the chances of successful execution of the digitalization agenda. Ultimately, the envisaged penetration and quality of service of this agenda should minimize the challenges of internet connection in the use of SORMAS. A further boost to the sustainability outlook of SORMAS is Ghana’s formal adoption of eSurveillance consistent with WHO recommendations is expected to attract dedicated organizational budgetary support for its operationalization. Given that SORMAS is now the national electronic tool for surveillance, there is reason to be confident that its implementation will be sustained in the medium to long term. The ultimate institutionalization would benefit from the suggestions of users about galvanizing support from local government agencies and private business establishments at the lowest reporting levels.
We note that these stakeholder identified barriers and facilitators cut across all constructs of the model by Greenhalgh et al [32]. Thus, the outcome of the implementation is contingent on a dynamic nonlinear interaction of interdependent factors. This phenomenon has been widely recognized by other models and frameworks of implementation science [78], exemplified by the number and variety of barriers encountered in the implementation of a tuberculosis contact investigating system in Uganda [17] and the substantial gains of web-based disease monitoring and management system in the Netherlands [43]. The facilitators and barriers also cut nearly uniformly between urban and rural districts, except that internet connectivity was generally better in urban districts as would be expected. The uniformity of facilitators and barriers regarding implementation between the 2 study regions could be explained by 2 factors. First, the truncated piloting of the implementation in the Greater Accra Region did not allow for systematic evaluation and addressing of early bottlenecks. Second, the need for mass recruitment and equipping of new users across the country for the pandemic response posed similar challenges to the performance of SORMAS, workforce training, and related demands, all of which depend on a common resource pool.
From the foregoing, we infer that the facilitators and barriers identified by the study participants regarding the implementation of SORMAS in Ghana are not entirely unique to this tool and country. For example, just as its compatibility with IDSR would make it readily acceptable to countries of the WHO–Africa Region, so will the challenge of interoperability with the DHIS2 pose barriers to its integration with public health systems of these countries. The challenge of poor internet connectivity will confront the implementation of any digital tool in any country to the extent of the insufficiencies of the national telecommunication services—be it in the quality of bandwidth, geographical penetration, or other context-specific factors. Moreover, as in the case of Ghana, many LMICs receive financial support from international development partners, some of which are either short term or inconsistent [79]. Hence, the threat of implementation failure for lack of reliable and sustainable local funding should concern any such country that undertakes the institutionalization of digital systems for surveillance and outbreak response. The timing of adoption, organizational capacities and work culture, workforce skill sets, public-private partnerships, and overall political and business climate have relevance for the implementation of SORMAS in Ghana, as would be expected for the implementation of similar digital tools at scale in comparable settings. The interactions among these factors and how they influence the implementation are certain to vary to various extents depending on the specific contexts of adopting countries in normal times or during public health crises.
Limitations and Strengths
Our study had 2 main limitations. First, apart from the 18% (4/22) of study participants who we purposively selected for their unique role in the implementation, the 82% (18/22) of other participants who responded promptly to our telephone calls were likely to be more interested in the system than the nonrespondents. Thus, it is possible that the range and magnitude of the barriers were underrated. However, their blunt expression of dissatisfaction about some aspects of the implementation suggests that they were balanced in their perspectives. In addition, we believe that our inclusion of all categories of stakeholders and independent observers served to cross-validate the responses of frontline workers, their supervisors, and software developers to reduce selection bias. Second, some resource persons declined the invitations to participate because they did not wish to have their interviews recorded. This possibly deprived the study of some more diverse perspectives. We minimized this risk by extensive probing during interviews and made follow-up calls to obtain complete data that were not immediately available or recallable or required consultation of coworkers or documents.
These limitations notwithstanding, our study had many strengths. First, the timing of the study allowed us to evaluate the implementation process in both normal and pandemic times. Thus, the richness of the findings has relevance for implementing similar tools in both scenarios. Second, the model by Greenhalgh et al [32] that we adapted as part of for our study design is a comprehensive model built from evidence obtained from an extensive systematic review of implementing innovations in health care organizations such as GHS. Thus, this model enabled us to identify a broad range of factors across all relevant aspects of the implementation, namely, technology, interactions of systems (internal, national, and international), and workforce behaviors. Third, our findings are also relevant in their timing as they could feed into evidence for funding prioritization for the adoption of eSurveillance as part of a national digitalization agenda. Fourth, our findings raise some important questions for further studies. An in-depth investigation of the business and political complexities of the telecommunication industry in Ghana could provide more insights about and possible solutions to the problems of poor information and communications technology services and how the private telecommunication industry could support public institutions in tackling the challenges of system interoperability that hamper the implementation and integration of digital systems. A review of funding models for the digitalization of surveillance in LMICs would also provide insights for adopting and adapting proven funding models to promote country ownership. As our findings reveal, the implementation of SORMAS in Ghana has so far benefited from a wide range of financial and technical contributions from the state, health workers, private sector, and international partners. Hence, a cost-benefit analysis would be a useful follow-up study to examine the direct, indirect, intangible, and opportunity costs of the implementation so far and could provide further insights for planning sustainable strategies.
We provide specific and targeted recommendations for the sustainable institutionalization of SORMAS in Ghana, which could also be useful for comparable LMICs (Table 2).
Table 2.
Target stakeholder | Recommendations about sustainability strategies |
Inventors |
|
Implementing partners and collaborators |
|
Ghana government |
|
GHS |
|
aDHIS2: District Health Information System–version 2.
bGHS: Ghana Health Service.
ceIDSR: electronic Integrated Disease Surveillance and Response.
Conclusions
The facilitators of and barriers to SORMAS implementation are multiple and interdependent. Important success conditions for implementation include enhanced scope and efficiency of task performance, strong technical and political stewardship, and self-motivated workforce. Inadequate funding, limited IT infrastructure, and lack of software development expertise are mutually reinforcing barriers to the progress of implementation and ownership. Some barriers are external, relate to overall national infrastructural development, and are not amenable even to unlimited project funding.
Acknowledgments
This study was supported by the Regional Program Support to Pandemic Prevention (RPPP) in the Economic Community of West African States Region funded by the Federal Ministry for Economic Cooperation and Development (Bundesministerium für wirtschaftliche Zusammenarbeit und Entwicklung) and cofinanced by the European Union. The authors are grateful to the study participants, research assistants, and the leadership and staff of the implementing partners of the Surveillance Outbreak Response Management and Analysis System in Ghana, namely, Ghana Health Service, Helmholtz-Zentrum für infektionsforschung (the Helmholtz Centre for Infection Research), Deutsche gesellschaft für internationale Zusammenarbeit (German Corporation for International Cooperation), Ghana Community Network System, and ePareto information systems.
Abbreviations
- DHIS2
District Health Information System–version 2
- GHS
Ghana Health Service
- GIZ
Deutsche gesellschaft für internationale Zusammenarbeit (German Corporation for International Cooperation)
- HZI
Helmholtz-Zentrum für infektionsforschung (the Helmholtz Centre for Infection Research)
- IDSR
Integrated Disease Surveillance and Response
- LMICs
low- and middle-income countries
- SORMAS
Surveillance Outbreak Response Management and Analysis System
- WHO
World Health Organization
Coding system and intercoder reliability estimates.
Summary of key facilitators of and barriers to the implementation of Surveillance Outbreak Response Management and Analysis System in Ghana (2022).
Data Availability
The data collected for this study are not publicly available owing to data protection restrictions. However, they are available from the corresponding author upon reasonable request and subject to written clearance of the request by the data protection office of the Helmholtz Centre for Infection Research (Helmholtz-Zentrum für infektionsforschung)–Braunschweig.
Footnotes
Conflicts of Interest: GK conceptualized SORMAS. FA-B, DOL, and EK are involved in the implementation of SORMAS in Ghana. AMH, CW, and BBK are involved in the epidemiological specifications and overall development of SORMAS.
References
- 1.Lombardo JS, Ross DL. Disease surveillance: a public health priority. In: Lombardo JS, Ross DL, editors. Disease Surveillance: A Public Health Informatics Approach. Hoboken, NJ: John Wiley & Sons; 2007. [Google Scholar]
- 2.Roess A, Gurman T, Ghoshal S, Mookherji S. Reflections on the potential of mHealth to strengthen health systems in low- and middle-income countries. J Health Commun. 2014;19(8):871–5. doi: 10.1080/10810730.2014.943126. [DOI] [PubMed] [Google Scholar]
- 3.Vasudevan L, Ghoshal S, Labrique A. mHealth and its role in disease surveillance. In: Blazes DL, Lewis SH, editors. Disease Surveillance: Technological Contributions to Global Health Securit. Boca Raton, FL: CRC Press; 2016. pp. 131–8. [Google Scholar]
- 4.Blazes DL, Lewis SH. Disease Surveillance: Technological Contributions to Global Health Security. Boca Raton, FL: CRC Press; 2016. [Google Scholar]
- 5.Measuring digital development: facts and figures. International Communication Union. 2021. [2022-11-22]. https://www.itu.int/en /ITU-D/Statistics/Pages/facts/default.aspx .
- 6.Ibrahim LM, Okudo I, Stephen M, Ogundiran O, Pantuvo JS, Oyaole DR, Tegegne SG, Khalid A, Ilori E, Ojo O, Ihekweazu C, Baraka F, Mulombo WK, Lasuba CL, Nsubuga P, Alemu W. Electronic reporting of integrated disease surveillance and response: lessons learned from northeast, Nigeria, 2019. BMC Public Health. 2021 May 13;21(1):916. doi: 10.1186/s12889-021-10957-9. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-021-10957-9 .10.1186/s12889-021-10957-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.eSurveillance implementation in the context of integrated disease surveillance and response in the WHO African region. World Health Organization Africa. 2015. [2022-09-11]. https://www.afro.who.int/sites/default/files/2017-06/esurveillance-imple mentation-in-the-context-of-integrated-disease-surveillance-and-response-in-the-who-african-region.pdf .
- 8.Cresswell K, Sheikh A. Organizational issues in the implementation and adoption of health information technology innovations: an interpretative review. Int J Med Inform. 2013 May;82(5):e73–86. doi: 10.1016/j.ijmedinf.2012.10.007.S1386-5056(12)00199-2 [DOI] [PubMed] [Google Scholar]
- 9.Gagnon MP, Desmartis M, Labrecque M, Car J, Pagliari C, Pluye P, Frémont P, Gagnon J, Tremblay N, Légaré F. Systematic review of factors influencing the adoption of information and communication technologies by healthcare professionals. J Med Syst. 2012 Feb;36(1):241–77. doi: 10.1007/s10916-010-9473-4. https://europepmc.org/abstract/MED/20703721 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Murray E, Burns J, May C, Finch T, O'Donnell C, Wallace P, Mair F. Why is it difficult to implement e-health initiatives? A qualitative study. Implement Sci. 2011 Jan 19;6:6. doi: 10.1186/1748-5908-6-6. https://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-6-6 .1748-5908-6-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Odendaal WA, Anstey Watkins J, Leon N, Goudge J, Griffiths F, Tomlinson M, Daniels K. Health workers' perceptions and experiences of using mHealth technologies to deliver primary healthcare services: a qualitative evidence synthesis. Cochrane Database Syst Rev. 2020 Mar 26;3(3):CD011942. doi: 10.1002/14651858.CD011942.pub2. https://europepmc.org/abstract/MED/32216074 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Wisdom JP, Chor KH, Hoagwood KE, Horwitz SM. Innovation adoption: a review of theories and constructs. Adm Policy Ment Health. 2014 Jul;41(4):480–502. doi: 10.1007/s10488-013-0486-4. https://europepmc.org/abstract/MED/23549911 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Betjeman TJ, Soghoian SE, Foran MP. mHealth in Sub-Saharan Africa. Int J Telemed Appl. 2013;2013:482324. doi: 10.1155/2013/482324. doi: 10.1155/2013/482324. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Hall CS, Fottrell E, Wilkinson S, Byass P. Assessing the impact of mHealth interventions in low- and middle-income countries--what has been shown to work? Glob Health Action. 2014;7:25606. doi: 10.3402/gha.v7.25606. https://europepmc.org/abstract/MED/25361730 .25606 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Labrique A, Vasudevan L, Chang LW, Mehl G. H_pe for mHealth: more "y" or "o" on the horizon? Int J Med Inform. 2013 May;82(5):467–9. doi: 10.1016/j.ijmedinf.2012.11.016. https://europepmc.org/abstract/MED/23279850 .S1386-5056(12)00240-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Marcolino MS, Oliveira JA, D'Agostino M, Ribeiro AL, Alkmim MB, Novillo-Ortiz D. The impact of mHealth interventions: systematic review of systematic reviews. JMIR Mhealth Uhealth. 2018 Jan 17;6(1):e23. doi: 10.2196/mhealth.8873. https://mhealth.jmir.org/2018/1/e23/ v6i1e23 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Meyer AJ, Armstrong-Hough M, Babirye D, Mark D, Turimumahoro P, Ayakaka I, Haberer JE, Katamba A, Davis JL. Implementing mHealth interventions in a resource-constrained setting: case study from Uganda. JMIR Mhealth Uhealth. 2020 Jul 13;8(7):e19552. doi: 10.2196/19552. https://mhealth.jmir.org/2020/7/e19552/ v8i7e19552 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.van Velthoven MH, Cordon C. Sustainable adoption of digital health innovations: perspectives from a stakeholder workshop. J Med Internet Res. 2019 Mar 25;21(3):e11922. doi: 10.2196/11922. https://www.jmir.org/2019/3/e11922/ v21i3e11922 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Bakibinga-Gaswaga E, Bakibinga S, Bakibinga DB, Bakibinga P. Digital technologies in the COVID-19 responses in sub-Saharan Africa: policies, problems and promises. Pan Afr Med J. 2020 May 18;35(Suppl 2):38. doi: 10.11604/pamj.supp.2020.35.2.23456. https://europepmc.org/abstract/MED/33623563 .PAMJ-SUPP-35-2-38 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Jalabneh R, Syed H, Pillai S, Apu E, Hussein M, Kabir R. Use of mobile phone apps for contact tracing to control the COVID-19 pandemic: a literature review. In: Mohanty SN, Saxena SK, Chatterjee JM, Satpathy S, editors. Applications of Artificial Intelligence in COVID-19. Heidelberg, Germany: Springer Verlag; 2021. pp. 389–404. [Google Scholar]
- 21.Sacks JA, Zehe E, Redick C, Bah A, Cowger K, Camara M, Diallo A, Gigo AN, Dhillon RS, Liu A. Introduction of mobile health tools to support Ebola surveillance and contact tracing in guinea. Glob Health Sci Pract. 2015 Dec;3(4):646–59. doi: 10.9745/ghsp-d-15-00207. https://www.ghspjournal.org/content/3/4/646 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Silenou BC, Nyirenda JL, Zaghloul A, Lange B, Doerrbecker J, Schenkel K, Krause G. Availability and suitability of digital health tools in Africa for pandemic control: scoping review and cluster analysis. JMIR Public Health Surveill. 2021 Dec 23;7(12):e30106. doi: 10.2196/30106. https://publichealth.jmir.org/2021/12/e30106/ v7i12e30106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Fähnrich C, Denecke K, Adeoye OO, Benzler J, Claus H, Kirchner G, Mall S, Richter R, Schapranow MP, Schwarz N, Tom-Aba D, Uflacker M, Poggensee G, Krause G. Surveillance and Outbreak Response Management System (SORMAS) to support the control of the Ebola virus disease outbreak in West Africa. Euro Surveill. 2015 Mar 26;20(12):21071. doi: 10.2807/1560-7917.es2015.20.12.21071. http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=21071 .21071 [DOI] [PubMed] [Google Scholar]
- 24.Lee HA, Kung HH, Lee YJ, Chao JC, Udayasankaran JG, Fan HC, Ng KK, Chang YK, Kijsanayotin B, Marcelo AB, Hsu CY. Global infectious disease surveillance and case tracking system for COVID-19: development study. JMIR Med Inform. 2020 Dec 22;8(12):e20567. doi: 10.2196/20567. https://medinform.jmir.org/2020/12/e20567/ v8i12e20567 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Contact tracing during an outbreak of Ebola virus disease. World Health Organization. 2014. [1999-11-30]. https://www.who.int/publications/i/item/9789290232575 .
- 26.Perscheid C, Benzler J, Hermann C, Janke M, Moyer D, Laedtke T, Adeoye O, Denecke K, Kirchner G, Beermann S, Schwarz N, Tom-Aba D, Krause G. Ebola outbreak containment: real-time task and resource coordination with SORMAS. Front ICT. 2018 Apr 10;5:7. doi: 10.3389/fict.2018.00007. https://www.frontiersin.org/articles/10.3389/fict.2018.00007/full . [DOI] [Google Scholar]
- 27.Tom-Aba D, Nguku PM, Arinze CC, Krause G. Assessing the Concepts and Designs of 58 mobile apps for the management of the 2014-2015 West Africa Ebola outbreak: systematic review. JMIR Public Health Surveill. 2018 Oct 29;4(4):e68. doi: 10.2196/publichealth.9015. https://publichealth.jmir.org/2018/4/e68/ v4i4e68 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Nsubuga P, Brown WG, Groseclose SL, Ahadzie L, Talisuna AO, Mmbuji P, Tshimanga M, Midzi S, Wurapa F, Bazeyo W, Amri M, Trostle M, White M. Implementing integrated disease surveillance and response: four African countries' experience, 1998-2005. Glob Public Health. 2010;5(4):364–80. doi: 10.1080/17441690903334943.916865082 [DOI] [PubMed] [Google Scholar]
- 29.Tom-Aba D, Silenou BC, Doerrbecker J, Fourie C, Leitner C, Wahnschaffe M, Strysewske M, Arinze CC, Krause G. The Surveillance Outbreak Response Management and Analysis System (SORMAS): digital health global goods maturity assessment. JMIR Public Health Surveill. 2020 Apr 29;6(2):e15860. doi: 10.2196/15860. https://publichealth.jmir.org/2020/2/e15860/ v6i2e15860 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Silenou BC, Tom-Aba D, Adeoye O, Arinze CC, Oyiri F, Suleman AK, Yinka-Ogunleye A, Dörrbecker J, Ihekweazu C, Krause G. Use of surveillance outbreak response management and analysis system for human monkeypox outbreak, Nigeria, 2017-2019. Emerg Infect Dis. 2020 Feb;26(2):345–9. doi: 10.3201/eid2602.191139. doi: 10.3201/eid2602.191139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Krause G. SORMAS® - surveillance outbreak response management and analysis system how it may contribute to EIOS. World Health Organization. 2019. [2023-10-07]. https://www.who.int/docs/default-source/eios-gtm-2019-presentations/31---krauseg -eios-gtm-2019.pdf?sfvrsn=8fa20cdf_2 .
- 32.Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x. http://europepmc.org/abstract/MED/15595944 .MILQ325 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.SORMAS-foundation / SORMAS-project. GitHub. 2020. [2023-10-07]. https://github.com/SORMAS-Foundation/SORMAS-Project .
- 34.COVID-19 Public Health Emergency of International Concern (PHEIC) Global research and innovation forum. World Health Organization. 2020. [2022-12-11]. https://www.who.int/publications/m/item/covid-19-public-health-emergency-of-international -concern-(pheic)-global-research-and-innovation-forum .
- 35.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–74. [PubMed] [Google Scholar]
- 36.Shaw J, Agarwal P, Desveaux L, Palma DC, Stamenova V, Jamieson T, Yang R, Bhatia RS, Bhattacharyya O. Beyond "implementation": digital health innovation and service design. NPJ Digit Med. 2018 Sep 20;1:48. doi: 10.1038/s41746-018-0059-8. doi: 10.1038/s41746-018-0059-8.59 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Hampshire K, Porter G, Mariwah S, Munthali A, Robson E, Owusu SA, Abane A, Milner J. Who bears the cost of 'informal mhealth'? Health-workers' mobile phone practices and associated political-moral economies of care in Ghana and Malawi. Health Policy Plan. 2017 Feb 31;32(1):34–42. doi: 10.1093/heapol/czw095. https://europepmc.org/abstract/MED/27476501 .czw095 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Toda M, Njeru I, Zurovac D, Kareko D, O-Tipo S, Mwau M, Morita K. Understanding mSOS: a qualitative study examining the implementation of a text-messaging outbreak alert system in rural Kenya. PLoS One. 2017 Jun 19;12(6):e0179408. doi: 10.1371/journal.pone.0179408. https://dx.plos.org/10.1371/journal.pone.0179408 .PONE-D-16-36313 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.van der Wal KR. Acceptance and use of mHealth tools by auxiliary midwives in Myanmar: a qualitative study. Université de Montréal. 2017. [2022-11-10]. https://tinyurl.com/5yjttcr7 .
- 40.Schoen J, Mallett JW, Grossman-Kahn R, Brentani A, Kaselitz E, Heisler M. Perspectives and experiences of community health workers in Brazilian primary care centers using m-health tools in home visits with community members. Hum Resour Health. 2017 Sep 29;15(1):71. doi: 10.1186/s12960-017-0245-9. https://human-resources-health.biomedcentral.com/articles/10.1186/s12960-017-0245-9 .10.1186/s12960-017-0245-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Ramirez M, Wu S, Ryan G, Towfighi A, Vickrey BG. Using beta-version mHealth technology for team-based care management to support stroke prevention: an assessment of utility and challenges. JMIR Res Protoc. 2017 May 23;6(5):e94. doi: 10.2196/resprot.7106. https://www.researchprotocols.org/2017/5/e94/ v6i5e94 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Trivedi MH, Daly EJ, Kern JK, Grannemann BD, Sunderajan P, Claassen CA. Barriers to implementation of a computerized decision support system for depression: an observational report on lessons learned in "real world" clinical settings. BMC Med Inform Decis Mak. 2009 Jan 21;9:6. doi: 10.1186/1472-6947-9-6. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/1472-6947-9-6 .1472-6947-9-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.van den Wijngaart LS, Geense WW, Boehmer AL, Brouwer ML, Hugen CA, van Ewijk BE, Koenen-Jacobs M, Landstra AM, Niers LE, van Onzenoort-Bokken L, Ottink MD, Rikkers-Mutsaerts ER, Groothuis I, Vaessen-Verberne AA, Roukema J, Merkus PJ. Barriers and facilitators when implementing web-based disease monitoring and management as a substitution for regular outpatient care in pediatric asthma: qualitative survey study. J Med Internet Res. 2018 Oct 30;20(10):e284. doi: 10.2196/jmir.9245. https://www.jmir.org/2018/10/e284/ v20i10e284 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Ginsburg AS, Tawiah Agyemang C, Ambler G, Delarosa J, Brunette W, Levari S, Larson C, Sundt M, Newton S, Borriello G, Anderson R. mPneumonia, an Innovation for Diagnosing and Treating Childhood Pneumonia in Low-Resource Settings: A Feasibility, Usability and Acceptability Study in Ghana. PLoS One. 2016 Oct 27;11(10):e0165201. doi: 10.1371/journal.pone.0165201. https://dx.plos.org/10.1371/journal.pone.0165201 .PONE-D-16-23248 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Lodhia V, Karanja S, Lees S, Bastawrous A. Acceptability, usability, and views on deployment of peek, a mobile phone mHealth intervention for eye care in Kenya: qualitative study. JMIR Mhealth Uhealth. 2016 May 09;4(2):e30. doi: 10.2196/mhealth.4746. http://mhealth.jmir.org/2016/2/e30 .v4i2e30 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Hao WR, Hsu YH, Chen KC, Li HC, Iqbal U, Nguyen PA, Huang CW, Yang HC, Lee P, Li MH, Hlatshwayo SL, Li YC, Jian WS. LabPush: a pilot study of providing remote clinics with laboratory results via short message service (SMS) in Swaziland, Africa - a qualitative study. Comput Methods Programs Biomed. 2015 Jan;118(1):77–83. doi: 10.1016/j.cmpb.2014.10.005.S0169-2607(14)00350-2 [DOI] [PubMed] [Google Scholar]
- 47.Kolltveit BH, Gjengedal E, Graue M, Iversen MM, Thorne S, Kirkevold M. Conditions for success in introducing telemedicine in diabetes foot care: a qualitative inquiry. BMC Nurs. 2017 Jan 13;16:2. doi: 10.1186/s12912-017-0201-y. https://bmcnurs.biomedcentral.com/articles/10.1186/s12912-017-0201-y .201 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, Hinder S, Fahy N, Procter R, Shaw S. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017 Nov 01;19(11):e367. doi: 10.2196/jmir.8775. https://www.jmir.org/2017/11/e367/ v19i11e367 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Rothstein JD, Jennings L, Moorthy A, Yang F, Gee L, Romano K, Hutchful D, Labrique AB, LeFevre AE. Qualitative assessment of the feasibility, usability, and acceptability of a mobile client data app for community-based maternal, neonatal, and child care in rural Ghana. Int J Telemed Appl. 2016;2016:2515420. doi: 10.1155/2016/2515420. doi: 10.1155/2016/2515420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Madon S, Amaguru JO, Malecela MN, Michael E. Can mobile phones help control neglected tropical diseases? experiences from Tanzania. Soc Sci Med. 2014 Feb;102:103–10. doi: 10.1016/j.socscimed.2013.11.036. https://linkinghub.elsevier.com/retrieve/pii/S0277-9536(13)00648-5 .S0277-9536(13)00648-5 [DOI] [PubMed] [Google Scholar]
- 51.Khan NU, Rasheed S, Sharmin T, Ahmed T, Mahmood SS, Khatun F, Hanifi S, Hoque S, Iqbal M, Bhuiya A. Experience of using mHealth to link village doctors with physicians: lessons from Chakaria, Bangladesh. BMC Med Inform Decis Mak. 2015 Aug 05;15:62. doi: 10.1186/s12911-015-0188-9. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-015-0188-9 .10.1186/s12911-015-0188-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Nguyen LH, LeFevre AE, Jennings L, Agarwal S, Mehl G, Labrique AB, Chava LD. Perceptions of data processes in mobile-based versus paper-based health information systems for maternal, newborn and child health: a qualitative study in Andhra Pradesh, India. BMJ Innov. 2015 Sep 30;1(4):167–73. doi: 10.1136/bmjinnov-2015-000063. https://innovations.bmj.com/content/1/4/167 . [DOI] [Google Scholar]
- 53.Ilozumba O, Dieleman M, Kraamwinkel N, van Belle S, Chaudoury M, Broerse JE. "I am not telling. The mobile is telling": factors influencing the outcomes of a community health worker mHealth intervention in India. PLoS One. 2018 Mar 27;13(3):e0194927. doi: 10.1371/journal.pone.0194927. https://dx.plos.org/10.1371/journal.pone.0194927 .PONE-D-17-23502 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Quinn EM, Corrigan MA, O'Mullane J, Murphy D, Lehane EA, Leahy-Warren P, Coffey A, McCluskey P, Redmond HP, Fulton GJ. Clinical unity and community empowerment: the use of smartphone technology to empower community management of chronic venous ulcers through the support of a tertiary unit. PLoS One. 2013 Nov 12;8(11):e78786. doi: 10.1371/journal.pone.0078786. https://dx.plos.org/10.1371/journal.pone.0078786 .PONE-D-13-32464 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Hatsu S, Mabeifam UM, Paitoo PC. Infrastructure sharing among Ghana’s mobile telecommunication networks: benefits and challenges. Am J Netw Commun. 2016 Apr;5(2):35–45. doi: 10.11648/j.ajnc.20160502.14. https://www.sciencepublishinggroup.com/journal/paperinfo?journalid=132&doi=10.11648/j.ajnc.20160502.14 . [DOI] [Google Scholar]
- 56.Anokye-Wusu AK. Post-merger conflicts: perspectives from AirtelTigo Ghana Limited. ResearchGate. 2021. [2023-08-03]. \https://tinyurl.com/4anm4mu3 .
- 57.Frimpong J, Young S. Alliance capitalism and the telecom industry: the Ghanaian experience: citeseer. University of Strathclyde. 2002. [2023-08-03]. https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=aa4bd4243fcdd049d902c46f2 815e2c519ded2cd .
- 58.Kyei JK. Assessment of post privatisation perfomance of Ghana telecom 2003. Kwame Nkrumah University of Science and Technology. 2003. Nov, [2023-10-07]. https://ir.knust.edu.gh/items/adcf0c33-56f2-43bb-a1c5-5c09f820c461 .
- 59.Awortwi N, Vondee J. Drifting towards convergence? Motivation and performance management in state and private companies in the provision of telecom services in Ghana. Public Admin Dev. 2007 Oct;27(4):261–72. doi: 10.1002/pad.458. https://onlinelibrary.wiley.com/doi/abs/10.1002/pad.458 . [DOI] [Google Scholar]
- 60.Low Bandwidth Data Base Synchronisation: a method for synchronising data of a database in mobile device with data in a central database. Patent of the Helmholtz Centre for Infection Research. [2023-10-07]. https://www.ascenion.de/technologieangebote/low-bandwidth-data-base-synchronization-lbds .
- 61.Chirambo GB, Muula AS, Thompson M. Factors affecting sustainability of mHealth decision support tools and mHealth technologies in Malawi. Inform Med Unlocked. 2019;17:100261. doi: 10.1016/j.imu.2019.100261. https://www.sciencedirect.com/science/article/pii/S2352914819302552 . [DOI] [Google Scholar]
- 62.Dharmayat KI, Tran T, Hardy V, Chirambo BG, Thompson MJ, Ide N, Carlsson S, Andersson B, O'Donoghue JM, Mastellos N. Sustainability of 'mHealth' interventions in sub- Saharan Africa: a stakeholder analysis of an electronic community case management project in Malawi. Malawi Med J. 2019 Sep;31(3):177–83. doi: 10.4314/mmj.v31i3.3. https://europepmc.org/abstract/MED/31839886 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Gouglas D, Christodoulou M, Plotkin S, Hatchett R. CEPI: driving progress toward epidemic preparedness and response. Epidemiol Rev. 2019 Jan 31;41(1):28–33. doi: 10.1093/epirev/mxz012. https://europepmc.org/abstract/MED/31673694 .5588068 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Rosenthal PJ, Breman JG, Djimde AA, John CC, Kamya MR, Leke RG, Moeti MR, Nkengasong J, Bausch DG. COVID-19: shining the light on Africa. Am J Trop Med Hyg. 2020 Jun;102(6):1145–1148. doi: 10.4269/ajtmh.20-0380. https://europepmc.org/abstract/MED/32372749 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Serchen J, Cline K, Mathew S, Hilden D, Health and Public Policy Committee of the American College of Physicians Preparing for future pandemics and public health emergencies: an American college of physicians policy position paper. Ann Intern Med. 2023 Sep;176(9):1240–4. doi: 10.7326/M23-0768. https://www.acpjournals.org/doi/abs/10.7326/M23-0768?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed . [DOI] [PubMed] [Google Scholar]
- 66.Watson CR, Watson M, Sell TK. Public health preparedness funding: key programs and trends from 2001 to 2017. Am J Public Health. 2017 Sep;107(S2):S165–7. doi: 10.2105/AJPH.2017.303963. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Kiendrébéogo JA, Meessen B. Ownership of health financing policies in low-income countries: a journey with more than one pathway. BMJ Glob Health. 2019 Oct 01;4(5):e001762. doi: 10.1136/bmjgh-2019-001762. https://gh.bmj.com/lookup/pmidlookup?view=long&pmid=31646009 .bmjgh-2019-001762 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Ejughemre UJ. Accelerated reforms in healthcare financing: the need to scale up private sector participation in Nigeria. Int J Health Policy Manag. 2014 Jan;2(1):13–9. doi: 10.15171/ijhpm.2014.04. https://europepmc.org/abstract/MED/24596895 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Olakunde B. Public health care financing in Nigeria: which way forward? Ann Nigerian Med. 2012;6(1):4. doi: 10.4103/0331-3131.100199. https://www.researchgate.net/publication/285080971_Public_health_care_financing_in_Nigeria_Which_way_forward . [DOI] [Google Scholar]
- 70.Mugwagwa JT, Chinyadza JK, Banda G. Private sector participation in health care in Zimbabwe: what’s the value-added? J Healthc Commun. 2017;02(02):10. doi: 10.4172/2472-1654.100050. https://www.research.ed.ac.uk/en/publications/private-sector-participation-in-health-care-in-zimbabwe-whats-the . [DOI] [Google Scholar]
- 71.McIntyre D. Private sector involvement in funding and providing health services in South Africa: implications for equity and access to health care. Health Economics Unit. 2010. [2023-08-04]. https://www.equinetafrica.org/sites/default/files/uploads/documents/DIS84privfin%20mcintyre.pdf .
- 72.Whyle EB, Olivier J. Models of public-private engagement for health services delivery and financing in Southern Africa: a systematic review. Health Policy Plan. 2016 Dec 13;31(10):1515–29. doi: 10.1093/heapol/czw075.czw075 [DOI] [PubMed] [Google Scholar]
- 73.Sambo LG, Kirigia JM. Africa's health: could the private sector accelerate the progress towards health MDGs? Int Arch Med. 2011 Nov 25;4(1):39. doi: 10.1186/1755-7682-4-39. https://europepmc.org/abstract/MED/22118626 .1755-7682-4-39 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Stallworthy G, Boahene K, Ohiri K, Pamba A, Knezovich J. Roundtable discussion: what is the future role of the private sector in health? Global Health. 2014 Jun 24;10(1):55. doi: 10.1186/1744-8603-10-55. https://globalizationandhealth.biomedcentral.com/articles/10.1186/1744-8603-10-55 .1744-8603-10-55 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Tawiah A. UN agencies in Ghana have begun the implementation of digitalisation programmes across various sectors of national development in support of the government’s digitalisation agenda. Graphic Online. 2022. [2022-11-11]. https://www.graphic.com.gh/news/general-news/un-agencies-support-digitalisation-agenda.html .
- 76.Ghana's digital agenda. National Communications Authority. 2018. [2022-11-28]. https://nca.org.gh/wp-content/uploads/2021/11/Key-NCA-Projects-2018.pdf .
- 77.World Bank Provides $200 Million to accelerate Ghana’s digital transformation agenda for better jobs. The World Bank. 2022. [2022-11-11]. https://www.worldbank.org/en/news/press-release/2022/04/28/afw-world-bank-provides-200-million-to-accelerate -ghana-digital-transformation-agenda-for-better-jobs .
- 78.Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015 Apr 21;10:53. doi: 10.1186/s13012-015-0242-0. https://implementationscience.biomedcentral.com/articles/10.1186/s13012-015-0242-0 .10.1186/s13012-015-0242-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Making development co-operation more effective. Organisation for Economic Co-operation and Development. 2019. [2023-10-07]. https://www.oecd-ilibrary.org/development/making-development-co-operation-more-effective_26f2638f-en .
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Coding system and intercoder reliability estimates.
Summary of key facilitators of and barriers to the implementation of Surveillance Outbreak Response Management and Analysis System in Ghana (2022).
Data Availability Statement
The data collected for this study are not publicly available owing to data protection restrictions. However, they are available from the corresponding author upon reasonable request and subject to written clearance of the request by the data protection office of the Helmholtz Centre for Infection Research (Helmholtz-Zentrum für infektionsforschung)–Braunschweig.