Skip to main content
PLOS Neglected Tropical Diseases logoLink to PLOS Neglected Tropical Diseases
. 2021 Oct 29;15(10):e0009920. doi: 10.1371/journal.pntd.0009920

Development and validation of a framework to improve neglected tropical diseases surveillance and response at sub-national levels in Kenya

Arthur K S Ng’etich 1,*, Kuku Voyi 1,#, Clifford M Mutero 1,2,3,#
Editor: Claudia Munoz-Zanzi4
PMCID: PMC8580251  PMID: 34714822

Abstract

Background

Assessment of surveillance and response system functions focusing on notifiable diseases has widely been documented in literature. However, there is limited focus on diseases targeted for elimination or eradication, particularly preventive chemotherapy neglected tropical diseases (PC-NTDs). There are limited strategies to guide strengthening of surveillance and response system functions concerning PC-NTDs. The aim of this study was to develop and validate a framework to improve surveillance and response to PC-NTDs at the sub-national level in Kenya.

Methods

A multi-phased approach using descriptive cross-sectional mixed-method designs was adopted. Phase one involved a systematic literature review of surveillance assessment studies to derive generalised recommendations. Phase two utilised primary data surveys to identify disease-specific recommendations to improve PC-NTDs surveillance. The third phase utilised a Delphi survey to assess stakeholders’ consensus on feasible recommendations. The fourth phase drew critical lessons from existing conceptual frameworks. The final validated framework was based on resolutions and inputs from concerned stakeholders.

Results

The first phase identified thirty studies that provided a combination of recommendations for improving surveillance functions. Second phase described PC-NTDs specific recommendations linked to simplified case definitions, enhanced laboratory capacity, improved reporting tools, regular feedback and supervision, enhanced training and improved system stability and flexibility. In the third phase, consensus was achieved on feasibility for implementing recommendations. Based on these recommendations, framework components constituted human, technical and organisational inputs, four process categories, ten distinct outputs, outcomes and overall impact encompassing reduced disease burden, halted disease transmission and reduced costs for implementing treatment interventions to achieve PC-NTDs control and elimination.

Conclusion

In view of the mixed methodological approach used to develop the framework coupled with further inputs and consensus among concerned stakeholders, the validated framework is relevant for guiding decisions by policy makers to strengthen the existing surveillance and response system functions towards achieving PC-NTDs elimination.

Author summary

Neglected tropical diseases (NTDs) affect marginalised and underserved populations with sub-national levels providing first contact healthcare services to the afflicted communities. NTDs amenable to chemoprophylaxis are primarily controlled through mass treatment interventions. However, identification of disease transmission hotspots requires strengthened health information systems (HIS) to inform targeted public health action and response. Using a multi-phased approach, we developed and validated a framework, which provided a logical approach for guiding actions to strengthen surveillance system functions in view of NTDs. Framework development involved undertaking a systematic literature review to retrieve generalised recommendations for improving surveillance system functions within the African context, conducting primary data surveys to identify disease-specific recommendations on improving surveillance system core, support and attribute functions regarding NTDs and determining feasibility for implementing recommended actions at the sub-national levels. A review of relevant conceptual frameworks provided information underpinning overall framework development. The study identified framework component interlinkages to achieve the desired results of reduced costs for implementing treatment interventions, halted disease transmission and reduced disease burden. Overall, the framework provides a logical approach for strengthening HIS at sub-national levels in NTD endemic regions, considering stakeholders’ perspectives and the available resources to achieve the ultimate goal of disease elimination.

Introduction

An integral component to achieving health systems strengthening is through enhanced performance of health information systems (HIS) [1,2]. Quality health information underpins stakeholders’ actions towards achieving quality health care [3]. Essentially, well-functioning health information and surveillance systems ensure generation, analysis, distribution and utilisation of reliable information to support decision-making across all health system levels [4]. A priority action outlined in the Kenyan HIS policy framework is the integration of data collection and dissemination through partnership in health information processes involving all health service providers [2]. This closely relates to the principle of consolidated efforts within the integrated disease surveillance and response (IDSR) system framework adopted by World Health Organization (WHO) Member States in Africa [5]. The IDSR framework categorises diseases as either being epidemic-prone, diseases of public health importance or diseases targeted for elimination or eradication [5]. In particular, neglected tropical diseases (NTDs) in Kenya are categorised as either being of public health importance or targeted for elimination or eradication [6]. NTDs are a diverse group of communicable diseases that prevail in tropical and subtropical regions, mainly affecting marginalised communities and are a major cause of deformities and disabilities [7]. The chronic nature of NTDs leads to a sustained cycle of poverty among the afflicted communities and exerts pressure on the already fragile health systems [8]. Therefore, WHO work plan for NTDs elimination identifies five intervention strategies including preventive chemotherapy among affected populations, intensified case finding (CF) and disease management, integrated vector management, improved sanitation and hygiene and veterinary public health [9]. Preventive chemotherapy (PC) is an essential strategy for NTDs infection control, which targets the disease causative agents–parasitic, viral and bacterial–concurrently through mass drug administration (MDA) [10]. However, focus on MDA strategies limits priority given to the role played by other social determinants and the existing health systems to achieve NTDs control. There is consensus among NTD experts that in order to achieve efficient and sustainable control and meet disease-specific elimination targets it requires well-functioning health systems [1114]. Overdependence on mass treatment strategies may exhaust the available resources, thereby impeding health system strengthening efforts [1113].

Neglected tropical diseases are a clear case in point regarding existing health systems functioning sub-optimally. NTDs are considered of low priority within national health information and disease surveillance systems, which may hinder generation of quality data and result to ineffective use and dissemination of information [15]. Dependence on chemoprophylaxis as a stand-alone intervention for PC-NTDs requires continued support of HIS components through strengthened surveillance systems. This identifies the need to establish strong and adaptable systems to improve data management capacities in NTD endemic countries [15]. Strengthened HIS will facilitate undertaking evidence-based actions and establishment of effective NTDs control interventions [11,12,15]. However, solely depending on existing interventions and technologies may not sufficiently achieve sustainable control and elimination of targeted NTDs [12,16]. Measures to strengthen existing health systems are critical to improving health personnel attitudes and credibility of the health system[17]. As a result, the need to improve present surveillance and response systems through novel frameworks tailored to local settings to inform targeted control efforts in NTD endemic areas is crucial [18].

The current framework was partly founded on the same principles adopted by conceptual frameworks for strengthening public health surveillance systems [19,20]. The intricacies of strengthening health system building blocks are evident from the varying perspectives illustrated by an array of conceptual frameworks applicable to different settings [2123]. Frameworks developed with the intention of assessing the strength of a health system should typically address all essential components including the resources dedicated to the system (inputs), what the system inputs intend to fulfill (processes and outputs) and the resulting benefits and fundamental change to the system (outcomes and impact) [21]. However, multiple complexities are involved since the overall health system performance is dependent on several other factors involving technical, social, organizational and cultural dynamics [21,23]. The framework herein focuses on strengthening the indicator-based components of the existing surveillance system that involves the collection of structured data through routine surveillance systems [24].

Previous public health surveillance systems assessments have prioritised execution of interventions, resulting outcomes and their impact. Therefore, the proposed framework intended to conceptualise the link between inputs, processes and relevant outcomes of the existing surveillance system. The framework was based on stakeholders’ perspectives on improving surveillance and response to PC-NTDs, with the intention of strengthening implementation of surveillance activities at the county level in Kenya. The goal was to enable concerned stakeholders effectively identify gaps within the existing surveillance system, prioritise plans of actions for improving the system and design indicators for progress monitoring [25]. Therefore, the proposed framework was aimed at providing an adoptable logical approach to guide stakeholders’ actions to improve surveillance and response to PC-NTDs at the sub national level in Kenya.

Methods

Ethics statement

Written informed consent was obtained from research participants involved at various stages of framework development and validation. Ethical approval was granted by the Faculty of Health Sciences Research Ethics Committee of the University of Pretoria in South Africa (Ethics Reference No: 27/2018) and the Institutional Research and Ethics Committee (IREC) of Moi University/Moi Teaching and Referral Hospital in Kenya (Formal Approval No: IREC 2099). In addition, the National Commission for Science, Technology and Innovation (NACOSTI) provided research authorisation to undertake the research in Kenya (Reference No: NACOSTI/P/18/62894/21393). Permission to conduct the overall study was granted by the Ministry of Health in Kenya and relevant County health authorities.

Methodology for framework development

Development of the framework for improving PC-NTDs surveillance and response encompassed four main phases (Fig 1). The first phase involved conducting a systematic review of literature, which identified generalised but critical recommendations emerging from prior studies to improve disease surveillance and response systems in the African region. The second phase involved primary data surveys conducted in PC-NTD endemic regions in Kenya to assess performance of surveillance core, support and attribute functions. The third phase used a modified-Delphi survey to assess stakeholders’ consensus on the importance and feasibility of implementing recommended actions to improve PC-NTD surveillance and response at the sub-national level in Kenya. Lastly, the fourth phase involved a review of previous HIS and public health surveillance system conceptual frameworks to gain insights into the existing frameworks.

Fig 1. Framework development process.

Fig 1

Phase I: Systematic review of literature on surveillance system assessment studies [26]

The purpose for this phase was to systematically review both published and grey literature retrieved from the relevant online databases including PubMed, Web of Science, Scopus, Cumulative Index for Nursing and Allied Health Literature (CINAHL) and World Health Organisation Library and Information Networks for Knowledge (WHOLIS). The focus of the systematic literature review process was to search for studies assessing disease surveillance and response systems in the African region based on health workers’ perspectives (PROSPERO Registration number CRD42019124108) [26]. The review focused on the post-adoption phase of the revised IDSR system as from 2010 and onwards. A combination of keywords were used to search for relevant studies including “surveillance”, “public health surveillance”, “integrated disease surveillance and response”, “evaluation”, “assessment”, “health worker”, “healthcare personnel”, “Africa” and “Sub Saharan Africa”. The review aimed to assess key findings and recommendations to improve surveillance and response systems in the African region based on health workers’ perspectives.

Phase II: Primary data surveys on surveillance core, support and attribute functions concerning PC-NTDs [27,28]

The aim of this phase was to conduct two empirical studies in NTDs endemic regions in Kenya. The studies aimed to assess performance of surveillance functions concerning PC-NTDs as perceived by healthcare workers. The two studies intended to put focus on improving PC-NTDs surveillance within the existing IDSR system, which is in line with the strategic objectives outlined in the Second National Strategic Plan for Neglected Tropical Diseases and the National Breaking Transmission Strategy in Kenya [29,30]. The first study used a mixed method cross-sectional survey to assess surveillance system core and support functions relating to PC-NTDs [27]. Core functions were based upon indicators that measured the system processes and outputs including case detection, registration and confirmation of health related events, reporting, analysis and interpretation of surveillance data and public health action including reporting and feedback to users of the system. On the other hand, support functions facilitated implementation of surveillance core functions comprising of standards and guidelines, training, supervisory activities, communication, and human, technical and financial resources [31]. The study sites comprised of 10 purposively sampled counties from three distinct geographical regions in Kenya including Rift Valley (Baringo, Narok and West Pokot), Coast (Kwale, Kilifi, Lamu, Tana River and Taita Taveta) and Eastern (Kitui and Embu) regions, which are co-endemic of at least three or more fully mapped PC-NTDs. The health system in Kenya is organised into four distinct levels: Tier I, also referred to as community health services; Tier II, identified as primary care level comprising of dispensaries and sub-county healthcare facilities; Tier III comprising of county referral hospitals; and Tier IV that encompasses all national referral hospitals. The sub-national levels constitute county and sub county levels including level 5, level 4 and level 3 facilities while the peripheral levels comprise of level 2 health facilities and the community health units. Health personnel involved in the study were enrolled from the community (50), health facility (192) and sub-national (44) levels. Modified WHO generic questionnaires, observation checklists and interview schedules were used for data collection. Semi-structured questionnaires were used to obtain information from healthcare personnel responsible for surveillance data collection and transmission at the community, healthcare facility, sub-county and county levels. In addition, interview schedules were used to conduct key informant interviews with healthcare personnel overseeing disease surveillance related activities in the PC-NTD endemic counties (S1 File). Both quantitative and qualitative data were concurrently analysed and the findings were integrated. The second study aimed to evaluate surveillance system attributes based on health facility workers’ perceptions concerning PC-NTDs [28]. Surveillance attribute functions included: (i) simplicity (ease of operation of the surveillance system); (ii) acceptability (willingness of persons to be involved in activities within the surveillance system); (iii) stability (ability of surveillance system to be available and reliable when required); (iv) flexibility (ease of surveillance system to adapt to change of information needs and operating conditions with minimal additional resources); (v) usefulness (surveillance system contribution to control and prevention of adverse health-related conditions); (vi) data quality (accuracy of data collected within the surveillance system), (vii) surveillance data timeliness (how quick information is conveyed across levels of the surveillance system); and, (viii) completeness (expected essential data requirements compared to actual reporting) [31]. The study sites were similar to those selected in the first survey. The study adopted a descriptive cross-sectional health facility survey involving 192 health workers responsible for disease surveillance and response activities in NTD endemic regions in Kenya. Self-administered likert-type questionnaires were used to assess healthcare personnel perceptions of surveillance system attributes on simplicity, acceptability, stability, flexibility, usefulness, data quality and reporting timeliness and completeness with regard to PC-NTDs.

Phase III: Feasibility of implementing recommendations to improve PC-NTDs surveillance and response [32]

This third phase was based on a Delphi survey, which involved enrollment of key stakeholders at the sub-national level responsible for overseeing disease surveillance and response activities in Kenya [32]. The Delphi procedure is a scientific method that uses a series of rounds to gather individual expert opinions in order to reach a consensus among participants. To obtain group consensus, the structured approach uses a combination of questionnaires or iterative rounds to collect data [33,34]. The survey aimed to assess the principal and feasible recommendations derived from the preceding first and second phase. This phase guided selection of key constructs making up the framework in line with stakeholders’ opinions and inputs. Stakeholders constituted individuals that regularly utilise information generated by the surveillance system to take appropriate actions or make decisions influencing implementation of interventions and policy-making processes [35,36].

Phase IV: Review of relevant conceptual frameworks

In the fourth phase, a comprehensive review of existing HIS and public health surveillance system conceptual frameworks was undertaken. Retrieval of the relevant documents involved basic search strategies; electronic database search, a manual reference search of selected documents and use of a generic internet search engine. Literature searches were undertaken using PubMed, Web of Science, Scopus, Google Scholar and a free Google search to identify the relevant frameworks. The key search terms included: “conceptual framework”, “model”, “health systems”, “health information systems”, “public health surveillance systems”, “surveillance and response”. These terms were used in various combinations to ensure the literature search was extensive. A manual reference check of the included frameworks was conducted to identify additional frameworks that met the inclusion criteria. The inclusion criteria for the reviewed frameworks was a specific focus on HIS, disease surveillance or public health surveillance systems; included a diagrammatic representation of the conceptual framework; aimed to influence specific health policies or decisions; and written in the English language. This review involved critical assessment of components making up the frameworks. In addition, reviewing the framework components provided an understanding on the relevant interlinkages, which formed the basis for the proposed framework.

Data management and analysis

In the first phase, data synthesis for quantitative studies was conducted narratively while analysis of extracted data from qualitative studies was done using thematic synthesis. A matrix of main themes of surveillance functions guided the thematic synthesis with emerging sub-themes. In the second phase, analysis of data in the first study involved frequency computations and summaries of respondents’ socio-demographic characteristics, with bivariate analysis between categorical variables assessed using Pearson’s Chi Square test. Independent variables associated with the outcome in the bivariate analysis were incorporated in mixed effects logistic regression models. Qualitative data analysis identified the main themes based on a coding framework. In the second study, frequency distributions for each question in the five-point likert scale were analysed, while reporting rates were summarised using percentages and estimated median values. Internal consistency for the group of variables in each attribute domain was assessed using Cronbach’s Alpha. In the third phase, categorical variables were summarised using descriptive statistics while participant responses measured on a likert scale were reported using frequency distributions. Consensus was defined as >70% of participants either “agreeing” or “strongly agreeing” with the recommendation statements in each of the two rounds. Reliability and coherence between items in questionnaires used in both rounds were independently tested using Cronbach’s Alpha coefficient. In the final phase, narrative synthesis was utilised by thematically coding lessons drawn from the existing conceptual frameworks.

Results

Phase I: Systematic review of literature on surveillance system assessment studies [26]

Thirty studies met the inclusion criteria and were assessed to retrieve generalised recommendations to improve surveillance systems within the revitalised IDSR framework adopted by African countries. Eighteen emerging sub-themes were identified for recommendations specific to improving four core surveillance functions and three support functions. However, no specific sub-themes emerged from assessing the surveillance system attributes. The surveillance core functions included; case confirmation, reporting, data analysis and feedback. Surveillance support functions included; training, supervision and resources while surveillance system attributes included; reporting timeliness and completeness, data quality and accuracy, usefulness, acceptability, simplicity and stability. Other key recommendations alluded to adoption of alternative surveillance strategies and calls for further research to strengthen surveillance systems.

Main themes were based on elements constituting the broader surveillance functions–core, support and attributes–while 18 emerging sub-themes were derived from the recommendations [3764] (Fig 2). Other recommendations included; alternative surveillance strategies (electronic based surveillance [39,48,53,54,60,65], community based surveillance [45,61] and syndromic surveillance [65]) and further calls for research on surveillance [46,54,62].

Fig 2. Surveillance system functions (main themes and emerging sub-themes).

Fig 2

Phase II: Primary data surveys on surveillance core, support and attribute functions concerning PC-NTDs [27,28]

This first study identified specific recommendations to strengthen surveillance functions focusing on PC-NTDs within the existing IDSR system. There were eleven a priori identified main themes with up to 62 emerging sub-themes based on recommendations to improve PC-NTDs surveillance and response according to health workers’ perspectives. A high degree of groundedness was defined as sub-themes (recommendations) that were mentioned fifteen or more times (G ≥ 15) by the research participants under each main theme (S1 and S2 Tables). Recommendations to improve PC-NTDs surveillance core activities were categorised into 7 main themes and 32 sub-themes. The principal recommendations considering a high degree of groundedness included provision of simplified case definitions, improved laboratory capacity, provision of PC-NTDs reporting tools, timely and regular feedback on surveillance reports, adoption of electronic feedback mechanisms, improved data analysis skills and provision of adequate outbreak response supplies. On the other hand, recommendations to strengthen surveillance support activities comprised of 4 main themes and 30 sub-themes. Therefore, the main recommendations to improve support functions based on a high degree of groundedness encompassed provision of surveillance guidelines for supervision, properly constituted supervisory teams, regular supervision from higher levels, frequent provision of PC-NTDs updates, regular sensitisation and involvement of all health workers in surveillance activities, enhanced training on PC-NTDs surveillance, improved human resource capacity, provision of surveillance reporting and analysis tools, availing equipment and training materials, provision of adequate funding to facilitate surveillance activities and provision of reliable transportation.

The subsequent study showed that health workers perceived the surveillance system to be simple (55%), acceptable (50%), stable (41%), flexible (41%), useful (51%) and to provide quality surveillance data (25%). Health personnel experienced difficulties completing IDSR reporting forms with regard to PC-NTDs, easily understanding reporting guidelines and utilising PC-NTDs case definitions. Further, health workers were less satisfied with their involvement in facility-based surveillance activities. Health workers perceived PC-NTDs to be of low priority compared to other conditions and were only willing to be involved in surveillance activities of diseases considered of priority. However, community level health workers were more willing to support and be involved in PC-NTDs surveillance activities. Heath workers felt the existing IDSR system lacked flexibility with regard to being well adapted to report all PC-NTDs co-endemic in the region and easily adapting to changes in information needs, technological shift and funding. Furthermore, minimal adaptability of the existing surveillance system to changes in reporting mechanisms from paper-based to electronic systems was reported. Respondents further indicated low stability of the surveillance system in terms of adequacy of the available forms to report PC-NTDs, resource sufficiency and capacity of health managers to support surveillance activities and address challenges promptly. Health workers also reported that the surveillance system lacked usefulness in terms of generating sufficient PC-NTDs surveillance data to inform implementation of control interventions and influence sufficient donor support. In addition, respondents felt the surveillance system lacked capacity to provide adequate information to inform efficient public health actions in view of PC-NTDs. Health facilities sampled from the PC-NTDs endemic regions hardly met the 80% target reporting thresholds. Only about one-third of the facilities met this threshold in terms of reporting timeliness of monthly surveillance data and slightly more than a half of facilities met the threshold for completeness of monthly reports. Overall, considering a cut off attribute score of above 50%, findings showed health workers perceived the existing surveillance system to be simple, acceptable and useful with regard to PC-NTDs. However, respondents had low perceptions on the stability, flexibility and data quality of the surveillance system. Notably, there was a dwindling trend in monthly reporting timeliness and completeness rates by health facilities over a three-year period.

Phase III: Feasibility of implementing recommendations to improve PC-NTDs surveillance and response [32]

Findings from the Delphi survey indicated that stakeholders agreed on the importance of 56 (93%) recommendation statements and further reached consensus on the feasibility of implementing 47 (84%) recommended priority actions at the sub-national level. Stakeholders had a converging opinion on the importance and feasibility of implementing recommendations in six sub-domains relating to feedback, epidemic preparedness and response and those relating to four surveillance system attributes–simplicity, acceptability, stability and flexibility. However, there was lack of consensus on specific recommendations regarding the remaining six sub-domains on their importance or feasibility for implementation. Furthermore, sensitivity analysis that incorporated those participants with neutral responses indicated that the participants considered all recommendation statements to be of importance. Nevertheless, there was still non-consensus on the feasibility of availing disease-specific case registers, confirmation of all PC-NTDs cases, undertaking routine data analysis, increasing the number of supervisory visits at the lower levels, involving all health workers in surveillance training, retaining trained surveillance personnel and increasing the number of health workers responsible for overseeing surveillance activities at the sub-national level.

Phase IV: Review of relevant conceptual frameworks

The systematic search identified 10 records eligible for full-text review. However, only 6 distinct conceptual frameworks focusing on HIS and public health surveillance systems met the inclusion criteria for review (S3 Table). Critical lessons drawn from HIS conceptual frameworks alluded to stakeholders’ involvement, the organisational setting and technological aspects. Further, reviewed public health surveillance frameworks focused on performance indicators, disease-specific surveillance aspects and outbreak detection. Lessons learned from the reviewed conceptual frameworks alluded to stakeholders’ involvement, framework components and their interlinkage and disease-focused perspectives [1923,36].

Development of a framework to improve PC-NTDs surveillance and response

Framework development was informed by feasible recommendations derived from the third phase; in addition, to the lessons drawn from reviewing relevant conceptual frameworks. The proposed framework aimed to provide a logical approach hinged on the inputs, processes and outputs to enable decision makers institute evidence-based actions to achieve the intended outcomes and the desired impact [66]. A stakeholder-oriented approach was adopted throughout the framework development process to identify practically feasible recommendations for implementation and ensure utilisation of evidence-based research findings for decision-making [67]. The underlying assumption was that research findings can only be reliable to effectively influence the policy making process if they are endorsed by concerned stakeholders [67]. This assumption formed the basis for undertaking the third phase, which identified key components of the proposed framework. We also adopted the logical framework approach (LFA) as stipulated in the guide to monitoring and evaluating communicable disease surveillance and response systems [68]. The framework components were categorised based on their focus on input factors (resources), process factors (planned activities), output factors (short, medium and long-term benefits), outcome factors (intended results) and the overall impact factors [68]. Framework development was guided by findings from the first, second, third and fourth phases with the aid of a logical component matrix to identify the interrelation between the derived themes (Table 1). The proposed framework intended to strengthen implementation of the core medical interventions for PC-NTDs control; preventive chemotherapy and intensified CF and disease management [9,69].

Table 1. Logical framework component matrix.

Phase II: Primary data studies Logical framework components (Paraphrased statements) Component III: Output themes Component IV: Outcome themes Phase I: Systematic literature review themes Phase III: Feasible actions (Yes/No) Phase IV: Reviewed conceptual frameworks themes
Early detection and effective response action Improved data accuracy and quality Efficient surveillance data transmission
Component I: Inputs
Input I: Resources–tools, equipment and infrastructure
Availing case registers*
All diseases are recorded in a common register due to lack of specific case registers for registration of NTDs presenting at the facilities
Provision of disease registers specific for NTDs across all surveillance levels requires additional resources
Accurate case registration and reporting - No Framework component (Input)
Increased laboratories at lower surveillance levels*
Supervisory team recommend specimen collection and forwarding to sub-county level for confirmation
Improved case confirmation capacity - - Strengthened laboratory support No Framework component (Input)
Adoption of electronic reporting tools
Having adopted electronic reporting systems in the previous years has enabled timely data transmission
Having an electronic reporting system at the facility level would ease reporting and eliminate the burden of physically submitting surveillance reports
Accurate case registration and reporting - - Improved reporting Yes Framework component (Input)
Clearly formulated action thresholds
Action thresholds guide health workers on when to implement certain measures such as school-based deworming exercises
Preset action thresholds for NTDs are hardly utilised with priority given to notifiable conditions
NTDs action thresholds are not well understood among health workers due to limited knowledge on data analysis
Improved epidemic preparedness and response - - - Yes Framework component (Input)
Adequate data analysis tools and equipment
Health workers need to be provided with sufficient guidelines to motivate conducting data analysis frequently
Lack of appropriate data analysis tools affects the frequency of conducting analysis of surveillance data collected
Strengthened data analysis - Improved data accuracy Yes Framework component (Input)
Provision of updated outbreak preparedness and response protocols
Preparedness for epidemics can be improved by providing the appropriate outbreak preparedness plans and manuals
Improved epidemic preparedness and response - - - Yes Framework component (Input)
Formulation of supervisory schedules for surveillance activities
We require a formal supervision plan specific for monitoring surveillance activities throughout the year
Lower levels lacked specific schedules for supervision and only conduct visits whenever a need arises
Enhanced supervision of surveillance activities - Strengthened implementation of surveillance system activities Yes Framework component (Input)
Availing adequate training materials and equipment across all surveillance levels
Low priority is given to distributing training materials to improve capacity of health workers on PC-NTDs surveillance
Training materials tend to be sufficiently provided at higher level facilities but with limited provision at the lower facility levels
Enhanced resource capacity to support surveillance activities - Yes Framework component (Input)
Availing electronic communication equipment for transmission of surveillance data
Electronic communication mechanisms will ensure feedback is relayed in a timely manner
Inadequate and non-functional electronic equipment limit transmission of surveillance reports
Improved training coverage on surveillance activities
Enhanced resource capacity to support surveillance activities



Improved surveillance data quality Yes Framework component (Input)
Components interlinkage
Input II: Resources—financial, technical and logistical support
Provision of an adequate number of skilled laboratory personnel
Community levels lack capacity to confirm suspected PC-NTD cases due to the unavailability of trained laboratory personnel
NTD endemic regions have limited number of well-trained laboratory staff with skills for case confirmation
Improved case confirmation capacity - - Improved specimen handling Yes Framework component (Input)
Enhanced training on surveillance data analysis
Lack of skills and knowledge to adequately conduct data analysis of surveillance data.
Further training on surveillance data analysis is required since most health workers only have the basic skills for analysis of surveillance
Strengthened data analysis
Improved training coverage on surveillance activities


-
Improved surveillance data quality
Yes Framework component
(Input)
Components interlinkage
Emergency supplies to respond to probable outbreaks
Lack of adequate supplies pose a challenge to health workers in terms of responding to outbreaks
More resource support in terms of supplies is required for adequate response to PC-NTDs epidemics
Improved epidemic preparedness and response
Enhanced resource capacity to support surveillance activities

-
-
- Yes Framework component (Input)
Increased funding to support PC-NTDs surveillance activities
Availing funds to facilitate the trainings for health workers
Budget allocations hardly factor in funds specific for conducting NTDs surveillance activities
Provision of adequate funds to facilitate conducting the supervisory visits at the lower levels
Lack of funds to adequately cover transportation costs
Enhanced resource capacity to support surveillance activities - Yes Framework component (Input)
Improved transport and logistical support to facilitate surveillance activities
Lack of adequate resources to transport specimen to the next level for confirmation
Unreliable means of transport affects timely transfer of NTD samples from the lower levels
Enhanced resource capacity to support surveillance activities - Yes Framework component (Input)
Increasing the number of health workers involved in surveillance activities*
Having health staff designated to handle surveillance activities and reports submission at the facility level
Enhanced resource capacity to support surveillance activities - No Framework component (Input)
Component II: Process
Process I: Strengthening existing surveillance tools
Update surveillance guidelines currently in use
Lack of up-to-date guidelines to efficiently identify and report PC-NTDs cases
Improving data analysis skills through provision of updated guidelines and training manuals for conducting analysis of surveillance data
Laboratory personnel require up-to-date case confirmation guidelines
Accurate case registration and reporting
Improved case confirmation capacity
Strengthened data analysis



-

-
-
Improved reporting
Improved data accuracy
Yes Framework component (Process)
Components interlinkage
Update the available PC-NTDs case definitions currently in use
Provision of updated standard case definition guidelines for effective case identification and notification
Need for clear visual aids and posters for NTDs standard case definitions to be displayed at the health facility level
Accurate case registration and reporting - Yes Framework component (Process)
Listing all PC-NTDs in the existing reporting forms
NTDs are still neglected in the available reporting form; not listed in the summary forms signifying lack of priority
Reporting NTDs as “other” conditions creates a low perception on their importance and influences health workers’ reporting attitudes
Accurate case registration and reporting
Prioritisation of PC-NTDs surveillance activities



Adequacy of reporting forms provision Yes Framework component (Process)
Process II: Strengthening existing surveillance core activities
Confirmation of all PC-NTDs at the lower surveillance levels*
Peripheral level facilities lack laboratories and have inadequate equipment for NTDs specimen collection, storage and transportation
Improved case confirmation capacity - - - No Framework component (Process)
Properly equipping laboratories at the health facility level to improve PC-NTDs case confirmation
Require fully equipped laboratories with trained laboratory personnel at the lower levels
Facilities lack updated case confirmation guidelines and adequate laboratory reagents to confirm PC-NTDs
Improved case confirmation capacity - - - Yes Framework component (Process)
Ensuring reporting forms are always readily available across all surveillance levels
Always having reporting forms available at the facility level will ensure timely reporting
Timely transmission of surveillance data is dependent on the availability of reporting forms
Accurate case registration and reporting - Yes Framework component (Process)
Availing updated reporting guidelines
Surveillance forms need to have specific provision for NTDs as opposed to reporting them as other conditions
Need to update IDSR guidelines and reporting forms for capturing NTDs that are prevalent in the region
Accurate capture of NTDs requires modified reporting forms
Accurate case registration and reporting Improved reporting
Identification of correct reporting channels
Yes Framework component (Process)
Immediate reporting of PC-NTD cases*
Lack of reporting tools makes notification of NTDs cases challenging
Improved communication channels at the peripheral levels would improve notification of suspected PC-NTD cases
Accurate case registration and reporting
Prioritisation of PC-NTDs surveillance activities
Improved epidemic preparedness and response




-


-
Identification of correct reporting channels No Framework component (Process)
Allocate adequate time for surveillance reports preparation and submission to the next levels
Preparing surveillance reports becomes time-consuming especially with other competing tasks
Accurate case registration and reporting Improved reporting Yes Framework component (Process)
Prioritising PC-NTDs data analysis
Deployment of health workers knowledgeable on data analysis and management
Increased sensitisation and regular training of health workers on conducting data analysis
Strengthened data analysis
Prioritisation of PC-NTDs surveillance activities


-
Improved data accuracy
Yes Framework component (Process)
Components interlinkage
Analysis of PC-NTDs data on a routine-basis*
Data analysis is not routinely done because health workers lack the adequate skills
Availing the relevant electronic equipment will facilitate conducting routine data analysis
Strengthened data analysis - Surveillance system performance monitoring No Framework component (Process)
Periodic trend analysis of PC-NTDs reported cases*
Frequent data analysis will enable assessment of disease trends
Surveillance data collected is not sufficient to conduct trend analysis
Strengthened data analysis - Surveillance system performance monitoring No Framework component (Process)
Prioritising feedback regarding PC-NTDs surveillance data
Frequent feedback on reports submitted to higher levels will motivate health workers to improve reporting
Written feedback enables effective referencing and ensures health workers use the reports as guidelines for taking action
Improved feedback on surveillance data
Prioritisation of PC-NTDs surveillance activities
-

-
Improved health workers’ attitudes Yes Framework component (Process)
Provision of timely and regular feedback on reported PC-NTDs surveillance data
Timely and complete feedback improves health worker reporting performance
Receiving regular feedback on submitted reports shows the health workers that their reports are valued and appreciated
Improved feedback on surveillance data - - Improved health workers’ attitudes Yes Framework component (Process)
Adoption of improved electronic feedback mechanisms
Need to improve feedback mechanisms by adapting electronic methods to ensure timely feedback
The existing mechanisms for relaying feedback on surveillance reports to the lower levels need improvement
Improved feedback on surveillance data
Enhanced resource capacity to support surveillance activities
-

-
Enhanced feedback from higher to lower surveillance levels Yes Framework component (Process)
Components interlinkage
Increased feedback on PC-NTDs to lower surveillance levels
Feedback reports from higher levels should be relevant to lower surveillance levels; feedback needs to be specific to surveillance activities undertaken at the facility generating the reports
Lack of reliable feedback mechanisms to the lower levels
Improved feedback on surveillance data - - Enhanced feedback from higher to lower surveillance levels Yes Framework component (Process)
Well-constituted outbreak response teams to respond to probable PC-NTDs outbreaks
Having properly constituted outbreak response teams in the region will improve control and response to NTD epidemics
Improved epidemic preparedness and response
Prioritisation of PC-NTDs surveillance activities

-
-
- Yes Framework component (Process)
Process III: Strengthening existing surveillance support activities
Prioritising supervision of PC-NTDs surveillance activities
The agenda of supervisory visits are hardly specific to PC-NTDs surveillance activities; priority given to notifiable conditions
Enhanced supervision of surveillance activities
Prioritisation of PC-NTDs surveillance activities
-


Strengthened implementation of surveillance system activities Yes Framework component (Process)
Regular supervision of PC-NTDs surveillance activities at the lower levels*
Increasing the frequency of supervision of surveillance activities especially at the lower levels
Regular supervisory visits at lower levels to monitor use of updated guidelines and surveillance tools
Enhanced supervision of surveillance activities - Utilisation of up-to-date information No Framework component (Process)
Properly constituting supervisory teams to adequately supervise PC-NTDs surveillance activities
Supervisory teams to always comprise of surveillance focal persons
Supervisory teams need to be knowledgeable on PC-NTDs to accord them priority
Enhanced supervision of surveillance activities
Prioritisation of PC-NTDs surveillance activities
-


- Yes Framework component (Process)
Increased community level participation to support supervision of PC-NTDs surveillance activities
Lack of functional community health units and demoralised community-based health workers sometimes unwilling to get involved in surveillance activities
Community health units are fundamental to having a functional surveillance system at the community level
Regular supervision at the lower levels will improve surveillance activities being conducted at this levels and enhance active case finding
Enhanced supervision of surveillance activities - Strengthened implementation of surveillance system activities Yes Framework component (Process)
Prioritising PC-NTDs in surveillance training
Health worker sensitisation on surveillance data analysis in PC-NTD endemic regions
There is rarely any formal training specific to NTDs or their surveillance activities
Training needs assessment for NTD surveillance should be conducted frequently
Need for increased resource support for post-basic training on NTDs
Improved training coverage on surveillance activities
Prioritisation of PC-NTDs surveillance activities



Improved surveillance data quality Yes Framework component (Process)
Regular training on PC-NTDs surveillance activities
Frequent training enables health workers to easily and consistently apply the available case definitions for NTDs
More training and awareness among health workers on conducting analysis of NTDs surveillance data is required
Regular training will ensure that supervisory visits are conducted in a standardised manner reviewing all disease surveillance activities
Important to have on-job trainings and sensitisation of health workers on supervisory activities at the lower levels
Accurate case registration and reporting
Enhanced supervision of surveillance activities
Improved training coverage on surveillance activities

-




Improved surveillance system performance
Enhanced knowledge on surveillance systems
Utilisation of up-to-date information
Yes Framework component (Process)
Components interlinkage
Involvement of all health workers in training on PC-NTDs surveillance activities
Not much priority is given to training of lower level health workers coupled by minimal effort by trained staff to cascade knowledge to other staff at peripheral levels
Involvement of all health workers in surveillance training ensures their needs are met and they receive the relevant up-to-date information
Improved training coverage on surveillance activities Enhanced knowledge on surveillance systems No Framework component
(Process)
Stakeholders’ involvement
Retaining trained surveillance staff across all surveillance levels*
Retention of trained staff ensures consistency in conducting surveillance activities
Improved training coverage on surveillance activities Improved surveillance system performance No Framework component (Process)
Improving telecommunication channels for data transmission
Having reliable communication channels will ensure that surveillance activities are well coordinated
Unreliable communication channels lead to delays in follow-ups on surveillance data
Adopting electronic communication channels at the lower levels will improve reporting
Accurate case registration and reporting
Enhanced resource capacity to support surveillance activities



- Yes Framework component (Process)
Components interlinkage
Improved means of transportation to facilitate surveillance activities
Unreliable transportation leads to delays in sending specimens to higher levels
Transportation challenges hinder supervisory activities
Enhanced resource capacity to support surveillance activities - Yes Framework component (Process)
Process IV: Strengthening surveillance system attributes
Simplification of existing guidelines for completing reporting forms is required
Training of health workers is required on application of the guidelines and reporting tools
Accurate case registration and reporting
Improved perception to surveillance system



Improved reporting
Simplicity
Yes Framework component (Process)
Simplifying available forms to ease reporting of PC-NTDs
Need for surveillance tools that are elaborate and easily understood by health workers to encourage reporting
Lower levels lack simplified tools to motivate reporting
Reporting of PC-NTDs could have been made easier if the reporting tools accommodated all the diseases
Accurate case registration and reporting
Improved perception to surveillance system



Adequacy of reporting forms provision
Simplicity
Yes Framework component (Process)
Components interlinkage
Simplifying PC-NTDs case definitions to ease application
Majority of health workers in the lower levels lack knowledge on NTDs case definitions; making it difficult for them to report the diseases
Improved perception to surveillance system
Prioritisation of PC-NTDs surveillance activities



Simplicity
Yes Framework component (Process)
Simplifying methods for PC-NTDs surveillance data collection and analysis
Data collection using the available tools is not efficient and easy to undertake; we require improved tools for reporting PC-NTDs
Strengthened data analysis
Improved perception to surveillance system



Simplicity Yes Framework component (Process)
Health managers to support surveillance activities in the region
Limited resource support for conducting surveillance activities influences health worker attitudes towards getting involved in surveillance activities
The system lacks acceptability among health workers due to lack adequate tools and resources to report and respond to NTDs
Improved perception to surveillance system
Prioritisation of PC-NTDs surveillance activities



Acceptability Yes Framework component (Process)
Stakeholders’ involvement
Considering PC-NTDs to be of public health importance in the region
NTDs are considered less important; this demotivates health worker involvement in surveillance activities concerning the diseases
PC-NTDs need to be prioritised from the highest to the lowest levels for effective surveillance to achieved
Prioritisation of PC-NTDs surveillance activities Acceptability Yes Framework component (Process)
Disease-specific perspective
Addressing challenges facing PC-NTDs surveillance activities with minimal delays
Health management need to respond promptly to challenges faced while undertaking surveillance activities
Improved perception to surveillance system
Prioritisation of PC-NTDs surveillance activities



Stability Yes Framework component (Process)
Disease-specific perspective
Existing surveillance systems to be well adapted to reporting all PC-NTDs in the region
Surveillance system prioritise reporting of diseases considered to be notifiable; therefore, not flexible to efficiently report other conditions such as NTDs
Improved perception to surveillance system
Prioritisation of PC-NTDs surveillance activities



- Yes Framework component (Process)
Disease-specific perspective
Existing surveillance systems to adapt easily to changes in PC-NTDs information needs
The surveillance system does not easily adapt to the changing NTDs distribution patterns; we hardly receive any updates on the diseases
Improved perception to surveillance system
Prioritisation of PC-NTDs surveillance activities



- Yes Framework component (Process)
Disease-specific perspective

*—Recommendation actions that lacked consensus among stakeholders on their feasibility for implementation

√—Denotes an existing link to the concerned theme category

-—Denotes lack of an existing link to the concerned theme category

The first step to developing the proposed framework involved analysing the required inputs. The existing surveillance and response system requires resource mobilisation through injection of inputs to facilitate the planned work in view of NTDs amenable to chemoprophylaxis at the sub-national levels. Therefore, stakeholders’ consensus on the feasible inputs were categorised into two sub-domains with the first being a combination of surveillance tools, equipment and infrastructure including; data analysis tools and equipment such as computers with pre-loaded analysis software, clearly formulated action thresholds, outbreak preparedness and response protocols and guidelines, surveillance activities supervisory schedules, training materials and electronic communication devices. The second sub-domain combined financial, technical and logistical support including; increased funding allocation to support surveillance activities, enhanced training on data analysis, provision of sufficient emergency supplies for outbreak response, reliable transportation and other logistical support.

The second step involved identification of practically feasible processes. The activities were categorised into four sub-domains; (i) strengthening existing surveillance tools, (ii) surveillance core activities, (iii) surveillance support activities, and (iv) surveillance system attributes concerning PC-NTDs. Actionable processes for strengthening the existing surveillance tools included; updating surveillance guidelines and the available standard case definitions currently in use and inclusion of all PC-NTDs in the reporting forms. Processes to strengthen the core activities in view of PC-NTDs included; fully equipping health facility level laboratories, availing updated reporting guidelines, ample time allocation for surveillance reports preparation and submission, enhanced PC-NTDs data analysis, provision of regular and timely feedback, adoption of electronic feedback mechanisms, increased feedback to lower levels and properly constituting outbreak response teams. Additionally, activities to strengthen support activities included; prioritising supervision of PC-NTDs surveillance activities, adequately constituting the supervisory teams, increasing community level involvement in supervisory activities, prioritising and conducting regular PC-NTDs surveillance training, improving telecommunication channels for data transmission and improving access to reliable transportation when undertaking surveillance activities. Lastly, processes to strengthen surveillance attributes regarding PC-NTDs included; simplification of existing reporting guidelines, reporting forms, standard case definitions, and data collection and analysis procedures, increased support for surveillance activities by health managers, consideration of PC-NTDs as conditions of public health importance, addressing surveillance activity challenges with minimum delays, ensuring surveillance systems are well-adapted to reporting all PC-NTDs and easily adapt to changes in information needs.

Consequently, inputs and processes in the planning phase facilitate achieving the intended results with anticipated outputs comprising; accurate case registration and reporting of PC-NTDs, improved case confirmation capacity, strengthened data analysis, improved feedback on surveillance data, improved epidemic preparedness and response, enhanced supervision of surveillance activities, improved training coverage on surveillance activities, enhanced resource capacity to support surveillance activities, improved health worker perceptions towards the surveillance system and prioritisation of PC-NTDs surveillance activities. Resultantly, the outcomes were thematically categorised into three sub-domains, which were linked to the likelihood of achieving either short, medium or long-term outcomes. The short-term outcome alluded to efficient transmission of surveillance data within the existing surveillance system while the medium-term outcome would result to improved surveillance data quality and lastly, the long-term outcome would be early detection and effective response action towards PC-NTDs. The overall impact of the resulting outcomes would be accurate estimation of disease burden, effective identification of disease transmission hotspots and implementation of targeted and cost-effective interventions.

The framework identified the intended results as a by-product of the input and process components making up the initial planned work phase (Fig 3). Consequently, the outputs were linked to one or more anticipated outcomes for strengthening PC-NTDs surveillance and response (Fig 4). First, to achieve the short-term outcome regarding efficient surveillance data transmission and improved data accuracy required enhanced supervision of surveillance activities. Moreover, achieving the medium-term outcome relating to improved surveillance data accuracy and quality relied on strengthened data analysis, improved feedback on surveillance data and enhanced support supervision. Lastly, attaining the long-term outcome of early disease detection and effective response action relied on improved case confirmation capacity, reinforced data analysis and improved epidemic preparedness and response action. Overall, all the three anticipated outcomes–short-term, medium-term and long-term–relied on accurate case registration and reporting, improved training coverage on surveillance, enhanced resource provision, improved health worker perceptions towards the surveillance system and prioritising PC-NTDs surveillance activities. The proposed framework further linked the combination of efficient surveillance data transmission and improved data accuracy and quality to the impact component on accurate estimation of reduced disease burden. Additionally, improved surveillance data accuracy and quality, early disease detection and effective response action were linked to effective identification of disease transmission hotspots. Lastly, the framework identified a link between a combination of short and medium term outcomes to implementation of targeted and cost-effective interventions as an impact component.

Fig 3. Draft framework for improving PC-NTDs surveillance and response.

Fig 3

Fig 4. Draft schematic illustration of component interlinkages in the intended results phase.

Fig 4

Framework validation

The purpose of framework development was to propose a logical approach for strengthening specific surveillance functions at the sub-national level to improve PC-NTDs surveillance and response. Therefore, a multi-phased approach was utilised to validate the proposed framework using: (i) consultative meetings with stakeholders at the sub-national and national levels and (ii) presentation of the draft framework in a conference meeting constituted of NTD researchers and policy experts. The aim of the consultative discussions was to review the draft framework components based on the expertise and experiences of healthcare stakeholders and decision makers. In addition, presentation of the draft framework in a scientific forum was intended to obtain further inputs to improve the framework components and assess scalability and adoptability of the framework especially at the sub-national level based on NTD research experts’ opinions. The validation process presented an opportunity to ascertain the accuracy of information underpinning the draft framework and identified key points for framework refinement. The process allowed participants to comment freely on the framework components in an open forum, which allowed for extensive discussions and drew out diverse stakeholder and expert opinions.

Validation process for the proposed framework

Phase I

The stakeholders’ consultative meetings at the sub-national level were conducted in two NTD endemic counties in Kenya. These counties included Baringo and West Pokot, which were purposely selected based on high prevalence of at least three co-endemic PC-NTDs in the regions. Fifteen participants from Baringo (9) and West Pokot (6) counties were enrolled in the validation exercise with representation from both county and sub-county levels. The participants comprised of directors of health, disease surveillance coordinators, epidemiologists, health information and records officers, NTD coordinators, public health officers and other key sub-national health stakeholders. In addition, stakeholder consultations ensued with relevant stakeholders drawn from the national disease surveillance unit (4) and the national NTD programme (3) in Kenya.

The consultative sessions first involved a larger group of participants, whereby the researcher provided a brief background to the framework and described the framework development process. In addition, participants were briefed on the core aim of developing the framework, framework components and their interlinkage. Participants were provided with copies of the draft framework, framework development process including the framework component matrix (Table 1) and a detailed illustration of framework components interlinkage. Subsequently, small group discussions of 3–5 participants were formed to further discuss and determine: (1) if the components of the framework required improvements or changes (2) whether the framework presented a logical flow of ideas and (3) the practicability of adopting the framework considering surveillance system capacity and accessible resources at the sub-national level. Broader forums were later reconstituted, involving all participants to further deliberate and reach consensus on resulting outcomes that emanated from the smaller groups.

Resolutions from the consultative sessions were used to improve the draft framework to its final status. The concerned stakeholders reached a number of resolutions on specific framework components (Table 2). First, thematic sub-categories were established in the planned work phase of the framework. These sub-categories were in line with the broader themes of human, technical and organisational components. Specific sub-themes making up the inputs and processes included human resource management, data management, standards and guidelines, tools and equipment, communication, resource support, surveillance activities management and surveillance system attributes. Secondly, the short-term outcomes were revised to include efficient transmission of surveillance data and improved data accuracy. Medium-term outcomes involved early disease detection and response action and improved surveillance data quality. Lastly, long-term outcomes included; improved implementation of targeted and cost-effective interventions, enhanced identification of disease transmission hotspots, and improved estimation of overall disease burden. Furthermore, long-term outcome components were linked to target interventions. For instance, enhanced identification of disease transmission hotspots was a desired long-term outcome, which was linked to intensified CF. Thirdly, impact components were revised to signify sustainable efforts resulting from the long-term outcomes towards achieving the ultimate goal of PC-NTDs elimination. Therefore, the overall impact components were reviewed to include reduced costs for implementing PC interventions, halted disease transmission and reduced disease burden relating to PC-NTDs. Fourthly, a link was established between specific medical interventions associated with framework components. Therefore, the framework was shown to target improvement of PC and intensified disease management (IDM) interventions. Moreover, impact components of the framework were linked to the ultimate goal of disease elimination as outlined in the NTD roadmap and in achieving the third SDG [70,71]. Further resolutions alluded to illustrating how the “planned work” phase led on to the “intended results” phase using a directional arrow. Lastly, participants at the sub-national level endorsed the framework as identifying feasible actions for strengthening specific surveillance functions in relation to PC-NTDs.

Table 2. Framework validation resolutions.
Participants Number of participants Validation session output
Baringo County (face-to-face and partly virtual) - Distinct thematic categories to be identified in line with human, technical and organisational components to merge common activities of the planned work phase of the framework.
- The framework needed to illustrate how “PC-NTD Elimination” is linked to the overall impact components. Participants suggested that the impact components of the framework should have a clear link to achieving the ultimate goal of disease elimination.
- Stakeholders identified the need for indicating the target interventions to illustrate the logical link between the specific interventions and framework components.
- Participants identified the need for reclassifying the outcome components to derive feasible short-term, medium-term and long-term outcomes.
- Participants considered the framework to be an essential instrument to guide logical decision-making and recommended adoption at county level.
County Director of Health 1
County Epidemiologist 1
County Disease Surveillance Coordinator 1
County Public Health Officer 1
County Health Systems Manager 1
County Monitoring and Evaluation Officer 1
County Special Programmes Coordinator 1
Sub-county Disease Surveillance Coordinator 1
Sub-county Health Records and Information Officer 1
West Pokot County (face-to-face and partly virtual) - Participants expressed the need for the framework to illustrate how the first phase of “planned work” led to the “intended results” phase using a directional arrow.
- The framework needed to clearly illustrate how it is focused on strengthening the two core medical interventions for PC-NTDs.
- Participants suggested the need to revise impact components to portray sustainable achievements following from attaining the long-term outcomes.
- Impact components needed to be linked to the key target of NTDs elimination–by ending epidemics resulting from the diseases–as outlined in the third Sustainable Development Goal.
- Participants endorsed all framework components and supported adoption of the framework to guide decisions to improve PC-NTDs surveillance and response at the sub-national level.
County Director of Health 1
County Disease Surveillance Coordinator 1
County Public Health Officer 1
County Health Records and Information Officer 1
Sub-county Disease Surveillance Coordinator 1
Sub-county Health Records and Information Officer 1
National level (face-to-face and partly virtual) - Participants identified need for sub-national stakeholders to formulate detailed log frames to provide clear guidelines to achieving the desired outcomes and impact.
- The schematic illustration of intended results phase needed revision to illustrate the interlinkage between outcomes and impact components for clarity of the final phase.
- All participants supported adoption of the framework at the sub-national level to guide resource allocations and for use in prioritising implementation of activities to improve PC-NTDs surveillance and response.
National disease surveillance unit 4
National NTD programme 3
Royal Society of Tropical Medicine (RSTMH) Research in Progress Meeting (fully virtual) - Participants indicated that the outcomes were to be interrelated with specific disease interventions.
- A common resolution among participants was that the desired outcomes and impact components needed rephrasing to depict sustainable efforts.
- Participants endorsed the framework as providing a logical approach to improving specific surveillance functions with a clear link to the targeted interventions.
Participants comprised of researchers, academicians and policy experts >250

On the other hand, framework validation at national level included a schematic illustration of the intended results phase focusing on the interlinkage between desired outcomes and impact components. Moreover, the logical framework was supplemented with detailed log frames for the desired impacts to be realised. The log frames for achieving the three distinct impact components constituted objectively verifiable indicators, sources of information, inputs (resources) and relevant assumptions (S4, S5 and S6 Tables). Log frames formulated through consultations with concerned stakeholders depicted that the overall impact of disease elimination was achievable through an integrated approach. This meant consolidating various inputs and processes at the planned work phase to achieve the intended results and outcomes. Essentially, stakeholders agreed that the framework offered a logical approach to improve PC-NTD surveillance and response from the initial planned work phase to achieving the intended results and the ultimate goal of disease elimination.

Phase II

The framework development process was further presented in a virtual conference meeting in the form of a research poster. The forum was partly composed of breakout sessions that enabled extensive discussions of the framework components with various NTD researchers and policy experts. An interrelation was established between the desired outcomes and the concerned disease interventions, similar to stakeholder resolutions in the first phase. The interlinkage provided a clear link between implementing specific control interventions and achieving the overall goals. Additionally, impact components were rephrased to portray “sustained” control efforts even post-elimination. Lastly, participants agreed that the framework provided a logical approach to guide stakeholders’ actions to achieve improved PC-NTDs surveillance and response in endemic settings (Fig 5). Stakeholder consultations in both phases aided in identifying critical interlinkages between the long-term outcomes and impact components in various combinations (Fig 6). First, improved implementation of targeted and cost-effective PC interventions, in addition to enhancing identification of disease transmission hotspots through active CF would have an overall impact of reducing costs for implementing treatment interventions. Secondly, identification of disease transmission hotspots and improved estimation of overall disease burden would inform effective implementation of PC interventions and intensify disease management, which would contribute to halted disease transmission. Finally, a combination of all long-term outcomes on implementation of targeted PC interventions, identification of disease transmission hotspots through active CF and improved estimation of overall disease burden to inform IDM would achieve reduced disease burden relating PC-NTDs. The overall impact of reduced costs for treatment interventions, halted disease transmission and reduced disease burden contribute towards achieving sustainable PC-NTDs elimination.

Fig 5. Final validated framework for improving PC-NTDs surveillance and response.

Fig 5

Fig 6. Final schematic illustration of component interlinkages in the intended results phase.

Fig 6

Discussion

We developed a logical framework for guiding implementation of recommendations to improve surveillance and response to NTDs amenable to chemoprophylaxis. The framework was grounded on existing conceptual frameworks and adopted a stakeholder-oriented approach to determine the framework components and their interlinkage [2123,67]. The feasible actions identified in the third phase of framework development were assessed and categorised as either constituting input or process components. The outputs, outcomes and impact components were thematically derived from reviewed literature in the first phase and analysis of participants’ open-responses in the second and third phases. Recommendations drawn from Phases I, II and III were incorporated into a logical component matrix to assess interdependence between the inputs, processes, outputs, outcomes and overall impact. Furthermore, we utilised the W. K. Kellogg Basic Logic Model to derive key constructs and themes as described by concerned health stakeholders [66]. The logic model provides a systematic and visual course of action to recognise the link between resources or inputs, planned activities and the intended results [66].

Implementation of interventions involving multiple diseases is imperative and cost-effective especially in NTD endemic regions as opposed to parallel disease-specific strategies [72]. The WHO categories twenty diseases and conditions to constitute NTDs with two distinct control measures; those diseases that are amenable to preventive chemoprophylaxis and those tackled through case management (CM) [7,9]. The focus of the current framework was on NTDs mainly controlled through PC interventions including lymphatic filariasis (LF), schistosomiasis, trachoma and soil transmitted helminth (STH) infections. Nonetheless, effective control of some of the PC-NTDs including LF and trachoma requires IDM [9,17]. Furthermore, WHO recommends five key strategies for prevention, control, elimination and eradication of NTDs [72,73]. These strategies include PC and IDM, which are the core medical interventions for curbing NTDs transmission. The other cross-cutting strategies include vector and intermediate host control, veterinary public health and provision of safe water, sanitation and hygiene [73]. Therefore, the present framework intended to link strengthened surveillance and response systems to the two core medical intervention strategies to achieve effective PC-NTDs control.

In the first phase of framework development, the systematic review revealed a dearth in surveillance assessment studies conducted in African countries with a focus on NTDs, which informed the second phase involving primary data surveys undertaken in an NTD endemic setting. An assessment of surveillance core, support and attribute functions regarding PC-NTDs targeted for control and elimination identified critical recommendations to improve their surveillance and response in Kenya. The third phase was aimed at assessing feasibility of implementing actions to improve PC-NTDs surveillance and response as perceived by healthcare workers in the second phase and generalised recommendations retrieved from the first phase. Consequently, the proposed framework components were informed by findings emerging from the three phases and a review of relevant conceptual frameworks, which formed the base for developing the current framework. Existing strategic plans focused on NTDs control and elimination formed the blueprint for framework development [29,30,73,74]. The framework looks to contribute towards efforts aimed at accelerating programmatic actions to control and eliminate NTDs as outlined in the recently launched Roadmap for NTDs 2021–2030 [70]. Essentially, the framework is inclined to improving the efficiency of medical interventions relating to implementation of PC, which is considered the safest and most effective intervention for controlling PC-NTDs. In addition, achieving NTDs-related morbidity reduction requires IDM, which involves early disease detection through active CF, treatment and clinical management critical to NTDs control and elimination [9].

A critical input of the framework was the provision of updated surveillance guidelines, which corresponds to meeting NTD elimination targets by way of providing standardised guidelines essential for systematic collection of population-based data [75]. Furthermore, utilisation of WHO-approved guidelines aids disease mapping, monitoring and post-MDA surveillance approaches [75]. On the other hand, implementation of integrated and targeted PC interventions are largely impeded by the lack of complete data [76]. Hence, improving the existing reporting forms to ensure accurate and complete reporting of PC-NTDs is justified. There are no standardised methods for collecting PC-NTDs morbidity data except through baseline surveys during MDA campaigns [77]. However, morbidity data collected while concurrently conducting MDA usually lack quality and accuracy [78]. This affects effective implementation of NTD-targeted morbidity management strategies in endemic regions [77]. Furthermore, countries requiring validation and eventual certification as having eliminated specific NTDs need to accurately estimate the number of cases in endemic regions at the implementation unit level and monitor morbidity management and disability prevention (MMDP) [78]. This requirement corresponds to the framework’s long-term outcome on improved estimation of overall PC-NTD burden.

A major challenge facing PC-NTDs control and elimination agenda in Kenya is minimal national and sub-national ownership of planned actions with most funding support for implementing interventions coming from development partners. In addition, limited involvement of local health stakeholders in NTDs control activities presents a pivotal sustainability challenge [30]. However, the validated framework components were identified based on convergence of opinion among various stakeholders. Stakeholder involvement and consensus is vital in guiding HIS strengthening and informing key healthcare decisions [20,21]. Analogous to the framework components, critical outcomes from the ‘First Forum on Surveillance-Response System Leading to Tropical Disease Elimination’ held on June 16–18, 2012 in Shanghai, identified key features influencing effective surveillance and elimination of NTDs [79]. These factors alluded to political will and good governance, commitment to utilise available resources to support disease elimination efforts, an established organisational and technical infrastructure with a competent health workforce, reliable healthcare services delivery and community involvement [79,80]. Therefore, critical elements of the validated framework are in line with meeting key targets to achieve NTDs elimination. Furthermore, increased knowledge on co-endemic NTDs may improve prompt case detection of multiple diseases that would eventually inform integrated management [17]. However, effective NTD training can only be achieved when disease-specific materials are utilised rather than adopting integrated health education approaches using complex guidelines [76]. This is consistent with the current framework process component on instituting regular training specific to PC-NTDs surveillance.

On the other hand, encouraging involvement of the community levels in surveillance activities is deemed to increase ownership and sustainability of the processes. This corresponds to efforts to empower communities living in NTD endemic regions through their participation in control interventions and formalizing the roles of community health workers [9,69]. Active CF at the peripheral level warrants reinforcement of community and health workers knowledge on NTDs through increased training and sensitisation [17]. Community health structures are an inherent part of health systems in developing countries especially regarding disease surveillance-related activities and efforts to achieve disease control. This is commensurate with the important assumption detailed in the log frames on increased community involvement through community-based surveillance activities [77]. Therefore, improved resource allocation at the sub-national level will support capacity building and training for community-based health workers resulting to strengthened community-level structures [30]. Effective surveillance systems may contribute immensely to active detection of symptomatic cases at the lower levels. However, measurement of NTDs burden may be hindered in a majority of endemic settings with substantial proportions of asymptomatic cases similar to challenges facing malaria elimination programmes [81].

The framework’s input and process components were broadly categorised into human, technical and organisational aspects. This was partly informed by the PRISM framework that clearly describes the interconnectedness between technical, behavioral and organisational factors [22]. Furthermore, the proposed framework adopted the HOT-fit concept that considers development of HIS according to an organisational plan of action while concurrently managing information technologies based on organisational needs [23]. The model considers human, organisation and technology as essential components of HIS, which influence information and service quality, system utilisation, user satisfaction, organisational environment and the net benefits [23]. Comparably, the validated framework combined human, technical and organisational input and process components to achieve the intended results. The framework further depicts a linkage between public health surveillance core, support and attribute functions and public health actions. This compares closely to the concept of linking public health surveillance activities to public health actions–acute or planned response–through a series of process-oriented measures to achieve the intended outputs and outcomes [19,20]. Achieving improved epidemic detection as a key output through processes involving data collection, analysis and epidemiologic investigations were synonymous with the framework for evaluating public health surveillance systems for early outbreak detection [36]. Likewise, ending NTD epidemics is a crucial target to achieving the third SDG [71].

Comparable to the framework, achieving NTDs elimination goals requires an intentional shift towards implementing PC strategies to not only attain conservative morbidity control but towards progressive disease transmission interruption [82]. Furthermore, implementation of cost-effective interventions rely on a shift from MDA to limiting the interventions to specific at-risk population groups [82]. Albeit the substantial progress so far achieved to control NTDs through cost-effective interventions, the remaining challenge of instituting adequate monitoring and surveillance efforts hinder sustained disease control and elimination [83]. Therefore, surveillance systems aid in the identification of disease transmission foci to inform targeted response actions in preference to mass interventional campaigns, which may otherwise result to misuse of scarce resources. In addition, continued mass treatment interventions may exert pressure on the disease causative agents resulting to drug resistance [84]. The validated framework further identifies the long-term component on improved estimation of overall disease burden as an enabler for IDM. For instance, effective surveillance systems could pinpoint regions with a high disease burden to inform appropriate actions [85].

Framework validation process identified opportunities for strengthening specific framework components. Stakeholder resolutions provided insights on the scalability, adoptability and feasibility of the framework to guide decisions for improving PC-NTDs surveillance and response at the sub-national level. Additionally, prior consensus statements in the Delphi survey identified actionable recommendations according to concerned health stakeholders, which informed components constituting the current framework. The log frames guided improved planning, implementation and management of activities to achieve desired goals [86]. They enabled structuring of framework elements–inputs, processes, outputs, outcomes and impact–to highlight the logical interlinkages [86]. Involvement of multiple stakeholders was required to assess the likelihood of implementing feasible actions. Therefore, stakeholders’ resolutions determined the applicability and acceptability of such a framework at sub-national levels of PC-NTD endemic settings in Kenya.

Strengths and limitations

A key strength of developing the framework lies within the third phase involving a Delphi survey, which identified the implementable actions considering health personnel perspectives. Therefore, the framework components were informed by feasible recommendations to improve surveillance and response to PC-NTDs at the sub-national levels. Validation of the framework involving relevant stakeholders was crucial and identified further opportunities for improving the framework components and assessing adoptability at the sub national level. However, to operationalise the framework, an in depth understanding of the decision making process at the sub-national level is vital to identify who makes decisions, what information is required to make decisions, and how and when decisions are to be made. Moreover, direct involvement of concerned communities will aid in validating the framework further to facilitate effective operationalisation. The framework postulates improving existing surveillance systems considering both an integrated and targeted process to controlling PC-NTDs. However, it may only apply to regions co-endemic of at least two or more PC-NTDs since the framework components intend to guide the decision-making process considering an integrated disease control approach. Furthermore, the framework validation phase was undertaken amid the COVID-19 pandemic, which resulted in conducting the validation process while strictly adhering to the Kenya Ministry of Health COVID-19 guidelines. This limited the number of face-to-face sessions undertaken and restricted the number of participants present within a given session. However, further resolutions from stakeholders were obtained through adopting alternative virtual mechanisms.

Conclusion

Framework development was based on inclusion of factors that were initially assessed by key stakeholders regarding their importance and feasibility at the sub-national level. Further validation of the framework through a consultative process with concerned stakeholders aided in assessing its adoption, acceptability and utilisation for decision-making to improve PC-NTDs surveillance and response within the existing IDSR system. However, acceptability of novel surveillance and response approaches are dictated by the socio-cultural and political dynamics that should be considered when instituting control efforts within a specific unique setting [18]. The ultimate goal of the framework is to contribute to efficient implementation of two core medical interventions of the five interventional packages outlined in the WHO work plans for NTDs elimination in Africa [9,69]. The framework is inclined towards supporting implementation of interventions relating to PC for populations at risk of the infection and CF and IDM, which are critical to achieving PC-NTDs elimination. The framework will contribute towards sustainable control efforts by maintaining increased coverage of targeted interventions against NTDs to achieve the desired impact. Furthermore, attaining disease elimination and eventual eradication requires effective routine surveillance systems for early detection of possible instances of disease re-emergence both nationally and sub-nationally. However, health system strengthening frameworks in resource-constrained settings have predominantly focused on national levels with minimal focus on sub-national levels [87]. Therefore, the validated framework intends to guide decisions that will direct efforts towards assessing surveillance system performance at the sub-national level in view of PC-NTDs and inform implementation of relevant policies and control programmes. It would be pertinent for the WHO Regional Office for Africa in collaboration with national health ministries to adopt the proposed logical framework approach, which is tailored for developing countries settings to achieve improved performance of surveillance functions relating to PC-NTDs.

Supporting information

S1 File. Data collection tools.

(PDF)

S1 Table. Recommendations to improve PC-NTDs surveillance core activities.

(DOCX)

S2 Table. Recommendations to improve PC-NTDs surveillance support activities.

(DOCX)

S3 Table. Summary of existing conceptual frameworks.

(DOCX)

S4 Table. Log frame 1.

(DOCX)

S5 Table. Log frame 2.

(DOCX)

S6 Table. Log frame 3.

(DOCX)

Acknowledgments

The authors acknowledge the Kenya Ministry of Health and the County level authorities for granting permission to undertake the prior surveys that informed framework development. We also extend our sincere gratitude to all the healthcare personnel who participated in the surveys and framework validation process.

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.World Health Organization. Monitoring and evaluation of health system strengthening. Geneva: Switzerland: World Health Organization. 2009. Available from: https://www.who.int/healthinfo/HSS_MandE_framework_Nov_2009.pdf. [Google Scholar]
  • 2.Ministry of Health-Kenya. Health information system policy document 2010–2030. Kenya: Ministry of Health. 2010. Available from: https://www.healthresearchweb.org/files/HISPolicyReportfinaldocument05.08.pdf. [Google Scholar]
  • 3.Kihuba E, Gathara D, Mwinga S, Mulaku M, Kosgei R, Mogoa W, et al. Assessing the ability of health information systems in hospitals to support evidence-informed decisions in Kenya. Glob Health Action. 2014;7(1):24859. doi: 10.3402/gha.v7.24859 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.World Health Organization. Everybody’s business: Strengthening health systems to improve health outcomes: WHO’s framework for action. Geneva, Switzerland: World Health Organization. 2007. Available from: https://apps.who.int/iris/handle/10665/43918. [Google Scholar]
  • 5.World Health Organization. Technical guidelines for integrated disease surveillance and response in the African region. Brazzaville, Republic of Congo and Atlanta, USA. 2010:1–398. Available from: https://www.afro.who.int/sites/default/files/2017-06/IDSR-Technical-Guidelines_Final_2010_0.pdf. [Google Scholar]
  • 6.Ministry of Health-Kenya. Technical Guidelines for Integrated Disease Surveillance and Response in Kenya - 2nd Edition. Kenya: Ministry of Health; 2012. Available from: http://guidelines.health.go.ke/#/category/23/132/meta. [Google Scholar]
  • 7.World Health Organization. Neglected Tropical Diseases. World Health Organization. 2021. Available from: https://www.who.int/teams/control-of-neglected-tropical-diseases. [Google Scholar]
  • 8.Lindoso JAL, Lindoso AAB. Neglected tropical diseases in Brazil. Rev Inst Med Trop Sao Paulo. 2009;51(5):247–53. doi: 10.1590/s0036-46652009000500003 [DOI] [PubMed] [Google Scholar]
  • 9.World Health Organization. Regional strategic plan for neglected tropical diseases in the African Region 2014–2020. Brazzaville: World Health Organization Regional Office for Africa. 2013. Available from: https://apps.who.int/iris/handle/10665/94314. [Google Scholar]
  • 10.Hotez PJ, Molyneux DH, Fenwick A, Kumaresan J, Sachs SE, Sachs JD, et al. Control of neglected tropical diseases. N Engl J Med. 2007;357(10):1018–27. doi: 10.1056/NEJMra064142 . [DOI] [PubMed] [Google Scholar]
  • 11.Utzinger J, Raso G, Brooker S, De Savigny D, Tanner M, Ørnbjerg N, et al. Schistosomiasis and neglected tropical diseases: towards integrated and sustainable control and a word of caution. Parasitology. 2009;136(13):1859–74. doi: 10.1017/S0031182009991600 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Marchal B, Van Dormael M, Pirard M, Cavalli A, Kegels G, Polman K. Neglected tropical disease (NTD) control in health systems: the interface between programmes and general health services. Acta Trop. 2011;120(Suppl 1):S177–85. doi: 10.1016/j.actatropica.2011.02.017 . [DOI] [PubMed] [Google Scholar]
  • 13.Spiegel JM, Dharamsi S, Wasan KM, Yassi A, Singer B, Hotez PJ, et al. Which new approaches to tackling neglected tropical diseases show promise? PLoS Med. 2010;7(5):e1000255. doi: 10.1371/journal.pmed.1000255 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Gyapong JO, Gyapong M, Yellu N, Anakwah K, Amofah G, Bockarie M, et al. Integration of control of neglected tropical diseases into health-care systems: challenges and opportunities. Lancet. 2010;375(9709):160–5. doi: 10.1016/S0140-6736(09)61249-6 . [DOI] [PubMed] [Google Scholar]
  • 15.World Health Organization. Sixty-Sixth World Health Assembly: Neglected Tropical; Diseases. 2013. Available from: https://www.who.int/neglected_diseases/WHA_66_fifth_day/en/. [Google Scholar]
  • 16.Keenan JD, Hotez PJ, Amza A, Stoller NE, Gaynor BD, Porco TC, et al. Elimination and eradication of neglected tropical diseases with mass drug administrations: a survey of experts. PLoS Negl Trop Dis. 2013;7(12):e2562. doi: 10.1371/journal.pntd.0002562 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Ukwaja KN, Alphonsus C, Eze CC, Lehman L, Ekeke N, Nwafor CC, et al. Investigating barriers and challenges to the integrated management of neglected tropical skin diseases in an endemic setting in Nigeria. PLoS Negl Trop Dis. 2020;14(4):e0008248. doi: 10.1371/journal.pntd.0008248 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Zhou X-N, Bergquist R, Tanner M. Elimination of tropical disease through surveillance and response. Infect Dis Poverty. 2013;2(1):1. doi: 10.1186/2049-9957-2-1 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.McNabb SJN, Chungong S, Ryan M, Wuhib T, Nsubuga P, Alemu W, et al. Conceptual framework of public health surveillance and action and its application in health sector reform. BMC Public Health. 2002;2(1):2. doi: 10.1186/1471-2458-2-2 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.McNabb SJ, Surdo AM, Redmond A, Cobb J, Wiley J, Chakrabarti S, et al. Applying a new conceptual framework to evaluate tuberculosis surveillance and action performance and measure the costs, Hillsborough County, Florida, 2002. Ann Epidemiol. 2004;14(9):640–5. doi: 10.1016/j.annepidem.2003.09.021 . [DOI] [PubMed] [Google Scholar]
  • 21.World Health Organization. Framework and standards for country health information systems. 2008. Available from: https://apps.who.int/iris/handle/10665/43872. [Google Scholar]
  • 22.Aqil A, Lippeveld T, Hozumi D. PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems. Health Policy Plan. 2009;24(3):217–28. doi: 10.1093/heapol/czp010 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Yusof MM, Kuljis J, Papazafeiropoulou A, Stergioulas LK. An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit). Int J Med Inform 2008;77(6):386–98. doi: 10.1016/j.ijmedinf.2007.08.011 . [DOI] [PubMed] [Google Scholar]
  • 24.Paquet C, Coulombier D, Kaiser R, Ciotti M. Epidemic intelligence: a new framework for strengthening disease surveillance in Europe. Euro Surveill. 2006;11(12):212–4. . [PubMed] [Google Scholar]
  • 25.Perry HN, McDonnell SM, Alemu W, Nsubuga P, Chungong S, Otten MW, et al. Planning an integrated disease surveillance and response system: a matrix of skills and activities. BMC Med. 2007;5:24. doi: 10.1186/1741-7015-5-24 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Ng’etich AKS, Voyi K, Kirinyet RC, Mutero CM. A systematic review on improving implementation of the revitalised integrated disease surveillance and response system in the African region: A health workers’ perspective. PLoS One. 2021;16(3):e0248998. doi: 10.1371/journal.pone.0248998 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Ng’etich AKS, Voyi K, Mutero CM. Assessment of surveillance core and support functions regarding neglected tropical diseases in Kenya. BMC Public Health. 2021;21(1):1–27. doi: 10.1186/s12889-020-10013-y . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Ng’etich AKS, Voyi K, Mutero CM. Evaluation of health surveillance system attributes: the case of neglected tropical diseases in Kenya. BMC Public Health. 2021;21(1):1–15. doi: 10.1186/s12889-020-10013-y . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Ministry of Health-Kenya. The Second Kenya National Strategic Plan for Control of Neglected Tropical Diseases 2016–2020. Kenya: Ministry of Health. 2016. Available from: https://espen.afro.who.int/system/files/content/resources/KENYA_NTD_Master_Plan_2016_2020.pdf. [Google Scholar]
  • 30.Ministry of Health-Kenya. Kenya National Breaking Transmission Strategy for Soil-Transmitted Helminthiasis, Schistosomiasis, Lymphatic Filariasis and Trachoma (2019–2023). Kenya: Ministry of Health. 2019. Available from: https://www.eliminateschisto.org/resources/kenyas-breaking-transmission-strategy [Google Scholar]
  • 31.German RR, Lee LM, Horan JM, Milstein R, Pertowski C, Waller M. Updated guidelines for evaluating public health surveillance systems. MMWR Recomm Rep. 2001;50(RR-13):1–35. . [PubMed] [Google Scholar]
  • 32.Ng’etich AKS, Voyi K, Mutero CM. Feasibility of Implementing Recommendations to Improve Neglected Tropical Diseases Surveillance and Response in Kenya: A Modified Delphi Study. rs:142063/v1 [Preprint]. 2021. [cited 2021 March 24]. Available from: doi: 10.1186/s12913-021-07075-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.De Villiers MR, De Villiers PJ, Kent AP. The Delphi technique in health sciences education research. Med Teach. 2005;27(7):639–43. doi: 10.1080/13611260500069947 [DOI] [PubMed] [Google Scholar]
  • 34.Jones J, Hunter D. Consensus methods for medical and health services research. BMJ. 1995;311(7001):376–80. doi: 10.1136/bmj.311.7001.376 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Freeman RE. Strategic management: a stakeholder approach. Cambridge university press; 2010. [Google Scholar]
  • 36.Buehler JW, Hopkins RS, Overhage JM, Sosin DM, Tong V. Framework for evaluating public health surveillance systems for early detection of outbreaks: recommendations from the CDC Working Group. MMWR Recomm Rep. 2004;53(Rr-5):1–11. . [PubMed] [Google Scholar]
  • 37.Baghdadi I. Assessment of core and support functions of case-based surveillance of meningitis in hospitals in Khartoum State in 2015. East Mediterr Health J. 2016;22(4):280–3. doi: 10.26719/2016.22.4.280 . [DOI] [PubMed] [Google Scholar]
  • 38.Dairo M, Afolayan D, Akinyemi M. Compliance with epidemic-prone diseases surveillance and response guidelines among health officers at surveillance units in South-West Nigeria. Afr Health Sci. 2018;18(2):428–36. doi: 10.4314/ahs.v18i2.28 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Ngwa MC, Liang S, Mbam LM, Mouhaman A, Teboh A, Brekmo K, et al. Cholera public health surveillance in the Republic of Cameroon-opportunities and challenges. Pan Afr Med J. 2016;24:222. doi: 10.11604/pamj.2016.24.222.8045 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Adokiya MN, Awoonor-Williams JK, Beiersmann C, Muller O. The integrated disease surveillance and response system in northern Ghana: challenges to the core and support functions. BMC Health Serv Res. 2015;15:288. doi: 10.1186/s12913-015-0960-7 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Ameh CA, Sufiyan MB, Jacob M, Waziri NE, Olayinka AT. Evaluation of the Measles Surveillance System in Kaduna State, Nigeria (2010–2012). Online J Public Health Inform. 2016;8(3):e206. doi: 10.5210/ojphi.v8i3.7089 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Jinadu KA, Adebiyi AO, Sekoni OO, Bamgboye EA. Integrated disease surveillance and response strategy for epidemic prone diseases at the primary health care (PHC) level in Oyo State, Nigeria: what do health care workers know and feel? Pan Afr Med J. 2018;31:19. doi: 10.11604/pamj.2018.31.19.15828 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Nnebue C, Onwasigwe C, Ibeh C, Adogu P. Effectiveness of data collection and information transmission process for disease notification in Anambra State, Nigeria. Niger J Clin Pract. 2013;16(4):483–9. doi: 10.4103/1119-3077.116894 . [DOI] [PubMed] [Google Scholar]
  • 44.Lar LA, Afolaranmi TO, Tagurum YO, Uzochukwu B, Zoakah AI. Challenges of integrated disease surveillance response reporting among healthcare personnel in Mangu, Plateau State, Nigeria. J. Public Health and Epidemiol. 2015;7(4):108–13. 10.5897/JPHE2015.0714. [DOI] [Google Scholar]
  • 45.Lakew GA, Wassie E, Ademe A, Fenta A, Wube S, Werede M, et al. Status of surveillance and routine immunization performances in Amhara Region, Ethiopia: findings from in-depth peer review. Pan Afr Med J. 2017;27:6. doi: 10.11604/pamj.supp.2017.27.2.10755 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Adokiya MN, Awoonor-Williams J, Beiersmann C, Mueller O. Evaluation of the reporting completeness and timeliness of the integrated disease surveillance and response system in northern Ghana. Ghana Med J. 2016;50(1):3–8. doi: 10.4314/gmj.v50i1.1 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Mboera LEG, Rumisha SF, Mlacha T, Mayala BK, Bwana VM, Shayo EH. Malaria surveillance and use of evidence in planning and decision making in Kilosa District, Tanzania. Tanzan. J. Health Res. 2017;19(3). 10.4314/thrb.v19i3.7. [DOI] [Google Scholar]
  • 48.Benson FG, Musekiwa A, Blumberg L, Rispel LC. Survey of the perceptions of key stakeholders on the attributes of the South African Notifiable Diseases Surveillance System. BMC Public Health. 2016;16(1):1120. doi: 10.1186/s12889-016-3781-7 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Abubakar A, Sambo M, Idris S, Sabitu K, Nguku P. Assessment of integrated disease surveillance and response strategy implementation in selected Local Government Areas of Kaduna state. Ann Nigerian Med. 2013;7(1):14–9. 10.4103/0331-3131.119981. [DOI] [Google Scholar]
  • 50.Begashaw B, Tesfaye T. Assessment of integrated disease surveillance and response implementation in special health facilities of Dawuro Zone. J Anesthesiol. 2016;4(3):11–5. 10.11648/j.ja.20160403.11. [DOI] [Google Scholar]
  • 51.Haakonde T, Lingenda G, Munsanje F, Chishimba K. Assessment of factors affecting the implementation of the integrated disease surveillance and response in public health care facilities: the case of Rufunsa District, Zambia. Divers Equal Health Care. 2018;15(1):15–22. [Google Scholar]
  • 52.Masiira B, Nakiire L, Kihembo C, Katushabe E, Natseri N, Nabukenya I, et al. Evaluation of integrated disease surveillance and response (IDSR) core and support functions after the revitalisation of IDSR in Uganda from 2012 to 2016. BMC Public Health. 2019;19(1):46. doi: 10.1186/s12889-018-6336-2 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Tsitsi JP, Nomagugu N, Gombe NT, Tshimanga M, Donewell B, Mungati M, et al. Evaluation of the Notifiable Diseases Surveillance System in Beitbridge District, Zimbabwe 2015. O J Epi. 2015;5(3):197. 10.4236/ojepi.2015.53024. [DOI] [Google Scholar]
  • 54.Maponga BA, Chirundu D, Shambira G, Gombe NT, Tshimanga M, Bangure D. Evaluation of the Notifiable diseases surveillance system in Sanyati district, Zimbabwe, 2010–2011. Pan Afr Med J. 2014;19:278. doi: 10.11604/pamj.2014.19.278.5202 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Adokiya MN, Awoonor-Williams JK, Barau IY, Beiersmann C, Mueller O. Evaluation of the integrated disease surveillance and response system for infectious diseases control in Northern Ghana. BMC Public Health. 2015;15:75. doi: 10.1186/s12889-015-1397-y . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Iwu AC, Diwe KC, Merenu IA, Duru CB, Uwakwe KA. Assessment of disease reporting among health care workers in a South Eastern State, Nigeria. Int J Community Med Public Health. 2016;3(10):2766–74. 10.18203/2394-6040.ijcmph20163359. [DOI] [Google Scholar]
  • 57.Mandyata CB, Olowski LK, Mutale W. Challenges of implementing the integrated disease surveillance and response strategy in Zambia: A health worker perspective. BMC Public Health. 2017;17(1):746. doi: 10.1186/s12889-017-4791-9 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Nnebue C, Onwasigwe C, Adogu P, Adinma E. Challenges of data collection and disease notification in Anambra State, Nigeria. Trop J Med Res. 2014;17(1):1–6. 10.4103/1119-0388.130173. [DOI] [Google Scholar]
  • 59.Mairosi N, Tshuma C, Juru T, Gombe N, Shambira G, Tshimanga M. Evaluation of Notifiable Disease Surveillance System in Centenary District, Zimbabwe, 2016. O J Epi. 2017;7(3):251–61. 10.4236/ojepi.2017.73019. [DOI] [Google Scholar]
  • 60.Randriamiarana R, Raminosoa G, Vonjitsara N, Randrianasolo R, Rasamoelina H, Razafimandimby H, et al. Evaluation of the reinforced integrated disease surveillance and response strategy using short message service data transmission in two southern regions of Madagascar, 2014–15. BMC Health Serv Res. 2018;18(1):265. doi: 10.1186/s12913-018-3081-2 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Issah K, Nartey K, Amoah R, Bachan EG, Aleeba J, Yeetey E, et al. Assessment of the usefulness of integrated disease surveillance and response on suspected ebola cases in the Brong Ahafo Region, Ghana. Infect Dis Poverty. 2015;4(1):17. doi: 10.1186/s40249-015-0051-3 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Mwatondo AJ, Ng’ang’a Z, Maina C, Makayotto L, Mwangi M, Njeru I, et al. Factors associated with adequate weekly reporting for disease surveillance data among health facilities in Nairobi County, Kenya, 2013. Pan Afr Med J. 2016;23:165. doi: 10.11604/pamj.2016.23.165.8758 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Adjei EY, Malm KL, Mensah KN, Sackey SO, Ameme D, Kenu E, et al. Evaluation of cholera surveillance system in Osu Klottey District, Accra, Ghana (2011–2013). Pan Afr Med J. 2017;28:224. doi: 10.11604/pamj.2017.28.224.10737 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Benson FG, Musekiwa A, Blumberg L, Rispel LC. Comparing laboratory surveillance with the notifiable diseases surveillance system in South Africa. Int J Infect Dis. 2017;59:141–7. doi: 10.1016/j.ijid.2017.03.007 . [DOI] [PubMed] [Google Scholar]
  • 65.Wu TSJ, Kagoli M, Kaasboll JJ, Bjune GA. Integrated Disease Surveillance and Response (IDSR) in Malawi: Implementation gaps and challenges for timely alert. PLoS One. 2018;13(11). doi: 10.1371/journal.pone.0200858 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Kellogg W. Logic model development guide. Michigan: WK Kellogg Foundation; 2004. [Google Scholar]
  • 67.Sauerborn R, Nitayarumphong S, Gerhardus A. Strategies to enhance the use of health systems research for health sector reform. Trop Med Int Health. 1999;4(12):827–35. doi: 10.1046/j.1365-3156.1999.00497.x . [DOI] [PubMed] [Google Scholar]
  • 68.World Health Organization. Communicable disease surveillance and response systems: guide to monitoring and evaluating. 2006. Available from: https://www.who.int/csr/resources/publications/surveillance/WHO_CDS_EPR_LYO_2006_2/en. [Google Scholar]
  • 69.Ortu G, Williams O. Neglected tropical diseases: exploring long term practical approaches to achieve sustainable disease elimination and beyond. Infect Dis Poverty. 2017;6(1):147. doi: 10.1186/s40249-017-0361-8 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.World Health Organization. Ending the neglect to attain the sustainable development goals: a road map for neglected tropical diseases 2021–2030. World Health Organization. 2020. Available from: https://apps.who.int/iris/handle/10665/332094. [Google Scholar]
  • 71.World Health Organization. Progress towards the SDGs: a selection of data from World Health Statistics. 2018. Available from: http://www.who.int/gho/publications/world_health_statistics/2018/EN_WHS2018_SDGhighlights.pdf?ua=1. [Google Scholar]
  • 72.Engels D, Zhou X-N. Neglected tropical diseases: an effective global response to local poverty-related disease priorities. Infect Dis Poverty. 2020;9(1):10. doi: 10.1186/s40249-020-0630-9 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.World Health Organization. Accelerating work to overcome the global impact of neglected tropical diseases: a roadmap for implementation: executive summary. 2012. Available from: https://apps.who.int/iris/handle/10665/70809. [Google Scholar]
  • 74.World Health Organization. The Expanded Special Project for Elimination of Neglected Tropical Diseases (ESPEN) 2017 Annual Report. 2018. Available from: https://apps.who.int/iris/handle/10665/272344?show=full. [Google Scholar]
  • 75.Kelly-Hope LA, Blundell HJ, Macfarlane CL, Molyneux DH. Innovative Surveillance Strategies to Support the Elimination of Filariasis in Africa. Trends Parasitol. 2018;34(8):694–711. doi: 10.1016/j.pt.2018.05.004 . [DOI] [PubMed] [Google Scholar]
  • 76.Kabatereine NB, Malecela M, Lado M, Zaramba S, Amiel O, Kolaczinski JH. How to (or not to) integrate vertical programmes for the control of major neglected tropical diseases in sub-Saharan Africa. PLoS Negl Trop Dis. 2010;4(6):e755. doi: 10.1371/journal.pntd.0000755 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Stanton MC, Mkwanda SZ, Debrah AY, Batsa L, Biritwum NK, Hoerauf A, et al. Developing a community-led SMS reporting tool for the rapid assessment of lymphatic filariasis morbidity burden: case studies from Malawi and Ghana. BMC Infect Dis. 2015;15:214. doi: 10.1186/s12879-015-0946-4 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Mwingira U, Chikawe M, Mandara WL, Mableson HE, Uisso C, Mremi I, et al. Lymphatic filariasis patient identification in a large urban area of Tanzania: An application of a community-led mHealth system. PLoS Negl Trop Dis. 2017;11(7):e0005748. doi: 10.1371/journal.pntd.0005748 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.The First Forum on Surveillance Response System Leading to Tropical Diseases Elimination. Shaghai, China: Chinese Center for Disease Control and Prevention: National Institute of Parasitic Diseases. 2012. Available from: https://en.ipd.org.cn/articletype/detail74.html. [Google Scholar]
  • 80.Tambo E, Ai L, Zhou X, Chen JH, Hu W, Bergquist R, et al. Surveillance-response systems: the key to elimination of tropical diseases. Infect Dis Poverty. 2014;3:17. doi: 10.1186/2049-9957-3-17 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.The malERA Consultative Group on Monitoring, Evaluation, and Surveillance. A research agenda for malaria eradication: monitoring, evaluation, and surveillance. PLoS Med. 2011;8(1):e1000400. doi: 10.1371/journal.pmed.1000400 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Montresor A, Gabrielli AF, Chitsulo L, Ichimori K, Mariotti S, Engels D, et al. Preventive chemotherapy and the fight against neglected tropical diseases. Expert Rev Anti Infect Ther. 2012;10(2):237–42. doi: 10.1586/eri.11.165 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Bergquist R, Yang GJ, Knopp S, Utzinger J, Tanner M. Surveillance and response: Tools and approaches for the elimination stage of neglected tropical diseases. Acta Trop. 2015;141(Pt B):229–34. doi: 10.1016/j.actatropica.2014.09.017 . [DOI] [PubMed] [Google Scholar]
  • 84.Sturrock HJ, Picon D, Sabasio A, Oguttu D, Robinson E, Lado M, et al. Integrated mapping of neglected tropical diseases: epidemiological findings and control implications for northern Bahr-el-Ghazal State, Southern Sudan. PLoS Negl Trop Dis. 2009;3(10):e537. doi: 10.1371/journal.pntd.0000537 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Hopkins A. Treating neglected tropical diseases. Community Eye Health. 2013;26(82):26–7. . [PMC free article] [PubMed] [Google Scholar]
  • 86.Department of International Development. Tools for Development: a handbook for those involved in development activity. Available from: http://www.dfid.gov.uk/pubs/files/toolsfordevelopment.pdf.
  • 87.World Health Organization. Pathways to health system performance assessment: a manual to conducting health system performance assessment at national or sub-National Level. Copenhagen: World Health Organization Regional office for Europe. 2012. Available from: https://www.euro.who.int/en/health-topics/Health-systems/health-systems-governance/publications/2012/pathways-to-health-system-performance-assessment. [Google Scholar]
PLoS Negl Trop Dis. doi: 10.1371/journal.pntd.0009920.r001

Decision Letter 0

Claudia Munoz-Zanzi, Victoria J Brookes

22 Jun 2021

Dear Mr Ngetich,

Thank you very much for submitting your manuscript "Development and validation of a framework to improve neglected tropical diseases surveillance and response at the sub-national level in Kenya" for consideration at PLOS Neglected Tropical Diseases. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments.

We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts.

Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Claudia Munoz-Zanzi

Associate Editor

PLOS Neglected Tropical Diseases

Victoria Brookes

Deputy Editor

PLOS Neglected Tropical Diseases

***********************

Reviewer's Responses to Questions

Key Review Criteria Required for Acceptance?

As you describe the new analyses required for acceptance, please consider the following:

Methods

-Are the objectives of the study clearly articulated with a clear testable hypothesis stated?

-Is the study design appropriate to address the stated objectives?

-Is the population clearly described and appropriate for the hypothesis being tested?

-Is the sample size sufficient to ensure adequate power to address the hypothesis being tested?

-Were correct statistical analysis used to support conclusions?

-Are there concerns about ethical or regulatory requirements being met?

Reviewer #1: (No Response)

Reviewer #2: Is the PC-NTD framework design part of a major integrated disease surveillance and response -ISDR- program overhauling? Since the phase 1 methods are similar to those reported in reference 27.

The authors have as indicator of achievement of the framework Increased community participation in surveillance activities. As described, community members have been enrolled as healthcare workers for epidemiologic surveillance and they did participate in the framework´s survey phase. So, the absence of community-level representatives in the validation sessions of the framework at both Baringo and West Pokot counties (Table 2) is of some concern on ethical grounds, since they, the local communities, should be considered stakeholders in processes that affect them Can the functionaries at the validation sessions be consideren community-level stakeholders?

Reviewer #3: The methods section is detailed and well aligned to the goal of the study. It is adequate especially regarding the objectives of the study. It however, gets repeated almost totally in the results section and so a way of preventing this should have been devised in order to prevent this repetition.

--------------------

Results

-Does the analysis presented match the analysis plan?

-Are the results clearly and completely presented?

-Are the figures (Tables, Images) of sufficient quality for clarity?

Reviewer #1: (No Response)

Reviewer #2: There is a extensive step by step description of the framework development. Table 1 is too long, but it seems unavoidable since it shows all variables or components of the framework that were taken into account.

Tre themes and subthemes of literature reviews in phase I are listed in detail in the text and it is tiresome. Instead, It should be presented as a table.

The authors should avoid to repeat the same statement in the text and related tables as in table 2.

Figures 2,3, 5 and 6 allow a clear under for the proposed framework process and interactions. But, Figure 4 is unnecessary, the information on it it should be placed in the text and integrated to respective figure legends ( 5 and 6)

Reviewer #3: The analysis as presented does match the analysis plan and clearly answers the research question according to the plan provided. The results though clear are too detailed, long and repetitive of earlier text in the manuscript. A means of summary the results to provide more focus and make it easier to read and follow should be explored.

The tables are of sufficient quality though they also provide to much information and details instead of being a summary of the findings. I would also suggest that the writers consider moving some of the less relevant tables to the appendix.

--------------------

Conclusions

-Are the conclusions supported by the data presented?

-Are the limitations of analysis clearly described?

-Do the authors discuss how these data can be helpful to advance our understanding of the topic under study?

-Is public health relevance addressed?

Reviewer #1: (No Response)

Reviewer #2: The conclusion are well presented.

However it as for most of public heath policies and interventions, sustainability is a key factor. The authors address that issue on the results but there is little or sparsely development in the conclusions.

Reviewer #3: The conclusions are supported by the data and unlike the methods and results sections the conclusions are more concise. The limitations of the study were discussed as well and the authors clearly indicated how the findings of the study would be used. However, the utility of the finding to WHO who provide technical guidance to the country programmes is not articulated in the paper.

--------------------

Editorial and Data Presentation Modifications?

Use this section for editorial suggestions as well as relatively minor modifications of existing data that would enhance clarity. If the only modifications needed are minor and/or editorial, you may wish to recommend “Minor Revision” or “Accept”.

Reviewer #1: (No Response)

Reviewer #2: As described in the results. Also, the author introduce some acronyms that will requiere a complete wording for not experts as active CF (active case finding), HIS (Hospital information system) and so.

Reviewer #3: The manuscript is too long, a bit repetitive in presentation, and difficult to read. The introduction and the methods section are very detailed and most of the information and data under methods gets repeated in the results section instead of presenting a summary in the methods. The manuscript could benefit from

--------------------

Summary and General Comments

Use this section to provide overall comments, discuss strengths/weaknesses of the study, novelty, significance, general execution and scholarship. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. If requesting major revision, please articulate the new experiments that are needed.

Reviewer #1: (No Response)

Reviewer #2: The authors present a comprehensive four-phases methodology for revision and proposal for development and validation of a framework for PC-NTDs surveillance and response.

The manuscript presents a framework development process and a proposal that can be suitable as a blueprint for framework implementation in other countries with prevalent NTDs

Reviewer #3: The concept is perfect and focused on providing an M&E framework for NTDs which is a laudable goal and missing on many NTD programmes. The manuscript demonstrates a good understanding of M&E broadly and how it can be applied for NTDs M&E for best results and decision-making. Generally, the paper is highly informative, and the writers have done a great job but as indicated it is too long and makes it difficult to read and follow. I would suggest that the manuscript is broken up into more than one paper. Many of the tables could also be put in the appendix.

I suggest a major review of the paper before considering it for publication despite its utility.

Under the results section, the attributes of the surveillance functions need to be appropriately defined since they overlap in definition noting that the WHO, the organization which is responsible for providing technical norms and guidance has specific definitions for these attributes. An example is the attributes of data quality which includes accuracy, completeness, reliability, and timeliness and many of the other attributes are covered in meaning and definition under these attributes of quality data. The paper should therefore be able to define on its own the different expected data attributes to serve as guidance for the reader and at least should be provided in the introduction or literature search section.

I also expect that based on the literature review and results of the surveys there should be some prioritization of the recommendations and therefore indicators that could guide the development of a framework and also tools and guidelines.

Writers of this paper also suggest that NTDs are prone to outbreaks or epidemics which require epidemic or emergency preparedness and response, which is unusual since NTDs are generally known to be chronic conditions and have different data needs from other outbreak-prone conditions. Also, it was not discussed that PC-NTDs data collection are often one-off activities contrary to institutional data collection for conditions like malaria which involve routine data and facility-based data collection. PC-NTD data collection is also community-based with minimal and often insignificant facility-based data collection. These are important points that should have been discussed in the paper.

There also seems to be a mix in the presentation between data needs and operational issues and this needs to be clarified in the paper. The paper could also be better informed by a description of the health system for a better understanding of the M&E and surveillance needs at the different levels with a focus on the sub-national.

--------------------

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: Nana-Kwadwo Biritwum

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Attachment

Submitted filename: Comments to the Authors-PNTD-D-21-00497.docx

PLoS Negl Trop Dis. doi: 10.1371/journal.pntd.0009920.r003

Decision Letter 1

Claudia Munoz-Zanzi, Victoria J Brookes

17 Oct 2021

Dear Mr Ngetich,

We are pleased to inform you that your manuscript 'Development and validation of a framework to improve neglected tropical diseases surveillance and response at sub-national levels in Kenya' has been provisionally accepted for publication in PLOS Neglected Tropical Diseases.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases.

Best regards,

Claudia Munoz-Zanzi

Associate Editor

PLOS Neglected Tropical Diseases

Victoria Brookes

Deputy Editor

PLOS Neglected Tropical Diseases

***********************************************************

Reviewer's Responses to Questions

Key Review Criteria Required for Acceptance?

As you describe the new analyses required for acceptance, please consider the following:

Methods

-Are the objectives of the study clearly articulated with a clear testable hypothesis stated?

-Is the study design appropriate to address the stated objectives?

-Is the population clearly described and appropriate for the hypothesis being tested?

-Is the sample size sufficient to ensure adequate power to address the hypothesis being tested?

-Were correct statistical analysis used to support conclusions?

-Are there concerns about ethical or regulatory requirements being met?

Reviewer #1: (No Response)

Reviewer #2: The manuscript meet the required criteria for acceptance. In a prior review, it was stated that the paper was valuable but it was long and repetitive. The authors were able to made some adjustment to make the manuscript more readable.

Reviewer #3: This is my second review of this paper and still think the methods is adequate and robust enough for answering the operational research questions under investigation leading results which can feed into the development of the proposed M&E framework.

**********

Results

-Does the analysis presented match the analysis plan?

-Are the results clearly and completely presented?

-Are the figures (Tables, Images) of sufficient quality for clarity?

Reviewer #1: (No Response)

Reviewer #2: The results are well presented.

Reviewer #3: The analysis plan enables the researchers to deep dive into all the issues and responses relevant to the objectives of this paper. In my opinion it is clear and comprehensive for eliciting the required data and results.

**********

Conclusions

-Are the conclusions supported by the data presented?

-Are the limitations of analysis clearly described?

-Do the authors discuss how these data can be helpful to advance our understanding of the topic under study?

-Is public health relevance addressed?

Reviewer #1: (No Response)

Reviewer #2: Discussion of results, conclusion and limitations for the design of the framework was consistent with the results and circumstances of the assessment and development.

Reviewer #3: The conclusions are clearly supported by the data collected and analysed. The utility of this paper towards informing WHO guidance for Neglected Tropical Diseases at the sub-national level and laudable and explicit in the paper.

**********

Editorial and Data Presentation Modifications?

Use this section for editorial suggestions as well as relatively minor modifications of existing data that would enhance clarity. If the only modifications needed are minor and/or editorial, you may wish to recommend “Minor Revision” or “Accept”.

Reviewer #1: (No Response)

Reviewer #2: No suggestions

Reviewer #3: A description of the neglected tropical diseases programme implemented in the two districts especially for PC-NTDs in the beginning of the manuscript would provide a very good understanding of this well written paper. There is also an overemphasis on NTDs being prone to outbreaks and having the potential to be categorized as public health emergencies requiring requiring emergency preparedness, but knowing PC-NTDs to be mainly chronic condition, requires that these statements should be made with caution. Nevertheless, conditions like schistosomiasis may present as such. I still find the paper a bit too long with a lot of information in the text also repeated in the tables. This paper should be published with or without further modifications.

**********

Summary and General Comments

Use this section to provide overall comments, discuss strengths/weaknesses of the study, novelty, significance, general execution and scholarship. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. If requesting major revision, please articulate the new experiments that are needed.

Reviewer #1: All my earlier comments have been satisfactorily addressed, I have no further comments.

Reviewer #2: As commented earlier, the framework design can be used as blueprint for similar surveillance and response systems proposals in other regions affected by NTDs

Reviewer #3: A description of the neglected tropical diseases programme implemented in the two districts especially for PC-NTDs in the beginning of the manuscript would provide a very good understanding of this well written paper. There is also an overemphasis on NTDs being prone to outbreaks and having the potential to be categorized as public health emergencies requiring requiring emergency preparedness, but knowing PC-NTDs to be mainly chronic condition, requires that these statements should be made with caution. Nevertheless, conditions like schistosomiasis may present as such. I still find the paper a bit too long with a lot of information in the text also repeated in the tables. This paper should be published with or without further modifications.

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Collins Okoyo

Reviewer #2: No

Reviewer #3: Yes: Dr. Nana-Kwadwo Biritwum

PLoS Negl Trop Dis. doi: 10.1371/journal.pntd.0009920.r004

Acceptance letter

Claudia Munoz-Zanzi, Victoria J Brookes

22 Oct 2021

Dear Dr Ng'etich,

We are delighted to inform you that your manuscript, "Development and validation of a framework to improve neglected tropical diseases surveillance and response at sub-national levels in Kenya," has been formally accepted for publication in PLOS Neglected Tropical Diseases.

We have now passed your article onto the PLOS Production Department who will complete the rest of the publication process. All authors will receive a confirmation email upon publication.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any scientific or type-setting errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Note: Proofs for Front Matter articles (Editorial, Viewpoint, Symposium, Review, etc...) are generated on a different schedule and may not be made available as quickly.

Soon after your final files are uploaded, the early version of your manuscript will be published online unless you opted out of this process. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting open-access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases.

Best regards,

Shaden Kamhawi

co-Editor-in-Chief

PLOS Neglected Tropical Diseases

Paul Brindley

co-Editor-in-Chief

PLOS Neglected Tropical Diseases

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Data collection tools.

    (PDF)

    S1 Table. Recommendations to improve PC-NTDs surveillance core activities.

    (DOCX)

    S2 Table. Recommendations to improve PC-NTDs surveillance support activities.

    (DOCX)

    S3 Table. Summary of existing conceptual frameworks.

    (DOCX)

    S4 Table. Log frame 1.

    (DOCX)

    S5 Table. Log frame 2.

    (DOCX)

    S6 Table. Log frame 3.

    (DOCX)

    Attachment

    Submitted filename: Comments to the Authors-PNTD-D-21-00497.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files.


    Articles from PLoS Neglected Tropical Diseases are provided here courtesy of PLOS

    RESOURCES