Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Feb 5;16(2):e0244192. doi: 10.1371/journal.pone.0244192

Innovative approach for potential scale-up to jump-start simplified management of sick young infants with possible serious bacterial infection when a referral is not feasible: Findings from implementation research

Abadi Leul 1,*, Tadele Hailu 1, Loko Abraham 1, Alemayehu Bayray 2, Wondwossen Terefe 2, Hagos Godefay 3, Mengesha Fantaye 4, Shamim Ahmad Qazi 5, Samira Aboubaker 5, Yasir Bin Nisar 6, Rajiv Bahl 6, Ephrem Tekle 7, Afework Mulugeta 2
Editor: Lawrence Palinkas8
PMCID: PMC7864440  PMID: 33544712

Abstract

Background

Neonatal bacterial infections are a common cause of death, which can be managed well with inpatient treatment. Unfortunately, many families in low resource settings do not accept referral to a hospital. The World Health Organization (WHO) developed a guideline for management of young infants up to 2 months of age with possible serious bacterial infection (PSBI) when referral is not feasible. Government of Ethiopia with WHO evaluated the feasibility of implementing this guideline to increase coverage of treatment.

Objective

The objective of this study was to implement a simplified antibiotic regimen (2 days gentamicin injection and 7 days oral amoxicillin) for management of sick young infants with PSBI in a programme setting when referral was not feasible to identify at least 80% of PSBI cases, achieve an overall adequate treatment coverage of at least 80% and document the challenges and opportunities for implementation at the community level in two districts in Tigray, Ethiopia.

Methods

Using implementation research, we applied the PSBI guideline in a programme setting from January 2016 to August 2017 in Raya Alamata and Raya Azebo Woredas (districts) in Southern Tigray, Ethiopia with a population of 260884. Policy dialogue was held with decision-makers, programme implementers and stakeholders at federal, regional and district levels, and a Technical Support Unit (TSU) was established. Health Extension Workers (HEWs) working at the health posts and supervisors working at the health centres were trained in WHO guideline to manage sick young infants when referral was not feasible. Communities were sensitized towards appropriate home care.

Results

We identified 854 young infants with any sign of PSBI in the study population of 7857 live births. The expected live births during the study period were 9821. Assuming 10% of neonates will have any sign of PSBI within the first 2 months of life (n = 982), the coverage of appropriate treatment of PSBI cases in our study area was 87% (854/982). Of the 854 sick young infants, 333 (39%) were taken directly to a hospital and 521 (61%) were identified by HEW at health posts. Of the 521 young infants, 27 (5.2%) had signs of critical illness, 181 (34.7%) had signs of clinical severe infection, whereas 313 (60.1%) young infants 7–59 days of age had only fast breathing pneumonia. All young infants with critical illness accepted referral to a hospital, while 117/181 (64.6%) infants with clinical severe infection accepted referral. Families of 64 (35.3%) infants with clinical severe infection refused referral and were treated at the health post with injectable gentamicin for 2 days plus oral amoxicillin for 7 days. All 64 completed recommended gentamicin doses and 63/64 (98%) completed recommended amoxicillin doses. Of 313 young infants, 7–59 days with pneumonia who were treated by the HEWs without referral with oral amoxicillin for 7 days, 310 (99%) received all 14 doses. No deaths were reported among those treated on an outpatient basis at health posts. But 35/477 (7%) deaths occurred among young infants treated at hospital.

Conclusions

When referral is not feasible, young infants with PSBI can be managed appropriately at health posts by HEWs in the existing health system in Ethiopia with high coverage, low treatment failure and a low case fatality rate. Moreover, fast breathing pneumonia in infants 7–59 days of age can be successfully treated at the health post without referral. Relatively higher mortality in sick young infants at the referral level health facilities warrants further investigation.

Introduction

In 2018, an estimated 2.5 million neonatal deaths occurred worldwide, of which 1 million were in Sub Saharan Africa contributing to 36% and 47% of under-5 deaths respectively [1]. Neonatal infections primarily bacterial in origin, including pneumonia, sepsis and meningitis are one of the major causes of 55000 neonatal deaths every year [2]. An estimated 6.9 million episodes of possible serious bacterial infection (PSBI) in young infants up to 2 months of age occur yearly in low- and middle-income countries [3]. The rate of home deliveries is high; unhygienic conditions abound around birth and access to appropriate treatment for sepsis is low [4, 5]. WHO recommends inpatient treatment of neonates with infection/sepsis with injectable benzylpenicillin/ampicillin plus gentamicin as first-line antibiotics and supportive care [6]. Nevertheless, the referral acceptance rate remains low in many low- and middle-income country settings [713].

Observational studies from Bangladesh, India and Nepal have shown that neonatal infections could be managed by trained health providers when referral to a hospital is not feasible, subsequently reducing neonatal mortality [79]. Later, randomized controlled trials from Bangladesh, Democratic Republic of Congo (DRC), Kenya, Nigeria and Pakistan reported successful treatment of young infants up to 2 months of age with signs of PSBI with simplified antibiotic regimens at first-level health facilities when a referral was not feasible [1013]. Using this evidence, the World Health Organization (WHO) developed a guideline to manage young infants with PSBI when referral is not feasible in 2015 [14]. It recommended both 2 and 7 days of injectable gentamicin plus 7 days of oral amoxicillin for treatment of young infants with signs of clinical severe infection (Box 1). In Ethiopia, due to difficult terrain and long distances to hospitals in rural areas, there was a need to provide access to treatment near people’s homes. Government of Ethiopia instituted the health extension worker (HEW) programme in rural areas in 2003, where HEWs identify and provide care to sick children among other activities. The Government of Ethiopia trained HEWs to implement community-based newborn care which included PSBI management when the referral was not feasible in selected communities in three regions between 2008 to 2013, but the estimated treatment coverage was only around 50%. [15]. Some of the reasons for this low coverage were lack of awareness, perceived illness severity, perceived early treatment by mothers and having other young children [16]. Thus, the objective of this study was to implement a simplified antibiotic regimen (2 days gentamicin injection and 7 days oral amoxicillin) for management of sick young infants with PSBI in a programme setting when referral was not feasible to identify at least 80% of PSBI cases, achieve an overall adequate treatment coverage of at least 80% and document the challenges and opportunities for implementation at the community level in two districts in Tigray, Ethiopia.

Box 1. Definitions and management strategies of young infants with signs of PSBI–adapted by Government of Ethiopia from WHO Guideline [14].

I. Signs of PSBI in a young infant 0–59 days of age

Severe chest indrawing, or no movement at all or movement only when stimulated, or not able to feed at all or not feeding well/stopped feeding well, or convulsions, or axillary high body temperature (≥ 38°C) or axillary low body temperature (<35.5°C) or young infant 0–6 days old with only fast breathing (respiratory rate ≥ 60 breaths per minute),.

Recommendation: Refer immediately to a higher-level referral health facility

If referral is not feasible, re-classify the sick young infant with signs of PSBI into the following

  • i) Critical illness: A young infant who has any of the following signs—convulsions (fits) or is unable to feed at all or no movement at all

    Recommendation: Refer immediately to a higher-level referral health facility. However, if referral is not feasible at all then treat the infant with injectable gentamicin once daily plus injection ampicillin twice daily up to 7 days on outpatient basis, with efforts made to refer the infant to a hospital as soon as possible.

  • ii) Clinical Severe Infection (CSI): A young infant who has any of the following signs—not feeding well/stopped feeding well, severe chest indrawing, high (38°C or above) or low (less than 35.5°C) axillary body temperature, movement only when stimulated, or fast breathing (60 or more breaths per minute) in infants 0–6 days of age (this last component was added to CSI as local adaptation by Government of Ethiopia, instead of having it separately as severe pneumonia as designated in WHO guideline)

    Recommendation: Refer immediately to a higher-level referral health facility. However, if referral is not feasible then treat the infant with injectable gentamicin once daily for 2 days plus oral amoxicillin twice daily up to 7 days on outpatient basis.

II. Sign of fast breathing pneumonia

Young infant 7–59 days old presenting with fast breathing (respiratory rate ≥ 60 breaths per minute)

Recommendation: Treat with oral amoxicillin for 7 days without referral to a higher-level facility.

Methods

Context and setting of the study

This implementation research was conducted at the health post level in two districts, Raya Alamata and Raya Azebo in Tigray, one of the regional states of Ethiopia. The two districts are characterized by lowland and highland agro-ecological conditions. The total population of the two study districts was 260,884 [17]. The neonatal mortality rate in the state was 34 deaths per 1000 births in 2016 [18]. The two districts were selected based on their higher neonatal mortality rates compared to other districts in Tigray [19]. Raya Alamata has one general hospital, five health centres and 17 health posts. Raya Azebo has one primary hospital, seven health centres and 22 health posts. Each of the health posts is staffed with two female HEWs. These public health institutions provide maternal and young infant health services either free or at a low cost. The health system structure in Ethiopia is a three-tiered health system structure of primary care (primary health care unit), secondary care (general hospital) and tertiary care (referral hospital). The Primary Health Care Unit (PHCU) at the bottom level consists of health posts that serve 5000, health centers that serve 25000 and a primary hospital which serves 100000 people. The PHCU feeds into the secondary level of health care, i.e. general hospital, which serves a population of one million and the general hospital, in turn, feeds into the referral hospital which serves about 5 million people. The HEWs at health posts from the PHCUs carry out the 17 different activities in close collaboration with local Women’s Development Groups (WDG) [20]. Among the main responsibilities entrusted to the WDGs is social mobilization for maternal, newborn and child health (MNCH) services. The HEWs are expected to conduct postnatal home visits on days 1, 3, 7 and 42 as per the MNCH guideline. A health centre has around 20 health professionals (health officers, nurses, midwives and laboratory technicians) but is not equipped to manage sick young infants on an inpatient basis.

Study design

This implementation research was a longitudinal study, in which data were collected prospectively from each young infant aged up to 2 months in the catchment area from January 2016 to August 2017.

Sample size determination

The sample size was determined based on the proportion of new live births in a year (3.1%) in Ethiopia. Thus, it is expected that there will be about 8087 (3.1% x 260884) live births in a year in both districts. We assumed 10% of the young infants will develop PSBI and hence about 809 young infants were to be included in the implementation research in a year [11].

Study population

All babies born during the study period were included in the study. Young infants up to 2 months of age with one or more signs of PSBI (Box 1) who were permanent residents of Raya Alamata and Raya Azebo districts were included in the study.

Primary outcome

The primary outcome of this study was the identification of at least 80% of the PSBI cases and provision of appropriate treatment for at least 80% of those identified cases in young infants aged up to 2 months. Appropriate treatment was defined as the provision of inpatient treatment (injectable gentamicin and ampicillin or any other appropriate antibiotics) or outpatient treatment (oral amoxicillin twice daily for at least 5 days plus IM gentamicin injection for 2 days) to sick young infants with PSBI when the referral was not feasible.

Secondary outcomes

Secondary outcomes included referral acceptance rate; infant death rate within two weeks after the initiation of inpatient or outpatient treatment; clinical deterioration defined as the emergence of any sign of critical illness or new sign of clinical severe infection during the outpatient treatment of sick young infants; any serious adverse effects such as local swelling at the injection site, new onset of rash, disseminated and severe rash, anaphylactic reaction, stopped passing urine for >12 hours (renal failure) and cellulitis or abscess at injection site in young infants who received simplified antibiotic treatment at health post level, rate of adherence to outpatient treatment and accuracy of classification of PSBI by HEWs.

Planning the intervention

Policy dialogue and consultative process

A policy dialogue facilitated by WHO was held between the Federal Ministry of Health (FMoH), the Regional Health Bureau (RHB), policy-makers, programme managers, health professionals, researchers from academia and other stakeholders. The WHO guideline for the management of PSBI when referral is not feasible [14] and evidence supporting it was presented and discussed [1013]. The consensus was reached on interventions and on the need to test the implementation of the WHO PSBI guideline in a programme setting in Mekelle. Subsequently, consultations were held with stakeholders, including FMoH, Tigray RHB, WHO, UNICEF, Save the Children (an implementation partner of the RHB) and technical experts from Mekelle University to set up implementation research sites.

Memorandum of understanding between TSU and stakeholders

Discussions were held among the TSU and key stakeholders to develop a memorandum of understanding, which articulated the roles and responsibilities of the RHB, Save the Children and the TSU (Table 1). The district health staff from the two selected districts were invited to participate.

Table 1. Roles and responsibilities of the various stakeholders.

RN Names of stakeholders Roles and responsibilities
1 Technical support unit (TSU) from Mekelle University • Leading the research activities
• Revision of the community-based neonatal care (CBNC) training materials to reflect the new WHO guideline [14]
• Supporting Save the Children, the implementing partner in training of health workers
• Orientation of women development group (WDG) members
• Monitoring and evaluation to assure quality
• Provision of technical support to Health Extension Workers (HEW), RHB and Save the Children
• Data management and analysis
• Dissemination of the progress of the implementation research through meetings and reports
• Document lessons and experiences regarding implementation of community-based treatment of possible serious bacterial infection (PSBI)
• Identify barriers and provide solutions to overcoming barriers.
2 Regional Health Bureau (RHB) • Implementation of the PSBI management guideline in the selected districts
• Leading the quarterly review meetings at region/district levels
• Provide advices for adjustments as necessary and monitored progress through its regular reporting systems
• Fulfil the logistic and human resource needs
• Ensure health posts are open during working hours
• Mobilize HEWs and other health workers, as well as relevant stakeholders, to participate in trainings and review meetings
• Mobilize stakeholders to support the smooth implementation of community-based management of PSBI
• Conduct periodic supportive supervision
• Ensure the availability of essential CBNC supplies at the health posts and health centres.
3 Save the Children • Implement the CBNC interventions, which included the training and post training follow-up of HEWs and other health workers
• Provide supportive supervision, performance review and clinical mentoring as per the CBNC protocol
• Ensure implementation issues identified during monitoring are communicated and acted upon in a timely fashion
• Support the implementation of strategies to improve newborn health care-seeking practices
• Report on the CBNC activities as per the nationally-agreed monitoring tools and indicators
• Share relevant information about training, and periodic monitoring and supervision
• Conduct joint supervision with the TSU and the RHB
• Participate in meetings at district/primary health care unit (PHCU) levels.
4 District Health Offices • Ascertain the readiness of the implementation research sites
• Commit their time and human resources to support the implementation of the study in their respective communities
• Conduct joint supervision with the TSU, Save the Children and RHB
• Ensure the active participation of WDGs, maternal and child health experts, cluster supervisors and HEWs from the two districts
• Ensure the HEWs assessed, treated, referred and followed-up sick young infants and conducted scheduled postnatal visits
• Ensure the supervisors and clinical mentors visited the young infants being treated and provided technical support and on-site mentoring in addition to follow-up on days 5 and 8.

Sensitization meetings

A sensitization meeting in each district, facilitated by the TSU, was carried out with the study site administrators, women’s affairs offices, WDGs, religious leaders, district health officers, hospital medical directors, health centre directors, supervisors and HEWs. Evidence for management of PSBI when referral is not feasible and its impact on neonatal mortality were discussed. This briefing increased trust with various stakeholders; led to buy-in and ownership of the study; improved linkages between various levels of the health system and resulted in smooth implementation of the research in the two study sites.

Training of health care providers

To harmonize the conduct of the implementation research across the various sites, WHO organized a Master Training of Trainers workshop in Ibadan, Nigeria, for all implementation research sites including two sites in Ethiopia, two in Nigeria, one in DRC, one in Pakistan and four in India.

Two paediatricians from the TSU participated, and they subsequently trained master trainers from Save the Children and the RHB at the Tigray site. Chart booklets and training manuals on the Integrated Management of Newborn and Childhood Illness (IMNCI) were adapted from WHO [21] and translated to the local language (Tigrigna). Laminated job aids were also developed. The training was provided to the HEWs in two rounds in each district (woreda) and 15 to 20 trainees at a time attended. Refresher training took place every six months. The health centre directors, district health office experts, cluster supervisors and leaders of the 1 to 5 networks of mothers (a group of six neighbouring women led by a model household woman) were also trained.

Interventions

HEWs from the health posts and nurses from the under-five clinics of the health centres were trained to provide health education, counsel mothers about newborn care including identification of signs of illness, and identifying and treating infants with PSBI (Box 1). HEWs identified sick young infants, assessed and classified them for PSBI, counselled families and provided treatment including to those who required referral but did not accept referral advice.

Identification and management of patients

Amongst the roles and responsibilities of the health centre is to technically support the activities of the HEWs from the satellite health posts. The HEWs worked with the community-based WDG leaders to identify sick young infants and promote prompt care-seeking at the health posts. The sick young infants were identified either by the WDGs or HEWs during their house-to-house visits. When the WDGs identified sick young infants in their neighborhoods during the visits, they informed the HEWs either in person or via telephone. However, if a sick young infant was identified by the HEWs, the mother/caregiver was advised to take the sick young infant to the nearby health centre or hospital. If the mother/caregiver refused, the HEW provided treatment using the PSBI treatment protocol (Box 1). Sick young infants were also brought by the mothers/caregivers directly to the health post or the hospitals. Once at the health post, the HEW assessed and classified the sick young infant. If the sick young infant was found to have a clinical severe infection or critical illness, the HEW counseled the mother/caregiver on referral. If the mother/caregiver accepted the referral, the HEW gave a pre-referral antibiotic dose. If the mother/caregiver refused referral or the young infant was classified as having only fast breathing pneumonia, the infant was treated at the health post. Follow-ups were carried out by the HEWs and the nurse supervisors. To ensure that services were available at all times, one HEW made home visits while the other provided services at the health post. When an injection dose fell on a weekend or the family did not come for injection or follow-up, the HEWs made home visits.

Referral mechanism. According to FMoH policy, HEWs refer sick young infants with PSBI signs to their linked health centres. However, often health centres lack the capacity, commodities and infrastructure to admit and manage infants with PSBI. As a result, sick young infants are referred from the health centre to a hospital. During implementation, training was organized in consultation with the RHB to train health centre staff and HEWs to manage young infants with signs of PSBI with the simplified antibiotic regimens, when referral to a hospital was not accepted by the family.

Quality control and assurance

The clinical mentor provided on-site support to HEWs and supervisors every month. Additionally, on-call support for specific PSBI cases was given as required. TSU paediatricians and Save the Children facilitators also provided technical and clinical support when needed. The knowledge and skills of the HEWs in the identification, assessment, classification and treatment of young infants with PSBI were routinely monitored and evaluated by the paediatricians and clinical mentors every month, and on-site training to HEWs and supervisors was provided as needed. The research team used a standard checklist during its monthly field visits to monitor progress. Review meetings were conducted every three months with the TSU team, Save the Children, RHB, District Health Offices heads and experts, health centre heads, HEWs and cluster supervisors to discuss issues of concern for smooth implementation of the PSBI research. WHO and the FMoH also visited sites to review progress and monitor the quality of implementation. The classification and treatment selection of PSBI cases by the HEWs were reviewed and counter-checked for accuracy by the TSU paediatricians every month.

Incentives provided to HEWs

The HEWs from the health posts were given around US$ 2 for completing each case reporting forms (CRF), and the clinical mentor was given US$ 200 monthly to compensate for his/her time.

Data collection and management

Data on pregnancy, birth, illness management, follow-up and outcomes were collected using pre-tested CRFs. HEWs collected and managed individual infant data with support from field supervisor nurses who checked the data regularly. Data from the field were sent to the study data management centre at Mekelle University. Inconsistencies were checked and resolved before data were entered into a computer using a specific database for the study. All young infants who were provided treatment were evaluated daily by the same treating HEW and by nurse supervisor on day 5 and day 8 for the ascertainment of the treatment outcome (improvement or deterioration).

Data analysis

Quantitative data were cleaned and entered into SPSS version 20 software. After checking for missing data, outliers and invalid values, descriptive analysis was conducted to report frequencies, coverage and proportion of sick young infants with clinical severe infection, critical illness, pneumonia, local bacterial infections; treatment failures (clinical deterioration at any time and/or failure to respond on day 4 of treatment); referrals and treatment outcomes along with relevant information regarding PSBI management and treatment at the community level.

Ethical considerations

The study protocol and all associated data collection instruments and consent forms were approved by the Ethical Review Boards of the College of Health Sciences at Mekelle University and Ethics Review Committee of WHO, Geneva. The study involved repeated visits to households. So, series of oral informed consents were obtained for participation in the study, i.e., for home visits during pregnancy and childbirth; for enrolment when the infant gets sick; for treatment; and for follow up visits.

Results

We identified 7857 live births during the 20 months (January 2016 –August 2017) of the study. Home visits by HEWs were made to 1790 (23%) on day 1, 5140 (65%) on day 3, 6376 (81%) on day 7, 6526 (83%) on day 42 and 6713 (85%) on day 59. We identified 854 infants with any sign of PSBI during the first two months of life.

Coverage and management of PSBI

We estimated that 25% of live births were not identified by HEWs in this study, particularly in the early part of the implementation (n = 1964), similar to that reported in a similar study from Zaria, Nigeria [22], leading to estimated total live births of 9821 during the study period. Assuming 10% of infants will have any sign of PSBI within the first two months of life (n = 982) [11], the identification and coverage of treatment of PSBI cases in our study area was 87% (854/982).

Of the 854 cases, 333 (39%) young infants were directly brought to the hospital by families and were treated there, whereas 521 (61%) were seen by HEWs or nurses. The coverage of identification of PSBI by the HEWs improved from 37% in the first quarter to 78% in the last quarter. (Fig 1). Of the 521 PSBI cases identified by HEWs and nurses, 313 (60.1%) young infants 7–59 days old had only fast breathing pneumonia, and all of them were treated with oral amoxicillin either at a health post or health centre without a referral (Table 2). One child did not respond to oral amoxicillin, and two were lost to follow-up. No serious adverse effect or death was reported.

Fig 1. Identification of PSBI cases against target by HEWs and nurse supervisors in each quarter of study, January 2016 to August 2017, n = 521.

Fig 1

Table 2. Young infants 7–59 days of age with only fast breathing pneumonia identified at health posts and health centres (n = 313).

Parameters N (%)
Identified and treated on outpatient basis at either health posts or health centres 313 (100)
 Identified at health posts by health extension workers 182 (58)
 Identified at health centres by nurses 131 (42)
Completed treatment 310 (99)
Compliance to treatment
Received all 14 doses of amoxicillin 308 (98)
Received 10–13 doses of amoxicillin 2 (0.6)
Received 6–9 doses of amoxicillin 1 (0.3)
Missing data 2 (0.6)
Follow-up of infants
Completed all follow-up visits 308 (98)
Partially followed-up (all follow-up visits not completed) 2 (0.6)
Lost to follow-up (outcome unknown) 2 (0.6)
Treatment outcomes*
Declared as ‘clinical treatment success’ 310 (99)
Declared as ‘clinical treatment failure’–developed signs of severe illness 1 (0.3)
Infants 7–59 days with fast breathing only with outcome unknown 2 (0.6)

*No death was documented.

Of these 521 infants with any sign of PSBI, 181 (34.7%) had signs of clinical severe infection, while 27 (5.2%) had signs of critical illness. Of the 181 young infants with clinical severe infection, the caregivers of 117 (64.6%) accepted referral to a hospital for treatment, whereas the caregivers of 64 (35.4%) refused referral and were treated at a health post. All except one (63, 98%) who were treated at health post received appropriate treatment. One was lost to follow-up, but no death was reported. Treatment adherence was 100% for injection gentamicin and 98% for oral amoxicillin respectively (Table 3). All cases of critical illness (n = 27) identified by HEWs accepted the referral and were treated in a hospital (Fig 2).

Table 3. Young infants 0–59 days of age with signs of clinical severe infection (n = 181).

Parameters N (%)
Brought by families to health post and classified as clinical severe infection 181
 Referred to hospital 181 (100%)
 Accepted referral to hospital 117 (64.6)
 Did not accept referral 64 (35.4)
  Accepted treatment at health post 64 (100)
   Completed treatment 63 (98)
Compliance to treatment
   Received 2 injections of gentamicin 64 (100)
   Received all 14 doses of DT amoxicillin 62 (96.8)
   Received 10–13 doses of DT amoxicillin 1 (1.6)
   Missing data 1 (1.6)
Follow-up of infants
   Completed all follow-up visits 63 (98)
   Lost to follow-up (outcome unknown) 1 (1.6)
Treatment outcomes*
   Declared as ‘clinical treatment success’ 63 (98)
   Declared as ‘outcome unknown’ 1 (1.6)

*No death was documented.

Fig 2. Schematic representation of the identification, assessment, classification, referral, treatment and follow up of sick young infants.

Fig 2

Accuracy of classification of HEWs

TSU paediatricians checked 390 data forms (182 with fast breathing pneumonia, 181 with clinical severe infection and 27 with critical illnesses) filled out by the HEWs and compared their recorded signs with their classifications and treatment. Only 22 of the 182 (12%) young infants with fast breathing and 11 of the 181 (6%) with signs of clinical severe infection were misclassified. None of the young infants with signs of critical illness was misclassified. Classifying young infants < 7 days of age with only fast breathing pneumonia was the most common misclassification by the HEWs. However, no discrepancy was detected in treatment selection for the classification of the young infant.

Deaths

Sick young infants with PSBI were followed-up on daily basis by the treating HEW and on day 5, day 8 and day 14 by the nurse supervisor when treatment was provided as an outpatient in the HP. Those young infants who were treated at a hospital were visited on day 14 to record their outcomes. Out of 854 young infants with PSBI, 35 (4%) died. All deaths occurred among infants who were treated at a hospital, 18 at Mehoni and 17 at Raya Alamata. Seven of these deaths were amongst the 144 (117 with clinical severe infection and 27 with critical illnesses) who were referred by HEWs (three had a critical illness and four had a clinical severe infection) to a hospital. All were given pre-referral treatment.

Implementation challenges and solutions

During this implementation research, several challenges were encountered. Solutions were found for most of them through collaborative efforts between TSU, the RHB, Save the Children, HEWs, health centres, and the district health office (Table 4).

Table 4. Implementation challenges encountered and solutions provided.

Stages Implementation challenge Solutions and actions
Patient identification, referral, treatment and follow up Poor pregnancy surveillance, recording and poor linkage between antenatal care and the health post and health centre/hospital A format on pregnancy cohort (listing pregnant mothers whose expected date of delivery was in the same month separately) was designed and distributed to each of the health centres. On-site training was provided to HEWs on the use of the format by the TSU. Health centres linked the pregnant women who visited the health centre for their first antenatal care follow-up with the HEWs. Laboratory results of pregnant women were communicated through a formal referral slip to the HEWs from the health posts.
Poor postnatal care home visit services Consultations and discussions were held between the HEWs and the TSU to ensure adherence to the postnatal care guideline of the FMoH (home visits on days 1, 3, 7 and 42). Sustainability remains a challenge.
Failure of HEWs to carry out CBNC activities properly Refresher training was provided to HEWs by master trainers and Save the Children with support from the TSU. This was complemented with on-site training by the TSU, the clinical mentors and the supervisors during the first two quarters which resulted in improvement in the skills to carry out activities as per standard case management.
Mismatch between assessment and classification as per chart booklet (not using the chart booklet) On-site training was provided to HEWs by the TSU on the use of the job aids distributed to health posts during the first quarter, with subsequent on-site mentorship by the TSU through the second and third quarters. This resulted in improvement in the skills to carry out activities as per standard case management in the subsequent quarters.
Poor on-site supportive supervision from the district health office and cluster supervisors Consultations, review meetings and discussions were held with the RHB, district health office and health centre staff and HEWs. Training was provided to the district supervisors and health centre staff by the TSU. Subsequently agreements were reached between the TSU, health centres and the District Health Offices to increase the frequency of supportive supervisory visits to health posts from once in six months to at least quarterly by the district health office and monthly by the TSU.
Confusion in the definition of young infant as a neonate (first 28 days of life) Refresher and onsite training were provided to HEWs, health centre and district health staff by the TSU to resolve confusion.
Confusion between integrated community case management (iCCM) and CBNC during the early days of project implementation HEWs, health workers from health centres and experts from the districts had a better awareness of iCCM than CBNC as iCCM had been in place for a few years. Refresher and on-site training were provided by Save the Children and the TSU.
Poor referral linkage across all levels Consultations and discussions were held between the TSU, FMoH, RHB and the district health office to improve the referral and feedback linkages and communication between health workers at different levels. They agreed to have an auditable referral system and to review the referrals during their meetings.
Discrepancies between the management of PSBI at health posts and health centres and ill-equipped health centres to manage referred PSBI cases Refresher and on-site training during the supportive supervisory visits were provided to health post and health centre staff in the study area. In addition, consultations and discussions were made with the RHB to address discrepancies. As a result, the RHB wrote a letter to the health centres to comply with using the simplified antibiotic treatment regimen implemented by the health posts unless the health centre has the capacity to admit and manage cases on an inpatient basis. The health centre workers were trained on PSBI case management by the TSU during the third quarter.
Poor health care-seeking behaviour of mothers Refresher training was provided to the HEWs and WDGs to create demand for the services provided at the health post. Community mobilization activities to increase care-seeking were also undertaken.
Referral and treatment Tendency of the HEWs to treat rather than to refer sick young infants with PSBI during the initial period of implementation research Refresher training and on-site supportive supervisory visits were provided to the HEWs to counsel mothers or families of sick young infants for referral to the next higher level of care. HEWs were made to understand to only treat sick young infants whose families refused to accept referral.
Expiry of medicines for simplified treatment regimen of PSBI During the on-site supportive supervisory visits of the TSU, the HEWs from the health posts were trained on how to read the expiry dates of drugs, report the drugs with short shelf lives and redistribute them to nearby health posts. Templates were developed for redistribution and reporting of these drugs in consultation with district health offices.
Data Collection The health management information system format was not capturing data on PSBI TSU held discussions with the RHB and the FMoH to align the information in the health management information system and CBNC, which resulted in a few key indicators to be incorporated in the revised DHIS.
Complicated data collection instruments (CRFs) has challenged their completion During the initial period of project implementation, the HEWs were concerned about the number and complexity of the data collection tools and did not complete some of the forms. Additional onsite training was provided to the HEWs to complete the various CRFs. TSU also revised the tools to make them much simpler.
Administrative issues Heavy workload of HEWs and missing of scheduled visits Consultations and discussions were made with the RHB to increase the number of HEWs. The RHB agreed in principle, but the number did not increase in many places. Health centre staff provided support to health posts when HEWs were unavailable, which this has worked well.
Disconnect between the health posts and the district health office and health centres regarding the implementation of the CBNC programme Consultations and discussions were held between the TSU and the district health office and health centres on CBNC and health post-based management of PSBI during the end of the first quarter, and quarterly review meetings chaired by the head of the RHB were held to improve the buy-in and ownership of the CBNC by the district health office and health centres. The district health office supervisors were included in the monitoring and evaluation activities of the TSU starting in the second quarter.
Closure of health posts during working hours, especially during campaigns Discussions were held with the district health offices and the HEWs in order to have one HEW at the health post during working hours. Additionally, it was agreed that the health posts would remain open during working hours even during public health campaigns. The district health office committed to send health workers from health centres when both the HEWs were unavailable at the health post.

Discussion

Our data show that the management of PSBI when the referral is not feasible is possible in the Ethiopian context. Coverage of treatment was higher (87%) than our target, which showed good utilization of services. In those who were treated on an outpatient basis, appropriate treatment and treatment completion rates (98%) were also very high. The fast breathing pneumonia in young infants age 7–59 days, which comprised of about two-fifth of all PSBI cases were treated successfully on an outpatient level without a referral. In those treated on an outpatient basis, a low treatment failure rate and no deaths were documented. These findings are in agreement with the findings from AFRINEST study conducted in similar communities from Nigeria, DRC and Kenya [11].

The referral acceptance rate (65%) among young infants with clinical severe infection was high in our study. We believe the main reasons for the better utilization of services and higher referral acceptance was most probably the presence of relatively active WDGs and their leaders to some extent especially after the initial implementation phase, free ambulance service and free treatment of neonates at the receiving health facilities. It resulted in better utilization of CBNC and PSBI services and building trust and confidence in the HEWs and health posts to treat and manage newborn illnesses at the community level when the referral was not feasible. On the other hand, the barriers for referral acceptance were long travel distance, low healthcare-seeking behaviour and cultural barriers as postpartum mothers do confine themselves in their homes till the time of baptism (40 days and 80 days for boys and girls respectively). Other studies have reported various reasons for refusal of referral advice such as economic constraints, distance to the hospital, quality of care or attitude of the health workers, poor referral system and lack of transport, cost of travel and treatment, lack of permission from family members, religious and cultural beliefs, and issues with lack of child care and other logistical problems [2326].

When we compare our data with other PSBI implementation research studies in various countries, we find some similarities and some differences. Our treatment coverage of 87% was a bit lower than that reported by the study in Zaria, Nigeria (96%) [22]; but was higher than those reported from Malawi (64%) [26]; Lucknow, India (53%) [27] and Kushtia, Bangladesh (31%) [28]. Like our study, high treatment completion rates were also reported by Malawi (95%) [26], Zaria, Nigeria (94.1%) [22] and MaMoni project, Bangladesh (80%) [29] in infants with clinical severe infection treated on an outpatient basis. Our proportion of fast breathing pneumonia in 7–59 day-old infants was 60% among those who were identified at a health post or a health centre, compared to 87% in Kushtia, Bangladesh [28], 30% in MaMoni project, Bangladesh [24], 28% in Malawi [26], 22% in Zaria, Nigeria [22] and 13.3% in Lucknow, India [27].

To effectively implement PSBI case management, an important step is to track all pregnant facilitated postnatal home visits, especially in the latter part of the implementation. The strategy of WDGs was conceptualized as a way to identify pregnancies and births, create demand for health care, wellness, and improve access to health care [30]. The close working relationship between the HEWs and WDGs has proven to be an efficient and effective approach to improve women and births in settings similar to the study communities [31, 20]. The involvement of the WDGs in the identification of cases, those who were lost to follow-up, and pregnant women who need close attention and immediate referral can improve the links between WDGs and HEWs and eventually improve care-seeking behaviour of families.

Although postnatal home visits by a trained health worker is an effective intervention to reduce neonatal mortality [3234], less attention was given to these in our study areas. The overall proportion of young infants visited within two days of their birth has been reported to be around 16% in Ethiopia [35]. As neonatal mortality is the highest in the first week of life, timely provision of postnatal care services and prompt identification and appropriate care-seeking for sick young infants helps in reducing neonatal mortality. Large numbers of women and their newborns remain at home during and immediately after birth, so building and reinforcing the links between the community and health facilities is essential to improve the provision of postnatal services. Strengthening this link will be key for the successful implementation of PSBI case management at a community level in the Ethiopian setting. Thus, as a complementary strategy to improving PNC home visits, reinforcing and strengthening the links between the health extension program and the community through the active participation of the WDGs (women development groups) and the links with the midwives who support the skilled deliveries of mothers in the health facilities (health centres/hospitals) is highly recommended.

During the first three months of the implementation period, there were discrepancies in the management of PSBI cases at the health centres and health posts. As health centres did not have facilities for admission, staffs were trained to treat sick young infants with PSBI when a referral was not feasible with twice ampicillin and once gentamicin injections for seven days on an outpatient basis. This was practically difficult, and thus almost all newborns with PSBI that used to come to the health centre ended up being referred to hospital thereby creating unnecessary delay. This issue was brought to the attention of the RHB, and it was agreed that the management of PSBI cases should follow the same protocol as that followed by HEWs. Following this decision, the health centre staffs were trained in PSBI management according to the new guideline. Data regarding PSBI activities were not captured on the District and Health Information System (DHIS) and resulted in discrepancies in what was being reported and done. After discussion with regional and federal health authorities, it was agreed to incorporate a few key indicators regarding PSBI case management in the DHIS. Besides, there were discrepancies between DHIS and CBNC data collection formats, which needed an alignment and due attention and action by the health sector.

The TSU presented the implementation process and the findings together with its challenges and successes to the FMoH and RHB. The national child health technical working group deliberated upon the findings from Tigray and the other study site in Jimma and recommended i) outpatient management of fast breathing pneumonia in a young infant aged 7–59 days with oral amoxicillin without referral and ii) use of gentamicin injection for two days plus oral amoxicillin for 7 days for management of clinical severe infection when a referral is not feasible. These have been now accepted as policy by the government and national IMNCI materials have been revised and are being scaled up in the country [36].

Our findings are sustainable in the absence of the study support and incentives because the implementation was entirely done by the existing health system with modest refresher trainings. These refresher trainings can easily be conducted by the health work force from the nearby health facilities (health centres and hospitals). Moreover, they are generalizable to the Ethiopian setting because the study communities are similar and the CBNC programmes are implemented following the same strategies. Besides the study data tools were adapted from the CBNC register which is used by HPs throughout the country.

There were several keys to successful intervention implementation in our study. First, high acceptance of referral advice and self-referral of sick young infants by families to the hospitals themselves. Second, provision of technical support to HEWs and other workers by expert paediatricians in the TSU and the ability of the TSU to conduct a dialogue with policy-makers for policy revisions and updates. Third, a common understanding of policy-makers (RHB, FMoH) and researchers about the identification and management of PSBI and a common objective of identifying viable solutions to increase access and coverage. The political commitment, health policy of the country, organization of the community and organization of the health care services were enabling factors for successful implementation. Fourth, this implementation research created a platform for discussion on optimization of care at different levels of the health system. The ability of health centres to function as referral sites for HEWs still warrants serious discussion. Finally, the partnership between technical experts, policy-makers and implementers to achieve the same objective was very fruitful. The support from the TSU contributed to the identification of implementation bottlenecks and facilitated problem-solving.

Our study had a couple of limitations, including the discrepancy between the expected and identified number of live births. The absence of direct baseline data before the intervention was another limitation of this study. The links between WDGs and HEWs were not as strong as expected, resulting in poor care-seeking behaviour among the mothers of young infants particularly in the initial stages of the implementation that resulted in relatively low cases in the initial periods of the implementation. The high turnover of the HEWs is another limitation, which is the result of high workload, absence of career structure in the health sector for HEWs and lack of incentives. The situation was felt during the monthly field visits as we were meeting new faces of HEWs. To address the high turnover of the HEWS, increasing the number of HEWs per health post (at least 3), creating career structure for HEWs and the construction of residential houses within the premises of the health posts were discussed with the health authorities to limit the fast turnover. Nonetheless, findings are likely representative of patterns of PSBI case management in rural Ethiopia.

In conclusion, PSBI management at the community level was fully implemented in all the health posts from the two districts with technical assistance from the TSU. The provision of training on assessment, classification and treatment of young infants with PSBI, together with regular mentoring and supervision from the TSU and supervisors and availability of supplies/commodities made HEWs confident to manage PSBI in young infants when a referral was not feasible. The treatment success rate was high with no deaths among PSBI cases managed by HEWs at health posts. Also, young infants 7–59 days with only fast breathing were successfully treated at the health post without a referral, thus increasing the access to treatment to a large proportion of sick young infants. Mortality occurred at the hospital level rather than at the health post level which might be due to sicker infants being referred to a hospital, delay in reaching the hospital or potentially hospital-acquired infections. Potential delays in a presentation at the hospital and quality of care at referral institutions need urgent attention by regional and federal health authorities. In Ethiopia, where neonatal mortality is still very high, management of PSBI when a referral is not feasible is essential. Our data show that it can be implemented at the primary health care level within the existing health system. Finally, the TSU contributed to solving challenges and finding solutions to implement the new guideline successfully. During scale-up, regular mentoring and supportive supervision of health services staff will be essential to achieve the desired goal.

Acknowledgments

The authors are thankful to the study participants and data collectors, specifically the HEWs from Raya Alamata and Raya Azebo Districts. We acknowledge support from the RHB, District Health Offices, health facilities (hospitals, health centres and health posts), FMoH, Save the Children, WHO Headquarters and Mekelle University.

Data Availability

All relevant data are within the manuscript.

Funding Statement

This study was funded by the Bill and Melinda Gates Foundation through a grant to the World Health Organization. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.UNICEF, WHO, World Bank, United Nations Population Division. Levels and trends in child mortality: report 2019. Estimates developed by the UN Interagency Group for Child Mortality Estimation. New York: UNICEF; 2019. Available from: https://childmortality.org/wp-content/uploads/2018/12/UN-IGME-Child-Mortality-Report-2019.pdf.
  • 2.UNICEF, WHO, World Bank, United Nations Population Division. Levels and trends in child mortality: report 2017. Estimates developed by the UN Interagency Group for Child Mortality Estimation. New York: UNICEF; 2017. Available from: http://childmortality.org/files_v21/download/IGME%20report%202017%20child%20mortality%20final.pdf.
  • 3.Seale AC, Blencowe H, Manu AA, Nair H, Bahl R, Qazi SA, et al. Estimates of possible severe bacterial infection in neonates in sub-Saharan Africa, south Asia, and Latin America for 2012: a systematic review and meta-analysis. Lancet Infect Dis. 2014; 14:731–41. 10.1016/S1473-3099(14)70804-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.African Neonatal Sepsis Trial Group. Simplified regimens for management of neonates and young infants with severe infection when hospital admission is not possible: study protocol for a randomized, open-label equivalence trial. Pediatr Infect Dis J. 2013; 32:S26–S32. 10.1097/INF.0b013e31829ff7d1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Darmstadt GL, Bhutta ZA, Cousens S, Adam T, Walker N, de Bernis L, et al. Evidence-based, cost-effective interventions: how many newborn babies can we save? Lancet. 2005; 365:977–88. 10.1016/S0140-6736(05)71088-6 [DOI] [PubMed] [Google Scholar]
  • 6.WHO. Pocketbook of hospital care for children Guidelines for the management of common illnesses with limited resources, 2nd ed. Geneva: WHO; 2013. [Google Scholar]
  • 7.Bang AT, Bang RA, Baitule SB, Reddy MH, Deshmukh MD. Effect of home-based neonatal care and management of sepsis on neonatal mortality: field trial in rural India. Lancet. 1999; 354:1955–61. 10.1016/S0140-6736(99)03046-9 [DOI] [PubMed] [Google Scholar]
  • 8.Baqui AH, Arifeen SE, Williams EK, Ahmed S, Mannan I, Rahman SM, et al. Effectiveness of home-based management of newborn infections by community health workers in rural Bangladesh. Pediatr Infect Dis J. 2009; 28: 304–10. 10.1097/INF.0b013e31819069e8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Khanal S, Sharma J, GC VS, Dawson P, Houston R, Khadka N, et al. Community health workers can identify and manage possible infections in neonates and young infants: MINI—a model from Nepal. J Health Popul Nutr. 2011; 29: 255–64. 10.3329/jhpn.v29i3.7873 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.African Neonatal Sepsis Trial (AFRINEST) Group, Tshefu A, Lokangaka A, Ngaima S, Engmann C, Esamai F, et al. Oral amoxicillin compared with injectable procaine benzylpenicillin plus gentamicin for treatment of neonates and young infants with fast breathing when referral is not possible: a randomised, open label, equivalence trial. Lancet. 2015; 385:1758–66. 10.1016/S0140-6736(14)62285-6 [DOI] [PubMed] [Google Scholar]
  • 11.African Neonatal Sepsis Trial (AFRINEST) Group, Tshefu A, Lokangaka A, Ngaima S, Engmann C, Esamai F, et al. Simplified antibiotic regimens compared with injectable procaine benzylpenicillin plus gentamicin for treatment of neonates and young infants with clinical signs of possible serious bacterial infection when referral is not possible: a randomised, open-label, equivalence trial. Lancet. 2015; 385:1767–76. 10.1016/S0140-6736(14)62284-4 [DOI] [PubMed] [Google Scholar]
  • 12.Baqui A, Saha S, Ahmed A, Shahidulla M, Quasem I, Roth DE, et al. Safety and efficacy of alternative antibiotic regimens compared with 7 day injectable procaine benzylpenicillin and gentamicin for outpatient treatment of neonates and young infants with clinical signs of severe infection when referral is not possible: a randomised open-label, equivalence trial. Lancet Glob Heal. 2015; 3: e279–87. [DOI] [PubMed] [Google Scholar]
  • 13.Mir F, Nisar I, Tikmani SS, Baloch B, Shakoor S, Jehan F, et al. Simplified antibiotic regimens for treatment of clinical severe infection in the outpatient setting when referral is not possible for young infants in Pakistan (Simplified Antibiotic Therapy Trial [SATT]): a randomised, open-label, equivalence trial. Lancet Glob Health. 2017; 5: e177–e185. 10.1016/S2214-109X(16)30335-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.WHO. Guideline: managing possible serious bacterial infection in young infants when referral is not feasible. Geneva: WHO; 2015. Available from: https://apps.who.int/iris/bitstream/handle/10665/181426/9789241509268_eng.pdf?sequence=1 [PubMed] [Google Scholar]
  • 15.Hailegebriel TD, Mulligan B, Cousins S, Mathewos B, Wall S, Bekele A, et al. Effect on neonatal mortality of newborn infection management at health post when referral is not possible: a cluster randomized trial in rural Ethiopia. Glob Health Sci Prac. 2017; 5(2):202–16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Simieneh et al. Mothers’health care seeking behavior and associated factors for common child hood illnesses. North west Ethiopia: Community based cross-sectional study. BMC Health Services Research (2019) 19:59 10.1186/s12913-019-3897-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Population Census Commission, Ethiopia. Statistical report of the 2007 population and housing census. Addis Ababa, Ethiopia: Population Census Commission; 2007.
  • 18.Central Statistical Agency (CSA) [Ethiopia] and ICF. Ethiopia Demographic and Health Survey 2016. Addis Ababa, Ethiopia, and Rockville, Maryland, USA: CSA and ICF; 2016.
  • 19.Tigray Regional Health Bureau. Annual Profile 2013, Mekelle, Tigray, Ethiopia. Tigray Regional Health Bureau; 2013.
  • 20.Teklehaimanot HD, Teklehaimanot A. Human resource development for a community-based health extension program: a case study from Ethiopia. Human Resources for Health 2013, 11:39 Available from: http://www.human-resources-health.com/content/11/1/39. 10.1186/1478-4491-11-39 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.World Health Organization. Integrated management of childhood illness. Management of the sick young infant aged up to 2 months Chart Booklet. World Health Organization, Geneva 2019. https://apps.who.int/iris/bitstream/handle/10665/326448/9789241516365-eng.pdf?ua=1
  • 22.Wammanda RD, Adamu SA, Joshua HD, Nisar YB, Qazi SA, Aboubaker S, et al. (2020) Implementation of the WHO guideline on treatment of young infants with signs of possible serious bacterial infection when hospital referral is not feasible in rural Zaria, Nigeria: [DOI] [PMC free article] [PubMed]
  • 23.Kozuki N, Guenther T, Vaz L, Moran A, Soofi SB, Kayemba CN, et al. A systematic review of community-to-facility neonatal referral completion rates in Africa and Asia. BMC Public Health. 2015. December; 15 (1):989 10.1186/s12889-015-2330-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Applegate JA, Ahmed S, Khan MA, et al. Early implementation of guidelines for managing young infants with possible serious bacterial infection in Bangladesh. BMJ Glob Health. 2019;4(6):e001643 Published 2019 Nov 19. 10.1136/bmjgh-2019-001643 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Owais A, Sultana S, Stein AD, Bashir NH, Awaldad R, Zaidi AK. Why do families of sick newborns accept hospital care? A community-based cohort study in Karachi, Pakistan. J Perinatol. 2011. September; 31 (9):586–92. 10.1038/jp.2010.191 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Guenther T, Mopiwa G, Nsona H, Qazi S, Makuluni R, Fundani CB, et al. Feasibility of implementing the World Health Organization case management guideline for possible serious bacterial infection among young infants in Ntcheu district, Malawi. PLoS One. 2020;15:e0229248 10.1371/journal.pone.0229248 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Awasthi S, Kesarwani N, Verma RK, Agarwal GG, Tewari LS, Mishra RK, et al. Identification and management of young infants with possible serious bacterial infection where referral was not feasible in rural Lucknow district of Uttar Pradesh, India: An implementation research. PLoS One. 2020:15(6):e0234212. 10.1371/journal.pone.0234212 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Rahman AE, Herrera S, Rubayet S, et al. Managing possible serious bacterial infection of young infants where referral is not possible: Lessons from the early implementation experience in Kushtia District learning laboratory, Bangladesh. PLoS One. 2020;15(5):e0232675 Published 2020 May 11. 10.1371/journal.pone.0232675 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Applegate JA, Ahmed S, Harrison M, Callaghan-Koru J, Mousumi M, Begum N, et al. Provider performance and facility readiness for managing infections in young infants in primary care facilities in rural Bangladesh. PLoS One. 2020;15:e0229988 10.1371/journal.pone.0229988 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.The Federal Democratic Republic of Ethiopia Ministry of Health. Health Sector Transformation Plan 2015/16–2019/20 (2008–2012 EFY). Addis Ababa, Ethiopia: Federal Ministry of Health; 2015.
  • 31.Debeb HG. Maternal mortality, then, now, and tomorrow: the experience of Tigray Region, Northern Ethiopia. Department of Public Health and Clinical Medicine, Epidemiology and Global Health, Umea University Sweden: 2016.
  • 32.Baqui AH, Ahmed S, Arifeen SE, Darmstadt GL, Rosecrans AM, Mannan I, et al. Effect of timing of first post natal home visit on neonatal mortality in Bangladesh: an observational cohort study. BMJ. 2009; 10.1136/bmj.b2826 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Duysburgh E, Kerstens B, Kouanda S, Kaboré CP, Yugbare DB, Gichangi P, et al. Opportunities to improve postpartum care for mothers and infants: design of context-specific packages of postpartum interventions in rural districts in four sub-Saharan African countries. BMC Pregnancy Childbirth. 2015; 15: 131–42. 10.1186/s12884-015-0562-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.WHO, UNICEF Joint statement on home visits. Geneva: WHO; 2009. Available from: https://apps.who.int/iris/bitstream/handle/10665/70002/WHO_FCH_CAH_09.02_eng.pdf?sequence=1.
  • 35.McPherson R, Hodgins S. Postnatal home visitation: Lessons from country programs operating at scale. J Glob Health. 2018;8(1):010422 10.7189/jogh.08.010422 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Government of Ethiopia. Integrated Community Management of Newborn and Childhood Illness; ICMNCI Chart Booklet. Federal Ministry of Health, Addis Ababa, June 2018.

Decision Letter 0

Lawrence Palinkas

26 Jun 2020

PONE-D-20-08171

Innovative approach for potential scale-up to jump-start simplified management of sick young infants with possible serious bacterial infection when referral is not feasible: findings from implementation research

PLOS ONE

Dear Dr. Luel,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 26 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Lawrence Palinkas

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: No

Reviewer #3: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This study is an important contribution as it provides evidence of the feasibility of implementing the PSBI guideline in Ethiopia and identifies challenges and their solutions. However, the manuscript requires revision and restructuring to be ready for publication (particularly the methods section).

Specific suggestions and questions are provided by section below:

METHODS:

Context and setting:

• Correct discrepancy – last sentence of introduction states: “in two regions in Ethiopia, Tigray and Jimma” while methods mention only two districts of Tigray (nothing in Jimma). Issue occurs again in last sentence of data management section: “Common data collection tools and the database were used by both the Tigray and Jimma sites”

• Would be useful to provide readers a bit more information on characteristics of HEWs (female, education and training levels). In addition, 17 activities of HEWs mentioned but not described – suggest to give examples and/or provide reference for people to have more info on HEWs and their roles

• Health system is well-described but there is little information provided on the communities (beyond the population size) – recommend to also provide short description of the community socio-demographics

Study population: the study tracked all live births during the study period to determine the denominator for estimated coverage – therefore the study population should be expanded to indicate that all babies born during the study period were included in the study and differentiate between those infants that were identified as sick and then treated through the study.

Primary and secondary outcomes: these are not sufficiently described or defined. Each primary and secondary outcome should be defined, ideally in a table. In addition, secondary outcomes should be expanded to include other indicators that are reported on in the results (e.g. follow-up, accuracy of HEWs)

Sample size determination is missing – should be added to Methods section.

Intervention: this section repeats information on the health system covered on content and that could be removed. Information on follow-up schedule (when, where, by who) should be included here.

Data management: should be revised to “Data collection and data management” and include information on the schedule for data collection (Day 3, Day 7? Etc)

Implementation phases:

- Phases of implementation: This section is very long and while important, could be condensed using tables with additional information provided in supplementary files. Specifically – recommend covering roles and responsibilities of each stakeholder group in a table (either in paper or supplementary file)

- Implementation Phase: it would help the reader to include a figure showing how cases of sick young infants were identified, referred, treated and followed up.

- Some content under patient identification should be included in results or discussion section – specifically: “In the initial stages, the demand side was weak which improved, particularly in those areas where WDGs and their leaders were more active. It resulted in better utilization of CBNC and PSBI services and building trust and confidence in the HEWs and health posts to treat and manage newborn illnesses at the community level when referral was not feasible.”

- Incentives– information on incentives to HEWs is included under the “Role of the District Health Office” but should be included under the “Implementation Phase” with its own sub-heading. Any other incentives provided through the study should be described here as well.

RESULTS:

- A table with results for the 117 children that accepted referral to the hospital and the 333 children who went directly to the hospital should be included (if not possible should be explained why not)

- Implementation challenges and solutions – a long list is provided, and it would be helpful for the reader to categorize or group these challenges somehow (perhaps into what stage – patient identification, referral, treatment, follow-up)

DISCUSSION:

- First sentence should include references to identify the studies referred to

- What are the reasons that acceptance of referral was so high in this setting? This contrasts with many other studies and deserves some attention in the discussion – particularly given the mortality that occurred there.

- The sentence” To effectively implement PSBI case management, the first step is to track all pregnant women and births” is misleading – it is possible to provide PSBI case management without this (as per Malawi example), but facility delivery levels and care-seeking must be high – so should be reworded to be specific to this context

- Study recommends strengthening postnatal home visits - what specifically should be done and how effective are these likely to be. The literature shows that obtaining high coverage of PNC home visits has not been successful in most settings (<20% coverage)– suggest referring to analysis by McPherson (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6005634/) and providing potential alternative/complementary strategies to increase identification of sick young infants

- High turnover of HEWs is mentioned as a limitation only in passing but would be quite important to understand – this should be elaborated on (what level of turnover, what possible reasons and what might be done to limit it)

- Discussion should address how generalizable are the findings to other settings in Ethiopia and how likely these results are to be sustained in the absence of the study support and incentives

Minor comment: Paper should receive a careful final edit as there are several typos and incomplete sentences.

Reviewer #2: Please see full attached comments.

General issues:

-terminology is interchanged and unclear throughout. What is the difference between sick young infants, PSBI, critical illness and clinical severe illness? These terms need to be defined and using distinctly.

-Unclear whether this study is looking at infants <2 months or 7-59 days as both are used

-More sophisticated data analysis should be used. For quality improvement/implementation research, a run chart or statistical process control chart (preferred) is necessary to demonstrate significant change due to interventions.

-There is no statistical significance reported for data analysis. The data is reported without any analysis provided. Overall rates are reported but there is no comparison to baseline data or trends over time. This is not standard for implementation research and prevents any conclusions to be made in terms of effectiveness of the interventions.

-There is no comparison of post-implementation data to a baseline data set. Baseline rates reported as “low” but the data are not reported. This prevents any conclusions that the interventions were successful.

-A key driver diagram is essential to a quality improvement/implementation project. This should be included to demonstrate the issues/barriers and linkage with interventions to achieve aims.

-The discussion of the interventions and practical strategies for implementation is strong. However, the data analysis is not strong enough to support conclusions of success. This manuscript is more descriptive of intervention implementation and barriers/solutions than true quality improvement research.

-There are so many different facets of this project and elements of data described, it may be helpful to narrow the focus so the key outcomes can be more prominent.

-The manuscript is very long. Please streamline where appropriate.

-occasional grammatical issues and typos throughout

Reviewer #3: Comments to the author:

General comment:

The topic is of interest and timely. However, major revisions are needed to make it publishable. Editing is needed to ensure clarity of writing.

Specific comments:

1.There are inconsistencies in between study objective, methods and presentation of results. Although the authors have mentioned that they have reported only the quantitative data, some of the findings are certainly not from quantitative data. For example, the results presented under ‘implementation challenges and solutions ‘and in Table 3.

On the other hand, at the end of ‘introduction’ section, the authors stated ‘’objective of the study was to implement a simplified antibiotic regimen (2 days gentamicin injection and 7 days oral amoxicillin) in a programme setting and to identify and document the challenges and opportunities for implementation at health post level in two regions in Ethiopia, Tigray and Jimma.’’ Organized, triangulated and sequential presentation of both the quantitative and qualitative findings may serve the purpose of this objective.

2.Under ‘ Context and setting of the study’ of the Methods section, the authors have mentioned “ the Primary Health Care Unit (PHCU) at the lowest level consists of five health posts, one health centre and one primary hospital. ……………” Later on, the authors have stated “A PHCU feeds into the secondary level of health care”. These are confusing. Need to be clear.

‘Specifically, they are expected to conduct postnatal home visits on days 1, 3, 7 and 42 as per the MNCH guideline.’ Who are they? Are they the HEWs or women from WDGs? Please make it clear.

3.Study design is not clear. Detailed description of the study design is needed for clear understanding.

4.First sentence under ‘study population’ of the Methods section needs to be rephrased.

5.First five sentences under ‘Intervention’ do not provide any information relating to intervention. These should go either under ‘introduction’ or study setting’. These are relating to Ethiopian health system and already briefly described under ‘introduction’ section, though.

6.Under ‘Ethical considerations’, the last sentence is not clear. It needs to be rephrased for clarity.

7.Data analysis section is not clear. It needs to be edited.

8.Before drawing a conclusion like ‘When referral is not feasible, PSBI management can be implemented safely and effectively at health posts by HEWs in the existing health system in Ethiopia’’, the author should perform analysis comparing the cases under different variables, between health posts and health centre, and show how statistically significant the results are. For example, compliance to treatment: health posts vs health centers; declared clinically treatment success: health posts vs health centers/hospitals

9.The authors should use a reference for making such a statement ‘Our data show that management of PSBI when referral is not feasible is possible in the Ethiopian context in line with data reported previously.’ (First sentence of the discussion section)

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Tanya Guenther

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: plos one review.docx

Decision Letter 1

Lawrence Palinkas

9 Oct 2020

PONE-D-20-08171R1

Innovative approach for potential scale-up to jump-start simplified management of sick young infants with possible serious bacterial infection when referral is not feasible: findings from implementation research

PLOS ONE

Dear Dr. Luel

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Nov 23 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Lawrence Palinkas

Academic Editor

PLOS ONE

Additional Editor Comments (if provided):

Thank you for submitting a revised version of this manuscript. It is quite evident that you have devoted considerable effort to respond to the comments and suggestions provided by the reviewers of the original manuscript. Although the revised version is somewhat responsive to these comments, as you will note from their reviewers of the revised manuscripts, some significant issues remain. Of particular concern is the absence of baseline data and use of only descriptive statistics to reach your conclusions. Your rationale for doing so is not entirely satisfactory. The drawing of conclusions based on rates found in other countries remains subjective, especially since no comparisons were made between implementation experiences in Ethiopia and these other countries. We suggest you pay particular attention to these comments in considering whether to submit another revision. We also note that your justification of sample size also requires some explanation. Typically, a power analysis is provided to determine whether your sample is sufficiently large to test your hypotheses. Your response lacks any calculation of statistical power, perhaps because you conducted no statistical analysis.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: (No Response)

Reviewer #3: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: No

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: No

Reviewer #3: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: No

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: General –

- review grammar thoroughly, there are scattered missing articles (“the”, “an”) and incomplete sentences.

-Description of intervention planning and stakeholders is much improved.

-Manuscript is generally much easier to understand from an outside perspective.

-Were the interventions adapted/adjusted throughout the study period based on the data or was this system implemented at once and then data reviewed at the end of the study period? There are barriers and solutions described but it is not clear if these were determined based on data or subjective reporting of issues/concerns.

-You address barriers and solutions and that quality control was monitored monthly, however the data is only displayed as totals without showing change over time. How often was the data analyzed?

-Since there is no baseline data reported, you should explain why this is the case and that you used comparisons of other sites without your interventions. Even changes of the initial quarter to the final quarter could show improvement as the interventions were accepted and modified but there doesn’t seem to be any comparison over time. The treatment coverage rate referenced early in the paper is not restated compared to your results in the discussion to show that you achieved your aims. It is also not clear if this was a similar or the same community.

Since there is no direct baseline data, that is a significant limitation of the results that needs to be addressed in the discussion.

-Much better use of tables and figures to elaborate on information. Data is more completely described.

-The manuscript is still quite long – try to find ways to make wording more concise and eliminate any unnecessary detail.

Specific -

Line 75- An estimated 2.5 million neonatal deaths worldwide and 1 million deaths in Sub Saharan Africa 75occurred in 2018 contributing to 36% and 47% of under-5deathsrespectively

-Is the 1 million included in the 2.5 million or additional? Clarify.

Line 77 - Neonatal infections primarily bacterial in origin, including pneumonia, sepsis, and meningitis

-Sepsis is a clinical diagnosis that can result from a number of types of bacterial infections (including pneumonia and meningitis). Do you mean bacteremia? Clarify.

Line 110-113 – too much detail on farming/agriculture that is not applicable to the study

Line 133 – Previously stated that this is implementation research, however study design here says longitudinal study design.

Line 143 – incomplete sentence

Line 145-147 – There seems to be 2 primary outcomes – identification of 80% of infants and treatment of 80% of infants. Please make this statement clearer.

Secondary outcomes – did you have any targets for these?

Line 155 - swelling local to injection site

-Local swelling at injection site

Line 192- woreda is not a commonly known word

Line 228-231 – since this was not an issue, consider eliminating this section

Line 247 – CRF is defined later and should be defined with this first acronym use

Line 255-257 – redundant, information provided earlier and this is not specific to data collection

Line 260 – Earlier you discuss only Tigray, not Jimma.

Line 265 – I do not believe treatment failures is defined.

Line 261 – How often was data reviewed/analyzed? Was this done throughout the study period or retrospective on conclusion of the study period?

Line 288 – Was there a goal for the percent identified by HEWs? If so, please add target line to figure. I would write out sentence with your initial percent (8.4%) and final percent (29.2%) here in results in addition to demonstrating in figure.

Results – serious adverse effects was listed as a secondary outcome and this is not addressed in results

Figure 2 – The depiction of this data is confusing. It appears that this is the total number of cases of PSBI identified by the HEWs and how many were identified of this total through each quarter. It does not reflect the number appropriately identified or categorized which is the actual information of interest. I’m not sure you can interpret that a better identification rate occurred because there may have just been more cases during a particular quarter. Your denominator to say identification increased would have to include infants with delayed identification or identification by other means, showing how many the HEWs identified vs missed. You could instead show improvement in their skills based on the number per quarter that were misclassified based on review by the pediatrician, with this number hopefully decreasing as the intervention progressed.

Line 331 – You discuss the referral acceptance rate, however this was not included in your primary or secondary outcomes.

Line 360-361 – incomplete sentence

Line 428 – this is very subjective.

Implementation challenges and solutions should be part of the methods section. This is an essential part of your interventions and the description of the implementation process.

Reviewer #3: Thanks to the authors. However, still there are inconsistencies in between study objective, methods and presentation of results. The authors mentioned that the objective of this implementation research was to implement a simplified antibiotic regimen (2 days gentamicin injection and 7 days oral amoxicillin) for management of sick young infants with PSBI in a programme setting when referral was not feasible to achieve an overall treatment coverage of at least 80% in two districts in Tigray, Ethiopia (line 102-105). The objective of an implementation research is to produce evidence, not to implement a programme only.

Without having any counterfactuals and based only on descriptive statistical analysis, it is not sufficient to draw a conclusion that when referral is not feasible, young infants with PSBI can be managed appropriately at health posts by HEWs in the existing health system in Ethiopia. Rather the authors could explore the factors associated with the high coverage (identification and treatment of 87% young infants with PSBI) with inferential analysis, and with the support of more qualitative data.

The authors also mentioned that they collected both the quantitative and qualitative data and they also reported some qualitative findings. It was not mentioned in the method section how the qualitative data were collected and analysed.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Feb 5;16(2):e0244192. doi: 10.1371/journal.pone.0244192.r004

Author response to Decision Letter 1


30 Nov 2020

Point by point responses to reviewers’ comments

Journal: PLOS ONE

Manuscript ID: PONE-D-08171

Manuscript Title: Innovative approach for potential scale-up to jump-start simplified management of sick young infants with possible serious bacterial infection when a referral is not feasible: findings from implementation research

Reviewer 2

1. General:

Comment # 1

- review grammar thoroughly, there are scattered missing articles (“the”, “an”) and incomplete sentences.

Author’s response:

Thank you. we have corrected the grammatical mistakes and the manuscript has been reviewed by a native English speaker.

Comment # 2

-Description of intervention planning and stakeholders is much improved.

Author’s response: Thank you.

Comment # 3

-Manuscript is generally much easier to understand from an outside perspective.

Author’s response: Thank you.

Comment # 4

-Were the interventions adapted/adjusted throughout the study period based on the data or was this system implemented at once and then data reviewed at the end of the study period. There are barriers and solutions described but it is not clear if these were determined based on data or subjective reporting of issues/concerns.

Author’s response:

Thank you. Since the study was implementation research, the interventions were adapted or adjusted based on the data collected. The sources of the data for the adjustment of interventions were quarterly review meetings, clinical mentoring, monitoring and evaluation checklist completed during the supportive supervision and follow up data collected using the CRFs (Case Reporting Forms).

Comment # 5

-You address barriers and solutions and that quality control was monitored monthly, however, the data is only displayed as totals without showing change over time. How often was the data analyzed?

Author’s response:

Thank you. We have presented our data in such a way that changes over time are displayed against the target and coverage (Please see Figure 1). The follow-up data from the case report forms were collected every month. The analysis was carried out quarterly. The field supervisor visited the health facilities every month for supportive supervision and clinical mentoring and provided on-site feedbacks to the problems encountered.

Comment # 6

-Since there is no baseline data reported, you should explain why this is the case and that you used comparisons of other sites without your interventions. Even changes in the initial quarter to the final quarter could show improvement as the interventions were accepted and modified but there doesn’t seem to be any comparison over time. The treatment coverage rate referenced early in the paper is not restated compared to your results in the discussion to show that you achieved your aims. It is also not clear if this was a similar or the same community.

Author’s response:

Thank you. The management of PSBI in young infants was not available in the study communities before the implementation of this research, therefore no comparative baseline data were available for comparison. But, the coverage of young infants with PSBI managed by the health extension workers (excluding those who directly went to a hospital) showed an improvement from 37% in the first quarter to 78% in the last quarter. We compared our findings with another study from Ethiopia referenced in our introduction [ref 15 in the list of references] . Also, our findings were in agreement with the AFRINEST study[ref 11 in the list of references] . The absence of direct baseline data is included as a limitation of this study as per the suggestion from the reviewer.

Page 13 line 283 – 285 of the revised manuscript

Page 15, line 327 – 328 of the revised manuscript

Fig 1. Of the revised manuscript

Comment # 7

-Much better use of tables and figures to elaborate on the information. Data is more completely described.

Author’s response: Thank you.

Comment # 8

-The manuscript is still quite long – try to find ways to make the wording more concise and eliminate any unnecessary detail.

Author’s response:

Thank you. We have tried to make it as concise as possible.

2. Specific:

Comment # 1

Line 75- An estimated 2.5 million neonatal deaths worldwide and 1 million deaths in Sub Saharan Africa occurred in 2018 contributing to 36% and 47% of under-5 deaths, respectively

-Is the 1 million included in the 2.5 million or additional? Clarify.

Authors’ response

Thank you for the clarification. Yes, the one million deaths are included in the 2.5 million neonatal deaths and the sentence was re-written as follows.

In 2018, an estimated 2.5 million neonatal deaths occurred worldwide, of which 1 million were in Sub Saharan Africa contributing to 36% and 47% of under-5 deaths respectively.

Page 5; line 80 - 81 of the revised manuscript.

Comment #2

Line 77 - Neonatal infections primarily bacterial in origin, including pneumonia, sepsis, and meningitis

-Sepsis is a clinical diagnosis that can result from a number of types of bacterial infections (including pneumonia and meningitis). Do you mean bacteremia? Clarify

Authors’ response

Thank you. Sepsis refers to the presence of bacteria in the blood with clinical manifestations. But, bacteremia is the presence of bacteria in blood. Hence it implies sepsis not bactermia.

Page 5; Line 82 -83 of the revised manuscript.

Comment #3

Line 110-113 – too much detail on farming/agriculture that is not applicable to the study.

Authors’ response

Thanks. We have removed the redundant information from the revised manuscript. The information was included to address the comments from another reviewer.

Comment #4

Line 133 – Previously stated that this is implementation research, however study design here says longitudinal study design.

Authors’ response

Thank you. The research design is a longitudinal study design since data were collected prospectively from each young infant through a period of 20 months. But, the strategy used to implement the research design was implementation research. We have revised the text to make it clearer.

Page 7; line 135 of the revised manuscript.

Comment #5

Line 143 – incomplete sentence

Authors’ response

Thank you for the comment. Addressed as per the reviewer’s comments.

All babies born during the study period were included in the study. Young infants up to 2 months of age with one or more signs of PSBI (Panel 1) who were permanent residents of Raya Alamata and Raya Azebo districts were included.

Page 7 ; line 147

Comment #6

Line 145-147 – There seems to be 2 primary outcomes – identification of 80% of infants and treatment of 80% of infants. Please make this statement clearer.

Secondary outcomes – did you have any targets for these?

Authors’ response

Thank you for the clarification.

The sentence is rewritten as follows: The primary outcome of this study was identification of at least 80% of the PSBI cases and provision of appropriate treatment for at least 80% of those identified cases of PSBI in young infants aged up to 2 months. We did not have any targets for the secondary outcomes but we monitored their occurrences.

Page 7; line 149 - 151 of the Revised Manuscript.

Comment #7

Line 155 - swelling local to injection site

-Local swelling at injection site

Authors’ response

Thanks. The sentence was corrected as per the recommendation.

Local swelling at the injection site

Page 8; Line 159- of the revised manuscript.

Comment #8

Line 192- woreda is not a commonly known word

Authors’ response

Thank you. We have replaced the word woreda by the district.

Pages10; line 196 of the revised manuscript.

Comment #9

Line 228-231 – since this was not an issue, consider eliminating this section

Authors’ response

Thank you. Supplies and commodities section is removed from the manuscript.

Comment #10

Line 247 – CRF is defined later and should be defined with this first acronym use

Authors’ response

Thanks. Comment is well taken and corrected. Case reporting forms (CRFs)

Page 12; line 247

Comment #11

Line 255-257 – redundant, information provided earlier and this is not specific to data collection

Authors’ response

Thank you for the comment. Redundant information is removed.

Comment #12

Line 260 – Earlier you discuss only Tigray, not Jimma.

Authors’ response

Thank you. The sentence is removed.

Comment #13

Line 265 – I do not believe treatment failure is defined.

Authors’ response

Thank you for this comment. Treatment failure was defined as clinical deterioration at any time and/ or failure to respond on day 4 of treatment.

Page 12; line 261 – 262 of the revised manuscript

Comment #14

Line 261 – How often was data reviewed/analyzed? Was this done throughout the study period or retrospective on conclusion of the study period?

Authors’ response

Thank you. Data was reviewed frequently on arrival to the data management center at Mekelle University for its completeness and was analyzed quarterly for the review meetings. Complete data analysis was done at the end of the project.

Comment #15

Line 288 – Was there a goal for the percent identified by HEWs? If so, please add target line to figure. I would write out sentence with your initial percent (8.4%) and final percent (29.2%) here in results in addition to demonstrating in figure.

Authors’ response

Thank you.

Yes. The HEWs were expected to identify at least 80% of PSBI cases reported from the districts. We have modified figure 1 to include coverage from the target than the proportion. The coverage of identification of PSBI by the HEWs improved 37% in the first quarter to 78% in the last quarter. This coverage doesn’t include those who went directly to the hospital.

Page 13 line 280 – 281 of the revised manuscript

Page 15, line 323 – 324 of the revised manuscript

Figure 1 in the revised manuscript

.

Comment #16

Results – serious adverse effects was listed as a secondary outcome and this is not addressed in results

Authors’ response

Thank you for the comment. It is included in the result section. No serious adverse effect or death was reported.

Page 14, line 288

Comment #17

Figure 2 – The depiction of this data is confusing. It appears that this is the total number of cases of PSBI identified by the HEWs and how many were identified of this total through each quarter. It does not reflect the number appropriately identified or categorized which is the actual information of interest. I’m not sure you can interpret that a better identification rate occurred because there may have just been more cases during a particular quarter. Your denominator to say identification increased would have to include infants with delayed identification or identification by other means, showing how many the HEWs identified vs missed. You could instead show improvement in their skills based on the number per quarter that were misclassified based on review by the pediatrician, with this number hopefully decreasing as the intervention progressed.

Authors’ response

Thank you. Figure 2 was included after a suggestion from reviewer 1 and has been accepted favourably. This figure intended to show the flow from livebirths to PSBI cases being identified and managed at different places of health care. We also documented their outcomes. We have revised figure 1 to provide information about the number of PSBI cases identified in each quarter.

Comment #18

Line 331 – You discuss the referral acceptance rate, however, this was not included in your primary or secondary outcomes

Authors’ response

Thank you for the comment. It is included as a secondary outcome.

Page 8; line 156 of the revised manuscript.

Comment #19

Line 360-361 – incomplete sentence

Authors’ response

Thank you for the comment. The incomplete sentence was removed.

Comment # 20

Line 428 – this is very subjective.

Authors response.

Thank you. This statement emanated from the findings presented in Figure 1. The coverage of PSBI identification during the early stages of the implementation was 30% and subsequently increased up to 62% due to the training provided to the HEWs and WDG leaders (Table 4).

Comment # 21

Implementation challenges and solutions should be part of the methods section. This is an essential part of your interventions and the description of the implementation process.

Author’s response

Thank you for your comment. We, however, believe that the implementation challenges and solutions were a result of our implementation research and we couldn’t have anticipated these challenges and their solutions beforehand.

Reviewer 3

Reviewer #3: Thanks to the authors. However, still there are inconsistencies in between study objective, methods and presentation of results. The authors mentioned that the objective of this implementation research was to implement a simplified antibiotic regimen (2 days gentamicin injection and 7 days oral amoxicillin) for management of sick young infants with PSBI in a programme setting when referral was not feasible to achieve an overall treatment coverage of at least 80% in two districts in Tigray, Ethiopia (line 102-105). The objective of an implementation research is to produce evidence, not to implement a program only.

Without having any counterfactuals and based only on descriptive statistical analysis, it is not sufficient to draw a conclusion that when referral is not feasible, young infants with PSBI can be managed appropriately at health posts by HEWs in the existing health system in Ethiopia. Rather the authors could explore the factors associated with the high coverage (identification and treatment of 87% young infants with PSBI) with inferential analysis, and with the support of more qualitative data.

The authors also mentioned that they collected both the quantitative and qualitative data and they also reported some qualitative findings. It was not mentioned in the method section how the qualitative data were collected and analysed.

Author’s responses

• Inconsistencies – In light of the comments, we have made the objective, methods and result sections consistent. The objectives are made to describe concisely what the research is trying to achieve (the results) through the approaches described in the method section. Implementation research in health is essential to improving the understanding of the challenges health systems face and how they impact implementation. Thus, in this implementation research, we have identified the contextual challenges affecting the implementation of PSBI in a program setting in two districts from Tigray, Ethiopia.

Thus the objective of this study was to implement a simplified antibiotic regimen (2 days gentamicin injection and 7 days oral amoxicillin) for management of sick young infants with PSBI in a programme setting when a referral was not feasible to identify at least 80% of PSBI cases, achieve an overall adequate treatment coverage of at least 80% and document the challenges and opportunities for implementation at the community level in two districts in Tigray, Ethiopia.

Page 6; line 105 – 110 of the revised manuscript

• Data analysis – We used descriptive analysis for analysis. This intervention was new in this community and before the initiation of this implementation research, this service was not provided in these communities. Our data showed that high treatment coverage was achieved for young infants with signs of PSBI. If one compares with previously published data from elsewhere in Ethiopia of 50% coverage after the intervention [reference 15 cited as footnote 1 on page 2], our results demonstrate a higher treatment coverage of 87%.

• Methods for qualitative data – Both quantitative and qualitative data were collected. But, in this manuscript, we primarily reported the quantitative findings. However, the results summarized in table 4 were qualitative data synthesized from the case report forms, review meetings, clinical mentoring visits and supportive supervision reports.

Attachment

Submitted filename: Point by point responses_reviewers_Oct17102020_CLEAN_SQ.doc

Decision Letter 2

Lawrence Palinkas

7 Dec 2020

Innovative approach for potential scale-up to jump-start simplified management of sick young infants with possible serious bacterial infection when referral is not feasible: findings from implementation research

PONE-D-20-08171R2

Dear Dr. Luel,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Lawrence Palinkas

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Lawrence Palinkas

25 Jan 2021

PONE-D-20-08171R2

Innovative approach for potential scale-up to jump-start simplified management of sick young infants with possible serious bacterial infection when a referral is not feasible: findings from implementation research

Dear Dr. Luel:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Lawrence Palinkas

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: plos one review.docx

    Attachment

    Submitted filename: Point by point responses_reviewers_28 Aug 2020.docx

    Attachment

    Submitted filename: Point by point responses_reviewers_Oct17102020_CLEAN_SQ.doc

    Data Availability Statement

    All relevant data are within the manuscript.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES