Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Jul 7;16(7):e0252700. doi: 10.1371/journal.pone.0252700

Lessons from implementation research on community management of Possible Serious Bacterial Infection (PSBI) in young infants (0-59 days), when the referral is not feasible in Palwal district of Haryana, India

Rupak Mukhopadhyay 1,#, Narendra Kumar Arora 1,*,#, Pradeep Kumar Sharma 2, Suresh Dalpath 2, Priya Limbu 1, Geetanjali Kataria 1, Rakesh Kumar Singh 1, Ramesh Poluru 1, Yogesh Malik 2, Ajay Khera 3, P K Prabhakar 3, Saket Kumar 2, Rakesh Gupta 2, Harish Chellani 4, Kailash Chander Aggarwal 4, Ratan Gupta 4, Sugandha Arya 4, Samira Aboubaker 5, Rajiv Bahl 6, Yasir Bin Nisar 6, Shamim Ahmad Qazi 5
Editor: Ricardo Q Gurgel7
PMCID: PMC8279773  PMID: 34234352

Abstract

Background

Neonatal sepsis is a major cause of death in India, which needs hospital management but many families cannot access hospitals. The World Health Organization and the Government of India developed a guideline to manage possible serious bacterial infection (PSBI) when a referral is not feasible. We implemented this guideline to achieve high coverage of treatment of PSBI with low mortality.

Methodology

The implementation research study was conducted in over 50 villages of Palwal district, Haryana during August 2017-March 2019 and covered a population of 199143. Policy dialogue with central, state and district health authorities was held before initiation of the study. A baseline assessment of the barriers in the implementation of the PSBI intervention was conducted. The intervention was implemented in the program setting. The research team collected data throughout and also co-participated in the implementation of the intervention for the first six months to identify bottlenecks in the health system and at the community level. RE-AIM framework was utilized to document implementation strategies of PSBI management guideline. Implementation strategies by the district technical support unit (TSU) included: (i) empower mothers and families through social mobilization to improve care-seeking of sick young infants 0–59 days of age, (ii) build capacity through training and build confidence through technical support of health staff at primary health centers (PHC), community health centers (CHC) and sub-centers to manage young infants with PSBI signs and (iii) improve performance of accredited social health activists (ASHAs).

Findings

A total of 370 young infants with signs of PSBI were identified and managed in 5270 live births. Treatment coverage was 70% assuming that 10% of live births would have PSBI within the first two months of life. Mothers identified 87.6% (324/370) of PSBI cases. PHCs and CHCs became functional and managed 150 (40%) sick young infants with PSBI. Twenty four young infants (7-59days) who had only fast breathing were treated with oral amoxicillin without a referral. Referral to a hospital was refused by 126 (84%); 119 had clinical severe infection (CSI), one 0–6 days old had fast breathing and six had critical illness (CI). Of 119 CSI cases managed on outpatient injection gentamicin and oral amoxicillin, 116 (96.7%) recovered, 55 (45.8%) received all seven gentamicin injections and only one died. All 7–59 day old infants with fast breathing recovered, 23 on outpatient oral amoxicillin treatment; and 19 (79%) received all doses. Of 65 infants managed at either district or tertiary hospital, two (3.1%) died, rest recovered. Private providers managed 155 (41.9%) PSBI cases, all except one recovered, but sub-classification and treatment were unknown. Sub-centers could not be activated to manage PSBI.

Conclusion

The study demonstrated resolution of implementation bottlenecks with existing resources, activated PHCs and CHCs to manage CSI and fast breathers (7–59 day old) on an outpatient basis with low mortality when a referral was not feasible. TSU was instrumental in these achievements. We established the effectiveness of oral amoxicillin alone in 7–59 days old fast breathers and recommend a review of the current national policy.

Introduction

Over half a million neonates died in 2019 in India and 33% of these deaths were due to one or more infectious causes [1]. Around 10% -13% of newborns and infants below two months develop symptoms and signs suggestive of possible serious bacterial infection (PSBI) [25]. Although the recommended treatment for possible serious bacterial infection (PSBI) is hospitalization [6, 7], referral to higher facilities and hospital admission remains challenging in several low and middle-income countries [811]. A verbal autopsy study from the study area (then called Mewat district) showed that 22.3% of neonatal deaths were due to sepsis and infections; and for 52.6% of these neonates, the families did not seek care outside their homes before death [12]. In the study in Delhi slums [8], only 24% of the PSBI infants complied with hospital referral; the reasons for non-compliance were–child not perceived to be ill enough for hospitalization by the family, no one to accompany the mother or care for other siblings, waiting for the response to medicines advised mostly by the unqualified local practitioners, sought medicine from other physicians, unpleasant past experiences of the hospital, and trial of home remedies. In the Bangladesh study [13], 28.5% of PSBI infants died when left untreated or treated by unqualified health providers.

Large randomized controlled trials from African and Asian countries demonstrated efficacy of simplified antibiotic therapy in outpatient setting [35, 14]. The World Health Organization developed a guideline for the management of PSBI in young infants up to two months of age with simplified antibiotic regimens when referral to a hospital was not feasible [15]. The government of India (GOI) had released a guideline for auxiliary nurse midwives (ANMs) in 2014 to manage PSBI on an outpatient basis with injection gentamicin and oral amoxicillin when a referral to a hospital was not feasible (revised in 2017) [16, 17]. It remained largely unimplemented due to the lack of understanding of operational and contextual bottlenecks for implementation of the guidelines in most parts of the country. In a resource-poor setting care-seeking for young infants remains challenging due to distance to hospital, accessibility, affordability, time cost, wage loss, concern about the quality of care or attitude of the health workers, and cultural issues [811, 18, 19]. In the study district (Palwal, Haryana-India), during 2016–17 and 2017–18, only 1.1% and 1.7% of all live births respectively were identified as having any sickness including PSBI by the health workers [20]. The referral compliance and outcome were not known. The objectives of this implementation research were to understand the programmatic bottlenecks, determine the feasibility and acceptability of contextually modified implementation strategies and increase access to PSBI treatment using WHO PSBI management guideline when the referral is not feasible [15]. The implementation was embedded within the existing national program strategies for newborn–Janani Suraksha Yojna (Safe Motherhood Program) [21], Home Based Newborn Care Program (HBNC) [22] and Integrated Management of Newborn and Childhood Illness (IMNCI) [23].

The implementation study was part of a WHO-Government of India initiative at four sites in India (Himachal Pradesh, Maharashtra, Uttar Pradesh and Haryana).

Methodology

Study population and study setting

The implementation research was conducted in Palwal district of Haryana (India) between August 2017 and March 2019, at INCLEN-SOMAARTH DDESS (Demographic, Developmental and Environmental Surveillance Site) (www.somaarth.org), comprising of a population of 199,143 in 50 villages of three administrative blocks (Hathin, Hodal and, Palwal) (Fig 1). In the Haryana Vision 2030 document [24], Palwal has been ranked lowest in the human development index and fares poorly across all three indicators of human development, health, education and per capita income. Palwal district is one of the aspirational districts of the Government of India (i.e. with amongst lowest development indicators). The crude birth rate of the district was 26/1000 (compared to 20.3 in Haryana and 20.4 in National) in 2017 [25]. The infant mortality rate in Palwal was 35/1000 live birth (Haryana-32.8 /1000; India-41/1000) and the neonatal mortality rate was 21/1000 live birth (Haryana 22.1 /1000; India 30/1000) [26, 27]. According to the HMIS (health management information system) [28], Palwal district recorded 24046 deliveries during the year 2018–2019; 77% (18615) were institutional and the remaining (23%; 5431) occurred in homes. Only 17% (946/5431) of the home deliveries were attended by any skilled birth attendant. Furthermore, a verbal autopsy study from the same area indicated that 25% of neonatal deaths were due to sepsis [12]. In 50% of death cases, the neonates were not taken to any health facility before death. The actual figure of newborns and young infants with PSBI who were not accessing a health facility might be even higher. The preferred choice of care-seeking for neonatal illness in the area has been unqualified village practitioners followed by government hospitals and private qualified practitioners [29]. In a recent study on community management of pneumonia from the same study area 78% of sick infants and children visited private care providers (qualified providers, chemist, traditional healers) [30].

Fig 1. Study area- INCLEN-SOMAARTH DDESS (Demographic Developmental and Environmental Surveillance Site) Palwal, Haryana (India).

Fig 1

Health infrastructure

Primary healthcare services in the study were provided through a network of 18 Sub-Centers (SCs), three Primary Health Centers (PHCs) and three Community Health Centers (CHCs), supported by a referral facility at the district hospital. A brief description of health infrastructure and available manpower during the study period is provided (Table 1). None of the PHCs and CHCs had a functional newborn stabilization unit. The referral and in-patient facility for newborn [18 bedded -sick-newborn care unit (SNCU)] was located in the district hospital at Palwal City, almost 30KMs away from the farthest PHC of the study area.

Table 1. Government district health facility framework and description of facilities in the context of PSBI management.

Sl. no Name of the Facility/ Institution Expected strength of health personnel Type of care provided Population covered Number of health facilities in the study area Number of health personnel in position during the study period for neonatal care
1 Accredited Social Health Activist (ASHA) Sanctioned positions for the area-172 Social mobilizer for promoting maternal and child health: ante-natal care; deliveries; immunization and sickness identification, counseling, door-to-door surveys for specific service recipients @One ASHA for approximately 1000 rural population Working from home 172
2 Sub-Centre (SC) 1. Two ANMs one male multi-purpose health worker (MPW) Lower most health service delivery facility; provides basic antenatal care, immunization and treatment for minor illnesses 3000–5000 18 ANM: 29 Male Multi Purpose Health worker -3
3 Primary Health Centre (PHC) 1. Two qualified doctors (1-allopathic-MBBS and 1- Ayush Traditional medicine physician) One staff nurse
2. One ANM Other staff not directly involved with neonatal care: 1 pharmacist; 1 health educator and 2 health assistants
PHC- first port of call to a qualified public sector doctor in rural areas for the sick and those who directly report or referred from Sub-Centres (5–6 SC fall under each PHC) for curative, preventive and promotive health care. 4–6 Bedded facility 20000–30000 3 PHC 1: Nagaljaat Medical Officer: 0
Nurse: 1
ANM: 2


PHC 2: Kot
Medical Officer: 2
Nurse: 0
ANM:1


PHC 3: Uttawar
Medical Officer: 2
Nurse: 0
ANM:1
4 Community Health Centre (CHC) 1. Five medical specialists (i.e., general surgeon, physician, gynecologist, anesthetist and pediatrician)
2. Four general duty officers (1 dental surgeon, 3 general medical officers
3. Twenty one paramedical and support other staff.
First referral unit for SCs and PHCs;
Facilities with one operation theater, X-ray machine, labour room and laboratory.
Provides facilities for 24X7 obstetric care and specialist consultations
Beds: 20–30
80000–120000 3 CHC 1: Aurangabad
Specialist: 0
Medical Officers: 4
Nurse: 1
ANM: 3


CHC 2: Hodal
Specialist: 0
Medical Officers: 4
Nurse: 4
ANM: 4


CHC 3: Hathin
Specialist: 0
Medical Officers: 5
Nurse: 4
ANM: 2
5 District Hospital (DH) Palwal district hospital is a
200 bedded hospital.
The district hospital has
1. Thirty seven specialists (including 3 paediatricians)
2. One hundred and thirty two paramedical staffs (including 90 Staff nurse)
District Hospital is secondary referral level facility and provides comprehensive secondary health care services to the population in the district. District Hospital is expected to deliver Essential (Minimum Assured Services) and Desirable (which we should aspire to achieve) package of services. The services include OPD, indoor and emergency service. In addition, basic specialty services, newborn care, psychiatric services, physical medicine and rehabilitation services, accident and trauma services, dialysis services and anti-retroviral therapy. Average population of a district varies between 15 to 30 million
Palwal district hospital covers a population of 1 million
1 Palwal Civil Hospital
Paediatrician:3 Medical officers:6 Nurse: 6 A deputy Chief Medical Officer [Deputy-CMO] supervised ANMs and ASHA coordinators [supervisors for ASHAs] Health administration in the district managed by Chief Medical Officer’s Office
6 Special Newborn Care Unit (SNCU) Managed by an adequately trained pediatrician, doctors, staff nurses and support staff to provide 24x7 services.
As per MOHFW, the expected staff strength for a SNCU should be
1. One doctor per 4 beds
2. One nurse per 1.5 beds
(Palwal SNCU should have 5 doctors and 12 nurses)
A SNCU is established at the district hospital and sub-district hospitals to provide care for sick newborns, i.e., all type of neonatal care except assisted ventilation and major surgeries. It is a separate unit close to the labour room with 12 or more beds.
Palwal DH- SNCU has 18 beds to manage sick newborns
>3000 to 20000 annual delivery at district /sub-district level 1 Same as mentioned in row 5 under the district hospital

Study design

RE-AIM framework [31] was adopted to evaluate the implementation of PSBI guidelines in the study (Fig 2). The district health system led the implementation of the PSBI management guideline (intervention). The research team co-participated in the implementation for the first six months to get a better insight into barriers and bottlenecks and later monitored the processes and impact of the implementation strategy for another 12 months.

Fig 2. Conceptual framework for implementation research (Modified RE-AIM framework).

Fig 2

Implementation strategy

To contextualize our implementation of the PSBI management intervention package, following discrete ERIC classification implementation strategies [32] were followed.

1. Built coalitions

The implementation study established a coalition at four levels. i). Ministry of Health and Family Welfare (MOHFW), Government of India. ii). State health department through Directorate of National Health Mission and obtained permission to undertake the study- deputy director of health agreed to actively participate in the functioning of the Technical Support Unit (TSU) established at the district level. iii). TSU oversaw the execution of the study with CMO (chief medical officer) as the chair who was also inducted as one of the investigators–the research team was formally introduced to different functionaries of the health department in the study villages. iv). Series of meetings with Panchayat members (local self-government) to inform about the project objectives and to obtain community willingness to participate.

As part of the policy dialogue with both central and state ministries of health, the research team obtained permission for modification of the GOI PSBI management guideline in a national workshop (October 2016) attended by national and state program managers, independent experts and brought it in line with the WHO PSBI guideline specifically for the implementation research study (Table 2). The same group of stakeholders also participated in the finalization of the research protocol. The research team provided technical support to the Haryana State NHM to modify the IMNCI recording form and PSBI case follow up card to manage and maintain follow-up records of PSBI infants treated in PHCs/CHCs.

Table 2. Differences between PSBI management guideline of Government of India (2014) and World Health Organization (2015).
SL no Area Specifics
Government of India Guideline (2014)16 WHO Guideline (2015)*15
1 Danger signs to define PSBI Eleven signs considered; the presence of one or more of these eleven signs defines PSBI. Definition simplified by the presence of one or more of the only seven signs. Four signs were removed (nasal flaring, grunting, presence of pustules or big boil, blood in stool)
2 Simple fast breathing in 7–59 day old as a separate category and its treatment versus fast breathing in ≤ 6-day old infants Fast breathing infants (≤59 days with or without other danger signs) considered PSBI and recommended to be treated as other PSBIs (Single daily dose of injectable gentamicin and twice-daily oral doses of amoxicillin for 7 days) if a referral is not possible Young infant aged 7–59 days, presenting with only fast breathing and no other danger sign, defined as Pneumonia. Recommended treatment with twice-daily oral doses of amoxicillin for seven days and no injectable gentamicin on an outpatient basis. WHO guideline does not recommend referral to a hospital.

Young infant aged less than or equal to six days presenting with only fast breathing and no other danger signs, defined as Severe Pneumonia, and managed as other PSBI conditions. Recommended referral to a hospital. If the family refuses to accept the referral advice, treat with single daily IM gentamicin and twice-daily oral amoxicillin for 7 days on an outpatient basis.
3 Dosage of oral amoxicillin Recommended -
25mg/kg/dose twice daily
Recommended -
50mg/kg/dose twice daily for 7 days
4 Dosage of intramuscular injection gentamicin 5mg/kg/dose once daily for 7 days 5mg/kg/dose once daily for 7 days
5 Reclassification when referral is not possible No such reclassification is mentioned If a referral is not possible, WHO guideline recommends following the reclassification of PSBI cases based on the presence of one or more following danger signs-
SEVERE PNEUMONIA: Please see above
CLINICAL SEVERE INFECTION: at least one sign of severe infection, i.e. not feeding well on observation, temperature 38°C or more, temperature less than 35.5°C, severe chest in-drawing, movement only when stimulated.
Recommended referral to a hospital. If the family refuses to accept the referral advice, treat with single daily IM gentamicin and twice-daily oral amoxicillin for 7 days on an outpatient basis.
CRITICAL ILLNESS: In a young infant, presence of any of the following signs: convulsions, unable to feed at all, no movement on stimulation, unable to cry, bulging fontanels, cyanosis
Recommended referral to a hospital. If the family refuses to accept the referral advice, treat with single daily intramuscular gentamicin and twice-daily injectable ampicillin until the referral is possible.

*The WHO guideline was used for the implementation study

2. Centralize technical assistance

A district Technical Support Unit (TSU) was constituted with the district CMO as the chairperson and representation from state directorate, district health administration, independent technical experts and the investigators from the research team. Terms of reference for the TSU included the following. i) To identify implementation bottlenecks based on the feedback from formative research. ii) To collate field experience of the district program managers and available PSBI implementation related evidence from other contexts particularly within the country. iii) To facilitate the development of implementation blueprint taking in to account the study context and its operational feasibility. A nodal officer was designated in the district health department to oversee the implementation, support participation of health personnel and monitor availability of supplies and logistics for the PSBI management, identify skill-building needs (training and re-orientation programs), and ensure regular and uninterrupted supplies of antibiotics (amoxicillin and gentamicin), equipment (thermometer and functional weighing scale) at all levels of health care along with the relevant stationery for the management of PSBI infants. TSU reviewed the implementation progress every two months for resolving operational issues and modified the strategy as required, and acted as a link between the state headquarters and the district health department and decided on mid-course corrections as and when required.

A quarterly progress report on case identification was prepared and shared with the district CMO office. Six-monthly progress and challenges were shared with the state health department and their help was sought whenever required.

3. Work with educational institutions

Three senior pediatricians and neonatologists from Vardhaman Mahavir Medical College and Safdarjung Hospital, Delhi, were taken on board for participating in policy dialogue with decision-makers, provide technical assistance to develop job- aids for field staff and messages for the community and ratify translation of IMNCI chart booklet in Hindi (local language). This manual has since become part of the national program document, and support training of medical officers and other health functionaries of the study area.

4. Conduct educational outreach programs

The outreach training was started alongside formative research and completed in a phased manner by January 2018 before the scale of the project to all the 50 villages. National trainers (n-4) along with pediatrician (n-1), medical officers (n-4), ASHA-trainers (n-2) facilitated 11workshops: six workshops for ASHAs (1-day orientation) and five for the remaining health staff (3-day training). Training format was modified to ensure that medical officers, ANMs and nurses physically evaluated and wrote prescriptions for the sick young infant and learnt counseling of mothers for home care. Interaction with ASHAs emphasized the importance and schedule of home visitation, essential newborn care, identification of danger signs and places where sick young infants could be managed.

5. Assessment for readiness and identify barriers and facilitators

A formative study was conducted at baseline between June 2017 and January 2018. The assessment was done in two parts.

Formative research-part 1(June-August 2017). Baseline assessment included four components. i) Facility assessment: WHO facility scoring tool [33] was adapted to assess readiness for the availability of PSBI related supplies, manpower, service delivery and mechanisms of monitoring implementation of PSBI guideline (DH-1, CHC-3, PHC-3, sub-centers-18). ii) ASHAs’ perspectives about HBNC program, home visitation, sickness identification among young infants and care provision were obtained through knowledge attitude and practice (KAP) survey (n- 60; at the rate of at least one ASHA per village). iii) Perspectives of recently delivered (<6 months) and lactating mothers: In-depth interviews (n-30 mothers) and KAP survey with 150 mothers (at the rate of 3 randomly selected mothers from every village) to document mothers’ awareness of danger signs, care-seeking for their sick newborn and perceived value of home visitation by the ASHAs. iv) Towards the end of part 1 of the formative phase, both in-depth interviews and the quantitative survey indicated ground-level challenges about home visitation under HBNC by the ASHAs, assessment and management of young infants at the PHCs and CHCs and its influence on the care-seeking by the families for sick young infants. The respondents (surveys of mothers and ASHAs) had touched on these issues but in a restrained manner probably due to the sensitive nature of the problems. Non-formal interactions (NFI) [3436] with primary care physicians working at CHCs and PHCs (n-5), pediatric specialists at district hospital (n-2), ASHAs (n-8), ANMs (n-5) and mothers (n-11) were undertaken to further explore these issues. Only senior investigators conducted NFIs which were considered critical to the success of the implementation research. No tape recording or notes were taken at the time of interaction but immediately after NFI, the summary of the interaction was noted down.

Co-participatory formative research–part 2 (August 2017- January 2018). The purpose was to get first-hand insight into challenges and barriers to implementing PSBI guideline beyond that obtained under Part 1 of the formative phase. The co-participant implementation phase was limited to six villages (population-29000); served by 71 ASHAs, two SCs, one CHC and the district hospital. During this period the research team also undertook house to house survey to determine the pregnancies missed by the health system (ASHAs), tracked them for deliveries and called up families with newborn to verify the ASHAs’ scheduled visits (For every new delivery a schedule of expected home visits by the ASHA was made and research staff called up the families between 48 and 96 hours after the scheduled time to confirm the home visits.) At least one of the investigators observed the doctors assessing infants aged less than 59 days at the CHC (receiving patients from the above mentioned six villages) using a structured observation checklist (S1 Checklist). This component was part of a planned staged implantation scale-up of the study; after the end of the six months, the study was expanded to all 50 villages.

6. Revision of the implementation blueprint after co-participatory formative research

Post formative research–part 2 the TSU decided to take up two focused activities as part of the implementation plan: (i) a structured physician mentoring activity to assess and manage sick young infants at PHCs and CHCs with confidence; and (ii) mounting social mobilization activities to empower the communities, families and mothers to recognize sick young infants, seek appropriate care and information about the availability of treatment facilities for these infants at the PHCs and CHCs.

7. Provide local technical assistance

TSU prepared a roster for the district paediatricians to go to CHC/PHC for hand-holding and confidence building of the primary care physicians. A paediatrician-visit occurred once every three months in every CHC/PHC. After the initial detailed training of clinicians, on-site meetings for primary physicians were organized at three CHC levels. Four such meetings were organized during the study. In these meetings, doctors from the district hospital CMO office, technical experts from partner medical college (Safdarjung Hospital) and, district Pediatrician took part.

Also, the research team worked along with block ASHA coordinators with 12 groups of ASHAs (5–8 per group; total 77) from villages that had missed more than 40% of the pregnancies, to teach filling of HBNC forms and ANC registers. A social network group (WhatsApp ®) was formed for physicians to share case videos, sending queries to pediatricians and the platform was used to pre-empt the pediatrician in the district about case referrals.

Oral amoxicillin was available at all levels, but injection gentamicin was not present in the PHCs and CHCs of the whole district. The research team worked with TSU and the CMO, ensured the availability of logistics and commodities in all outreach facilities especially the availability of antibiotics, one ml syringe, newborn weighing scale and thermometers. The research team monitored the stock availability on monthly basis and the staffs were encouraged to send timely indents to avoid stock-outs. With the approval of the Child health division of Haryana National Health Mission, the IMNCI recording form, PSBI referral card and PSBI case-record registers were modified to align with the requirements of the project. These were then printed and distributed by the research team for the duration of the project.

8. Increase demand through a structured social mobilization campaign

Existing community outreach platforms were leveraged for empowering families. The mobilization activities focused on four aspects. i) Identification of danger signs by the families and mothers. ii) Awareness about ASHAs’ home visitation schedule and her expected duties during home visitation. iii) Awareness of the availability of treatment facilities for sick young in PHCs and CHCs. iv) Dissemination of case-studies of successful recovery from illness after availing treatment from public health facilities.

To achieve the above objectives, multi-pronged social mobilization strategies were adapted–

  1. Wall paintings (@ at least two per village): content included ASHAs home visitation schedule, the danger signs for the sick young infants and place where treatment was available.

  2. Village Health and Nutrition Day (VHND) celebration and Village Health Sanitation Nutrition Council (VHSNC) meetings were activated as per the GOI guidelines. These platforms were used for communicating the schedule and purpose of home visitation by ASHAs under HBNC program. ASHAs used flipcharts and posters to create awareness of danger signs among pregnant women and other community members attending these meetings. ASHAs also shared experiences from PSBI cases who had recovered after receiving simplified treatment in PHCs and CHCs.

  3. The district health system introduced sick infant danger sign counseling in ANC-clinic conducted under Pradhan Mantri Surakshit Matritva Abhiyan (PMSMA).

  4. The district health system added one page on the PSBI danger signs and schedule of ASHAs home visits in the Mother-Child Protection Card.

  5. Adhikaar Yatra (Health Rights March)–Schoolchildren (studying in class 8 and 9), their teachers and area ASHAs organized 69 rallies (@ at least one rally per study village) to spread awareness on newborn care, danger signs of sickness and ASHAs’ home visitations.

  6. The District administration of Palwal organized a Super village Challenge—a village level competition in the third and fourth implementation quarters. Villages in Palwal district competed to achieve water, sanitation and hygiene (WaSH) and newborn and maternal health targets. The initiative led to greater engagement of local self-government (Panchayat members) due to visibility and recognition of the local leadership.

  7. Community contact meetings: Four such meetings were organized by the research team to bring together the local leadership, teachers, religious leaders and the district health leadership to engage them in the development and roll-out of social mobilization activities, share the progress and success of the implementation of PSBI guideline in the area.

9. Development and distribution of educational materials

Job Aids—IMNCI chart booklets, IMNCI recording forms, and PSBI case follow up forms were modified by the research team in collaboration with technical partners, translated in Hindi and introduced into the program for use by the ASHAs, ANMs and doctors. These were also distributed across all health facilities. Wallboards for treatment algorithms and antibiotic dosage were fixed in PHCs, CHCs and SCs. Pamphlets with key messages were distributed during school rallies.

Data collection, management and analysis

The research data collection team comprised of Indian traditional medicine graduates with master’s in public health, graduate social scientists and field workers with at least 10 years of schooling. The research personnel were trained as per their assigned tasks in a 3–5 days’ workshop. They collected data for during the formative research; medical graduates interacted with medical officers in primary health facilities in the first two quarters, conducted post-treatment follow up (on 8th and 14th day) of PSBI diagnosis irrespective of the place where they were treated and abstracted administrative data from official documents of ASHAs, ANMs, PHCs, CHCs and district hospital. The data included: pregnancy, live birth, home visitation by ASHAs, sick young infants assessed and managed at different public sector health facilities, PSBI case classification formats, drugs administered, place of management (outpatient or in-patient), adherence, and follow up on day four and seven after initiating the treatment from all government health facilities. Written informed consents were taken from the families /stakeholders.

As part of the community mobilization and engagement activities, the families were asked to inform the research team telephonically if they chose to take their sick young infants to private providers (S1 Table). Data about obtaining treatment at private health facilities, clinical features at the time of seeking care and outcome was based on the recall by the mothers and families and available prescriptions. Information was obtained by the research team on the 8th and 14th day follow up post-initiation of treatment. The information about the case classification was not available for these cases. The processes and experiences of different aspects of implementation were recorded in the daily diaries of the study investigator and team leaders.

Quantitative data (KAP surveys of mothers and ASHAs, facility assessments, pregnancy and birth surveillance, assessment of sick young infants, treatment provided and outcome) was double entered in RedCap® double data module, for detecting inconsistencies and merged after validation. Data was exported to STATA® (Version 15.0) for analysis. Descriptive statistics were used to present coverage data, treatment adherence and cross-sectional survey data.

Qualitative data

Transcripts of recorded interviews (IDIs conducted during formative research with health service personnel, mothers and ASHAs) were prepared and complemented with field notes taken during non-formal interactions. All transcripts were entered in IQDAS (INCLEN Qualitative Data Analysis Software) [37]. Data were free-listed and key axial and selective codes were generated for analysis.

Results/observations

Both qualitative and quantitative data were used to identify implementation bottlenecks.

Table 3 provides observations and contextualized implementations under three sections: ASHAs, health service providers (primary care physicians, ANMs, and nurses) and mothers and the community.

Table 3. Implementation barriers and bottlenecks identified through formative research, application of contextualized strategies and their impact on PSBI program implementation.

Level Observation made during formative phase—Challenges identified Action taken and impact on the program implementation
ASHAs (Accredited Social Health Activist) Performance 1. Pregnancy Tracking: House to house pregnancy survey was done by the research team in the 50 study villages. ASHAs did not share their records for five villages; in the remaining, ASHAs had missed 36% (857/2359) pregnancies in 45 villages. • Block ASHA Coordinators and District Immunization Officer re-emphasized the quarterly door to door survey by ASHAs. However, no change occurred in the intensity of supervision and ASHAs continued to rely on their social network approach for pregnancy detection.
2. Record maintenance: Almost half (49.4%: 2605/5270) of the ASHAs refused to share their home visitation records with the research team citing incompleteness and not having permissions from their superiors. Most ASHAs maintained rough records before copying these in the official forms. HBNC (Home-based newborn care) forms and ANC (Ante-natal Clinics) records were incomplete/ partially filled. ASHAs mentioned that they did not know how to fill in ANC and HBNC visit recording forms.
3. Post-Natal Home Visitation: Home visits were irregular, not as per schedule and ASHAs did not accomplish the tasks as expected. ASHAs did not emphasize the identification of danger signs to the mothers during the home visitations.
• Following administrative actions were taken: Twelve trainings and re-orientation sessions were conducted by ASHA supervisors and local ANMs with small batches of ASHAs (total-82; 5–9 ASHAs per batch) to reorient ASHAs on various HBNC and ANC indicators, filling reporting formats and counseling of mothers during home visitation, VHND (village health and nutrition day) and VHSNC (Village Health, Sanitation & Nutrition Committee) meetings.
• Record maintenance did not show any improvement; the practice of having rough record-keeping persisted
• The frequency and regularity of the home visitation did not improve (Table 4).
4. Monitoring of Post-Natal home visitations: The monitoring of ASHA’s post-natal home visitation by ASHA Coordinators was practically absent. • CMO convened a meeting of the ASHA coordinators in the second quarter of the study and thereafter were asked to report their supervisory tasks during monthly meetings.
• We could not verify the frequency and quality of monitoring visits by ASHA coordinators.
5. Supplies of HBNC forms to ASHAs: Availability was irregular during the formative phase • On the direction of TSU, INCLEN ensured the availability of relevant stationery with all the ASHAs through the study period.
6. Referral of Sick infants to PHCs (Primary Health Centers)/CHCs (Community Health Centers): ASHAs were reluctant to refer sick young infants to CHCs and PHCs because ‘doctors referred these infants without even assessing’. • As the PHCs and CHCs became functional during the implementation research, ASHAs started referring sick young infants to these facilities.
• 11% of the PSBI infants were identified by ASHAs and were referred to primary care facilities compared to none in the six months before the launch of the study.
Health Service providers (Primary care physicians in CHC/PHC, ANMs, Staff Nurses) 7. Operationalization of sub-centers and ANMs: Formative research revealed that ANMs did not consider themselves as care providers and did not have the confidence to assess and manage sick young infants. They looked up to physicians at PHCs and CHCs for guidance. • As part of the research, joint training of ANMs, nurses and physicians was conducted, which gave the trainees opportunity to independently assess sick young infants and write simplified antibiotic prescriptions for them.
• ANMs could not be made confident to assess and manage sick young infants independently in the sub-centres. Only one ANM identified and managed two PSBI patients at one of the CHCs under the supervision of the medical officer.
8. Management of Sick Young Infants by Primary care physicians:
 • PHC/CHC Doctors were reluctant to assess and treat sick young infants even after regular IMNCI / PSBI trainings. Sick infants were frequently referred by them without even preliminary assessment.
 • Doctors were unwilling to fill up IMNCI recording forms
 • Up to the co-implementation phase, doctors were hesitant to give injectable gentamicin
• As part of the study, the trainees were allowed to independently assess sick young infants and write simplified antibiotic prescriptions for them.
• IMNCI trained research team members accompanied sick infants in the first two implementation quarters to support medical officers in the assessment and management of sick young infants at PHCs/CHCs. This practice was gradually reduced and stopped in the third implementation quarter as they had become confident to assess and manage and appropriately refer sick young infants if required.
• TSU organized hand-holding visits by district paediatricians from the third implementation quarter onwards by rotation to the CHCs and PHCs. This was to re-affirm the appropriateness of the assessment and prescriptions for sick young infants by primary care physicians and enhance their confidence. Visiting paediatricians emphasized the rationality and effectiveness of prescribing simplified antibiotic therapy including injection gentamicin.
• From the second implementation quarter onward, the PSBI performance review of PHCs/CHCs became the standing agenda item of the CMO’s quarterly review.
• Impact: Primary physicians at PHCs/CHCs were able to manage almost 1/3rd of the PSBI cases in the first 2 quarters and thereafter ended the study with over 40% of PSBI cases being managed at primary care health facilities (Table 5).
• Doctors continued to be reluctant to fill IMNCI case classification forms throughout the study
• The prescription and administration of gentamicin improved as the study progressed
9. Referral of sick young infants to higher facilities:
 • The referral system was almost non-functional; doctors and other health staff from PHCs/CHCs referred sick young infants without referral notes and any written guidance about where to take the infant. None received any pre-referral treatment.
 •PHC and CHC staff was usually not sure about the compliance by the families on suggested referral.
 • Families faced difficulties due to little importance and priority accorded to the referral slips from the field, sub-centres or PHCs/CHCs at the district hospital and other higher-level facilities.
 • The parents would many times decide to give up and return home without any treatment due to lack of clear guidance about the place of treatment for their sick infant, running from one facility to another or seeking care from private practitioners.
• On the advice of TSU, CMO office notified: (i) doctors at CHCs and PHCs were to inform paediatrician at the district hospital when referring any sick infants; (ii) referral note was made mandatory with a clear mention of the reason for referral and place of referral; and (iii) medical superintendent was apprised of the admission in SNCU and requested to conduct a monthly review of neonatal admissions.
• District hospital administration made available round the clock transport arrangement to regional medical college Nuh (50 KMs) and another tertiary hospital in Delhi (65 KMs).
• Despite these efforts, the referral system remained inadequate till the end of the research and could not be streamlined as desired.
10. Governance and human resource management: During the implementation period there was a frequent change in leadership (4 CMOs changed) and a strike by health staffs (once by ANMs and other paramedical personnel for 3–4 weeks) and ASHAs (twice for a total period of 6–7 weeks) • The achievements of the implementation research were with available staff and no effort was made to re-deploy the staff in the study area.
Also, there was a deficiency of doctors 23% (8/34-including district pediatricians); 45% nurse (13/29) and 24% (13/55) ANMs. All ASHA positions were filled.
Mothers and community 1. Identification of Sick young Infants: Formative research showed that 1/3rd (33.8%; 51/151) of the mothers could not mention even a single danger sign for their infants.
2. Care-seeking behavior: The majority of mothers and families did not realize the sickness of their young infants; this led to delayed care-seeking. Also, they were not sure about the appropriate health facilities for the treatment of their sick young infants.
3. Perceptions of ASHA’s Home Visitation: Most families and mothers were neither aware of ASHA’s home visitation schedule nor about its purpose. Therefore many mothers and families did not value post-natal home visitation made by AHSA.
4. Opinion on Public Health Facilities: Family had trust issues in the public health facilities particularly for their young ones at PHCs/CHCs; and or had a previous bad experience.
• Initial interaction between the research team and the families indicated that mothers could quickly learn to recognize the danger signs and were ready for prompt and timely care-seeking once they realized the baby was sick. The response was encouraging within the first quarter of the study (co-implementation phase).
• TSU advised implementing structured and multi-pronged, contextually relevant social mobilization activities, utilizing existing community platforms and institutions. Mobilization activities focused on four aspects. (a) Identification of danger signs by the families and mothers. (b) Awareness about ASHAs’ home visitation schedule and her expected duties during home visitation. (c) Awareness of the availability of treatment facilities for sick young in PHCs and CHCs. (d) Dissemination of case-studies of successful recovery from illness after availing treatment from public health facilities. Through the study period, 87.6% (324/370) PSBI infants were brought by the mothers and families to health facilities
The strategy worked and 87% of the PSBI infants were brought by the mothers and families to health facilities.

Barriers to PSBI program

ASHAs were making home visits irregularly and incompletely. The mothers did not value these visits as they were unaware of the purpose of these visits. ASHAs didn’t emphasize the danger signs of sick young infants and their record maintenance was poor. During the six months before the IR, no sick young infant was referred to the primary health facilities (PHCs and CHCs); ASHAs complained that doctors at these places did not see the sick young infants below 6 months.

In general, there were some supply issues at the PHCs and CHCs. Gentamicin injections were not part of the essential drug list and hence supply was erratic. Stock-outs for thermometers, home visitation recording formats were frequently observed.

PHC and CHC medical officers were reluctant to assess and manage treat newborns even after trainings and diverted sick infants to unspecified higher centers (i.e., without specifically telling where to go) without assessment. ANMs did not consider themselves as treatment providers, were hesitant to independently treat sick newborns at sub-center. Their confidence was further shaken when medical officers also demonstrated their hesitancy for managing sick infants.

Very few mothers and families could recognize the initial symptoms of the sickness in their young infants and hence the delay in care-seeking. As part of the formative study, only 53% (80/151) of mothers mentioned one or more danger signs in the newborn (almost all of them talked about fever and some about the other features of sickness) without realizing the seriousness and outcome of illness in young infants. In addition to the factors mentioned above, the families lacked trust in the public health system for managing their sick young infants; these infants were commonly taken to private providers (both qualified and unqualified) during sickness.

Identification of sick young infants and management

Total 370 young infants with signs of PSBI were identified and treated in 5270 live births (Fig 3). Treatment coverage was 70% assuming that on average 10% of live births would have PSBI within the first two months of life [25].

Fig 3. Flow diagram of identification, place of management and outcome of young infants with signs of Possible Serious Bacterial Infection (PSBI) (Aug 2017 –Mar 2019).

Fig 3

In the two years before the study, no PSBI cases were managed at either of the PHCs and CHCs. TSU suggested a structured handholding and mentoring exercise for the doctors working in the CHCs and PHCs (Table 3), which resulted in 31.6% (12/38) of the PSBI cases evaluated at PHCs and CHCs in the first quarter of the study (Table 4). During this period, no sick infants were identified or managed at sub-centers. In the majority of PSBI cases (87.6%; 324/370) families sought care by themselves from various types of health facilities and 11.4% (42/370) were identified and mobilized by ASHAs (Table 4).

Table 4. Identification, the first point of care, place of treatment and number of deaths of in young infants with PSBI signs across six study quarters (N- 370).

Implementation Quarters Quarter1 Quarter2 Quarter3 Quarter4 Quarter5 Quarter6 Total
 Time period Aug-2017 to Oct-2017 Nov-2017 to Jan-2018 Feb-2018 to Apr-2018 May-2018 to July-2018 Aug-2018 to Oct-2018 Nov-2018 to Jan-2019 Aug-2017 to Jan-2019 (Total 6 quarters)
2.1. Total number of live births occurred 259 740 1,002 1,253 1,244 772 5,270
2.2. PSBI infant identified 38(14.7) 10(1.4) 49(4.9) 117(9.3) 108(8.7) 48(6.2) 370(7.0)
2.3. PSBI infant identified by
 • ASHA 7(18.4) 2(20.0) 5(10.2) 10(8.6) 13(12.0) 5(10.4) 42(11.4)
 • Families 29(76.3) 8(80.0) 44(89.8) 106(90.6) 95(88.0) 42(87.5) 324(87.6)
 • ANM 1(2.6) 0(0.0) 0(0.0) 0(0.0) 0(0.0) 0(0.0) 1(0.3)
 • Doctors 1(2.6) 0(0.0) 0(0.0) 1(0.8) 0(0.0) 1(2.1) 3(0.8)
2.4. The first point of care*
 • Government primary facility (PHC/CHC) 12(31.6) 3(30.0) 23(46.9) 51(43.6) 61(56.5) 24(50.0) 174(47.0)
 • District Hospital 4(10.5) 2(20.0) 5(10.2) 13(11.1) 13(12.0) 3(6.3) 40(10.8)
 • Tertiary 0(0.0) 0(0.0) 0(0.0) 0(0.0) 1(0.9) 0(0.0) 1(0.3)
 • Private facility 22(57.9) 5(50.0) 21(42.9) 53(45.3) 33(30.6) 21(43.8) 155(41.9)
2.5. Place of treatment*
 • Government primary facility (PHC/CHC) 11(28.9) 3(30.0) 21(42.9) 46(39.3) 47(43.5) 22(45.8) 150(40.5)
 • District Hospital 6(15.8) 3(30.0) 7(14.3) 19(16.2) 20(18.5) 5(10.4) 60(16.2)
 • Tertiary 0(0.0) 0(0.0) 2(4.1) 1(0.8) 2(1.8) 0(0.0) 5(1.4)
 • Private facility 21(55.3) 4(40.0) 19(38.8) 51(43.6) 39(36.1) 21(43.8) 155(41.9)
2.6 No. of Deaths identified§ 1(2.6) 0(0.0) 0(0.0) 0(0.0) 1(0.9) 1(2.1) 3(0.8)

* None of the case represented and managed in Sub Centres

Government primary health care facility (PHC/CHC) includes: primary health center (PHC) and community health center (CHC)

Numbers mentioned in the Place of treatment are different from the First point of care as patients were referred from first point of care to final place of treatment (see Fig 3 for further details)

§Denominator is number of PSBI infant identified in the respective quarter

none of the FB only (7–59 days old) case died.

ASHAs performance

During the first four quarters of the study, 24 out of 322 (7.5%) of the PSBI infants were identified by ASHAs compared to none in the six months before the IR. We triangulated the administrative visitation records submitted by ASHAs to the health department with information obtained from the families through the telephone calls made by the research teams between August 2017 and July 2018 when 3254 deliveries had occurred in the study area. The research team made 16,977 calls during this period. The calls were made within 48 hours after the seven government recommended post-natal home visits (days 1, 3, 7, 14, 21, 28, 42) from 2001 mother-newborn duos and partially from another 487 mother-duos. ASHAs shared information about home visitation for only 1475 (1475/3254; 45.3%) mother-newborn duos, reporting that incomplete home visit records were not shared. Visit wise information abstracted from ASHAs official record and that based on the telephone call by the research staff are provided in Table 5. The families reported that 17% (336/2001) of the mother-newborn had no post-natal home visitation by the ASHAs compared to ASHAs data showing at least some visits for every mother-child duo.

Table 5. Post-natal home visitation by ASHAs during first four quarters (Aug 2017—Jul 2018) of study period*.

Post-natal home visits by ASHAs Based on the official record submitted by ASHA (N– 1475) Based on the call from the research team to families (complete information available about the scheduled visits) (N– 2001)
n (%) n (%)
 • Day 1 366(24.8) 372(18.6)
 • Day 3 1341(90.9) 1079(53.9)
 • Day 7 1414(95.9) 923(46.1)
 • Day 14 1385(93.9) 880(44.0)
 • Day 21 1324(89.8) 799(40.0)
 • Day 28 1250(84.7) 785(39.2)
 • Day 42 1168(79.2) 854(42.7)
 • 0 visits 0 (0%) 336(16.8)

*Total no. of live births during Aug 2017-Jul 2018–3,254

†Refusal of ASHA to share records of 1,779 mother–child dyads

‡Total no. of calls made to the families—16,977

Referred out of and referred into PHC/CHCs

Only 18% cases (31/174) accepted a referral for hospitalization: critical illness (CI)-6, clinical severe infection (CSI) -23, and severe pneumonia (fast breathing in 0–6 days old) -2. A pre-referral dosage of injection gentamicin was given in 71% (22/31) of referred cases (Fig 3).

Place of treatment

Finally 40.5% (150/370) were treated at PHCs/CHCs, 17.6% (65/370) at district hospital (n-60) and 5 infants at tertiary care facilities; whereas the remaining 42% were managed at private health facilities (Table 4). Among 150 cases treated at primary care facilities,119 had a clinical severe infection, six with a critical illness, and one with severe pneumonia (infant aged 0–6 days with fast breathing) and 24 cases had pneumonia (infant aged 7–59 days with only fast breathing) (Table 4 and Fig 3).

Adherence to simplified antibiotic treatment for PSBI cases at PHCs and CHCs

Only 46% (58 out of 126 CSI, CI and severe pneumonia cases) completed 7-days of injection gentamicin and a third did not receive any injection. However, the majority of pneumonia (fast breathers 7–59 day old) cases (79.2%; 19/24) received all 14 doses of amoxicillin (Table 6).

Table 6. Detail of treatment and follow-up of young infants with PSBI signs according to their clinical sub-categories (N = 370).

Parameters Total PSBI cases Critical illness (CI) Clinical severe infection (CSI)* Fast breathing only (7–59 days)
A. Case Management and outcome of the PSBI cases who were treated at a government primary health facility (PHC and CHC)
4.1. Number of PSBI cases treated n = 150 n = 6 n = 120 n = 24
4.2. No of PSBI cases who completed recommended simplified antibiotic treatment 68(45.3) 2(33.3) 47(39.2) 19(79.2)
4.3. Doses of antibiotic received—Gentamicin
 • 7 injections 58(38.7) 3(50.0) 55(45.8) -
 • ≥2<7 injections 24(16.0) 2(33.3) 21(17.5) 1(4.2)
 • 1 injection 6(4.0) 1(16.7) 5(4.2) -
 • 0 injection 62(41.3) 0(0.0) 39(32.5) 23 (96)
4.4 Doses of antibiotic received—Amoxicillin
 • 14 doses 102(68.0) 4(66.7) 79(65.8) 19(79.2)
 • 7–13 doses 22(14.7) 0(0.0) 17(14.2) 5(20.8)
 • ≥1< 7 doses 4(2.7) 1(16.7) 3(2.5) 0(0.0)
 • 0 dose of amoxicillin 22(14.7) 1(16.7) 21(17.5) 0(0.0)
4.5. Follow-up visits of PSBI cases during treatment (simplified antibiotic regimen)
 • Follow-up on Day 4 117(78.0) 6(100) 93(77.5) 18(75.0)
 • Completed all follow-up visits (Day 4 and Day 7) 92(61.3) 4(66.7) 77(64.2) 11(45.8)
 • Partial followed-up (Either day 4 or Day 7) 26(17.3) 2(33.3) 17(14.2) 7(29.2)
 • No follow-up 32(21.3) 0(0.0) 26(21.7) 6(25.0)
4.6. Treatment outcomes for PSBI cases (simplified antibiotic regimen)
 • Declared as ‘Clinical treatment success’ 145(96.7) 6(100.0) 116(96.7) 23(95.8)
 • Declared as ‘Clinical treatment failure’ 4(2.7) 0(0.0) 3(2.5) 1(4.2)
 • Death 1(0.7) 0(0.0) 1(0.8) 0(0.0)
B. Treatment outcome of PSBI cases treated at the District hospital/Tertiary Hospital (based on follow up on day 14 after diagnosis of the illness) n = 65 n = 19 n = 39 n = 7
 • Recovered 61(93.8) 16(84.2) 38(97.4) 7(100)
 • Still sick 2(3.1) 1(5.3) 1(2.6) -
 • Outcome unknown - - - -
 • Died 2(3.1) 2(10.5) - -
C. Treatment outcome of PSBI cases treated by a private provider (based on follow up on day 14 after diagnosis of the illness)  § n = 155
 • Recovered 154(99.4) - - -
 • Still sick - - - -
 • Outcome unknown 1(0.6) - - -
 • Died - - - -

*Includes one infant 0–6 days old with fast breathing (severe pneumonia)

†One fast breathing only (7–59 days) case received injection gentamicin

Definition of Treatment Failure: the appearance of any new sign of CI or CSI up to day 8 of treatment (worsening) or persistence of all presenting signs of CSI or CI on day 4 or persistence of any presenting sign by day 8 of treatment

§Case classification was not known for cases managed at a private facility

Follow up and outcome of PSBI treated in PHCs/CHCs

Out of 150 PSBI cases who received simplified outpatient treatment for PSBI at PHC/CHC, 117 infants (79%) came for WHO-recommended mandatory follow up on Day-4 at the health facility (Table 6). Four infants (2.7%) had clinical treatment failure: two had stopped simplified antibiotic treatment and two did not receive injection gentamicin at all. One infant, who received complete 7 days of simplified treatment and recovered, died suddenly at home on the 15th day after being enrolled.

Treatment outcome of the PSBI case treated in other facilities

Out of 65 PSBI cases managed at the district or a tertiary care hospital, 93.8% improved (61/65). Two with signs of critical illness died in the district hospital (Table 6). Two infants with pneumonia (7–59 days) did not accept treatment at PHC/CHC and received 14 doses of oral amoxicillin treatment from pediatric OPD of the district hospital, also recovered. All PSBI patients managed in private health facilities recovered, except one whose outcome is unknown (Fig 3).

Sickness other than PSBI identified during the IR

Out of 5270 live births, 296 (5.6%) young infants had an illness other than PSBI. Out of 296, 126 (42.6%) had a local infection, 109 (36.8%) had diarrhoea, 47 (15.9%) had jaundice and in 13 (4%) infants with low weight had feeding difficulties but without any sign of PSBI (S2 Table).

Discussion

Our coverage of identifying and treating PSBI cases was 70% (370 out of 5270 live births) when compared to an average 10% PSBI prevalence in young infants [25]. Among those who came to public health primary care facilities (PHCs/CHCs), less than 20% accepted a referral for hospitalization; remaining were managed in outpatients with simplified antibiotics; only one died (1/370; 0.3%) and rest recovered. Two-fifth of the PSBI infants were managed at public health facilities including district and tertiary care hospitals. Adherence to simplified antibiotic therapy for PSBI infants in the PHCs and CHCs gradually improved during the life of the project. Cases of the 7–59 day old fast breathers, received oral amoxicillin and recovered uneventfully. By the end of the implementation research, the majority of the families were able to recognize sick young infants and sought timely care.

In this implementation research, the PHCs and CHC became functional to manage the sick young infants with PSBI. The related supplies like antibiotics were made available with no stock-outs. PHC and CHC doctors, who were initially not confident to handle the infants less than 6 months, started managing PSBI with structured hand-holding and mentoring support. Lack of confidence amongst PHC and CHC doctors to assess and manage (including giving injections) to sick newborns and young infants has been reported in earlier studies from other parts of India [3841]. The primary care physicians were particularly apprehensive about administering gentamicin injections in the first two quarters but the adherence gradually improved during the project. Variable adherence for treatment and follow up in the primary care including deviation from pre-referral protocol perhaps can partly be attributed to prescribers’ conviction, confidence and caregivers’ perception of the severity of the illness, perception on the recovery of the child, and limited counseling and communication between doctors and the mothers [19, 4244].

Similar to the strategy adopted by the current study, technical support to manage PSBI through a linkage between the PHCs and their feeder hospital pediatricians and/or neonatologists provided mentorship and encouraged physicians in the primary care setting to manage PSBI in infants in Nigeria [45]. Competency-based pre and in-service training complemented by supportive supervision instilled confidence along with skill improvement amongst primary care physicians and mid-wives to perform newborn resuscitation in actual field conditions in Afghanistan [42], and South Africa [46] and manage sick young infants with PSBI more recently in India [3941].

ANMs treated only two PSBI patients during the study at PHC/CHC under the doctor’s supervision. GOI guideline recommends ANMs to manage PSBI cases at sub-centers, but despite the availability of supplies and training these could not be made functional. Formative research indicated that ANMs did not consider themselves as treatment providers and were afraid of administering therapeutic injections. The sub-centers where ANMs conducted their routine ANC and immunization clinics, suffered from poor infrastructure, non-availability of ANMs most of the time for medical consultation (she is travelling to villages under her charge for different program activities) and perception of the community about sub-centers not as places for management of severe ailments like PSBI. The majority of ANMs were not aware of the government permission to ANMs for assessment and management of PSBI infants including administration of injection gentamicin. Most of them perceived that assessment and management of sick young infants was the primary responsibility of the medical officers and thereafter if the doctors assigned them any responsibility, they could comply with it. We noted that ANMs developed confidence in administering injection gentamicin to PSBI after they observed the PHC/CHC doctors prescribing and administering these injections to sick young infants. A recent qualitative study from Pune on the performance of ANMs and three implementation research studies done in Maharashtra, Uttar Pradesh and Himachal Pradesh in India demonstrated the hesitation of ANMs to prescribing medicine for the same reasons [3941, 47].

According to the HBNC program, home visitation by the ASHAs is key to empower mothers and also identify and prompt mobilization of sick neonates for appropriate care-seeking and management [22]. In the present study, ASHAs had identified little over one-tenth of all PSBI cases in the study area compared to none during the six months before the launch of the IR in the area. The poor performance of ASHAs for home visitation, and documentation despite efforts by the district health authorities and three rounds of skill-building exercises by the research team, was of concern; hence post-natal home visitations could not be leveraged sufficiently for the identification of sick infants. ASHAs were expected to prepare a line list that contained the names of the beneficiaries due for immunization, which was closely monitored, supervised and accounted for and hence this activity were performed with consistency and quality. On the other hand, there was an almost complete absence of on-ground supervision of quality and quantity of ASHAs’ post-natal home visitation and scrutiny of the HBNC forms filled by them. The investigators felt that this was the major reason for poor performance despite incentives and skill-building workshops. Mothers had reported poor performance of ASHAs (<25%) for advice/counseling regarding obstetric danger sign assessment and neonatal care in Karnataka [48]. Issues like involvement in multiple programs, delayed incentive payments and lack of coordination with ANMs-were some of the other factors identified in the recently published IR from three different parts of the country [3941].

We adopted a multi-channel targeted community mobilization approach to empower the families and mothers, which enabled them to identify 88% of the sick young infants and seek care in a timely manner. Overall only one PSBI patients died out of sick young infants managed on an outpatient basis at the PHCs/CHCs during the study period. In the study from Malawi, 85% of PSBI cases were identified by families and out of 378 PSBI cases, only one CSI baby died [49]. In comparison, the case fatality rate in a similar study from the Lucknow site in India was much higher, where families of many PSBI cases refused to accept referral or treatment at a public health facility and numerous families faced delays in getting appropriate treatment at a government hospital [40]. Low PSBI mortality in the current observational study could therefore be attributed to early identification of illness and timely care seeking by the mothers and families and prompt treatment at the health facilities. Several innovative demand-side strategies to educate mothers and families in essential newborn care, identification of sickness in young infants, timely and appropriate care-seeking have been assessed through several research studies [5056], but the results have been variable, i.e., 4% to 30% improvement in care-seeking [53] and up to 52% reduction in neonatal mortality [52, 56].

In a recent study from rural Bangladesh, care-seeking remained high with private providers (95%), predominantly village health doctors (over 80%) [57]. Caregivers in several low and low-middle income countries indicate distrust in government hospital doctors, inconsistent availability of health personnel and medicines as some of the important reasons for choosing private sector providers. However, when families perceived sickness to be severe enough, they sought higher-level care, from either the public or private sector [19]. In our study, although there was a limitation about the quality of data about PSBI infants treated at private facilities, 42% sought care from them. The observation was consistent with data from implementation research on integrated community case management in the same study area by another research group [30] and in Maharashtra [41] where private providers constitute an important service provider and need program attention.

The TSU was constituted as an interface between the program and the technical support for the implementation research to ensure smooth implementation and to oversee the developments on the ground. On the advice of the TSU, the research team co-implemented the PSBI program with health personnel during the first six months for better insight into implementation challenges, which helped to better contextualize strategies. It thus played an important role in the implementation of this intervention in the program setting. The establishment of such an institutional platform at the district level with technical support from local medical college and or public health institution can play a facilitator role when new interventions are rolled out or implementation challenges arise within the existing programs [3941].

The results from our observational feasibility study need to be seen in light of its limitations. We were able to identify a much smaller number of infants with fast breathing due to a concurrent study about the management of the fast breathers by ASHAs, which led to relatively lower coverage of the sick young infants. But it is unlikely to influence the documentation of our experience of using simplified antibiotic including injectable antibiotics for other more severe categories of PSBI. Home visits by ASHAs were irregular and of poor quality for empowering the families and mothers, which led to a relatively small proportion of sick young infants by them. ASHAs are permanent member of the public health field team and can provide the sustainability to PSBI program, so the district authorities need to follow-up to increase the postnatal home visits. We did not cross-check the antibiotic doses administrated by the public facility doctors. Thus we could only comment on the effectiveness of simplified antibiotic therapy but cannot comment on the drug dosage and its response. Finally, for various operational and administrative reasons, we had to terminate the study without executing the panned exit strategy prepared in consultation with the TSU, which is likely to influence the sustainability of program refinements after the exit of the research team.

Conclusions

In conclusion, we identified some key implementation barriers such as irregular and poor quality home visitation by the ASHAs, poor ability of the families and mothers to identify danger signs in their young infants, lack of confidence of primary care physicians at PHCS/CHCs to manage sick young infants and reluctance of the ANMs to consider themselves as care providers. Most of the bottlenecks could be resolved by the district and state authorities and technical assistance from experts through leveraging existing resources and developing contextualized strategies. We demonstrated the feasibility of implementing management of PSBI on an outpatient basis when referral to a hospital was not feasible in a program setting by focusing on hand holding and confidence building of the primary care physicians, making the CHCs and PHCs functional and targeted social mobilization to empower the mothers and families for early recognition of sickness in their young infants.

Supporting information

S1 Checklist. Observation checklist for medical officers.

(DOCX)

S1 Fig. Identification, first point of care, place of treatment and number of deaths of in young infants with PSBI signs across six study quarters (N- 370).

(DOCX)

S1 Table. List of private providers who managed 155 PSBI infants during implementation research at district Palwal (Haryana, India).

(DOCX)

S2 Table. Total sickness identified in 0–59 days old infants during implementation period (Aug 2017—Jan 2019).

(DOCX)

S1 Data. INCLEN Palwal PSBI IR crf1 (n-5270).

(XLSX)

S2 Data. INCLEN Palwal PSBI IR crf2 (n-5270).

(XLSX)

S3 Data. INCLEN Palwal PSBI IR crf3 (n-370).

(XLSX)

S4 Data. INCLEN Palwal PSBI IR crf4 (n-370).

(XLSX)

S5 Data. INCLEN Palwal PSBI IR crf5 (n-370).

(XLSX)

Acknowledgments

We thank the Department of Health, Government of Haryana for facilitating the implementation research. We extend our gratitude to the public sector health personnel including doctors, ANMs, and ASHAs engaged in service delivery, community leaders of the area, district education department and school principals for supporting community mobilization efforts.

Data Availability

The data underlying the results presented in the study are available from Brig (Rtd.) V. K. Panday (Email: vk.panday@inclentrust.org; Phone - +91-8607023300).

Funding Statement

The study was supported by a grant from Bill and Melinda Gates Foundation (OPP1114815) to the Department of Maternal, Newborn, Child and Adolescent Health, World Health Organization, Geneva, Switzerland. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Newborn and child health. Let’s end preventable neonatal deaths and ensure every child alive [Internet]. UNICEF. 2019 [cited 10 Jan 2021]. Available from: https://www.unicef.org/india/what-we-do/newborn-and-child-health
  • 2.Saha SK, Schrag SJ, El Arifeen S, Mullany LC, Shahidul Islam M, Shang N, et al. Causes and incidence of community-acquired serious infections among young children in south Asia (ANISA): an observational cohort study. The Lancet. 2018;392:145–59. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Tshefu A, Lokangaka A, et al. Simplified antibiotic regimens compared with injectable procaine benzylpenicillin plus gentamicin for treatment of neonates and young infants with clinical signs of possible serious bacterial infection when referral is not possible: a randomised, open-label, equivalence trial. Lancet 2015; 385: 1767–76 doi: 10.1016/S0140-6736(14)62284-4 [DOI] [PubMed] [Google Scholar]
  • 4.Mir F, Nisar I, Tikmani SS, Baloch B, Shakoor S, Jehan F et al. Simplified antibiotic regimens for treatment of clinical severe infection in the outpatient setting when referral is not possible for young infants in Pakistan (Simplified Antibiotic Therapy Trial [SATT]): a randomised, open-label, equivalence trial. Lancet Glob Health 2017; 5: e177–85 doi: 10.1016/S2214-109X(16)30335-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Baqui A, Saha S, Ahmed A, Shahidulla M, Quasem I, Roth DE et al. Safety and efficacy of alternative antibiotic regimens compared with 7 day injectable procaine benzylpenicillin and gentamicin for outpatient treatment of neonates and young infants with clinical signs of severe infection when referral is not possible: a randomised open label, equivalence trial. Lancet Glob Heal. 2015; 3: e279–87 [DOI] [PubMed] [Google Scholar]
  • 6.World Health Organization. Integrated Management of Childhood Illness (IMCI), chart booklet. Geneva: WHO; 2014. Available at: http://apps.who.int/iris/bitstream/10665/104772/16/9789241506823_Chartbook_eng.pdf. Accessed: 4 May 2020.
  • 7.World Health Organization. Pocket book of hospital care for children: guidelines for the management of common illnesses with limited resources, 2nd edn. Geneva: World Health Organization, 2013. Available at: https://apps.who.int/iris/bitstream/handle/10665/81170/9789241548373_ eng.pdf?sequence=1 Accessed: 4 May 2020
  • 8.Bhandari N, Bahl R, Bhatnagar V, Bhan MK. Treating sick young infants in urban slum setting. Lancet.1996;347(9017):17745. 10.5555/uri:pii:S0140673696908569 [DOI] [PubMed] [Google Scholar]
  • 9.Bang AT, Bang RA, Baitule SB, Reddy MH, Deshmukh MD. Effect of home-based neonatal care and management of sepsis on neonatal mortality: field trial in rural India. The lancet. 1999Dec4;354(9194):1955–61. 10.1016/S0140-6736(99)03046-9 [DOI] [PubMed] [Google Scholar]
  • 10.Baqui AH, El-Arifeen S, Darmstadt GL, Ahmed S, Williams EK, Seraji HR, et al. Effect of community-based newborn-care intervention package implemented through two service-delivery strategies in Sylhet district, Bangladesh: a cluster-randomised controlled trial. The lancet. 2008Jun7;371(9628):1936–44. 10.1016/S0140-6736(08)60835-1 [DOI] [PubMed] [Google Scholar]
  • 11.Zaidi AK, Tikmani SS, Warraich HJ, Darmstadt GL, Bhutta ZA, Sultana S, et al. Community-based treatment of serious bacterial infections in newborns and young infants: a randomized controlled trial assessing three antibiotic regimens. The Pediatric infectious disease journal. 2012Jul1;31(7):667–72. 10.1097/INF.0b013e318256f86c [DOI] [PubMed] [Google Scholar]
  • 12.Deshmukh V, Lahariya C, Krishnamurthy S, Das M K, Pandey R M, Arora N K. Taken to health care provider or not, under-five children die of preventable causes: Findings from cross sectional survey and social autopsy in rural India. Ind J Comm Med 2016; 41(2): 108–119 doi: 10.4103/0970-0218.177527 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Baqui AH, Arifeen SE, Williams EK, Ahmed S, Mannan I, Rahman SM, et al. Effectiveness of home-based management of newborn infections by community health workers in rural Bangladesh. Pediatr Infect Dis J. 2009Apr;28(4):304–10. doi: 10.1097/INF.0b013e31819069e8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Tshefu A, Lokangaka A, Ngaima S, Engmann C, Esamai F, Gisore P, et al. Oral amoxicillin compared with injectable procaine benzylpenicillin plus gentamicin for treatment of neonates and young infants with fast breathing when referral is not possible: a randomised, open-label, equivalence trial. The Lancet. 2015May2;385(9979):1758–66. 10.1016/S0140-6736(14)62285-6 [DOI] [PubMed] [Google Scholar]
  • 15.World Health Organization. Guideline: Managing possible serious bacterial infection in young infants when referral is not feasible. Geneva: WHO; 2015. Available at: https://apps.who.int/iris/bitstream/handle/10665/181426/9789241509268_eng.pdf?sequence=1 [PubMed]
  • 16.Ministry of Health and Family Welfare Government of India. Operational Guidelines Use of Gentamicin by ANMs for management of sepsis in young infants under specific situations. Ministry of Health and Family Welfare Government of India; 2014. Available at: https://www.healthynewbornnetwork.org/hnn-content/uploads/Operational-Guidelines_India.pdf Accessed 1 Nov 2019.
  • 17.Government of India. Addendum to Operational Guidelines on Use of Gentamicin by ANMs for Management of Sepsis in Young Infants under Specific Situations. Available at https://nhm.gov.in/New_Updates_2018/Om_and_orders/rmncha/child_health/Addendum.pdf accessed on 3 June 2020.
  • 18.Kozuki N, Guenther T, Vaz L, Moran A, Soofi SB, Kayemba CN, et al. A systematic review of community-to-facility neonatal referral completion rates in Africa and Asia. BMC Public Health. 2015;15:989.doi: 10.1186/s12889-015-2330-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Applegate JA, Ahmed S, Harrison M, Callaghan-Koru J, Mousumi M, Begum N, et al. Caregiver acceptability of the guidelines for managing young infants with possible serious bacterial infections (PSBI) in primary care facilities in rural Bangladesh. PLoS One. 2020;15:e0231490. doi: 10.1371/journal.pone.0231490 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.District Health Reporting System. Haryana. Government of India (2018)
  • 21.Ministry of Health and family Welfare, Maternal Health Division. Janani SurakshaYojana: Features and Frequently Asked Questions. Government of India New Delhi; 2006. Available at: https://nhm.gov.in/WriteReadData/l892s/97827133331523438951.pdf Accessed: 25 May 2020
  • 22.Ministry of Health and Family Welfare, Government of India New Delhi. Home Based Newborn Care Operational guidelines. 2014. Available at: https://www.healthynewbornnetwork.org/hnn-content/uploads/Revised_Home_Based_New_Born_Care_Operational_Guidelines_2014.pdf Accessed: 4 May 2020
  • 23.Ministry of Health & Family Welfare, Government of India. In service Integrated Management of Neonatal and Childhood management (Module 1 to Module 9).Government of India New Delhi; 2009. Available at: https://nhm.gov.in/images/pdf/programmes/child-health/guidelines/module_1.pdf Accessed: 25 May 2020
  • 24.Government of Haryana. Vision2030 for Haryana, In: Department of Economic and Statistical Analysis, Haryana, 2017. http://esaharyana.gov.in/Portals/0/undp-2030.pdf
  • 25.India Ministry of Home Affairs Government of India. Sample Registration System Statistical Report Office of the Registrar General & Census Commissioner New Delhi. India 2017. https://censusindia.gov.in/Vital_Statistics/SRS_Report_2017/SRS%20Statistical%20Report%202017.pdf
  • 26.International Institute for Population Sciences (IIPS) and ICF. 2017. National Family Health Survey (NFHS-4), India, 2015–16: Haryana. Mumbai: IIPS.
  • 27.International Institute for Population Sciences (IIPS) and ICF. 2017. National Family Health Survey (NFHS-4), 2015–16: India. Mumbai: IIPS.
  • 28.Ministry of Health & Family Welfare, Government of India. Health Management Information System: Performance of Key HIMS Indicators 2018–2019. Available at: https://nrhm-mis.nic.in/hmisreports/frmstandard_reports.aspx
  • 29.Kaushal Monika, Aggarwal Rajiv, Singal Ashwani, Shukla Hemant, Kapoor Suresh K., Paul Vinod K., Practices Breastfeeding and Health-seeking Behavior for Neonatal Sickness in a Rural Community, Journal of Tropical Pediatrics, Volume 51, Issue 6, December 2005, Pages 366–376, 10.1093/tropej/fmi035 [DOI] [PubMed] [Google Scholar]
  • 30.Taneja S, Dalpath S, Bhandari N, Kaur J, Mazumder S, Chowdhury R, et al. Operationalising integrated community case management of childhood illnesses by community health workers in rural Haryana. ActaPaediatrica. 2018Dec;107:80–8 10.1111/apa.14428 [DOI] [PubMed] [Google Scholar]
  • 31.Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health (1999) 89(9):1322–7. doi: 10.2105/ajph.89.9.1322 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Powell B.J., Waltz T.J., Chinman M.J. et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Sci 10, 21 (2015). 10.1186/s13012-015-0209-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.World Health Organization, Regional office for South-East Asia Region. Assessment Tool for Hospital Care: Improving the Quality of Care for Reproductive, Maternal, Neonatal, Child and Adolescent Health in South-East Asia Region. Regional office for South-East Asia Region, WHO; 2016. Available at: https://apps.who.int/iris/bitstream/handle/10665/279767/assessmenttool-hospitalcare-eng.pdf?sequence=5&isAllowed=y Accessed: 4 May 2020
  • 34.Chaturvedi S., Ramji S., Arora N. K., Rewal S., Dasgupta R., Deshmukh V., & for INCLEN Study Group (2016). Time-constrained mother and expanding market: emerging model of under-nutrition in India. BMC public health, 16, 632. 10.1186/s12889-016-3189-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Gray DE. 2nd ed. Thousand Oaks, California: Sage Publications; 2009. Doing Research in the Real World
  • 36.Swain J., & Spire Z. (2020). The Role of Informal Conversations in Generating Data, and the Ethical and Methodological Issues. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 21(1). 10.17169/fqs-21.1.3344 [DOI] [Google Scholar]
  • 37.IQDAS—For Qualitative Analysis Inclen, New Delhi Available at: http://inclentrust.org/inclen/somaarth-iv-for-qualitative-analysis/
  • 38.Mohan P, Iyengar SD, Agarwal K, Martines JC, Sen K. Care-seeking practices in rural Rajasthan: barriers and facilitating factors. J Perinatol. 2008Dec;28Suppl 2:S31–7. 10.1038/jp.2008.167 [DOI] [PubMed] [Google Scholar]
  • 39.Goyal N, Rongsen-Chandola T, Sood M, Sinha B, Kumar A, et al. (2020) Management of possible serious bacterial infection in young infants closer to home when referral is not feasible: Lessons from implementation research in Himachal Pradesh, India. PLOS ONE 15(12): e0243724. 10.1371/journal.pone.0243724 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Awasthi S, Kesarwani N, Verma RK, Agarwal GG, Tewari LS, et al. (2020) Identification and management of young infants with possible serious bacterial infection where referral was not feasible in rural Lucknow district of Uttar Pradesh, India: An implementation research. PLOS ONE 15(6): e0234212. doi: 10.1371/journal.pone.0234212 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Roy S, Patil R, Apte A, Thibe K, Dhongade A, et al. (2020) Feasibility of implementation of simplified management of young infants with possible serious bacterial infection when referral is not feasible in tribal areas of Pune district, Maharashtra, India. PLOS ONE 15(8): e0236355. 10.1371/journal.pone.0236355 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Kim YM, Ansari N, Kols A, Tappis H, Currie S, Zainullah P, et al. Assessing the capacity for newborn resuscitation and factors associated with providers’ knowledge and skills: a cross-sectional study in Afghanistan. BMC Pediatr. 2013Sep10;13:140. 10.1186/1471-2431-13-140 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Nightingale R, Colbourn T, Mukanga D, Mankhambo L, Lufesi N, McCollum ED, et al. Non-adherence to community oral-antibiotic treatment in children with fast-breathing pneumonia in Malawi–secondary analysis of a prospective cohort study. Pneumonia. 2016Dec;8(1):21. 10.1186/s41479-016-0024-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Sun N, Rau PL. Barriers to improve physician–patient communication in a primary care setting: Perspectives of Chinese physicians. Health Psychology and Behavioral Medicine. 2017Jan1;5(1):166–76. 10.1080/21642850.2017.1286498 [DOI] [Google Scholar]
  • 45.Wammanda RD, Adamu SA, Joshua HD, Nisar YB, Qazi SA, Aboubaker S, et al. Implementation of the WHO guideline on treatment of young infants with signs of possible serious bacterial infection when hospital referral is not feasible in rural Zaria, Nigeria: Challenges and solutions. PLoS ONE. 2020;15(3):e0228718. 10.1371/journal.pone.0228718 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Couper ID, Thurley JD, Hugo JF.The neonatal resuscitation training project in rural South Africa.Rural Remote Health. 2005Oct-Dec;5(4):459. [PubMed] [Google Scholar]
  • 47.Pyone T, Karvande S, Gopalakrishnan S, Purohit V, Nelson S, Balakrishnan SS, et al. Factors governing the performance of Auxiliary Nurse Midwives in India: A study in Pune district. PLoS ONE. 2019;14(12):e0226831. 10.1371/journal.pone.0226831 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Fathima FN, Raju M, Varadharajan KS, Krishnamurthy A, Ananthkumar SR, Mony PK. Assessment of ’accredited social health activists’-a national community health volunteer scheme in Karnataka State, India. J Health PopulNutr. 2015Mar;33(1):137–45. [PMC free article] [PubMed] [Google Scholar]
  • 49.Guenther T, Mopiwa G, Nsona H, Qazi S, Makuluni R, Fundani CB, et al. Feasibility of implementing the World Health Organization case management guideline for possible serious bacterial infection among young infants in Ntcheu district, Malawi. PLoS ONE. 2020;15(4):e0229248. 10.1371/journal.pone.0229248 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Sharkey AB, Martin S, Cerveau T, Wetzler E, Berzal R. Demand generation and social mobilisation for integrated community case management (iCCM) and child health: Lessons learned from successful programmes in Niger and Mozambique. J Glob Health. 2014Dec;4(2):020410. 10.7189/jogh.04.020410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Tripathy P, Nair N, Barnett S, Mahapatra R, Borghi J, Rath S, et al. Effect of a participatory intervention with women’s groups on birth outcomes and maternal depression in Jharkhand and Orissa, India: a cluster-randomised controlled trial. Lancet. 2010Apr3;375(9721):1182–92. 10.1016/s0140-6736(09)62042-0 [DOI] [PubMed] [Google Scholar]
  • 52.Darmstadt GL, Choi Y, Arifeen SE, Bari S, Rahman SM, Mannan I, et al. Evaluation of a cluster-randomized controlled trial of a package of community-based maternal and newborn interventions in Mirzapur, Bangladesh. PLoS ONE. 2010Mar24;5(3):e9696. 10.1371/journal.pone.0009696 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Kumar V, Mohanty S, Kumar A, Misra RP, Santosham M, Awasthi S, et al. Effect of community-based behaviour change management on neonatal mortality in Shivgarh, Uttar Pradesh, India: a cluster-randomised controlled trial. Lancet. 2008Sep27;372(9644):1151–62. 10.1016/s0140-6736(08)61483-x [DOI] [PubMed] [Google Scholar]
  • 54.Herbert HK, Lee AC, Chandran A, Rudan I, Baqui AH. Care seeking for neonatal illness in low- and middle-income countries: a systematic review. PLoS Med. 2012;9(3):e1001183. 10.1371/journal.pmed.1001183 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Lee AC, Lawn JE, Cousens S, Kumar V, Osrin D, Bhutta ZA, et al. Linking families and facilities for care at birth: what works to avert intrapartum-related deaths.Int J Gynaecol Obstet. 2009Oct;107Suppl 1:S65–85, S86-8. 10.1016/j.ijgo.2009.07.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Dongre AR, Deshmukh PR, Garg BS. A community based approach to improve health care seeking for newborn danger signs in rural Wardha, India. Indian J Pediatr. 2009Jan;76(1):45–50. 10.1007/s12098-009-0028-y [DOI] [PubMed] [Google Scholar]
  • 57.Rahman AE, Herrera S, Rubayet S, Banik G, Hasan R, et al. (2020) Managing possible serious bacterial infection of young infants where referral is not possible: Lessons from the early implementation experience in Kushtia District learning laboratory, Bangladesh. PLOS ONE 15(5): e0232675. 10.1371/journal.pone.0232675 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Ricardo Q Gurgel

1 Sep 2020

PONE-D-20-18867

Lessons from an implementation research on community management of possible serious bacterial infection (PSBI) in young infants (0-59 days), when referral is not feasible in Palwal district of Haryana, India.

PLOS ONE

Dear Dr. Arora,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

There are extensive suggestions that must be faced to correct defects and make the manuscript to improve. Please report each change with the correction you´ve done in a document. An English revision is also necessary.

Please submit your revised manuscript by Sep 28 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Ricardo Q. Gurgel, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

3. We note that you have included the phrase “data not shown” in your manuscript. Unfortunately, this does not meet our data sharing requirements. PLOS does not permit references to inaccessible data. We require that authors provide all relevant data within the paper, Supporting Information files, or in an acceptable, public repository. Please add a citation to support this phrase or upload the data that corresponds with these findings to a stable repository (such as Figshare or Dryad) and provide and URLs, DOIs, or accession numbers that may be used to access these data. Or, if the data are not a core part of the research being presented in your study, we ask that you remove the phrase that refers to these data.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Reviewer’s comments

The Introduction is concise and focused.

Methodology

The authors describe some of the health indicators like Neonatal Mortality Rate and Infant Mortality Rate (lines 111-114). However it is not clear if these indicators are specific to the study area or are national rates. If these are specific to the study area then each indicator should be compared to the national rates.

This study to a large extent exposes the health care seeking behavior of the community. The authors should present some of the relevant health care seeking indicators of the study setting. In addition to mentioning the number of health facility deliveries they should provide the proportion of home deliveries or deliveries assisted by health personnel. Also, other health seeking behaviors like proportion of the population who self-medicate or use other community management (including use of traditional methods) should be stated.

Study settings: The authors give a general description of the health facility structure but do not give the exact staffing and other resources in the study district. They need to describe the staffing levels in the different levels of health care and other facilities for management of the newborn.

Study design: In Line 137 the authors have not described the implementation research model used in the study. This information is very important for implementation research. The authors should clearly state the implementation research principle and design that was used in the study. Did they apply any framework?

Line 154-155: This sentence may not be included. The authors should avoid such casual statements as it puts questions on the criteria for selection of the study team.

Formative research:

Lines 179-181: Some of the methods used in the formative research are not scientifically rigorous, e.g. the use of non-formal interaction with health care personnel would not give the most valid results. They could have used standard methods like Key Informant Interviews.

In lines 181-184: the authors do not state the data collection methods used in baseline assessments of some of the factors; e.g. Exploration of the attitude and confidence of health providers in managing sick young infants; Existing gaps in reporting and monitoring HBNC related indicators; Quality and frequency of home visitations, etc. Without this information it is difficult to verify the reliability of the data.

Lines 196-200: Were standardized observation checklists used?

The authors should specify which data collection methods or data collection tools were used to obtain the data. They should differentiate between the methods used for quantitative and qualitative data collection.

The data analysis section is not described in detail. This study has a large component of qualitative data. The authors should describe in detail how the data from the various qualitative methods were analyzed and represented. The analysis of the different quantitative data, similarly, should be clearly described.

Discussion

Lines 396-401: The authors should explore and clearly indicate the possible reasons for poor performance of the ANMs and ASHA since their study had extensive qualitative aspects. They need to discuss the limitations these personnel are facing e.g. what hinders them from being confident in treating the newborns; why would the ASHAs have incomplete data; could it be a lack of training? Is it poor motivation from working conditions? These issues need to come out clearly. The authors are in a better position to give recommendations on how to enhance the performance of these personnel.

Line 428-431: The mortality rate in this study is impressively low. This is very important data from this study, and the authors ought to magnify this information. The authors should discuss how the NMR in their study compares with the national rates and explain the reasons for the low mortality rate. These may form their stem for major recommendations.

432-442: The authors do not have much evidence to discuss the private health facilities. However they can expound on the effects their interventions had on the services in the public health facilities and the increased utilization.

In the section on limitations, the authors should discuss each limitation stating the effects it had on the findings in their study.

The authors should calculate and reflect the cost estimate for the implementation of the interventions in order to shed light on feasibility of sustainability of the program.

Conclusion section (461-469): The conclusions of the study are not well aligned to the objectives. The authors should review this section and align the objectives (lines 93-100) to the conclusion. The authors are advised to avoid the use of abbreviations in the conclusion, except for those globally recognized.

Writing style; linguistic expression

The authors should use italics only when necessary.

Lines 191-194: Improve the English sentence construction.

Lines 237-241: Improve sentence construction and grammar. Use appropriate punctuation marks.

Lines 253-254; Review the sentence.

Lines 443; improve on the sentence construction.

Reviewer #2: This an interesting and potentially very useful formative evaluation of an effort to implement guidelines for community management of PSBI in young infants as a treatment option when referral is not possible in the Palwal district of Haryana, India. The implementation effort was multi-phased and appears to have shown some significant and important results with respect to feasibility of implementation; the paper also highlights some important “lessons learned” from the experience which may be beneficial for scaling out similar types of interventions and preventing further infant mortality. The potential contributions of the paper in its current form, however, are undermined by (1) a lack of clarity in describing the implementation and evaluation processes as distinct processes (where possible) or overlapping entities (when applicable); (2) informed descriptions of the methods, with scientific (or pragmatic) justifications for decisions made; (3) lack of boundaries between description of methods and reporting of results; (4) presentation of results that is very difficult to follow and does not focus on key findings relating to the purview of the research, as an observational, pragmatic study of feasibility of implementing guidelines in these type of communities; and (5) a lack of recognition of the limitations of the study, particularly when it comes to questions around, e.g., establishing the “effectiveness” of a drug relative to questions about implementation feasibility. The following comments highlight changes recommended prior to this paper’s acceptance for publication.

Background

• This section is quite short & missing some key information—notably, while the authors note that referral for admission to hospitals in areas like the one under study are challenging, they don’t describe any of the barriers. This is crucial background for understanding why an alternative process like the guideline implementation being studied is a preferable alternative to simply addressing those barriers to better referral.

• The authors should also add in some additional detail about the PSBI problem—e..g., what are the current mortality rates in India from PSBI, what fraction of infant mortality could be prevented with better treatment for PSBI, and how much would mortality rates be expected to decline if GOI/WHO guidelines were followed?

• The authors also need to include information (somewhere—here if documented in prior research/reports) what the known bottlenecks/barriers to implementing these guidelines are (e.g., the cited “paucity of operational and contextual barriers”)—what were these barriers and how did they inform the current research project?

• The objectives as currently written are difficult to follow and do not clearly align with an implementation evaluation or understanding of current barriers—I would strongly encourage the authors to make these objectives more concrete and then use these objectives to organize the methods (both implementation and evaluation methods) and results reporting. As an example, for objective 1, it is unclear what the authors are referring to when they say they are “strengthening the existing health system for early identification”—does that mean they are assessing barriers, or adding new resources, or …? Similarly, with objective 2—what is meant by “prepare primary care facilities”? What sort of preparation or implementation support is being provided? and how does this differ with objective 3, where the PSBI program is “embedded”? Without clarity as to the concrete aims of these objective in terms of both the program implementation and evaluation, it is very difficult to evaluate whether or not the implementation effort and evaluation went according to plan or—more importantly—whether the feasibility identified would be translatable to other similar settings.

Methodology

• Study population: Some additional information on the “aspirational” aspect of the Palwal district would be appreciated to understand potential generalizability, namely how do the birth and mortality rates compare to those across India? Additionally, the authors never note or justify why this district was chosen for this work & how this might relate to the generalizability of the findings—for example, is this a case of “if it doesn’t work here, it likely won’t work in other districts” because barriers should be lower here?

• Health infrastructure: Would encourage structuring the table currently labeled as Panel 1 in a way that makes it easier to follow and compare across settings—for example, having columns indicating type of provider present, type of care provided, maybe the total population it serves and/or number present in the area studied (the latter of which was not information I saw in the current format). This presentation would help to highlight key differences, especially as they relate to big questions regarding access undergirding this project.

• Study design:

o Section should specify which implementation research principles were used and justify the selection

o Generally, this section, the steps/methods used & how they map onto the objectives was difficult to follow. Would strongly suggest including a diagram or figure that maps both the steps of the process and the pieces of the formative evaluation onto the overall study objectives.

o Details about the study protocols—especially for interviews, surveys, etc—are almost completely absent. Protocols for each of these data collection efforts should be (at least briefly) described, in a table or elsewhere. Also, this section consistently conflates research methods with results—for example, reporting final Ns for data collection instruments, rather than study protocols and procedures for recruiting individuals to complete measures, instruments, or interviews.

o Policy dialogue: Panel 2 is interesting and clearly very important, but no context is given for why certain departures from the WHO guidelines were determined and/or how they were justified. This is very important to understand as implementation efforts assume implementation of an evidence-based practice; if these guidelines are forcing departure from that evidence-base, it undermines the entire endeavor. Alternatively, tailoring that is done to address known barriers is an important part of the implementation process and thus provision of details about why these changes were made should be provided.

o Implementation phase: Specifics on the implementation strategy used should be provided ideally in line with Proctor, Powell & McMillen (2013) and/or as specified through the ERIC classification of implementation strategies (cf. Powell et al, 2015).

o Table 1: This table is clearly both very important and also incredibly onerous and almost entirely ineffective at communicating information. Additionally, the information included here seems to be related to results, not methods—so it should be moved, and the results should be presented in a more reader-accessible and organized way. One option may be to keep this table as supplemental information and highlight key results (in the results section!) that are curated by the authors as highlighting key lessons learned.

o Nudges: No rationale or justification is provided for using the nudge strategy—which is notable because evidence regarding the effectiveness of nudges in changing behaviors is mixed. Additionally, it is not clear where or at what stages nudges were developed, how they were integrated into the overall implementation strategy, what protocol for nudges were & whether these protocols were followed with fidelity, and/or what results they were expected to have. Finally, no citations are provided for definitions of or literature around behavioral nudges.

o Data collection/management: Again, results are presented here. No Ns should be presented in methods sections (other than population N or target Ns).

• Results

o As with the methods section, it is difficult to follow which results track from which stages of the process. I would again encourage picking a structure for presenting the overall study design (e.g., in phases), mapping the objectives/research questions to those phases, and then mapping results (in this section) to those phases/questions. As presented currently, the conflation of methods for evaluation and results of those evaluations are very convoluted and difficult to extricate to determine whether results are valid or reliable, or whether they answer questions of interest.

o Table 2: Unclear whether the days listed in Column 1 are ranges (e.g., is the second line reflecting visits that occurred between Day 1 and Day 3 or just on Day 3)? Also unclear why 0 visits is inapplicable to the partial information category. Finally, I didn’t see the response rate indicated anywhere in the table or text—is it correct that the response rate is (2001+487)/16,997 total calls, i.e., less than 15%?

o Table 3: The presentation of this table (as well as some of the text in the conclusion) suggests that there were some over-time improvements in implementation, however these effects are not apparent from this table—perhaps because there is so much information that is presented here? One suggestion would be to curate this table a bit more to focus on the results that were most interesting? For example, since sub-centres were never the first point of care nor place of treatment, these rows could be removed from the table & a footnote could indicate this absence of action. Additionally, if changes over time are of interest, proper statistical tests should be included. (Note that a multi-paneled figure reflecting trends would be a much more reader-friendly way to convey this information as well).

o PSBI management:

� Unclear where the 10% live births with PSBI assumption comes from; this should be justified and sources referenced.

� Table 4: Best practices in this table should be highlighted to indicate what proportion of cases were ‘high fidelity’. Additionally, having a separate category for 6 cases (Critical illness) is problematic—would combine with one of the other categories (or simply not include as its own column). I also don’t think sections B1 and B2 need to be in the table since they are not a focus of the implementation effort. Discuss in the text but exclude from the table.

� Unclear what the purpose of is including section on sicknesses identified other than PSBI—this should be dropped, and other relevant information related to barriers to care should be expanded.

• Discussion:

o Unclear where the 70% treatment coverage rate came from—this should be defined precisely in the results section.

o Generally, conclusions need to be tempered for this paper, and the conclusions should remind the readers from the outset that this was an observational, feasibility study for implementation of a particular guideline. While this paper does seem to strongly support feasibility of this intervention, there are serious limitations related to the selection of the region, problems with data reporting, and of course the study design that limit generalizability of findings, and certainly limit any notions of effectiveness or causality of the implementation. This is particularly notable for the authors claim that this study “demonstrated that oral amoxicillin alone is effective in managing pneumonia cases”—such a claim simply cannot be made with a study like this as there is no control case; data is purely observational. Further, claims like this distract from the implementation focus of the study. The authors would be much better off focusing on the purview suggested by the title—lessons from implementation—rather than trying to make claims related to clinical effectiveness. Of course, this doesn’t mean that they cannot claim that low mortality rates and high treatment rates aren’t important; they are—but they are reflective of the potential for guidelines like this to be implemented in communities like this that have room for improvement; their “effect” on downstream clinical outcomes simply cannot be estimated without a more rigorous study design.

o As with the rest of the manuscript, the conclusion has several places where important references appear to be missing—e.g., for “recent implementation research” that describes adherence to antibiotics guidelines improving slowly over time.

o The limitations should reflect the limitations of the observational study design, potential threats to validity and generalizability related to the population of interest, and larger issues related to data quality and potential missing data. This section is very weak at the moment.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Jul 7;16(7):e0252700. doi: 10.1371/journal.pone.0252700.r002

Author response to Decision Letter 0


15 Mar 2021

Reviewer #1: Reviewer’s comments

1. The Introduction is concise and focused.

• Response: Thank you.

Methodology

2. The authors describe some of the health indicators like Neonatal Mortality Rate and Infant Mortality Rate (lines 111-114). However it is not clear if these indicators are specific to the study area or are national rates. If these are specific to the study area then each indicator should be compared to the national rates.

Response: We have revised the estimate. Now, study region NMR and IMR are presented as per Haryana State Maternal and Infant Death review System (MIDSR, 2015-16); State and National estimate is referred from NFHS 4 (National Family Health Survey 2015-16) . References have been updated accordingly. We have added the following sentence in the revised manuscript on page 7, line 151- 154-130. “Infant mortality rate in Palwal was 35/1000 live birth (Haryana-32.8 /1000; India-41/1000) and neonatal mortality rate was 21/1000 live birth (Haryana 22.1 /1000; India 30/1000).”

3. This study to a large extent exposes the health care seeking behavior of the community. The authors should present some of the relevant health care seeking indicators of the study setting. In addition to mentioning the number of health facility deliveries they should provide the proportion of home deliveries or deliveries assisted by health personnel. Also, other health seeking behaviors like proportion of the population who self-medicate or use other community management (including use of traditional methods) should be stated.

Response: We have now revised the section that represents the care seeking behavior in study area. We have added information on home deliveries and deliveries conducted by skilled birth attendants (NFHS 4). Data on self-medication and careseeking behavior has also been added. We have added the following sentence in the revised manuscript on page 7, line 155-165.

“According to the HMIS (health management information system), [28] Palwal district recorded 24046 deliveries during the year 2018-2019; 77% (18615) were institutional and the remaining (23%; 5431) occurred in homes. Only 17% (946/5431) of the home deliveries were attended by any skilled birth attendant. Furthermore, a verbal autopsy study from the same area indicated that 25% of neonatal deaths were due to sepsis [12] . In 50% of death cases, the neonates were not taken to any health facility before death. The actual figure of newborns and young infants with PSBI who were not accessing a health facility might be even higher. The preferred choice of care-seeking for neonatal illness in the area has been unqualified village practitioners followed by government hospitals and private qualified practitioners [29]. In a recent study on community management of pneumonia from the same study area 78% of sick infants and children visited private care providers (qualified providers, chemist, traditional healers). [30]”

4. Study settings: The authors give a general description of the health facility structure but do not give the exact staffing and other resources in the study district. They need to describe the staffing levels in the different levels of health care and other facilities for the management of the newborn.

• Response: We have segregated the staffs in different levels of health care now in Panel 1 (Please see the fifth column) in the revised manuscript page 8-10 as given below:

Panel 1: Government district health facility framework and description of facilities in the context of PSBI management

Sl. no Name of the Facility/ Institution Expected strength of health personnel Type of care provided Population covered Number of health facilities in the study area Number of health personnel in position during the study period for neonatal care

1 Accredited Social Health Activist ( ASHA) Sanctioned positions for the area-172

Social mobilizer for promoting maternal and child health: ante-natal care; deliveries; immunization and sickness identification, counseling,

door-to-door surveys for specific service recipients @One ASHA for approximately 1000 rural population Working from home

172

2 Sub-Centre

(SC) 1. Two ANMs

2. one male multi-purpose health worker (MPW) Lower most health service delivery facility; provides basic antenatal care, immunization and treatment for minor illnesses 3000-5000 18 ANM: 29

Male Multi Purpose Health worker -3

3 Primary Health Centre (PHC) 1. Two qualified doctors (1-allopathic-MBBS and 1- Ayush Traditional medicine physician)

2. One staff nurse

3. One ANM

4. Other staff not directly involved with neonatal care: 1 pharmacist; 1 health educator and 2 health assistants PHC- first port of call to a qualified public sector doctor in rural areas for the sick and those who directly report or referred from Sub-Centres (5-6 SC fall under each PHC) for curative, preventive and promotive health care.

4-6 Bedded facility 20000-30000 3 PHC 1: Nagaljaat

Medical Officer: 0

Nurse: 1

ANM: 2

PHC 2: Kot

Medical Officer: 2

Nurse: 0

ANM:1

PHC 3: Uttawar

Medical Officer: 2

Nurse: 0

ANM:1

4 Community Health Centre (CHC) 1. Five medical specialists (i.e., general surgeon, physician, gynecologist, anesthetist and pediatrician)

2. Four general duty officers (1 dental surgeon, 3 general medical officers

3. Twenty one paramedical and support other staff. First referral unit for SCs and PHCs;

Facilities with one operation theater, X-ray machine, labour room and laboratory.

Provides facilities for 24X7 obstetric care and specialist consultations

Beds: 20-30 80000-120000 3 CHC 1: Aurangabad

Specialist: 0

Medical Officers: 4

Nurse: 1

ANM: 3

CHC 2: Hodal

Specialist: 0

Medical Officers: 4

Nurse: 4

ANM: 4

CHC 3: Hathin

Specialist: 0

Medical Officers: 5

Nurse: 4

ANM: 2

5 District Hospital (DH) Palwal district hospital is a

200 bedded hospital.

The district hospital has

1. Thirty seven specialists (including 3 paediatricians)

2. One hundred and thirty two paramedical staffs ( including 90 Staff nurse) District Hospital is secondary referral level facility and provides comprehensive secondary health care services to the population in the district. District Hospital is expected to deliver Essential (Minimum Assured Services) and Desirable (which we should aspire to achieve) package of services. The services include OPD, indoor and emergency service. In addition, basic specialty services, newborn care, psychiatric services, physical medicine and rehabilitation services, accident and trauma services, dialysis services and anti-retroviral therapy. Average population of a district varies between 15 to 30 million

Palwal district hospital covers a population of

1 million 1

Palwal Civil Hospital

Paediatrician:3

Medical officers:6

Nurse: 6

A deputy Chief Medical Officer [Deputy-CMO] supervised ANMs and ASHA coordinators [supervisors for ASHAs]

Health administration in the district managed by Chief Medical Officer’s Office

6 Special Newborn Care Unit (SNCU) Managed by an adequately trained pediatrician, doctors, staff nurses and support staff to provide 24x7 services.

As per MOHFW, the expected staff strength for a SNCU should be

1. One doctor per 4 beds

2. One nurse per 1.5 beds

( Palwal SNCU should have 5 doctors and 12 nurses) A SNCU is established at the district hospital and sub-district hospitals to provide care for sick newborns, i.e., all type of neonatal care except assisted ventilation and major surgeries. It is a separate unit close to the labour room with 12 or more beds.

Palwal DH- SNCU has 18 beds to manage sick newborns >3000 to 20000 annual delivery at district /sub-district level 1 Same as mentioned in row 5 under the district hospital

5. Study design: In Line 137 the authors have not described the implementation research model used in the study. This information is very important for implementation research. The authors should clearly state the implementation research principle and design that was used in the study. Did they apply any framework?

• Response: We have incorporated the study framework adopted from the RE-AIM framework. We have added the following sentence in the revised manuscript on page 10, line 184-185.

“RE-AIM framework [31] was adopted to evaluate the implementation of PSBI guidelines in the study (Fig 2).”

Ref - Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health (1999) 89(9):1322–7. doi:10.2105/AJPH.89.9.1322

6. Line 154-155: This sentence may not be included. The authors should avoid such casual statements as it puts questions on the criteria for selection of the study team.

• Response: We considered policymakers and district level implementers as key stakeholders who were part of the policy and programme dialogue process. The Chief Medical Officer (Dr PK Sharma) has participated in the strategic planning, analysis and subsequent dissemination process; CMO travelled to Nairobi (Kenya) to make the presentation of the study findings to the international audience also; Deputy director made presentations in protocol finalization meeting in Lagos (Nigeria) while CMO made four national-level presentations. We hope that our explanation takes care of the reviewer’s concerns.

Formative research:

7. Lines 179-181: Some of the methods used in the formative research are not scientifically rigorous, e.g. the use of non-formal interaction with health care personnel would not give the most valid results. They could have used standard methods like Key Informant Interviews.

• Response: Non-formal interaction (NFI) or informal interaction is a scientifically valid qualitative method that is cited in the literature (please see references cited below). In our study, we asked questions that were related to their professional practices, skills and confidence in handling sick young infants. Thus the NFIs as a qualitative technique had better scope to explore and examine the domains more realistically in a real-world situation. All the NFIs had semi-structured interview guides.

References for NFIs:-

o Chaturvedi, S., Ramji, S., Arora, N. K., Rewal, S., Dasgupta, R., Deshmukh, V., & for INCLEN Study Group (2016). Time-constrained mother and expanding market: an emerging model of under-nutrition in India. BMC public health, 16, 632. https://doi.org/10.1186/s12889-016-3189-4

o Gray DE. 2nd ed. Thousand Oaks, California: Sage Publications; 2009. Doing Research in the Real World

o Swain, J., & Spire, Z. (2020). The Role of Informal Conversations in Generating Data, and the Ethical and Methodological Issues. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 21(1). doi:http://dx.doi.org/10.17169/fqs-21.1.3344

8. In lines 181-184: the authors do not state the data collection methods used in baseline assessments of some of the factors; e.g. Exploration of the attitude and confidence of health providers in managing sick young infants; Existing gaps in reporting and monitoring HBNC related indicators; Quality and frequency of home visitations, etc. Without this information, it is difficult to verify the reliability of the data.

• Response: We have revised the paragraph in light of the reviewer’s comments. Please refer line 259 to 278 in page 14 and 14

“Formative research-part 1(June-August 2017): Baseline assessment included four components. i) Facility assessment: WHO facility scoring tool [33] was adapted to assess readiness for the availability of PSBI related supplies, manpower, service delivery and mechanisms of monitoring implementation of PSBI guideline (DH-1, CHC-3, PHC-3, sub-centers-18). ii) ASHAs’ perspectives about HBNC program, home visitation, sickness identification among young infants and care provision were obtained through knowledge attitude and practice (KAP) survey (n- 60; at the rate of at least one ASHA per village). iii) Perspectives of recently delivered (<6 months) and lactating mothers: In-depth interviews (n-30 mothers) and KAP survey with 150 mothers (at the rate of 3 randomly selected mothers from every village) to document mothers’ awareness of danger signs, care-seeking for their sick newborn and perceived value of home visitation by the ASHAs. iv) Towards the end of part 1 of the formative phase, both in-depth interviews and the quantitative survey indicated ground-level challenges about home visitation under HBNC by the ASHAs, assessment and management of young infants at the PHCs and CHCs and its influence on the care-seeking by the families for sick young infants. The respondents (surveys of mothers and ASHAs) had touched on these issues but in a restrained manner probably due to the sensitive nature of the problems. Non-formal interactions (NFI) [34, 35, 36] with primary care physicians working at CHCs and PHCs (n-5), pediatric specialists at district hospital (n-2), ASHAs (n-8), ANMs (n-5) and mothers (n-11) were undertaken to further explore these issues. Only senior investigators conducted NFIs which were considered critical to the success of the implementation research. No tape recording or notes were taken at the time of interaction but immediately after NFI, the summary of the interaction was noted down. “

9. Lines 196-200: Were standardized observation checklists used?

The authors should specify which data collection methods or data collection tools were used to obtain the data. They should differentiate between the methods used for quantitative and qualitative data collection.

• Response:

a. A pregnancy survey was conducted using a standardized line listing formats consisting of some key information of pregnant women [name, age, last menstrual period (LMP), expected date of delivery (EDD), name of Husband, name of household head, date of pregnancy registration, number of antenatal care (ANC) visits].

b. Documentation of ASHA’s post-natal home visitation by calling of recently delivered mothers -was conducted using a call confirmation sheet. For every new delivery, a calling- scheduled for expected ASHAs visits were made. The call schedule was fixed at 48 hours after the expected AHSAs home visitation for the family. Research staff made a call to the families to confirm if home visits were conducted by ASHAs.

c. We did not carry out any real-time observation for ASHAs home visitation. We have removed the text referring to the above observation.

d. Observation checklist of physician included - (1) if the physician asked how was the infant(2) asked for seven danger signs (3) examined the child (4) used IMNCI recording form.

We have modified the write up ( line 279- 291 in page 15 and page 16 )

“Co-participatory formative research – part 2 (August 2017- January 2018): The purpose was to get first-hand insight into challenges and barriers to implementing PSBI guideline beyond that obtained under Part 1 of the formative phase. The co-participant implementation phase was limited to six villages (population-29000); served by 71 ASHAs, two SCs, one CHC and the district hospital. During this period the research team also undertook house to house survey to determine the pregnancies missed by the health system (ASHAs), tracked them for deliveries and called up families with newborn to verify the ASHAs’ scheduled visits (For every new delivery a schedule of expected home visits by the ASHA was made and research staff called up the families between 48 and 96 hours after the scheduled time to confirm the home visits.) At least one of the investigators observed the doctors assessing infants aged less than 59 days at the CHC (receiving patients from the above mentioned six villages) using a structured observation checklist ( Supporting Information S1.Checklist) . This component was part of a planned staged implantation scale-up of the study; after the end of the six months, the study was expanded to all 50 villages. “

10. The data analysis section is not described in detail. This study has a large component of qualitative data. The authors should describe in detail how the data from the various qualitative methods were analyzed and represented. The analysis of the different quantitative data, similarly, should be clearly described.

• Response: We have modified the data analysis section as per the reviewer’s feedback ( Line no – 358 to 387 in page no 18 and 19)

“ The research data collection team comprised of Indian traditional medicine graduates with master’s in public health, graduate social scientists and field workers with at least 10 years of schooling. The research personnel were trained as per their assigned tasks in a 3-5 days’ workshop. They collected data for during the formative research; medical graduates interacted with medical officers in primary health facilities in the first two quarters, conducted post-treatment follow up (on 8th and 14th day) of PSBI diagnosis irrespective of the place where they were treated and abstracted administrative data from official documents of ASHAs, ANMs, PHCs, CHCs and district hospital. The data included: pregnancy, live birth, home visitation by ASHAs, sick young infants assessed and managed at different public sector health facilities, PSBI case classification formats, drugs administered, place of management (outpatient or in-patient), adherence, and follow up on day four and seven after initiating the treatment from all government health facilities.

As part of the community mobilization and engagement activities, the families were asked to inform the research team telephonically if they chose to take their sick young infants to private providers (Table S1). Data about obtaining treatment at private health facilities, clinical features at the time of seeking care and outcome was based on the recall by the mothers and families and available prescriptions. Information was obtained by the research team on the 8th and 14th day follow up post-initiation of treatment. The information about the case classification was not available for these cases. The processes and experiences of different aspects of implementation were recorded in the daily diaries of the study investigator and team leaders.

Quantitative data (KAP surveys of mothers and ASHAs, facility assessments, pregnancy and birth surveillance, assessment of sick young infants, treatment provided and outcome) was double entered in RedCap® double data module, for detecting inconsistencies and merged after validation. Data was exported to STATA® (Version 15.0) for analysis. Descriptive statistics were used to present coverage data, treatment adherence and cross-sectional survey data.

Qualitative data: Transcripts of recorded interviews (IDIs conducted during formative research with health service personnel, mothers and ASHAs) were prepared and complemented with field notes taken during non-formal interactions. All transcripts were entered in IQDAS (INCLEN Qualitative Data Analysis Software) [37]. Data were free-listed and key axial and selective codes were generated for analysis.”

Discussion

11. Lines 396-401: The authors should explore and indicate the possible reasons for the poor performance of the ANMs and ASHA since their study had extensive qualitative aspects. They need to discuss the limitations these personnel are facing e.g. what hinders them from being confident in treating the newborns; why would the ASHAs have incomplete data; could it be a lack of training? Is it poor motivation from working conditions? These issues need to come out clearly. The authors are in a better position to give recommendations on how to enhance the performance of these personnel.

• Response: We have elaborated the possible reasons now

ANM related issues ( Line -534 to 549 in page no 33 and 34)

“Formative research indicated that ANMs did not consider themselves as treatment providers and were afraid of administering therapeutic injections. The sub-centers where ANMs conducted their routine ANC and immunization clinics, suffered from poor infrastructure, non-availability of ANMs most of the time for medical consultation (she is travelling to villages under her charge for different program activities) and perception of the community about sub-centers not as places for management of severe ailments like PSBI. The majority of ANMs were not aware of the government permission to ANMs for assessment and management of PSBI infants including administration of injection gentamicin. Most of them perceived that assessment and management of sick young infants was the primary responsibility of the medical officers and thereafter if the doctors assigned them any responsibility, they could comply with it. We noted that ANMs developed confidence in administering injection gentamicin to PSBI after they observed the PHC/CHC doctors prescribing and administering these injections to sick young infants. A recent qualitative study from Pune on the performance of ANMs and three implementation research studies done in Maharashtra, Uttar Pradesh and Himachal Pradesh in India demonstrated the hesitation of ANMs to prescribing medicine for the same reasons [47, 39, 40, 41].”

ASHA related issues ( Line -552 to 566 in page no 34 and 35)

“The poor performance of ASHAs for home visitation, and documentation despite efforts by the district health authorities and three rounds of skill-building exercises by the research team, was of concern; hence post-natal home visitations could not be leveraged sufficiently for the identification of sick infants. ASHAs were expected to prepare a line list that contained the names of the beneficiaries due for immunization, which was closely monitored, supervised and accounted for and hence this activity were performed with consistency and quality. On the other hand, there was an almost complete absence of on-ground supervision of quality and quantity of ASHAs’ post-natal home visitation and scrutiny of the HBNC forms filled by them. The investigators felt that this was the major reason for poor performance despite incentives and skill-building workshops. Mothers had reported poor performance of ASHAs (<25%) for advice/counseling regarding obstetric danger sign assessment and neonatal care in Karnataka [48]. Issues like involvement in multiple programs, delayed incentive payments and lack of coordination with ANMs-were some of the other factors identified in the recently published IR from three different parts of the country [39, 40, 41 ].”

12. Line 428-431: The mortality rate in this study is impressively low. This is very important data from this study, and the authors ought to magnify this information. The authors should discuss how the NMR in their study compares with the national rates and explain the reasons for the low mortality rate. These may form their stem for major recommendations.

• Response: We have incorporated some text on low mortality. However, considering the present study design and scope of the study we feel that we must not over-interpret the data. Please refer Line 574 – 580 in page no 35

“ Low PSBI mortality in the current observational study could therefore be attributed to early identification of illness and timely care seeking by the mothers and families and prompt treatment at the health facilities. Several innovative demand-side strategies to educate mothers and families in essential newborn care, identification of sickness in young infants, timely and appropriate care-seeking have been assessed through several research studies [50-56], but the results have been variable, i.e., 4% to 30% improvement in care-seeking [53] and up to 52% reduction in neonatal mortality[52, 56].”

13. 432-442: The authors do not have much evidence to discuss private health facilities. However they can expound on the effects their interventions had on the services in the public health facilities and the increased utilization.

• Response: We did not document the newborn management practices of private health facilities and thus we could not describe the effect of our intervention in the private sector. As documented in our formative research and indicated in another study (Taneja et al), the communities in the study area preferred private health facilities to seek care for their sick young infants.

Refer line 583 to 591 in page 35 and 36

Taneja S, Dalpath S, Bhandari N, Kaur J, Mazumder S, Chowdhury R, et al. Operationalising integrated community case management of childhood illnesses by community health workers in rural Haryana. ActaPaediatrica. 2018 Dec;107:80-8https://doi.org/10.1111/apa.14428 PMID: 30570793

14. In the section on limitations, the authors should discuss each limitation stating the effects it had on the findings in their study.

• Response: We have modified the section as suggested.

Refer line no 601 to 614 in page 36

“The results from our observational feasibility study need to be seen in light of its limitations. We were able to identify a much smaller number of infants with fast breathing due to a concurrent study about the management of the fast breathers by ASHAs, which led to relatively lower coverage of the sick young infants. But it is unlikely to influence the documentation of our experience of using simplified antibiotic including injectable antibiotics for other more severe categories of PSBI. Home visits by ASHAs were irregular and of poor quality for empowering the families and mothers, which led to a relatively small proportion of sick young infants by them. ASHAs are permanent member of the public health field team and can provide the sustainability to PSBI program, so the district authorities need to follow-up to increase the postnatal home visits. We did not cross-check the antibiotic doses administrated by the public facility doctors. Thus we could only comment on the effectiveness of simplified antibiotic therapy but cannot comment on the drug dosage and its response. Finally, for various operational and administrative reasons, we had to terminate the study without executing the panned exit strategy prepared in consultation with the TSU, which is likely to influence the sustainability of program refinements after the exit of the research team.”

15. The authors should calculate and reflect the cost estimate for the implementation of the interventions in order to shed light on feasibility of sustainability of the program.

• Response: We are preparing a separate manuscript on cost estimate as it requires a fair amount of space due to separate methodology etc. It didn’t under the scope of the current manuscript so we didn’t include it. The other collaborating sites from India, which have already published similar implementation lessons didn’t include a cost estimate.

Goyal N, Rongsen-Chandola T, Sood M, Sinha B, Kumar A, et al. (2020) Management of possible serious bacterial infection in young infants closer to home when referral is not feasible: Lessons from implementation research in Himachal Pradesh, India. PLOS ONE 15(12): e0243724. https://doi.org/10.1371/journal.pone.0243724 PMID: 33351810

Awasthi S, Kesarwani N, Verma RK, Agarwal GG, Tewari LS, et al. (2020) Identification and management of young infants with possible serious bacterial infection where referral was not feasible in rural Lucknow district of Uttar Pradesh, India: An implementation research. PLOS ONE 15(6): e0234212. PMID: 32497092

Roy S, Patil R, Apte A, Thibe K, Dhongade A, et al. (2020) Feasibility of implementation of simplified management of young infants with possible serious bacterial infection when referral is not feasible in tribal areas of Pune district, Maharashtra, India. PLOS ONE 15(8): e0236355. https://doi.org/10.1371/journal.pone.0236355 PMID: 32833993

Conclusion section

16. (461-469): The conclusions of the study are not well aligned to the objectives. The authors should review this section and align the objectives (lines 93-100) to the conclusion. The authors are advised to avoid the use of abbreviations in the conclusion, except for those globally recognized.

• Response: We have aligned the two.

Please refer line 617 to 626 in page 37

“In conclusion, we identified some key implementation barriers such as irregular and poor quality home visitation by the ASHAs, poor ability of the families and mothers to identify danger signs in their young infants, lack of confidence of primary care physicians at PHCS/CHCs to manage sick young infants and reluctance of the ANMs to consider themselves as care providers. Most of the bottlenecks could be resolved by the district and state authorities and technical assistance from experts through leveraging existing resources and developing contextualized strategies. We demonstrated the feasibility of implementing management of PSBI on an outpatient basis when referral to a hospital was not feasible in a program setting by focusing on hand holding and confidence building of the primary care physicians, making the CHCs and PHCs functional and targeted social mobilization to empower the mothers and families for early recognition of sickness in their young infants.”

Writing style; linguistic expression

17. The authors should use italics only when necessary.

• Response: Revised as per suggestion

18. Lines 191-194: Improve the English sentence construction

• Response: Revised

19. Lines 237-241: Improve sentence construction and grammar. Use appropriate punctuation marks.

• Response : corrected

20. Lines 253-254; Review the sentence.

• Response: corrected

21. Lines 443; improve on the sentence construction.

• Response: corrected

Reviewer #2:

This an interesting and potentially very useful formative evaluation of an effort to implement guidelines for community management of PSBI in young infants as a treatment option when referral is not possible in the Palwal district of Haryana, India. The implementation effort was multi-phased and appears to have shown some significant and important results with respect to feasibility of implementation; the paper also highlights some important “lessons learned” from the experience which may be beneficial for scaling out similar types of interventions and preventing further infant mortality. The potential contributions of the paper in its current form, however, are undermined by (1) a lack of clarity in describing the implementation and evaluation processes as distinct processes (where possible) or overlapping entities (when applicable); (2) informed descriptions of the methods, with scientific (or pragmatic) justifications for decisions made; (3) lack of boundaries between description of methods and reporting of results; (4) presentation of results that is very difficult to follow and does not focus on key findings relating to the purview of the research, as an observational, pragmatic study of feasibility of implementing guidelines in these type of communities; and (5) a lack of recognition of the limitations of the study, particularly when it comes to questions around, e.g., establishing the “effectiveness” of a drug relative to questions about implementation feasibility. The following comments highlight changes recommended prior to this paper’s acceptance for publication.

Background

22. This section is quite short & missing some key information—notably, while the authors note that referral for admission to hospitals in areas like the one under study are challenging, they don’t describe any of the barriers. This is crucial background for understanding why an alternative process like the guideline implementation being studied is a preferable alternative to simply addressing those barriers to better referral.

Response : Reasons added.

Pleeasse refer line 101 to 107, in page 5

“In the study in Delhi slums [8], only 24% of the PSBI infants complied with hospital referral; the reasons for non-compliance were – child not perceived to be ill enough for hospitalization by the family, no one to accompany the mother or care for other siblings, waiting for the response to medicines advised mostly by the unqualified local practitioners, sought medicine from other physicians, unpleasant past experiences of the hospital, and trial of home remedies. In the Bangladesh study [13], 28.5% of PSBI infants died when left untreated or treated by unqualified health providers. “

23. The authors should also add in some additional detail about the PSBI problem—e..g., what are the current mortality rates in India from PSBI, what fraction of infant mortality could be prevented with better treatment for PSBI, and how much would mortality rates be expected to decline if GOI/WHO guidelines were followed?

• Response: Statistics added at the beginning of the introduction.

Please refer line 94 to 101 in page 5

Over half a million neonates died in 2019 in India and 33% of these deaths were due to one or more infectious causes.[1]. Around 10% -13% of newborns and infants below two months develop symptoms and signs suggestive of possible serious bacterial infection (PSBI) [2,3,4,5]. Although the recommended treatment for possible serious bacterial infection (PSBI) is hospitalization [6,7 ], referral to higher facilities and hospital admission remains challenging in several low and middle-income countries [8,9, 10, 11 ]. A verbal autopsy study from the study area (then called Mewat district) showed that 22.3% of neonatal deaths were due to sepsis and infections; and for 52.6% of these neonates, the families did not seek care outside their homes before death. [12]

24. The authors also need to include information (somewhere—here if documented in prior research/reports) what the known bottlenecks/barriers to implementing these guidelines are (e.g., the cited “paucity of operational and contextual barriers”)—what were these barriers and how did they inform the current research project?

• Response: We have now mentioned some of the known barriers from other country settings. Please note that, we have already mentioned in the introduction that there was a “paucity of evidence on contextual and operational barriers as far as India is concerned ”- Our study ( and other three sites from India) are expected to shed some light on the understanding of bottlenecks as these studies have captured the implementation process on a real-time basis. The implementation of the guideline truly happened for the first time in four sites in India, thus we could not refer to other data that highlighted the barriers of the implementation.

However, we have mentioned what are the challenges in care seeking for sick young infants. Please refer line -116 to 118 in page 5 and 6

“In a resource-poor setting care-seeking for young infants remains challenging due to distance to hospital, accessibility, affordability, time cost, wage loss, concern about the quality of care or attitude of the health workers, and cultural issues. [8,9,10,11, 18, 19 ] ”

25. The objectives as currently written are difficult to follow and do not align with an implementation evaluation or understanding of current barriers—I would strongly encourage the authors to make these objectives more concrete and then use these objectives to organize the methods (both implementation and evaluation methods) and results reporting. As an example, for objective 1, it is unclear what the authors are referring to when they say they are “strengthening the existing health system for early identification”—does that mean they are assessing barriers, or adding new resources, or …? Similarly, with objective 2—what is meant by “prepare primary care facilities”? What sort of preparation or implementation support is being provided? and how does this differ with objective 3, where the PSBI program is “embedded”? Without clarity as to the concrete aims of these objective in terms of both the program implementation and evaluation, it is very difficult to evaluate whether or not the implementation effort and evaluation went according to plan or—more importantly—whether the feasibility identified would be translatable to other similar settings.

• Response : We have modified the language to make it clearer.

Please refer line 121- 124 in page no 6

“The objectives of this implementation research were to understand the programmatic bottlenecks, determine the feasibility and acceptability of contextually modified implementation strategies and increase access to PSBI treatment using WHO PSBI management guideline when the referral is not feasible [15]”

Methodology

26. Study population: Some additional information on the “aspirational” aspect of the Palwal district would be appreciated to understand potential generalizability, namely how do the birth and mortality rates compare to those across India? Additionally, the authors never note or justify why this district was chosen for this work & how this might relate to the generalizability of the findings—for example, is this a case of “if it doesn’t work here, it likely won’t work in other districts” because barriers should be lower here?

• Response: Birth and mortality rate have been added. Also, the rationale for choosing the district has been given

Please refer line 146- 165 in page 7.

“Developmental and Environmental Surveillance Site) (www.somaarth.org), comprising of a population of 199,143 in 50 villages of three administrative blocks (Hathin, Hodal and, Palwal) (Fig 1). In the Haryana Vision 2030 document, [24] Palwal has been ranked lowest in the human development index and fares poorly across all three indicators of human development, health, education and per capita income. Palwal district is one of the aspirational districts of the Government of India (i.e. with amongst lowest development indicators). The crude birth rate of the district was 26/1000 (compared to 20.3 in Haryana and 20.4 in National) in 2017. [25] The infant mortality rate in Palwal was 35/1000 live birth (Haryana-32.8 /1000; India-41/1000) and the neonatal mortality rate was 21/1000 live birth (Haryana 22.1 /1000; India 30/1000). [26 27] According to the HMIS (health management information system), [28] Palwal district recorded 24046 deliveries during the year 2018-2019; 77% (18615) were institutional and the remaining (23%; 5431) occurred in homes. Only 17% (946/5431) of the home deliveries were attended by any skilled birth attendant. Furthermore, a verbal autopsy study from the same area indicated that 25% of neonatal deaths were due to sepsis [12] . In 50% of death cases, the neonates were not taken to any health facility before death. The actual figure of newborns and young infants with PSBI who were not accessing a health facility might be even higher. The preferred choice of care-seeking for neonatal illness in the area has been unqualified village practitioners followed by government hospitals and private qualified practitioners [29]. In a recent study on community management of pneumonia from the same study area 78% of sick infants and children visited private care providers (qualified providers, chemist, traditional healers). [30]”

27. Health infrastructure: Would encourage structuring the table currently labeled as Panel 1 in a way that makes it easier to follow and compare across settings—for example, having columns indicating type of provider present, type of care provided, maybe the total population it serves and/or number present in the area studied (the latter of which was not information I saw in the current format). This presentation would help to highlight key differences, especially as they relate to big questions regarding access undergirding this project.

• Response: Table has been modified as suggested.

Please refer Panel 1 in the revised manuscript page 8-10 as given below

Panel 1: Government district health facility framework and description of facilities in the context of PSBI management

Sl. no Name of the Facility/ Institution Expected strength of health personnel Type of care provided Population covered Number of health facilities in the study area Number of health personnel in position during the study period for neonatal care

1 Accredited Social Health Activist ( ASHA) Sanctioned positions for the area-172

Social mobilizer for promoting maternal and child health: ante-natal care; deliveries; immunization and sickness identification, counseling,

door-to-door surveys for specific service recipients @One ASHA for approximately 1000 rural population Working from home

172

2 Sub-Centre

(SC) 3. Two ANMs

4. one male multi-purpose health worker (MPW) Lower most health service delivery facility; provides basic antenatal care, immunization and treatment for minor illnesses 3000-5000 18 ANM: 29

Male Multi Purpose Health worker -3

3 Primary Health Centre (PHC) 5. Two qualified doctors (1-allopathic-MBBS and 1- Ayush Traditional medicine physician)

6. One staff nurse

7. One ANM

8. Other staff not directly involved with neonatal care: 1 pharmacist; 1 health educator and 2 health assistants PHC- first port of call to a qualified public sector doctor in rural areas for the sick and those who directly report or referred from Sub-Centres (5-6 SC fall under each PHC) for curative, preventive and promotive health care.

4-6 Bedded facility 20000-30000 3 PHC 1: Nagaljaat

Medical Officer: 0

Nurse: 1

ANM: 2

PHC 2: Kot

Medical Officer: 2

Nurse: 0

ANM:1

PHC 3: Uttawar

Medical Officer: 2

Nurse: 0

ANM:1

4 Community Health Centre (CHC) 4. Five medical specialists (i.e., general surgeon, physician, gynecologist, anesthetist and pediatrician)

5. Four general duty officers (1 dental surgeon, 3 general medical officers

6. Twenty one paramedical and support other staff. First referral unit for SCs and PHCs;

Facilities with one operation theater, X-ray machine, labour room and laboratory.

Provides facilities for 24X7 obstetric care and specialist consultations

Beds: 20-30 80000-120000 3 CHC 1: Aurangabad

Specialist: 0

Medical Officers: 4

Nurse: 1

ANM: 3

CHC 2: Hodal

Specialist: 0

Medical Officers: 4

Nurse: 4

ANM: 4

CHC 3: Hathin

Specialist: 0

Medical Officers: 5

Nurse: 4

ANM: 2

5 District Hospital (DH) Palwal district hospital is a

200 bedded hospital.

The district hospital has

3. Thirty seven specialists (including 3 paediatricians)

4. One hundred and thirty two paramedical staffs ( including 90 Staff nurse) District Hospital is secondary referral level facility and provides comprehensive secondary health care services to the population in the district. District Hospital is expected to deliver Essential (Minimum Assured Services) and Desirable (which we should aspire to achieve) package of services. The services include OPD, indoor and emergency service. In addition, basic specialty services, newborn care, psychiatric services, physical medicine and rehabilitation services, accident and trauma services, dialysis services and anti-retroviral therapy. Average population of a district varies between 15 to 30 million

Palwal district hospital covers a population of

1 million 1

Palwal Civil Hospital

Paediatrician:3

Medical officers:6

Nurse: 6

A deputy Chief Medical Officer [Deputy-CMO] supervised ANMs and ASHA coordinators [supervisors for ASHAs]

Health administration in the district managed by Chief Medical Officer’s Office

6 Special Newborn Care Unit (SNCU) Managed by an adequately trained pediatrician, doctors, staff nurses and support staff to provide 24x7 services.

As per MOHFW, the expected staff strength for a SNCU should be

3. One doctor per 4 beds

4. One nurse per 1.5 beds

( Palwal SNCU should have 5 doctors and 12 nurses) A SNCU is established at the district hospital and sub-district hospitals to provide care for sick newborns, i.e., all type of neonatal care except assisted ventilation and major surgeries. It is a separate unit close to the labour room with 12 or more beds.

Palwal DH- SNCU has 18 beds to manage sick newborns >3000 to 20000 annual delivery at district /sub-district level 1 Same as mentioned in row 5 under the district hospital

28. Study design: Section should specify which implementation research principles were used and justify the selection. Generally, this section, the steps/methods used & how they map onto the objectives was difficult to follow. Would strongly suggest including a diagram or figure that maps both the steps of the process and the pieces of the formative evaluation onto the overall study objectives.

• Response: We have incorporated the study framework adopted from the RE-AIM framework. We have added the following sentence in the revised manuscript on page 10, line 184-185.

“RE-AIM framework [31] was adopted to evaluate the implementation of PSBI guidelines in the study (Fig 2).”

Ref - Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health (1999) 89(9):1322–7. doi:10.2105/AJPH.89.9.1322

29. Details about the study protocols—especially for interviews, surveys, etc—are almost completely absent. Protocols for each of these data collection efforts should be (at least briefly) described, in a table or elsewhere. Also, this section consistently conflates research methods with results—for example, reporting final Ns for data collection instruments, rather than study protocols and procedures for recruiting individuals to complete measures, instruments, or interviews.

• Response: We have now provided study protocol in details. Study procedures data collection, management and analysis section has been modified now.

Please refer line 257-291 in page s 14, 15 1ns 16 for protocol of formative phase

“A formative study was conducted at baseline between June 2017 and January 2018. The assessment was done in two parts.

Formative research-part 1(June-August 2017): Baseline assessment included four components. i) Facility assessment: WHO facility scoring tool [33] was adapted to assess readiness for the availability of PSBI related supplies, manpower, service delivery and mechanisms of monitoring implementation of PSBI guideline (DH-1, CHC-3, PHC-3, sub-centers-18). ii) ASHAs’ perspectives about HBNC program, home visitation, sickness identification among young infants and care provision were obtained through knowledge attitude and practice (KAP) survey (n- 60; at the rate of at least one ASHA per village). iii) Perspectives of recently delivered (<6 months) and lactating mothers: In-depth interviews (n-30 mothers) and KAP survey with 150 mothers (at the rate of 3 randomly selected mothers from every village) to document mothers’ awareness of danger signs, care-seeking for their sick newborn and perceived value of home visitation by the ASHAs. iv) Towards the end of part 1 of the formative phase, both in-depth interviews and the quantitative survey indicated ground-level challenges about home visitation under HBNC by the ASHAs, assessment and management of young infants at the PHCs and CHCs and its influence on the care-seeking by the families for sick young infants. The respondents (surveys of mothers and ASHAs) had touched on these issues but in a restrained manner probably due to the sensitive nature of the problems. Non-formal interactions (NFI) [34, 35, 36] with primary care physicians working at CHCs and PHCs (n-5), pediatric specialists at district hospital (n-2), ASHAs (n-8), ANMs (n-5) and mothers (n-11) were undertaken to further explore these issues. Only senior investigators conducted NFIs which were considered critical to the success of the implementation research. No tape recording or notes were taken at the time of interaction but immediately after NFI, the summary of the interaction was noted down.

Co-participatory formative research – part 2 (August 2017- January 2018): The purpose was to get first-hand insight into challenges and barriers to implementing PSBI guideline beyond that obtained under Part 1 of the formative phase. The co-participant implementation phase was limited to six villages (population-29000); served by 71 ASHAs, two SCs, one CHC and the district hospital. During this period the research team also undertook house to house survey to determine the pregnancies missed by the health system (ASHAs), tracked them for deliveries and called up families with newborn to verify the ASHAs’ scheduled visits (For every new delivery a schedule of expected home visits by the ASHA was made and research staff called up the families between 48 and 96 hours after the scheduled time to confirm the home visits.) At least one of the investigators observed the doctors assessing infants aged less than 59 days at the CHC (receiving patients from the above mentioned six villages) using a structured observation checklist ( Supporting Information S1.Checklist) . This component was part of a planned staged implantation scale-up of the study; after the end of the six months, the study was expanded to all 50 villages”.

Refer line no -359 to 387 in page 18 -19 describe data ccollection and management in details

“The research data collection team comprised of Indian traditional medicine graduates with master’s in public health, graduate social scientists and field workers with at least 10 years of schooling. The research personnel were trained as per their assigned tasks in a 3-5 days’ workshop. They collected data for during the formative research; medical graduates interacted with medical officers in primary health facilities in the first two quarters, conducted post-treatment follow up (on 8th and 14th day) of PSBI diagnosis irrespective of the place where they were treated and abstracted administrative data from official documents of ASHAs, ANMs, PHCs, CHCs and district hospital. The data included: pregnancy, live birth, home visitation by ASHAs, sick young infants assessed and managed at different public sector health facilities, PSBI case classification formats, drugs administered, place of management (outpatient or in-patient), adherence, and follow up on day four and seven after initiating the treatment from all government health facilities.

As part of the community mobilization and engagement activities, the families were asked to inform the research team telephonically if they chose to take their sick young infants to private providers (Table S1). Data about obtaining treatment at private health facilities, clinical features at the time of seeking care and outcome was based on the recall by the mothers and families and available prescriptions. Information was obtained by the research team on the 8th and 14th day follow up post-initiation of treatment. The information about the case classification was not available for these cases. The processes and experiences of different aspects of implementation were recorded in the daily diaries of the study investigator and team leaders.

Quantitative data (KAP surveys of mothers and ASHAs, facility assessments, pregnancy and birth surveillance, assessment of sick young infants, treatment provided and outcome) was double entered in RedCap® double data module, for detecting inconsistencies and merged after validation. Data was exported to STATA® (Version 15.0) for analysis. Descriptive statistics were used to present coverage data, treatment adherence and cross-sectional survey data.

Qualitative data: Transcripts of recorded interviews (IDIs conducted during formative research with health service personnel, mothers and ASHAs) were prepared and complemented with field notes taken during non-formal interactions. All transcripts were entered in IQDAS (INCLEN Qualitative Data Analysis Software) [37]. Data were free-listed and key axial and selective codes were generated for analysis.”

30. Policy dialogue: Panel 2 is interesting and clearly very important, but no context is given for why certain departures from the WHO guidelines were determined and/or how they were justified. This is very important to understand as implementation efforts assume implementation of an evidence-based practice; if these guidelines are forcing departure from that evidence-base, it undermines the entire endeavor. Alternatively, tailoring that is done to address known barriers is an important part of the implementation process and thus provision of details about why these changes were made should be provided.

• Response: We want the reiterate that the WHO guideline (2015) was used as an intervention package and not the GOI (2014) guideline. Thus we have used evidenced-based guideline only. In the section “Built coalition” we have mentioned that we organized a national workshop to harmonize GOI guideline with WHO guideline. There was no departure from the WHO guideline during implementation.

Please refer line 207 – 213 in page 11

“As part of the policy dialogue with both central and state ministries of health, the research team obtained permission for modification of the GOI PSBI management guideline in a national workshop (October 2016) attended by national and state program managers, independent experts and brought it in line with the WHO PSBI guideline specifically for the implementation research study (Panel 2). The same group of stakeholders also participated in the finalization of the research protocol. The research team provided technical support to the Haryana State NHM to modify the IMNCI recording form and PSBI case follow up card to manage and maintain follow-up records of PSBI infants treated in PHCs/CHCs.”

31. Implementation phase: Specifics on the implementation strategy used should be provided ideally in line with Proctor, Powell & McMillen (2013) and/or as specified through the ERIC classification of implementation strategies (cf. Powell et al, 2015).

• Response: We have modified the nomenclature of implementation strategies in the methodology section according to the ERIC classification.

Please refer line no 194 – 195 in page 11

“To contextualize our implementation of the PSBI management intervention package, following discrete ERIC classification implementation strategies [32] were followed.”

32. Table 1: This table is clearly both very important and also incredibly onerous and almost entirely ineffective at communicating information. Additionally, the information included here seems to be related to results, not methods—so it should be moved, and the results should be presented in a more reader-accessible and organized way. One option may be to keep this table as supplemental information and highlight key results (in the results section!) that are curated by the authors as highlighting key lessons learned.

• Response: The table has now been moved to the result section. And text has been modified for more clearity. Please refer page 21-24

33. Nudges: No rationale or justification is provided for using the nudge strategy—which is notable because evidence regarding the effectiveness of nudges in changing behaviors is mixed. Additionally, it is not clear where or at what stages nudges were developed, how they were integrated into the overall implementation strategy, what protocol for nudges were & whether these protocols were followed with fidelity, and/or what results in they were expected to have. Finally, no citations are provided for definitions of or literature around behavioral nudges.

• Response: Thank you for this insight. We realized that what we leveraged as an implementation strategy is not a “behavioral nudge” in its true sense. We thus had no scope to measure the impact of behavioral nudge. We have now mentioned implementation strategies as per ERIC nomenclature. For the study, we did not develop a strict nudge protocol neither did we document the fidelity.

34. Data collection/management: Again, results are presented here. No Ns should be presented in methods sections (other than population N or target Ns).

• Response: Now the section is modified as suggested.

Refer line no -359 to 387 in page 18 -19 describe data ccollection and management in details

“The research data collection team comprised of Indian traditional medicine graduates with master’s in public health, graduate social scientists and field workers with at least 10 years of schooling. The research personnel were trained as per their assigned tasks in a 3-5 days’ workshop. They collected data for during the formative research; medical graduates interacted with medical officers in primary health facilities in the first two quarters, conducted post-treatment follow up (on 8th and 14th day) of PSBI diagnosis irrespective of the place where they were treated and abstracted administrative data from official documents of ASHAs, ANMs, PHCs, CHCs and district hospital. The data included: pregnancy, live birth, home visitation by ASHAs, sick young infants assessed and managed at different public sector health facilities, PSBI case classification formats, drugs administered, place of management (outpatient or in-patient), adherence, and follow up on day four and seven after initiating the treatment from all government health facilities.

As part of the community mobilization and engagement activities, the families were asked to inform the research team telephonically if they chose to take their sick young infants to private providers (Table S1). Data about obtaining treatment at private health facilities, clinical features at the time of seeking care and outcome was based on the recall by the mothers and families and available prescriptions. Information was obtained by the research team on the 8th and 14th day follow up post-initiation of treatment. The information about the case classification was not available for these cases. The processes and experiences of different aspects of implementation were recorded in the daily diaries of the study investigator and team leaders.

Quantitative data (KAP surveys of mothers and ASHAs, facility assessments, pregnancy and birth surveillance, assessment of sick young infants, treatment provided and outcome) was double entered in RedCap® double data module, for detecting inconsistencies and merged after validation. Data was exported to STATA® (Version 15.0) for analysis. Descriptive statistics were used to present coverage data, treatment adherence and cross-sectional survey data.

Qualitative data: Transcripts of recorded interviews (IDIs conducted during formative research with health service personnel, mothers and ASHAs) were prepared and complemented with field notes taken during non-formal interactions. All transcripts were entered in IQDAS (INCLEN Qualitative Data Analysis Software) [37]. Data were free-listed and key axial and selective codes were generated for analysis.”

Result

35. As with the methods section, it is difficult to follow which results track from which stages of the process. I would again encourage picking a structure for presenting the overall study design (e.g., in phases), mapping the objectives/research questions to those phases, and then mapping results (in this section) to those phases/questions. As presented currently, the conflation of methods for evaluation and results of those evaluations are very convoluted and difficult to extricate to determine whether results are valid or reliable, or whether they answer questions of interest.

• Response: In the study design section, the overall study design is presented in a phased manner. We have attempted to differentiate between implementation and research (evaluation) in the framework itself. The results are now separated from the methods.

Please refer aour contextualized Re AIM framework figure in page 10 line 191 wher in we have presented study design in phase manner .

36. Table 2: Unclear whether the days listed in Column 1 are ranges (e.g., is the second line reflecting visits that occurred between Day 1 and Day 3 or just on Day 3)? Also unclear why 0 visits is inapplicable to the partial information category. Finally, I didn’t see the response rate indicated anywhere in the table or text—is it correct that the response rate is (2001+487)/16,997 total calls, i.e., less than 15%?

• Response: The table number is now table 3. The data presented in Column 1 are not ranges. Each line representing the visits on that particular day. The partial information category is now deleted to avoid confusion.

Refer page 28

Table 3. Post-natal home visitation by ASHAs during first four quarters (Aug 2017 - Jul 2018) of study period *

Post-natal home visits by ASHAs Based on the official record submitted by ASHA

(N – 1475) † Based on the call from the research team to families

(complete information available about the scheduled visits)

(N – 2001) ‡

n (%) n (%)

• Day 1 366(24.8) 372(18.6)

• Day 3 1341(90.9) 1079(53.9)

• Day 7 1414(95.9) 923(46.1)

• Day 14 1385(93.9) 880(44.0)

• Day 21 1324(89.8) 799(40.0)

• Day 28 1250(84.7) 785(39.2)

• Day 42 1168(79.2) 854(42.7)

• 0 visits 0 (0%) 336(16.8)

*Total no. of live births during Aug 2017-Jul 2018 – 3,254

†Refusal of ASHA to share records of 1,779 mother–child dyads

‡Total no. of calls made to the families - 16,977

37. Table 3: The presentation of this table (as well as some of the text in the conclusion) suggests that there were some over-time improvements in implementation, however, these effects are not apparent from this table—perhaps because there is so much information that is presented here? One suggestion would be to curate this table a bit more to focus on the results that were most interesting? For example, (a) since sub-centres were never the first point of care nor place of treatment, these rows could be removed from the table & a footnote could indicate this absence of action. Additionally, (b) if changes over time are of interest, proper statistical tests should be included. (Note (c) that a multi-paneled figure reflecting trends would be a much more reader-friendly way to convey this information as well).

• Response :

(a) Sub-centre row is now deleted.

(b) Multi paneled figure to show the change is now attached as Supporting information .

PSBI management:

38. Unclear where the 10% live births with PSBI assumption comes from; this should be justified and sources referenced.

• Response: This data is referenced now.

Please refer line 427 in page 26

Saha SK, Schrag SJ, El Arifeen S, Mullany LC, Shahidul Islam M, Shang N, et al. Causes and incidence of community-acquired serious infections among young children in south Asia (ANISA): an observational cohort study. The Lancet. 2018;392:145–59.

African Neonatal Sepsis Trial (AFRINEST) group, Tshefu A, Lokangaka A, et al. Simplified antibiotic regimens compared with injectable procaine benzylpenicillin plus gentamicin for treatment of neonates and young infants with clinical signs of possible serious bacterial infection when referral is not possible: a randomised, open-label, equivalence trial. Lancet 2015; 385: 1767–76 pmid:25842221

Mir F, Nisar I, Tikmani SS, Baloch B, Shakoor S, Jehan F et al. Simplified antibiotic regimens for treatment of clinical severe infection in the outpatient setting when referral is not possible for young infants in Pakistan (Simplified Antibiotic Therapy Trial [SATT]): a randomised, open-label, equivalence trial. Lancet Glob Health 2017; 5: e177–85 pmid:27988146

Baqui A, Saha S, Ahmed A, Shahidulla M, Quasem I, Roth DE et al. Safety and efficacy of alternative antibiotic regimens compared with 7 day injectable procaine benzylpenicillin and gentamicin for outpatient treatment of neonates and young infants with clinical signs of severe infection when referral is not possible: a randomised open label, equivalence trial. Lancet Glob Heal. 2015; 3: e279–87

39. Table 4: Best practices in this table should be highlighted to indicate what proportion of cases were ‘high fidelity’. Additionally, having a separate category for 6 cases (Critical illness) is problematic—would combine with one of the other categories (or simply not include as its own column). I also don’t think sections B1 and B2 need to be in the table since they are not a focus of the implementation effort. Discuss in the text but exclude from the table.

• Response :

i. Row number 2 under section A represents the high fidelity cases.

ii. We belive that the ‘Critical Illness’ should be represented separately, as they are seriously sick infants, who ideally should not be managed in primary facilities; However, because they refused hospitalization they were managed at the primary care facilities. This is a high risk for mortality category that cannot be combined with other categories.

iii. Our aim was also to incarese access to treatment for PSBI also. Management of PSBI at the referral level facilties is important because this is the current standard of care. That is why we included this information. We felt this is important to mention and it gives a complete picture.

iv. We have separated the ‘Private Providers’ from the ‘Hospital Management’ as ‘C’. The reviewer 1 recommended the private sector data to be presented. l

40. Unclear what the purpose of is including section on sicknesses identified other than PSBI—this should be dropped, and other relevant information related to barriers to care should be expanded.

• Response: Again, other illnesses were presented to complete the picture. We realized that, to make a health facility functional (in terms of managing sick young infants), one should include other illnesses alongwith the PSBI cases. It is crucial to build trust of the community in order to influence their careseeking behaviour in a positive manner.

Discussion

41. Unclear where the 70% treatment coverage rate came from—this should be defined precisely in the results section.

Response: We have clarified the language about treatment coverage. Previously published data reported around 10% prevalence of PSBI in young infants up to 2 months of age (see references below). We used this 10% for calculating the coverage purpose. Considering 5270 live births in our study area during the study tenure, our estimated cases would have been 527, but in our study area we identified only 370 cases that were treated, which indicates a coverage of 70%.

Saha SK, Schrag SJ, El Arifeen S, Mullany LC, Shahidul Islam M, Shang N, et al. Causes and incidence of community-acquired serious infections among young children in south

Asia (ANISA): an observational cohort study. The Lancet. 2018;392:145–59.

African Neonatal Sepsis Trial (AFRINEST) group, Tshefu A, Lokangaka A, et al. Simplified antibiotic regimens compared with injectable procaine benzylpenicillin plus gentamicin for treatment of neonates and young infants with clinical signs of possible serious bacterial infection when referral is not possible: a randomised, open-label, equivalence trial. Lancet 2015; 385: 1767–76 pmid:25842221

Mir F, Nisar I, Tikmani SS, Baloch B, Shakoor S, Jehan F et al. Simplified antibiotic regimens for treatment of clinical severe infection in the outpatient setting when referral is not possible for young infants in Pakistan (Simplified Antibiotic Therapy Trial [SATT]): a randomised, open-label, equivalence trial. Lancet Glob Health 2017; 5: e177–85 pmid:27988146

42. Baqui A, Saha S, Ahmed A, Shahidulla M, Quasem I, Roth DE et al. Safety and efficacy of alternative antibiotic regimens compared with 7 day injectable procaine benzylpenicillin and gentamicin for outpatient treatment of neonates and young infants with clinical signs of severe infection when referral is not possible: a randomised open label, equivalence trial. Lancet Glob Heal. 2015; 3: e279–87Generally, conclusions need to be tempered for this paper, and the conclusions should remind the readers from the outset that this was an observational, feasibility study for implementation of a particular guideline. While this paper does seem to strongly support feasibility of this intervention, there are serious limitations related to the selection of the region, problems with data reporting, and of course the study design that limit generalizability of findings, and certainly limit any notions of effectiveness or causality of the implementation. This is particularly notable for the authors claim that this study “demonstrated that oral amoxicillin alone is effective in managing pneumonia cases”—such a claim simply cannot be made with a study like this as there is no control case; data is purely observational. Further, claims like this distract from the implementation focus of the study. The authors would be much better off focusing on the purview suggested by the title—lessons from implementation—rather than trying to make claims related to clinical effectiveness. Of course, this doesn’t mean that they cannot claim that low mortality rates and high treatment rates aren’t important; they are—but they are reflective of the potential for guidelines like this to be implemented in communities like this that have room for improvement; their “effect” on downstream clinical outcomes simply cannot be estimated without a more rigorous study design.

• Response: We have modified the conclusion section as per the suggestions

Please refer line 617- 626 in page 37

“In conclusion, we identified some key implementation barriers such as irregular and poor quality home visitation by the ASHAs, poor ability of the families and mothers to identify danger signs in their young infants, lack of confidence of primary care physicians at PHCS/CHCs to manage sick young infants and reluctance of the ANMs to consider themselves as care providers. Most of the bottlenecks could be resolved by the district and state authorities and technical assistance from experts through leveraging existing resources and developing contextualized strategies. We demonstrated the feasibility of implementing management of PSBI on an outpatient basis when referral to a hospital was not feasible in a program setting by focusing on hand holding and confidence building of the primary care physicians, making the CHCs and PHCs functional and targeted social mobilization to empower the mothers and families for early recognition of sickness in their young infants”.

43. As with the rest of the manuscript, the conclusion has several places where important references appear to be missing—e.g., for “recent implementation research” that describes adherence to antibiotics guidelines improving slowly over time.

• Response: We have removed the statement.

44. The limitations should reflect the limitations of the observational study design, potential threats to validity and generalizability related to the population of interest, and larger issues related to data quality and potential missing data. This section is very weak at the moment.

• Response : Section has been modified.

Please refer line 601- 614 in page 36

The results from our observational feasibility study need to be seen in light of its limitations. We were able to identify a much smaller number of infants with fast breathing due to a concurrent study about the management of the fast breathers by ASHAs, which led to relatively lower coverage of the sick young infants. But it is unlikely to influence the documentation of our experience of using simplified antibiotic including injectable antibiotics for other more severe categories of PSBI. Home visits by ASHAs were irregular and of poor quality for empowering the families and mothers, which led to a relatively small proportion of sick young infants by them. ASHAs are permanent member of the public health field team and can provide the sustainability to PSBI program, so the district authorities need to follow-up to increase the postnatal home visits. We did not cross-check the antibiotic doses administrated by the public facility doctors. Thus we could only comment on the effectiveness of simplified antibiotic therapy but cannot comment on the drug dosage and its response. Finally, for various operational and administrative reasons, we had to terminate the study without executing the panned exit strategy prepared in consultation with the TSU, which is likely to influence the sustainability of program refinements after the exit of the research team.

________________________________________

Attachment

Submitted filename: 1. Response to th Reviewers 15th March 2021.docx

Decision Letter 1

Ricardo Q Gurgel

21 May 2021

Lessons from an implementation research on community management of possible serious bacterial infection (PSBI) in young infants (0-59 days), when referral is not feasible in Palwal district of Haryana, India.

PONE-D-20-18867R1

Dear Dr. Arora,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Ricardo Q. Gurgel, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #3: (No Response)

Reviewer #4: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #3: Yes

Reviewer #4: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #3: This is an important paper relates to WHO guideline on implementation of management of possible severe bacterial infection in low-middle income countries that has critical importance for global public health and findings of the study could affect policy and practice in other settings. It is professionally written paper. I do not have major reservations. However, the paper needs minor revision on the following issues before it can be considered for publication.

Please delete lines 247-252 “out of family…………………… S1 table” from method section and author may describe it is result section.

Table 2 can be deleted and replace in brief narration.

Please revise Table 1 as it is too lengthy. It would be rendered concise and comprehensive for the ease of readers.

There is some repetition in the paper.

Please delete lines 303-307 “there were two …………………………………………………… in the CHCs and PHCs (Table 1)”. As it is repetition, already documented in table 1.

Please delete line 316-325 “Implementation of nudge strategies” section as it is repetition.

Reviewer #4: 1. This research should be viewed in the context of a series of studies conducted in different geographical locations in India that have been published in your journal,

PLOS ONE. This is a part of the implementation research on WHO PSBI guidelines.

2. The objective of the study is to implement the PSBI guideline developed by the WHO & GOI

3. The RE- AIM Framework was adopted to document the implementation strategy.

4. Chance of working in a real world setting, strength and weaknesses of different approaches have been tested using the Reach, Effectiveness, Adoption, Implementation & Maintenance approaches that are together expected to determine the Public Health Impact of the intervention.

5. Considering the above, the individual level impact in terms of reaching the target population and efficacy of the intervention have been achieved in good measure in the study ( 70% coverage and above 90% achievement of clinical treatment success). However, a higher Coverage of intervention (80%) was achieved in Himachal Pradesh (Goyal et al). Identification of PSBI by ASHA workers was reported to be 80% in the study by Awasthi et al in Uttar Pradesh.

As members of this collaborative research team, the authors of the manuscript could have used learnings from these settings to improve the implementation in Palwal.

6. One can not comment on the consistency and the cost of intervention implementation, as it has not been evaluated or reported in the manuscript.

7. Maintenance of the intervention effects in the study setting was probably not possible to observe, as the authors report termination of the study without executing the planned exit strategy, under limitations.

8. The TSU served as the backbone in the implementation research study: although the strategies to empower mothers and families, building capacity through training of health staff seems to be partially successful, the strategy for improving performance of the ASHAs, ANMs seems to have failed.

It is mentioned that the health system laid emphasis on the registration /line listing of the beneficiaries by the ASHAs, however, completing the visitation as per schedule of HBNC was not prioritised.

The authors have not explained any reasons for this. It is mentioned that Non formal interactions with health care providers were conducted to explore these issues in a restrained manner. However, better remedial measures if implemented under the guidance of the TSU/ or on the basis of feedback from the research team that co-participated in the implementation for initial six months to identify barriers, could have led to improved coverage of HBNC visits by ASHA resulting in better identification of PSBI as well.

Learnings from the efficacy trials such as the Gadchiroli study (Bang et al The Lancet 1999) and more recently results of an M-health intervention study conducted in Gujarat (Modi et al PLOS One- 2019) indicate that Village health workers now called ASHAs, if trained adequately can help improve the morbidity mortality indicators immensely.

9. The qualitative research has been designed and implemented well. Community mobilization activities have been described well.

10. Data presented in Table 2 describes identification, point of care, place of treatment, number of deaths by six Quarters, however, no trends can be observed in the data presented. It is not helpful in understanding the impact of study activities on outcomes.

11. Table 3 Post natal Home visitation by ASHAs shows substantial discrepancy in data reported by ASHA and the data collected by the research team on phone calls: The reasons for this should have been better discussed, it is just mentioned that incomplete data on mother-infant dyad was not reported.

12. The ASHAs identified only one tenth of the PSBI cases: was the incentive based payment system working adequately in the study setting? could there be monetary reasons for underperformance among others, listed by the authors in the discussion section.?

13. Similarly, what were the reasons for better impact on mothers and family members as compared to ASHAs and other health workers?

14.The Implementation research study identified the bottlenecks of implementation of PBSI guideline in presence of a TSU and its positive role, well emphasised in the manuscript. The reasons for failure of its strategies to improve service delivery by ASHAs, ANMs needs to be further explored

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #3: Yes: Prof Sajid Soofi

Reviewer #4: Yes: Anju Sinha

Acceptance letter

Ricardo Q Gurgel

23 Jun 2021

PONE-D-20-18867R1

Lessons from implementation research on community management of possible serious bacterial infection (PSBI) in young infants (0-59 days), when the referral is not feasible in Palwal district of Haryana, India.

Dear Dr. Arora:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Ricardo Q. Gurgel

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Checklist. Observation checklist for medical officers.

    (DOCX)

    S1 Fig. Identification, first point of care, place of treatment and number of deaths of in young infants with PSBI signs across six study quarters (N- 370).

    (DOCX)

    S1 Table. List of private providers who managed 155 PSBI infants during implementation research at district Palwal (Haryana, India).

    (DOCX)

    S2 Table. Total sickness identified in 0–59 days old infants during implementation period (Aug 2017—Jan 2019).

    (DOCX)

    S1 Data. INCLEN Palwal PSBI IR crf1 (n-5270).

    (XLSX)

    S2 Data. INCLEN Palwal PSBI IR crf2 (n-5270).

    (XLSX)

    S3 Data. INCLEN Palwal PSBI IR crf3 (n-370).

    (XLSX)

    S4 Data. INCLEN Palwal PSBI IR crf4 (n-370).

    (XLSX)

    S5 Data. INCLEN Palwal PSBI IR crf5 (n-370).

    (XLSX)

    Attachment

    Submitted filename: 1. Response to th Reviewers 15th March 2021.docx

    Data Availability Statement

    The data underlying the results presented in the study are available from Brig (Rtd.) V. K. Panday (Email: vk.panday@inclentrust.org; Phone - +91-8607023300).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES