Skip to main content
PLOS Global Public Health logoLink to PLOS Global Public Health
. 2023 Nov 21;3(11):e0001990. doi: 10.1371/journal.pgph.0001990

World Health Organization Danger Signs to predict bacterial sepsis in young infants: A pragmatic cohort study

Omolabake Akinseye 1,, Constantin R Popescu 2,3,, Msandeni Chiume-Kayuni 4,5, Michael A Irvine 6,7, Norman Lufesi 8, Tisungane Mvalo 9,10, Niranjan Kissoon 1,2, Matthew O Wiens 11, Pascal M Lavoie 1,2,*
Editor: Musa Mohammed Ali12
PMCID: PMC10662722  PMID: 37988384

Abstract

Bacterial sepsis is generally a major concern in ill infants. To help triaging decisions by front-line health workers in these situations, the World Health Organization (WHO) has developed danger signs (DS). The objective of this study was to evaluate the extent to which nine DS predict bacterial sepsis in young infants presenting with suspected sepsis in a low-income country setting. The study pragmatically evaluated nine DS in infants younger than 3 months with suspected sepsis in a regional hospital in Lilongwe, Malawi, between June 2018 and April 2020. Main outcomes were positive blood or cerebrospinal fluid (CSF) cultures for neonatal pathogens, and mortality. Among 401 infants (gestational age [mean ± SD]: 37.1±3.3 weeks, birth weight 2865±785 grams), 41 had positive blood or CSF cultures for a neonatal pathogen. In-hospital mortality occurred in 9.7% of infants overall (N = 39/401), of which 61.5% (24/39) occurred within 48 hours of admission. Mortality was higher in infants with bacterial sepsis compared to other infants (22.0% [9/41] versus 8.3% [30/360]; p = 0.005). All DS were associated with mortality except for temperature instability and tachypnea, whereas none of the DS were significantly associated with bacterial sepsis, except for “unable to feed” (OR 2.25; 95%CI: 1.17–4.44; p = 0.017). The number of DS predicted mortality (OR: 1.75; 95%CI: 1.43–2.17; p<0.001; AUC: 0.756), but was marginally associated with positive cultures with a neonatal pathogen (OR 1.22; 95%CI: 1.00–1.49; p = 0.046; AUC: 0.743). The association between number of DS and mortality remained significant after adjusting for admission weight, the only statistically significant co-variable (OR 1.75 [95% CI: 1.39–2.23]; p<0.001). Considering all positive cultures including potential bacterial contaminants resulted a non-significant association between number of DS and sepsis (OR 1.09 [95% CI: 0.93–1.28]; p = 0.273). In conclusion, this study shows that DS were strongly associated with death, but were marginally associated with culture-positive pathogen sepsis in a regional hospital setting. These data imply that the incidence of bacterial sepsis and attributable mortality in infants in LMIC settings may be inaccurately estimated based on clinical signs alone.

Introduction

Three million children die each year worldwide in their first month of age, with a significant proportion of these deaths occurring during the first week [1]. Severe infections (including sepsis, pneumonia, diarrhea and viral diseases) are common causes of serious illnesses in young infants [2]. Up to 25% of cases in low- and middle-income countries (LMICs) have identified bacterial causes [3]. However, the lack of diagnostic resources, particularly in LMICs makes it difficult to accurately quantify this burden. This gap has enormous implications in terms of implementing policies and guidelines for the use of antimicrobials to prevent these deaths [1]. At the individual level, identifying bacterial causes for sepsis is crucial to prevent fatalities and guide the correct empiric antibiotic therapy in the context of rising antimicrobial resistance. Indeed, the misuse, or even the overuse, of antibiotics carries a risk of subsequent treatment failure due to colonization by resistant bacteria [4, 5].

To assist front-line health workers, the World Health Organization (WHO) and United Nations International Children’s Emergency Fund developed algorithms in the early 1990s to help triage interventions for sick children [6]. This Integrated Management of Childhood Illness (IMCI) strategy included the identification of clinical signs to alert the need for escalation of care, later termed Danger Signs (DS) [6]. Subsequently, the Young Infant Clinical Signs Study Group carried out a multi-centered study in six LMICs and found that seven signs (i.e., history of difficulty feeding, grunting, convulsions, movement only when stimulated, respiratory rate ≥60 breaths per minute (bpm), severe chest indrawing, temperature below 35.5°C or above 37.5°C, prolonged capillary refill, cyanosis and stiff limbs) best predicted the need for higher level of care, with a sensitivity of 74% to 85%, and specificity of 75% to 79%, depending on infants’ age (i.e., 0 to 6 days versus 7 to 59 days old) [7]. A systematic review of five studies on 17,506 infants found similar results [8].

Over time, the use of DS has been extended to provide a reasonable basis for the initiation of empiric antibiotic treatment [9]. However, these signs have neither been developed nor validated to diagnose sepsis of bacterial etiology. Neonatal disorders such as transient tachypnea of the newborn, hypoglycemia, hyaline membrane disease, birth asphyxia, and viral infections (to mention only a few), present like bacterial sepsis [10]. Hence, a key question is whether DS can reasonably identify young infants who truly benefit from antibiotic treatment. Only a few studies have attempted to answer this question, but certainly none that have, to the best of our knowledge, been conducted prospectively, in a pragmatic setting where clinicians, not research staff, pragmatically reported DS [11].

The objective of this study was to determine the extent to which WHO DS predict bacterial sepsis in young infants, in a LMIC hospital setting where front-line health workers were asked to assess and record the presence of DS in infants who presented with suspected sepsis.

Materials and methods

Study approval

The study was approved by the National Health Science Research Committee of Malawi (#17/8/1819) and the University of British Columbia’s Children’s and Women’s Research Ethics Board (#H16-02639). The study was supported by the chair of the Department of Pediatrics at Kamuzu Central Hospital and discussed with leaders from the Pediatric and Child Health Association (PACHA), UNICEF Malawi and the Ministry of Health of Malawi.

Study design, setting & population

This study was a pragmatic cohort study, and secondary analysis of data from a parent study that aimed to identify molecular RNA-sequencing signatures of bacterial sepsis in young infants with suspected sepsis [12]. In the parent study, infants below 3 months of age with suspected sepsis, defined according to the attending staff’s clinically suspicion, were sequentially enrolled “around the clock” at the time they presented to the neonatal or pediatric units at Kamuzu Central Hospital in Lilongwe, Malawi between June 5th, 2018, and April 6th, 2020 (including recruitment, exposure and data collection). To minimize bias towards false-negative blood culture, infants were excluded if they had been on antibiotics more than 4 hours prior to the cultures. About 851 infants presented with suspected sepsis and the vast majority were not enrolled because staff were unable to get consent–either parents declined, or were not approached for consent due to lack of time and/or competing clinical demands. Written informed consent was obtained from parents/guardian of each participant, in English or Chichewa (main local language). Enrolled infants were followed during hospitalization at Kamuzu Central Hospital, until transferred to another facility or discharged home.

The Kamuzu Central Hospital the largest referral hospital in central Malawi, where approximatively 3,000 infants are admitted to its neonatal unit annually. “Suspected sepsis” was defined as per the clinical staff, essentially in an infant that looked unwell where bacterial sepsis could not be excluded clinically. Before the study, the staff at Kamuzu Central Hospital did not have routinely access to blood culture or other ancillary tests, IV fluids and gavage feeds were also most often not available due to limited resources and supplies. Available interventions include antibiotics, assistance with feeding and routine surgeries when necessary. Oxygen and continuous positive pressure ventilation were only available to an extremely limited number of infants, on a limited basis when the hospital had electrical power. Invasive mechanical ventilation was not possible. During the study, investigators did not have access to information that could identify participants, except for the consent forms which were kept under the responsibility of the local study PI (MCK). The study was administered and local research staff were hired through a partnership with the Parent and Child Health Initiative (PACHI), a Malawian non-profit non-governmental organization, which works in collaboration with the Ministry of Health.

Clinical data and blood samples collection

Each infant had an initial clinical evaluation by a healthcare worker (or staff, either a nurse or clinical officer). The presence of the following nine DS were prospectively collected at presentation, using electronic forms, on a tablet device: i) history of not feeding well (interviewing the parent/caregiver), entered as “feeding well”, “unable to feed” or “uninterested in feeding” (combining the latter two categories), ii) fast breathing ≥60 bpm (with respiratory rate visually counted by attended clinician), iii) temperature instability, defined as axillary body temperature <35.5°C or >38°C, (measured using an electronic Welch Allyn SureTempTM thermometer, model 692), iv) drowsiness/difficulty to wake, v) grunting, vi) severe chest recession, vii) central cyanosis, viii) movements only when stimulated or no movement at all and ix) convulsions (defined pragmatically by attending clinician). Additionally, clinical staff had to report whether they felt the infant was “well”, “ill” or “severely ill” at the time of assessment. However, in keeping with a pragmatic design, the study did not attempt to enforce strict criteria for illness status, or for to define suspected sepsis or the presence or absence of DS. All infants also had a standardized aerobic blood culture (minimum 2 mL of blood) collected within 4 hours of presentation, using a rigorously implemented aseptic protocol (with in-training of all front-line healthcare providers prior to study initiation), as detailed [13]. Cerebrospinal fluid (CSF) cultures were collected by clinical staff, whenever they felt it was clinically indicated, at their discretion, based on availability of supplies, and the cost of the test that had to be paid by parents. No urine cultures were performed.

Blood cultures, were paid by the study, and processed into BACTEC PEDS Plus culture bottles incubated for 5 days in a BD BACTEC 9050 instrument. Identification of organisms from blood or CSF cultures was completed in-house using bioMerieux API, and BD Crystal kits at a local University of North Carolina-affiliated research facility, as described [12]. Bacterial isolates that could be restored (∼60% of isolates) were also analyzed for further confirmation of identity on a Microflex LT MALDI-TOF mass spectrometer, using the BioTyper software version 3.1 (Bruker Daltonik, Germany). Culture results were made available to clinicians involved in the care of the infants.

Outcome measures

The primary outcomes of interest were mortality, and culture-positive sepsis defined as the bacterial growth of a known neonatal pathogen in blood or CSF culture sample. Micro-organisms not commonly considered as pathogens in term or near-term infants, such as coagulase-negative Staphylococcus, Micrococcus, Corynebacterium, Bacillus species, or streptococcus species such as S. oralis were considered as potential contaminants and were excluded from the main bacterial sepsis outcome [14], but these potential contaminants were included in a sensitivity analysis using an alternate bacterial sepsis outcome “including potential contaminants” (S1 Table). In-hospital mortality was recorded until discharge home or transfer to another hospital facility. Data were considered missing when infants were transferred within 72 hours after initial admission to the hospital.

Statistical analysis

In the parent study, the sample size was set on the original molecular signature aim, at 500 infants over two years, assuming a 20% incidence of bacterial sepsis and expecting to identify between 10 and 50 differentially expressed molecular gene markers [12]. However, the study needed to be stopped early, in April 2020 due to the COVID-19 pandemic, so in the end only 401 infants were enrolled. All infants originally enrolled in the parent study were analyzed. Demographic characteristics were reported descriptively using the mean/median with dispersion. The nine aforementioned WHO DS were used as predictors. All quantitative variables were analyzed as such, except for fast breathing and temperature instability which were categorized according to WHO definitions (see above). Odds ratios were calculated for each DS and the main outcomes of bacterial sepsis or mortality. Logistic regressions were conducted between the number of DS and the main outcomes. In separate analyses, odds ratios were calculated using logistic regressions between mean DS (i.e., the number of DS divided by the available DS data) to determine the effect of missing DS data. Unadjusted logistic regression models, including demographic variables, were conducted to determine the predictive value of the DS. The predictive performance of DS for each outcome was assessed using the area under receiver operator characteristic curve (AUC-ROC). Sociodemographic variables associated with mortality, as well as their independent effects were analyzed using regression models. Only complete cases were used in the analysis for associations with individual DS, or the outcome “cumulative number of DS”. However, analyses were also conducted using “mean number of DS”, to account for missing values, with no significant differences in results. Statistical significance was considered at p-value <0.05 with no adjustment made for multiple testing in unadjusted models. Analyses were performed using R (version 4.1.0) and SPSS version 20 (IBM, Armonk, NY, USA). The complete dataset for this study can be found in S1 Dataset.

Inclusivity in global research

Additional information regarding the ethical, cultural, and scientific considerations specific to inclusivity in global research is included in the S1 Questionnaire.

Results

Study population

The majority of the 401 infants included in the study were term or late preterm infants, born vaginally, presented from home in their first week of post-natal life, and had roughly equal female/male distribution (Table 1). Most infants were reported by clinicians to look ill at the time of initial presentation (69.3%; 278/401), 22.2% (89/401) were severely ill, and 8.5% appeared well (34/401). In total, 79.8% (320/401) presented at least one DS. Overall, 56.9% (228/401) of infants had been ill for at least 24 hours prior to initial presentation, and their parents had traveled a median distance of 17 kilometers, often by foot or taxi, to reach the nearest hospital. In total, 94/401 (23.4%) infants had received antibiotics prior to the blood culture, for a median of 2 hours (range 0.75 to 3.5 hours). The duration of antibiotic use in infants ranged from 1 to 30 days (Table 1). Few infants with negative blood culture had antibiotics discontinued after 48 hours (21/401, 5.2%).

Table 1. Socio-demographic characteristics of the study population.

Participant characteristics N with data
Gestational age at birth (weeks), mean (SD) 37.1 (3.3) 397
Birth weight (gram), mean (SD) 2865 (785) 380
Female, no (%) 185 (46) 401
Admitted from, no (%) 401
    Inborn (i.e., admitted from birth hospital) 161 (40.1)
    Transferred from another facility 224 (55.8)
    Home 16 (4.0)
Post-natal age at presentation (days), median (IQR) 4 (2–16) 401
Mode of delivery, no (%) 398
    Caesarean section 101 (25.2)
    Vaginal delivery 297 (71.8)
Duration of illness before presentation to hospital (hours), median (IQR) 24 (12–48) 341
Distance of travel to hospital (km), median (IQR) 17 (11–25) 342
Illness status, number on infants (%) 401
    Well 34 (8.5)
    Ill 278 (69.3)
    Severely ill 89 (22.2)
Total duration of antibiotics (days), median (IQR) 6 (5–9) 401
Duration of hospital stay (days), median (IQR) 7 (5–9) 401
Danger Signs, number of infants (%)
    Not feeding well 171 (43.3) 395
    Convulsions 28 (7.0) 401
    Drowsy / Difficult to wake 33 (8.2) 401
    Movements only when stimulated or no movements 26 (6.5) 401
    Fast breathing > = 60 per min 104 (27.1) 384
    Grunting 30 (7.5) 401
    Severe chest recessions 51 (12.7) 401
    Temperature instability >38°C or <35.5°C 118 (32.7) 361
    Central cyanosis 29 (7.2) 401

Outcome data

The proportion of infants with bacterial sepsis, considering only known pathogens in term and near-term infants, was 10.2% (41/401). Blood (39/401) and CSF (2/204) cultures were positive for pathogens in 9.7% and 1.0% of the infants, respectively. Of 230 infants under 7 days old, 21 (9.1%) had bacterial sepsis with a pathogen versus 20 of the 171 infants (11.7%; p = 0.402 by chi-square test) ≥ 7 days old. The proportion of gram-positive sepsis (21/39) and gram-negative sepsis (20/39) were similar among all infants (S1 Table), and were also similar between infants under 7 days (9 versus 12) and infants ≥ 7 days old (12 versus 8; p = 0.272 by chi-square test, noting however the small sample size for comparison). The proportion of sepsis was also similar in inborn infants (19/161) versus infants transferred from another hospital facility (22/224) or admitted from home (0/16). Three infants were transferred before 72 hours from admission, so the mortality outcome was considered missing in these infants. Among the remaining infants, mortality was 9.7% (i.e., 39/398), of which 61.5% [24/39] died within 48 hours.

Associations with mortality and culture-positive outcomes

The following DS were significantly associated with mortality (Table 2): not feeding well, convulsions, drowsy/difficult to wake, movements only when stimulated or no movements, grunting, severe chest recessions, central cyanosis. In contrast, fast breathing or temperature instability were not significantly associated with mortality. The number of DS was also significantly associated with mortality (OR 1.75 [95%CI: 1.43–2.17] per cumulative DS; p<0.001; AUC: 0.743) (S1 Fig). Admission weight was significantly associated with mortality, but neither age of the mother, gestational age, birth weight nor sex were significantly associated with mortality (S2 Table). When adjusting for these co-variables, both the cumulative (OR 1.75 [95% CI: 1.39–2.23]; p<0.001) and mean number of DS (1.80 [95% CI: 1.44–2.30]; p<0.001) remained highly significantly associated with mortality (S2 Table).

Table 2. Associations between DS and mortality.

Variable Odds ratio (OR) 95%CI P value
Not feeding well 7.21 3.27–18.2 <0.001*
Convulsions 3.52 1.31–8.59 0.008*
Drowsy / Difficult to wake 5.04 2.12–11.4 <0.001*
Movements only when stimulated or no movements 4.89 1.88–11.9 <0.001*
Fast breathing > = 60 per min 1.86 0.87–3.85 0.100
Grunting 3.95 1.54–9.34 0.002*
Severe chest recessions 3.01 1.34–6.37 0.005*
Temperature instability >38°C or <35.5°C 1.70 0.75–3.75 0.191
Central cyanosis 4.15 1.62–9.87 0.002*

*Significant ORs (p<0.05)

Mortality was higher in infants with bacterial sepsis with a known neonatal pathogen compared to other infants (22.0% [9/41] versus 8.3% [30/360]; p = 0.005). Bacterial sepsis was significantly associated with mortality (OR 3.07 [95%CI: 1.28–6.82]; p = 0.008). However, the only DS significantly associated with bacterial sepsis when considering only known neonatal pathogens was not feeding well (OR 2.25 [95%CI: 1.17–4.44]; p = 0.017 (Table 3); 61.0% [25/41] of the children with bacterial sepsis were not feeding well versus 41.2% [146/354] of the other children). Associations between convulsions, drowsiness, lethargy (i.e., movements only when stimulated or no movement), tachypnea, grunting, severe chest recession, temperature instability and central cyanosis were all non-significant (Table 3). Association was between cumulative number of DS and bacterial sepsis was marginally signiSficant (OR 1.22 [95% CI: 1.00–1.49]; p = 0.046) (S2 Fig). At discharge, clinical staff selected non-bacterial sepsis in 76.3% (306/401), bacterial sepsis in 15.5% (62/401) and “other non-sepsis syndromes” in 8.2% (33/401) of cases, from these options, for study purposes.

Table 3. Association between DS and bacterial sepsis when organism is a known pathogen.

Variable Odds ratio (OR) 95%CI P value
Not feeding well 2.25 1.17–4.44 0.017*
Convulsions 0.65 0.10–2.30 0.571
Drowsy / Difficult to wake 0.86 0.20–2.57 0.811
Movements only when stimulated or no movements 1.65 0.46–4.59 0.382
Fast breathing > = 60 per min 1.06 0.49–2.17 0.868
Grunting 2.38 0.84–5.89 0.077
Severe chest recessions 2.17 0.92–4.74 0.061
Temperature instability >38°C or <35.5°C 1.60 0.78–3.24 0.193
Central cyanosis 1.01 0.32–3.03 0.994

*Significant ORs (p<0.05)

Associations when including potential contaminant blood cultures

When considering positive blood cultures for potential contaminants (S1 Table), an additional 45 infants had positive blood or CSF cultures (total of 86 infants with positive blood cultures). One infant had a contaminating blood culture, but grew unidentified gram-negative diplococci in the CSF, so this infants was originally classified as bacterial sepsis with a pathogen (total of 46 infants with potential blood culture contaminants). When including infants with positive blood cultures for both contaminants and pathogens, and infants with positive CSF cultures, culture positivity was not significantly associated with mortality (OR 1.74 [95% CI: 0.82–3.53]; p = 0.135), or any DS (S3 Table). The number of DS was also not significantly associated with bacterial sepsis when including all pathogens and potential contaminants (OR 1.09 [95% CI: 0.93–1.28]; p = 0.273; S3 Fig).

Discussion

This study found that most WHO DS were significantly associated with mortality, but only one DS (i.e., not feeding well) as significantly associated with bacterial sepsis with a positive blood or CSF culture for a neonatal pathogen. Additionally, none of the other DS were significantly associated with bacterial sepsis in this LMIC neonatal cohort. The latter results held true whether only bacterial pathogens, or pathogens plus potential bacterial contaminants were considered. Notably, a significant minority (39%) of parent of infants with bacterial sepsis initially declared that their child was feeding well at presentation. Therefore, absence of this DS could practically miss a large proportion of infants with bacterial sepsis in real life. Few studies have attempted to determine how DS can predict bacterial sepsis caused by bacterial pathogens in young infants. A retrospective Brazilian study reviewed data on 83 sick neonates over a 12-month period, and came to the same conclusion that DS alone or in combination did not predict severe serious bacterial infection [15]. The current study findings also support findings from another study carried out in primary care, rural setting in Bangladesh, India and Pakistan [16], clinical signs could not differentiate infants with viral or bacterial illnesses. To the best of our knowledge, however, the current study is the first to pragmatically examine whether DS predict bacterial sepsis in infants. These findings were obtained in an LMIC setting where DS were prospectively identified by front line healthcare workers as they would normally do in real-life, outside a research protocol–we assumed that this study design would more closely reflects the practical utility of DS. The current study findings have implications for a hospital setting. Essentially, it suggests that DS cannot reliably identify infants with bacterial sepsis who require antibiotic treatment. However, further research is needed to determine the generalizability of the results to other hospital contexts.

The strength of this study are its robust standardized blood culture outcome measures where contamination during blood sampling were minimized by using protocolized aseptic procedures, and the robust microbiological identification methods, including access to a certified clinical laboratory lab and protocols on-site augmented by advanced MALDI-TOF species determination in another, North American clinical microbiology laboratory. The strong association between bacterial sepsis and mortality provides reassurance infants with positive cultures were correctly identified.

In addition to the main findings, the current study also found that only a minor proportion of infants with suspected sepsis showed positive blood culture. A limited number of studies have prospectively estimated the incidence of bacterial sepsis in LMIC cohorts, and can be discussed here in the context of the current study findings. A hospital-centred study in Delhi, India, included 13,530 neonates (all comers; mean GA±SD: 36.0±3.4 weeks) monitored daily for clinical signs of sepsis with per-protocol completion of a sepsis work-up (blood culture and lumbar puncture) prior to initiating antibiotics, and found a 14.3% incidence of culture-positive sepsis [17], which is in keeping with the current study findings. Another study in community settings in Madagascar, Senegal and Cambodia reported 8.2% culture-confirmed sepsis among 514 neonates assessed for “possible serious bacterial infection” out of 3,688 infants followed during the neonatal period [18]. One large study followed 12,622 live births up to 60 days of age in rural India between April 2002 and March 2005, with daily home visits and clinical assessment, and standardized blood and CSF cultures following enrollment of infants with suspected sepsis. It reported a 6.3% incidence of culture-confirmed sepsis (53 with positive blood cultures out of 842 infants assessed, excluding potential contaminants), for a population-level incidence of culture-confirmed sepsis of 6.7 per 1,000 births [19]. Taken together, these findings support incidence rates found in the current study, and provide robust data on the incidence of bacterial sepsis in LMIC settings, and form the basis for future studies to measure the impact of potential interventions.

Blood cultures are the gold standard for diagnosing bacterial sepsis in young infants [20]. However, these tests lack sensitivity in neonates [21]. In the current study we were careful to prescribe a minimum blood volume to maximize culture yield. Yet, a key question is whether we misestimate the proportion of bacterial sepsis in infants in whom cultures are negative? The Aetiology of Neonatal Infection in South Asia (ANISA) study [22] also attempted to identify the cause of sepsis for 6022 cases of possible serious bacterial infections in infants in the first 60 days after birth, in a population of 63,114 livebirth). Bacterial and viral (e.g., respiratory syncytial virus) causes were identified in 16% and 12% of cases, respectively. For the remaining 72% cases, no pathogen could be identified despite systematic blood and respiratory cultures, which is consistent with findings from the current study.

Evidently the use of antibiotics in the current study was high, with the vast majority of infants receiving antibiotics for a minimum of five days during hospitalization, as per hospital practices. As in other LMIC settings, blood cultures were not routinely available at the study site prior to the study. As such, no approach had been developed to stop antibiotics after 48 hours given a negative blood culture. In another study in Thailand, the duration of antibiotic use was also high with durations of 15 and 8 days for culture-positive and culture-negative early-onset neonatal sepsis, respectively [23]. These results highlight the limits of having to rely on DS, and potential coercive effect of the lack of laboratory resources capable of providing basic laboratory test results to help “rule out” sepsis [24].

A number of study limitations should be acknowledged. Although a sizeable proportion of the recruited infants presented from home, data were collected in a single hospital-type setting; as such, caution should be exercised when generalizing to other hospital settings or extrapolating to non-hospital primary care settings. For logistical reasons CSF was collected from only approximately half of the infants, which may have underestimated the incidence of bacterial sepsis. Similarly, urine or anaerobic blood cultures were not collected, which may have resulted in missed bacteremia. Some infants received antibiotics prior to blood culture, which may have lowered bacterial sepsis estimates. Moreover, due to the limited diagnostic capabilities of the study LMIC settings, in most cases, causes of deaths or alternate diagnoses could not be determined. Similarly, the study did not include non-bacterial testing, which precluded identification of viral sepsis syndromes.

In conclusion, this study validates the use of WHO DS to predict fatal outcomes, but not to reliably identify infants with bacterial sepsis. In other words, relying solely on DS to identify infants with bacterial sepsis is likely to lead to overtreatment while at the same time missing infants who require antibiotic treatment. This study further emphasizes the need for better diagnostics for bacterial sepsis, to ensure that health gains continue to improve, in areas of the world where sepsis represents a huge burden and where antimicrobial resistance is also increasing at alarming rates [25].

Supporting information

S1 Table. Bacterial isolates categorized as pathogens or potential contaminants in secondary analysis using the modified bacterial sepsis outcome.

*Bacteria were also cultured from cerebrospinal fluid (CSF).

(DOCX)

S2 Table. Baseline infant characteristics associated with increased mortality.

£adjusted OR for age of mother, gestational age, birth and admission weights, age of the infant and sex; *Significant ORs (p<0.05).

(DOCX)

S3 Table. Associations between DS and bacterial sepsis when all organisms are included (i.e., including both pathogens and potential contaminants).

(DOCX)

S1 Fig. Relationship between DS and mortality (with corresponding data).

Plots of model fits—Death as outcome.

(DOCX)

S2 Fig. Relationship between DS and pathogen bacterial sepsis (with corresponding data).

Plots of model fits—pathogen sepsis as outcome.

(DOCX)

S3 Fig. Relationship between DS and bacterial sepsis including contaminants (with corresponding data).

Plots of model fits–All sepsis as outcome.

(DOCX)

S1 Questionnaire. PLOS inclusivity in global research questionnaire.

(DOCX)

S1 Dataset. Raw, line-level dataset (Excel spreadsheet) for the study and cohort.

(XLSX)

S1 File. STROBE checklist.

(DOCX)

Acknowledgments

We thank Bentry Tembo, Rhoda Chifisi and Blessings Chiluzi for help with recruitment and data collection, Charles Mwansambo, Patience Johane and the staff at the PACHI for administrative and operational support during the study, Robert Krysiak, Gerald Tegha and the staff of the University of North Carolina–Malawi lab for performing all bacterial cultures and identification, on-site, in Lilongwe, according to clinical laboratory standards, Dr. David Goldfarb for expert input into data interpretation, Amber Johnson from the British Columbia Children’s Hospital Microbiology Laboratory for secondary confirming bacterial isolates by mass spectrometry.

Data Availability

All data can be found in the manuscript and supporting information files.

Funding Statement

This study was support by a grant from Grand Challenges Canada (R-ST-POC-1707-04630). PML was supported by the BC Children’s Hospital Research Foundation through the Investigator Grant Award Program. CRP was funded by a Sue Carruthers Graduate Studentship from the BC Children’s Hospital Foundation. TM also received a Grand Challenges Exploration grant from the Bill and Melinda Gates Foundation (OPP1211936). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.GBD 2016 Causes of Death Collaborators. Global, regional, and national age-sex specific mortality for 264 causes of death, 1980–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet. 2017;390(10100):1151–210. doi: 10.1016/S0140-6736(17)32152-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Rudd KE, Johnson SC, Agesa KM, Shackelford KA, Tsoi D, Kievlan DR, et al. Global, regional, and national sepsis incidence and mortality, 1990–2017: analysis for the Global Burden of Disease Study. Lancet. 2020;395(10219):200–11. doi: 10.1016/S0140-6736(19)32989-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Fleischmann-Struzek C, Goldfarb DM, Schlattmann P, Schlapbach LJ, Reinhart K, Kissoon N. The global burden of paediatric and neonatal sepsis: a systematic review. Lancet Respir Med. 2018;6(3):223–30. doi: 10.1016/S2213-2600(18)30063-8 [DOI] [PubMed] [Google Scholar]
  • 4.Costelloe C, Metcalfe C, Lovering A, Mant D, Hay AD. Effect of antibiotic prescribing in primary care on antimicrobial resistance in individual patients: systematic review and meta-analysis. BMJ. 2010;340:c2096. doi: 10.1136/bmj.c2096 [DOI] [PubMed] [Google Scholar]
  • 5.Klingenberg C, Kornelisse RF, Buonocore G, Maier RF, Stocker M. Culture-Negative Early-Onset Neonatal Sepsis—At the Crossroad Between Efficient Sepsis Care and Antimicrobial Stewardship. Front Pediatr. 2018;6:285. doi: 10.3389/fped.2018.00285 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Costello A. Integrated management of childhood illness. Lancet. 1997;350(9087):1266. doi: 10.1016/S0140-6736(05)62471-3 [DOI] [PubMed] [Google Scholar]
  • 7.Young Infants Clinical Signs Study Group. Clinical signs that predict severe illness in children under age 2 months: a multicentre study. The Lancet. 2008;371(9607):135–42. doi: 10.1016/S0140-6736(08)60106-3 [DOI] [PubMed] [Google Scholar]
  • 8.Opiyo N, English M. What clinical signs best identify severe illness in young infants aged 0–59 days in developing countries? A systematic review. Archives of disease in childhood. 2011;96(11):1052–9. doi: 10.1136/adc.2010.186049 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.World Health Organization. Pocket Book of Hospital Care for Children: Guidelines for the Management of Common Childhood Illnesses. WHO Guidelines Approved by the Guidelines Review Committee. 2nd ed. Geneva, 2013. [PubMed]
  • 10.Wynn JL, Polin RA. Progress in the management of neonatal sepsis: the importance of a consensus definition. Pediatr Res. 2018;83(1–1):13–5. doi: 10.1038/pr.2017.224 [DOI] [PubMed] [Google Scholar]
  • 11.Clinical prediction of serious bacterial infections in young infants in developing countries. The WHO Young Infants Study Group. Pediatr Infect Dis J. 1999;18(10 Suppl):S23–31. [DOI] [PubMed] [Google Scholar]
  • 12.Popescu CR, Tembo B, Chifisi R, Cavanagh MMM, Lee AH, Chiluzi B, et al. Whole blood genome-wide transcriptome profiling and metagenomics next-generation sequencing in young infants with suspected sepsis in a low-and middle-income country: A study protocol. Gates Open Res. 2020;4:139. doi: 10.12688/gatesopenres.13172.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Popescu C, Tembo B, Chifisi R, Cavanagh M, Chiluzi B, Lufesi N, et al. Procedure policies, data collection form and model consent form (supplemental material)~Improving the Early Diagnosis of Neonatal Sepsis in Malawi. In: Scholars Portal Dataverse, editor. 2 ed 2020. [Google Scholar]
  • 14.Downie L, Armiento R, Subhi R, Kelly J, Clifford V, Duke T. Community-acquired neonatal and infant sepsis in developing countries: efficacy of WHO’s currently recommended antibiotics—systematic review and meta-analysis. Archives of disease in childhood. 2013;98(2):146–54. doi: 10.1136/archdischild-2012-302033 [DOI] [PubMed] [Google Scholar]
  • 15.Ronfani L, Vilarim JN, Dragovich D, Bacalhau AF, Cattaneo A. Signs of severe bacterial infection in neonates. J Trop Pediatr. 1999;45(1):48–51. doi: 10.1093/tropej/45.1.48 [DOI] [PubMed] [Google Scholar]
  • 16.Arvay ML, Shang N, Qazi SA, Darmstadt GL, Islam MS, Roth DE, et al. Infectious aetiologies of neonatal illness in south Asia classified using WHO definitions: a primary analysis of the ANISA study. The Lancet Global health. 2022;10(9):e1289–e97. doi: 10.1016/S2214-109X(22)00244-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Study IotDNI. Characterisation and antimicrobial resistance of sepsis pathogens in neonates born in tertiary care centres in Delhi, India: a cohort study. Lancet Glob Health. 2016;4(10):e752–60. doi: 10.1016/S2214-109X(16)30148-6 [DOI] [PubMed] [Google Scholar]
  • 18.Huynh BT, Kermorvant-Duchemin E, Chheang R, Randrianirina F, Seck A, Ratsima EH, et al. Severe bacterial neonatal infections in Madagascar, Senegal, and Cambodia: A multicentric community-based cohort study. Plos Medicine. 2021;18(9). doi: 10.1371/journal.pmed.1003681 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Panigrahi P, Chandel DS, Hansen NI, Sharma N, Kandefer S, Parida S, et al. Neonatal sepsis in rural India: timing, microbiology and antibiotic resistance in a population-based prospective study in the community setting. J Perinatol. 2017;37(8):911–21. doi: 10.1038/jp.2017.67 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Polin RA. Management of neonates with suspected or proven early-onset bacterial sepsis. Pediatrics. 2012;129(5):1006–15. doi: 10.1542/peds.2012-0541 [DOI] [PubMed] [Google Scholar]
  • 21.Popescu CR, Cavanagh MMM, Tembo B, Chiume M, Lufesi N, Goldfarb DM, et al. Neonatal sepsis in low-income countries: epidemiology, diagnosis and prevention. Expert Rev Anti Infect Ther. 2020;18(5):443–52. doi: 10.1080/14787210.2020.1732818 [DOI] [PubMed] [Google Scholar]
  • 22.Saha SK, Schrag SJ, El Arifeen S, Mullany LC, Shahidul Islam M, Shang N, et al. Causes and incidence of community-acquired serious infections among young children in south Asia (ANISA): an observational cohort study. Lancet. 2018;392(10142):145–59. doi: 10.1016/S0140-6736(18)31127-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Kiatchoosakun P, Jirapradittha J, Sirikarn P, Laopaiboon M, Pattanittum P, Chandrakachorn W, et al. Early-Onset Neonatal Sepsis and Antibiotic Use in Northeast Thailand. Am J Perinatol. 2019;36(12):1295–303. doi: 10.1055/s-0038-1676829 [DOI] [PubMed] [Google Scholar]
  • 24.Lavoie PM, Popescu CR, Molyneux EM, Wynn JL, Chiume M, Keitel K, et al. Rethinking management of neonates at risk of sepsis. Lancet. 2019;394(10195):279–81. doi: 10.1016/S0140-6736(19)31627-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Iregbu K, Dramowski A, Milton R, Nsutebu E, Howie SRC, Chakraborty M, et al. Global health systems’ data science approach for precision diagnosis of sepsis in early life. Lancet Infect Dis. 2022;22(5):e143–e52. doi: 10.1016/S1473-3099(21)00645-9 [DOI] [PubMed] [Google Scholar]
PLOS Glob Public Health. doi: 10.1371/journal.pgph.0001990.r001

Decision Letter 0

Joseph Donlan

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

29 Jun 2023

PGPH-D-23-00809

World Health Organization Danger Signs to predict bacterial sepsis in newborns: A pragmatic prospective cohort study

PLOS Global Public Health

Dear Dr. Lavoie,

Thank you for submitting your manuscript to PLOS Global Public Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Global Public Health’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please note that we have only been able to secure a single reviewer to assess your manuscript. We are issuing a decision on your manuscript at this point to prevent further delays in the evaluation of your manuscript. Please be aware that the editor who handles your revised manuscript might find it necessary to invite additional reviewers to assess this work once the revised manuscript is submitted. However, we will aim to proceed on the basis of this single review if possible.

Your manuscript has been assessed by an expert reviewer, whose full comments are appended below. The reviewer has requested clarification on several aspects of the methodology and interpretation of the findings. Please ensure you respond to each point carefully in your response to reviewers document, and modify your manuscript accordingly.

Please submit your revised manuscript by Aug 13 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at globalpubhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pgph/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Dr Joseph Donlan

Editorial Office

PLOS Global Public Health

Journal Requirements:

1. Please include a complete copy of PLOS’ questionnaire on inclusivity in global research in your revised manuscript. Our policy for research in this area aims to improve transparency in the reporting of research performed outside of researchers’ own country or community. The policy applies to researchers who have travelled to a different country to conduct research, research with Indigenous populations or their lands, and research on cultural artefacts. The questionnaire can also be requested at the journal’s discretion for any other submissions, even if these conditions are not met.  Please find more information on the policy and a link to download a blank copy of the questionnaire here: https://journals.plos.org/globalpublichealth/s/best-practices-in-research-reporting. Please upload a completed version of your questionnaire as Supporting Information when you resubmit your manuscript.

2. We noticed that you used "not shown" in the manuscript. We do not allow these references, as the PLOS data access policy requires that all data be either published with the manuscript or made available in a publicly accessible database. Please amend the supplementary material to include the referenced data or remove the references.

3. We have noticed that you have a list of Supporting Information legends in your manuscript. However, there are no corresponding files uploaded to the submission. Please upload them as separate files with the item type 'Supporting Information'. 

Additional Editor Comments (if provided):

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does this manuscript meet PLOS Global Public Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #1: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Global Public Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript is written in such a way that it is easy to understand. The study topic is interesting, sufficient justification is provided in the background. This study revealed that most WHO danger signs are not a predictor of neonatal bacterial sepsis, even if in some circumstances, antibacterial treatment is initiated based on the presence of these signs. This study also indicates that a substantial portion of sepsis-suspected newborns have negative blood cultures or that causative agents are missed because of the inherent problems of the diagnostic method. The concern is WHO danger signs and clinical presentation of bacterial sepsis may overlap. Dealing with ‘danger signs’ and ‘neonatal sepsis’ without discussing/mentioning the clinical picture of neonatal sepsis makes things unclear for the reader. As described in the manuscript, the entry point for the study participant was ‘suspected of sepsis’ and not ‘showing danger signs’. It is good if an attempt was made to describe this issue in the manuscript. What does this study recommend? Is bacterial sepsis missed because of the low sensitivity of the diagnostic method used? Or are there other causes? In case of blood culture-negative results where there are danger signs, is it appropriate not to give antibiotics? It is clear that the use of antibiotics in the absence of bacterial etiology has its own disadvantages; however, the risk and benefits should be sought. All these issues need to be reflected in the discussion. A clear implication of the study has to be stated.

General comment

• In the main method give the operation definition ‘suspected sepsis’ in newborns.

• Which types of bacteria were isolated from CSF?

• Some terms are inconsistent within the manuscript “young infants”, “Newborns”, “Neonates”, “infants” It is good to define the study population and use it consistently throughout the manuscript.

• The study design, sample size (500 vs 401 vs) is not clearly mentioned.

• Consider replacing ‘h’ with ‘hours’ if it means so

• Line # 144 “enrollment” Line # “approximatively” check the spelling

• Mention the nine WHO danger signs in the clinical data and samples collection section.

• Was the attempt made to isolate anaerobic bacteria? If not. include in the limitation

• As the etiology of neonatal sepsis varies with age; I suggest considering presenting the result section by taking into account the age classification of newborns (< 7 days of age and 7-90 days of age)

• What were the criteria to collect CSF?

• How bacteria were identified after blood culture is not clear, for how long the blood culture was incubated before it was declared negative.

• There is no description of how CSF was cultured

Specific comments

• In the abstract section, I suggest separating methods and findings/results

• In the abstract it is written as “This prospective study evaluated nine DS in infants younger than 3 months…” Do newborns with the age of 3 months were included?

• Line #93: “Over time, the use of DS has been extended to provide a reasonable basis for the initiation of empiric antibiotic treatment (9). However, these signs have neither been developed nor validated to diagnose sepsis of bacterial etiology.” Is it correct to use reference #9 for the information given? Reference #9 looks like a guideline developed by WHO, is the WHO recommending the use of empiric antibiotic treatment without evidence?

• In material and method section line #109 “study that aimed to identify molecular signatures of bacterial sepsis in young infants…” was molecular techniques used to diagnose sepsis?

• Line #113-114: “…. infants were excluded if they had received antibiotics for >4 hours at the time of enrollment.” What if they have received antibiotics treatment in the last two weeks?

• Line # 114-117: Out of 851, how many refused to participate, the condition was not permissive, and how many were included in the study?

• Line #119: “The Kamuzu Central Hospital the largest referral hospital in central Malawi, where approximatively 3,000 infants are admitted to its neonatal unit annually” needs reference

• Line # 128-129: “During the 129 study, the authors did not have access to information that could identify participants…” if this is the case how lab results were communicated to the attending physician? Line # 150 “Culture results were made available to clinicians within 5 days.” And also the recommended incubation period of blood culture is about a week, how culture result is available for the physician within 5 days?

• Line # 193-195: “In total, 94/401 (23.4%) infants had received antibiotics prior to the blood culture, for a median of 2 hours (range 0.75 to 3.5 195 hours)” This could have affected the findings

• Some data were collected from the baby’s mother for example gestational age, and mode of delivery. Was consent sought from mothers?

• Table 1 needs to be improved. Why values in the column ‘N with data’ are variable given the total sample size is 401? Fifth row what does ‘inborn’ mean?

• Table 1: Why capturing “Illness status, number on infants” is needed provided that the study population are newborns suspected of sepsis (ill) visiting the hospital

• Line # 202: The contamination rate is somewhat high “However, about half (46 / 85) had bacterial types considered to be contaminants” If the blood specimen were collected aseptically they may be true pathogens.

• Line 203-204: “…and non-pathogenic streptococcus species such as oralis)…” you may rewrite as ‘….and non-pathogenic Streptococcus species such as S. oralis)…’ Consider scientific name during writing the name of bacteria.

• Table 2: it is good if a column is added to show frequency and proportion in the ‘yes’ and ‘No’ categories for all variables. Doing so will make the reader see the prevalence in each cell.

Danger signs Mortality, n(%) OR 95%CI p-value

Yes No

Not feeding well N(%) N(%)

Convulsion N(%) N(%)

• Table 3: it is good if a column is added to show frequency and proportion in yes and No category for all variables.

Danger signs Blood culture result, n(%) OR 95%CI p-value

Yes No

Not feeding well N(%) N(%)

Convulsion N(%) N(%)

• Tables 2 and 3: I don’t see the importance of using (), it can be omitted.

• Discussion lines # 277-278: “Taken together, these findings suggest that bacterial sepsis may be uncommon in this age group even in LMICs when sepsis is clinically suspected.” This is an area of controversy in LMICs and sub-Saharan African countries. Proxy studies and systematic reviews and meta-analyses reported a high burden of neonatal sepsis in these regions. Strong recommendations should be forwarded to concerned bodies so that similar studies (like the present study) using robust diagnostic methods to be conducted in the region. This will assist in device appropriate prevention strategies for the regions which may include vaccines and measure the impact of the prevention strategy. Without knowing the real burden of neonatal sepsis along with its etiology we may not objectively measure the impact of the prevention strategy to be used.

• Discussion: line# 302-304: “The strong association between bacterial sepsis and mortality suggest that the infants with positive cultures were correctly identified” Is there a finding which supports this claim?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Musa Mohammed Ali

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLOS Glob Public Health. doi: 10.1371/journal.pgph.0001990.r003

Decision Letter 1

Musa Mohammed Ali

26 Sep 2023

PGPH-D-23-00809R1

World Health Organization Danger Signs to predict bacterial sepsis in young infants: A pragmatic cohort study

PLOS Global Public Health

Dear Dr. Lavoie,

Thank you for submitting your manuscript to PLOS Global Public Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Global Public Health’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We invite you to address all the comments given by reviewer including the selection criteria to select study participants, sample size was determination and contamination rate, .

Please submit your revised manuscript by Oct 26 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at globalpubhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pgph/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Musa Mohammed Ali, PhD

Guest Editor

PLOS Global Public Health

Journal Requirements:

1. “Please include a complete copy of PLOS’ questionnaire on inclusivity in global research in your revised manuscript. Our policy for research in this area aims to improve transparency in the reporting of research performed outside of researchers’ own country or community. The policy applies to researchers who have travelled to a different country to conduct research, research with Indigenous populations or their lands, and research on cultural artefacts. The questionnaire can also be requested at the journal’s discretion for any other submissions, even if these conditions are not met.  Please find more information on the policy and a link to download a blank copy of the questionnaire here: https://journals.plos.org/globalpublichealth/s/best-practices-in-research-reporting. Please upload a completed version of your questionnaire as Supporting Information when you resubmit your manuscript.

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Does this manuscript meet PLOS Global Public Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Global Public Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: The overall study concepts are very important especially from the study setting point of view.

I had the following comments and point of clarification for author.

#1. How were the study participants selected? What was the criteria included in the study? How was sepsis suspected was defined for this study?

#2. Why high figure of non-response rate (401/851 approached)? Was it the problem of awareness or high price of blood culture? How do you explain this for researchers.

#3. Clarify how you had determined the sample size in your plan (500) and achievement (400).

#4. In page 6 line 155 you mentioned about urine culture in your work but can’t found any in the finding or method related with this. Clarify!

#5. You did CSF culture for the selected infants in the study. How did you select for those who CSF culture done and not done?

#6. Most of children was on antibiotics for the median?? Of 6 days. How this matched with your mention exclusion criteria, more than 4hrs? May the BACTEC have an advantage of reducing the effect of antibiotics on bacterial growth?

#7. How were contaminants defined in the study? Have you done with more than one bottle blood culture? Is there a possibility for those bacteria like CoNS, to be a potential pathogen?

#8. What is the total contaminant rate in the study based on your definition used? How this rate comparable with the tolerable WHO blood culture rate? Figure on the supplementary table is high!

#9. Once you have an identified bacterium, why can’t look for antibiotic resistance?

#10. What is the overall about the conclusion of your study? Does it conclude with DS more related with sepsis caused by other than bacterial infections or what? elaborate?

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PGPH-D-23-00809_R1_AN.pdf

PLOS Glob Public Health. doi: 10.1371/journal.pgph.0001990.r005

Decision Letter 2

Musa Mohammed Ali

18 Oct 2023

World Health Organization Danger Signs to predict bacterial sepsis in young infants: A pragmatic cohort study

PGPH-D-23-00809R2

Dear Dr Lavoie,

We are pleased to inform you that your manuscript 'World Health Organization Danger Signs to predict bacterial sepsis in young infants: A pragmatic cohort study' has been provisionally accepted for publication in PLOS Global Public Health.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they'll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact globalpubhealth@plos.org.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Global Public Health.

Best regards,

Musa Mohammed Ali, PhD

Guest Editor

PLOS Global Public Health

***********************************************************

Reviewer Comments (if any, and for reference):

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Does this manuscript meet PLOS Global Public Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Global Public Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: All comments are addressed.

Reviewer #2: Authors address comments raised during the review process!

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Adugna Negussie Gudeta

**********

Attachment

Submitted filename: PGPH-D-23-00809_R2_reviewer_R2.pdf

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Bacterial isolates categorized as pathogens or potential contaminants in secondary analysis using the modified bacterial sepsis outcome.

    *Bacteria were also cultured from cerebrospinal fluid (CSF).

    (DOCX)

    S2 Table. Baseline infant characteristics associated with increased mortality.

    £adjusted OR for age of mother, gestational age, birth and admission weights, age of the infant and sex; *Significant ORs (p<0.05).

    (DOCX)

    S3 Table. Associations between DS and bacterial sepsis when all organisms are included (i.e., including both pathogens and potential contaminants).

    (DOCX)

    S1 Fig. Relationship between DS and mortality (with corresponding data).

    Plots of model fits—Death as outcome.

    (DOCX)

    S2 Fig. Relationship between DS and pathogen bacterial sepsis (with corresponding data).

    Plots of model fits—pathogen sepsis as outcome.

    (DOCX)

    S3 Fig. Relationship between DS and bacterial sepsis including contaminants (with corresponding data).

    Plots of model fits–All sepsis as outcome.

    (DOCX)

    S1 Questionnaire. PLOS inclusivity in global research questionnaire.

    (DOCX)

    S1 Dataset. Raw, line-level dataset (Excel spreadsheet) for the study and cohort.

    (XLSX)

    S1 File. STROBE checklist.

    (DOCX)

    Attachment

    Submitted filename: Plos Response to Reviewers comments.docx

    Attachment

    Submitted filename: PGPH-D-23-00809_R1_AN.pdf

    Attachment

    Submitted filename: Response to reviewers.docx

    Attachment

    Submitted filename: PGPH-D-23-00809_R2_reviewer_R2.pdf

    Data Availability Statement

    All data can be found in the manuscript and supporting information files.


    Articles from PLOS Global Public Health are provided here courtesy of PLOS

    RESOURCES