In this multicenter case-control study, we derive and internally validate a highly sensitive score that identifies non–ill-appearing febrile infants at low probability of bacteremia and/or bacterial meningitis.
Abstract
Video Abstract
OBJECTIVES:
To derive and internally validate a prediction model for the identification of febrile infants ≤60 days old at low probability of invasive bacterial infection (IBI).
METHODS:
We conducted a case-control study of febrile infants ≤60 days old who presented to the emergency departments of 11 hospitals between July 1, 2011 and June 30, 2016. Infants with IBI, defined by growth of a pathogen in blood (bacteremia) and/or cerebrospinal fluid (bacterial meningitis), were matched by hospital and date of visit to 2 control patients without IBI. Ill-appearing infants and those with complex chronic conditions were excluded. Predictors of IBI were identified with multiple logistic regression and internally validated with 10-fold cross-validation, and an IBI score was calculated.
RESULTS:
We included 181 infants with IBI (155 [85.6%] with bacteremia without meningitis and 26 [14.4%] with bacterial meningitis) and 362 control patients. Twenty-three infants with IBI (12.7%) and 138 control patients (38.1%) had fever by history only. Four predictors of IBI were identified (area under the curve 0.83 [95% confidence interval (CI): 0.79–0.86]) and incorporated into an IBI score: age <21 days (1 point), highest temperature recorded in the emergency department 38.0–38.4°C (2 points) or ≥38.5°C (4 points), absolute neutrophil count ≥5185 cells per μL (2 points), and abnormal urinalysis results (3 points). The sensitivity and specificity of a score ≥2 were 98.8% (95% CI: 95.7%–99.9%) and 31.3% (95% CI: 26.3%–36.6%), respectively. All 26 infants with meningitis had scores ≥2.
CONCLUSIONS:
Infants ≤60 days old with fever by history only, a normal urinalysis result, and an absolute neutrophil count <5185 cells per μL have a low probability of IBI.
What’s Known on This Subject:
Commonly used risk-stratification criteria for febrile infants were either developed >2 decades ago in studies that included relatively few infants with bacteremia and/or bacterial meningitis or include procalcitonin, which is not readily available in some hospitals.
What This Study Adds:
A newly derived score is highly sensitive for the identification of non–ill-appearing febrile infants ≤60 days old with invasive bacterial infection. Infants with fever by history only, normal urinalysis results, and an absolute neutrophil count <5185 cells per μL had a low probability of infection.
Febrile infants ≤60 days of age are at high risk for serious bacterial infections.1 Because neither clinical appearance nor individual laboratory tests are reliable indicators of which infants have serious bacterial infections,2,3 several criteria (eg, Boston, Philadelphia, Rochester) are used to stratify infants as being at low or not low risk for infection.4–6 However, these criteria were developed >25 years ago, and the epidemiology of serious bacterial infections has changed considerably since that time.7,8 Additionally, the specific low-risk predictors (eg, normal white blood cell [WBC] cutpoint) were determined by expert opinion rather than statistical derivation.1 In studies that evaluated the performance of these criteria, with the exception of a recent investigation conducted by our research collaborative,9 most infants with serious bacterial infections had urinary tract infections (UTIs) rather than invasive bacterial infections (IBIs) (ie, bacteremia and/or bacterial meningitis).1,5,6,10,11 Because most infants with UTIs will be identified by using urinalysis,12 and because IBIs are more likely to result in adverse outcomes,13 an updated clinical prediction model derived in a contemporary sample that includes a large number of infants with IBI would impact the clinical care of febrile infants.
The Step-by-Step approach, a risk-stratification algorithm that includes age, clinical appearance, urinalysis, procalcitonin, C-reactive protein (CRP), and absolute neutrophil count (ANC), was recently validated in a cohort of febrile infants ≤90 days of age that included 87 infants with IBI.14 Although the Step-by-Step approach had a sensitivity of 92% for identification of infants with IBI,14 procalcitonin results are not readily available in some hospitals and primary care offices in the United States. Additionally, a prediction model that, similar to the Step-by-Step approach, identifies which febrile infants are at low risk for IBI without cerebrospinal fluid (CSF) testing may reduce unnecessary lumbar punctures in low-risk infants, many of whom currently undergo this procedure.15 Our objective was to derive and internally validate a clinical prediction model for IBI in a sample that included a large number of non–ill-appearing febrile infants ≤60 days of age with IBI.
Methods
Study Design
We conducted a case-control study of non–ill-appearing infants ≤60 days of age with a documented rectal temperature ≥38.0°C evaluated in the emergency departments (EDs) of 11 children’s hospitals between July 1, 2011 and June 30, 2016. Infants with IBI (case patients) were matched by hospital and date of visit to 2 febrile infants without IBI (control patients). The study protocol was approved by each hospital’s institutional review board.
Case Patients
Infants ≤60 days of age with IBI were identified through query of each hospital’s microbiology laboratory database or electronic medical record system for blood (bacteremia) and/or CSF (bacterial meningitis) cultures with growth of a pathogen, as described previously.8,9 Infants were excluded if the culture was documented to have been treated as a contaminant by the medical team.8,16
Infants with IBI were eligible for inclusion if they presented to a participating hospital’s ED either from home or from an outpatient clinic (ie, were not transferred from another ED) and if the infant was (1) febrile, defined as a rectal temperature ≥38.0°C (100.4°F) at home, in an outpatient clinic, or in the ED1,5,11; (2) not ill appearing, as documented on the ED physical examination17; and (3) without a complex chronic condition.18,19 Ill-appearing infants and those with complex chronic conditions were excluded because the prevalence of IBI may be higher in these infants,2 and these infants would not be classified as low risk.
Control Patients
Potentially eligible control patients were identified through query of the Pediatric Health Information System for infants ≤60 days of age with an ED visit during the 5-year study period and who had both urine and blood cultures obtained.9,15 For 1 participating site that did not contribute data to the Pediatric Health Information System, potential control patients were identified through query of the hospital’s electronic medical record by using the same search criteria.
Each case patient was matched to 2 control infants at the same hospital with the closest date of visit to the case patient. If >2 infants were eligible as control patients on the basis of date of visit, a random number generator was used to select which control patients to include. Medical records were then reviewed for each potential control patient to assess for eligibility. Control patients were eligible if they met the same inclusion criteria as case patients with the exception that (1) their blood and, if obtained, CSF culture had no growth of a pathogen and (2) they had not received antibiotics within 7 days before the ED visit. Control patients were not excluded on the basis of peripartum maternal antibiotic exposure. Febrile infants with UTIs8,12 without concomitant IBI were eligible for inclusion as control patients. Encounters subsequent to the index ED visit were reviewed to ensure that the control patient was not ultimately diagnosed with an IBI. If a potentially eligible control patient was deemed ineligible after medical record review, the infant with the next-closest date of visit was selected, and the process was repeated until 2 eligible control patients were identified for each case patient.
Data Collection
For each case patient and control patient, we extracted data from the medical record on variables that we hypothesized to be associated with the presence of IBI.4–6,14,20 These variables included the following: demographics (age and sex); past medical history (gestational age); historical features (household sick contacts, symptoms of upper respiratory infection [URI], and duration of fever); measured temperature (at home or in an outpatient clinic, in triage, and highest recorded in the ED); physical examination findings (triage heart rate and respiratory rate and signs of URI and/or bronchiolitis); laboratory data (WBC count, ANC, CRP, procalcitonin, and urinalysis results12); and bacterial culture results (urine, blood, and CSF). CSF parameters were not assessed as predictors. Data were entered into a secure Research Electronic Data Capture tool21 that was pilot tested at each site and on which investigators were trained before data collection.
Statistical Analyses
A risk-prediction model for IBI was constructed by using a weighted multiple logistic regression approach with weights determined by the 2% prevalence of IBI in the population.7,22 Each predictor of interest was first considered in the model by itself. For continuous predictors, we used a graphical aid to assess whether the relationship was linear with the logit (loge[Pr(IBI = 1)/(1−Pr(IBI = 1))]) and followed up with the Box-Tidwell test.23 An α level of 0.10 was used to select candidate predictors for the model. Before building an adjusted model, we used Spearman rank correlation (|ρ| ≥0.90) to assess for potential multicollinearity among continuous predictors and compared the distributions of continuous predictors by categorical predictors using the Wilcoxon rank test. All possible 2-way interactions were considered in the final multiple logistic regression model. Adjusted odds ratios (aORs) with 95% confidence intervals (CIs) were used to quantify the magnitude of the association between each predictor and the primary outcome (IBI). Analyses were adjusted for study site by using this variable as a fixed effect in the model. An α level of 0.05 was required for the retention of a variable in the final adjusted model. For continuous predictors, we determined the cutoff values that maximized the area under the receiver operating characteristic curve (AUC) and in turn provided the optimal combination of sensitivity and specificity. The cutoff values were the same regardless of the prevalence of IBI used in the weighted model (eg, 2% vs 3% prevalence).
The performance of our prediction model was assessed by using calibration and discrimination metrics.24 The former is evaluated by using a qualitative aid, a calibration curve, to assess how well the model predicts the absolute risk relative to the observed probability of an outcome.25,26 The latter is a measure of how well the model discriminates between infants with and without IBI; an AUC was used to quantify this measure.27 Given that predictions from a model for a sample of observations used to create the model itself will result in the underestimation of prediction error, we used k-fold cross-validation for internal validation.28,29 We randomly divided the data into 10 folds (sets) to refit the model on any given 9 folds by leaving 1 fold out and obtaining predictions for the held-out fold. This internal validation approach provides a new estimate of the precision interval around the AUC, which is corrected for the estimated prediction error.
By using the predictors identified in the final model, an IBI score was developed with points assigned on the basis of the strength of the association of the predictor and the outcome (ie, presence of IBI) as expressed by the aOR for each predictor. The predictor with the aOR of the smallest magnitude was assigned 1 point, and the other predictors were assigned points on the basis of the relative magnitude of their aORs.30 Infants with missing data for any of the components of the score were excluded from the main analysis, but the IBI score was applied to case patients with missing data in a sensitivity analysis.
Statistical analyses were implemented by using Stata Data Analysis and Statistical Software version 15.0 (Stata Corp, College Station, TX) and SAS 9.4 (SAS Institute, Inc, Cary, NC).
Results
Study Sample
Of the 394 infants with IBI who presented to the 11 participating EDs during the 5-year study period, 181 (45.9%) met inclusion criteria as case patients and were matched to 362 control patients (Fig 1). Among the 181 infants with IBI, 155 (85.6%) had bacteremia without meningitis, and 26 (14.4%) had bacterial meningitis (19 [73.1%] with concomitant bacteremia). The pathogens are listed in Supplemental Table 5. Seventy-seven infants with IBI (42.5%) had a concomitant UTI compared with 21 of 362 control patients (5.8%). Twenty-three case patients (12.7%) and 138 control patients (38.1%) had a history of a rectal temperature ≥38.0°C but did not have a fever recorded in the ED.
FIGURE 1.
Study sample.
Compared with controls, case patients with IBI were younger and had higher triage heart rates, maximum temperatures recorded in the ED, median WBC counts, and median ANCs. A higher proportion of infants with IBI had an abnormal urinalysis result, although a lower proportion had household sick contacts or symptoms or signs of URI (Table 1).
TABLE 1.
Demographic and Clinical Characteristics of Case Patients With IBI and Matched Control Patients
| Case Patients With IBI, n = 181 | Control Patients, n = 362 | Pa,b | |
|---|---|---|---|
| Demographics | |||
| Age, d, median (IQR) | 28 (16–43) | 35.5 (23–47) | <.001 |
| Female sex, n (%) | 80 (44.2) | 161 (44.5) | .95 |
| History, n of N (%) | |||
| Prematurityc | 13 of 177 (7.3) | 20 of 339 (5.9) | .52 |
| Duration of fever ≤24 hd | 141 of 153 (92.2) | 288 of 309 (93.2) | .68 |
| Household sick contactse | 47 of 146 (32.2) | 141 of 290 (48.6) | .001 |
| Vital signs, median (IQR) | |||
| Triage temperature, °C | 38.4 (38.0–38.9) | 38.0 (37.5–38.4) | <.001 |
| Highest ED temperature, °C | 38.6 (38.2–39.0) | 38.1 (37.6–38.5) | <.001 |
| Triage HR | 177 (160–190) | 164 (152–180) | <.001 |
| Triage RR | 44 (38–56) | 44 (36–52) | .14 |
| Physical examination, n of N (%) | |||
| URI symptoms or signsf,g | 41 of 172 (23.8) | 167 of 342 (48.8) | <.001 |
| Bronchiolitish | 5 of 181 (2.8) | 21 of 362 (5.8) | .12 |
| Laboratory | |||
| Abnormal urinalysis, n of N (%)i,j | 90 of 171 (52.6) | 42 of 337 (12.5) | <.001 |
| WBC, cells per μL, median (IQR) | 11 600 (8200–15 300) | 10 000 (7700–13 000) | .001 |
| ANC, cells per μL, median (IQR) | 6322 (4119–9535) | 3524 (2056–5358) | <.001 |
HR, heart rate; RR, respiratory rate.
Unadjusted comparisons between case patients and control patients used the Mann-Whitney U test for continuous variables and the χ2 test for categorical variables.
Characteristics with P ≤ .10 were considered for inclusion in the prediction model.
Four case patients and 23 control patients were missing gestational age.
Twenty-eight case patients and 53 control patients were missing documentation of duration of fever.
Thirty-five case patients and 72 control patients were missing documentation of household sick contacts.
Nine case patients and 20 control patients were missing documentation of URI symptoms or signs.
URI symptoms or signs (eg, congestion, rhinorrhea, and cough) as documented in the history or on ED physical examination.
Signs of bronchiolitis (eg, rales, wheeze, and coarse breath sounds) as documented on ED physical examination.
Eleven case patients and 25 control patients were missing urinalysis.
Urine dipstick with positive leukocyte esterase or positive nitrites or urine microscopy with >5 WBCs per high-power field or >5 WBCs per mm3 on enhanced urinalysis.
Multiple Logistic Regression Analysis
Four predictors were associated with the presence of IBI: age, highest temperature recorded in the ED, abnormal urinalysis result, and ANC (Table 2). To identify the cutoff value for ANC, the ANC level was incrementally varied to evaluate the effect on the discriminatory ability of the model; an ANC value of 5185 cells per μL was determined to be optimal. The model fit the observed data well, as shown by the calibration plot, in which the calibration curve overlapped with the diagonal reference line of perfect calibration (Fig 2). The AUC was 0.83 (95% CI: 0.79–0.86) for the weighted model. On 10-fold cross-validation, the AUC was 0.83 (95% CI: 0.78–0.87).
TABLE 2.
Multiple Logistic Regression Model to Predict IBI in Febrile Infants
| Adjusted Odds of IBIa (95% CI) | |
|---|---|
| Age, d | |
| ≥21 | Reference |
| <21 | 2.07 (1.14–3.76) |
| Highest temperature in the ED, °C | |
| <38.0 | Reference |
| 38.0–38.4 | 2.31 (1.08–4.95) |
| ≥38.5 | 6.57 (3.25–13.29) |
| Urinalysis result | |
| Normal | Reference |
| Abnormalb | 5.71 (3.24–10.06) |
| ANC, cells per μL | |
| <5185 | Reference |
| ≥5185 | 3.15 (1.83–5.43) |
Adjusted for age, highest temperature recorded in the ED, urinalysis, and ANC, with study site as a fixed effect.
Urine dipstick with positive leukocyte esterase or positive nitrites or urine microscopy with >5 WBCs per high-power filed or >5 WBCs per mm3 on enhanced urinalysis.
FIGURE 2.
Calibration plot for the IBI prediction model with the estimated probability of IBI (x-axis) plotted against the outcome (presence of IBI). The calibration curve (solid line), with a 95% confidence band, overlaps with the diagonal reference line of perfect calibration (hashed line), indicating that the prediction model fit the observed data well.
IBI Score
Using the 4 predictors identified in the final model, an IBI score was developed with a range of possible scores of 0 to 10 points (Table 3). Among the 492 infants (90.6% of the sample) for whom data were available for each of the predictors (169 case patients and 323 control patients), the sensitivity and specificity of a score ≥2 were 98.8% (95% CI: 95.8%–99.9%) and 31.3% (95% CI: 26.3%–36.6%), respectively (Table 4). The 2 case patients with fever by history only and a low-risk score of <2 were a 3-day-old and a 40-day-old, both of whom had bacteremia due to Enterococcus spp. Moderate-risk IBI scores of ≥3 and ≥4 had higher specificity (52.0% and 57.3%, respectively) but lower sensitivity (92.9% and 88.2%, respectively). Of 12 infants with IBI who had missing data, 11 (91.7%) had scores ≥2, and one 27-day-old infant with group B streptococcal bacteremia and a missing urinalysis result had a score of 0.
TABLE 3.
IBI Score
| Predictor | Pointsa |
|---|---|
| Age <21 d | 1 |
| Highest temperature in the ED 38.0–38.4°C | 2 |
| Highest temperature in the ED ≥38.5°C | 4 |
| Abnormal urinalysis resultb | 3 |
| ANC ≥5185 cells per μL | 2 |
Total possible scores range from 0 to 10.
Urine dipstick with positive leukocyte esterase or positive nitrites or urine microscopy with >5 WBCs per high-power field or >5 WBCs per mm3 on enhanced urinalysis.
TABLE 4.
Performance Characteristics of the IBI Score for Identification of Febrile Infants With IBI
| Points | Case Patients (N = 169),a n (%) | Control Patients (N = 323),b n (%) | IBI Score | Sensitivity (95% CI) | Specificity (95% CI) | LR+ (95% CI) | LR− (95% CI) |
|---|---|---|---|---|---|---|---|
| Low risk | |||||||
| 0 | 1 (0.6) | 81 (25.1) | ≥1 | 99.4 (96.7–100.0) | 25.1 (20.4–30.2) | 1.33 (1.24–1.41) | 0.02 (0–0.17) |
| 1 | 1 (0.6) | 20 (6.2) | ≥2 | 98.8 (95.8–99.9) | 31.3 (26.3–36.6) | 1.44 (1.33–1.55) | 0.04 (0.01–0.15) |
| Moderate risk | |||||||
| 2 | 10 (5.9) | 67 (20.7) | ≥3 | 92.9 (87.9–96.3) | 52.0 (46.4–57.6) | 1.94 (1.72–2.18) | 0.14 (0.08–0.24) |
| 3 | 8 (4.7) | 17 (5.3) | ≥4 | 88.2 (82.3–92.6) | 57.3 (51.7–62.7) | 2.06 (1.80–2.37) | 0.21 (0.14–0.32) |
| Higher risk | |||||||
| 4 | 26 (15.4) | 58 (18.0) | ≥5 | 72.8 (65.4–79.3) | 75.2 (70.2–79.8) | 2.94 (2.38–3.63) | 0.36 (0.28–0.47) |
| 5 | 20 (11.8) | 30 (9.3) | ≥6 | 60.9 (53.2–68.3) | 84.5 (80.1–88.3) | 3.94 (2.97–5.22) | 0.46 (0.38–0.56) |
| 6 | 27 (16.0) | 20 (6.2) | ≥7 | 45.0 (37.3–52.8) | 90.7 (87.0–93.6) | 4.84 (3.31–7.08) | 0.61 (0.53–0.70) |
| 7 | 31 (18.3) | 21 (6.5) | ≥8 | 26.6 (20.1–34.0) | 97.2 (94.8–98.7) | 9.56 (4.79–19.07) | 0.75 (0.69–0.83) |
| 8 | 4 (2.4) | 0 (0) | ≥9 | 24.3 (18.0–31.4) | 97.2 (94.8–98.7) | 8.71 (4.34–17.48) | 0.78 (0.71–0.85) |
| 9 | 30 (17.8) | 7 (2.2) | 10 | 6.5 (3.3–11.3) | 99.4 (97.8–99.9) | 10.51 (2.36–46.88) | 0.94 (0.90–0.98) |
| 10 | 11 (6.5) | 2 (0.6) | — | — | — | — | — |
LR+, positive likelihood ratio; LR−, negative likelihood ratio; —, not applicable.
Twelve case patients with IBI for whom score could not be calculated because of missing data.
Thirty-nine control patients without IBI for whom score could not be calculated because of missing data.
Eighty-one of 169 case patients (47.9%) and 282 of 323 control patients (87.3%) with available data for all the predictors had a normal urinalysis result. Among infants with a normal urinalysis result, the sensitivity of an IBI score ≥2 was 97.5% (95% CI: 91.4%–99.7%), and the specificity was 35.8% (95% CI: 30.2%–41.7%). Among 129 infants with abnormal urinalysis results and available data, the sensitivity of a score ≥4 (ie, abnormal urinalysis result with any additional predictor) was 97.7% (95% CI: 92.0%–99.7%), but the specificity was 9.8% (95% CI: 2.7%–23.1%).
None of the 26 infants with bacterial meningitis had a low-risk IBI score <2. Two infants with meningitis had a moderate-risk score of 2, and none had a score of 3. The infants with scores of 2 both had group B streptococcal bacteremia and meningitis. One infant was a 36-day-old born at 31 weeks’ gestational age with 14% bands on complete blood count, and the other was a 54-day-old with 25% bands. Eight infants with meningitis had abnormal urinalysis results, and all had scores ≥5.
Discussion
In this multicenter study, we derived a highly sensitive clinical score to identify non–ill-appearing febrile infants ≤60 days old at low and moderate probability of IBI. Infants with fever by history only, a normal urinalysis result, and ANC <5185 cells per μL had a low probability of IBI. Because the IBI score does not incorporate results of CSF testing, this score could help clinicians avoid lumbar punctures for these infants.
Commonly cited low-risk criteria (eg, Boston, Philadelphia, and Rochester) risk stratify febrile infants using a combination of demographic, historical, physical examination, and laboratory factors determined by consensus.1,4–6 The Step-by-Step approach includes predictors with commonly used cutoff values associated with IBI.31,32 The IBI score was derived statistically to find optimal cutpoints for each continuous predictor from a sample that included by far the largest number of non–ill-appearing infants with IBI to date.1,14 Because an IBI score ≥2 had a sensitivity of 98.8%, with a narrow 95% CI of 95.8% to 99.9%, the highly sensitive score has improved precision for the identification of non–ill-appearing febrile infants at low probability of IBI compared with other risk-stratification algorithms that also do not include CSF testing (Rochester, modified Philadelphia, Step-by-Step).9,14
Previous investigations have reported a similar prevalence of IBI among infants febrile in the ED when compared with those with only a history of fever.33,34 However, we observed that infants ≤60 days old with a history of fever, but no recorded fever in the ED, had a low probability of IBI if they additionally had a normal urinalysis result and an ANC <5185 cells per μL. The IBI score is the first algorithm to separately risk stratify infants with fever by history only and can be used to potentially avoid lumbar punctures and hospitalization for these low-risk infants, who are often managed similarly to infants with a measured fever in the ED.1,9,14 Specifically, with an IBI prevalence (or pretest probability) of 2% and a negative likelihood ratio of 0.04 for a score ≥2, infants with a score <2 would have a posttest probability of IBI of 0.08%. Therefore, among 1000 non–ill-appearing febrile infants, only 1 infant will have a score <2 and harbor an IBI, and lumbar punctures and hospitalization could be avoided in the ∼300 infants without IBI who have scores <2. Additionally, although age <21 days was a predictor of IBI, this age cutoff identified only 1 additional infant with IBI. Because neonates ≤28 days old evaluated in the ED routinely undergo CSF testing and admission,15,35 using an IBI score <2 to define low risk could have a significant impact by reducing lumbar punctures and hospitalization in neonates with a low probability of IBI.
Although the sensitivity of an IBI score ≥2 was 98.8%, the specificity (31.3%) is lower than the Rochester criteria (44.5%) and Step-by-Step approach (46.9%)14 although similar to that of the modified Philadelphia criteria (34.5%).9 Using scores of ≥3 or ≥4 increased the specificity to >50%. Although the sensitivities of these score cutoffs were reduced to 93% and 88%, respectively, they are similar to those of other risk-stratification algorithms that do not include CSF testing.9,14 Two infants with a score of 2 had meningitis, although both infants had substantial bandemia, and 1 was also premature. In assessing the need for lumbar puncture in moderate-risk infants, clinicians should weigh the full clinical picture and consider the use of shared decision-making with parents. Additionally, all 8 infants with abnormal urinalysis results and meningitis had scores ≥5. Overall, because of its low specificity and positive likelihood ratio, and because the presence of fever in the ED would achieve a score of 2, the IBI score alone should not be used to determine the need for lumbar puncture in infants with scores ≥2. Rather, a score <2 can be used to identify infants with a history of fever only, who have a low probability of having an IBI, and who may not require CSF testing.
Our study has several limitations. First, although we likely identified all infants with IBI using our search strategy for case patients, our case-control design prohibited the derivation of the IBI score among the entire population of febrile infants without IBI. Second, although we applied weights to the multiple logistic regression analysis to account for the 2% prevalence of IBI among all febrile infants in the population,7 our IBI score should be externally validated before being used in clinical practice. Third, clinical variables such as clinical appearance may not be accurately assessed by using medical records. Fourth, only 26 infants had bacterial meningitis. Nevertheless, our study included a larger number of non–ill-appearing infants with meningitis than previous investigations that derived or validated a prediction model for febrile infants.1,4–6,14 Fifth, because the prevalence of IBI is higher among ill-appearing infants2 and there is consensus on the management of these infants, we excluded 98 febrile infants who were ill appearing. It is likely that ill appearance would be a significant predictor of IBI, and therefore, our results apply only to non–ill-appearing infants. Sixth, although ∼7% of case patients did not have data available for all predictors, all but 1 of these case patients still had IBI scores ≥2. Lastly, CRP and procalcitonin were obtained in only 22 and 4 infants in our study, respectively, and we were unable to evaluate these laboratory parameters as predictors of IBI. However, this low use of CRP and procalcitonin reflects their lack of availability or use at some hospitals.
Conclusions
A clinical score that includes age, highest temperature recorded in the ED, urinalysis, and ANC can be used by clinicians to identify infants with fever by history only who have a low probability of bacteremia and/or bacterial meningitis. A prospective investigation is needed to externally validate this IBI score.
Acknowledgments
We acknowledge the following collaborators in the Febrile Young Infant Research Collaborative who collected data and contributed as group authors for this study: Elana A. Feldman, MD (Lucile Packard Children’s Hospital Stanford, Palo Alto, CA); Catherine E. Lumb, BS (University of Alabama at Birmingham School of Medicine, Birmingham, AL); Christine E. Mitchell, BSN (Children’s Hospital of Philadelphia, Philadelphia, PA); and Sarah J. Shin, BSN (Children’s Hospital of Philadelphia, Philadelphia, PA).
Glossary
- ANC
absolute neutrophil count
- AUC
area under the receiver operating characteristic curve
- CI
confidence interval
- CRP
C-reactive protein
- CSF
cerebrospinal fluid
- ED
emergency department
- IBI
invasive bacterial infection
- URI
upper respiratory infection
- UTI
urinary tract infection
- WBC
white blood cell
Footnotes
Dr Aronson conceptualized and designed the study, supervised data collection locally and nationally, performed the data analyses, interpreted the data, drafted the initial manuscript, and critically reviewed and revised the manuscript for important intellectual content; Dr Shabanova contributed to design of the study, performed the data analyses, interpreted the data, and critically reviewed and revised the manuscript for important intellectual content; Dr Shapiro contributed to design of the study, interpreted the data, and critically reviewed and revised the manuscript for important intellectual content; Drs Wang, Nigrovic, Pruitt, DePorre, Leazer, Desai, Sartori, Marble, Rooholamini, McCulloh, Woll, and Balamuth collected local data, interpreted the data, and critically reviewed and revised the manuscript for important intellectual content; Drs Alpern, Shah, Williams, and Browning interpreted the data and critically reviewed and revised the manuscript for important intellectual content; Dr Shah collected local data and critically reviewed and revised the manuscript for important intellectual content; Dr Neuman contributed to conceptualization and design of the study, collected local data, interpreted the data, and critically reviewed and revised the manuscript for important intellectual content; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.
FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.
FUNDING: Supported in part by Clinical and Translational Science Award grants KL2 TR001862 (Drs Aronson and Shapiro) and UL1TR0001863 (Dr Shapiro) from the National Center for Advancing Translational Science, a component of the National Institutes of Health. The content is solely the responsibility of the authors and does not represent the official views of the National Institutes of Health. Funded by the National Institutes of Health (NIH).
POTENTIAL CONFLICT OF INTEREST: Drs Shapiro and Neuman have served as expert witnesses in malpractice cases involving the evaluation of infants with infections; the other authors have indicated they have no potential conflicts of interest to disclose.
References
- 1.Hui C, Neto G, Tsertsvadze A, et al. Diagnosis and management of febrile infants (0-3 months). Evid Rep Technol Assess (Full Rep). 2012;(205):1–297 [PMC free article] [PubMed] [Google Scholar]
- 2.Nigrovic LE, Mahajan PV, Blumberg SM, et al. ; Febrile Infant Working Group of the Pediatric Emergency Care Applied Research Network (PECARN) . The Yale observation scale score and the risk of serious bacterial infections in febrile infants. Pediatrics. 2017;140(1):e20170695. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Cruz AT, Mahajan P, Bonsu BK, et al. ; Febrile Infant Working Group of the Pediatric Emergency Care Applied Research Network . Accuracy of complete blood cell counts to identify febrile infants 60 days or younger with invasive bacterial infections. JAMA Pediatr. 2017;171(11):e172927. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Dagan R, Powell KR, Hall CB, Menegus MA. Identification of infants unlikely to have serious bacterial infection although hospitalized for suspected sepsis. J Pediatr. 1985;107(6):855–860 [DOI] [PubMed] [Google Scholar]
- 5.Baskin MN, O’Rourke EJ, Fleisher GR. Outpatient treatment of febrile infants 28 to 89 days of age with intramuscular administration of ceftriaxone. J Pediatr. 1992;120(1):22–27 [DOI] [PubMed] [Google Scholar]
- 6.Baker MD, Bell LM, Avner JR. Outpatient management without antibiotics of fever in selected infants. N Engl J Med. 1993;329(20):1437–1441 [DOI] [PubMed] [Google Scholar]
- 7.Powell EC, Mahajan PV, Roosevelt G, et al. ; Febrile Infant Working Group of the Pediatric Emergency Care Applied Research Network (PECARN) . Epidemiology of bacteremia in febrile infants aged 60 days and younger. Ann Emerg Med. 2018;71(2):211–216 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Woll C, Neuman MI, Pruitt CM, et al. ; Febrile Young Infant Research Collaborative . Epidemiology and etiology of invasive bacterial infection in infants ≤60 days old treated in emergency departments. J Pediatr. 2018;200:210–217.e1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Aronson PL, Wang ME, Shapiro ED, et al. ; Febrile Young Infant Research Collaborative . Risk stratification of febrile infants ≤60 days old without routine lumbar puncture. Pediatrics. 2018;142(6):e20181879. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Garra G, Cunningham SJ, Crain EF. Reappraisal of criteria used to predict serious bacterial illness in febrile infants less than 8 weeks of age. Acad Emerg Med. 2005;12(10):921–925 [DOI] [PubMed] [Google Scholar]
- 11.Jaskiewicz JA, McCarthy CA, Richardson AC, et al. ; Febrile Infant Collaborative Study Group . Febrile infants at low risk for serious bacterial infection–an appraisal of the Rochester criteria and implications for management. Pediatrics. 1994;94(3):390–396 [PubMed] [Google Scholar]
- 12.Tzimenatos L, Mahajan P, Dayan PS, et al. ; Pediatric Emergency Care Applied Research Network (PECARN) . Accuracy of the urinalysis for urinary tract infections in febrile infants 60 days and younger. Pediatrics. 2018;141(2):e20173068. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Pruitt CM, Neuman MI, Shah SS, et al. ; Febrile Young Infant Research Collaborative . Factors associated with adverse outcomes among febrile young infants with invasive bacterial infections. J Pediatr. 2019;204:177–182.e1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Gomez B, Mintegi S, Bressan S, Da Dalt L, Gervaix A, Lacroix L; European Group for Validation of the Step-by-Step Approach . Validation of the “Step-by-Step” approach in the management of young febrile infants. Pediatrics. 2016;138(2):e20154381. [DOI] [PubMed] [Google Scholar]
- 15.Aronson PL, Thurm C, Alpern ER, et al. ; Febrile Young Infant Research Collaborative . Variation in care of the febrile young infant <90 days in US pediatric emergency departments. Pediatrics. 2014;134(4):667–677 [DOI] [PubMed] [Google Scholar]
- 16.Biondi E, Evans R, Mischler M, et al. Epidemiology of bacteremia in febrile infants in the United States. Pediatrics. 2013;132(6):990–996 [DOI] [PubMed] [Google Scholar]
- 17.Baskin MN, Goh XL, Heeney MM, Harper MB. Bacteremia risk and outpatient management of febrile patients with sickle cell disease. Pediatrics. 2013;131(6):1035–1041 [DOI] [PubMed] [Google Scholar]
- 18.Feudtner C, Hays RM, Haynes G, Geyer JR, Neff JM, Koepsell TD. Deaths attributed to pediatric complex chronic conditions: national trends and implications for supportive care services. Pediatrics. 2001;107(6). Available at: www.pediatrics.org/cgi/content/full/107/6/e99 [DOI] [PubMed] [Google Scholar]
- 19.Feudtner C, Feinstein JA, Zhong W, Hall M, Dai D. Pediatric complex chronic conditions classification system version 2: updated for ICD-10 and complex medical technology dependence and transplantation. BMC Pediatr. 2014;14:199. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Bachur RG, Harper MB. Predictive model for serious bacterial infections among infants younger than 3 months of age. Pediatrics. 2001;108(2):311–316 [DOI] [PubMed] [Google Scholar]
- 21.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Rose S, van der Laan MJ A note on risk prediction for case-control studies. 2008. Available at: http://biostats.bepress.com/ucbbiostat/paper241. Accessed September 11, 2018
- 23.Box GEP, Tidwell PW. Transformation of the independent variables. Technometrics. 1962;4(4):531–550 [Google Scholar]
- 24.Alba AC, Agoritsas T, Walsh M, et al. Discrimination and calibration of clinical prediction models: users’ guides to the medical literature. JAMA. 2017;318(14):1377–1384 [DOI] [PubMed] [Google Scholar]
- 25.Pepe MS, Feng Z, Huang Y, et al. Integrating the predictiveness of a marker with its performance as a classifier. Am J Epidemiol. 2008;167(3):362–368 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Van Calster B, Nieboer D, Vergouwe Y, De Cock B, Pencina MJ, Steyerberg EW. A calibration hierarchy for risk models was defined: from utopia to empirical data. J Clin Epidemiol. 2016;74:167–176 [DOI] [PubMed] [Google Scholar]
- 27.Pencina MJ, D’Agostino RB Sr. Evaluating discrimination of risk prediction models: the C statistic. JAMA. 2015;314(10):1063–1064 [DOI] [PubMed] [Google Scholar]
- 28.Lachenbruch PA, Mickey MR. Estimation of error rates in discriminant analysis. Technometrics. 1968;10(1):1–11 [Google Scholar]
- 29.Luntz A, Brailovsky V. On estimation of characters obtained in statistical procedure of recognition [in Russian]. Techicheskaya Kibernetica. 1969;3 [Google Scholar]
- 30.Nigrovic LE, Kuppermann N, Malley R. Development and validation of a multivariable predictive model to distinguish bacterial from aseptic meningitis in children in the post-Haemophilus influenzae era. Pediatrics. 2002;110(4):712–719 [DOI] [PubMed] [Google Scholar]
- 31.Gomez B, Bressan S, Mintegi S, et al. Diagnostic value of procalcitonin in well-appearing young febrile infants. Pediatrics. 2012;130(5):815–822 [DOI] [PubMed] [Google Scholar]
- 32.Mintegi S, Bressan S, Gomez B, et al. Accuracy of a sequential approach to identify young febrile infants at low risk for invasive bacterial infection. Emerg Med J. 2014;31(e1):e19–e24 [DOI] [PubMed] [Google Scholar]
- 33.Mintegi S, Gomez B, Carro A, Diaz H, Benito J. Invasive bacterial infections in young afebrile infants with a history of fever. Arch Dis Child. 2018;103(7):665–669 [DOI] [PubMed] [Google Scholar]
- 34.Ramgopal S, Janofsky S, Zuckerbraun NS, et al. Risk of serious bacterial infection in infants aged ≤60 days presenting to emergency departments with a history of fever only. J Pediatr. 2019;204:191–195 [DOI] [PubMed] [Google Scholar]
- 35.Aronson PL, Thurm C, Williams DJ, et al. ; Febrile Young Infant Research Collaborative . Association of clinical practice guidelines with emergency department management of febrile infants ≤56 days of age. J Hosp Med. 2015;10(6):358–365 [DOI] [PMC free article] [PubMed] [Google Scholar]