Skip to main content
Chest logoLink to Chest
. 2018 Oct 3;154(6):1385–1394. doi: 10.1016/j.chest.2018.09.006

Building a Prediction Model for Radiographically Confirmed Pneumonia in Peruvian Children

From Symptoms to Imaging

Farhan Pervaiz a, Miguel A Chavez a,b, Laura E Ellington c, Matthew Grigsby a, Robert H Gilman b,d, Catherine H Miele a, Dante Figueroa-Quintanilla e, Patricia Compen-Chang e, Julio Marin-Concha b, Eric D McCollum f, William Checkley a,b,
PMCID: PMC6335257  PMID: 30291926

Abstract

Background

Community-acquired pneumonia remains the leading cause of death in children worldwide, and current diagnostic guidelines in resource-poor settings are neither sensitive nor specific. We sought to determine the ability to correctly diagnose radiographically confirmed clinical pneumonia when diagnostics tools were added to clinical signs and symptoms in a cohort of children with acute respiratory illnesses in Peru.

Methods

Children < 5 years of age with an acute respiratory illness presenting to a tertiary hospital in Lima, Peru, were enrolled. The ability to predict radiographically confirmed clinical pneumonia was assessed using logistic regression under four additive scenarios: clinical signs and symptoms only, addition of lung auscultation, addition of oxyhemoglobin saturation (Spo2), and addition of lung ultrasound.

Results

Of 832 children (mean age, 21.3 months; 59% boys), 453 (54.6%) had clinical pneumonia and 221 (26.6%) were radiographically confirmed. Children with radiographically confirmed clinical pneumonia had lower average Spo2 than those without (95.9% vs 96.6%, respectively; P < .01). The ability to correctly identify radiographically confirmed clinical pneumonia using clinical signs and symptoms was limited (area under the curve [AUC] = 0.62; 95% CI, 0.58-0.67) with a sensitivity of 66% (95% CI, 59%-73%) and specificity of 53% (95% CI, 49%-57%). The addition of lung auscultation improved classification (AUC = 0.73; 95% CI, 0.69-0.77) with a sensitivity of 75% (95% CI, 69%-81%) and specificity of 53% (95% CI, 49%-57%) for the presence of crackles. In contrast, the addition of Spo2 did not improve classification (AUC = 0.73; 95% CI, 0.69-0.77) with a sensitivity of 40% (95% CI, 33%-47%) and specificity of 72% (95% CI, 68%-75%) for an Spo2 ≤ 92%. Adding consolidation on lung ultrasound was associated with the largest improvement in classification (AUC = 0.85; 95% CI, 0.82-0.89) with a sensitivity of 55% (95% CI, 48%-63%) and specificity of 95% (95% CI, 93%-97%).

Conclusions

The addition of lung ultrasound and auscultation to clinical signs and symptoms improved the ability to correctly classify radiographically confirmed clinical pneumonia. Implementation of auscultation- and ultrasound-based diagnostic tools can be considered to improve diagnostic yield of pneumonia in resource-poor settings.

Key Words: auscultation, lung ultrasound, oxyhemoglobin saturation, pneumonia, prediction models

Abbreviations: AUC, area under the curve; CXR, chest radiography; LUS, lung ultrasound; Spo2, oxyhemoglobin saturation; WHP, World Health Organization


Pneumonia remains the most common infectious cause of morbidity and mortality in young children worldwide.1 Most of the 1.1 million deaths in children < 2 years of age occur in resource-limited settings.2 Early and accurate diagnosis of bacterial pneumonia presents a major challenge toward successful treatment. Current international guidelines rely on clinical presentation and physical examination, with imaging used in ambiguous or severe cases.3, 4 A lack of trained physicians and access to diagnostic tools, such as laboratory tests and imaging, make it difficult to follow international guidelines in resource-limited settings.

The World Health Organization (WHO) developed a pneumonia case management algorithm for resource-limited settings, allowing diagnosis based on symptoms and clinical signs.5 This algorithm has been shown to have low diagnostic specificity.6, 7, 8 Furthermore, no individual clinical features, including those in the WHO case management algorithm, were sufficient to reliably predict radiographically confirmed pneumonia.9 Although chest radiography (CXR) is a standard diagnostic tool for the identification of pneumonia, it has poor validity.10 Without a standardized training approach, such as the WHO CXR methodology, CXR also has high interobserver variability, and current clinical guidelines do not require a CXR for the diagnosis of pneumonia.4 There is evidence that lung auscultation and pulse oximetry improve the ability to correctly identify pneumonia11, 12; however, a recent prospective study had mixed results with pulse oximetry improving diagnosis but not auscultation.13 Lung ultrasound (LUS) has been shown to have good sensitivity and specificity compared with CXR.14, 15, 16, 17

Previous studies have attempted to develop predictive models in children with suspicion of pneumonia.18, 19, 20, 21, 22 Current algorithms have not been reliable and have been limited by small samples or the exclusion of common pediatric respiratory diseases such asthma or bronchiolitis.21, 22 We sought to assess the diagnostic value of clinical prediction models based on lung auscultation, pulse oximetry, and LUS to identify radiographically confirmed clinical pneumonia in Peruvian children < 5 years of age. This assessment may elucidate the value of implementing these clinical tools where CXR may not be available or appropriate in the diagnosis of pneumonia.

Methods

Study Design

We consecutively enrolled children aged 2 to 59 months presenting to the ED, inpatient wards, and outpatient clinics with an acute respiratory illness at the Instituto Nacional de Salud del Niño in Lima, Peru, between January 2012 and September 2013.23 The Instituto Nacional de Salud del Niño is the largest freestanding pediatric hospital in Lima. It is a public government-run hospital (www.insn.gob.pe) serving predominantly low-income populations, and it is also a national referral center. We excluded children with a history of significant heart disease or chronic respiratory disease other than asthma and children who required invasive airway management. We also recruited 230 children without any acute illness,23 but we limited the use of their data to oxyhemoglobin saturation (Spo2) values in this analysis. This cohort of children was used in a previous LUS validation study,16 and study protocol was published elsewhere.23 The study was approved by the institutional review board committees of the Instituto Nacional de Salud del Niño (Lima, Peru) (No. CL-4311), A.B. PRISMA (Lima, Peru) (No. CE1457.11), and the Johns Hopkins School of Medicine (Baltimore, MD) (No. 64148). Written informed consent was obtained from a parent or guardian prior to enrollment into the study.

Data Collection

Child participants who met inclusion criteria underwent a standard clinical assessment, after consent was obtained from their parents, for signs and symptoms, including lung auscultation, pulse oximetry, and imaging. Clinical assessment, including auscultation, was conducted by the treating pediatrician. A study team member recorded the clinical findings, including auscultation findings, vital signs, presenting history, and Spo2.23 All children underwent LUS and had an anterior-posterior CXR taken. Spo2 was assessed using pediatric probes on either Rad 5v pulse oximeters (Masimo Corp) or, in few instances, the peripheral pulse oximeters available at Instituto Nacional de Salud del Niño. Lung auscultation was performed on the anterior and posterior zones of the thorax, with the patient supine or upright, as previously described.23 Pediatricians conducting auscultation were asked to report the presence of the following findings: crackles, wheeze, decreased breath sounds, or bronchial breath sounds. Ausculatory findings were obtained with acoustic stethoscopes.

Definitions

We used WHO growth standards to define wasting (weight-for-height z score < −2 SD), stunting (height-for-age z score < −2 SD), and severe malnutrition (weight-for-height z score of ≤ −3 SD).24 We used age-specific respiratory rate cutoffs to define tachypnea: ≥ 50 breaths/min for children 2 to 11 months of age and ≥ 40 breaths/min for children 12 to 59 months of age.4 Tachycardia was defined as ≥ 190 beats/min for children 2 to 11 months of age and ≥ 140 beats/min for children 12 to 59 months of age.4 Pulse oximetry was included as a continuous variable, but we conducted sensitivity analyses with Spo2 cutoffs of ≤ 92% and ≤ 95%.

Pneumonia

The definitions of clinical pneumonia, asthma, bronchiolitis, or an upper respiratory tract infection were based on standard of care, using patient history and physical examination, including Spo2 and CXR results. A clinical diagnosis was made by the treating pediatrician. Children had WHO-defined pneumonia if they had an acute presentation of either cough or difficulty breathing and also had either lower chest wall indrawing or age-specific tachypnea.4 Severe pneumonia or very severe disease was defined as WHO pneumonia with at least one of the following danger signs: persistent vomiting, convulsions, lethargy, no oral intake, stridor, or severe malnutrition.25 Severe clinical pneumonia was defined as a clinical diagnosis of pneumonia, by the treating pediatrician, and the presence of at least one of the danger signs previously listed.25

LUS

Study children received a complete LUS using a MicroMaxx portable ultrasound machine (Sonosite/FujiFilm) with an HFL38/13-6 MHz linear transducer. LUS assessment was conducted by one of three trained general practitioners following a standardized protocol developed using international recommendations.16, 26 Interpretation and conduct of LUS were performed independent of clinical evaluation and CXR findings.16 We defined pneumonia on LUS as the presence of a hypoechoic area consistent with a consolidation and occupying of more than one intercostal space in longitudinal view, or a smaller consolidation with a pleural effusion, and interstitial abnormalities was defined as three or more B lines within a single acoustic window. We required agreement by two of three ultrasound readers for a final LUS diagnosis.16

Radiographic Pneumonia

We obtained anteroposterior CXR on all children with an acute respiratory illness. Radiographic pneumonia was defined as the presence of a lobar consolidation with or without pleural effusion.27 All chest radiographs were reviewed by two members of a team of three expert pediatric radiologists blinded to clinical information and results from LUS.16 Radiographic diagnosis was made as a consensus of the team using a standardized protocol, as previously described.16

Biostatistical Methods

Our primary objective was to assess the ability of different diagnostic algorithms to correctly classify children diagnosed with clinical pneumonia that is corroborated by the finding of a lobar consolidation on CXR. As such, we compared each additive clinical scenario against radiographically confirmed clinical pneumonia. We evaluated the following four additive scenarios: WHO-defined pneumonia,5 addition of lung auscultation findings, addition of Spo2 by pulse oximetry, followed by the addition of LUS findings. We used multivariable logistic regression to model the presence of radiographically confirmed clinical pneumonia as a function of the four additive scenarios, adjusted for malnutrition (both wasting and stunting), having tachycardia, and a having previous history of pneumonia.

We used logistic regression to calculate a concordance statistic (C statistic), which is statistically equivalent to the area under the curve (AUC).28 Models with a higher AUC did better at identifying radiographically confirmed clinical pneumonia. Analyses were performed using STATA version 13 (Stata Corp) and R (The R Foundation).

Results

Participant Characteristics

There were 832 children recruited to the study and who underwent diagnostic imaging for pneumonia. Two children were missing clinical data (< 1%) and were excluded from the analysis. We summarized participant characteristics in Table 1. Mean participant age was 21.3 months, 59% of which were boys, 8% were wasted, and 17% were stunted. The study primarily included an inner city population that is low to middle income. We summarized socioeconomic status in Table 1. Overall, final clinical diagnoses, as reported by the treating pediatrician, were as follows: 453 (55%) had clinical pneumonia, 133 (16%) had asthma, 103 (12%) had bronchiolitis, and 143 (17%) had an upper respiratory infection. Radiologists identified 221 consolidations (27%) and 264 interstitial opacities (32%) on chest radiographs in children. A total of 191 children (23%) met criteria for radiographically confirmed clinical pneumonia and 429 children (51.6%) met criteria for WHO-defined pneumonia.

Table 1.

Demographic Information and Clinical Characteristics According to Study Group

Characteristics Full Sample 2-11 mo of Age 12-59 mo of Age
Demographic characteristics
 Sample size 832 (100) 39 (322) 61 (510)
 Age, mo 21.3 ± 16.2 6.5 ± 2.8 30.6 ± 14.1
 No. of boys 59 (488) 60 (193) 58 (295)
Social demographics
 No. of people in household 5.0 ± 0.07 5.3 ± 0.11 4.9 ± 0.09
 No. of people in household
 < 3 3 (22) 2 (5) 3 (17)
 3-6 78 (648) 76 (243) 80 (405)
 7-10 17 (138) 20 (64) 15 (74)
 > 10 3 (22) 3 (9) 3 (13)
 Employment status of parents
 Both parents employed 23 (193) 13 (43) 30 (150)
 Only father employed 72 (596) 82 (260) 66 (336)
 Only mother employed 2 (17) 2 (7) 2 (10)
 Neither parent employed 2 (20) 3 (9) 2 (11)
 Father education level, y
 < 6 2 (17) 2 (7) 2 (10)
 6-10 15 (120) 18 (56) 13 (64)
 11-12 59 (483) 62 (195) 57 (288)
 > 12 22 (182) 16 (51) 26 (131)
 Mother education level, y
 < 6 3 (25) 4 (14) 2 (11)
 6-10 25 (211) 28 (91) 24 (120)
 11-12 50 (413) 53 (171) 48 (242)
 > 12 22 (179) 14 (45) 26 (134)
 Water supply
 Home water supply 91 (755) 88 (283) 93 (472)
 External water supply 9 (77) 12 (39) 7 (38)
 Toilet waste elimination
 Connection to city drainage 90 (746) 86 (277) 92 (469)
 Home septic tank < 1 (1) 0 (0) < 1 (1)
 Latrine 10 (85) 14 (45) 8 (40)
Clinical characteristics
 Weight-for-height z score 0.26 ± 1.70 0.48 ± 1.68 0.12 ± 1.69
 % < −2 SD 8 (69) 7 (21) 9 (48)
 Height-for-age z score −0.42 ± 1.95 −0.48 ± 1.96 −0.39 ± 1.95
 % < −2 SD 17 (140) 19 (61) 15 (79)
 Symptoms
 Cough 99 (825) 99 (321) 99 (504)
 Difficulty breathing 84 (696) 88 (282) 81 (414)
 Fever 64 (529) 64 (205) 64 (324)
 Chest indrawing 36 (300) 47 (150) 29 (150)
 Temperature (°C) 36.8 ± 0.65 36.8 ± 0.60 36.8 ± 0.68
 No. with ≥ 38.0°C 9 (74) 8 (26) 9 (48)
 Heart rate 130 ± 18 135 ± 17 126 ± 18
 Tachycardia 15 (126) 0 (0) 25 (126)
 Respiratory rate 39 ± 12 44 ± 12 36 ± 11
 Tachypnea 36 (301) 31 (99) 40 (202)
 Oxygen saturation 96 ± 3 97 ± 3 96 ± 3
 No. ≤ 95% 31 (259) 31 (99) 31 (160)
 No. ≤ 92% 9 (73) 8 (25) 9 (48)
 Auscultation findings
 Wheeze 45 (373) 46 (148) 44 (225)
 Crackles 53 (445) 57 (183) 51 (262)
 Decreased breath sounds 12 (98) 8 (27) 14 (71)

Values are mean ± SD or %. (No).

Distribution of Spo2 by Pneumonia Status

We plotted the distribution of Spo2 values by categories of acute respiratory illness, ranging from none to having severe pneumonia, and stratified by CXR findings (Fig 1). Mean Spo2 was lowest in children with a clinical diagnosis of pneumonia, followed by children with either asthma, bronchiolitis, or an upper respiratory tract infection. It was highest among children without an acute illness. Overall, mean Spo2 was lower in children with clinical pneumonia than in those who did not have clinical pneumonia (95.9% vs 97.1%, respectively; P < .001). There was no difference in Spo2 values between children with nonsevere clinical pneumonia and those with severe clinical pneumonia (95.9% vs 95.5%, respectively; P = .78). However, a difference was seen between children with WHO-defined pneumonia and those with WHO-defined severe pneumonia (96.1% vs 95.3%, respectively; P = .02). Additionally, no difference was found between children with radiographically confirmed clinical pneumonia and those with clinical pneumonia without a consolidation (95.9% vs 95.9%, respectively; P = .96).

Figure 1.

Figure 1

Oxyhemoglobin saturation (Spo2) among children by acute respiratory illness status. Boxplots, from left to right, represent Spo2 values for children without an acute respiratory illness, with an acute respiratory illness that was not pneumonia (asthma, bronchiolitis, or upper respiratory infections), with clinical pneumonia, and with severe clinical pneumonia. The gray dots represent outliers (ie, values that lie > 1½ times the interquartile range). Diamonds/circles and vertical bars to the left of each boxplot represent the mean Spo2 and corresponding 95% CI, respectively, stratified by chest radiography (CXR) findings (diamonds show CXR without a consolidation, circles show CXR with a consolidation).

Classification of Radiographically Confirmed Pneumonia

We summarized the diagnostic validity for each individual clinical tool (Table 2) and plotted AUCs (Fig 2) and corresponding receiver operating characteristic curves (Fig 3) for the different diagnostic tools based on the described four additive scenarios to classify pneumonia when using radiographically confirmed clinical pneumonia. WHO-defined pneumonia had a 66% sensitivity and 53% specificity for correctly identifying radiographically confirmed clinical pneumonia. The presence of cough or shortness of breath with intercostal indrawing or age-specific tachypnea, crackles on auscultation, and decreased breath sounds on auscultation had sensitivities > 60%, whereas decreased breath sounds on auscultation, Spo2 ≤ 92%, and consolidation on LUS had specificities > 90% (Table 2). Consolidation on LUS had the highest positive likelihood ratio for radiographically confirmed clinical pneumonia, whereas consolidation on LUS and presence of crackles had the lowest negative likelihood ratio. As noted in Figure 2, the use of WHO-defined pneumonia was limited in its ability to classify radiographically confirmed clinical pneumonia. The addition of lung auscultation improved the classification of radiographically confirmed clinical pneumonia, with decreased breath sounds, presence of crackles, and absence of wheezes independently associated (Fig 4). The addition of pulse oximetry to identify hypoxemia as a continuous variable (Fig 2) did not improve the classification of radiographically confirmed clinical pneumonia beyond WHO-defined pneumonia and lung auscultation. Additionally, no improvement in classification is seen using hypoxemia cutoffs of Spo2 ≤ 92% (AUC = 0.73; 95% CI, 0.69-0.77) or ≤ 95% (AUC = 0.73; 95% CI, 0.69-0.77). Both hypoxemia cutoffs, ≤ 92% and ≤ 95%, were not associated with radiographically confirmed clinical pneumonia (Fig 4). Finally, the addition of Spo2 alone to WHO-defined pneumonia did not improve classification (AUC = 0.63; 95% CI, 0.59-0.67).

Table 2.

Assessment of Diagnostic Validity of Each Clinical Tool

Diagnostic Tools Se % (95% CI) Sp % (95% CI) LR+ (95% CI) LR– (95% CI) PPV % (95% CI) NPV % (95% CI)
WHO pneumonia 66.3 (59.1-73.0) 52.7 (48.7-56.6) 1.40 (1.23-1.60) 0.64 (0.52-0.79) 29.4 (25.1-33.9) 84.0 (80.1-87.5)
Auscultation findings
 Presence of crackles 75.3 (68.5-81.2) 53.0 (49.0-56.9) 1.60 (1.43-1.80) 0.47 (0.36-0.60) 32.2 (27.9-36.8) 87.8 (84.1-90.9)
 Absence of wheezes 64.2 (57.0-71.0) 47.3 (43.4-51.3) 1.22 (1.07-1.39) 0.76 (0.61-0.93) 26.6 (22.6-30.9) 81.7 (77.4-85.5)
 Decreased breath sounds 23.2 (17.4-29.8) 91.6 (89.1-93.6) 2.74 (1.91-3.95) 0.84 (0.77-0.91) 44.9 (34.8-55.3) 80.1 (77.0-82.9)
Oxyhemoglobin saturation ≤ 95% 9.5 (5.7-14.6) 91.4 (89.0-93.5) 1.10 (0.66-1.83) 0.99 (0.94-1.04) 24.7 (15.3-36.1) 77.3 (74.1-80.2)
Oxyhemoglobin saturation ≤ 92% 40.0 (33.0-47.3) 71.6 (67.9-75.0) 1.41 (1.14-1.74) 0.84 (0.74-0.95) 29.5 (24.0-35.4) 80.1 (76.6-83.3)
Consolidation on lung ultrasound 55.3 (47.9-62.5) 95.0 (93.0-96.6) 11.05 (7.70-15.9) 0.47 (0.40-0.55) 76.6 (68.7-83.4) 87.7 (85.1-90.1)

LR+ = positive likelihood ratio, LR– = negative likelihood ratio; NPV = negative predictive value; PPV = positive predictive value; Se = sensitivity; Sp = specificity; WHO = World Health Organization.

Figure 2.

Figure 2

Area under the curve (AUC) (C statistic) for each of the four additive clinical scenarios used to classify radiographically confirmed clinical pneumonia, stratified by age group. We plotted AUCs and corresponding 95% CIs derived from multivariable logistic regression models for each additive clinical scenario (described in y axis), for all children in the sample (first panel) and stratified by age group: 2 to 11 mo of age (middle panel) and 12 to 59 mo of age (bottom panel). We also present numerical AUCs and 95% CIs for each row. LUS = lung ultrasound; Spo2 = oxyhemoglobin saturation; WHO = World Health Organization.

Figure 3.

Figure 3

Receiver operating characteristic (ROC) curves for each of the four additive clinical scenarios used to classify radiographically confirmed clinical pneumonia, stratified by age group. We plotted ROC curves derived from multivariable logistic regression models for each additive clinical scenario (described in y axis), for all children in the sample (left panel) and stratified by age group: 2 to 11 mo of age (middle panel) and 12 to 59 mo of age (right panel). See Figure 2 legend for expansion of other abbreviations.

Figure 4.

Figure 4

Forest plot of the odds of having radiographically confirmed clinical pneumonia using four types of clinical tools. We plotted the adjusted OR of having radiographically confirmed clinical pneumonia for each four clinical tools in an additive scenario using overall study sample, and then stratified by age groups (2-11 and 12-59 mo of age). Adjusted ORs are represented with diamonds and 95% CIs are represented by horizontal lines. We show the additive scenarios on the y axis. Four sets of logistic regression models were built. The first model included a composite for variables to WHO pneumonia, and adjusted for confounders (medical history of pneumonia, age-specific tachycardia, and weight-for-height and height-for-age z scores). The second model included WHO pneumonia, three auscultatory variables (absence of wheezes, presence of crackles, and decreased breath sounds), and vide supra confounders. The third model was a set of models that included WHO pneumonia, the three auscultatory variables, Spo2 expressed three different ways, and vide supra confounders. Specifically, we ran three independent models with Spo2 as a continuous variable, and Spo2 with the thresholds of ≤ 95% and ≤ 92%. The fourth model included WHO pneumonia, the three auscultatory variables, continuous Spo2, two lung ultrasound variables (interstitial abnormalities or consolidation), and vide supra confounders. Adjusted ORs and 95% CIs are also presented numerically for each row. See Figure 2 legend for expansion of abbreviations.

LUS contributed to the largest improvement in the classification of radiographically confirmed clinical pneumonia. When LUS alone, without auscultation and Spo2, was added to WHO-defined pneumonia, it improved the classification of radiographically confirmed clinical pneumonia (AUC = 0.82; 95% CI, 0.78-0.85). Consolidation on LUS was associated with radiographically confirmed clinical pneumonia (Fig 4). Finding interstitial abnormalities on LUS was indicative of not having radiographically confirmed clinical pneumonia. The addition of Spo2 and LUS, without lung auscultation, improved classification of radiographically confirmed pneumonia beyond clinical signs and symptoms (AUC = 0.82; 95% CI, 0.79-0.86). However, the model that included lung auscultation, with Spo2 and LUS, had better discrimination (AUC = 0.85 vs AUC = 0.82).

Subgroup Analyses

In children 12 to 59 months of age, the use of WHO-defined pneumonia resulted in poor classification of radiographically confirmed clinical pneumonia (Fig 2). The addition of lung auscultation improved classification (Fig 2), with crackles, decreased breath sounds, and absence of wheezes independently associated with radiographically confirmed clinical pneumonia (Fig 4). The addition of pulse oximetry to identify hypoxemia did not improve classification (Fig 2) and was not independently associated with radiographically confirmed clinical pneumonia (Fig 4). LUS contributed the largest improvement in the classification of radiographically confirmed clinical pneumonia.

In infants 2 to 11 months of age, the use of WHO-defined pneumonia also resulted in poor classification (Fig 2). The addition of lung auscultation improved classification, albeit less so than in children 12 to 59 months of age (Fig 2). When the contributions of lung auscultation were also assessed independently, we found that the presence of crackles and absence of wheezes were not associated with radiographically confirmed clinical pneumonia, whereas decreased breath sounds were associated with radiographically confirmed clinical pneumonia (Fig 4). The addition of pulse oximetry resulted in an improvement in the classification of radiographically confirmed clinical pneumonia (Fig 2). A lower Spo2 was associated with a higher odds of having radiographically confirmed clinical pneumonia (Fig 4). Finally, LUS again was associated with the largest improvement in the classification of radiographically confirmed clinical pneumonia (Fig 2).

Discussion

We found that the WHO definition of pneumonia based on clinical symptoms and signs alone had poor discrimination for radiographically confirmed clinical pneumonia among Peruvian children who presented with an acute respiratory illness. Although children with pneumonia had lower Spo2, the use of pulse oximetry to identify hypoxemia did not add value, above WHO-defined pneumonia, to the classification of radiographically confirmed clinical pneumonia in the overall population. In contrast, both the use of auscultation or LUS improved the classification of children with radiographically confirmed clinical pneumonia.

Lung auscultation remains an important component of pneumonia diagnosis with more predictive accuracy than an initial clinical assessment alone. In the study population, the presence of crackles, decreased breath sounds, and absence of wheezes were all important predictors for radiographically confirmed clinical pneumonia. This is consistent with other studies where auscultation is a useful predictor of radiographically confirmed pneumonia.29 Presence of physicians, trained personnel, or even a device30 that identifies lung sounds may be critical for increasing the accuracy of a clinical algorithm for the diagnosis of pneumonia in resource-limited settings.

The use of pulse oximetry to identify pneumonia is supported by studies showing that a low Spo2 may help to identify more cases of pneumonia than a clinical approach alone.12, 31 Our findings in Peru demonstrated that although Spo2 was significantly lower in children with pneumonia when compared with those who did not have pneumonia, it did not add value to other diagnostic tools to identify radiographically confirmed clinical pneumonia. One possibility that may explain our findings is that our study was conducted in a tertiary referral hospital, where physicians were able to more easily recognize hypoxemia without having to use a pulse oximeter. The sample size may also limit our ability to provide adequate inferences because only 73 children (9%) had an Spo2 ≤ 92%. Our analysis suggests that Spo2 may aid in the diagnosis of pneumonia when assessing infants 2 to 11 months of age, possibly because clinical signs of hypoxemia are more difficult to ascertain in this age group.

Finally, consolidation on LUS, when added to a clinical model, pulse oximetry, and lung auscultation, had the strongest prediction values for radiographically confirmed clinical pneumonia. Children with interstitial opacities alone on LUS were less likely to have radiographically confirmed clinical pneumonia. LUS has recently been proposed as an alternative to CXR because of its high accuracy to diagnose pneumonia in both adults14 and children,15 with pediatric studies confirming these findings in low-resource communities.16 In addition, studies have shown that LUS is a safe alternative to CXR in children with suspected pneumonia.32, 33 Our data support these safety and efficacy trials in the use of LUS as a good predictor of radiographically confirmed clinical pneumonia. Moreover, LUS could be a substitute for CXR in settings that do not have the capability or resources to manage a CXR system.

Our study has several strengths. First, we obtained data on clinical signs and symptoms, auscultation, Spo2, and imaging in a large number of children with acute respiratory symptoms. Second, LUS was interpreted by practitioners blinded to clinical or CXR information to avoid potential biases in the interpretation of LUS images. Finally, this study included a variety of acute lower respiratory conditions that could be confused with pneumonia.

Our study also has some potential shortcomings. First, the study population was mostly derived from a tertiary referral center. Although children were recruited from outpatient clinics and not all children were referred for respiratory illness, the generalizability of our findings may be limited to children seeking care at tertiary medical centers. Second, we excluded children with chronic lung disease other than asthma and congenital cardiac diseases from the study, further limiting generalizability. Third, we only conducted longitudinal scans when performing LUS. It is possible that the addition of transverse scanning would have resulted in higher diagnostic performance for pneumonia.34 Finally, a gold standard for the diagnosis of pediatric pneumonia is not well defined, and we acknowledge that the interobserver variability in the interpretation of CXR, especially on absence of clinical findings, is high.

Conclusions

Different algorithms, including use of signs and symptoms, laboratory data, and imaging, have been proposed to better diagnose pneumonia in children. Still, there is no consensus of which predictors have the highest yield for discrimination of radiographically confirmed clinical pneumonia, and results may vary depending on population, age, and setting. Our analysis found that lung auscultation and LUS may improve diagnosis of pediatric pneumonia, beyond clinical signs and symptoms. The next steps should be validation studies to assessing utility, ease of use, and feasibility of auscultation and LUS tools in resource-limited settings, and their impact on clinical outcomes.

Acknowledgments

Author contributions: W. C. had ultimate oversight over study conduct, analysis, and interpretation of results. F. P. contributed to design of manuscript, conducted the data analysis and interpretation, and was responsible for writing the manuscript. M. A. C. was responsible for supervision of data gathering and ultrasound, participated in sonographic grading, contributed equally to interpretation of findings, and contributed to writing of the manuscript. L. E. E. contributed to the study design, was responsible for the conduct of the study, was responsible for supervision of data gathering and ultrasound, participated in sonographic grading, contributed to the analysis and interpretation, and contributed to writing of the manuscript. M. G. contributed to data analysis and interpretation and contributed to writing of the manuscript. R. H. G. contributed to study design, contributed to analysis and interpretation, and contributed to writing of the manuscript. C. H. M. contributed to data interpretation and contributed to writing of the manuscript. D. F.-Q. was responsible for the conduct of the study and contributed to writing of the manuscript. P. C.-C. was responsible for radiographic analysis for chest radiographs and contributed to writing of the manuscript. J. M.-C. was responsible for supervision of data gathering and ultrasound, participated in sonographic grading, and contributed to writing of the manuscript. E. D. M. contributed equally to data interpretation and contributed to writing of the manuscript. W. C. conceived the study design, contributed to analysis and interpretation, and was responsible for writing of the manuscript.

Financial/nonfinancial disclosures: None declared.

Role of sponsors: The sponsor had no role in the design of the study, the collection and analysis of the data, or the preparation of the manuscript.

Other contributions: We thank the support provided by Asociacion Benefica PRISMA, Instituto Nacional de Salud del Niño, and collaborators at Johns Hopkins University, Cincinnati Children’s Hospital, and Hospital Nacional Eduardo Rebagliati Martins.

Footnotes

FUNDING/SUPPORT: W. C. is supported by the Bill & Melinda Gates Foundation [Grant OPP1117483] and by the National Institutes of Health [Grant 1UM1HL134590]. L. E. E. was supported by the Doris Duke Charitable Foundation Clinical Research Fellowship.

References

  • 1.World Health Organization . World Health Organization; Geneva, Switzerland: 2014. Pneumonia: Fact Sheet No 331. [Google Scholar]
  • 2.Liu L., Johnson H.L., Cousens S. Global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. 2012;379(9832):2151–2161. doi: 10.1016/S0140-6736(12)60560-1. [DOI] [PubMed] [Google Scholar]
  • 3.Harris M., Clark J., Coote N. British Thoracic Society guidelines for the management of community acquired pneumonia in children: update 2011. Thorax. 2011;66(suppl 2):ii1–ii23. doi: 10.1136/thoraxjnl-2011-200598. [DOI] [PubMed] [Google Scholar]
  • 4.Bradley J.S., Byngton C.L., Shah S.S. The management of community-acquired pneumonia in infants and children older than 3 months of age: clinical practice guidelines by the Pediatric Infectious Diseases Society and the Infectious Diseases Society of America. Clin Infect Dis. 2011;53(7):e25–e76. doi: 10.1093/cid/cir531. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Pio A. Standard case management of pneumonia in children in developing countries: the cornerstone of the acute respiratory infection programme. Bull World Health Organ. 2003;81(4):298–300. [PMC free article] [PubMed] [Google Scholar]
  • 6.Hazir T., Qazi S., Nisar Y.B. Assessment and management of children aged 1-59 months presenting with wheeze, fast breathing, and/or lower chest indrawing; results of a multicentre descriptive study in Pakistan. Arch Dis Child. 2004;89(11):1049–1054. doi: 10.1136/adc.2003.035741. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Hazir T., Nisar Y.B., Abbasi S. Comparison of oral amoxicillin with placebo for the treatment of world health organization-defined nonsevere pneumonia in children aged 2-59 months: a multicenter, double-blind, randomized, placebo-controlled trial in Pakistan. Clin Infect Dis. 2011;52(3):293–300. doi: 10.1093/cid/ciq142. [DOI] [PubMed] [Google Scholar]
  • 8.World Health Organization. Consultative Meeting to Review Evidence and Research Priorities in the Management of Acute Respiratory Infections (ARI): Meeting Report. Geneva, Switzerland: World Health Organization; 2004.
  • 9.Rambaud-Althaus C., Althaus F., Genton B., D'Acremont V. Clinical features for diagnosis of pneumonia in children younger than 5 years: a systematic review and meta-analysis. Lancet Infect Dis. 2015;15(4):439–450. doi: 10.1016/S1473-3099(15)70017-4. [DOI] [PubMed] [Google Scholar]
  • 10.Hazir T., Nisar Y.B., Qazi S.A. Chest radiography in children aged 2-59 months diagnosed with non-severe pneumonia as defined by World Health Organization: descriptive multicentre study in Pakistan. BMJ. 2006;333(7569):629. doi: 10.1136/bmj.38915.673322.80. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Margolis P., Gadomski A. The rational clinical examination. Does this infant have pneumonia? JAMA. 1998;279(4):308–313. doi: 10.1001/jama.279.4.308. [DOI] [PubMed] [Google Scholar]
  • 12.Modi P., Munyaneza R.B., Goldberg E. Oxygen saturation can predict pediatric pneumonia in a resource-limited setting. J Emerg Med. 2013;45(5):752–760. doi: 10.1016/j.jemermed.2013.04.041. [DOI] [PubMed] [Google Scholar]
  • 13.Shah S.N., Bachur R.G., Simel D.L. Does this child have pneumonia?: The rational clinical examination systematic review. JAMA. 2017;318(5):462–471. doi: 10.1001/jama.2017.9039. [DOI] [PubMed] [Google Scholar]
  • 14.Chavez M.A., Shams N., Ellington L.E. Lung ultrasound for the diagnosis of pneumonia in adults: a systematic review and meta-analysis. Respir Res. 2014;15(1):50. doi: 10.1186/1465-9921-15-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Pereda M.A., Chavez M.A., Hooper-Miele C.C. Lung ultrasound for the diagnosis of pneumonia in children: a meta-analysis. Pediatrics. 2015;135(4):714–722. doi: 10.1542/peds.2014-2833. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Ellington L.E., Gilman R.H., Chavez M.A. Lung ultrasound as a diagnostic tool for radiographically-confirmed pneumonia in low resource settings. Respir Med. 2017;128:57–64. doi: 10.1016/j.rmed.2017.05.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Chavez M.A., Naithani N., Gilman R.H. Agreement Between the World Health Organization algorithm and lung consolidation identified using point-of-care ultrasound for the diagnosis of childhood pneumonia by general practitioners. Lung. 2015;193(4):531–538. doi: 10.1007/s00408-015-9730-x. [DOI] [PubMed] [Google Scholar]
  • 18.Mahabee-Gittens E.M., Grupp-Phelan J., Brody A.S. Identifying children with pneumonia in the emergency department. Clin Pediatr. 2005;44(5) doi: 10.1177/000992280504400508. 427-423. [DOI] [PubMed] [Google Scholar]
  • 19.Bunuel Alvarez J.C., Vila Pablos C., Heredia Quicios J. Usefulness of physical examination at a primary health centre to diagnose infant pneumonia caught in the community. Aten Primaria. 2003;32(6):349–354. doi: 10.1016/S0212-6567(03)79295-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Rothrock S.G., Green S.M., Fanelli J.M., Cruzen E., Costanzo K.A., Pagane J. Do published guidelines predict pneumonia in children presenting to an urban ED? Pediatr Emerg Care. 2001;17(4):240–243. doi: 10.1097/00006565-200108000-00003. [DOI] [PubMed] [Google Scholar]
  • 21.Lynch T., Platt R., Gouin S., Larson C., Patenaude Y. Can we predict which children with clinically suspected pneumonia will have the presence of focal infiltrates on chest radiographs? Pediatrics. 2004;113(3 Pt 1):e186–e189. doi: 10.1542/peds.113.3.e186. [DOI] [PubMed] [Google Scholar]
  • 22.Bilkis M.D., Gorgal N., Carbone M. Validation and development of a clinical prediction rule in clinically suspected community-acquired pneumonia. Pediatr Emerg Care. 2010;26(6):399–405. doi: 10.1097/PEC.0b013e3181e05779. [DOI] [PubMed] [Google Scholar]
  • 23.Ellington L.E., Gilman R.H., Tielsch J.M. Computerised lung sound analysis to improve the specificity of paediatric pneumonia diagnosis in resource-poor settings: protocol and methods for an observational study. BMJ Open. 2012;2(1):e000506. doi: 10.1136/bmjopen-2011-000506. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.World Health Organization . World Health Organization; Geneva, Switzerland: 2006. WHO child growth standards: length/height for age, weight-for-age, weight-for-length, weight-for-height and body mass index-for-age, methods and development. [Google Scholar]
  • 25.World Health Organization . World Health Organization; Geneva, Switzerland: 2014. Integrated Management of Childhood Illness. Chart Booklet. [Google Scholar]
  • 26.Volpicelli G., Elbarbary M., Blaivas M. International evidence-based recommendations for point-of-care lung ultrasound. Intensive Care Med. 2012;38(4):577–591. doi: 10.1007/s00134-012-2513-4. [DOI] [PubMed] [Google Scholar]
  • 27.Cherian T., Mulholland E.K., Carlin J.B. Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies. Bull World Health Organ. 2005;83(5):353–359. [PMC free article] [PubMed] [Google Scholar]
  • 28.Pencina M.J., D’Agostino B. Evaluating discrimination of risk prediction models: the C-statistic. JAMA. 2015;314(10):1063–1064. doi: 10.1001/jama.2015.11082. [DOI] [PubMed] [Google Scholar]
  • 29.Neuman M.I., Monuteaux M.C., Scully K.J. Prediction of pneumonia in a pediatric emergency department. Pediatrics. 2011;128(2):246–253. doi: 10.1542/peds.2010-3367. [DOI] [PubMed] [Google Scholar]
  • 30.Ellington L.E., Emmanouilidou D., Elhilali M. Developing a reference of normal lung sounds in healthy Peruvian children. Lung. 2014;192(5):765–773. doi: 10.1007/s00408-014-9608-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Madico G., Gilman R.H., Jabra A. The role of pulse oximetry. Its use as an indicator of severe respiratory disease in Peruvian children living at sea level. Respiratory Group in Peru. Arch Pediatr Adolesc Med. 1995;149(11):1259–1263. doi: 10.1001/archpedi.1995.02170240077012. [DOI] [PubMed] [Google Scholar]
  • 32.Ambroggio L., Sucharew H., Rattan M.S. Lung ultrasonography: a viable alternative to chest radiography in children with suspected pneumonia? Pediatrics. 2016;176:93–98. doi: 10.1016/j.jpeds.2016.05.033. [DOI] [PubMed] [Google Scholar]
  • 33.Jones B.P., Tay E.T., Elikashvili I. Feasibility and safety of substituting lung ultrasonography for chest radiography when diagnosing pneumonia in children: a randomized controlled trial. Chest. 2016;150(1):131–138. doi: 10.1016/j.chest.2016.02.643. [DOI] [PubMed] [Google Scholar]
  • 34.Milliner B.H., Tsung J.W. Lung consolidation locations for optimal lung ultrasound scanning in diagnosing pediatric pneumonia. J Ultrasound Med. 2017;36(11):2325–2328. doi: 10.1002/jum.14272. [DOI] [PubMed] [Google Scholar]

Articles from Chest are provided here courtesy of American College of Chest Physicians

RESOURCES