Abstract
Background
Various case definitions of respiratory syncytial virus lower respiratory tract infection (RSV-LRTI) are currently proposed. We assessed the performance of 3 clinical case definitions against the World Health Organization definition recommended in 2015 (WHO 2015).
Methods
In this prospective cohort study conducted in 8 countries, 2401 children were followed up for 2 years from birth. Suspected LRTIs were detected via active and passive surveillance, followed by in-person clinical evaluation including single timepoint respiratory rate and oxygen saturation (by pulse oximetry) assessment, and nasopharyngeal sampling for RSV testing by polymerase chain reaction. Agreement between case definitions was evaluated using Cohen’s κ statistics.
Results
Of 1652 suspected LRTIs, 227 met the WHO 2015 criteria for RSV-LRTI; 73 were classified as severe. All alternative definitions were highly concordant with the WHO 2015 definition for RSV-LRTI (κ: 0.95–1.00), but less concordant for severe RSV-LRTI (κ: 0.47–0.82). Tachypnea was present for 196/226 (86.7%) WHO 2015 RSV-LRTIs and 168/243 (69.1%) LRTI/bronchiolitis/pneumonia cases, clinically diagnosed by nonstudy physicians. Low oxygen saturation levels were observed in only 55/226 (24.3%) WHO 2015 RSV-LRTIs.
Conclusions
Three case definitions for RSV-LRTI showed high concordance with the WHO 2015 definition, while agreement was lower for severe RSV-LRTI. In contrast to increased respiratory rate, low oxygen saturation was not a consistent finding in RSV-LRTIs and severe RSV-LRTIs. This study demonstrates that current definitions are highly concordant for RSV-LRTIs, but a standard definition is still needed for severe RSV-LRTI.
Clinical trial registration
Keywords: case definition, disease severity, hospitalization, infant, lower respiratory tract infections, newborn, respiratory syncytial virus
Respiratory syncytial virus (RSV) causes respiratory illnesses ranging from common cold to moderate and severe lung disease. Symptoms and methods used to identify/track RSV disease are not always the same in different settings. We compared how 3 definitions of RSV disease differ from a definition recommended in 2015 by the World Health Organization (WHO). We followed 2401 children from 8 countries from birth to 2 years and tracked all instances of RSV disease according to each definition. The number of RSV disease cases without severe symptoms was similar using all definitions (227 for the WHO, and between 226 and 236 for 3 other definitions). In contrast, numbers varied widely for children with severe symptoms (73 cases for the WHO, and between 23 and 145 cases for the other definitions). A universal definition of RSV disease and severity is needed to test and compare treatments and prevention measures against RSV.
Graphical Abstract
Background
Globally, lower respiratory tract infections (LRTIs) remain one of the most common causes of morbidity and mortality, particularly in young children and low-income countries [1, 2]. Respiratory syncytial virus (RSV) is a leading cause of acute LRTI in children <6 months of age and a substantial burden on healthcare services worldwide [1, 3–5]. A meta-analysis of RSV global disease burden in children <5 years of age in 2019 estimated that 33.0 million RSV-LRTI cases, 3.6 million RSV-LRTI hospital admissions, and 101 400 RSV-attributable deaths (45% in infants <6 months) occur annually [5]. Many RSV-associated deaths occur in the community and may be overlooked by hospital-based surveillance, contributing to the high RSV mortality rates in low- and middle-income countries (LMICs) [6–11].
RSV disease burden estimates and cross-study comparisons are limited by differences in inclusion criteria, case ascertainment methodologies, and RSV diagnostic tests. Importantly, published studies of RSV disease burden or interventional trials have not used consistent case definitions for LRTI and severe LRTI. Consistent, standardized RSV-LRTI case definitions would allow comparisons of estimates between different populations and facilitate more efficient planning, implementation, and evaluation of RSV prevention programs [12]. A standardized definition will also strengthen a rigorous approach to the clinical development of RSV prevention interventions.
Starting in 1995, the World Health Organization (WHO) developed RSV-LRTI case definitions based on clinical symptoms and observations as part of the integrated management of childhood illness (IMCI) strategy to detect and treat acute LRTIs [13]. To evaluate interventions against RSV in clinical trials, the WHO revised these definitions in 2015 by incorporating oxygen saturation (SpO2) measurements (an indicator of hypoxemia) to diagnose and classify RSV-LRTI severity [12]. However, the use of pulse oximetry-measured SpO2 to assess severity of RSV disease is controversial, with no definitive documented cutoff values or validations [14–16].
We conducted a prospective international cohort study of infants from birth to 2 years of age to detect RSV-LRTI using active and passive surveillance, with laboratory confirmation of viral etiology. In this report, we assess the performance of the WHO 2015 case definitions and 3 other case definitions for RSV-LRTI.
METHODS
Study Design and Participants
We conducted this prospective, observational cohort study between December 2013 and October 2017 at study sites located in high-income countries (HICs; Canada, Finland, and the United States) and LMICs (Argentina, Bangladesh, Honduras, South Africa, and Thailand). The study design and eligibility criteria are described in detail elsewhere [17]. Briefly, children were enrolled at birth and followed during their first 2 years of life. LRTI cases were detected using active and passive surveillance (ie, regular site contacts vs. spontaneous reports). Here, we report the evaluation of 4 case definitions; other objectives have been described [17] or will be reported elsewhere.
We conducted the study in accordance with Good Clinical Practice, the Declaration of Helsinki, and all applicable regulatory requirements. The study protocol, subsequent amendments, and informed consent forms were reviewed and approved by national regulatory authorities and Institutional Review Boards/Institutional Ethics Committees at each site. The trial is registered on ClinicalTrials.gov (NCT01995175); the full study protocol is available at https://www.gsk-studyregister.com/en/trial-details/?id=200150.
Procedures
The study procedures were described elsewhere [17]. Briefly, suspected LRTI was defined as RTI symptoms with potential LRTI involvement, including cough, runny nose, or blocked nose with any signs of breathing difficulty. Children with suspected LRTI identified through surveillance were examined in-person within 72 h to collect the following: temperature, respiratory rate (RR), SpO2, a nasopharyngeal swab sample, and all clinical symptoms. RR was measured manually, using a stethoscope and a counter/watch, for at least 60 s. SpO2 was determined using dedicated study-provided pulse oximeters, generally while the child was breathing room air.
RSV was detected and subtypes were characterized using an in-house reverse transcription-quantitative real-time polymerase chain reaction assay (RT-qPCR).
Parents/legally authorized representatives recorded any symptoms on diary cards for 14 days after identification of a suspected LRTI, or until symptom resolution (if >14 days). Each case was followed by study staff with subsequent regular contacts. Healthcare utilization during the entire episode was recorded. Any physician diagnosis of LRTI, pneumonia, or bronchiolitis during the episode, occurring outside the study and subsequent to the study examination visit, was recorded (hereafter denoted physician-diagnosed LRTI).
Case Definitions
The 4 RSV-LRTI case definitions evaluated in this study are presented in Table 1. A case definition elaborated by the study sponsor in collaboration with experts (hereafter denoted protocol definition) and 1 used in surveillance in Kenya (Nokes definition) [18] were evaluated. An exploratory case definition not including chest indrawing to define severe disease was also evaluated following a 2014 change in the WHO IMCI guidance [19]. Any LRTI episode meeting criteria for a given case definition was counted as a case under that definition; all other episodes were considered noncases. Concordance of all 3 definitions with the WHO 2015 definition [12] was assessed.
Table 1.
WHO 2015 [12] | Protocol (Current Study) | Nokes et al. (2008) [18] | Exploratory | |
---|---|---|---|---|
RSV-LRTI | ▪ Child with history of cough or difficulty breathing | ▪ Child with history of cough or runny nose or blocked nose | ▪ Child with history of cough or difficulty breathing | ▪ Child with history of cough or difficulty breathing |
▪ SpO2 <95% or RR increase | ▪ SpO2 <95% or RR increase | ▪ SpO2 <90% accompanied by clinical diagnosis of LRTI/bronchiolitis, or RR increase, or lower chest wall indrawing | ▪ SpO2 <95%, or RR increase, or lower chest wall indrawing | |
▪ RSV-positive by RT-qPCR | ▪ RSV-positive by RT-qPCR | ▪ RSV-positive by RT-qPCR | ▪ RSV-positive by RT-qPCR | |
Severe RSV-LRTI | ▪ Child with RSV-LRTI | ▪ Child with RSV-LRTI | ▪ Child with RSV-LRTI | ▪ Child with RSV-LRTI |
▪ SpO2 <93% or lower chest wall indrawing | ▪ SpO2 <92%, or difficulty breathing (leading to irritability/agitation or lethargy/sleepiness), or lower chest wall indrawing, or reduced/no vocalization, or apnea >20 seconds, or cyanosis, or stop feeding well/dehydration | ▪ At least one of the following: SpO2<90% accompanied by clinical diagnosis of LRTI/bronchiolitis or lower chest wall indrawing | ▪ SpO2 <93% |
Abbreviations: LRTI, lower respiratory tract infection; RR, respiratory rate; RSV, respiratory syncytial virus; RT-qPCR, reverse transcription-quantitative polymerase chain reaction; SpO2, saturation of peripheral oxygen; WHO, World Health Organization.
Notes: RR increase was defined as ≥60/min (<2 months of age); ≥50/min (2–11 months of age); ≥40/min (12–24 months of age). RR, SpO2, and clinical symptoms were recorded by study staff at in-person visits conducted within 72 h from the identification of a new or worsened suspected LRTI case through active or passive surveillance.
Statistical Analyses
The enrollment target was 2400 participants; sample size was determined as previously described [17]. Analyses were performed using data collected from children meeting all eligibility criteria until study completion or drop-out (eg, withdrawn consent, lost to follow-up, lack of compliance).
Clinical case definitions were compared with the WHO 2015 case definition based on RSV-LRTI or severe RSV-LRTI case status (case vs. noncase), considering all new suspected LRTI episodes, including recurrent events. Case definitions were also compared among the subset of RSV-positive suspected LRTI episodes. Agreement between RSV hospitalizations and RSV-LRTI hospitalizations (in-patient admission with or without intensive care) was also evaluated for each case definition. Concordance was estimated using Cohen’s kappa (κ) statistic [20, 21]; values from 0.60 to 0.79 indicated moderate agreement, from 0.80 to 0.90 strong agreement, and above 0.90 almost perfect agreement [22].
RESULTS
Study Population
Of 2402 children enrolled in the study, 2401 were included in the analyses; 1439 (59.9%) were from LMICs (Supplementary Figure 1) [17].
Baseline characteristics were previously described [17]. Briefly, most children (62.9%) were born during a period with high regional RSV transmission in each country (Supplementary Figure 1) and after 37 weeks of gestation (92.5%). Approximately half of children (49.5%) had mothers with a university education or higher; race distribution varied by country [17]. No children had an underlying condition associated with low SpO2.
Agreement Between RSV-LRTI Definitions
In total, 1652 suspected LRTI episodes (565 first episodes of LRTI; Supplementary Table 1) were identified; 356 were RSV-positive. Per the WHO 2015 case definition, 227 episodes were RSV-LRTI cases and 1425 (including 129 RSV-positive episodes not meeting other defining criteria) were noncases; 73 were severe RSV-LRTI cases.
Around 85% of first episodes occurred in LMICs for both WHO 2015 RSV-LRTI (174 in LMICs, 32 in HICs) and severe RSV-LRTI (58 in LMICs, 11 in HICs). The proportion of WHO 2015 severe RSV-LRTIs among first episodes of WHO 2015 RSV-LRTI varied from 29.9% to 42.1% in LMICs and from 25.0% to 50.0% in HICs (Supplementary Table 1).
All 3 alternative definitions were highly concordant with the WHO 2015 definition (κ coefficients between 0.95 and 1.00; Supplementary Table 2). In a post hoc analysis considering only RSV-positive episodes, agreement with the WHO 2015 definition was similar for the protocol and exploratory definitions, but lower for the Nokes definition (Supplementary Table 2).
Table 2.
WHO 2015 RSV-LRTI | |||
---|---|---|---|
Case | Noncase | κ (95% CI) | |
Protocol definition (current study) | |||
Case | 227 | 0 | 1.00 (1.00–1.00) |
Noncase | 0 | 1425 | |
Nokes et al. 2008 definition | |||
Case | 217 | 9 | 0.95 (0.93–0.97) |
Noncase | 10 | 1416 | |
Exploratory definition | |||
Case | 227 | 9 | 0.98 (0.96–0.99) |
Noncase | 0 | 1416 | |
WHO 2015 severe RSV-LRTI | |||
Case | Noncase | κ (95% CI) | |
Protocol definition (current study) | |||
Case | 68 | 77 | 0.60 (0.52–0.68) |
Noncase | 5 | 1502 | |
Nokes et al. (2008) definition | |||
Case | 58 | 9 | 0.82 (0.75–0.89) |
Noncase | 15 | 1570 | |
Exploratory definition | |||
Case | 23 | 0 | 0.47 (0.34–0.59) |
Noncase | 50 | 1579 |
Abbreviations: case/noncase, any suspected LRTI episode meeting all criteria for a given case definition/all other suspected LRTI episodes; CI, confidence interval; LRTI, lower respiratory tract infection; RSV, respiratory syncytial virus; WHO, World Health Organization; κ, Cohen’s kappa coefficient.
Notes:Around 85% of first episodes of WHO 2015 RSV-LRTI and severe RSV-LRTI occurred in low- to middle-income countries (LMICs) (174 in LMICs and 32 in high-income countries [HICs] for WHO 2015 RSV-LRTI, and 58 in LMICs and 11 in HICs for WHO 2015 severe RSV-LRTI).
Of 73 WHO 2015 severe RSV-LRTI cases, 68 were also severe RSV-LRTI by the protocol definition; 1502 were noncases by both definitions. Overall, alternative case definitions for severe RSV-LRTI were less concordant than those for RSV-LRTI of any severity (κ coefficients between 0.47 and 0.82; Table 2). In a post hoc analysis among RSV-positive episodes only, agreement between alternative case definitions and the WHO 2015 definition was lower for the protocol definition and similar for other definitions (Supplementary Table 2).
RSV viral loads were highest among episodes meeting the WHO 2015 severe RSV-LRTI definition (Supplementary Figure 2).
Comparison of RSV Hospitalizations to Case Definitions
The agreement between suspected RSV-LRTI hospitalizations and hospitalizations for each RSV-LRTI case definition is summarized in Supplementary Table 3. In total, 31 hospitalizations occurred among suspected RSV-LRTIs (Supplementary Table 1). Altogether, 8.8% of WHO 2015 RSV-LRTI and 16.4% of WHO 2015 severe RSV-LRTI episodes required hospitalization [17]. Among hospitalized children 0–11 months of age, the WHO 2015 case definition was met for 16 episodes; 10 were severe. Nine were RSV-positive but did not meet WHO 2015 LRTI criteria: 6 infants had breathing difficulty or wheezing (of whom 3 were dehydrated or not feeding well), and 1 had breath holding spells; in 2 cases hospital records were not located. Among children 12–23 months of age, 4 cases with hospitalization met the WHO 2015 RSV-LRTI criteria, of which 2 were severe.
Evaluation of WHO 2015 Case Definition Components
The frequency of selected symptoms reported during the examination visits was similar for WHO 2015 RSV-LRTI and physician-diagnosed LRTI cases. For WHO 2015 severe RSV-LRTI episodes, this frequency tended to be higher for nostril flaring and irritability/agitation and was substantially higher for chest indrawing compared to WHO 2015 RSV-LRTI or physician-diagnosed LRTI episodes (Table 3).
Table 3.
Physician’s Diagnosis of LRTI, Bronchiolitis, or Pneumonia (N = 243) | WHO 2015 RSV-LRTI (N = 226) |
WHO 2015 Severe RSV-LRTI (N = 73) |
||||
---|---|---|---|---|---|---|
Symptom | n | % (95% CI) | n | % (95% CI) | n | % (95% CI) |
Cougha | 243 | 100 (98.5–100) | 226 | 100 (98.4–100) | 73 | 100 (95.1–100) |
Blocked nosea | 214 | 88.1 (83.3–91.9) | 199 | 88.1 (83.1–92.0) | 62 | 84.9 (74.6–92.2) |
Runny nosea | 224 | 92.2 (88.1–95.2) | 211 | 93.4 (89.3–96.2) | 68 | 93.2 (84.7–97.7) |
Wheezing | 187 | 77.0 (71.1–82.1) | 182 | 80.5 (74.8–85.5) | 63 | 86.3 (76.2–93.2) |
Stridor | 21 | 8.6 (5.4–12.9) | 19 | 8.4 (5.1–12.8) | 9 | 12.3 (5.8–22.1) |
Flare of the nostrils | 24 | 9.9 (6.4–14.3) | 22 | 9.7 (6.2–14.4) | 16 | 21.9 (13.1–33.1) |
Irritability/agitation | 72 | 29.6 (24.0–35.8) | 66 | 29.2 (23.4–35.6) | 30 | 41.1 (29.7–53.2) |
Lethargy/sleepiness | 17 | 7.0 (4.1–11.0) | 14 | 6.2 (3.4–10.2) | 8 | 11.0 (4.9–20.5) |
Any chest indrawing | 56 | 23.0 (17.9–28.9) | 57 | 25.2 (19.7–31.4) | 57 | 78.1 (66.9–86.9) |
Reduced/no vocalization | 42 | 17.3 (12.7–22.6) | 45 | 19.9 (14.9–25.7) | 18 | 24.7 (15.3–36.1) |
Any apneaa | 3 | 1.2 (0.3–3.6) | 7 | 3.1 (1.3–6.3) | 4 | 5.5 (1.5–13.4) |
Cyanosisa | 3 | 1.2 (0.3–3.6) | 2 | 0.9 (0.1–3.2) | 1 | 1.4 (0.0–7.4) |
Stop feeding well | 68 | 28.0 (22.4–34.1) | 68 | 30.1 (24.2–36.5) | 27 | 37.0 (26.0–49.1) |
Dehydration | 7 | 2.9 (1.2–5.8) | 5 | 2.2 (0.7–5.1) | 3 | 4.1 (0.9–11.5) |
Fever (temperature >37.5°C) | 62 | 25.5 (20.2–31.5) | 63 | 27.9 (22.1–34.2) | 24 | 32.9 (22.3–44.9) |
Vomitinga | 93 | 38.3 (32.1–44.7) | 84 | 37.2 (30.9–43.8) | 32 | 43.8 (32.2–55.9) |
Diarrheaa | 68 | 28.0 (22.4–34.1) | 71 | 31.4 (25.4–37.9) | 28 | 38.4 (27.2–50.5) |
Abbreviations: CI, confidence interval; LRTI, lower respiratory tract infection; n (%), number (percentage) of cases with each symptom; N, total number of cases according to each definition; RSV, respiratory syncytial virus; WHO, World Health Organization.
Notes:
aSymptoms reported during the interview or on the diary card were also included. All suspected LRTI cases (new or worsened) were included in this analysis.
The frequency of tachypnea and low SpO2 rates was also assessed. Among WHO 2015 RSV-LRTI episodes, data were available for 226; 1 episode (occurring in a 0–2 month-old child in Argentina) had not met LRTI criteria when the RSV-positive swab was collected (but met them later) and was therefore excluded from this analysis. Tachypnea was observed in most episodes (Figure 1). Overall, the RR was increased above the age-specific threshold for 196 of 226 (86.7%) WHO 2015 RSV-LRTI cases. For physician-diagnosed LRTI, a RR above the age-specific threshold was observed for 168 of 243 (69.1%) cases.
Low SpO2 was not frequently identified in cases of WHO 2015 RSV-LRTI (Figure 2). SpO2 <95% was recorded for only 55 of 226 (24.3%) WHO RSV-LRTI cases and 40 of 243 (16.5%) physician-diagnosed LRTIs, while SpO2 <93% was recorded for 23 (10.2%) and 18 (7.4%) cases, respectively. Among the WHO 2015 severe RSV-LRTI cases, SpO2 was <95% in 38.4% of episodes and <93% in 31.5% of episodes. Overall and within each age group, SpO2 varied widely for severe RSV-LRTI episodes, ranging from 62% to 99% overall (0–2 months: 62–99%, 2–11 months: 80–99%, 12–23 months: 91–99%).
DISCUSSION
Multiple interventions for the prevention of RSV infection in infants are in the late stages of clinical development [23, 24]. Consistent, validated, and simple definitions for reporting outcomes in RSV disease are critical as new methods of RSV disease prevention become available. This study is the first to assess the performance of several known case definitions in comparison to the WHO 2015 clinical case definition based on data obtained in a prospective longitudinal multicenter international study using PCR-based RSV detection and data collected across diverse geographic and economic settings.
Each of the explored 3 alternative case definitions was almost perfectly concordant with the WHO 2015 definition in identifying RSV-LRTI of any severity, undoubtedly reflecting the similarity between criteria used (SpO2 and tachypnea) across case definitions. Allowing runny or blocked nose as an alternative for history of cough in the criteria did not impact the detection of cases, as shown by the high agreement between the WHO 2015 and protocol definitions. The lowest concordance was observed for the Nokes definition, decreasing further when the analysis was repeated on RSV-positive cases only.
By contrast with cases of any severity, concordance between the WHO 2015 and the alternative case definitions was not high when comparing cases of severe RSV-LRTIs. This finding is important, as severe RSV-LRTI is often used as an endpoint in clinical trials. However, this was somewhat expected considering the higher variability of the criteria used to define severe disease across the different definitions, in particular the varying thresholds for SpO2 (<93% versus <92% vs. <90%). The protocol definition also included symptoms that were previously identified as clinical predictors for severe RSV requiring hospitalization, such as apnea [25, 26]. The Nokes definition showed the highest agreement with the WHO 2015 definition of severe RSV-LRTI. For the exploratory definition, lower chest wall indrawing was a criterion for RSV-LRTI but not of severe cases. Of note, lower chest wall indrawing is included in the WHO 2015 definition of severe RSV-LRTI for clinical trials [12]. However, in 2014 the WHO revised the 2005 pneumonia definitions to exclude it as a severity indicator, based on evidence that chest indrawing could safely be managed at home with oral antibiotics [19]. In a previous study, lower chest wall indrawing was not a clinical predictor for critical RSV-LRTI episodes (ie, requiring oxygen via mask, continuous or bilevel positive airway pressure, or mechanical ventilation) [27].
The role of individual components of the definition was also evaluated for the WHO 2015 case definition. Tachypnea was observed in most severe and nonsevere episodes. In contrast, most physician-diagnosed LRTI cases did not have tachypnea. Case definitions for LRTI rely on the RR criterion, which can raise challenges in a clinical setting, especially during the first few months of life. RRs can be influenced by many factors: ambient conditions, agitation, presence of fever, whether the child is awake or sleeping, body weight, or gender [28, 29]. Currently used methods are known to provide imprecise values [30]. In addition, in hospital settings there are various approaches to measure RR [31]; automatic methods and clinical observations may be more often employed in higher-resource settings while manual devices are used in low-resource settings (timers, counters), leading to potential differences in the accuracy of RR measurements.
Low SpO2 was not frequently identified in RSV-LRTI episodes. Importantly, there was a large overlap between the number of cases with the same SpO2 identified with the WHO 2015 case definitions and physician-diagnosed LRTI. Therefore, we could not identify a clear threshold for hypoxemia to suggest an improved definition of RSV-LRTIs or severe RSV-LRTIs in future interventional trials. In a previous study, SpO2 ≤90% at hospital admission was associated with an increased risk of critical LRTI due to RSV, although it was a nonspecific indicator when considered on its own (in the absence of other predictive clinical symptoms) [27]. The accuracy of SpO2 measurements has been shown to vary with race [32] and the SpO2 range, especially at values <90% [33]. For the same individual, values measured when lying at rest and sitting [34] or at different anxiety levels [35] may differ significantly. In addition, natural fluctuations in SpO2 occur over time [36]; therefore, using a single measurement in this study may have impacted our findings and led to lower numbers of cases with SpO2 <95%. Longitudinal or continuous SpO2 measurements might offer further insight into illness severity beyond a single measurement.
The use of SpO2 to clinically assess disease severity or to differentiate between severe and nonsevere LRTI has been debated and explored over recent decades. The WHO proposes thresholds of 93% for severe RSV-LRTI and 90% for very severe RSV-LRTI [12]. The American Academy of Pediatrics guidelines mention a cutoff of 90% for oxygen supplementation in bronchiolitis [14], while the United Kingdom NICE recommendations state that cases with SpO2 <92% should be referred for hospital emergency care [16]. However, a study assessing different hypoxemic targets in infants indicated no differences in the safety and clinical effectiveness for SpO2 targets of 90% and 94% in bronchiolitis management [15]. All guidelines recommend caution, highlighting the possibility of errors if relying on a single measurement or inappropriate instruments. Finally, standardized definitions for RSV illness severity should incorporate provisions for individuals with low baseline SpO2 measurements. Despite these potential issues, SpO2 for assessing disease severity is an objective measure that can be readily obtained in diverse clinical settings.
To date, a variety of LRTI case definitions are used as outcome measures for recent or ongoing clinical trials of preventive or treatment interventions against RSV (such as vaccines or monoclonal antibodies), which can lead to difficulty in comparing estimated vaccine or treatment efficacy. For instance, in a phase 3 trial evaluating the prevention of RSV-specific medically significant LRTI in infants whose mothers were vaccinated with a RSV-F-nanoparticle vaccine, evidence of medical significance was defined by the presence of hypoxemia (SpO2 <95% at sea level or <92% at an altitude of >1800 m) or tachypnea (≥70 breaths per minute at <60 days of age and ≥60 breaths per minute at ≥60 days of age) [37]. Other ongoing clinical trials are using different endpoints to assess vaccine efficacy, such as RSV-medically attended acute respiratory illness (NCT04520659), medically attended LRTI (NCT04424316), or medically assessed, RSV-associated LRTI (NCT04605159). These differences mean that vaccine efficacy estimates from these trials cannot be directly compared. For example, when considering tachypnea alone, over half of the RSV-LRTI cases identified in this analysis through the WHO 2015 case definition would not meet the case definition in the phase 3 trial for the maternal nanoparticle RSV-F vaccine. In the current study, we found that only 16.4% of severe RSV-LRTI episodes required hospitalization, varying largely by country [17], suggesting that hospitalization is also not a consistent indicator of RSV-LRTI severity. These observations underscore the need for a standardized case definition to support vaccine evaluation and decision-making related to new and evolving RSV prevention strategies.
As noted, our results do not provide insight to determine an optimal SpO2 threshold for severe RSV-LRTI. However, as SpO2 measurements varied widely among WHO 2015 severe RSV-LRTI cases, the results suggest that phase 4 studies conducted in settings with limited resources, where SpO2 is not readily available, could consider a case definition that omits SpO2 and relies on other indicators of severity. However, further investigation is needed as this study did not collect repeated SpO2 measurements.
This prospective, international study is one of the largest to date allowing comparison of case definitions with data collected through consistent methods across multi-national populations. However, the study has several limitations. The countries in this study may not be representative or generalizable globally. Despite efforts to standardize activities across all sites, there could still be potential differences in case ascertainment and follow-up and in site-specific return visit rates, which are necessary for staff to complete evaluations for suspected LRTIs. In addition, concordance between case definitions was not evaluated by economic setting (ie, LMICs vs. HICs) in post hoc analyses, due to an insufficient number of episodes in HICs. Of note, this study was designed only to investigate the agreement of alternative definitions with the WHO 2015 definition, and no analyses or modeling were conducted to validate a clinical RSV-LRTI case definition.
CONCLUSION
Three alternative clinical RSV-LRTI case definitions showed excellent concordance with the WHO 2015 definition, but agreement was lower for severe RSV-LRTI. Fewer cases with increased RR were identified for physician-diagnosed LRTI than for WHO 2015 RSV-LRTI episodes; both definitions led to a similar, relatively low number of RSV-LRTI cases with low SpO2, even in severe cases. In contrast to increased RR, low SpO2 was not a consistent finding in RSV-LRTIs and severe RSV-LRTIs and did not appear concordant with other definition elements. Including more components might identify more RSV-LRTI cases. This study demonstrates that existing definitions are highly concordant for RSV-LRTI cases, but there is still a need to establish a standard definition of severe RSV-LRTI.
Supplementary Material
Acknowledgments
The authors thank all participants and their families, study nurses, coordinators, and study investigators. The authors are grateful to Satu Kokko and Miia Virta (University of Tampere Oulu Vaccine Research Clinic, Oulu, Finland), Outi Laajalahti (Seinäjoki Unit, Tampere University, Finland), Paulina Paavola (University of Tampere Kokkola Vaccine Research Clinic, Kokkola, Finland), Delmy Mejía, Mayra Moreno, and Mauricio Pinto (DEMEDICA, San Pedro Sula, Honduras), Anthony Pruitt (Wee Care Pediatrics, Roy, Utah, United States), Susana Rolse (Vaccines and Infectious Diseases Analytics Research Unit of the University of the Witwatersrand, Johannesburg, South Africa), Ulises D’Andrea (Instituto Médico Río Cuarto, Córdoba, Argentina), Sarah Steele and Hanna Schlaack (Seattle Children’s Hospital, Seattle, WA, United States), Pamela MacIntyre and Gina Dickie (Canadian Center for Vaccinology, Halifax, Canada), Antonio Gonzalez-Lopez, and Meng Shi (previously employed by GSK), Melanie Moreno (Syneos c/o GSK), Andreea Mahalean and Laura Maria Scurtu (Modis c/o GSK), Myriam Acosta, Thi Lien-Anh Nguyen, Jenifer Bolognese, Jo Ann Colas, Melanie Hercor, Magali de Heusch, Koen Maleux, Valérie Vantomme, and Huajun Wang (GSK) for their contributions to the study. The authors would also like to thank Modis c/o GSK for medical writing and design support (Petronela M. Petrar) and manuscript coordination.
Financial support. This work was supported by GlaxoSmithKline Biologicals SA. GlaxoSmithKline Biologicals SA covered all costs associated with the development and publishing of the present manuscript.
Potential conflicts of interest. R. A. C., V. B., S. G., O. G., M. S., and I. D. are GSK employees. G. H., A. L., and S. K. S. were GSK employees at the time the study was conducted. S. G., O. G., and S. K. S. have received personal fees and R. A. C. and I. D. have received other compensation from GSK, outside the submitted work. R. A. C., S. G., A. L., S. K. S., and I. D. hold shares in GSK. J. A. E., J. B. D., J. M. L., S. A. M., A. C., N. P. K., T. P., and T. V. have received research grants from GSK during the conduct of the study. J. A. E. has received grants from MedImmune (now AstraZeneca), Pfizer, Merck, and Novavax, and personal fees from Sanofi Pasteur, AstraZeneca, Meissa Vaccines, Pfizer, and Moderna, outside the submitted work. J. B. D. has also received research grants from MedImmune (now AstraZeneca), Pfizer, Novavax, and Diassess, outside the submitted work. J. M. L. also reports other compensation from Immunovaccine, grants from Novavax, Janssen, and Regeneron, outside the submitted work; in all cases these are paid to Dalhousie University. J. M. L. holds the Canadian Institutes of Health Research-GSK Chair in Pediatric Vaccinology at Dalhousie University. S. A. M. has received institution grants and personal fees from BMGF and GSK, and institution grants from Pfizer, Novavax, AstraZeneca, and Minervax. N. P. K. has received research grants from Pfizer, Sanofi Pasteur, Merck, GSK, and Protein Science (now Sanofi), outside the submitted work. T. V. has received research grants from VBI Vaccines and Janssen. K. Z., A. B., L. C. , L. J., A. K., P. S., A. T., and J. T.: No conflict.
Contributor Information
Janet A Englund, Seattle Children’s Research Institute/University of Washington, Seattle, Washington, USA.
Rachel A Cohen, GSK, Rockville, Maryland, USA.
Veronique Bianco, GSK, Rockville, Maryland, USA.
Joseph B Domachowske, Department of Pediatrics, SUNY Upstate Medical University, Syracuse, New York, USA.
Joanne M Langley, Canadian Center for Vaccinology (Dalhousie University, IWK Health and Nova Scotia Health), Halifax, Nova Scotia, Canada.
Shabir A Madhi, South African Medical Research Council Vaccines and Infectious Diseases Analytics Research Unit, University of the Witwatersrand, Johannesburg, South Africa.
Khalequ Zaman, International Centre for Diarrheal Disease, Dhaka, Bangladesh.
Agustin Bueso, DEMEDICA, San Pedro Sula, Honduras.
Ana Ceballos, Instituto Médico Río Cuarto, Río Cuarto, Córdoba, Argentina.
Luis Cousin, DEMEDICA, San Pedro Sula, Honduras.
Sanjay Gandhi, GSK, Mumbai, India.
Olivier Gruselle, GSK, Wavre, Belgium.
Lisa Jose, South African Medical Research Council Vaccines and Infectious Diseases Analytics Research Unit, University of the Witwatersrand, Johannesburg, South Africa.
Nicola P Klein, Kaiser Permanente Vaccine Study Center, Oakland, California, USA.
Anthonet Koen, South African Medical Research Council Vaccines and Infectious Diseases Analytics Research Unit, University of the Witwatersrand, Johannesburg, South Africa.
Thanyawee Puthanakit, Center of Excellence for Pediatric Infectious Diseases and Vaccines, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.
Meng Shi, GSK, Rockville, Maryland, USA.
Peter Silas, Wee Care Pediatrics, Syracuse, Utah, USA.
Auchara Tangsathapornpong, Faculty of Medicine, Thammasat University, Pathum Thani, Thailand.
Jamaree Teeratakulpisarn, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand.
Timo Vesikari, Nordic Research Network Oy, Tampere, Finland.
Gerco Haars, GSK, Wavre, Belgium.
Amanda Leach, GSK, Rockville, Maryland, USA.
Sonia K Stoszek, GSK, Rockville, Maryland, USA.
Ilse Dieussaert, GSK, Wavre, Belgium.
References
- 1. GBD 2017 Causes of Death Collaborators. Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018; 392:1736–88. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. World Health Organization. The Global Health Obsevatory: Causes of child death. Accessed 21 July 2021. http://www.who.int/data/gho/data/themes/topics/indicator-groups/indicator-group-details/GHO/causes-of-child-death.
- 3. Shi T, McAllister DA, O’Brien KL, et al. Global, regional, and national disease burden estimates of acute lower respiratory infections due to respiratory syncytial virus in young children in 2015: a systematic review and modelling study. Lancet 2017; 390:946–58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Stein RT, Bont LJ, Zar H, et al. Respiratory syncytial virus hospitalization and mortality: Systematic review and meta-analysis. Pediatr Pulmonol 2017; 52:556–69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Li Y, Wang X, Blau DM, et al. Global, regional, and national disease burden estimates of acute lower respiratory infections due to respiratory syncytial virus in children younger than 5 years in 2019: a systematic analysis. Lancet 2022; 399:2047–64. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Caballero MT, Bianchi AM, Grigaites SD, et al. Community mortality due to respiratory syncytial virus in Argentina: population-based surveillance study. Clin Infect Dis 2021; 73:S210–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Kazi AM, Aguolu OG, Mughis W, et al. Respiratory syncytial virus-associated mortality among young infants in Karachi, Pakistan: a prospective postmortem surveillance study. Clin Infect Dis 2021; 73:S203–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Satav A, Crow R, Potdar V, et al. The burden of respiratory syncytial virus in children under 2 years of age in a rural community in Maharashtra, India. Clin Infect Dis 2021; 73:S238–47. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Simões EAF, Dani V, Potdar V, et al. Mortality from respiratory syncytial virus in children under 2 years of age: a prospective community cohort study in rural Maharashtra, India. Clin Infect Dis 2021; 73:S193–202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Srikantiah P, Vora P, Klugman KP.. Assessing the full burden of respiratory syncytial virus in young infants in low- and middle-income countries: the importance of community mortality studies. Clin Infect Dis 2021; 73:S177–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Mazur NI, Löwensteyn YN, Willemsen JE, et al. Global respiratory syncytial virus-related infant community deaths. Clin Infect Dis 2021; 73:S229–37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Modjarrad K, Giersing B, Kaslow DC, Smith PG, Moorthy VS; WHO RSV Vaccine Consultation Expert Group. WHO consultation on respiratory syncytial virus vaccine development report from a World Health Organization meeting held on 23–24 March 2015. Vaccine 2016; 34:190–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. World Health Organization. Handbook: IMCI integrated management of childhood illness. Accessed 11 October 2021.http://apps.who.int/iris/handle/10665/42939.
- 14. American Academy of Pediatrics, Subcommittee on Diagnosis and Management of Bronchiolitis. Diagnosis and management of bronchiolitis. Pediatrics 2006; 118:1774–93. [DOI] [PubMed] [Google Scholar]
- 15. Cunningham S, Rodriguez A, Adams T, et al. Oxygen saturation targets in infants with bronchiolitis (BIDS): a double-blind, randomised, equivalence trial. Lancet 2015; 386:1041–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. National Institute for Health and Care Excellence (NICE). Bronchiolitis in children: diagnosis and management. Published: 01 June 2015. Last updated 09 August 2021. Accessed 09 March 2023.https://www.nice.org.uk/guidance/ng9/chapter/1-Recommendations#when-to-refer.
- 17. Langley JM, Bianco V, Domachowske JB, et al. Incidence of respiratory syncytial virus lower respiratory tract infections during the first 2 years of life: a prospective study across diverse global settings. J Infect Dis 2022; 226:374–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Nokes DJ, Okiro EA, Ngama M, et al. Respiratory syncytial virus infection and disease in infants and young children observed from birth in Kilifi District, Kenya. Clin Infect Dis 2008; 46:50–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. World Health Organization. Revised WHO classification and treatment of childhood pneumonia at health facilities. Evidence summary. Accessed 11 October 2021.http://apps.who.int/iris/bitstream/handle/10665/137319/9789241507813_eng.pdf.
- 20. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960; 20:37–46. [Google Scholar]
- 21. Cohen J. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull 1968; 70:213–20. [DOI] [PubMed] [Google Scholar]
- 22. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 2012; 22:276–82. [PMC free article] [PubMed] [Google Scholar]
- 23. PATH. RSV vaccine and mAb snapshot. Accessed 28 September 2021.http://www.path.org/resources/rsv-vaccine-and-mab-snapshot/.
- 24. Giersing BK, Karron RA, Vekemans J, Kaslow DC, Moorthy VS.. Meeting report: WHO consultation on respiratory syncytial virus (RSV) vaccine development, Geneva, 25–26 April 2016. Vaccine 2019; 37:7355–62. [DOI] [PubMed] [Google Scholar]
- 25. Hirve S, Crawford N, Palekar R, Zhang W; WHO RSV surveillance Group. Clinical characteristics, predictors, and performance of case definition-Interim results from the WHO global respiratory syncytial virus surveillance pilot. Influenza Other Respir Viruses 2020; 14:647–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Lalani K, Yildirim I, Phadke VK, Bednarczyk RA, Omer SB.. Assessment and validation of syndromic case definitions for respiratory syncytial virus infections in young infants: a latent class analysis. Pediatr Infect Dis J 2019; 38:1177–82. [DOI] [PubMed] [Google Scholar]
- 27. Atwell JE, Geoghegan S, Karron RA, Polack FP.. Clinical predictors of critical lower respiratory tract illness due to respiratory syncytial virus in infants and children: data to inform case definitions for efficacy trials. J Infect Dis 2016; 214:1712–6. [DOI] [PubMed] [Google Scholar]
- 28. Gagliardi L, Rusconi F.. Respiratory rate and body mass in the first three years of life. The working party on respiratory rate. Arch Dis Child 1997; 76:151–4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Shah SN, Bachur RG, Simel DL, Neuman MI.. Does this child have pneumonia? The rational clinical examination systematic review. JAMA 2017; 318:462–71. [DOI] [PubMed] [Google Scholar]
- 30. Drummond GB, Fischer D, Arvind DK.. Current clinical methods of measurement of respiratory rate give imprecise values. ERJ Open Res 2020; 6:00023–2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Ginsburg AS, Lenahan JL, Izadnegahdar R, Ansermino JM.. A systematic review of tools to measure respiratory rate in order to identify childhood pneumonia. Am J Respir Crit Care Med 2018; 197:1116–27. [DOI] [PubMed] [Google Scholar]
- 32. Sjoding MW, Dickson RP, Iwashyna TJ, Gay SE, Valley TS.. Racial bias in pulse oximetry measurement. N Engl J Med 2020; 383:2477–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Ross PA, Newth CJ, Khemani RG.. Accuracy of pulse oximetry in children. Pediatrics 2014; 133:22–9. [DOI] [PubMed] [Google Scholar]
- 34. Ceylan B, Khorshid L, Güneş Ü Y, Zaybak A.. Evaluation of oxygen saturation values in different body positions in healthy individuals. J Clin Nurs 2016; 25:1095–100. [DOI] [PubMed] [Google Scholar]
- 35. Arda KN, Akay S, Yetkin S.. Is there a relationship between oxygen saturation and MRI-induced anxiety? A prospective study. Clin Imaging 2020; 60:147–52. [DOI] [PubMed] [Google Scholar]
- 36. Bhogal AS, Mani AR.. Pattern analysis of oxygen saturation variability in healthy individuals: entropy of pulse oximetry signals carries information about mean oxygen saturation. Front Physiol 2017; 8:555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Madhi SA, Polack FP, Piedra PA, et al. Respiratory syncytial virus vaccination during pregnancy and effects in infants. N Engl J Med 2020; 383:426–39. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.