Skip to main content
eBioMedicine logoLink to eBioMedicine
. 2023 Aug 9;95:104745. doi: 10.1016/j.ebiom.2023.104745

Reconstructing the impact of COVID-19 on the immunity gap and transmission of respiratory syncytial virus in Lombardy, Italy

Hadrian Jules Ang a, Francesco Menegale b,c, Giuseppe Preziosi d, Elena Pariani e, Maurizio Migliari f, Laura Pellegrinelli e, Giuseppe Maria Sechi f, Sabrina Buoro g, Stefano Merler b, Danilo Cereda g, Marcello Tirani g,h,i, Piero Poletti b,i,∗∗, Ilaria Dorigatti a,i,
PMCID: PMC10432612  PMID: 37566927

Summary

Background

Respiratory syncytial virus (RSV) is a leading cause of hospitalisation and mortality in young children globally. The social distancing measures implemented against COVID-19 in Lombardy (Italy) disrupted the typically seasonal RSV circulation during 2019–2021 and caused substantially more hospitalisations during 2021–2022. The primary aim of this study is to quantify the immunity gap-defined as the increased proportion of the population naïve to RSV infection following the relaxation of COVID-19 restrictions in Lombardy, which has been hypothesised to be a potential cause of the increased RSV burden in 2021–2022.

Methods

We developed a catalytic model to reconstruct changes in the age-dependent susceptibility profile of the Lombardy population throughout the COVID-19 pandemic. The model is calibrated to routinely collected hospitalisation, syndromic, and virological surveillance data and tested for alternative assumptions on age-dependencies in the risk of RSV infection throughout the pandemic.

Findings

We estimate that the proportion of the Lombardy population naïve to RSV infection increased by 60.8% (95% CrI: 55.2–65.4%) during the COVID-19 pandemic: from 1.4% (95% CrI: 1.3–1.6%) in 2018–2019 to 2.3% (95% CrI: 2.2–2.5%) before the 2021–2022 season, corresponding to an immunity gap of 0.87% (95% CrI: 0.87–0.88%). We found evidence of heterogeneity in RSV transmission by age, suggesting that the COVID-19 restrictions had variable impact on the contact patterns and risk of RSV infection across ages.

Interpretation

We estimate a substantial increase in the population-level susceptibility to RSV in Lombardy during 2019–2021, which contributed to an increase in primary RSV infections in 2021–2022.

Funding

UK Medical Research Council (MRC), UK Foreign, Commonwealth & Development Office (FCDO), EDCTP2 programme, European Union, Wellcome Trust, Royal Society, EU-MUR PNRR INF-ACT.

Keywords: RSV, Mathematical modelling, Catalytic models, Immunity gap, COVID-19 restrictions


Research in context.

Evidence before this study

We searched Medline using Ovid for all studies published up to 2 February 2023 with the query “(respiratory syncytial virus∗ OR RSV∗) AND (COVID∗ OR SARS-CoV-2∗)” and included the relevant subject headers “Respiratory Syncytial Viruses” and “COVID-19”. We found six studies employing dynamical or regression models projecting forward the expected impact of the easing of COVID-19 related non-pharmaceutical interventions (NPIs) on RSV cases or hospitalisations in the USA, South Africa, UK, Norway, and Japan. Changes in RSV circulation caused by the NPIs implemented to counter SARS-CoV-2 spread is hypothesised to be a key driver of observed changes in RSV burden.

Added value of this study

We analysed RSV surveillance data collated in Lombardy (Italy) throughout the COVID-19 pandemic, which adds to the growing list of geographical regions that have experienced an atypical RSV resurgence following the relaxation of COVID-19 restrictions. In this work we quantify the increase in population-level susceptibility to primary RSV infection from age-stratified disease surveillance and hospitalisation data. We also estimate age-dependencies in the risk of RSV infection, highlighting the variable impact that NPIs implemented against COVID-19 had on RSV transmission.

Implications of all the available evidence

Our findings contribute to better understanding age-dependencies in RSV transmission and susceptibility, and the effects that COVID-19 restrictions have had on other respiratory viruses such as RSV. The developed approach could be applied to different streams of surveillance data to estimate changes in the susceptibility profile of the population to other infectious diseases, which has implications for public health planning.

Introduction

Respiratory syncytial virus (RSV) is a leading cause of acute lower respiratory infection (ALRI) in young children, which in severe cases can lead to hospitalisation and death.1, 2, 3 In 2019 alone, there were around 33 million RSV-associated ALRI episodes worldwide leading to around 100,000 deaths among children 0–5 years of age.1 Older adults are also vulnerable to severe disease due to RSV, which caused around 336,000 hospitalisations and 14,000 in-hospital deaths globally in 2015.4

RSV is transmitted through direct or indirect contact with secretions from the respiratory tract of an infectious individual, such as through large droplets or contaminated objects.2,5,6 Most children in their first months of life are protected against RSV infection by the passive transfer of maternal-specific antibodies, but titre levels vary across individuals.2,5 As antibody levels wane, infants become vulnerable to disease even if antibodies are still detectable.2,5,7

Infection provides short-term, partial immunity against reinfection,8 and long-term partial reduction in susceptibility to further post-primary infections.9,10 While symptoms among healthy adults are usually mild, in young children and vulnerable populations (e.g., those who are immunocompromised, and individuals with other pre-existing cardiovascular or pulmonary conditions) infection can develop into bronchiolitis or pneumonia and result in severe disease outcomes.5

While in tropical regions RSV seasonality is less well-defined,10 in temperate regions, such as Italy, RSV transmission is seasonal, starting in autumn and ending in spring.11,12 The emergence of the coronavirus disease 2019 (COVID-19) pandemic prompted the introduction of non-pharmaceutical interventions (NPIs).13 A retrospective analysis of the Italian response to the pandemic found that NPIs were successful in reducing SARS-CoV-2 transmission by significantly decreasing the number of social contacts.14 COVID-19 vaccination allowed a relaxation of restrictions and the progressive resumption of pre-pandemic social contacts.15 However, NPIs had significant effects on the transmission of several other respiratory viruses beyond SARS-CoV-2,13 including RSV.16

Modelling studies showed that large reductions in RSV transmission stemming from the implementation of NPIs would lead to an accumulation of susceptible individuals, resulting in large out-of-season RSV outbreaks when restrictions were relaxed.17, 18, 19, 20, 21, 22, 23 This predicted outcome was realised in Australia, Finland, Japan, and the UK, which experienced marked decreases in RSV case detection compared to previous winter seasons during the 2020–2021 season, followed by larger and/or earlier peaks in transmission in 2021–2022 when anti-COVID-19 measures were progressively relaxed.24, 25, 26, 27

Data from Lombardy in Northern Italy shows that RSV circulation followed a similar pattern, with a larger and earlier peak in hospitalisations in 2021–2022 experienced after extremely low levels of transmission in 2020–2021.28 It has been hypothesised that a gap in immunity caused by the implementation of NPIs played a key role in shaping the atypical 2021–2022 season,26,29 which is supported by the decreased levels of RSV antibody titres observed in Canada and the Netherlands.30,31

In this study, we use catalytic models applied to routinely collected hospitalisation discharge records, and epidemiological and virological surveillance data to investigate heterogeneities in RSV epidemiology and the impact of COVID-19 restrictions on the transmission intensity of RSV. Similar to proportional hazard models, catalytic models describe how the risk of an event per time unit changes over time, accounting for the expected duration of the time to event. Specifically, catalytic epidemic models can be used to estimate the accumulation of immunity from the age distribution of observed cases, by defining the force of infection (FOI) experienced at a given age a, the probability of remaining susceptible in the interval 0 to a−1, and the probability of acquiring infection at age a.32, 33, 34 By reconstructing the susceptibility profile of the population throughout the COVID-19 pandemic, we infer the extent to which changes in susceptibility and transmission explain the observed infection and hospitalisation patterns during the last four RSV seasons in Lombardy region.

Methods

Data

We analyse surveillance and hospitalisation data from 2018 to 2022. The 2019–2020 season was only partially affected by the NPIs implemented against COVID-19, which was first detected in Lombardy in February 2020.13 In contrast, the 2020–2021 season was characterised by restrictions imposed to counter the second COVID-19 wave in Italy and the emergence of the SARS-CoV-2 Alpha variant in early 2021.13,35 After the rollout of the national vaccination program against COVID-19, social distancing measures were progressively relaxed from the second half of 2021 onwards.13

We use age-stratified aggregated time-series of syndromic and virological surveillance data from the Italian influenza surveillance network (InfluNet),36 and aggregated hospital discharge data from Lombardy (∼10 M inhabitants)37 region provided by Regione Lombardia.28 InfluNet is a sentinel network of general practitioners (GPs) and paediatricians monitoring 2–4% of the approximately 10 million resident population of Lombardy and reporting weekly numbers of outpatients seeking care for influenza-like illness (ILI) along with the number of cases tested for respiratory viruses including RSV.36

The typical surveillance season spans weeks 46–17 of successive years. During the 2020–2021 season, surveillance was extended to include weeks 31–45 of 2021.36 The ILI and virological data are collected for four age-groups: 0–4, 5–14, 15–64, and 65+ years. The InfluNet data were used to estimate the number of RSV-attributable ILI cases per age-group and season, by multiplying the age-specific ILI incidence, the seasonal RSV test positivity rate, and the size of the Lombardy population37 [see the Supplementary Information (SI) and Pellegrinelli et al.11 for details].

These data were complemented with records provided by the official authorities at Regione Lombardia on the number of weekly hospital discharges due to RSV,28 made available for age-groups 0–6 months, 7–12 months, yearly age-groups up to age 80, and an aggregated group for individuals 81+ years.

Catalytic model

We use a catalytic modelling approach38,39 to reconstruct the susceptibility profile of the Lombardy population to RSV primary infection and estimate the RSV FOI, λ(a,y), which is defined as the per-capita rate at which individuals of age a who had never experienced the infection in the past are infected in season y. We explore two scenarios, one accounting for maternally derived immunity (MDI) against infection, which we assumed to last for four months following birth40 (μ=1), and one with no MDI (μ=0). In the model, the probability of primary infection for a subject aged 0–12 months (a=0) in season y is given by

P0y,1=(1eλ(0,y))(1μ/3) (1)

Denoting P¯0y,1=1P0y,1 the probability of escaping primary infection at age a=0 in season y, the probability of primary infection for an individual of age a1 in season y is given by

Pay,1=P¯0ya,1(ei=1a1λ(i,ya+i))(1eλ(a,y)) (2)

where P¯0ya,1(ei=1a1λ(i,ya+i)) denotes the probability of escaping infection up to season y and (1eλ(a,y)) represents the probability of infection in season y (see SI for details). Similarly, the probability of post-primary RSV infection by an individual of age a1 in season y is defined by

Pay,2=(1P¯0(ya),1(ei=1a1λ(i,ya+i)))(1esλ(a,y)) (3)

where parameter s= 0.7710 reflects the reduced susceptibility of individuals who have already experienced a first RSV infection.9,10 We computed the probability of RSV infection as the sum of the probabilities of primary and post-primary infection. For each season, we derived the expected number of RSV infections reporting ILI symptoms and the expected number of RSV hospitalisations, by estimating age-specific ascertainment and hospitalisation rates from surveillance data. The RSV test positivity ratio across different age-groups was also estimated making use of available virological records. We assumed that the probabilities of hospitalisation (ρHosp) and of reporting to surveillance given an RSV infection (ρSurv), and the test positive ratio (ρV) could all vary across age-groups but remained fixed throughout the considered seasons.

At the start of each season y, the initial epidemiological conditions can be quantified in terms of the proportion of individuals age a who have previously had RSV:

δa,yBEFORE=(1P¯0(ya),1(ei=1a1λ(i,ya+i))) (4)

and the overall proportion of the population naïve to RSV:

NaiveyBEFORE=1aδa,yBEFORE×NayaNay (5)

where Nay is the population size at age a in season y. The immunity gap (Δy) in any given season y can be computed as the difference in proportion of the RSV naïve population in that season compared to the pre-pandemic season, 2018–2019.

Δy=NaiveyBEFORENaive20182019BEFORE (6)

We explored potential heterogeneities in exposure to the infection experienced by individuals at different ages and across seasons by estimating age-specific FOI values

λ(a,y)={λyC,a4λyY,4<a14λyA,a>14 (7)

and testing 4 different model variants: (A) λyC=λyY=λyA; (B) (λyC=λyY)λyA; (C) λyC(λyY=λyA); (D) λyCλyYλyA (see Table 1 for details). In the model, λ(a,y) represents the FOI experienced by individuals with age a during the season y, which is assumed to be proportional to the cumulative number of RSV-attributable ILI cases identified during the season and an age- and season-specific per-capita transmission rate. We modelled the number of hospitalisations and RSV-attributable ILI cases with Poisson distributions, their age distributions with multinomial distributions, and the RSV testing data using a binomial distribution.

Table 1.

Model descriptions and deviance information criterion.

FOI assumption Description DIC
Model A λyC=λyY=λyA Age-constant and time-varying FOI. 18,165
Model B (λyC=λyY)λyA Age- and time-varying FOI, with the assumption that FOI among 5–14-year-olds is equal to the FOI for 0–4-year-olds. 15,139
Model C λyC(λyY=λyA) Age- and time-varying FOI, with the assumption that FOI among 5–14-year-olds is equal to the FOI for those 15-years-old and older. 8,195
Model D λyCλyYλyA Age- and time-varying FOI where the FOI across the three age-groups is allowed to freely vary. 6,088

95% exact binomial confidence intervals are shown for the RSV tests.

RSV, respiratory syncytial virus; ILI, influenza-like illness; CI, confidence interval.

DIC, deviance information criterion; FOI, force of infection.

Each model variant was calibrated to the observed seasonal hospital discharge and RSV-attributable ILI data using the Markov Chain Monte Carlo (MCMC) Bayesian inferential framework in Stan41 using the No-U-Turn Sampler (NUTS). For each model variant, four independent chains with randomised starting points were run for 20,000 iterations each, with 10,000 iterations used for warmup. The prior distributions were informed by published estimates8,42, 43, 44, 45, 46 (Supplementary Tables S1–S4). Model selection was conducted according to the deviance information criterion (DIC), a metric that is used for model selection by accounting for both the goodness of fit and the model complexity (in terms of the number of estimated parameters).47,48 We report the mean and 95% credible intervals (CrI) of the posterior distribution of the parameters. Model estimates of the immunity gap in the 2021–2022 and 2022–2023 seasons were computed. The estimate for 2022–2023 made use of 2020 mortality rates as obtained from the Italian National Institute of Statistics.49 A description of all model variables may be found in Supplementary Table S5.

Sensitivity analyses

Beyond testing the impact of assuming no MDI (μ=0), we explored how model estimates were affected by a hypothetical increase of 25% and 50% in the probability of reporting RSV (ρSurv) between 2019 and 2022, as a result of increased testing during the pandemic (Table 2).

Table 2.

Number of hospitalisations, RSV-attributable ILI cases, and RSV test positivity per season (total across all age-groups).

Season Hospital discharges RSV-attributable ILI cases Positive tests/Total tests (%, 95% CI)
2018–2019 2,288 195,590 41/213 (19.25, 14.18–25.19%)
2019–2020 1,944 70,512 48/631 (7.61, 5.66–9.96%)
2020–2021 53 0 0/448 (0.00, 0.00–0.82%)
2021–2022 2,745 152,831 202/1121 (18.02, 15.81–20.40%)

95% exact binomial confidence intervals are shown for the RSV tests.

RSV, respiratory syncytial virus; ILI, influenza-like illness; CI, confidence interval.

DIC, deviance information criterion; FOI, force of infection.

Moreover, although results of a cohort study in Kilifi, Kenya highlighted that potential differences in disease severity after first and subsequent infection events were not significant when controlling for age,8 we explored the potential effect of considering a reduced probability of hospitalisation for post-primary RSV infections.

Full details on the model equations, variants, parameter prior distributions, and sensitivity analyses are available in the SI Methods section.

Ethics

Ethical clearance and written informed consent were not required. The modelling study uses only aggregated counts and incidence records.

Role of the funding source

None of the study funders were involved in the study design, data analysis, or writing of the manuscript.

Results

Data analysis

While the number of hospitalisations caused by RSV remained stable during the 2018–2019 and 2019–2020 seasons, the impact of the NPIs implemented against COVID-19 (which started in February 2020)13 was already visible in the number of RSV-attributable ILI cases and RSV positivity rates recorded in the 2019–2020 season (Fig. 1b and c).13 As shown in Table 1, there were fewer RSV-attributable ILI cases in 2019–2020 compared to 2018–2019, despite the larger number of tests performed (631 tests in 2019–2020 compared to 213 in 2018–2019).

Fig. 1.

Fig. 1

Weekly RSV data from 2018–2019 to 2021–2022. Panels show: (a) hospital discharges, (b) average reconstructed RSV-attributable ILIs, and (c) RSV test positivity rates. RSV, respiratory syncytial virus; ILI, influenza-like illness.

No RSV-attributable ILI cases were recorded in 2020–2021, as all 448 tests performed during the season were negative. Moreover, there were only 53 hospitalisations, representing a 97.7% decrease from the 2,288 hospitalisations recorded in 2018–2019.

Fig. 1a shows that the 2021–2022 season was characterised by an atypical earlier and larger peak in hospitalisations compared to previous seasons. Interestingly, the larger number of hospitalisations was accompanied by fewer RSV-attributable ILI cases (152,831 in 2021–2022 versus 195,590 in 2018–2019 overall, of which 54,870 and 51,658 were in 0–4 year-olds, respectively) (Fig. 1b) despite similar test positivity rates overall (18.02% [95% CI: 15.81–20.40%] in 2021–2022 versus 19.25% [95% CI: 14.18–25.19%] in 2018–2019) and among 0–4 year olds (35.01% [95% CI: 30.54–39.69%] in 2021–2022 versus 39.62% [95% CI: 26.45–54.00%] in 2018–2019).

Model results

The model allowing the FOI to vary across the three age-groups (model D) was preferred according to the DIC (Table 2). Hereafter, we present the estimates obtained with model D and refer to it as the baseline model. Fig. 2 shows that the baseline model can reproduce the number and age-distribution of hospital discharges associated with RSV, the number and age-distribution of RSV-attributable ILI cases, and the RSV test positivity ratio per age-group. The model fit and parameter estimates of other model variants are presented in Supplementary Figure S1 and Supplementary Table S6, respectively.

Fig. 2.

Fig. 2

Summary of model fit to data. Observed and modelled (a) number of hospital discharges associated with RSV, (b) age-distribution of hospital discharges (age 0 refers to 0–6-month-olds and age 0.5 refers to 7–12-month-olds), (c) number of RSV-attributable ILI cases, (d) age-distribution of RSV-attributable ILI cases, and (e) RSV test positivity ratio. In all panels, error bars represent the 95% exact binomial CIs (where applicable) and the 95% CrIs for the model estimates. RSV, respiratory syncytial virus; ILI, influenza-like illness; CIs, confidence intervals; CrIs, credible intervals.

The parameter estimates show large reductions in the FOI across all age-groups in 2019–2020, the season when the COVID-19 pandemic emerged, followed by a nearly complete suppression of RSV transmission in 2020–2021, and a substantially larger FOI in 2021–2022, comparable in size to the pre-COVID season 2018–2019 (Fig. 3a). Among those 0–4 years, the FOI estimates in 2021–2022 are on average 0.28 (95% CrI: 0.20–0.37) higher than those in the pre-COVID season. While the FOI among those 0–4 years decreased from 2018–2019 to 2019–2020, our results suggest that in the same period the per-capita RSV transmission rate increased (from 0.58 [95% CrI: 0.49–0.66] × 100,000 season−1 to 0.83 [95% CrI: 0.73–0.92] × 100,000 season−1) (Fig. 3b). In contrast, the per-capita RSV transmission rate associated with individuals aged 5–14 years dropped from 0.10 (95% CrI: 0.07–0.13) × 100,000 season−1 in 2018–2019 to 0.04 (95% CrI: 0.03–0.05) × 100,000 season−1 in 2019–2020. A less evident reduction was found among those 15+ years: from 0.06 (95% CrI: 0.05–0.07) × 100,000 season−1 in 2018–2019 to 0.05 (95% CrI: 0.04–0.06) × 100,000 season−1 in 2019–2020.

Fig. 3.

Fig. 3

Model estimates. Estimated (a) FOI for the three age-groups 0–4, 5–14, and 15+ years, (b) per-capita RSV transmission rates, as estimated by dividing the FOI model estimates by the cumulative number of RSV-attributable ILI cases reported each season (y-axis on a log-scale); and probability of (c) hospitalisation, (d) a case being symptomatic and reported to surveillance, and (e) test positive ratio associated with RSV. In all panels, points represent the mean and error bars represent 95% CrIs. FOI, force of infection; RSV, respiratory syncytial virus; ILI, influenza-like illness; CrIs, credible intervals.

Our estimates show that both the FOI and transmission rates in 2021–2022 among 5–14 and 15+ years age-groups remained below the pre-COVID levels, suggesting that spontaneous behavioural changes and COVID-19 related measures likely contributed to a reduction in RSV circulation in 2021–2022 compared to the pre-COVID period.13

We estimate a 22.8% (95% CrI: 21.1–24.9%) probability of hospitalisation among RSV infected individuals aged 0–6 months, which decreases to almost zero in the 3+ years age-group (Fig. 3c and Supplementary Table S5). Our estimates suggest that the probability of reporting ILI symptoms to surveillance is similar across age-groups, ranging from 22.1% (95% CrI: 20.5–24.2%) among 0–4 year-olds to 15.3% (95% CrI: 12.3–18.7%) among 65+ year-olds (Fig. 3d).

On average, the RSV test positive ratio was higher in individuals 5+ years (75.9% [95% CrI: 62.6–88.6%]) than in children aged 0–4 years (55.7% [95% CrI: 48.6–63.6%]), possibly reflecting higher rates of respiratory infections beyond RSV, in young children (Fig. 3e).

We estimate that the RSV infection attack rate among 1–4 year-olds increased from 59.7% (95% CrI: 54.5–64.5%) in 2018–2019 to 70.7% (95% CrI: 64.5–76.3%) in 2021–2022 (Fig. 4a). In older individuals, lower attack rates were found compared to the pre-COVID season. This is likely the result of an immunity gap led by the reduced circulation of RSV caused by the NPIs implemented to counter the spread of SARS-CoV-2. In fact, we found an immunity gap of 0.87% (95% CrI: 0.87–0.88%), which represents a 60.8% (95% CrI: 55.2–65.4%) increase in the proportion of the Lombardy population naïve to RSV at the start of the 2021–2022 season (2.3% [95% CrI: 2.2–2.5%]) compared to 2018–2019 (1.4% [95% CrI: 1.3–1.6%]; Fig. 4b). The proportion of the population 1–5 years (young children) who were RSV naïve increased from 15.6% (95% CrI: 13.6–18.1%) in 2018–2019 to 40.5% (95% CrI: 38.5–43.0%) in 2021–2022. This represents an immunity gap of 24.97% (95% CrI: 24.79–25.14%) among individuals 1–5 years.

Fig. 4.

Fig. 4

Attack rates and estimates of the proportion of the population naïve to RSV. Estimated (a) RSV attack rates by age-group per season (bars represent the mean, and error bars the 95% CrIs) and (b) proportion of Lombardy population naïve to RSV infection at the start of each season. RSV, respiratory syncytial virus; CrIs, credible intervals.

We estimate 1.5% (95% CrI: 1.3–1.7%) of the population naïve to RSV at the start of the following 2022–2023 season, which compared to the 2018–2019 estimate (1.4% [95% CrI: 1.3–1.6%]) suggests that the immunity gap has almost completely been filled after the resurgent 2021–2022 season.

Sensitivity analyses

Using model D with no MDI, we estimated that the proportion of the population naïve to RSV increased from 1.2% (95% CrI: 1.1–1.3%) in 2018–2019 to 2.0% (95% CrI: 1.9–2.2%) at the start of the 2021–2022 season, therefore suggesting an immunity gap of 0.88% (95% CrI: 0.88–0.89%). Due to the absence of MDI, we estimated a larger number of RSV infections among individuals aged 0–6 months and hence a reduced estimated probability of hospitalisation in this age-group (7.62% [95% CrI: 7.03–8.35%]). Model fit, parameter estimates, and immunity gap results assuming the absence of MDI are presented in Supplementary Figures S2, Supplementary Table S7, and Supplementary Figure S3, respectively.

A slightly larger immunity gap of 0.96% (95% CrI: 0.96–0.97%) and 1.02% (95% CrI: 1.02–1.03%) was estimated when assuming a 25% and 50% increase in ρSurv for seasons 2019–2022, respectively. When a reduced probability of hospitalisation for post-primary infections was considered, the proportion of the population naïve to RSV was estimated to increase from 1.7% (95% CrI: 1.6–1.9%) at the start of 2018–2019 to 2.6% (95% CrI: 2.5–2.8%) in 2021–2022, with an immunity gap of 0.88% (95% CrI: 0.87–0.89%) that is consistent with our baseline estimates. Full results of all sensitivity analyses performed are shown in the SI Results section (Supplementary Figures S4 and S5 and Supplementary Table S8 for scenarios with increased reporting, and Supplementary Figures S6–S8 and Supplementary Table S9 for the scenario with reduced probability of hospitalisation for post-primary infections).

Discussion

In this study, we analysed RSV surveillance and hospitalisation data from Lombardy region in Northern Italy throughout the COVID-19 pandemic, where an absent 2020–2021 season followed by an atypical larger and earlier peak in RSV hospitalisations in 2021–2022 was observed. This is in line with other reports from Japan, Finland, Australia, and the UK.24, 25, 26, 27 Previous studies hypothesised that this resurgence may result from an immunity gap caused by reduced RSV exposure stemming from the implementation of NPIs.26 This hypothesised link between the immunity gap generated from the implementation of NPIs and the resurgence of RSV was forecasted by prospective modelling studies applied to data from Norway, USA, UK, South Africa [preprint], Hong Kong, and Japan.17, 18, 19, 20, 21, 22, 23 A solid quantitative assessment of such immunity gap from observed data represents a key priority for RSV research and preparedness planning.26,29

To address this important issue, we developed a modelling study based on the use of catalytic models, which allowed reconstruction of the susceptibility profile of the population. The model was informed by hospital discharge records, and epidemiological and virological surveillance data from four transmission seasons spanning the years 2018–2022.

Our estimates of the proportion of individuals who previously experienced RSV infection in the pre-COVID 2018–2019 season (45.0% [95% CrI: 41.2–48.3%] of 1-year-olds, and 82.0% [95% CrI: 77.5–85.7%] of 2-year-olds), are comparable to the results obtained in a serological study conducted in the Netherlands before the COVID-19 pandemic, which found that 44.1% of 1-year-olds and 84.6% of 2-year-olds had experienced primary infection.42

By accounting for heterogeneity in RSV circulation across age-groups over time, we inferred variations in the impact of the NPIs implemented against COVID-19 on the risk of infection experienced at different ages. Our estimates suggest that the COVID-19 restrictions likely caused a marked reduction of potentially infectious contacts in individuals aged 5–14 years, and to a lower extent in individuals aged 15+ years. This is at least partially ascribable to school closures widely implemented in the first two years of the pandemic.13 However, results obtained for the 2021–2022 season show that, after restrictions were relaxed,13 both the FOI and transmission rates among individuals aged 5–14 years remained below pre-COVID levels. On the other hand, the RSV FOI for children aged 0–4 years was larger in 2021–2022 compared to 2018–2019. This increase could be linked to reductions in RSV exposure for expectant mothers during pregnancy which may have affected the extent and proportion of maternally derived immunity acquired at birth by children who were born during the pandemic.30,31

The model developed in this analysis has limitations. For instance, we assumed a fixed age-independent reduction in susceptibility for post-primary infections (s = 0.77).10 We also did not explicitly consider the progressive waning of MDI nor include potential reductions in the duration of MDI inherited by children born during the pandemic resulting from reduced RSV exposure of mothers. Possible differences in the epidemiology of RSV subgroup A and B were not considered either. Nonetheless, our estimates of the immunity gap determined by COVID-19 restrictions are robust with respect to the assumptions we made on the potential contribution of maternal immunity in protecting against the infection, the probability of hospitalisation for post-primary infections, and potential changes in the reporting of RSV cases determined by increased testing during the pandemic.

In sum, our modelling analysis clearly shows that the unexpected increase in RSV hospitalisations observed in 2021–2022 could be at least partially ascribed to a higher incidence of primary RSV infection among young individuals. This is well reflected by the 60% increase we estimated for the proportion of individuals without prior RSV exposure.

More in general, this study shows how data fusion modelling approaches linking different streams of surveillance data can provide new insight into RSV epidemiology, its transmission patterns, and the role that COVID-19 restrictions had on the changes in immunity and observed epidemic dynamics. Notably, the methods developed in this study can be used in the future to continue to monitor RSV circulation, as well as the transmission intensity of other infectious diseases using routinely collected surveillance data from around the world.

Contributors

The study was conceptualised by ID and PP. HJA, ID, EP, LP, GP, GMS, PP, and MM curated the data. HJA performed the formal analysis. Funding was acquired by ID, SM, and PP. HJA, ID, PP, FM, DC, and MT designed the methodology. Software was developed by HJA. The underlying data was verified by MT, DC, and GP. HJA, ID, and PP generated the visuals. The original draft of the manuscript was written by HJA, ID, and PP and was reviewed and edited by ID, EP, SM, FM, PP, SB, DC, and MT. The project was supervised by ID, SM, and PP. All authors had full access to the study data, have reviewed and approved the final version of the manuscript.

Data sharing statement

Model code and aggregated data are available online at https://github.com/hadrianang/RSV-Lombardy. More granular time series data may be made upon reasonable request to the corresponding authors.

Declaration of interests

The authors declare no competing interests.

Acknowledgements

HJA and ID acknowledge funding from the MRC Centre for Global Infectious Disease Analysis (reference MR/R015600/1), jointly funded by the UK Medical Research Council (MRC) and the UK Foreign, Commonwealth & Development Office (FCDO), under the MRC/FCDO Concordat agreement and is also part of the EDCTP2 programme supported by the European Union. ID acknowledges funding by the Wellcome Trust and Royal Society (grant number 213494/Z/18/Z). SM and PP acknowledge EU funding within the NextGeneration EU-MUR PNRR Extended Partnership initiative on Emerging Infectious Diseases (Project no. PE00000007, INF-ACT). For the purpose of open access, the authors have applied a CC BY public copyright licence to any Author Accepted Manuscript version arising from this submission.

Footnotes

Appendix A

Supplementary data related to this article can be found at https://doi.org/10.1016/j.ebiom.2023.104745.

Contributor Information

Piero Poletti, Email: poletti@fbk.eu.

Ilaria Dorigatti, Email: i.dorigatti@imperial.ac.uk.

Appendix A. Supplementary data

Supplementary Information
mmc1.docx (112KB, docx)

Supplementary Figure S1.

Supplementary Figure S1

Summary of model fit to data for scenarios with MDI. Observed and estimated (a) number of hospital discharges associated with RSV, (b) age-distribution of hospital discharges (age 0 refers to 0–6-month-olds and age 0.5 refers to 7–12-month-olds), (c) number of RSV-attributable ILI cases, (d) age-distribution of RSV-attributable ILI cases, and (e) RSV test positivity ratio. In all panels, error bars represent the 95% exact binomial CIs around the data (where applicable) and the 95% CrIs for the model estimates. MDI, maternally derived immunity; RSV, respiratory syncytial virus; ILI, influenza-like illness; CIs, confidence intervals; CrIs, credible intervals.

Supplementary Figure S2.

Supplementary Figure S2

Summary of model fit to data for scenarios without MDI. Observed and estimated (a) number of hospital discharges associated with RSV, (b) age-distribution of hospital discharges (age 0 refers to 0–6-month-olds and age 0.5 refers to 7–12-month-olds), (c) number of RSV-attributable ILI cases, (d) age-distribution of RSV-attributable ILI cases, and (e) RSV test positivity ratio. In all panels, error bars represent the 95% exact binomial CIs around the data (where applicable) and the 95% CrIs for the model estimates. MDI, maternally derived immunity; RSV, respiratory syncytial virus; ILI, influenza-like illness; CIs, confidence intervals; CrIs, credible intervals.

Supplementary Figure S3.

Supplementary Figure S3

Proportion naïve to RSV over time. Estimates obtained with the baseline model (left), and the sensitivity analysis with Model D and no MDI (right). MDI, maternally derived immunity; RSV, respiratory syncytial virus.

Supplementary Figure S4.

Supplementary Figure S4

Summary of model fit to data for ahypothetical25% and 50% increase in reporting during pandemic affected seasons versus baseline. Observed and estimated (a) number of hospital discharges associated with RSV, (b) age-distribution of hospital discharges (age 0 refers to 0–6-month-olds and age 0.5 refers to 7–12-month-olds), (c) number of RSV-attributable ILI cases, (d) age-distribution of RSV-attributable ILI cases, and (e) RSV test positivity ratio. In all panels, error bars represent the 95% exact binomial CIs around the data (where applicable) and the 95% CrIs for the model estimates. RSV, respiratory syncytial virus; ILI, influenza-like illness; CIs, confidence intervals; CrIs, credible intervals.

Supplementary Figure S5.

Supplementary Figure S5

Estimated proportion naïve to RSV over time. Estimates obtained with the baseline model (left), and the two sensitivity analyses with 25% increased reporting (central) and 50% increased reporting (right). RSV, respiratory syncytial virus.

Supplementary Figure S6.

Supplementary Figure S6

Parameter estimates for the baseline and calibratedr (reduced probability of hospitalisation for post-primary infections) models. (a) Probability of hospitalisation, (b) probability of reporting to surveillance, and (c) Test positive probability.

Supplementary Figure S7.

Supplementary Figure S7

Summary of model fit to data for calibratedr(reduced probability of hospitalisation for post-primary infections)versus baseline model. Observed and estimated (a) number of hospital discharges associated with RSV, (b) age-distribution of hospital discharges (age 0 refers to 0–6-month-olds and age 0.5 refers to 7–12-month-olds), (c) number of RSV-attributable ILI cases, (d) age-distribution of RSV-attributable ILI cases, and (e) RSV test positivity ratio. In all panels, error bars represent the 95% exact binomial CIs around the data (where applicable) and the 95% CrIs for the model estimates. RSV, respiratory syncytial virus; ILI, influenza-like illness; CIs, confidence intervals; CrIs, credible intervals.

Supplementary Figure S8.

Supplementary Figure S8

Proportion naïve to RSV over time. Estimates obtained with the baseline model (left) and the sensitivity analysis with a reduced probability of hospitalisation for post-primary infections (right). RSV, respiratory syncytial virus.

References

  • 1.Li Y., Wang X., Blau D.M., et al. Global, regional, and national disease burden estimates of acute lower respiratory infections due to respiratory syncytial virus in children younger than 5 years in 2019: a systematic analysis. Lancet. 2022 doi: 10.1016/S0140-6736(22)00478-0. https://www.thelancet.com/journals/lancet/article/PIIS0140-6736(22)00478-0/fulltext [cited 2022 May 23]. Available from: [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Bergeron H.C., Tripp R.A. Immunopathology of RSV: an updated review. Viruses. 2021;13(12):2478. doi: 10.3390/v13122478. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Li X., Willem L., Antillon M., Bilcke J., Jit M., Beutels P. Health and economic burden of respiratory syncytial virus (RSV) disease and the cost-effectiveness of potential interventions against RSV among children under 5 years in 72 Gavi-eligible countries. BMC Med. 2020;18(1):82. doi: 10.1186/s12916-020-01537-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Shi T., Denouel A., Tietjen A.K., et al. Global disease burden estimates of respiratory syncytial virus–associated acute respiratory infection in older adults in 2015: a systematic review and meta-analysis. J Infect Dis. 2020;222(Supplement_7):S577–S583. doi: 10.1093/infdis/jiz059. [DOI] [PubMed] [Google Scholar]
  • 5.Borchers A.T., Chang C., Gershwin M.E., Gershwin L.J. Respiratory syncytial virus—a comprehensive review. Clin Rev Allergy Immunol. 2013;45(3):331–379. doi: 10.1007/s12016-013-8368-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Falsey A.R., Walsh E.E. Respiratory syncytial virus infection in adults. Clin Microbiol Rev. 2000;13(3):371–384. doi: 10.1128/cmr.13.3.371-384.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Kapikian A.Z., Mitchell R.H., Chanock R.M., Shvedoff R.A., Stewart C.E. An epidemiologic study of altered clinical reactivity to respiratory syncytial (RS) virus infection in children previously vaccinated with an inactivated RS virus vaccine. Am J Epidemiol. 1969;89(4):405–421. doi: 10.1093/oxfordjournals.aje.a120954. [DOI] [PubMed] [Google Scholar]
  • 8.Ohuma E.O., Okiro E.A., Ochola R., et al. The natural history of respiratory syncytial virus in a birth cohort: the influence of age and previous infection on reinfection and disease. Am J Epidemiol. 2012;176(9):794–802. doi: 10.1093/aje/kws257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Poletti P., Merler S., Ajelli M., et al. Evaluating vaccination strategies for reducing infant respiratory syncytial virus infection in low-income settings. BMC Med. 2015;13(1):49. doi: 10.1186/s12916-015-0283-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Paynter S., Yakob L., Simões E.A.F., et al. Using mathematical transmission modelling to investigate drivers of respiratory syncytial virus seasonality in children in the Philippines. PLoS One. 2014;9(2) doi: 10.1371/journal.pone.0090094. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Pellegrinelli L., Galli C., Bubba L., et al. Respiratory syncytial virus in pediatric influenza-like illness cases in Lombardy, Northern Italy, during seven consecutive winter seasons (from 2014–2015 to 2020–2021) Influenza Other Respir Viruses. 2022;16(3):481–491. doi: 10.1111/irv.12940. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.De Conto F., Conversano F., Medici M.C., et al. Epidemiology of human respiratory viruses in children with acute respiratory tract infection in a 3-year hospital-based survey in Northern Italy. Diagn Microbiol Infect Dis. 2019;94(3):260–267. doi: 10.1016/j.diagmicrobio.2019.01.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Hale T., Angrist N., Goldszmidt R., et al. A global panel database of pandemic policies (Oxford COVID-19 Government Response Tracker) Nat Hum Behav. 2021;5(4):529–538. doi: 10.1038/s41562-021-01079-8. [DOI] [PubMed] [Google Scholar]
  • 14.Marziano V., Guzzetta G., Rondinone B.M., et al. Retrospective analysis of the Italian exit strategy from COVID-19 lockdown. Proc Natl Acad Sci U S A. 2021;118(4) doi: 10.1073/pnas.2019617118. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Marziano V., Guzzetta G., Mammone A., et al. The effect of COVID-19 vaccination in Italy and perspectives for living with the virus. Nat Commun. 2021;12(1):7272. doi: 10.1038/s41467-021-27532-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Vittucci A.C., Piccioni L., Coltella L., et al. The disappearance of respiratory viruses in children during the COVID-19 pandemic. Int J Environ Res Public Health. 2021;18(18):9550. doi: 10.3390/ijerph18189550. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Bents S., Viboud C., Grenfell B., et al. The impact of COVID-19 non-pharmaceutical interventions on future respiratory syncytial virus transmission in South Africa [preprint] medRxiv. 2022 doi: 10.1101/2022.03.12.22271872. [DOI] [Google Scholar]
  • 18.Baker R.E., Park S.W., Yang W., Vecchi G.A., Metcalf C.J.E., Grenfell B.T. The impact of COVID-19 nonpharmaceutical interventions on the future dynamics of endemic infections. Proc Natl Acad Sci U S A. 2020;117(48):30547–30553. doi: 10.1073/pnas.2013182117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Madaniyazi L., Seposo X., Ng C.F.S., et al. Respiratory syncytial virus outbreaks are predicted after the COVID-19 pandemic in Tokyo, Japan. Jpn J Infect Dis. 2022;75(2):209–211. doi: 10.7883/yoken.JJID.2021.312. [DOI] [PubMed] [Google Scholar]
  • 20.Methi F., Størdal K., Telle K., Larsen V.B., Magnusson K. Hospital admissions for respiratory tract infections in children aged 0–5 years for 2017/2023. Front Pediatr. 2022;9 doi: 10.3389/fped.2021.822985. https://www.frontiersin.org/articles/10.3389/fped.2021.822985 [cited 2023 May 30]. Available from: [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Koltai M., Krauer F., Hodgson D., et al. Determinants of RSV epidemiology following suppression through pandemic contact restrictions. Epidemics. 2022;40 doi: 10.1016/j.epidem.2022.100614. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Zheng Z., Pitzer V.E., Shapiro E.D., Bont L.J., Weinberger D.M. Estimation of the timing and intensity of reemergence of respiratory syncytial virus following the COVID-19 pandemic in the US. JAMA Netw Open. 2021;4(12) doi: 10.1001/jamanetworkopen.2021.41779. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Cheng W., Zhou H., Ye Y., et al. Future trajectory of respiratory infections following the COVID-19 pandemic in Hong Kong. Chaos. 2023;33(1) doi: 10.1063/5.0123870. [DOI] [PubMed] [Google Scholar]
  • 24.Ujiie M., Tsuzuki S., Nakamoto T., Iwamoto N. Resurgence of respiratory syncytial virus infections during COVID-19 pandemic, Tokyo, Japan. Emerg Infect Dis. 2021;27(11):2969–2970. doi: 10.3201/eid2711.211565. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Kuitunen I., Artama M., Haapanen M., Renko M. Respiratory virus circulation in children after relaxation of COVID-19 restrictions in fall 2021—a nationwide register study in Finland. J Med Virol. 2022;94(9):4528–4532. doi: 10.1002/jmv.27857. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Bardsley M., Morbey R.A., Hughes H.E., et al. Epidemiology of respiratory syncytial virus in children younger than 5 years in England during the COVID-19 pandemic, measured by laboratory, clinical, and syndromic surveillance: a retrospective observational study. Lancet Infect Dis. 2023;23(1):56–66. doi: 10.1016/S1473-3099(22)00525-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Eden J.S., Sikazwe C., Xie R., et al. Off-season RSV epidemics in Australia after easing of COVID-19 restrictions. Nat Commun. 2022;13(1):2884. doi: 10.1038/s41467-022-30485-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Ministero della Salute Hospital discharge records [Internet]. Schede di dimissione ospedaliera - SDO. https://www.salute.gov.it/portale/temi/p2_4.jsp?lingua=italiano&tema=Assistenza,%20ospedale%20e%20territorio&area=ricoveriOspedalieri Available from:
  • 29.Billard M.N., Bont L.J. Quantifying the RSV immunity debt following COVID-19: a public health matter. Lancet Infect Dis. 2023;23(1):3–5. doi: 10.1016/S1473-3099(22)00544-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Reicherz F., Xu R.Y., Abu-Raya B., et al. Waning immunity against respiratory syncytial virus during the coronavirus disease 2019 pandemic. J Infect Dis. 2022;226(12):2064–2068. doi: 10.1093/infdis/jiac192. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.den Hartog G., van Kasteren P.B., Schepp R.M., Teirlinck A.C., van der Klis F.R.M., van Binnendijk R.S. Decline of RSV-specific antibodies during the COVID-19 pandemic. Lancet Infect Dis. 2023;23(1):23–25. doi: 10.1016/S1473-3099(22)00763-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Bosetti P., Poletti P., Stella M., Lepri B., Merler S., De Domenico M. Heterogeneity in social and epidemiological factors determines the risk of measles outbreaks. Proc Natl Acad Sci U S A. 2020;117(48):30118–30125. doi: 10.1073/pnas.1920986117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Li S., Ma C., Hao L., et al. Demographic transition and the dynamics of measles in six provinces in China: a modeling study. PLoS Med. 2017;14(4) doi: 10.1371/journal.pmed.1002255. Riley S. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Ferrari M.J., Djibo A., Grais R.F., Grenfell B.T., Bjørnstad O.N. Episodic outbreaks bias estimates of age-specific force of infection: a corrected method using measles as an example. Epidemiol Infect. 2010;138(1):108–116. doi: 10.1017/S0950268809990173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Lai A., Bergna A., Menzo S., et al. Circulating SARS-CoV-2 variants in Italy, October 2020–March 2021. Virol J. 2021;18(1):168. doi: 10.1186/s12985-021-01638-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Istituto Superiore di Sanità Sistema di Sorveglianza Integrata dell’Influenza. InfluNet. https://w3.iss.it/site/RMI/influnet/Default.aspx [cited 2022 August 9]. Available from:
  • 37.Italian National Institute of Statistics . 2022. Lombardia population. Resident population on 1st January.http://dati.istat.it/?lang=en [cited 2022 April 28]. Available from: [Google Scholar]
  • 38.Cauchemez S., Hoze N., Cousien A., Nikolay B., ten bosch Q. How modelling can enhance the analysis of imperfect epidemic data. Trends Parasitol. 2019;35(5):369–379. doi: 10.1016/j.pt.2019.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Cox V., O’Driscoll M., Imai N., et al. Estimating dengue transmission intensity from serological data: a comparative analysis using mixture and catalytic models. PLoS Negl Trop Dis. 2022;16(7) doi: 10.1371/journal.pntd.0010592. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Ochola R., Sande C., Fegan G., et al. The level and duration of RSV-specific maternal IgG in infants in Kilifi Kenya. PLoS One. 2009;4(12) doi: 10.1371/journal.pone.0008088. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Stan Development Team . 2022. Stan modeling language user guide and reference manual, 2.26.3.https://mc-stan.org Available from: [Google Scholar]
  • 42.Andeweg S.P., Schepp R.M., van de Kassteele J., Mollema L., Berbers G.A.M., van Boven M. Population-based serology reveals risk factors for RSV infection in children younger than 5 years. Sci Rep. 2021;11:8953. doi: 10.1038/s41598-021-88524-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Kutsaya A., Teros-Jaakkola T., Kakkola L., et al. Prospective clinical and serological follow-up in early childhood reveals a high rate of subclinical RSV infection and a relatively high reinfection rate within the first 3 years of life. Epidemiol Infect. 2016;144(8):1622–1633. doi: 10.1017/S0950268815003143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Glezen W.P., Taber L.H., Frank A.L., Kasel J.A. Risk of primary infection and reinfection with respiratory syncytial virus. Am J Dis Child. 1986;140(6):543–546. doi: 10.1001/archpedi.1986.02140200053026. [DOI] [PubMed] [Google Scholar]
  • 45.Public Health England Respiratory syncytial virus (RSV): symptoms, transmission, prevention, treatment. GOV.UK. https://www.gov.uk/government/publications/respiratory-syncytial-virus-rsv-symptoms-transmission-prevention-treatment/respiratory-syncytial-virus-rsv-symptoms-transmission-prevention-treatment [cited 2022 July 25]. Available from:
  • 46.van Boven M., Teirlinck A.C., Meijer A., et al. Estimating transmission parameters for respiratory syncytial virus and predicting the impact of maternal and pediatric vaccination. J Infect Dis. 2020;222(Supplement_7):S688–S694. doi: 10.1093/infdis/jiaa424. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Spiegelhalter D.J., Best N.G., Carlin B.P., van der Linde A. The deviance information criterion: 12 years on. J R Stat Soc Ser B Stat Methodol. 2014;76(3):485–493. [Google Scholar]
  • 48.Gelman A., Hwang J., Vehtari A. Understanding predictive information criteria for Bayesian models. Stat Comput. 2014;24(6):997–1016. [Google Scholar]
  • 49.Italian National Institute of Statistics . 2022. Deaths: death rate.http://dati.istat.it/Index.aspx?QueryId=19671&lang=en# [cited 2022 August 12]. Available from: [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Information
mmc1.docx (112KB, docx)

Articles from eBioMedicine are provided here courtesy of Elsevier

RESOURCES