Skip to main content
PLOS Computational Biology logoLink to PLOS Computational Biology
. 2022 Jun 24;18(6):e1010234. doi: 10.1371/journal.pcbi.1010234

Evidence for influenza and RSV interaction from 10 years of enhanced surveillance in Nha Trang, Vietnam, a modelling study

Naomi R Waterlow 1,*, Michiko Toizumi 2, Edwin van Leeuwen 1,3, Hien-Anh Thi Nguyen 4, Lay Myint-Yoshida 2,#, Rosalind M Eggo 1,#, Stefan Flasche 1,#
Editor: Daniel M Weinberger5
PMCID: PMC9262224  PMID: 35749561

Abstract

Influenza and Respiratory Syncytial Virus (RSV) interact within their host posing the concern for impacts on heterologous viruses following vaccination. We aimed to estimate the population level impact of their interaction. We developed a dynamic age-stratified two-pathogen mathematical model that includes pathogen interaction through competition for infection and enhanced severity of dual infections. We used parallel tempering to fit its parameters to 11 years of enhanced hospital-based surveillance for acute respiratory illnesses (ARI) in children under 5 years old in Nha Trang, Vietnam. The data supported either a 41% (95%CrI: 36–54) reduction in susceptibility following infection and for 10.0 days (95%CrI 7.1–12.8) thereafter, or no change in susceptibility following infection. We estimate that co-infection increased the probability for an infection in <2y old children to be reported 7.2 fold (95%CrI 5.0–11.4); or 16.6 fold (95%CrI 14.5–18.4) in the moderate or low interaction scenarios. Absence of either pathogen was not to the detriment of the other. We find stronger evidence for severity enhancing than for acquisition limiting interaction. In this setting vaccination against either pathogen is unlikely to have a major detrimental effect on the burden of disease caused by the other.

Author summary

Influenza and Respiratory Syncytial Virus (RSV) cause large burdens of disease. Instead of acting independently, there may be short term cross-protection between them. The evidence of this to date comes from ecological studies which are unable to test the mechanism, or biological studies that are unable to determine the population level impacts of such cross-protection. We create a mathematical model that simulates the circulation of these two viruses, and allows for cross-protection between them. We then fit this model to hospital reported cases of confirmed infection from Nha Trang, Vietnam in order to estimate whether any cross-protection exists in this setting. We show that there are two possibilities—either no interaction or moderate interaction that can result in the observed circulation patterns. However, we further show that co-infection results in an increased reporting rate, presumably due to increased severity.

Introduction

Influenza and Respiratory Syncytial Virus (RSV) have large health and economic impacts globally, particularly in young children where they cause 870 000 [1] and 3.2 million [2] hospitalisations in <5 year olds per year respectively. While pediatric influenza vaccines are licensed for use in some countries, global uptake is poor and efficacy depending on the match to the circulating strains. RSV vaccines are in development, with close to 20 vaccine candidates being evaluated in pre-licensure trials [3].

The impact of vaccination may be enhanced if concurrent co-infections increase the propensity of severe disease beyond that of either pathogen [4]. However, the impact of vaccination may be lessened if vaccination reduces competitive pressure between influenza and RSV and thus leads to increased circulation of the other pathogen. Such competitive pressure has been observed in the form of cross protection in mouse studies that showed e.g. a protective effect of live attenuated influenza vaccine administration on RSV replication [5] and influenza infection on RSV severity [6], mediated by the innate immune system. Population level evidence for the effect of cross-protection on influenza and RSV epidemiology, however, is largely of observational nature: a lack of coincidence in peak timings [7,8], changes in RSV peak timing following unusual influenza seasons [914] and alternating infection patterns [15].

Cross-protection following a primary infection could occur through a variety of mechanisms including viral competition for resources in the host [16], the activation of the innate immune system such as through toll-like receptors (TLRs) 3 and 7 [17,18] or short term immune memory through surviving cells in an antiviral state (e.g. epithelial cells following influenza infection [19]). These interactions could result in a reduction in subsequent infection with the other viruses, and estimates of the duration of cross-protection and its biological pathway vary. Experimental infection of ferrets estimated less than 2 weeks protection between influenza A and B viruses [20], yet cells forming the respiratory epithelium can survive in a state of heightened antiviral activation for 3 to 12 weeks after influenza A infection, with waning of the conferred protection observable at 6 weeks [19].

In Nha Trang, Vietnam, for more than 10 years children admitted to the single public hospital with acute respiratory illness have been tested for presence of influenza and RSV infection as part of an enhanced surveillance. RSV circulation is highly seasonal, and influenza circulation varies year on year, thus giving a unique opportunity to systematically investigate evidence for their interaction at population level. We use this data in combination with a dynamic transmission model to estimate the strength of cross-protection and the effects of co-infections on disease severity (defined as the proportion of infections that require hospital attendance).

Methods

Ethics statement

This study was approved by the Institutional Review Boards of the London School of Hygiene & Tropical Medicine (16166 /RR/12988) and the National Institute of Hygiene and Epidemiology in Vietnam (VN01057-28/2015).

Study population

We used data from a hospital-based enhanced surveillance study of children with respiratory disease, as previously described [21,22]. In brief, children younger than 5 years old who resided in 16 out of the 27 communes of Nha Trang (resident population of 210’739) and attended he paediatric ward in Khanh Hoa General Hospital (KHGH) in Nha Trang, central Vietnam, with Acute Respiratory Infection (ARI) were enrolled and offered a suite of additional diagnostics. ARI was defined as Cough and / or difficulty breathing. Khanh Hoa hospital is a tertiary care facility and is the only public hospital for the catchment area of the study. More than 94% of all pediatric ARI admissions are typically enrolled. Upon admission, Nasopharyngeal (NP) samples were taken from patients, nucleic acid was extracted and multiplex-PCR assays were performed in order to detect infection with up to 13 respiratory viruses, including influenza A and RSV. Positive samples underwent a second, confirmatory PCR test and only individuals who tested positive in both PCRs were included. We use aggregate weekly data, from 5th February 2007 until 4th December 2017. We assumed that an ARI episode, for which Influenza or RSV were detected from the nasopharynx on admission, was caused by the respective pathogen. The dataset excludes neonatal cases under 28 days old.

To inform transmission pathways in the population we used age specific contact-patterns, based on a contact study in the same area, conducted in 2010[23]. In total 2002 Nha Trang residents of all ages participated in the study. A contact was defined as either skin-to-skin contact or a two-way conversation.

Data analysis

We calculated the correlation between all reported influenza and RSV cases each week using a Pearson’s Correlation test.

Assuming no interaction (in susceptibility to or severity of dual infections), we calculated the required annual RSV infection attack rate in order to observe the reported number of dual infections (Eqs 13). We estimate the RSV attack rate rather than the influenza attack rate, as RSV is more consistent year on year (see section 1 in S1 Text for influenza equivalent). Using a negative binomial likelihood with Brent optimization we estimated the RSV reporting rate that would correspond to the maximum likelihood of observing the reported weekly number of dual infections. We then used this estimate of the reporting rate to calculate the annual RSV population attack rate required in order to observe this many coinfected ARI admissions. The credible intervals for the attack rate were calculated using the Hessian matrix from the optimisation. If the estimated attack rate is high, this may suggest that influenza and RSV co-infection increase severity (and hence reporting). If the estimated attack rate is low, this could suggest that co-infection is less likely that at random due to competition between the viruses.

IDualIInfluenza*PRSV (1)
PRSVIRSV*1/γRSV/υRSV (2)
ARRSVIRSV/υRSV (3)

With parameters: Incidence of reported cases (I), Prevalence of Infection (P), Duration of Infection (1/γRSV, 9 days—see Table 1), attack rate (AR) and estimated reporting rate (υ).

Table 1. Parameter definitions, values and priors.

Parameter Symbol Value Prior Source
Transmission rate INF β INF Fitted Based on R0,INF See section 4 in S1 Text for calculations
Basic Reproduction Rate Influenza R 0,INF Fitted Between 1 and 8 [26]
Transmission rate RSV β RSV Fitted Based on R0,RSV See section 4 in S1 Text for calculations
Basic Reproduction Rate RSV for strain y R 0,RSV,y Fitted Between 1 and 8 [26]
RSV age group susceptibility (0–1, 2–4, 5–15, 16–64,65+ τ i Fixed 1, 0.75, 0.65, 0.65, 0.65 Based on Henderson et al (1979) [27], see section 5 in S1 Text
Infectious period Influenza 1/γINF 3.8 days - Cauchemez et al (2004) [28]
Range from published papers: 1–4.5 days [2831]
Infectious period RSV 1/γRSV 9 days - Weber et al (2001) [25]
Range from published papers 6.7–12 days [25,32,33]
Strength of cross-protection σ Fitted 0–1 Assuming competitive [34]
Duration of cross-protection 1/ρ Fitted 0—Inf days
Proportion of each age group infected with Influenza, at the start of the season δ INF,s Fitted 0–1
Proportion of each age group infected with RSV, at the start of the season δ RSV,s Fitted 0–1
Proportion susceptible to influenza at the start of the season η s Fitted 0–1 Exponential function, see section 6 in S1 Text for details
Influenza proportion reported in ages 0–1 κ INF Fitted 0–0.4
Influenza multiplier for proportion reported ages 2–4 vs 0–1 κ INF,m Fitted 0–5
RSV proportion reported in age group i κ RSV,i Fitted 0–0.4 No additional severity from dual infection [35]
RSV ON-1 reporting multiplier κ RSV,2012 Fitted 1–5 ON-1 clinically more severe [24]
Dual infection multiplier on RSV proportion reporting κ Dual Fitted 1—Inf Based on analysis of expected RSV Attack Rate above.
Overdispersion parameter k Fitted 0-Inf

Model

We created an age-structured deterministic transmission model for influenza and RSV, allowing for short-term cross-protection. Individuals are either Susceptible (S), Infectious (I), cross-Protected (P) and Recovered (R) for influenza (INF) and (RSV).

Susceptibles become infected at force of infections λINF and λRSV, and move into the I states. They then remain infectious for 1/γINF and 1/γRSV days and during the infectious period and 1/ρ days thereafter they are cross-protected and thus their propensity for heterologous infection is reduced by factor σ, the strength of cross-protection. There is no difference in inherent susceptibility by age for influenza, but there is reduced susceptibility to RSV in older age groups, determined by parameter τi.

The force of infection includes age-specific contact rates derived from a local contact survey [23]. Modelled age-groups are: 0–1 years (infants), 2–4 years (pre-school), 5–15 years (school), 16–64 years (adults) and 65 + (older adults). Infection reporting rates vary by age-group and virus, and for RSV reporting rates are increased by a multiplier from 2012 onwards, due to the circulation of a new genotype that has increased the average severity of infection and thus the proportion of reported infections (ON-1) [24]. There is also a multiplier on the RSV reporting rates for dual infections, allowing them to be reported more frequently, for example because of increased propensity for respiratory disease that would require healthcare seeking (as observed in adults [4]). Model equations are shown in section 3 in S1 Text.

We model the persisting immunity to influenza at the start of each season individually, with an initial proportion susceptible. This allows for a different immunity profile at the start of each season, without needing to account for waning of immunity, dynamics across virus subtypes and seasonality specifically. [25]. Due to infections in previous influenza seasons and potential vaccination, susceptibility to influenza is assumed to decline exponentially at rate η with age (see section 6 in S1 Text). This is modelled as non-leaky cross-protection, due to the combination of different exposures. For RSV we assume the only immunity at the beginning of the season is the age-specific reduction in susceptibility (leaky immunity), as immunity to reinfection typically lasts less than a year. Due to the short-time period modelled (max 66 weeks), we do not include births, deaths or ageing, but instead hold the age-group specific population sizes constant at the levels of 2010. Parameter definitions and values are shown in Table 1.

To capture the annual influenza and RSV epidemics despite regular changes, particularly in the timing of influenza circulation, we defined the annual start of the season as the minimum number of combined RSV and Influenza cases (on a 4 week rolling mean) between the 1st of November and the 1st of May each season. If one or more weeks had the same rolling average, we took the first occurrence within the time window.

Likelihood

We fitted the model to the age-stratified weekly number of ARI cases with nasopharyngeal carriage of either influenza or RSV using a negative binomial likelihood. To fit the allocation of those cases into influenza, RSV or dual infections we added a multinomial component to the likelihood, resulting in an overall log likelihood of:

LL(θ|x)=j=1N=2i=1n(NB(μi,j,k)+MN(pRSVi,j,pFlui,j,pDuali,j)) (4)

Where x are the reported infections, θ are the parameters, j are the two age groups 0–1 and 2–4, and i are the weeks, with n being the total number of weeks. NB is the likelihood of the observed number of cases being a random draw from a negative binomial distribution with the total number of modelled infections as the mean, μ, and the fitted overdispersion parameter, k. MN is the multinomial likelihood, with pRSV, pFlu and pDual being the respective probabilities of the infection with influenza, RSV or both, calculated from the ratio of model reported cases.

Inference

We used parallel tempering to fit the model. This method involves running multiple markov chains simultaneously, with different ‘temperatures’ that place a weighting on the likelihood. Swaps between the chains are then proposed every x (in this case 5) iterations, and accepted with acceptance ratio:

R=e((LL(i)LL(j))*(τjτi))

Where

τi=1Ti

For full details of the method see Vousden et al (2016)[36] We ran the parallel tempering algorithm with 12 chains and 450,000 iterations. The initial 250,000 iterations were discarded as burn-in. Accepted samples from the first chain were then thinned to 1 in 10 for analysis, resulting in a final sample size of 20’000.

Single pathogen simulations

To assess the maximal indirect heterologous effect an intervention against either pathogen (e.g. widespread vaccination)could have in this environment, we assumed that complete absence of one of the viruses. We then calculated the relative change in the number of cases in the pathogen not targeted by the intervention. Estimates are based on model simulations using 1000 posterior parameter samples of the fitted model.

Sensitivity analyses

We assessed the sensitivity of our estimates of the strength of interaction of influenza and RSV to the prior on the interaction parameter and to the reporting rates of dual infections. We reran the model with a prior on the interaction parameter for strong interaction, using a normal distribution with mean 0.8 and standard deviation of 0.15. In addition, we ran a version of the model which did not allow an increased reporting rate for dual infections, as it has been reported that in this setting there is no increased severity of dual infections among hospitalised children [35]. Instead, it was assumed that the reporting rate for dual infections was the same as that for RSV-only infections.

Software

All analysis except for the fitting was done in R version 4.0.0. The fitting was done on R 3.4 on AWS ec2 machines. Code is available at https://github.com/NaomiWaterlow/NhaTrang_flu_rsv_interaction

Results

Descriptive analysis

A total of 788 influenza and 1687 RSV hospitalised paediatric ARI cases were reported between 5th February 2007 and 4th December 2017; 78 (9% of influenza cases and 4% of RSV cases) of these were dual infections (Fig 1A and 1B). The mean age of at admission was 22 months and 16 months for influenza and RSV cases respectively. RSV notifications showed strong consistent seasonality across years, peaking usually in the 34th week of the year, whereas influenza showed less seasonality, but typically occurs after Tết Nguyên Đán holidays and before the RSV epidemic (Fig 1C).

Fig 1. Data.

Fig 1

A) Weekly reported infections of children under 5 years old infected with influenza and RSV over the study period. B) Total number of cases reported over the entire study period by age group and virus. C) Percentage of reported cases by week of the year for RSV and Influenza. The thick lines show the combined total reported across all years, the semi-transparent lines show the 4-week moving average per year.

There was a small, not statistically significant, negative correlation between weekly influenza and RSV incidence, with the Pearson correlation coefficient -0.074 (95% CrI:-0.160 to 0.009). (Figure A in S1 Text)

We estimated that in order to observe the weekly reported number of dual infections when assuming independence of influenza and RSV infection, the annual RSV attack rate needed to be 720% (95% CrI: 560–1000) in ages 0-1y and 430% (95% CrI: 270–980) in ages 2-4y. The high attack rate suggests that in fact influenza and RSV infections are not independent but that co-infection is likely to substantially enhance the propensity for hospitalisation with ARI in this setting.

Model inference

The model was able to fit the case data for influenza and RSV well (Fig 2, see section 7 in S1 Text for further fitting and convergence details). The posterior estimates for the relative reduction in heterologous acquisition rates during and following Influenza or RSV infection was bimodal, with one mode at 0.004 (95%CrI 0.000–0.046), indicating hardly any competition for infection, and one mode at 0.41 (95%CrI 0.36–0.54), indicating moderate competition, assuming a cut-off between modes at 0.2 (Fig 3). The posterior for the duration of interaction also had multiple modes, with the mode corresponding to moderate competition at 10.0 days (95%CrI 7.1–12.8 days).

Fig 2. Model Fit: Black lines are the data, coloured lines are the 95% CrI posterior predictive interval.

Fig 2

Panels show the fit by age group and Virus.

Fig 3. Posterior estimates for parameters sigma and rho, and the corresponding likelihood values.

Fig 3

Colour is split by sigma value of 0.2. B) Goodness of Fit: Observed cases by season against Modelled cases by season by virus and age group. The black line indicates the same value.

The main differences between modes for other parameters were in the detection rate of influenza, which ranged from 13 to 21% of infections reported (section 8 in S1 Text) and the increased reporting for dual infections. We estimate that in the moderate competition mode the observation of influenza and RSV coinfection among ARI cases was 8.2 (95%CrI 6.9–9.9) times more likely than would have been expected by chance in ages 2–4 and 16.6 (95%CrI 14.5–18.4) in ages 0–1. This compares to the no competition scenario where the observation of influenza and RSV coinfection among ARI cases was 3.6 (95%CrI 2.5–5.8) and 7.2 (95%CrI 5.0–11.4) times more likely than would have been expected by chance in ages 2–4 and 0–1 respectively.

To assess the relevance of RSV and influenza interaction on population level in this setting we simulated single pathogen versions of the parameterised model. In the case of no competition, absence of influenza (e.g. through widespread vaccination) reduced RSV hospitalisations by 4.1% (95%CrI 3.3–7.1%) due to a lack of co-infections with higher propensity for severe disease and absence of RSV reduced influenza hospitalisations by 7.2% (95%CrI 4.4–7.2%) in the study period. In the moderate competition mode, absence of influenza reduced RSV hospitalisations by 5.7% (95%CrI 4.9–6.5%). In the absence of RSV 1.8% (95%CrI -0.7–7.2%) more hospitalised cases for influenza occurred (Fig 4).

Fig 4. Vaccination scenarios: Number of cases modelled over all seasons, with different vaccination assumptions.

Fig 4

Dots represent the median and lines the 95% CrI.

Sensitivity

As a sensitivity analysis, we assumed that co-infection will not modulate the propensity to be admitted to the local hospital with ARI symptoms (see section 9 in S1 Text), which pushed the posterior to the no competition mode. Further, we reran the model with a prior for strong competition through cross-protection, which pushed the posterior to the moderate interaction mode (see section 10 in S1 Text).

Discussion

We use data from more than 10 years of enhanced surveillance in Nha Trang, Vietnam to estimate the interaction of influenza and RSV epidemiology. We find that the observed data is consistent with infection reducing heterologous acquisition either by 41% (95%CrI 36% - 54%) for 10.0 days (95%CrI 7.1–12.8 days) after infection or hardly at all. We estimate that influenza-RSV co-infection increases the propensity of an infection to be reported through the ARI hospital surveillance by between 2.5 and 18.4 times. We go on to show that control of one virus in this setting may have little impact on the circulation of the other but can have an added benefit in reducing hospitalisations with co-infections.

A key strength of this dataset is the inclusion of cases infected with both influenza and RSV. Surprisingly though, some dual infections are reported at times when the two viruses seldom found in the hospital setting individually which may be a result of stochastic effect owing to the low number of observed dual infections and has limited the strength of inference from them. While many papers reporting co-infections do not include timings of the co-infections [3739], these off-peak co-infections were not observed in Texas [40]. In addition, in Nha Trang influenza circulates continuously at low prevalence with small epidemics, which would result in constant low-level cross-protection, rather than a short-term more concentrated interaction after a large epidemic, such as in the UK [41]. This low-level cross-protection could have been absorbed into the transmission rate of RSV, explaining the low estimate of the RSV R0 (1.24 compared to a range of 1.2–9.1 in published papers [26]). These location-specific features will need to be considered when generalising the findings. However, in general, the setting of this study is a strength of the paper, as many of the countries where respiratory viruses circulate at low levels year-round are the same countries with limited influenza vaccine uptake. This study also has a high participation rate, however we do not have information on participants who declined to take part in the study, and this may bias the results.

Much of the evidence for cross-protection is on an individual, biological level [5,6,20]. However the impact of this individual level cross-protection on population level has been unclear, due to relatively small infection prevalence at any point in time (we estimate the seasonal attack rate for influenza as 0.011–0.15, and that peak prevalence never exceeded 0.8%), and thus a low propensity for co-infection with RSV. This may be exaggerated by clustering factors such as household transmission, reducing the opportunity for cross-infection. As an example in Kilifi, Kenya, household transmission of RSV contributed about 50% of all RSV transmission in households with young children [42]. Our model assumes a well-mixed population, so does not account for any population clustering beyond the age-specific contact matrices. In addition, we assume that risk of infection is age-dependent, but otherwise homogeneous. However, increased risk of influenza infection may be correlated with increased risk of RSV infection, due to demographic factors such as poor hygiene and household clustering. This may overestimate the effect of dual infections on reporting.

In our model we assumed the cross-protection between the two viruses to be bi-directional, having the same impact irrelevant of which virus caused the first infection. This assumption is based on the mechanism of cross-protection being the activation of the innate immune system into a general antiviral state. However, in the study site the influenza epidemic occurs before the RSV epidemic, therefore our estimate of the strength of cross-protection on susceptibility to the second virus is mainly an estimate of the impact of influenza on RSV and does not necessarily capture any dynamics in the other direction. In addition, our model is not able to capture delays in the timing of cross-protection, which could potentially occur when considering other mechanisms of cross-protection.

Evidence of cross-protection between influenza and RSV also comes from shifts in epidemic peaks, particularly after the 2009 influenza pandemic [1013]. However these studies are observational, and cannot test mechanisms. As the SARS-CoV-2 pandemic has demonstrated, behavioural responses can have huge impacts on viral circulation, with many geographies seeing shifts in epidemic peaks for usually consistent viruses, such as RSV [43,44], due to limitations on social contacts. Fear generated from high infection rates can also drastically alter individuals behaviour [45], even without wide-spread implementations of restrictions.

Our model does not take into account different subtypes of influenza or RSV, due to the added complexity, additional parameters required and the lack of subtype specific data. We therefore assume that any cross-protection between influenza and RSV does not vary by subtype. We account for different immunity levels to circulating influenza subtypes by fitting a susceptibility parameter at the start of each season. This is necessary because we fit to each season, rather than including immunity waning and fitting over the time period combined. In addition, the dual infections appear to cluster in certain years, and a different explanation of this could be interaction between different viral subtypes each year. While the start weeks of our season are fixed manually, we account for any impacts of this by fitting the proportion infected at the start of each season for each virus. While most of the posterior estimates are reasonable, the reporting rate for influenza infections is high, between 13 and 21%, compared to estimated 12% from data in Yoshida et al. (2013). However, many milder cases (including outpatients) are included in the reports as they may seek healthcare at the hospital, thereby increasing the expected reporting rate in this context. The posterior for the detection rate of influenza is one of the few parameters that, like the strength of cross-protection parameter, is bimodal. However these were not greatly different, with the medians of the two priors only differing by 3.6% and therefore not substantially different to help us distinguish between the two modes. Overall therefore, our model estimates fit the data well, as well as known aspects of influenza and RSV transmission, such as high influenza attack rates in children [46,47], and higher RSV severity in the youngest children [48].

Conclusions

In summary, we use a novel modelling framework to interrogate a unique case time-series for single and dual infection from Nha Trang, Vietnam. We find that influenza and RSV co-infection substantially increases hospitalisation rates in children. In addition we show that the data supports either no or moderate individual-level cross protection against infection but either way with relatively little population level impact. This alleviates some concerns of heterologous effects of RSV or influenza vaccination, however, particularly in settings with more pronounced and overlapping RSV and influenza seasons the impact of vaccination on the other pathogen’s epidemiology may be more noticeable.

Supporting information

S1 Text. Further technical details and sensitivity analyses.

(DOCX)

Data Availability

The code and summarised data underlying this project are available at https://github.com/NaomiWaterlow/NhaTrang_flu_rsv_interaction.

Funding Statement

NRW was supported by the Medical Research Council (grant number MR/N013638/1). EvL and RME declare funding from the National Institute for Health Research (NIHR) Health Protection Research Unit (HPRU) in Modelling and Health Economics, a partnership between PHE, Imperial College London, and LSHTM (grant number NIHR200908). EvL was supported by the European Union's Horizon 2020 research and innovation programme - project EpiPose (101003688). SF is funded through a Sir Henry Dale Fellowship jointly funded by the Wellcome Trust and the Royal Society (grant number 208812/Z/17/Z). RME acknowledges an HDR UK Innovation Fellowship (grant: MR/S003975/1), MRC (grant: MC_PC 19065), and NIHR (grant: NIHR200908) for the Health Protection Research Unit in Modelling and Economics at LSHTM. The views expressed in this publication are those of the author(s) and not necessarily those of the funders. This ARI surveillance study in Nha Trang was supported by Japan Program for Infectious Diseases Research and Infrastructure, Japan Agency for Medical Research and Development (AMED) under Grant Number JP21wm0125006. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Lafond KE, Nair H, Rasooly MH, Valente F, Booy R, Rahman M, et al. Global Role and Burden of Influenza in Pediatric Respiratory Hospitalizations, 1982–2012: A Systematic Analysis. Tumwine JK, editor. PLOS Med. 2016;13: e1001977–e1001977. doi: 10.1371/journal.pmed.1001977 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Shi T, McAllister DA, O’Brien KL, Simoes EAF, Madhi SA, Gessner BD, et al. Global, regional, and national disease burden estimates of acute lower respiratory infections due to respiratory syncytial virus in young children in 2015: a systematic review and modelling study. Lancet Lond Engl. 2017;390: 946–958. doi: 10.1016/S0140-6736(17)30938-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.WHO | WHO vaccine pipeline tracker. WHO. 2016.
  • 4.Zhang Y, Zhao J, Zou X, Fan Y, Xiong Z, Li B, et al. Severity of influenza virus and respiratory syncytial virus coinfections in hospitalized adult patients. J Clin Virol Off Publ Pan Am Soc Clin Virol. 2020;133: 104685. doi: 10.1016/j.jcv.2020.104685 [DOI] [PubMed] [Google Scholar]
  • 5.Lee YJ, Lee JY, Jang YH, Seo S-U, Chang J, Seong BL. Non-specific Effect of Vaccines: Immediate Protection against Respiratory Syncytial Virus Infection by a Live Attenuated Influenza Vaccine. Front Microbiol. 2018;9: 83–83. doi: 10.3389/fmicb.2018.00083 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Walzl G, Tafuro S, Moss P, Openshaw PJ, Hussell T. Influenza virus lung infection protects from respiratory syncytial virus-induced immunopathology. J Exp Med. 2000;192: 1317–26. doi: 10.1084/jem.192.9.1317 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Glezen WP, Paredes A, Taber LH. Influenza in Children. JAMA. 1980;243: 1345–1345. doi: 10.1001/jama.1980.03300390029017 [DOI] [PubMed] [Google Scholar]
  • 8.Anestad G. Interference between outbreaks of epidemic viruses. Scand J Infect Dis. 1982;39: 653–654. doi: 10.1080/00365540701253860 [DOI] [PubMed] [Google Scholar]
  • 9.Hirsh S, Hindiyeh M, Kolet L, Regev L, Sherbany H, Yaary K, et al. Epidemiological changes of Respiratory Syncytial Virus (RSV) infections in Israel. PLoS ONE. 2014;9. doi: 10.1371/journal.pone.0090515 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Meningher T, Hindiyeh M, Regev L, Sherbany H, Mendelson E, Mandelboim M. Relationships between A(H1N1)pdm09 influenza infection and infections with other respiratory viruses. Influenza Other Respir Viruses. 2014;8: 422–430. doi: 10.1111/irv.12249 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Gröndahl B, Ankermann T, Von Bismarck P, Rockahr S, Kowalzik F, Gehring S, et al. The 2009 pandemic influenza A(H1N1) coincides with changes in the epidemiology of other viral pathogens causing acute respiratory tract infections in children. Infection. 2014;42: 303–308. doi: 10.1007/s15010-013-0545-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Casalegno JS, Ottmann M, Bouscambert-Duchamp M, Valette M, Morfin F, Lina B. Impact of the 2009 influenza a(H1N1) pandemic wave on the pattern of hibernal respiratory virus epidemics, France, 2009. Eurosurveillance. 2010;15: 2–2. doi: 10.2807/ese.15.27.19608-en [DOI] [PubMed] [Google Scholar]
  • 13.Mak GC, Wong AH, Ho WYY, Lim W. The impact of pandemic influenza A (H1N1) 2009 on the circulation of respiratory viruses 2009–2011. Influenza Other Respir Viruses. 2012;6: e6–10. doi: 10.1111/j.1750-2659.2011.00323.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.van Asten L, Bijkerk P, Fanoy E, van Ginkel A, Suijkerbuijk A, van der Hoek W, et al. Early occurrence of influenza A epidemics coincided with changes in occurrence of other respiratory virus infections. Influenza Other Respir Viruses. 2016;10: 14–26. doi: 10.1111/irv.12348 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Nishimura N, Nishio H, Lee MJ, Uemura K. The clinical features of respiratory syncytial virus: Lower respiratory tract infection after upper respiratory tract infection due to influenza virus. Pediatr Int. 2005;47: 412–416. doi: 10.1111/j.1442-200x.2005.02099.x [DOI] [PubMed] [Google Scholar]
  • 16.Pinky L, Dobrovolny HM. Coinfections of the respiratory tract: Viral competition for resources. PLoS ONE. 2016;11. doi: 10.1371/journal.pone.0155589 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Valkenburg SA, Rutigliano JA, Ellebedy AH, Doherty PC, Thomas PG, Kedzierska K. Immunity to seasonal and pandemic influenza A viruses. Microbes Infect. 2011;13: 489–501. doi: 10.1016/j.micinf.2011.01.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Ascough S, Paterson S, Chiu C. Induction and Subversion of Human Protective Immunity: Contrasting Influenza and Respiratory Syncytial Virus. Front Immunol. 2018;9: 323–323. doi: 10.3389/fimmu.2018.00323 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Hamilton J. Club cells surviving influenza A virus infection induce temporary nonspecific antiviral immunity. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Laurie KL, Guarnaccia TA, Carolan LA, Yan AWC, Aban M, Petrie S, et al. Interval Between Infections and Viral Hierarchy Are Determinants of Viral Interference Following Influenza Virus Infection in a Ferret Model. J Infect Dis. 2015;212: 1701–1710. doi: 10.1093/infdis/jiv260 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Yoshida L-M, Suzuki M, Thiem VD, Smith WP, Tsuzuki A, Huong VTT, et al. Population based cohort study for pediatric infectious diseases research in Vietnam. Trop Med Health. 2014;42: 47–58. doi: 10.2149/tmh.2014-S07 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Yoshida LM, Suzuki M, Yamamoto T, Nguyen HA, Nguyen CD, Nguyen AT, et al. VIRAL PATHOGENS ASSOCIATED WITH ACUTE RESPIRATORY INFECTIONS IN CENTRAL VIETNAMESE CHILDREN. Pediatr Infect Dis J. 2010;29: 75–77. doi: 10.1097/INF.0b013e3181af61e9 [DOI] [PubMed] [Google Scholar]
  • 23.Waroux OLPD, Edmunds WJ, Takahashi K, Ariyoshi K, Mulholland EK, Goldblatt D, et al. Predicting the impact of pneumococcal conjugate vaccine programme options in Vietnam. Hum Vaccines Immunother. 2018;14: 1939–1947. doi: 10.1080/21645515.2018.1467201 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Yoshihara K, Le MN, Okamoto M, Wadagni ACA, Nguyen HA, Toizumi M, et al. Association of RSV-A ON1 genotype with Increased Pediatric Acute Lower Respiratory Tract Infection in Vietnam. Sci Rep. 2016;6. doi: 10.1038/srep278562 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Weber A, Weber M, Milligan P. Modeling epidemics caused by respiratory syncytial virus (RSV). Math Biosci. 2001;172: 95–113. doi: 10.1016/s0025-5564(01)00066-9 [DOI] [PubMed] [Google Scholar]
  • 26.Spencer JA, Shutt DP, Moser SK, Clegg H, Wearing HJ, Mukundan H, et al. Epidemiological parameter review and comparative dynamics of influenza, respiratory syncytial virus, rhinovirus, human coronavirus, and adenovirus. medRxiv. 2020; 2020.02.04.20020404. doi: 10.1101/2020.02.04.20020404 [DOI] [Google Scholar]
  • 27.Henderson FW, Collier AM, Clyde WA, Denny FW. Respiratory-Syncytial-Virus Infections, Reinfections and Immunity. N Engl J Med. 1979;300: 530–534. doi: 10.1056/NEJM197903083001004 [DOI] [PubMed] [Google Scholar]
  • 28.Cauchemez S, Carrat F, Viboud C, Valleron AJ, Boëlle PY. A Bayesian MCMC approach to study transmission of influenza: application to household longitudinal data. Stat Med. 2004;23: 3469–3487. doi: 10.1002/sim.1912 [DOI] [PubMed] [Google Scholar]
  • 29.Hayden FG, Treanor JJ, Fritz RS, Lobo M, Betts RF, Miller M, et al. Use of the Oral Neuraminidase Inhibitor Oseltamivir in Experimental Human Influenza. JAMA. 1999;282: 1240–1240. doi: 10.1001/jama.282.13.1240 [DOI] [PubMed] [Google Scholar]
  • 30.Chowell G, Echevarría-Zuno S, Viboud C, Simonsen L, Tamerius J, Miller MA, et al. Characterizing the Epidemiology of the 2009 Influenza A/H1N1 Pandemic in Mexico. Peiris JSM, editor. PLoS Med. 2011;8: e1000436–e1000436. doi: 10.1371/journal.pmed.1000436 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Cori A, Valleron AJ, Carrat F, Scalia Tomba G, Thomas G, Boëlle PY. Estimating influenza latency and infectious period durations using viral excretion data. Epidemics. 2012;4: 132–138. doi: 10.1016/j.epidem.2012.06.001 [DOI] [PubMed] [Google Scholar]
  • 32.Moore HC, Jacoby P, Hogan AB, Blyth CC, Mercer GN. Modelling the Seasonal Epidemics of Respiratory Syncytial Virus in Young Children. Sugrue RJ, editor. PloS One. 2014;9: e100422–e100422. doi: 10.1371/journal.pone.0100422 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Hall CB, Douglas RG, Geiman JM. Respiratory syncytial virus infections in infants: quantitation and duration of shedding. J Pediatr. 1976;89: 11–5. doi: 10.1016/s0022-3476(76)80918-3 [DOI] [PubMed] [Google Scholar]
  • 34.Opatowski L, Baguelin M, Eggo RM. REVIEW Influenza Interaction with Cocirculating Pathogens, and Its Impact on Surveillance, Pathogenesis and Epidemic Profile: A Key Role for Mathematical Modeling. Hobman TC, editor. PLOS Pathog. 2017;14: e1006770–e1006770. doi: 10.1101/203265 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Yoshida L-M, Suzuki M, Nguyen HA, Le MN, Dinh Vu T, Yoshino H, et al. Respiratory syncytial virus: co-infection and paediatric lower respiratory tract infections. Eur Respir J. 2013;42: 461–469. doi: 10.1183/09031936.00101812 [DOI] [PubMed] [Google Scholar]
  • 36.Vousden WD, Farr WM, Mandel I. Dynamic temperature selection for parallel tempering in Markov chain Monte Carlo simulations. Mon Not R Astron Soc. 2016;455: 1919–1937. doi: 10.1093/MNRAS/STV2422 [DOI] [Google Scholar]
  • 37.Thongpan I, Vongpunsawad S, Poovorawan Y. Respiratory syncytial virus infection trend is associated with meteorological factors. Sci Rep. 2020;10: 10931. doi: 10.1038/s41598-020-67969-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Goka E, Vallely P, Mutton K, Klapper P. Influenza A viruses dual and multiple infections with other respiratory viruses and risk of hospitalisation and mortality. Influenza Other Respir Viruses. 2013;7: 1079–1087. doi: 10.1111/irv.12020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Price OH, Sullivan SG, Sutterby C, Druce J, Carville KS. Using routine testing data to understand circulation patterns of influenza A, respiratory syncytial virus and other respiratory viruses in Victoria, Australia. Epidemiol Infect. 2019;147: e221. doi: 10.1017/S0950268819001055 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Meskill SD, Revell PA, Chandramohan L, Cruz AT. Prevalence of co-infection between respiratory syncytial virus and influenza in children. Am J Emerg Med. /03//;35: 495–498. doi: 10.1016/j.ajem.2016.12.001 [DOI] [PubMed] [Google Scholar]
  • 41.Waterlow NR, Flasche S, Minter A, Eggo RM. Competition between RSV and influenza: limits of modelling inference from surveillance data. Epidemics. 2021; 100460. doi: 10.1016/j.epidem.2021.100460 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Kombe IK, Munywoki PK, Baguelin M, Nokes DJ, Medley GF. Model-based estimates of transmission of respiratory syncytial virus within households. Epidemics. 2019;27: 1–11. doi: 10.1016/j.epidem.2018.12.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.McNab S, Ha Do LA, Clifford V, Crawford NW, Daley A, Mulholland K, et al. Changing Epidemiology of Respiratory Syncytial Virus in Australia—delayed re-emergence in Victoria compared to WA/NSW after prolonged lock-down for COVID-19. Clin Infect Dis. 2021. [cited 23 Jun 2021]. doi: 10.1093/cid/ciab240 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Gomez GB, Mahé C, Chaves SS. Uncertain effects of the pandemic on respiratory viruses. Science. 2021;372: 1043–1044. doi: 10.1126/science.abh3986 [DOI] [PubMed] [Google Scholar]
  • 45.Funk S, Salathé M, Jansen VAA. Modelling the influence of human behaviour on the spread of infectious diseases: a review. J R Soc Interface. 2010;7: 1247–56. doi: 10.1098/rsif.2010.0142 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Minter A, Hoschler K, Jagne YJ, Sallah H, Armitage E, Lindsey B, et al. Estimation of Seasonal Influenza Attack Rates and Antibody Dynamics in Children Using Cross-Sectional Serological Data. J Infect Dis. 2020. [cited 14 Jul 2021]. doi: 10.1093/infdis/jiaa338 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Jayasundara K, Soobiah C, Thommes E, Tricco AC, Chit A. Natural attack rate of influenza in unvaccinated children and adults: a meta-regression analysis. BMC Infect Dis. 2014;14: 670. doi: 10.1186/s12879-014-0670-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.CDC. Learn about RSV in Infants and Young Children. In: Centers for Disease Control and Prevention [Internet]. 18 Dec 2020. [cited 14 Jul 2021]. Available: https://www.cdc.gov/rsv/high-risk/infants-young-children.html [Google Scholar]
PLoS Comput Biol. doi: 10.1371/journal.pcbi.1010234.r001

Decision Letter 0

Daniel M Weinberger, Virginia E Pitzer

18 Jan 2022

Dear Mrs Waterlow,

Thank you very much for submitting your manuscript "Evidence for Influenza and RSV interaction from 10 years of enhanced surveillance in Nha Trang, Vietnam, a modelling study." for consideration at PLOS Computational Biology.

As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments.

The reviewers raise important questions and concerns about the model structure and complexity and the description of the model, which need to be addressed.

We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts.

Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Daniel M Weinberger

Guest Editor

PLOS Computational Biology

Virginia Pitzer

Deputy Editor-in-Chief

PLOS Computational Biology

***********************

The reviewers are generally enthusiastic about the analysis but raise important questions and concerns about the model structure and complexity, which need to be addressed.

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: Overall, this is a well-done and clearly-written analysis of interactions between Influenza and RSV using detailed surveillance data from Vietnam. The authors developed an age-stratified transmission model for RSV and influenza, which was fitted to children aged <5 years with either one or two respiratory viruses infections to determine the strength of cross-protection and the effects of co-infections on disease severity. The authors concluded that co-infections increase the probability of being hospitalized and had a bimodal conclusion on cross-protection. The methods employed are well-justified and clearly articulated, and the conclusions appear to be broadly consistent with the results presented. However, I do have a few major comments regarding the methodology.

[1] The authors fitted 15 parameters for each season individually (line 159 and table 1). The maximum time period for each season in the model is 66 weeks and it seems that RSV infections are mostly concentrated between November and May (line 172-line 173 and Figure 1C), which are about 26 weeks. I am concerned that the sparsity of the data may cause issues of parameter identifiability. I find it hard to be convinced that the whole model converged well giving that several parameters showed bimodal posterior distributions. I would recommend the authors use the entire 10 year period with yearly varying parameters of influenza and use weakly informative priors based on published literature, especially for those 0-inf priors.

[2] In the Supplement, Model equations section, the outflow from line 68 -(1-sigma)*lambda_INFi*PS_i does not equal to the inflow in line 72 lambda*PS_i. Also, if the epsilon means introduction rate from external sources, it should not show up as outflows from the susceptible population. It would also help readers to understand the equations if the authors can specify the meaning of each compartment like what is done in main text 138-139 and the captions of Figure 2C.

Minor comments:

Introduction

[3] It may be better to clarify what is the “interaction” that this paper refers to. In lines 88 and 89, “to estimate the strength of cross-protection and the effects of co-infections on disease severity” may be more precise as it corresponds to the conclusions.

Methods

[4] Line 98: Do you have information on the 6% that were not enrolled in the study? Are their demographic background (remote living? who may have less chance of interactions with those living in the city) and contact patterns (such as household size) the same as those enrolled in the study?

[5] Line 100: Can you provide the sensitivity and specificity of the multiplex-PCR test?

[6] Line 198: Please provide information on how many interactions were left for the parameter estimates.

Reviewer #2: PCOMPBIOL-D-21-01994

The authors aim to better quantify the interaction between influenza virus and RSV, using data on pediatric infection from Nha Trang in Vietnam, and using a transmission modeling approach.

I appreciate the challenging nature of this type of study. But in this current form, I find the study lacking in several ways, and I have tried to describe these below. Perhaps some of these shortcomings can be addressed, in which case, it could be a worthwhile contribution to this field.

1. Important parts of the transmission model (and data) are not presented or adequately described.

It is unclear what assumptions the authors make about the dynamics of and transmission from individuals >5 years? It is stated in the methods that older age groups are modeled (which is good), but the data used to calibrate these, and the results (ie, incidence of flu and RSV from model simulations) are lacking.

Given that >5 population will be substantially larger, and may play an overriding role in driving the dynamics of pediatric infections, it should be described with more clarity and supported with data.

Similarly, it is unclear if and how seasonality is modeled. Given seasonal nature of transmission, especially of RSV, I think it would be important to carefully include this.

2. The model for interaction between influenza and RSV, is not conceptualized or described in detail.

In the background, authors describe that 1. increased severity of co-infections and 2. cross protection between two viral infections as the two pathways of interactions that the authors are interested in estimating.

However, it is unclear how is severity of co-infections are modeled; and what data are used to measure severe forms of co-infections.

For example, cross protection is modeled in a specific way, and it is unclear to me that the assumptions are justified. For example, it is assumed to be symmetric -- that protection from an infection of influenza to RSV would be the same in the opposite direction?

The evidence that authors cite in the background are mostly protection from prior influenza infection on RSV. At the very least, the modeling framework should be flexible to allow for protective interaction in one direction.

The fact that they find bimodality in their results may also be pointing to this.

Relatedly, while the duration of the cross protection is explored, the onset of the cross-protection is assumed to begin instantaneously. It would be importantly explore the timing, especially given that some of the studies they site report protection after several weeks.

3. I find it hard to make sense of the findings -- 41% cross-protection for 10 days or nothing. I can make sense of a finding where the data and the model are not able to find statistically significant evidence of interaction -- that no interaction and some interactions are equally likely.

But from what the authors are presenting, it appears to argue for two very distinct, yet very clearly defined interactions, which seems to be contradictory. I think this aspect needs to be explored in greater detail.

A few options may be:

(i) exploring more flexible forms of interaction (eg, allowing for asymmetry or delay in onset, as I have argued in 2)

(ii) showing simulations of two explanations -- whether one model captures certain features of the data better.

(iii) showing profile likelihoods for rho, to clearly show how evidence for the estimates compare.

Minor points/comments:

Abstract:

Line 24: Unclear what "heterologous ecological changes" means. Suggest simplifying the language.

Lines 31-33: The statement seems confusing or contradictory. Is this meant to suggest that you data cannot distinguish between

Lines 33-35: I do not understand what the two respective scenarios with 7.2 and 16.6 fold increases are -- perhaps something is missing?

Background:

One thing to point out in describing the two potential types of interactions, increased severity of co-infections and protective effect of influenza on RSV, is also the timing of those.

Clarifying in these studies the evidence for concurrent infections vs consecutive ones, would be helpful to the readers.

Perhaps useful to stipulate the specific types of cross-protection you are describing, particularly those in which two viral agents are not related antigenically.

Methods

It would useful to know the population denominators for Nha Trang.

It is unclear how seasonality is modeled, if it is at all?

Figure 1: Age groups do not include 4-5 years?

Figure 2: Part of this figure is illegible, especially panel C, model diagram, both due to smal text size and the quality of the figure.

Reviewer #3: Overall I think the authors present a strong, well-written, and interesting paper that will help improve our understanding of the interactions between various respiratory pathogens, and the implications for public health. I should make clear that I am not an expert in mathematical modeling, though what the authors describe having done seems reasonable to me. I do have a few minor comments/suggestions for the authors that I think will help improve the overall clarity and readability of the manuscript.

Comments:

Pg 7 (lines 62-63): This study was only in adults. The evidence in children has been far more mixed. Edit: I see you addressed this later on!

Pgs 10-11 (lines 144-145) and pg 11 (lines 162-163): Upon first reading these sentences they appear to contradict each other. After looking at it a bit more closely it becomes clear that they do not, but I would recommend revising these sentences to make this more apparent. Your language in the discussion (pg 22, lines: 343-345) was particularly helpful in understanding the reasoning behind your approach, but addressing this earlier in the methods of the paper would be helpful.

Pg 15 (lines: 209-212): The reasoning behind the second sensitivity analysis is a bit confusing as it is currently written. I would suggest the authors revise these sentences a bit to make this clearer.

Pg 19 figure 2A: It appears that the dual infections tended to cluster in certain years which might indicate the importance of subtype specific interactions. While I appreciate the substantial complexity that influenza and RSV subtypes would add to the model, if you have data on the influenza and/or RSV subtypes that tended to predominate in years where dual infections were more/less frequently observed this would be quite helpful to include in the descriptive analysis.

Pgs 20-21 (lines: 310-313): The setting of this analysis I think is a strength as many of the countries where respiratory viruses circulate at low levels year-round are the same countries with limited influenza vaccine uptake.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No: Please refer to general comments

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1010234.r003

Decision Letter 1

Daniel M Weinberger, Virginia E Pitzer

20 May 2022

Dear Mrs Waterlow,

We are pleased to inform you that your manuscript 'Evidence for Influenza and RSV interaction from 10 years of enhanced surveillance in Nha Trang, Vietnam, a modelling study.' has been provisionally accepted for publication in PLOS Computational Biology.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

You may also wish to address the small (optional) comment from the reviewer below.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. 

Best regards,

Daniel M Weinberger

Guest Editor

PLOS Computational Biology

Virginia Pitzer

Deputy Editor-in-Chief

PLOS Computational Biology

***********************************************************

Thanks for your re-submission and apologies for the long review--it was difficult to wrangle the reviewers to have a look at it. I am recommending acceptance; Reviewer 1 does have 1 comment that could be addressed if you would like to address it with a minor revision. Comment from Reviewer 1: "One thing that can be improved is the discussion of simulation as shown in reviewer 2’s comment. The author can discuss how well their model structure is able to capture the parameter space based on their previously published simulation study entitled Competition between RSV and influenza: Limits of modelling inference from surveillance data."

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: The authors addressed all the comments pretty well. I do not have any further comments except for one, which is also optional.

One thing that can be improved is the discussion of simulation as shown in reviewer 2’s comment. The author can discuss how well their model structure is able to capture the parameter space based on their previously published simulation study entitled Competition between RSV and influenza: Limits of modelling inference from surveillance data.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Zhe Zheng

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1010234.r004

Acceptance letter

Daniel M Weinberger, Virginia E Pitzer

21 Jun 2022

PCOMPBIOL-D-21-01994R1

Evidence for Influenza and RSV interaction from 10 years of enhanced surveillance in Nha Trang, Vietnam, a modelling study.

Dear Dr Waterlow,

I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Marianna Bach

PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Text. Further technical details and sensitivity analyses.

    (DOCX)

    Attachment

    Submitted filename: NhaTrang Reviewer response.pdf

    Data Availability Statement

    The code and summarised data underlying this project are available at https://github.com/NaomiWaterlow/NhaTrang_flu_rsv_interaction.


    Articles from PLoS Computational Biology are provided here courtesy of PLOS

    RESOURCES