Abstract
Background
Seasonal influenza activity showed a sharp decline in activity at the beginning of the emergence of COVID-19. Whether there is an epidemiological correlation between the dynamic of these 2 respiratory infectious diseases and their future trends needs to be explored.
Objective
We aimed to assess the correlation between COVID-19 and influenza activity and estimate later epidemiological trends.
Methods
We retrospectively described the dynamics of COVID-19 and influenza in 6 World Health Organization (WHO) regions from January 2020 to March 2023 and used the long short-term memory machine learning model to learn potential patterns in previously observed activity and predict trends for the following 16 weeks. Finally, we used Spearman correlation coefficients to assess the past and future epidemiological correlation between these 2 respiratory infectious diseases.
Results
With the emergence of the original strain of SARS-CoV-2 and other variants, influenza activity stayed below 10% for more than 1 year in the 6 WHO regions. Subsequently, it gradually rose as Delta activity dropped, but still peaked below Delta. During the Omicron pandemic and the following period, the activity of each disease increased as the other decreased, alternating in dominance more than once, with each alternation lasting for 3 to 4 months. Correlation analysis showed that COVID-19 and influenza activity presented a predominantly negative correlation, with coefficients above –0.3 in WHO regions, especially during the Omicron pandemic and the following estimated period. The diseases had a transient positive correlation in the European region of the WHO and the Western Pacific region of the WHO when multiple dominant strains created a mixed pandemic.
Conclusions
Influenza activity and past seasonal epidemiological patterns were shaken by the COVID-19 pandemic. The activity of these diseases was moderately or greater than moderately inversely correlated, and they suppressed and competed with each other, showing a seesaw effect. In the postpandemic era, this seesaw trend may be more prominent, suggesting the possibility of using one disease as an early warning signal for the other when making future estimates and conducting optimized annual vaccine campaigns.
Keywords: COVID-19, influenza, negative correlation, seesaw effect, respiratory infectious disease, epidemiological trends
Introduction
Influenza was primarily characterized as a seasonal epidemic before the COVID-19 pandemic. Stringent public health and social interventions (PHSMs) were implemented in early 2020 to contain the spread of SARS-CoV-2, and influenza activity also declined [1-3]. However, during the latest winter and spring, influenza re-emerged and had a three-year-high level of activity in China [4] and other countries [5] at the same time that there was reduced virulence of Omicron and easing of PHSMs. Under the same natural conditions and PHSMs in a region, there seems to be a subtle relationship between these 2 respiratory infections. For example, they have been found to cocirculate and to coinfect people [6], but most study subjects have been COVID-19 patients [6,7]. General population-based epidemiological patterns and regularities have not yet been fully explored.
Member countries of the World Health Organization (WHO) regions update influenza activity data weekly in the FluNet, a web-based global influenza virology surveillance tool first introduced in 1997 [8]. The WHO divides member countries into 6 regions based on their location, including the African region (AFRO), Eastern Mediterranean region (EMRO), European region (EURO), Americas region (AMRO), Southeast Asian region (SEARO), and Western Pacific region (WPRO) [9]. Since January 2020, a subset of member countries in each region have also reported their national test positivity rates for SARS-CoV-2 on a weekly basis. Influenza sentinel surveillance systems were leveraged to integrate SARS-CoV-2 testing in specimens from influenza surveillance sources. The genomic sequencing of SARS-CoV-2 from representative and systematically sourced sentinel specimens has been expedited to monitor the trends and prevalence (ie, proportions) of existing and emerging circulating and cocirculating genetic variants (ie, clades) and to improve the geographic and demographic representativeness and timeliness of SARS-CoV-2 genetic-sequence data in publicly accessible databases to inform PHSMs [10].
Most studies have conducted epidemiological analyses and estimation of COVID-19 or influenza by leveraging infectious disease dynamics models [11-13] (eg, the susceptible-exposed-infected-removed model), but few have predicted trends based on longer time series and machine learning during the past 3 years. These models help tackle multimodal data and are increasingly being used in auxiliary diagnosis and other medical areas [14,15]. They are composed of different networks with various connections, referred to as neural networks or neural-like networks, to achieve automated learning and prediction by mimicking the neural network construction of the human brain. This method is highly adaptable and can adjust itself to diverse data sets, thus adapting itself to different application scenarios. Secondly, deep learning avoids human specification by automatically extracting data features and processing them. This is highly scalable and can improve simulation performance by increasing the network layers and nodes to cope with larger-scale data and more complex problems [16]. Therefore, more learning models could be introduced into infectious disease surveillance and studies.
In this study, we examined global changes in COVID-19 and influenza activity since 2020, aiming to assess the correlation between COVID-19 and influenza activity and estimate upcoming trends with the help of a deep learning model. The findings may provide a theoretical reference for the epidemiological patterns of these 2 respiratory infectious diseases and insights for future interventions.
Methods
Summary of the Study Design
In this study, we retrospectively described the dynamics of COVID-19 and influenza in the 6 WHO regions from January 2020 to March 2023 and used a neural network model to learn potential patterns of previously observed activity to predict trends for the next 16 weeks. Finally, based on an epidemiological perspective, Spearman correlation coefficients were used to assess the past and future correlations. The analysis was performed using Python (version 3.9.6; Python Software Foundation).
Data Source
The test positivity rate was used as an accurate indicator of disease activity; this method used the number of positive tests as the numerator and the specimens processed as the denominator. We extracted the weekly test positivity rates for influenza and SARS-CoV-2 from reports to FluNet between January 12, 2020, and March 26, 2023 [10], covering the AFRO, EMRO, EURO, AMRO, SEARO, and WPRO. The detailed raw data names and sources are presented in Multimedia Appendix 1, Table S1.
Model Construction
Based on the 3-year activity of COVID-19 and influenza, we used a long short-term memory (LSTM) machine learning model to estimate trends in the following 16 weeks. LSTM is widely applied to stock and sales forecasting, specializing in a unique memory cell structure that can process long time-series information more effectively than other net models. It can be trained directly on the series without smoothness requirements, reducing the need for artificial intervention and enhancing objectivity [16]. The LSTM transforms the traditional neurons of a neural network into store cells, which are capable of storing and transmitting the hidden information in a time series (Figure 1).
The LSTM converts conventional neurons into a storage unit containing a matrix of 3 gating devices: input gate, forgetting gate, and output gate. These combine to control the data information flow and store the hidden information in the time series [17], hence solving the gradient disappearance [18,19] (Figure 1).
First, the forgetting gate filters the information in the unit Ct–1 at the previous moment t–1, and how much of its Ct–1 information is retained depends on the forget gate ft that has the range [0, 1]; ft is set as 1 or 0 and in between, with the information of Ct–1 corresponding to all retained, all forgotten, and partially forgotten proportions, respectively. In the forgetting gate unit equation (equation 1), let Wf, Xt, yt–1, and bf denote the weight of the forgetting gate, the input at time t, the hidden state at time t–1, and the bias of the forget gate. The sigmoid activation function is σ (equation 2).
Second, the input gate represents the information acquired at the moment t. It determines how much information from the input Xt at the moment t can be saved in the unit Ct (equations 3 and 4). Wi and Wc are the weights of the input gates. The biases of the input gates are bi and bc, and tanh is the activation function (equation 5).
Third, the update of the unit status Ct (equation 6) depends on two parts: One is the product of the unit status Ct at the moment t–1 and the forget gate ft, namely the retained information, and the other part is the product of the input unit status C ~t at the present moment t and the input gate it, namely the new information obtained. C ~t is the input node at time t.
Fourth, the output gate is used to output the hidden status yt at the moment t (equations 7 and 8). Wo and bo are the respective weights and biases of the output gates.
Model Performance Evaluation and Selection of Optimal Parameters
To enhance the model prediction accuracy and scalability, we used the mean absolute percentage error and root mean squared error as evaluation indicators to determine the optimal proportion of training set and test set, as well as step size, layers, nodes, and algorithms [20,21], for different regions. The selection process is detailed in Multimedia Appendix 1, Tables S2-S6.
Correlation Analysis
We referred to the WHO list of the currently circulating variants of concern of SARS-CoV-2 [22] and the study objectives to uniformly divide all regions into 5 time periods to analyze the correlations: these periods covered the original strain (January 2020 to November 2020), cocirculation of a multivariant strain (referred to as “others”; December 2020 to April 2021), Delta (May 2021 to November 2021), Omicron (November 2021 to March 2023), and the period estimated by the models (March 2023 to July 2023). The starting and ending dates of variant pandemics in different regions differed slightly. In the 6 WHO regions, the Spearman nonparametric analysis of COVID-19 and influenza activity was conducted sequentially to identify whether the epidemiological patterns were correlated across the 5 time periods mentioned above. The correlation analysis was not intended to reveal causality but rather to identify and explain significant trends.
Ethical Statement
As only published data were used for this study, ethical approval was not necessary.
Results
Description of Past Trends
Before the Delta variant emerged, the activity of the original strain and other variants of SARS-CoV-2 was higher than that of influenza in the 6 regions. Among the regions, SARS-CoV-2 activity was observed in AFRO, EMRO, and AMRO at a high level (peaking at over 30%), and influenza activity was at a low level (peaking at about less than 10%). Both fluctuated with low activity levels (less than 15% overall), but influenza activity was relatively lower in SEARO, WPRO, and EURO.
Following the emergence of Delta as the globally dominant strain, influenza activity began to increase in WHO regions, but in the AMRO and EURO, activity was less than 10% and remained below that of Delta. In the other 4 WHO regions, Delta activity reached a peak (over 30%) and then declined to below 10%, and the decline was accompanied by a step-up in influenza activity to 10% to 20% until the advent of Omicron.
During the first 3 months of the Omicron pandemic, influenza activity in the 6 regions first declined alongside soaring Omicron activity and then increased immediately when Omicron plummeted, whereas the influenza test positivity rate overall was consistently lower than that of Omicron. Thereafter, their trends were identical; each declined as the other rose. This occurred 1 to 2 more times, being more apparent in EMRO, AMRO, WPRO, and EURO; each alternation, when influenza activity was higher than Omicron or vice versa, lasted for about 3 to 4 months (Figure 2).
Estimated COVID-19 and Influenza Trends
We estimated the dynamics of COVID-19 and influenza activity for 16 weeks after the study observation end point (March 26, 2023). The estimation was that they would be alternatingly prevalent at less than 40% positivity rates, except for AMRO (over 40%). In SEARO and EURO, it was estimated that influenza and COVID-19 activity would be closely matched, with both hovering around 10% positivity rates; in AFRO and EMRO, influenza activity would rise from 10% to about 20% to 30%, while COVID-19 activity would decrease from similar levels to less than 5%, and COVID-19 activity would no longer be consistently higher than influenza. Conversely, influenza could decrease to below 10% in AMRO and WPRO as COVID-19 activity might go up to above 30% (Figure 2).
Correlation Between COVID-19 and Influenza Activity in Different Time Periods
The Spearman coefficients were calculated for different phases of COVID-19 and influenza activity. In our study, correlation coefficients less than 0.3, 0.3 to less than 0.6, and more than or equal to 0.6 were considered weak, moderate, and strong correlations, respectively. Statistically, COVID-19 and influenza were moderately and negatively correlated in EMRO, AMRO, and WPRO during the original-strain pandemic (–0.355, –0.593, –0.448) and also in EMRO (–0.358) during the multivariant mixed pandemic, while they were transiently, strongly, and positively correlated in EURO and WPRO (0.621 and 0.667). During the Delta pandemic, the 2 diseases were moderately and negatively correlated in AFRO, EMRO, and AMRO (–0.472, –0.422, –0.351). During the Omicron pandemic, they were moderately and negatively correlated in EMRO, AMRO, and SEARO (–0.403, –0.370, –0.469) and highly negatively correlated in EURO (–0.702). Similarly, in the estimated 16-week trend, they showed more significant and highly negative correlations in AFRO, EMRO, and WPRO (–0.724, –0.791, –0.600) and a moderate negative correlation in EURO (–0.474). Overall, COVID-19 and influenza activity were significantly negatively correlated, with coefficients greater than 0.3, especially during the Omicron pandemic and in the upcoming period. No significant correlation was found for other pandemic phases and WHO regions (Figure 3).
Discussion
Principal Findings
This study analyzed the dynamics of COVID-19 and influenza in 6 WHO regions over the past 3 years and estimated them in the following 16 weeks. We found that early in the pandemic, when COVID-19 was emerging as an infectious disease, influenza activity stayed below 10% for more than 1 year in the 6 WHO regions. Subsequently, influenza activity gradually rose as Delta activity dropped, but still peaked at a level below that of Delta. Omicron alternated with influenza as the dominant disease. The trend of one disease declining as another rises has been named the seesaw effect [23] and was clearly apparent in the epidemiological patterns of the 2 infectious diseases in this study, characterized by increasing magnitude and frequency, with each alternation have a duration of about 3 to 4 months, suggesting a competitive relationship. The seesaw effect of alternating dominance is likely to become more conspicuous in the postpandemic era. Negative correlation coefficients for different WHO regions and time periods statistically complement the validation of this effect.
Our quantitative analysis based on epidemiological indicators (test positivity rates from the population) showed the dynamic patterns of the 2 respiratory diseases, which have similar transmission modes. The generation and variation of the seesaw effect could be related to numerous factors. On the one hand, from a biological perspective, respiratory viruses share the same host; therefore, viruses compete with each other for susceptible cells in the host. Cells invaded by one respiratory virus produce immune interference that drives uninfected neighboring cells to adopt a protectively antiviral status [24,25], making the host resistant or only partially susceptible to subsequent viruses. One example is the significant decrease in rhinovirus prevalence in patients during peak influenza activity [26]. On the other hand, this effect varies in magnitude and duration across regions, which could be driven by the different intensity of PHSMs adopted in different countries [27-30] and time periods [31], differences in vaccination and natural infection status, or variant strain properties. For example, the earliest adoption of strict nonpharmaceutical interventions in China not only controlled the spread and dissemination of the original strain [32], but also reduced influenza activity by 82%, and by 64% in the north and south [3]. Interestingly, after the PHSMs, influenza activity in China in the latest winter was at a low level because of the rapid rise in Omicron infections in the population at the same time, and after the Omicron test positivity rate dropped, influenza activity jumped sharply, to over 50%. This once again suggests that driving factors influence the magnitude of the seesaw effect and the timing of its onset. In addition, the higher virulence of the original strain attacked individuals more and longer [6], resulting in less opportunity for influenza virus infection; thus, absolute suppression occurred in the first year of the COVID-19 pandemic. The more moderate virulence and lower severity of Delta and Omicron allow the possibility of infecting the host with influenza, which may explain why influenza activity increased after the Delta pandemic and was able to dominate during the Omicron period.
During the multivariant pandemic period, the dynamics of COVID-19 and influenza had short-term positive correlations in EURO and WPRO, while negative correlations were not significant in other regions. Temporary phenomena mediated by complex factors, such as the sudden appearance of variants, require more evidence to unravel their underlying mechanisms. Similar phenomena have been observed in other studies: there are reports of coinfection with SARS-CoV-2 and influenza A in some countries [33-36], and meta-analyses based on the November 2019 to August 2021 period [37] all showed coinfection with both diseases. Nevertheless, most study subjects have been COVID-19 patients or laboratory animals rather than the general population [37,38], with a low proportion of observed coinfections (about 1%) or small sample sizes [39] before and during the Omicron pandemic [37,40]. Inevitably, the positive correlation for susceptibility to coinfection at the individual level or in some high-risk populations might lead to serious clinical outcomes [41]; therefore, much larger, sample-based meta-studies are warranted to explore the reasons for this phenomenon to prevent and control it or to meet the potential surge in hospital visits and demand. In addition, it is worth noting that other respiratory infectious diseases have been threatening humans. Further research on the interactions between respiratory pathogens other than COVID-19 and influenza remains to be done. Regardless of the fate of COVID-19, influenza, or other respiratory pathogens, necessary personal protection and vaccination should be implemented.
Our study provided qualitative and quantitative assessments of the interaction between COVID-19 and influenza. We identified a seesaw effect between COVID-19 and influenza activity based on a competitive effect from an epidemiological perspective, echoing viral antagonism from a historical pathogenic perspective. This finding can be used to guide disease surveillance, early warning, and intervention; for example, real-time surveillance of viral dynamics can be used to estimate trends in other diseases or stagger vaccinations in response to alternating epidemics or pandemics.
Limitations
There are some limitations to mention. First, the high uncertainty of viral variation, changes in influenza visit behavior triggered by early and rigorous interventions, the decline in SARS-CoV-2 tests in some countries, and other unforeseen factors all interfered with the observed positive test numbers for the 2 diseases studied. Hence, we used the test positivity rate rather than the number of positive tests as an indicator of activity and divided the time periods to minimize the negative impact. Second, the raw data may not fully represent the overall trend in each area because of the limited number of member countries that periodically report to the WHO. Nevertheless, there is no more authoritative data source for COVID-19 and influenza activity.
Conclusions
Influenza activity and former seasonal epidemiological patterns were shaken by the COVID-19 pandemic. Their activities were inversely correlated to a moderate or greater degree, and they suppressed and competed with each other, showing a seesaw effect. In the postpandemic era of COVID-19, seesaw trends will be more prominent, prompting the possibility of using one disease as an early warning signal for the other for future estimates; this could be used to conduct optimized annual vaccine campaigns.
Acknowledgments
We sincerely thank all the member of the Infectious Diseases Team at the School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College. This study was supported by the Non‑profit Central Research Institute Fund of the Chinese Academy of Medical Sciences (2021‑RC330‑002) and the Chinese Academy of Medical Sciences Innovation Fund for Medical Sciences (2021-I2M-1-044, 2020-I2M-1-001). The funding sources had no role in data collection or interpretation or decisions relating to data publication.
Abbreviations
- AFRO
African region of WHO
- AMRO
Americas region of the WHO
- EMRO
Eastern Mediterranean region of the WHO
- EURO
European region of the WHO
- LSTM
long short-term memory
- PHSM
public health and social measures
- SEARO
Southeast Asia region of the WHO
- WHO
World Health Organization
- WPRO
Western Pacific region of the WHO
Supplementary material and tables for the methods and results.
Data Availability
The data are available in the FluNet repository [10]. The code generated and analyzed during this study are available from the corresponding author on reasonable request.
Footnotes
Authors' Contributions: QW and LF conceptualized and designed the study. QW, JY, PD, YS, and JQ performed data collection. QW, M Jia, and WL performed data analysis and model construction. QW and M Jiang wrote the first draft. LF and WY supervised the project. All authors read and approved the final manuscript. Authors LF and WY (yangweizhong@cams.cn) are cocorresponding authors for this article.
Conflicts of Interest: None declared.
References
- 1.Olsen SJ, Azziz-Baumgartner Eduardo, Budd AP, Brammer L, Sullivan S, Pineda RF, Cohen C, Fry AM. Decreased influenza activity during the COVID-19 pandemic-United States, Australia, Chile, and South Africa, 2020. Am J Transplant. 2020 Dec;20(12):3681–3685. doi: 10.1111/ajt.16381. https://linkinghub.elsevier.com/retrieve/pii/S1600-6135(22)21652-9 .S1600-6135(22)21652-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Sakamoto H, Ishikane M, Ueda P. Seasonal influenza activity during the SARS-CoV-2 outbreak in Japan. JAMA. 2020 May 19;323(19):1969–1971. doi: 10.1001/jama.2020.6173. https://europepmc.org/abstract/MED/32275293 .2764657 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Feng L, Zhang T, Wang Q, Xie Y, Peng Z, Zheng J, Qin Y, Zhang M, Lai S, Wang D, Feng Z, Li Z, Gao GF. Impact of COVID-19 outbreaks and interventions on influenza in China and the United States. Nat Commun. 2021 May 31;12(1):3249. doi: 10.1038/s41467-021-23440-1. doi: 10.1038/s41467-021-23440-1.10.1038/s41467-021-23440-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Influenza Weekly Report. Chinese National Influenza Center. [2023-04-13]. https://ivdc.chinacdc.cn/cnic/zyzx/lgzb/202304/t20230413_265257.htm .
- 5.Global Influenza Programme. World Health Organization. [2023-04-12]. https://www.who.int/teams/global-influenza-programme/surveillance-and-monitoring/influenza-updates .
- 6.Swets MC, Russell CD, Harrison EM, Docherty AB, Lone N, Girvan M, Hardwick HE, ISARIC4C Investigators. Visser LG, Openshaw PJM, Groeneveld GH, Semple MG, Baillie JK. SARS-CoV-2 co-infection with influenza viruses, respiratory syncytial virus, or adenoviruses. Lancet. 2022 Apr 16;399(10334):1463–1464. doi: 10.1016/S0140-6736(22)00383-X. https://linkinghub.elsevier.com/retrieve/pii/S0140-6736(22)00383-X .S0140-6736(22)00383-X [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Kawai S, Fukushima K, Yomota M, Fukuda A, Fujiwara S, Tanaka M, Kobayashi T, Yajima K, Hosomi Y, Imamura A. Number of patients with influenza and COVID-19 coinfection in a single Japanese hospital during the first wave. Jpn J Infect Dis. 2021 Nov 22;74(6):570–572. doi: 10.7883/yoken.JJID.2020.1009. doi: 10.7883/yoken.JJID.2020.1009. [DOI] [PubMed] [Google Scholar]
- 8.FluNet. World Health Organization. [2023-03-10]. https://www.who.int/tools/flunet .
- 9.WHO regional offices. World Health Organization. [2023-03-10]. https://www.who.int/about/who-we-are/regional-offices .
- 10.Influenza and SARS-CoV-2 surveillance data reported to FluNet. World Health Organization. [2023-04-10]. https://tinyurl.com/y6crsw4u .
- 11.Franco N. COVID-19 Belgium: Extended SEIR-QD model with nursing homes and long-term scenarios-based forecasts. Epidemics. 2021 Dec;37:100490. doi: 10.1016/j.epidem.2021.100490. https://linkinghub.elsevier.com/retrieve/pii/S1755-4365(21)00041-4 .S1755-4365(21)00041-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Shin H. A multi-stage SEIR(D) model of the COVID-19 epidemic in Korea. Ann Med. 2021 Dec;53(1):1159–1169. doi: 10.1080/07853890.2021.1949490. https://europepmc.org/abstract/MED/34269629 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Wang Y, Wang P, Zhang S, Pan H. Uncertainty modeling of a modified SEIR epidemic model for COVID-19. Biology (Basel) 2022 Aug 02;11(8):1157. doi: 10.3390/biology11081157. https://www.mdpi.com/resolver?pii=biology11081157 .biology11081157 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Wu X, Wang H, Shi P, Sun R, Wang X, Luo Z, Zeng F, Lebowitz MS, Lin W, Lu J, Scherer R, Price O, Wang Z, Zhou J, Wang Y. Long short-term memory model - A deep learning approach for medical data with irregularity in cancer predication with tumor markers. Comput Biol Med. 2022 May;144:105362. doi: 10.1016/j.compbiomed.2022.105362. https://linkinghub.elsevier.com/retrieve/pii/S0010-4825(22)00154-8 .S0010-4825(22)00154-8 [DOI] [PubMed] [Google Scholar]
- 15.Lu JY, Zhu J, Zhu J, Duong TQ. Long-short-term memory machine learning of longitudinal clinical data accurately predicts acute kidney injury onset in COVID-19: a two-center study. Int J Infect Dis. 2022 Sep;122:802–810. doi: 10.1016/j.ijid.2022.07.034. https://linkinghub.elsevier.com/retrieve/pii/S1201-9712(22)00429-5 .S1201-9712(22)00429-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997 Nov 15;9(8):1735–80. doi: 10.1162/neco.1997.9.8.1735. [DOI] [PubMed] [Google Scholar]
- 17.Shu X, Tang J, Qi G, Liu W, Yang J. Hierarchical long short-term concurrent memory for human interaction recognition. IEEE Trans Pattern Anal Mach Intell. 2021 Mar;43(3):1110–1118. doi: 10.1109/TPAMI.2019.2942030. [DOI] [PubMed] [Google Scholar]
- 18.Jo Y, Lee L, Palaskar S. Combining LSTM and latent topic modeling for mortality prediction. ArXiv. doi: 10.48550/arXiv.1709.02842. Preprint posted online Sep 8, 2017. https://arxiv.org/pdf/1709.02842.pdf . [DOI] [Google Scholar]
- 19.DiPietro R, Hager G. Deep learning: RNNs and LSTM. In: Zhou SK, Rueckert D, Fichtinger G, editors. Handbook of Medical Image Computing and Computer Assisted Intervention. Cambridge, MA: Academic Press; 2020. pp. 503–519. [Google Scholar]
- 20.Zhang J, Nawata K. Multi-step prediction for influenza outbreak by an adjusted long short-term memory. Epidemiol Infect. 2018 May;146(7):809–816. doi: 10.1017/S0950268818000705. https://europepmc.org/abstract/MED/29606177 .S0950268818000705 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Xu J, Wu Q. Prediction on influenza-like virus pathogen and its effects on prognosis of patients with community acquired pneumonia under long and short term memory neural network model. Results Phys. 2021 May;24:104079. doi: 10.1016/j.rinp.2021.104079. https://pdf.sciencedirectassets.com/280687/1-s2.0-S2211379721X00046/1-s2.0-S2211379721002394/main.pdf?X-Amz-Security-Token=IQoJb3JpZ2luX2VjEI3%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLWVhc3QtMSJHMEUCIQDAv8qgRNlTqMiGZrRieo5aEjjuXB9hwx6o%2B%2BRc9v6dFgIgBI6ypzm4bnoPPHxew0XYz2S7kbg1srCoQho%2F4wxGLJsqvAUIxf%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FARAFGgwwNTkwMDM1NDY4NjUiDGr9fhIVUmniIczwiCqQBZSTd0GnhRNlGdhHnPHyjOqXe4lK1PYncHcF9jMId2IwaSRrKR2QAjhU0EkYbKbLKz5X1dTgmUlWLvAmCqRLshqvPSbrSwWeQ%2FHgFqjZpQOOSYLbyMObPdiXePMNkXrk%2F2%2FxGI8gNc%2FFU70Mb%2BsXuRiV83iWuUdbzokoC2f4fbdWk9Jnuvg10Vh69CyTlhIJmTSeSFKGE2UOC1%2B66NYZNL4KdSDJvQk6hu0TgRlCKASbvBNmlNMcNvQifTGnqIlY51DRhATJ8ugMAwK3oAUMi1IkCeTewl26u%2F1%2BF2qBYkqADE1OQQOlXvb5YhOFIgTipafP2Ax%2BANM%2Fo8lT%2FT04d%2BSYIdi4aeKrgMcd%2BMuvWYrRNSZNNndHVb0pK%2BDk7b%2Fjy4wxsqg9CGEhYKjdFhZ%2BP7Xiu0Kqxbdf%2BIkvwAKeLCVw079WPcM%2BcCTn%2FPNAggVMe6k4iir50nap3LP4y29PWpwD3WVxxl6bwtkYjUG4%2F%2BTGUWntt10VAo22ypNdQClq8TZJ9OR3zmnGm8Xs9xzvotwXPUROtJBwcGfqRBGj%2BWIcsdOnB%2BEKcXTSW6gmia5%2BkWWeJgDTZnaFyg7TLa9soRrL%2Bw63D1ay%2FIot2FwniG9A2vgInKm9OydcTJsj7uvlGiNOFXLSVOREOeMNUzEtiSKZuPeLL8KnH1p3vLwGyFjmjF3j8SiS4O%2BPV3ZuFfd4DXsIShvNHUq%2FKoBjfs2%2BcAOtMaQaTu%2BLusY3eEuFLcDKRTT4nvd59idO2zxkuxfAAfGvrYXHTC4I2ZjIR0paCpttGtC6NA8ZBvon7DOryHZDzfaaY7%2B69qPFRP0BmeYwGZYcREQSfEPjDswQVJjcH9Net7VJ6IReNK07zWL5E47tMI7346MGOrEB2BdrEbxxBIKz9sEbWM0tpB3t8NpeLiyLQWgkpH99AUwvqCC7gVBtUPfncw1fFcNjeKdgNrGJZuowBfmFY%2FSfflV3fB%2BMhLKXcMjdV5aO1NZAkiae7cUBjt6Pe79EcCIXehlAamBdjaJY35lzd%2FWGMRnq09NfVJ8XX0xQaOUmpQz3XMOwMGVJxXrA%2BckMMNCh5nU%2B2RrHRI4xgYbmo8P8FGYbZwH9hwuhUbsFgqNsklXM&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20230601T214743Z&X-Amz-SignedHeaders=host&X-Amz-Expires=300&X-Amz-Credential=ASIAQ3PHCVTYVFHALQ4V%2F20230601%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Signature=e96e2504d29e136edb5b93385d545a312ee38ea130a85966427a4bc2eeb538d7&hash=45e6d68d14108a3b15a1c45541ead5ebf4da267ea15b53c532e06e090c2fdf44&host=68042c943591013ac2b2430a89b270f6af2c76d8dfd086a07176afe7c76c2c61&pii=S2211379721002394&tid=spdf-8432f98f-b26f-42ad-88da-5f601ebf1f58&sid=08aa08504fa5794fb65aa9b89152e671fb95gxrqa&type=client&tsoh=d3d3LnNjaWVuY2VkaXJlY3QuY29t&ua=190e560b5f0f075e5005&rr=7d0aa81cbffaa20a&cc=ca . [DOI] [Google Scholar]
- 22.Tracking SARS-CoV-2 variants. World Health Organization. [2023-04-10]. https://www.who.int/activities/tracking-SARS-CoV-2-variants .
- 23.Ortwine JK, Werth BJ, Sakoulas G, Rybak MJ. Reduced glycopeptide and lipopeptide susceptibility in Staphylococcus aureus and the "seesaw effect": Taking advantage of the back door left open? Drug Resist Updat. 2013;16(3-5):73–9. doi: 10.1016/j.drup.2013.10.002.S1368-7646(13)00027-7 [DOI] [PubMed] [Google Scholar]
- 24.Chan K, Carolan L, Korenkov D, Druce J, McCaw J, Reading P, Barr Ian G, Laurie Karen L. Investigating viral interference between influenza A virus and human respiratory syncytial virus in a ferret model of infection. J Infect Dis. 2018 Jul 02;218(3):406–417. doi: 10.1093/infdis/jiy184. https://europepmc.org/abstract/MED/29746640 .4994087 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Gonzalez A, Ijezie E, Balemba O, Miura T. Attenuation of influenza A virus disease severity by viral coinfection in a mouse model. J Virol. 2018 Dec 01;92(23):e00881-18. doi: 10.1128/JVI.00881-18. https://europepmc.org/abstract/MED/30232180 .JVI.00881-18 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Nickbakhsh S, Mair C, Matthews L, Reeve R, Johnson PCD, Thorburn F, von Wissmann B, Reynolds A, McMenamin J, Gunson RN, Murcia PR. Virus-virus interactions impact the population dynamics of influenza and the common cold. Proc Natl Acad Sci U S A. 2019 Dec 26;116(52):27142–27150. doi: 10.1073/pnas.1911083116. https://www.pnas.org/doi/abs/10.1073/pnas.1911083116?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .1911083116 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Hong HC, Lee H, Lee SJ, Park C, Lee M. The determinants of adherence to public health and social measures against COVID-19 among the general population in South Korea: national survey study. JMIR Public Health Surveill. 2023 Jan 17;9:e35784. doi: 10.2196/35784. https://publichealth.jmir.org/2023//e35784/ v9i1e35784 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Leung K, Wu JT, Leung GM. Effects of adjusting public health, travel, and social measures during the roll-out of COVID-19 vaccination: a modelling study. Lancet Public Health. 2021 Sep;6(9):e674–e682. doi: 10.1016/S2468-2667(21)00167-5. https://linkinghub.elsevier.com/retrieve/pii/S2468-2667(21)00167-5 .S2468-2667(21)00167-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Flaxman S, Mishra S, Gandy A, Unwin HJT, Mellan TA, Coupland H, Whittaker C, Zhu H, Berah T, Eaton JW, Monod M, Imperial College COVID-19 Response Team. Ghani Azra C, Donnelly Christl A, Riley Steven, Vollmer Michaela A C, Ferguson Neil M, Okell Lucy C, Bhatt Samir. Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe. Nature. 2020 Aug;584(7820):257–261. doi: 10.1038/s41586-020-2405-7.10.1038/s41586-020-2405-7 [DOI] [PubMed] [Google Scholar]
- 30.Brauner JM, Mindermann S, Sharma M, Johnston D, Salvatier J, Gavenčiak T, Stephenson AB, Leech G, Altman G, Mikulik V, Norman AJ, Monrad JT, Besiroglu T, Ge H, Hartwick MA, Teh YW, Chindelevitch L, Gal Y, Kulveit J. Inferring the effectiveness of government interventions against COVID-19. Science. 2021 Feb 19;371(6531):eabd9338. doi: 10.1126/science.abd9338. https://www.science.org/doi/abs/10.1126/science.abd9338?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .science.abd9338 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Carvalho T, Krammer F, Iwasaki A. The first 12 months of COVID-19: a timeline of immunological insights. Nat Rev Immunol. 2021 Apr;21(4):245–256. doi: 10.1038/s41577-021-00522-1. https://europepmc.org/abstract/MED/33723416 .10.1038/s41577-021-00522-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Lai S, Ruktanonchai NW, Zhou L, Prosper O, Luo W, Floyd JR, Wesolowski A, Santillana M, Zhang C, Du X, Yu H, Tatem AJ. Effect of non-pharmaceutical interventions to contain COVID-19 in China. Nature. 2020 Sep;585(7825):410–413. doi: 10.1038/s41586-020-2293-x. https://europepmc.org/abstract/MED/32365354 .10.1038/s41586-020-2293-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Hashemi SA, Safamanesh S, Ghasemzadeh-Moghaddam Hamed, Ghafouri M, Azimian A. High prevalence of SARS-CoV-2 and influenza A virus (H1N1) coinfection in dead patients in Northeastern Iran. J Med Virol. 2021 Feb;93(2):1008–1012. doi: 10.1002/jmv.26364. [DOI] [PubMed] [Google Scholar]
- 34.Covin S, Rutherford G. Coinfection, severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), and influenza: an evolving puzzle. Clin Infect Dis. 2021 Jun 15;72(12):e993–e994. doi: 10.1093/cid/ciaa1810. https://europepmc.org/abstract/MED/33277660 .6024509 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Cuadrado-Payán Elena, Montagud-Marrahi E, Torres-Elorza M, Bodro M, Blasco M, Poch E, Soriano A, Piñeiro Gaston J. SARS-CoV-2 and influenza virus co-infection. Lancet. 2020 May 16;395(10236):e84. doi: 10.1016/S0140-6736(20)31052-7. https://europepmc.org/abstract/MED/32423586 .S0140-6736(20)31052-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Wu X, Cai Y, Huang X, Yu X, Zhao L, Wang F, Li Q, Gu S, Xu T, Li Y, Lu B, Zhan Q. Co-infection with SARS-CoV-2 and influenza a virus in patient with pneumonia, China. Emerg Infect Dis. 2020 Jun;26(6):1324–1326. doi: 10.3201/eid2606.200299. doi: 10.3201/eid2606.200299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Krumbein H, Kümmel Lara S, Fragkou PC, Thölken Clemens, Hünerbein Ben L, Reiter R, Papathanasiou KA, Renz H, Skevaki C. Respiratory viral co-infections in patients with COVID-19 and associated outcomes: A systematic review and meta-analysis. Rev Med Virol. 2023 Jan;33(1):e2365. doi: 10.1002/rmv.2365. https://europepmc.org/abstract/MED/35686619 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Bai L, Zhao Y, Dong J, Liang S, Guo M, Liu X, Wang X, Huang Z, Sun X, Zhang Z, Dong L, Liu Q, Zheng Y, Niu D, Xiang M, Song K, Ye J, Zheng W, Tang Z, Tang M, Zhou Y, Shen C, Dai M, Zhou L, Chen Y, Yan H, Lan K, Xu K. Coinfection with influenza A virus enhances SARS-CoV-2 infectivity. Cell Res. 2021 Apr;31(4):395–403. doi: 10.1038/s41422-021-00473-1. https://europepmc.org/abstract/MED/33603116 .10.1038/s41422-021-00473-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Adams K, Tastad KJ, Huang S, Ujamaa D, Kniss K, Cummings C, Reingold A, Roland J, Austin E, Kawasaki B, Meek J, Yousey-Hindes K, Anderson EJ, Openo KP, Reeg L, Leegwater L, McMahon M, Bye E, Poblete M, Landis Z, Spina NL, Engesser K, Bennett NM, Gaitan MA, Shiltz E, Moran N, Sutton M, Abdullah N, Schaffner W, Talbot HK, Olsen K, Staten H, Taylor CA, Havers FP, Reed C, Budd A, Garg S, O'Halloran A, Brammer L. Prevalence of SARS-CoV-2 and influenza coinfection and clinical characteristics among children and adolescents aged <18 years who were hospitalized or died with influenza - United States, 2021-22 influenza season. MMWR Morb Mortal Wkly Rep. 2022 Dec 16;71(50):1589–1596. doi: 10.15585/mmwr.mm7150a4. doi: 10.15585/mmwr.mm7150a4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Fujita DM, Dos Santos Soares Graciela, Sartori GP, Henrique da Silva Nali L. COVID-19 and Influenza coinfection: The rise of Ômicron and H3N2 in Brazil - 2022. Travel Med Infect Dis. 2022;46:102262. doi: 10.1016/j.tmaid.2022.102262. https://europepmc.org/abstract/MED/35038569 .S1477-8939(22)00008-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Kim E, Nguyen T, Casel MAB, Rollon R, Kim S, Kim Y, Yu K, Jang S, Yang J, Poo H, Jung JU, Choi YK. Coinfection with SARS-CoV-2 and influenza A virus increases disease severity and impairs neutralizing antibody and CD4 T cell responses. J Virol. 2022 Mar 23;96(6):e0187321. doi: 10.1128/jvi.01873-21. https://journals.asm.org/doi/abs/10.1128/jvi.01873-21?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed . [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplementary material and tables for the methods and results.
Data Availability Statement
The data are available in the FluNet repository [10]. The code generated and analyzed during this study are available from the corresponding author on reasonable request.