Abstract
The waves of COVID-19 infections driven by its variants continue to nullify the success we achieved through efficacious vaccines, social restrictions, testing and quarantine policies. This paper models the two major variants-driven waves by two sets of susceptible-infected-quarantined-recovered-vaccinated-deceased coupled dynamics that are modulated by the three main interventions: vaccination, quarantine and restrictions. This system is used to demonstrate that the second major novel coronavirus wave in the US is caused by the delta variant and the corresponding rapid surge in infectious cases is driven by the unvaccinated pool of the populace. Next, a feedback control based planned vaccination strategy is derived and is shown to be able to suppress the surge in infections effectively.
Subject terms: Computational biology and bioinformatics, Systems biology, Diseases
Introduction
The major waves of COVID-19 infections, after the initial onset, are largely caused by the emerging variants of concern1. They prolong the persistence of infections inflicting loss to human lives, economies and continue to strain the public health infrastructure2. The development of highly efficacious vaccines against COVID-19 and its variants have indeed proven to be effective in averting symptomatic infections and illnesses3. However, despite the availability of these vaccines and repurposed antiviral therapies4, the recent COVID-19 wave of infections have wreaked havoc. Recent studies have analyzed the second surge behavior of COVID-19 in the US states5 and associated mortality in the US and Europe6. The alarming rise of novel coronavirus variants necessitates genomic surveillance for early anticipation and initiation of mitigation strategies to contain such outbreaks7 . Problems connected with vaccine hesitancy and the availability and distribution of vaccines in the poorest countries must be countered with systematic vaccination policies and plans8,9. Therefore, it is important to mathematically and objectively analyze the underlying factors that fuel these subsequent surges in infections and possible mitigation strategies.
Nonlinear dynamical models involving some combination of susceptible/S, infected/I, recovered/R together with some additional compartments have been utilized to predict the initial evolution of this pandemic10,11. Early mitigation strategies based on feedback control were developed to achieve a decay in infections through planned interventions in terms of levels of social restrictions12 and number of tests and quarantine13. However, once efficacious vaccines were being developed and administered, these models needed to be adapted to include the vaccination rates and states. So, age structured vaccinated/V compartments were added to evaluate age group prioritized vaccination strategies14 whereas the effect of two vaccine doses was modeled with two V states15. Two additional states of quarantined/Q and deceased/D were included followed by an ensemble Kalman filter design to estimate the evolution of infections16. A simple SIR model plus exposed/E state with prophylactic and therapeutic interventions was considered to analyze the stability of the pandemic17. A similar model was simulated with stochastic transmission and recovery rates18 and analyzed in a discrete time setting with auto-regressive transmission rate19.
Early optimal control based vaccine administration by minimizing number of infections over a time horizon have been formulated with constraints on daily vaccination rate20. Optimal control strategy based on age-structured administration21 and together with regional dynamics22 were also explored. Optimal vaccination polices that aim to decrease the reproduction number were examined23 together with the addition of plasma transfusion as control variable24. However, this body of work did not consider the added complexities posed by the emergent variants of SARS-CoV-2. Some of the recent work that consider variants include multiple transmissions rates corresponding to the different strains15 and use multiple sets of SIRV states to track the evolution of the respective viral infection strains and analyze stability25. Optimal control has recently been applied to variant models to compute an effective restriction policy26,27.
In spite of these developments, what is lacking is a systemic analysis of the major waves, their underlying cause and an effective mitigation policy. In this paper, a system is introduced to explain the evolution of the two variants and establish the delta variant as the driver of the second major wave in the US (peaking in September, 2021). The variant-specific rates of transmission, along side recovery, mortality, test and quarantine, vaccination rates are all learnt from reported data28 for the US during January 22, 2020 to November 30, 2021 by gradient-free stochastic optimization. From here, the unvaccinated pool of people driving the second wave of surge in infections is established. Finally, feedback control based planned vaccination strategies are shown to be able to suppress the number of cases and mortality along with the duration of the pandemic.
Methods
The initial havoc caused by the novel coronavirus in terms of mortality, mental and economic health in the year 2020 was coming under control by the development and administration of efficacious vaccines through early 2021, until the devastation caused by the emerging variants of interest. Therefore, the epidemic models, controls and analysis which revolve around a single strain need to be adapted to explain the recurrent waves associated with the dominant strains.
Variant dynamics
Here, the nonlinear coupled dynamical system is introduced to model the two dominant variants and associated waves in the US, see Fig. 1. The susceptible/S can be infected initially by the dominant strain with a rate of transmission and later with the other dominant variant with a multiplier to accommodate more/less infectious nature of the second variant, to end up in the infected pools respectively. These infected are actively tested and quarantined with rate and pushed to compartments , respectively.
Figure 1.
The dynamics governed by rate parameters.
Meanwhile, the infected and quarantined populace can recover with rate to end up in corresponding to dominant strains 1, 2 respectively. Vaccines are actively administered at rate to the susceptible and recovered, who then make up the vaccinated/V compartment. Those who succumb to the disease move from quarantine to deceased/D with mortality rate . The key here is that this model accommodates the fact that people who recover from the alpha strain and remain unvaccinated can be infected by the second strain. The full system is formulated through equations (1)–(9), with N the total population.
1 |
2 |
3 |
4 |
5 |
6 |
7 |
8 |
9 |
Note that, the baseline rate of transmission needs to be time-varying to reflect continued gradual relaxation of social restrictions after imposing a severe lockdown, that can be accommodated by a sigmoid function of (18) with lower, upper limits of respectively. Since the vaccines and delta variant were introduced in the middle of the pandemic, they can be modeled by step functions of (19) with v, f denoting the respective start of the delta variant and fully vaccinated individuals. The disease free equilibrium/DFE can be obtained by equating all the derivatives in (1)–(9) to the zero vector, to be
10 |
where the superscript denotes the DFE. The time-varying rates of reproduction of the variants, (alpha variant) during the first wave and (delta variant) during the second wave, can be derived from (16) to be
11 |
12 |
with the overall time-varying rate of reproduction of the pandemic given by .
Parameter tdentification
The system is modeled as per the set of coupled nonlinear differential equations of (1)–(9) with and corresponding to the two major variant-driven waves. The reported number of confirmed cases, recovered, fully vaccinated and deceased over the span of the pandemic are recorded in vectors respectively from the Johns Hopkins public repository28. The various underlying epidemic rate and intervention parameters are learnt from this data by solving the optimization problem of (13) that minimizes its difference to the model predictions,
13 |
constrained to the dynamics of the system (1)–(9), where the output of the integrals are computed daily and are the squared norm. The limit of integration for infections, deceased and fully vaccinated run through the span of the pandemic or the interval of analysis T. The lack of recovery data after is reflected by the corresponding upper limit. The minimization problem of (13) being constrained to the underlying nonlinear dynamics of the system of (1)–(9), makes it hard to compute the gradient of the cost function J analytically. Therefore, a derivative-free stochastic optimization technique based on Nelder and Mead29 based on evolving simplexes of solutions is used to find the best set of rate parameters , the algorithm follows:
- Initialize:
An dimensional simplex is formed around the seed value of , with associated cost J(p) from (13). Here, the number of dimensions .
- Order:
Evaluate the cost function at vertices by numerically integration and sort and compute the centroid .
- Terminate:
If standard deviation of simplex vertices is within specified tolerance, output optimal set of parameters as .
- Reflect:
Compute with . If , then , go to Order.
- Expand:
If , then . Further if , then and go to Order, else and go to Order.
- Contract:
Here , so . Further if , then and go to Order.
- Shrink:
Here , replace for all and go to Order.
Note are respectively the reflection, expansion, contraction and shrink coefficients and their standard values are . The algorithm terminates with the optimized values of the parameters p that justify the recorded observations.
Controlled vaccination
Here the aim is to find a model based feedback control strategy that leads to a steady decrease in number of infections by systematically modulating the daily rate of fully vaccinated. The dynamics of the infectious variants can be written in a matrix form as follows
14 |
Now consider a positive semi-definite function V equivalent to the energy of the infectious pandemic,
15 |
which is positive everywhere in except at the DFE where it has 0 energy. Therefore, in order to stop the epidemic, a series of control actions must be executed that asymptotically reduce this infectious energy to 0 thus stabilizing at the DFE. This is equivalent to setting the gradient of the energy V to be negative semi-definite to obtain,
16 |
which is negative everywhere in except at the DFE where it is 0. The two eigenvalues of the coefficient matrix in (16) appear on its main diagonal and correspond to the dynamics of the primary and the delta variant of the pandemic in the US. In order to enforce the negativity condition on both, the time-varying controlled vaccination rate parameter must be given by (17) that asymptotically stabilizes the pandemic.
17 |
This ensures the respective rate of reproductions are less than 1 so that the net infections decelerate; if not, they keep rising.
Results
The COVID-19 pandemic dynamics are modeled by the system of (1)–(9) as a basis for analyzing the evolution of the two dominant waves in the US largely driven by the dominant variants of SARS-CoV-2. We refer to the large spike in reported cases in January 2021 as the first major wave in the US and the large spike in reported cases in September 2021 as the second major wave in the US. The intervention parameters are learnt from the reported data on daily cases28 and used to interpret the two major waves to be driven by the two major variants and the unvaccinated pool of people driving the second surge in infections.
Model analysis
The baseline transmission rate is designed by the following sigmoid function,
18 |
The rates of fully vaccinated and delta variant are modeled by the following step function,
19 |
The nine states of the system , with non-negative initial conditions, always evolve with non-negative values and belong to . This follows from the property that when initial in Eq. (1). Similarly for their initial values substituted out their respective differential equations of (2)–(9). Summing equations (1)–(9) yields , which implies the solutions of the system are invariant in the set given by .
Note that although, we have used the same mortality rate for both the variants, distinct ones can be easily incorporated in the model, if necessary.
System identification
The unknown parameters of the system include and are to be learned from the publicly available reported cases28. Daily cumulative infections and number of recovered, deceased and fully vaccinated between January 22, 2020 to November 30, 2021 are recorded in vectors respectively. Now, the best set of pandemic parameters are the ones for which the model predictions most closely match the reported cases. The minimization problem of (13) is constrained to the coupled dynamics of the nonlinear equations (1)–(9), that cannot be integrated analytically, hence neither could the gradients of the cost function be computed. Therefore, a derivative free stochastic optimization technique of Nelder and Mead29 is adapted to solve the nonlinear optimization problem. The results plotted in Fig. 2 show a very good match between the model predictions and the reported data in terms of infected, recovered, vaccinated and deceased. Besides finding the baseline time-varying sigmoid transmission parameters and the test/quarantine, recovery and death rates, it also deduces the start and rate of the second major wave and projects the recovered cases for the rest of 2021 where no data was available.
Figure 2.
The system response with optimized parameters closely matches the reported COVID-19 data.
Analysis of waves and variants
Based on the optimal set of parameters learnt for the system that match the reported data on number of cumulative infections, recovered, vaccinated and deceased, these very variables are now seamlessly projected into the future to track their evolution. These results are plotted in Fig. 3 and give us an immediate sense of the course of the pandemic with the current rates of transmission, recovery and mortality and current rate of interventions of vaccination alongside continuous test and quarantine. Next we want to leverage the development of the system together with the optimized set of parameters to motivate the necessity of the delta variant to drive the second wave. To do so, all the nine states including susceptible, vaccinated, deceased and the two sets of infected, quarantined, recovered of (1)–(9) are solved for by inserting the optimized rates of transmissions, test/quarantine, recovery, vaccination and mortality. The two distinct waves are now clear from the results plotted in Fig. 4. A careful examination reveals that the alpha infectious variant is the driver for the first wave and its delta variant is the driver for the second wave. The reason can be noted from the rate of reproductions of the two variants plotted in Fig. 5, with (alpha variant) during the first wave and (delta variant) during the second wave. Further, the impossibility of the alpha variant causing a second major wave stems from the fact that, beyond the first major wave, the minimum number of susceptible/S are insufficient to cause a surge,
20 |
(M stands for million) as evident from the low numbers of S in Fig. 4 during the year 2021. The inequality itself is derived from the condition on reproduction rate (11). Also, the highly contagious nature of the delta variant, widely reported in literature30 can be verified through Fig. 5.
Figure 3.
The system projections with optimized parameters learned over historical COVID-19 data.
Figure 4.
The optimized system reveals the underlying dynamics of the two major variant-driven waves.
Figure 5.
The time-varying rate of reproduction for the two dominant variants reveals a delta wave to be more contagious.
Wave of unvaccinated
Now that we demonstrated the second wave could not have been caused by the alpha strain of SARS-CoV-2 and that another variant, in this case delta was necessary, the next step is to reason out what caused this surge in spite of administration of efficacious vaccines. Note that during the surge of infections causing the second wave, the susceptible/S alone could not have caused it as explained through (20). The only other possibility entails addition of the large pool of people that recovered from the alpha strain but remained unvaccinated i.e. , which then satisfies the condition,
21 |
derived from the condition on variant reproduction rate (12). Indeed, the growth of is supported by the investigation in Fig. 5, which follows from the flow in Fig. 1. However, an increase in the rate of vaccination uptake would certainly have reduced the pool, pushing them to fully vaccinated/V pool, thereby decreasing variant reproduction rate and its corresponding surge. Finally the optimized set of pandemic parameters can be used to project the possible course of the pandemic in the US by integrating the system of (1)–(9). The results are plotted in Fig. 6.
Figure 6.
The optimized system projections reveal the evolution of the variant-driven waves.
Note that this analysis also justifies the usage of same rate of infection by the second variant of susceptible and those that recovered from the first strain, as the number of recovered gradually outnumber the susceptible; therefore, adding another parameter may just further complicate the optimization problem.
Discussion
The system projections based on optimized parameters obtained by derivative-free stochastic optimization matched well with the recorded data as seen in Figs. 2 and 3. Further, with this as basis, two crucial properties: the necessity of the two major variants driving the two major waves and the growing population of recovered from the alpha strain who remained unvaccinated driving the second surge in infections were proven through Eqs. (20)–(21) and supported by Figs. 4 and 5. The very high number of mortality caused by the the major waves are evident from Fig. 6 and is a matter of grave concern. The question naturally arises, if it was possible to suppress the second wave in particular, thereby reducing the fatalities, by systematically modulating the vaccine administration.
The answer lies in systematically regulating the daily rate of fully vaccinated by using the principles of feedback control. A time-varying control law is derived in (17), that guarantees a negative gradient of the infectious energy of the pandemic, asymptotically leading to disease free equilibrium/DFE. During the first major wave, corresponding to the alpha strain will dominate and during the second major wave corresponding to the delta strain will dominate.
In the first scenario, this control law is applied to the pandemic system in the early stages of the second wave (July 2021), reacting to the widely detected emergence of the delta variant, when vaccines were widely made available. From the results plotted in Fig. 7, one can conclude that the second wave could be largely avoided leading to a substantial decrease in mortality (reduction by 3M). The time-varying control of suggests a higher percolation of rate of fully vaccinated/V as a necessary step towards attaining the target of suppressing the second wave.
Figure 7.
Eliminating the delta wave by time-varying feedback control based vaccination.
In the next scenario, a time-invariant controlled vaccination rate parameter can be derived from (17) that considers the supremum of the time-varying policies to give (22) where and corresponds to maximum transmission with no social restrictions.
22 |
The results plotted in Fig. 8 reveal that this feedback control based vaccination approach, even with a delayed application (from August 2021), could suppress the peak of the second wave leading to reduced mortality (reduction by 2M). A comparison of Figs. 7 with 8 reveals the importance of timing of adopting feedback control based vaccination policy i.e. early application can suppress the pandemic wave more effectively and save many more lives.
Figure 8.
Suppressing the delta wave by time-invariant feedback control based vaccination.
Acknowledgements
The support of UTC Institute for Advanced Systems Engineering and UConn School of Engineering are appreciated.
Author contributions
Author has conceived and performed the identification and control of COVID-19 variants as well as reviewed the manuscript.
Data availability
All data generated in this study are have been included in this paper.
Competing interests
The author declares no competing interests.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Lin L, Zhao Y, Chen B, He D. Multiple COVID-19 waves and vaccination effectiveness in the united states. Int. J. Environ. Res. Public Health. 2022;19:2282. doi: 10.3390/ijerph19042282. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Jackson, J. K. Global economic effects of COVID-19 (Tech. Rep, Congressional Research Service, 2021).
- 3.Abu-Raddad LJ, Chemaitelly H, Butt AA. Effectiveness of the bnt162b2 COVID-19 vaccine against the b. 1.1. 7 and b. 1.351 variants. N. Engl. J. Med. 2021;20:20. doi: 10.1056/NEJMc2104974. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Dutta A. Optimizing antiviral therapy for COVID-19 with learned pathogenic model. Sci. Rep. 2022;12:1–9. doi: 10.1038/s41598-021-99269-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.James N, Menzies M. COVID-19 in the United States: Trajectories and second surge behavior. Chaos Interdiscip. J. Nonlinear Sci. 2020;30:091102. doi: 10.1063/5.0024204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.James N, Menzies M, Radchenko P. COVID-19 second wave mortality in Europe and the United States. Chaos Interdiscip. J. Nonlinear Sci. 2021;31:031105. doi: 10.1063/5.0041569. [DOI] [PubMed] [Google Scholar]
- 7.Paul P, et al. Genomic surveillance for SARS-CoV-2 variants circulating in the United States, December 2020-May 2021. Morb. Mortal. Wkly Rep. 2021;70:846. doi: 10.15585/mmwr.mm7023a3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Rackimuthu S, Hasan MM, Bardhan M, Essar MY. COVID-19 vaccination strategies and policies in India: The need for further re-evaluation is a pressing priority. Int. J. Health Plann. Manage. 2021;20:20. doi: 10.1002/hpm.3321. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Riaz MMA, et al. Global impact of vaccine nationalism during covid-19 pandemic. Trop. Med. Health. 2021;49:1–4. doi: 10.1186/s41182-021-00394-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Xiang Y, et al. COVID-19 epidemic prediction and the impact of public health interventions: A review of COVID-19 epidemic models. Infect. Dis. Modell. 2021;20:20. doi: 10.1016/j.idm.2021.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Kucharski AJ, et al. Early dynamics of transmission and control of COVID-19: A mathematical modelling study. Lancet Infect. Dis. 2020;20:2. doi: 10.1016/S1473-3099(20)30144-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Tsay C, Lejarza F, Stadtherr MA, Baldea M. Modeling, state estimation, and optimal control for the US COVID-19 outbreak. Sci. Rep. 2020;10:1–12. doi: 10.1038/s41598-020-67459-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Dutta, A. Stabilizing COVID-19 infections in US by feedback control based test and quarantine. In 2020 IEEE Global Humanitarian Technology Conference (GHTC), 1–6 (IEEE, 2020).
- 14.Yang C, Yang Y, Li Y. Assessing vaccination priorities for different ages and age-specific vaccination strategies of covid-19 using an seir modelling approach. PLoS One. 2021;16:e0261236. doi: 10.1371/journal.pone.0261236. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Zhang, S. et al. An extended COVID-19 epidemiological model with vaccination and multiple interventions for controlling COVID-19 outbreaks in the UK. medRxiv (2021).
- 16.Ghostine R, Gharamti M, Hassrouny S, Hoteit I. An extended SEIR model with vaccination for forecasting the COVID-19 pandemic in using an ensemble Kalman filter. Mathematics. 2021;9:636. doi: 10.3390/math9060636. [DOI] [Google Scholar]
- 17.Wintachai P, Prathom K. Stability analysis of SEIR model related to efficiency of vaccines for COVID-19 situation. Heliyon. 2021;7:e06812. doi: 10.1016/j.heliyon.2021.e06812. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Balsa C, Lopes I, Guarda T, Rufino J. Computational simulation of the COVID-19 epidemic with the SEIR stochastic model. Comput. Math. Organ. Theory. 2021;20:1–19. doi: 10.1007/s10588-021-09327-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Li Y, Ge L, Zhou Y, Cao X, Zheng J. Toward the impact of non-pharmaceutical interventions and vaccination on the COVID-19 pandemic with time-dependent SEIR model. Front. Artif. Intell. 2021;4:26. doi: 10.3389/frai.2021.648579. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Meerza, S. I. A., Karimi, S. M., Little, B. B., Zurada, J. M. & Inanc, T. Optimal scheduling of anticipated COVID-19 vaccination: A case study of New York state. arXiv preprintarXiv:2008.10702 (2020).
- 21.Foy BH, et al. Comparing COVID-19 vaccine allocation strategies in India: A mathematical modelling study. Int. J. Infect. Dis. 2021;103:431–438. doi: 10.1016/j.ijid.2020.12.075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Molla J, et al. Adaptive and optimized covid-19 vaccination strategies across geographical regions and age groups. PLoS Comput. Biol. 2022;18:e1009974. doi: 10.1371/journal.pcbi.1009974. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Acuña-Zegarra MA, Díaz-Infante S, Baca-Carrasco D, Olmos-Liceaga D. COVID-19 optimal vaccination policies: A modeling study on efficacy, natural and vaccine-induced immunity responses. Math. Biosci. 2021;337:108614. doi: 10.1016/j.mbs.2021.108614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Couras, J., Area, I., Nieto, J. J., Silva, C. J. & Torres, D. F. Optimal control of vaccination and plasma transfusion with potential usefulness for COVID-19. In Analysis of Infectious Disease Problems (COVID-19) and Their Global Impact 509–525 (Springer, Berlin, 2021).
- 25.Fudolig M, Howard R. The local stability of a modified multi-strain SIR model for emerging viral strains. PLoS One. 2020;15:e0243408. doi: 10.1371/journal.pone.0243408. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Arruda EF, Das SS, Dias CM, Pastore DH. Modelling and optimal control of multi strain epidemics, with application to covid-19. PLoS One. 2021;16:e0257512. doi: 10.1371/journal.pone.0257512. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Ndondo A, et al. Analysis, modeling and optimal control of COVID-19 outbreak with three forms of infection in Democratic Republic of the Congo. Results Phys. 2021;24:104096. doi: 10.1016/j.rinp.2021.104096. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect. Dis. 2020;20:533–534. doi: 10.1016/S1473-3099(20)30120-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Gao F, Han L. Implementing the nelder-mead simplex algorithm with adaptive parameters. Comput. Optim. Appl. 2012;51:259–277. doi: 10.1007/s10589-010-9329-3. [DOI] [Google Scholar]
- 30.Alexandar S, Ravisankar M, Kumar RS, Jakkan K. A comprehensive review on COVID-19 delta variant. Int. J. Pharmacol. Clin. Res. 2021;5:83–5. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All data generated in this study are have been included in this paper.