Abstract
We consider whether one can forecast the emergence of variants of concern in the SARS-CoV-2 outbreak and similar pandemics. We explore methods of population genetics and identify key relevant principles in both deterministic and stochastic models of spread of infectious disease. Finally, we demonstrate that fitness variation, defined as a trait for which an increase in its value is associated with an increase in net Darwinian fitness if the value of other traits are held constant, is a strong indicator of imminent transition in the viral population.
Introduction
RNA viruses such as SARS-CoV-2 have high mutation rates, which allows them to rapidly adapt to changing environments. Fortunately, most mutations are deleterious, and high deleterious mutation loads can be limiting even to the point of error catastrophe [1], extinction as a result of excessive mutations, in the most extreme cases. Even so, antigenic escape is a significant concern with rapidly mutating viruses, since such escape could challenge pandemic control efforts. Some RNA viruses such as influenza A/H3N2 exhibit frequent antigenic escape, with the most recent common ancestor rarely more than 3-5 years in the past [2]. Other viruses such as measles, mumps, or HCV may take decades or even centuries to develop significant antigenic mutations [3]. When, antigenic escape does occur, it can trigger an escalation of new infections as the novel variant is able to reinfect previously immune hosts. Other effects of such mutations such as increased transmission rates, when they arise, result in the novel strain quickly dominating the (antigenically similar) viral population with a speed that is dictated by the magnitude of the relative selective advantage.
Therefore, monitoring for the emergence of antigenic escape or increased transmission rate within the SARS-CoV-2 population is a capability that is fundamentally important for controlling the pandemic. Genetic sequencing of isolates is the primary monitoring framework, but it requires deciding what proportion of isolates will be sampled from each subpopulation being monitored. Toward that end, we explore to what degree and how the tools of population genetics can inform monitoring processes. At the heart of this problem lies the key question: Where and when will the next variant of concern arise?
On its face, this question seems impossible to answer. Indeed, it is often presumed that evolution, being a complex and random process, is by its nature unpredictable [4, 5]. Yet, it has been demonstrated that fitness can be forecast for short time horizons [5]. Further, viral populations are subject to dynamical processes that govern host infection and transmission. These dynamics, often over-simplified into compartmental Susceptible-Infected-Resistant (SIR) models [6, 7] and other similar models, can be used to understand the direction of selective pressure. Thus, there is reason to hope that while one may not be able to know where the next variant of concern will arise, one could make educated estimations. Aligning genetic monitoring activities with the probability distribution of variant emergence will improve efficiency and increase chances of identifying novel variants early.
Related work
[8] ran a number of simulations and then trained and evaluated machine learning models designed to forecast the rise of novel antigenic types. The authors of this study were researching whether having identified a novel antigenic type, one can predict whether it will rise to a critical relative frequency of infections. This differs from the present work, in which we consider whether we can predict this event without having to first identify a novel strain at all. That is, we attempt to answer the question: will a novel type arise?
Multi-strain dynamics
Much research focusing on the emergence of novel strains assume the pre-existence of these strains at very low levels [9–12]. In this setting, models of multi-strain dynamics can predict where and when these strains may be detected (i.e., reach sufficient levels) as a function of relative fitness. Similar models can describe the fixation of strains that have higher transmission rates, longer recovery times, or other competitive advantages. The models can also include strain-to-strain mutation rates, which serve as additional source/sink terms.
Fig 1 illustrates how this works with a two-strain SIRS model, detailed in Appendix A. Like an SIR model, SIRS models describe the rates of change of the number of individuals who are susceptible, infected, or resistant. However, unlike an SIR model, SIRS models include loss of immunity over time, thus resistant individuals can become susceptible. The solid line shows the number of active infections for Strain 1 (wild-type). The dashed line shows the number of active infections for Strain 2 (mutant). The dotted line shows the proportion of infections caused by the two strains. In this example scenario, Strain 2 has escaped the immune response elicited by the vaccine (otherwise, Strains 1 and 2 are equivalent and infection by either confers immunity to the other). Aggressive vaccination of the population leads to the rapid dominance by Strain 2 and includes an overall reduction in peak infections. A lower vaccine rate delays the dominance of Strain 2, while no vaccination results in Strain 2 remaining in obscurity. Here, the initial proportion of Strain 2 is 10−6. Note that under this simple model, vaccination confers a competitive advantage to Strain 2 and its dominance is inevitable. Different choices of parameter values only change the timing of this outcome.
A real challenge with these models is that the time at which the mutant strain reaches detectable levels within the population is very sensitive to its initial population, which cannot be experimentally measured. If one does not assume pre-existence, then one must describe the dynamics by which novel strains come into being, i.e. mutation.
A neutral model of genetic diversity
The simplest form of mutation models are models of neutral mutation. Here, it is presumed that mutations have no effect on fitness. The aim then, is to describe the level of genetic diversity in a population over time. [13] adapt a model of mean number of pairwise differences between sequences under varying population size first proposed by [14], to estimate genetic diversity over time during a viral outbreak. This simple model is given as
(1) |
where π is the mean number of pairwise differences, U is the mutation rate, τ is the recovery rate, μ is the host population birth rate, and I is the number of infected individuals. This model can use the retrospective data and forecast numbers of active cases (currently infected individuals) obtained from any relevant case forecasting model, to provide an estimate of within-strain genetic diversity.
Phylodynamic models
A significant challenge with modeling genetic mutation is that one must also describe how genotype relates to phenotype. Much is known about the SARS-COV-2 virus genome [15] including site specific mutation rates [16]. Yet, to model the genotype-phenotype relationship may require understanding how mutations affect protein folding and resulting protein-protein interactions. Computational approaches for exploring these factors exist [17], but are likely too computationally expensive to comprehensively characterize the genetic landscape.
A common alternative approach is to describe the change of fitness directly [5, 18, 19]. Fitness dynamics can be described using the following integrodifference equation
(2) |
where x is a scalar quantity measuring fitness, u(x, t) is proportion of the population with fitness x at time t, u * g = ∫Ω u(x − τ, t)g(τ, t)dτ, μ is the mutation rate, and is the average population fitness. The shape and properties of the mutation likelihood g controls the properties of the fitness trajectories [18]; either a train of well separated beneficial mutations rising to fixation or a traveling wave moving in the direction of increasing fitness.
Compartmental models can be combined with fitness evolution relatively easily, under the assumption of a single antigenic cluster. For example, an SIR model with mutation is given below. However, modeling multiple antigenic clusters requires model extensions [20] which are not easily handled by deterministic frameworks. Instead, stochastic [21] and deterministic-stochastic hybrid [2] methods are used.
Empirical data
Resources such as GISAID [22] and Nextstrain [23] have made phylogenetic analysis of tens of thousands of SARS-CoV-2 isolates available. The observed phylogeny show contemporary clades displacing earlier ones. The turn over in clades shows ongoing fitness evolution. Some clades including 20H/501Y.V2, 20C/S:452R, and 20J/501Y.V3 show growing antigenic distances.
Methods & results
An important design choice in modeling variant emergence is whether to consider antigenic mutation. In the absence of antigenic mutation, the models simplify and are more readily treated with deterministic systems. Including antigenic mutation is most readily handled using agent based stochastic models.
Viral phylodynamics in the absence of antigenic mutation
In the absence of antigenic mutation, the phylodynamics of a viral population can be captured by a small modification to common compartmental models. By considering infections I(β, γ, t) to be a function of both time t and phenotype β, γ one arrives at a familiar compartmental formulation in the population totals and one additional equation describing the proportion of infections .
(3) |
(4) |
(5) |
Here, S is the size of susceptible population, is the total number of infections. and are the population averaged transmission and recovery rates, and g is the mutation kernel. A derivation of the above can be found in the Appendix B. Note that (5) describes continuous mutation and naturally re-derives (2) in the infectious disease context. The equation can be modified to describe mutation only at the time of transmission, as in [21], resulting in the last term changing to μS[(βu) * g − βu]. Both forms are approximations, allowing one to avoid modeling within host dynamics.
From Eq (5) one can see that fitness is defined by the scalar quantity and that fitness is maximally increased in the direction . This model does not explicitly include immune escape. The selective pressure in favor of immune escape can be characterized, however. If a genotype with parameters β and γ mutates in a way to achieve partial immune escape, parameterized by δ ∈ [0, 1], then its instantaneous fitness will be . The fitness gradient then becomes
(6) |
where the last position represents immune escape. Eq (6) makes it clear that selective pressure changes over the course of an outbreak and can be described in roughly three phases. Initially, susceptible hosts are plentiful and fitness is conferred by both increasing β and decreasing γ which describes the length of time a host spreads the virus. As host availability decreases selective pressure favors variants that are able to spread longer (lower γ), but transmissibility becomes less important. With yet further reduction in available hosts, pressure begins to strongly favor immune escape which would increase the number of available of hosts.
Fig 2 shows simulation results from system (3)–(5) using a Gaussian mutation kernel g. Fig 2a shows the mean transmission rate β and recovery rate γ over the course of a simulated outbreak. The arrows indicate the direction of maximal selective pressure in the (β, γ) plane. This figure demonstrates that the gradient in (6) agrees with simulation with isotropic mutation kernels and no small-population effects (see [18]). Fig 2b shows the magnitude of selective pressure given by (6) assuming that no immune escape variant has emerged. This figure illustrates the three phases of pressure direction described above.
Viral phylodynamics in the presence of antigenic mutation
Antigenic mutations are simpler to simulate using stochastic agent based models and similar techniques, as compared to deterministic compartmental models. We therefore adapted an existing agent based model for influenza A/H3N2 which includes mutation in both transmission rate and the antigenic space [21]. We sampled key model parameters independently and uniformly over a range of plausible values, with the exception of population size for which log10 population size was sampled uniformly. These key parameters, their descriptions, and range of values are given in Table 1. Using default parameters, this model shows spindly phylogeny, with novel antigenic variants rising to fixation approximately every three years. For the purpose of illustration, Fig 3 shows an example simulation representing a year period. Fig 3a shows weekly infections colored by antigenic type. Note that colors for different types may appear similar and the contribution of each type is separated by black lines. Fig 3b shows the proportion of infections caused by each type over time. Fig 3c shows the variance of key fitness measures over time. These are the proportion of the population that is susceptible (susc.), the transmission rate which includes the effects of deleterious mutation load (beta), and the reproduction value (R). Note that there are three periods of transition of dominant antigenic type which correspond to three periods of increased variance in fitness.
Table 1. Range of perturbed simulation parameters.
Parameter | Description | Range |
---|---|---|
log10(initialNs) | log Population size | [4, 8] |
initialPrR | Initial strain resistance | [0, 0.5] |
beta | Base transmission rate | [0.3, 0.6] |
nu | Recovery rate | [0.15, 0.25] |
lambda | Non-antigenic mutation rate (mean number of mutations per transmission event) | [0.05, 0.25] |
mutCost | Base transmission rate cost for deleterious non-antigenic mutations | [0.006, 0.01] |
epsilon | Probability of beneficial non-antigenic mutation | [0.1, 0.2] |
lambdaAntigenic | Antigenic mutation rate (mean number of mutations per transmission event) | [0.00075, 0.001] |
Similarly to [8], we ran a number of simulations and then trained and evaluated machine learning models designed to forecast the rise of novel antigenic types. We ran 2,000 simulations, each simulating a 3 year period. Fig 4 includes a single example, showing infections by antigenic type, proportion of types, and variance of fitness measures as in Fig 3. The third year in each simulation was discarded, only being used to determine whether an antigenic type would reach 5% relative infection frequency. We refer to antigenic types reaching 5% relative frequency as novel variants. Other types that do not reach this threshold are out competed and not considered novel variants. For each simulation, the weeks between origination and the time at which a novel variant first reaches 5% relative frequency are labeled as ‘positive’, indicating the presence of a latent novel variant. The weeks after a novel variant attains 5% relative frequency are discarded. All other weeks are labeled as ‘negative’.
Simulations in which no antigenic types originate beyond the initial type were discarded, leaving 1,510 simulations. This was done because when no novel antigenic types originate, susceptibility variance is identically zero. Exactly zero variance has two consequences. First, variance becomes incredibly informative resulting in prediction performance significantly higher than reported below (AUC 0.933), since the resulting negative samples fall below any nonzero threshold. Second, determining that the true variance is truly zero in real-world applications is problematic. This issue is further explored in the discussion below.
Each week is then featurized by the current number of infections, cumulative infections, total number of susceptible hosts, population size, and the means and variances of susceptible host proportion (susc.), the transmission rate (beta), and the reproduction value (R). Finally, we append the previous week’s values as additional features. We trained and evaluated a Random Forest using blocked 10 fold cross-validation, wherein weeks from the same simulation where not allowed to be split across multiple folds.
Fig 5 shows Reciever Operator Characteristic (ROC) curves for Random Forests trained using all features (red, solid) and using only case count based features (i.e. no fitness features) (blue, dashed). The black dash-dot line indicates the random line. Using all features the model achieves an area under the ROC curve (AUC) of 0.731, while using only case count based features the model achieves an AUC of 0.606. Using only the variance of susceptible host proportion for the current and previous week is sufficient to achieve an AUC of 0.716, indicating that antigenic variation is a leading indicator of novel strain emergence.
Conclusion
We have demonstrated that systematic properties of population dynamics in infectious diseases can inform the likelihood of the random process of mutation. When mutation is strong, the traveling wave of the fitness distribution tends to move in the direction of the fitness gradient. When mutation is weak, the fitness dynamics are characterized by periodic substitution events [18]. In this case, variation in population fitness is a strong indicator that such an event is imminent. Our simulation results support these conclusions.
In order to apply these findings to the SARS-CoV-2 pandemic, we must be able to measure variation within the viral population. In the absence of this capability, our results indicate that one would suffer a significant decrease in predictive power. As mentioned above, while isolates can increasingly be sequenced and their genetic sequences analyzed, one must be able to link genotype to the relevant aspects of phenotype or fitness. Certain types of mutations, those located in the spike protein for example are more likely to have an impact on fitness, but quantifying that impact may be difficult. Neutralizing monoclonal antibody testing [24] may serve as a suitable proxy. In addition, increased variation in antibody response to collected isolates may well indicated increased antigenic variation. However, more study is required to quantify these relationships.
We expected the gradient in Eq (6) to be much more informative of outcomes of the stochastic agent based simulations. This proved not to be the case. Mutations arise at a rate proportional to the number of transmission events and as the fitness gradient changes, the fate of a mutant may become favorable. While this fitness gradient can inform these changes, the range of parameter values chosen created such large variation in susceptible host proportion, as well as trajectories of the same, that the relationship between susceptible host proportion and probability of a novel variant emerging was overwhelmed. This may be appropriate however, since considerable uncertainty continues to remain concerning the most appropriate models and parameter values to describe the SARS-CoV-2 outbreak. This will likely be the case in future outbreaks as well.
Appendices
A Two-strain SIRS model with vaccination
A sample two-strain competitive SIRS model with vaccination. Vaccination is assumed to confer permanent immunity against strain 1 but none against strain 2. Infection by either strain confers temporary immunity to both. Table 2 summarizes model variables, parameters, and parameter values.
(7) |
(8) |
(9) |
(10) |
(11) |
(12) |
(13) |
(14) |
Table 2. Two-strain SIRS model variables and parameters used in simulations.
Variable | Description |
---|---|
S; S(0) = N − I1(0) − I2,S(0) | Susceptible but unvaccinated population |
V; V(0) = 0 | Vaccinated and susceptible population |
I1; I1(0) = 100 | Individuals infected by Strain 1 |
I2,S; I2,S(0) = 10−4 | Unvaccinated individuals infected by Strain 2 |
I2,V; I2,V(0) = 0 | Vaccinated individuals infected by Strain 2 |
R1; R1(0) = 0 | Individuals recovered from Strain 1 |
R2,S; R2,S(0) = 0 | Unvaccinated individuals recovered from Strain 2 |
R2,V; R2,V(0) = 0 | Vaccinated individuals recovered from Strain 2 |
N = 106 | Total population size |
μ = 3 ⋅ 10−3 | Population birth and death rate |
v = 5000, 1000, 0 | Vaccination rate |
σ(S) | 1-Sigmoid function to stabilize system: |
β1 = 2.5 ⋅ 10−7 | Transmission rate for Strain 1 |
β2 = 2.5 ⋅ 10−7 | Transmission rate for Strain 2 |
Loss of immunity rate | |
Recovery rate |
B SIR model with mutation
Let I(β, γ, t) be the number of infections by a pathogen with transmission rate β and recovery rate γ at time t. Let S(t) be the number of susceptible individuals in the population.
The total number of infections is given by . The proportion of infections with a given value of β and γ is .
Susceptible individuals are infected at a rate of
(15) |
Similarly, the number of infections changes at a rate of
(16) |
where is the convolution of the infected population with the mutation kernel g. This assumes that mutation of the pathogen changes the status of entire host. In reality, deleterious mutations within a host will be out-competed and will not fix within the host. This can be addressed by choice of g.
Let and . Then,
(17) |
Similarly,
(18) |
Finally,
(19) |
Data Availability
Source code is available on GitHub at https://github.com/kmautonsys/covidvariants.git.
Funding Statement
Auton Systems LLC provided support in the form of salaries for authors KM and AD, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.
References
- 1. Eigen M. Error catastrophe and antiviral strategy. Proceedings of the National Academy of Sciences. 2002;99(21):13374–13376. doi: 10.1073/pnas.212514799 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Yan L, Neher RA, Shraiman BI. Phylodynamic theory of persistence, extinction and speciation of rapidly adapting pathogens. Elife. 2019;8:e44205. doi: 10.7554/eLife.44205 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Grenfell BT, Pybus OG, Gog JR, Wood JL, Daly JM, Mumford JA, et al. Unifying the epidemiological and evolutionary dynamics of pathogens. science. 2004;303(5656):327–332. doi: 10.1126/science.1090727 [DOI] [PubMed] [Google Scholar]
- 4. Mayr E. Toward a new philosophy of biology: Observations of an evolutionist. 211. Harvard University Press; 1988. [Google Scholar]
- 5. Gerrish PJ, Sniegowski PD. Real time forecasting of near-future evolution. Journal of the Royal Society Interface. 2012;9(74):2268–2278. doi: 10.1098/rsif.2012.0119 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Ganyani T, Faes C, Hens N. Simulation and Analysis Methods for Stochastic Compartmental Epidemic Models. Annual Review of Statistics and Its Application. 2021;8. doi: 10.1146/annurev-statistics-061120-034438 [DOI] [Google Scholar]
- 7. Tang L, Zhou Y, Wang L, Purkayastha S, Zhang L, He J, et al. A Review of Multi-Compartment Infectious Disease Models. International Statistical Review. 2020;88(2):462–513. doi: 10.1111/insr.12402 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Castro LA, Bedford T, Meyers LA. Early prediction of antigenic transitions for influenza A/H3N2. PLoS computational biology. 2020;16(2):e1007683. doi: 10.1371/journal.pcbi.1007683 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Day T, Gandon S, Lion S, Otto SP. On the evolutionary epidemiology of SARS-CoV-2. Current Biology. 2020;30(15):R849–R857. doi: 10.1016/j.cub.2020.06.031 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Roche B, Drake JM, Rohani P. An Agent-Based Model to study the epidemiological and evolutionary dynamics of Influenza viruses. BMC bioinformatics. 2011;12(1):1–10. doi: 10.1186/1471-2105-12-87 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Fudolig M, Howard R. The local stability of a modified multi-strain SIR model for emerging viral strains. PloS one. 2020;15(12):e0243408. doi: 10.1371/journal.pone.0243408 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Bonhoeffer S, May RM, Shaw GM, Nowak MA. Virus dynamics and drug therapy. Proceedings of the National Academy of Sciences. 1997;94(13):6971–6976. doi: 10.1073/pnas.94.13.6971 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Gordo I, Gomes MGM, Reis DG, Campos PR. Genetic diversity in the SIR model of pathogen evolution. PloS one. 2009;4(3):e4876. doi: 10.1371/journal.pone.0004876 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Tajima F. The effect of change in population size on DNA polymorphism. Genetics. 1989;123(3):597–601. doi: 10.1093/genetics/123.3.597 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Mousavizadeh L, Ghasemi S. Genotype and phenotype of COVID-19: Their roles in pathogenesis. Journal of Microbiology, Immunology and Infection. 2020. doi: 10.1016/j.jmii.2020.03.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Vilar S, Isom DG. One year of SARS-CoV-2: How much has the virus changed? Biology. 2021;10(2):91. doi: 10.3390/biology10020091 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Dill KA, MacCallum JL. The protein-folding problem, 50 years on. science. 2012;338(6110):1042–1046. doi: 10.1126/science.1219021 [DOI] [PubMed] [Google Scholar]
- 18. Sniegowski PD, Gerrish PJ. Beneficial mutations and the dynamics of adaptation in asexual populations. Philosophical Transactions of the Royal Society B: Biological Sciences. 2010;365(1544):1255–1263. doi: 10.1098/rstb.2009.0290 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Martin G, Roques L. The nonstationary dynamics of fitness distributions: asexual model with epistasis and standing variation. Genetics. 2016;204(4):1541–1558. doi: 10.1534/genetics.116.187385 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Gandon S, Day T, Metcalf CJE, Grenfell BT. Forecasting epidemiological and evolutionary dynamics of infectious diseases. Trends in ecology & evolution. 2016;31(10):776–788. doi: 10.1016/j.tree.2016.07.010 [DOI] [PubMed] [Google Scholar]
- 21. Koelle K, Rasmussen DA. The effects of a deleterious mutation load on patterns of influenza A/H3N2’s antigenic evolution in humans. Elife. 2015;4:e07361. doi: 10.7554/eLife.07361 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Elbe S, Buckland-Merrett G. Data, disease and diplomacy: GISAID’s innovative contribution to global health. Global Challenges. 2017;1(1):33–46. doi: 10.1002/gch2.1018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Hadfield J, Megill C, Bell SM, Huddleston J, Potter B, Callender C, et al. Nextstrain: real-time tracking of pathogen evolution. Bioinformatics. 2018;34(23):4121–4123. doi: 10.1093/bioinformatics/bty407 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Li Q, Nie J, Wu J, Zhang L, Ding R, Wang H, et al. SARS-CoV-2 501Y. V2 variants lack higher infectivity but do have immune escape. Cell. 2021. doi: 10.1016/j.cell.2021.02.042 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Source code is available on GitHub at https://github.com/kmautonsys/covidvariants.git.