Abstract
Does target cell depletion, innate immunity, or adaptive immunity play the dominant role in controlling primary acute viral infections? Why do some individuals have higher peak virus titers than others? Answering these questions is a basic problem in immunology and can be particularly difficult in humans due to limited data, heterogeneity in responses in different individuals, and limited ability for experimental manipulation. We address these questions for infections following vaccination with the live attenuated Yellow Fever Virus (YFV-17D) by analyzing viral load data from 80 volunteers. Using a mixed effects modeling approach, we find that target cell depletion models do not fit the data as well as innate or adaptive immunity models. Examination of the fits of the innate and adaptive immunity models to the data allows us to select a minimal model that gives improved fits by widely used model selection criteria (AICc and BIC), and explains why it is hard to distinguish between the innate and adaptive immunity models. We then ask why some individuals have over 1000 fold higher virus titers than others, and find that most of the variation arises from differences in the initial/maximum growth rate of the virus in different individuals.
1 Introduction
Primary acute viral infections are characterized by an initial period of rapid growth followed by a decline and clearance of the virus [35,7,26]. What accounts for these basic features of infection and in particular what is responsible for the initial decline in the density of virus? Three hypotheses are widely considered – target cell depletion [5,7,44,16,9], innate immunity [42,34,11,29,18, 16] and adaptive immunity [40]. In the target cell depletion (sometimes called resource depletion) hypothesis, the virus infects and kills the cells that are the target for viral replication faster than they can be replenished. The depletion of these target cells results in a decline in the density of virus. In the innate immunity hypotheses the virus induces the innate immune response which includes the production of cytokines such as type I interferons and/or the activation of phagocytes such as macrophages and neutrophils. These factors cause a decline in viral density by a combination of reduction in virus growth and increased virus clearance. In the adaptive immunity hypothesis, the virus stimulates the clonal expansion of antigen-specific B and T cells, which then control the infection via virus-specific antibodies and the killing of infected cells by CD8 T cells. Determining the role of target cell depletion, innate and adaptive immunity in the control of infections has practical implications for the use of drugs to control infection and the generation of resistance [35,19].
Discriminating between these hypotheses is challenging as mathematical models incorporating any of these three hypotheses can generate dynamics consistent with the basic features of an acute infection (i.e. rapid virus growth followed by decline). Model discrimination is particularly difficult for data from human infections for a number of reasons. It is difficult to obtain detailed time courses of infection and immunity. Ethical constraints preclude most experimental manipulations. Finally host genetic diversity and differences in environment introduce much larger heterogeneity in the dynamics of infection and immunity than is seen in inbred laboratory mice kept in controlled conditions [39,6,32,41,33,12,38,14].
In the case of influenza A infection, an early modeling study [5] in humans proposed that the loss of target cells played a dominant role in the control of virus. Later studies using more extensive data from horses resulted in reevaluation of this conclusion as models incorporating an interferon response were better fits to the data [42,34]. In the case of SIV and HIV infections, early studies proposed that target cell depletion plays a key role in the decline in virus during the acute phase of infection [36,46]. A subsequent study analyzed data on SIV infection of rhesus macaques following depletion of CD8 T cells, and suggested that these cells play a crucial role in the decline of virus during the acute phase of infection [40]. While it is an intracellular protozoa and not a virus, a similar debate exists for malaria infection. Although it is clear that adaptive immunity is required for the long-term control and clearance of infection, the roles of target cell depletion and innate immunity during the initial decline in parasitemia are less clear [28,21,4,23,30]. Finally, determining the role of target cell depletion and innate immunity in the control of dengue and zika is of current interest and one modeling study has suggested that an innate immunity plays an important role [8]. When the data comes from experimental infections of animals, manipulations that alter the numbers of target cells or deplete components of the innate and adaptive immune responses can facilitate discriminating between the different hypotheses [47,40, 20].
In this paper we study what controls viral infections of humans that arise following immunization with the yellow fever virus strain YFV-17D. YFV-17D is widely used as a safe and effective live attenuated virus vaccine. Following immunization the virus generates a relatively mild acute infection that lasts for about 1 to 2 weeks and ends with the clearance of the virus and the generation of long-lasting immunity [31]. We use data from 80 naive individuals who were seronegative for YFV prior to vaccination. Following immunization with YFV-17D these individuals were intensively sampled and virus and CD8 T cell responses quantified. This gave us a fine-grained look at the dynamics of viral load following immunization [15,1].
An outline of the paper is as follows. We begin in Section 2 by describing the data on the dynamics of virus following immunization with YFV-17D. In Section 3 we construct mathematical models incorporating the three different hypotheses (target cell depletion, innate immunity, or adaptive immunity), and in Section 4 we consider which model best reproduces the virus dynamics measured in the data from the 80 vaccinated individuals.
2 Data
The data is described in detail in earlier papers [15,1]. Briefly, 80 healthy volunteers were injected with Yellow Fever vaccine virus (YFV-17D), a live attenuated virus. Viral titers were recorded on day 0, 1, 2, 3, 5, 7, 9, 11 and 14. The data showed that the peak virus load typically occurred at day 5 or 7 following immunization, and the virus was rapidly cleared in the subsequent 2 to 4 days. The CD8 T cell response to YFV was measured by following the number of activated Ki67+, Bcl2+ CD8 T cells in the blood at days 0, 3, 7, 11, 14, 28 and 90 following infection and this was supplemented by measurement of responses to the HLA-A2 restricted epitope in the NS4B protein of YFV in a subset of individuals possessing HLA-A2 MHC. The number of activated T cells were not significantly above background (day 0) at day 3 following infection and only just above background at the peak observed viremia. Consequently the CD8 T cell data was not of sufficient resolution to be useful for the timeframe of this analysis and we focused on the virus data alone.
3 Models of viral dynamics
We first present three within host models of viral dynamics that correspond to the three hypotheses for the control of infection. These are the target cell model, the innate immunity model and the adaptive immunity model. The basic outline of the models is shown in Fig. 2. We consider alternative versions of these models in S1 in Online Resource 1.
Fig. 2. Models for the three hypotheses.
In Panel A we show the target cell model. In this model virus infection converts uninfected target cells to an infected state. Infected cells produce virus and have an increased death rate. In Panel B we show the innate immunity model. The virus grows exponentially and induces the activation of resting immune cells, which become activated. Activated innate immune cells are responsible for the control of virus. In Panel C we show the adaptive immunity model. In this model the virus induces the clonal expansion (replication) of virus-specific cells. These cells are responsible for clearance of the virus.
The target cell depletion model, or target cell model, assumes that the viral infection will continue to grow provided that there are sufficient uninfected target cells. If S and I are the number of susceptible and infected target cells, and V equals the number of virions, then
| (1) |
where β is the parameter describing infectivity, p is rate of production of virions by infected cells, δ is the death rate of infected cells, and c is the decay rate of virions. As the number of target cells and infected cells is unobserved, we can set p ≡ 1.
The innate immunity model assumes that the virus induces an innate immune response R that is responsible for controlling the infection. We let the virus grow exponentially at rate r in the absence of the immune response. We assume that there is a fixed population of innate immune cells. These start in a resting state but can become active in the presence of virus. Therefore the innate immune response has a maximum response level which we scale to unity [45,2]. R represents the proportion of the maximum innate response – and can be thought of as the fraction of innate immune cells such as macrophages or dendritic cells that are in an activated state and producing cytokines that control the infection. The activation of immune cells is incorporated as a saturating function of viral load. Similarly the control of viral infection is incorporated as a saturating function of cytokines [25]. However, we assume that the lifespan of cytokines is short, so their concentration is proportional to R. The innate immunity model is described by
| (2) |
where s, ϕ, and m are the parameters for the activation of innate immunity by virus, δ is the rate of inactivation of innate immune cells in the absence of virus, and k, ψ, and n are the parameters for control of the virus by innate immunity. We note that R is the inducible component of the innate response and any constitutive (non-varying component) would be incorporated by a change in the initial/maximum growth rate of the virus r.
The adaptive immunity model is similar to the innate immune model except for the term for the growth of immunity. In contrast to innate immunity which involves the activation of a fixed population of cells, adaptive immune responses are generated by clonal expansion of virus-specific cells in a manner dependent on the density of the virus. Consequently, the adaptive immune response can potentially reach a higher magnitude than innate immunity [40, 25,26]. The adaptive immunity model is described by
| (3) |
where s, ϕ, and m are the parameters for the activation of adaptive immunity by virus, δ is the rate of loss of adaptive immunity in the absence of virus, and k, ψ and n are the parameters for control of the virus by adaptive immunity. We have chosen X(0) = 1 which amounts to rescaling of the response to its initial value. Note that the term δ(X − X0) represents the maintenance of X at a stable initial value in the absence of antigen stimulation. Differences in the initial value of the response in different individuals can be accounted for by changes in the value of ψ.
We note that the parameters s, ϕ, m.. etc take different values for innate and adaptive responses. Further, as the rate of virus clearance is relatively rapid compared with the timescale for loss of both innate and adaptive immunity we set the parameter δ for the rate of decay of these responses to zero.
4 Model comparison
There are a number of approaches to fitting models to longitudinal data for the dynamics of virus infections. The simplest is to fit the model to the average data for the dynamics of infection. A more widely used approach is to fit the model to each individual independently and examine the parameters for the different individuals [5,42,34]. Ideally, the number of observations for each individual is large compared to the number of model parameters to prevent overfitting. A more sophisticated approach is mixed effects modeling [11,25, 9], in which the mean and standard deviation for each parameter within a population is estimated. As the data for each individual is relatively limited we focus on the mixed effects modeling framework and where relevant mention its advantages compared with the previous approaches.
To compare the fit of each of our models to data, we calculate the likelihood using a mixed effects framework, assuming independent log-normal priors for each model parameter. The mean and standard deviation of these priors is calculated by minimizing the likelihood function
| (4) |
where p(Yi|f, λ) is the probability that model f produces the data with parameter choice λ, and q(λ|θ, ω) is the probability of λ according to the prior. As many of our measurements fall below the limit of detection, we use a left censoring approach [17] to calculate p(Yi|f, λ). If the measurement is below the limit of detection, yc = 10 genomes per ml, then we evaluate the probability that the model would produce any subthreshold value.
| (5) |
where the value of σ must also be estimated for each model by maximizing (4). For further details about the calculation of the likelihood see section S2 in Online Resource 1 as well as [27,37,17]. We use the software package Monolix to maximize this likelihood function [24,43].
We examine the fit of a model to the data by minimizing −2 logL and smaller numbers indicate better model fits. In order to statistically compare the fit of models with different numbers of parameters we used two commonly used measures the corrected Akaike’s Information Criterion (AICc) and the Bayesian Information Criterion (BIC) which are information-based criteria that assess model fit. Both AICc and BIC are based on −2 logL. Both add a penalty based on number of parameters and have corrections for finite sample sizes. AICc = −2LogL + 2NK/(N − K − 1) and BIC = −2LogL + K logN where N is the number of data points and K is the number of parameters. A difference in BIC between two models of over 10 is considered to be evidence of strong support in favor of the model with the lower BIC.
5 Results
5.1 All models can fit the average dynamics of infection and data from individual volunteers
We begin by examining if the target cell model, innate immunity model and adaptive immunity model could fit the average dynamics of virus during the infection. In Figure 3 we see that all three models can fit the data on the average dynamics of infection, and indeed they produce almost indistinguishable fits. The models give virtually identical log likelihoods, and thus AICc and BIC both favor the target cell model as it has the fewest number of parameters (see Table S1 in Online Resource 1). We also find that all three models are able to fit to the data for each individual separately. Figure 4 shows the results for a few representative individuals. In some individuals such as Panel A of Figure 4 the target cell model can give a very different trajectory for the dynamics of infection compared with the trajectories generated by the innate and adaptive immunity models. The problem is that there are only a few datapoints for the dynamics of infection in a given individual and the models compared with the number of parameters for each of the models, and consequently we run into the problem of overfitting. These results are not unexpected, but we feel they illustrate the limitations of these approaches and motivate the mixed effects modeling framework.
Fig. 3. Fits to average virus data.
We plot the raw data viral titer in grey, the mean at each timepoint as black dots, and the median as black crosses. All three models produce virtually identical fits to the average dynamics of infection.
Fig. 4. Individual fits to dynamics of virus in four subjects.
We fit the three models (i.e. the target cell, innate and adaptive immunity models) to the data on the dynamics of infection in four different individuals. We see that all three models can fit the data well. However in some individuals (e.g. Panel A) the target cell model can give a very different trajectories for the dynamics of infection from the innate and adaptive immunity models.
5.2 A mixed effects modeling approach rejects the target cell model
We use a mixed effects modeling approach to help discriminate between models that we were not able to distinguish between by fitting to the mean data. The mixed effects framework must reproduce both the dynamics of infection and the pattern of variation between individuals.
The results of fitting the three different models to the viral load data using a mixed effects approach is shown in Table 1. The log-likelihood indicates that the innate and adaptive immunity models fit significantly better than the target cell model. This is supported by the AICc and BIC values which take the different numbers of parameters into account – the difference in BIC between the target cell and the other two models is about 40 which indicates very strong statistical support for rejecting the target cell model. The difference in BIC between the innate and adaptive models is small indicating that it is not possible to discriminate between these two models.
Table 1. Comparison of virus models.
Log likelihood, AICc, and BIC for mixed effects fits. NP is the number of parameters.
| −2LogL | AICc | BIC | NP | |
|---|---|---|---|---|
| Target cell model | 1301 | 1323 | 1349 | 15 |
| Innate immunity model | 1235 | 1270 | 1309 | 17 |
| Adaptive immunity model | 1234 | 1269 | 1308 | 17 |
| Minimal immunity model | 1241 | 1264 | 1289 | 11 |
Representative fits are shown in Figure 5, and the fits to all 80 individuals are shown in SI Figure 1. Visual inspection reveals that while all three models are able to capture the basic features of the expansion of virus followed by its control, the innate and adaptive immunity models appear able to capture the dynamics better than the target cell model in a few individuals. In particular comparison of the fits to each individual separately with the fits using the mixed effects framework (i.e. comparing Figures 4 & 5) indicate that the fits of the target cell model become significantly worse when the mixed effects framework constrains the variation in parameters between different individuals.
Fig. 5. Fits from the mixed effects modeling approach.
We show the fits obtained using the mixed effects modeling framework to the same four individuals shown in Figure 4. The circles are the data collected for each individual and the dashed line represents the limit of detection. We see that the innate and adaptive immunity models produce similar dynamics of infection and fit the data better than the target cell model. Fits to all 80 individuals are shown in the Online Resource 1.
The mixed effects approach rejects the target cell model because it cannot reproduce the variance in peak viral load. Changing the number of target cells in this model can change the peak viral load. However, such a change would also lead to much more rapid transmission of the pathogen, which is not observed. Therefore to match the data for each individual, the target cell model must simultaneously change S0 and β in almost exact proportion with each other. This tight correlation of parameters is heavily penalized in a mixed effects framework where β and S0 are assumed to vary independently. There is no biological reason for S0 and β to be correlated.
5.3 Parameters and a minimal model
In Table 2 we show the parameters for the innate and adaptive immunity models that give us the best overall fit and the standard deviations of these parameters between different individuals. Both models give comparable rates of viral growth (r) and the level of virus required for triggering of the responses (ϕ). The growth rate r corresponds to a doubling times for the virus of around ln(2)/r = 9 hours, and innate and adaptive immunity are triggered at half maximal rates at relatively low viral loads ϕ of around 25 genomes/ml. The hill coefficients for the terms for stimulation of immunity and killing of virus are significantly greater than one.
Table 2. Parameter fits for innate/adaptive/minimal immune mixed effects models.
These values represent the mean and standard deviation of the priors that maximize the likelihood as calculated by monolix. All parameters are assumed to be log-normally distributed, constraining all parameters to be positive. In some cases the standard deviation is greater than the mean, because the lognormal distribution can be highly skewed. (gen/ml) refers to viral genomes per ml of blood. Parameter distributions for all models are show in Online Resource 1 Figures 2–5
| Parameter | Description | Innate | Adaptive | Minimal | |||
|---|---|---|---|---|---|---|---|
| Mean | S.D. | Mean | S.D. | Mean | S.D | ||
| r (1/day) | Viral growth rate | 1.69 | 0.48 | 1.83 | 0.46 | 1.60 | 0.47 |
| k (1/day) | Max killing rate | 4.18 | 0.46 | 4.11 | 0.56 | 3.68 | 0.66 |
| s (1/day) | Immune growth/activation rate | 0.17 | 0.01 | 0.52 | 0.02 | ||
| ϕ (gen/ml) | V req’d for 50% max activation | 25.2 | 9.67 | 23.6 | 7.67 | 11.2 | 3.90 |
| ψ | R/X req’d for 50% max killing | 0.37 | 0.01 | 3.78 | 0.22 | ||
| V0 (gen/ml) | Viral load at t = 0 | 0.10 | 0.08 | 0.10 | 0.08 | 0.10 | 0.04 |
| n | Hill exponent in killing term | 27.9 | 48.4 | 6.97 | 10.38 | ||
| m | Hill exponent in activation term | 3.67 | 9.22 | 1.62 | 0.16 | ||
| td (days) | Time before immune response | 2.90 | 0.26 | ||||
When fitting the data, we find that n and m are generally large enough to warrant replacing the hill functions in (2) and (3) with step functions, with the possible exception of m in the adaptive model. We therefore hypothesized that we might further improve the model by replacing the hill functions with step function. This results in two discontinuous ODEs
| (6) |
and
| (7) |
where H is the heaviside step function. Both (6) and (7) reduce to the following form
| (8) |
In the above, td is the time it takes for the immune response to reach the threshold ψ. Its value is given by
| (9) |
The virus starts at titer V0 (at time 0) and grows exponentially at rate r followed by exponential decay at rate (r − k) when the induced innate or adaptive response reaches a critical threshold. Immunity would be triggered when the virus titer reaches ϕ and reach the threshold for virus control after a delay td. This model has three fewer parameters than the prior innate and adaptive immunity models described by (2) & (3): td is a composite of the parameters that includes s and ψ in the innate and adaptive immunity models. Therefore, the values in Table 2 for the innate and adaptive models should only be viewed as a parameter set consistent with the data. Thus we cannot say how rapidly the innate response saturates or how many divisions the cells of the adaptive response undergo.
A comparison of fitting the minimal inducible immunity model with the previous three different models to the viral load data using a mixed effects approach is shown in Table 1. The log-likelihood indicates that the minimal inducible immunity model fits the data almost as well as the innate and adaptive immunity models and significantly better than the target cell model. When we take the number of parameters into account, the AICc and BIC values tell us that the minimal inducible immunity model is statistically the best model having an AICc roughly 5 less and a BIC roughly 19 less than the more complex innate and adaptive immunity models.
To isolate which parameters are important for generating this variability, we vary one parameter at a time and then calculate the peak viral load, integral viral load, time of peak, and time of clearance for each individual. We set the test parameter equal to the posterior mode for each volunteer, and hold the others at the population means given in Table 2. Both the innate model and the adaptive models primarily generate the variance in viral load via the parameter r which represents the initial viral growth rate (Table 3), although there is a small contribution of the immune killing rate k to the clearance time. The variation in r could reflect between host differences such as the infectivity, density, and life span of susceptible cells and the rate of production and clearance of virus. All of these factors could be due the standing level of innate immunity; our model only predicts that the inducible component does not contribute to the variation in load observed between different individuals. This is primarily because we find very little variation between individuals in inducible immune response.
Table 3. Contribution of parameters in the minimal immunity model to variance in viral dynamics.
We first calculate the best fit parameter set for each individual. Then we set all but one parameter to the mean value and calculate the variance in peak viral load (log scale), integral viral load (log scale), time of peak and time of clearance. The first column shows the variance in these measures when all parameters are allowed to vary. We see that the parameter r is by far the most significant in producing the observed heterogeneity in viral load. The variance in the peak viral load in the data is roughly 4.5 logs, so the best model explain roughly 50% of the variance.
| Full | r | k | ϕ | V0 | td | s | ψ | n | m | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Peak | Minimal | 2.30 | 2.20 | 0.00 | 0.00 | 0.02 | 0.01 | ||||
| Virus | Innate | 2.51 | 1.55 | 0.00 | 0.02 | 0.06 | 0.01 | 0.00 | 0.04 | 0.00 | |
| Adaptive | 2.75 | 1.79 | 0.00 | 0.00 | 0.12 | 0.00 | 0.00 | 0.27 | 0.00 | ||
|
| |||||||||||
| Area | Minimal | 0.81 | 0.68 | 0.00 | 0.01 | 0.01 | 0.01 | ||||
| Under | Innate | 0.74 | 0.58 | 0.00 | 0.01 | 0.05 | 0.00 | 0.00 | 0.01 | 0.01 | |
| Curve | Adaptive | 0.52 | 0.22 | 0.00 | 0.00 | 0.09 | 0.00 | 0.00 | 0.05 | 0.00 | |
|
| |||||||||||
| Peak | Minimal | 1.20 | 0.47 | 0.18 | 0.02 | 0.01 | 0.04 | ||||
| Time | Innate | 1.43 | 0.18 | 0.02 | 0.02 | 0.05 | 0.01 | 0.00 | 0.05 | 0.02 | |
| Adaptive | 1.06 | 0.24 | 0.08 | 0.01 | 0.08 | 0.00 | 0.00 | 0.07 | 0.00 | ||
|
| |||||||||||
| Clearance | Minimal | 1.99 | 1.85 | 0.02 | 0.01 | 0.00 | 0.02 | ||||
| Time | Innate | 2.16 | 1.31 | 0.00 | 0.02 | 0.01 | 0.01 | 0.00 | 0.05 | 0.01 | |
| Adaptive | 2.29 | 1.44 | 0.01 | 0.00 | 0.03 | 0.00 | 0.00 | 0.20 | 0.00 | ||
6 Robustness
We have demonstrated that three immune response models are a better fit to the data than a target cell depletion model. It is important to examine the extent to which this result is robust to the details of the models, such as whether there is a delay between infection of a target cell and the production of virus as in [5] or the nature of the function that describes activation of innate or adaptive immunity. We explored the following different models for each of the hypotheses (equations in Online Resource 1).
For the target cell models we explored the effect of: adding an eclipse phase [5]; simplifying the model by making a quasi-steady-state assumption that the decay rate of virus is fast [35]; and adding these together. For the innate immunity model we explored the effect of: using a simplified model for innate immunity with n = m = 1 [2]; using the model for cytokine production suggested by Pawelek et al [34]; using a simplified version of the Pawelek model [34]; and using a model suggested by Saenz et al [42]. For adaptive immunity we use: a simplified model for the dynamics of adaptive immunity with n = m = 1 [3]; and a simplified model for adaptive immunity with saturation in killing [25]. The quality of fits for all models is listed in Table 4.
Table 4. Comparison of goodness of fit to viral load data.
We compare the loglikelihood, AICc and BIC of each model using both fits to the mean data and mixed effects fits. Each row represents a different model and the models are clustered by type.
| Model | -2logl | AICc | BIC |
|---|---|---|---|
| Target cell models | |||
| Target cell model (1) | 1298 | 1320 | 1346 |
| Target cell limited w/eclipse phase | 1294 | 1321 | 1351 |
| …with virus in steady state (QSS) | 1312 | 1330 | 1352 |
| …with QSS and eclipse phase | 1314 | 1336 | 1362 |
|
| |||
| Innate immunity models | |||
| Innate immunity model (2) | 1235 | 1270 | 1309 |
| Simplified induction of immunity | 1282 | 1304 | 1330 |
| Pawelek model | 1278 | 1312 | 1352 |
| Simplified Pawelek | 1291 | 1309 | 1330 |
| Saenz model | 1258 | 1315 | 1377 |
|
| |||
| Adaptive immunity models | |||
| Adaptive immunity model (3) | 1234 | 1269 | 1308 |
| Simplified adaptive immunity | 1312 | 1335 | 1360 |
| Simplified adaptive w/saturated killing | 1269 | 1300 | 1335 |
|
| |||
| Minimal immunity model (8) | 1241 | 1264 | 1289 |
None of the other models considered could fit the data as well as the three immune models (2), (3), or (8). Models incorporating an immune response are better fits by AICc and BIC than those that only include depletion of target cells. The only exception to this is the simplified adaptive immunity model with mass action killing, however this is fixed by incorporating a saturation term to the killing rate. Therefore we conclude that the primary mechanism controlling infection in these individuals is an immune response and not depletion of target cells.
7 Discussion
We have used a combination of mathematical modeling and statistical analysis of viral dynamics data to explore which factor is primarily responsible for controlling the yellow fever virus YFV-17D following immunization of humans. Our results reject target cell depletion, and suggest that some form of inducible immunity is likely to be the principal factor in the control of YFV-17D. Our results suggest that the current data is consistent with either innate or adaptive immune responses being the principle factor for the control of the virus, and we were not able to discriminate between these hypotheses. A previous modeling study by Le et al. [25] suggested that the adaptive immune response (YFV-specific CD8 cells) controlled YFV-17D infections. The Le et al study showed that the dynamics of virus was consistent with an adaptive CD8 T cell response but did not consider alternative hypotheses. Our results suggest that it is not possible to discriminate between control by adaptive or innate immunity and highlight the importance of considering multiple hypotheses [22,13].
As described in the introduction, the identification of the principal factor responsible for control of acute infections has been the subject of considerable interest and many modeling studies. A number of factors make this problem potentially difficult, as we briefly discuss below. First, using models to discriminate between different hypotheses requires sufficient data, which can be problematic for human infections. We were fortunate to use a study with extensive sampling of virus at days 0, 1, 2, 3, 5, 7, 9, 11, 14 in the blood. Second, even with this unprecedented level of sampling there were usually only between 1 and 4 timepoints when the virus was above the threshold of detection. Fitting separately to each individual as in [34,42,5] was impractical for this data set. In this situation a mixed effects modeling approach can help as fewer parameters need to be estimated from the data. Third, each of the hypotheses can be described by a number of alternative models. Our approach to this problem was to examine multiple models that would describe each hypothesis. We examined 4 different target cell models, 5 innate immunity models and 3 different adaptive immunity models. We now describe some of the key assumptions and corresponding caveats of our study. The data that we model comprises of measurements of the virus titer in the blood of individuals, rather than from tissue samples. This is a common limitation of human studies. Second, we focus on the virus data. We lack data on cytokines and other measures of activation of the innate immune response, and the data on CD8 T cell and antibody responses are barely above background at the time of peak viremia (see section 2 on Data). Third we use simple deterministic models which ignore stochastic effects.
In our data, peak viral load could vary over 104 fold between individuals. Therefore, we also explored which factors might be responsible for this heterogeneity. We found that in our model a single parameter, the initial viral growth rate of the virus (r in (2) & (3)), explains most of this variation, rather than the parameters that describe how immunity is elicited or how fast it grows. This is supported by the observation that the peak virus density happens in a relatively narrow time-range (typically at day 5 or 7 of the measurements). A number of biological factors could result in changes in the initial growth rate of the virus including differences in the susceptibility of cells to infection, the burst size of the virus, as well as constitutive levels of innate immune responses in different individuals. Further studies will need to be done to answer this question.
Interestingly, it is the heterogeneity in viral dynamics between individuals that allows us to distinguish between models. A mixed effects approach requires the models to reproduce both the dynamics of infection in individuals and the heterogeneity within the population. If this heterogeneity had been smaller in our data set, model discrimination would have been much harder as all models could reproduce the mean data. For example, a recent study on Zika virus infection in Rhesus Macaques [9] found that a target cell limited model could reproduce their data. However, their viral load data showed considerably lower between subject variability than we observed. For many years, immunological studies have focused on inbred animal models, in relatively sterile environments as these conditions minimize variability in the outcome of experiments [39,10]. The present study suggests that, at least in some situations, data obtained from ‘dirty’ mice, which may be exposed to a variety of pathogens, and outbred mice with variable genetics, may prove useful to quantitative modelers.
Supplementary Material
Table 1: Comparison of goodness of fit to viral load data We compare the loglikelihood, AICc and BIC of each model using both fits to the average data and mixed effects fits. Each row represents a different model and the models are clustered by type. The target cell depletion models are shown first, followed by various immune models found in the literature, and then models that we developed for this paper.
Figure 1: Viral load vs time post vaccination. Each panel represents a different volunteer. Data is represented by dots. Note that the limit of detection is 10 genomes per ml. The curves represent the models simulated using the posterior modes as calculated by monolix. The numbers in each panel represent the sum or square residuals from each model in the following order:Target Cell, Innate immunity, Adaptive immunity, Minimal immunity
Figure 2: Histograms and qq-plots of the posterior means for the target cell depletion model. The number on each qq-plot is the p-value for the Anderson-Darling test of normality, a lower number mean the values are less likely to have come from a normal distribution.
Figure 3: Histograms and qq-plots of the posterior means for the innate immunity model. The number on each qq-plot is the p-value for the Anderson-Darling test of normality, a lower number mean the values are less likely to have come from a normal distribution.
Figure 4: Histograms and qq-plots of the posterior means for the adaptive immunity model. The number on each qq-plot is the p-value for the Anderson-Darling test of normality, a lower number mean the values are less likely to have come from a normal distribution.
Figure 5: Histograms and qq-plots of the posterior means for the minimal model. The number on each qq-plot is the p-value for the Anderson-Darling test of normality, a lower number mean the values are less likely to have come from a normal distribution.
Fig. 1. Summary of Yellow Fever Vaccine data.
80 volunteers were vaccinated with yellow fever vaccine and their plasma viral load was tracked for two weeks [15,1]. Each solid line represents a different volunteer, dashed line is the limit of detection. Time points with undetectable virus are imputed at 5 genome per ml (half the limit of detection) to aid visualization.
Fig. 6. Minimal inducible-immunity model.

A minimal model to explain the data for virus and inducible immunity. The virus exhibits exponential growth and decay and the immune response is induced at virus density ϕ and controls the virus with a time delay td. We show.
Acknowledgments
This work was supported by four NIH grants NIH U54GM111274, NIH R01AI110720 (to R. Antia), NIH U19AI11789102 (to R.Antia and R.Ahmed), and U19AI057266 (to R. Ahmed).
Contributor Information
James Moore, Department of Biology, Emory University, Atlanta, GA, USA.
Hasan Ahmed, Department of Biology, Emory University, Atlanta, GA, USA.
Jonathan Jia, Department of Biology, Emory University, Atlanta, GA, USA.
Rama Akondy, Department of Microbiology and Immunology, Emory University, Atlanta, GA, USA.
Rafi Ahmed, Department of Biology, Emory University, Atlanta, GA, USA.
Rustom Antia, Emory Vaccine Center, Emory University, Atlanta, GA, USA.
References
- 1.Akondy RS, Johnson PL, Nakaya HI, Edupuganti S, Mulligan MJ, Lawson B, Miller JD, Pulendran B, Antia R, Ahmed R. Initial viral load determines the magnitude of the human CD8 T cell response to yellow fever vaccination. PNAS. 2015;112(10):3050–3055. doi: 10.1073/pnas.1500475112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Antia R, Koella JC. A model of non-specific immunity. J Theor Biol. 1994;168(2):141–150. doi: 10.1006/jtbi.1994.1094. [DOI] [PubMed] [Google Scholar]
- 3.Antia R, Levin BR, May RM. Within-host population dynamics and the evolution and maintenance of microparasite virulence. Am Nat. 1994:457–472. [Google Scholar]
- 4.Antia R, Yates A, de Roode JC. The dynamics of acute malaria infections. i. effect of the parasite’s red blood cell preference. Proc Biol Sci. 2008;275(1641):1449–58. doi: 10.1098/rspb.2008.0198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Baccam P, Beauchemin C, Macken CA, Hayden FG, Perelson AS. Kinetics of influenza A virus infection in humans. J Virol. 2006;80(15):7590–7599. doi: 10.1128/JVI.01623-05. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Barton ES, White DW, Cathelyn JS, Brett-McClellan KA, Engle M, Diamond MS, Miller VL, Virgin HW. Herpesvirus latency confers symbiotic protection from bacterial infection. Nature. 2007;447(7142):326–329. doi: 10.1038/nature05762. [DOI] [PubMed] [Google Scholar]
- 7.Beauchemin CA, Handel A. A review of mathematical models of influenza A infections within a host or cell culture: lessons learned and challenges ahead. BMC Public Health. 2011;11(Suppl 1):S7. doi: 10.1186/1471-2458-11-S1-S7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Ben-Shachar R, Koelle K. Minimal within-host dengue models highlight the specific roles of the immune response in primary and secondary dengue infections. J R Soc Interface. 2015;12(103):20140,886. doi: 10.1098/rsif.2014.0886. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Best K, Guedj J, Madelain V, de Lamballerie X, Lim SY, Osuna CE, Whitney JB, Perelson AS. Zika plasma viral dynamics in nonhuman primates provides insights into early infection and antiviral strategies. PNAS. 2017;114(33):8847–8852. doi: 10.1073/pnas.1704011114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Beura LK, Hamilton SE, Bi K, Schenkel JM, Odumade OA, Casey KA, Thompson EA, Fraser KA, Rosato PC, Filali-Mouhim A, et al. Normalizing the environment recapitulates adult human immune traits in laboratory mice. Nature. 2016;532(7600):512–516. doi: 10.1038/nature17655. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Canini L, Carrat F. Population modeling of influenza A/H1N1 virus kinetics and symptom dynamics. J Virol. 2011;85(6):2764–2770. doi: 10.1128/JVI.01318-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Carr EJ, Dooley J, Garcia-Perez JE, Lagou V, Lee JC, Wouters C, Meyts I, Goris A, Boeckxstaens G, Linterman MA, Liston A. The cellular composition of the human immune system is shaped by age and cohabitation. Nat Immunol. 2016 doi: 10.1038/ni.3371. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Chamberlin TC. The method of multiple working hypotheses With this method the dangers of parental affection for a favorite theory can be circumvented. Science. 1890;15:92–96. doi: 10.1126/science.148.3671.754. [DOI] [PubMed] [Google Scholar]
- 14.Davis MM. A prescription for human immunology. Immunity. 2008;29(6):835–838. doi: 10.1016/j.immuni.2008.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Edupuganti S, Eidex RB, Keyserling H, Akondy RS, Lanciotti R, Orenstein W, del Rio C, Pan Y, Querec T, Lipman H, Barrett A, Ahmed R, Teuwen D, Cetron M, Mulligan MJ. A randomized, double-blind, controlled trial of the 17D yellow fever virus vaccine given in combination with immune globulin or placebo: comparative viremia and immunogenicity. Am J Trop Med Hyg. 2013;88(1):172–177. doi: 10.4269/ajtmh.2012.12-0179. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Elemans M, Thiébaut R, Kaur A, Asquith B. Quantification of the relative importance of CTL, B cell, NK cell, and target cell limitation in the control of primary SIV-infection. PLOS Comput Biol. 2011;7(3):e1001,103. doi: 10.1371/journal.pcbi.1001103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Guedj J, Thiébaut R, Commenges D. Maximum likelihood estimation in dynamical models of HIV. Biometrics. 2007;63(4):1198–1206. doi: 10.1111/j.1541-0420.2007.00812.x. [DOI] [PubMed] [Google Scholar]
- 18.Handel A, Longini IM, Antia R. Towards a quantitative understanding of the within-host dynamics of influenza A infections. Journal of the Royal Society Interface. 2010;7(42):35–47. doi: 10.1098/rsif.2009.0067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Handel A, Longini IM, Jr, Antia R. Neuraminidase inhibitor resistance in influenza: assessing the danger of its generation and spread. PLoS Comput Biol. 2007;3(12):e240. doi: 10.1371/journal.pcbi.0030240. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Handel A, Longini IM, Jr, Antia R. Towards a quantitative understanding of the within-host dynamics of influenza a infections. J R Soc Interface. 2010;7(42):35–47. doi: 10.1098/rsif.2009.0067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Haydon DT, Matthews L, Timms R, Colegrave N. Top-down or bottom-up regulation of intra-host blood-stage malaria: do malaria parasites most resemble the dynamics of prey or predator? Proc Biol Sci. 2003;270(1512):289–98. doi: 10.1098/rspb.2002.2203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Hilborn R, Mangel M. Monographs in population biology. Princeton University Press; Princeton, N.J: 1997. The ecological detective : confronting models with data; p. 28. 96009638 Ray Hilborn and Marc Mangel. ill.; 23 cm. [Google Scholar]
- 23.Kochin BF, Yates AJ, de Roode JC, Antia R. On the control of acute rodent malaria infections by innate immunity. PLoS One. 2010;5(5):e10,444. doi: 10.1371/journal.pone.0010444. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Kuhn E, Lavielle M. Maximum likelihood estimation in nonlinear mixed effects models. Comput Stat Data An. 2005;49(4):1020–1038. [Google Scholar]
- 25.Le D, Miller JD, Ganusov VV. Mathematical modeling provides kinetic details of the human immune response to vaccination. Front Cell Infect Microbiol. 2015;4:1–13. doi: 10.3389/fcimb.2014.00177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Li Y, Handel A. Modeling inoculum dose dependent patterns of acute virus infections. J Theor Biol. 2014;347:63–73. doi: 10.1016/j.jtbi.2014.01.008. [DOI] [PubMed] [Google Scholar]
- 27.Lindstrom MJ, Bates DM. Nonlinear mixed effects models for repeated measures data. Biometrics. 1990:673–687. [PubMed] [Google Scholar]
- 28.McQueen PG, McKenzie FE. Age-structured red blood cell susceptibility and the dynamics of malaria infections. PNAS. 2004;101(24):9161–9166. doi: 10.1073/pnas.0308256101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Miao H, Hollenbaugh JA, Zand MS, Holden-Wiltse J, Mosmann TR, Perelson AS, Wu H, Topham DJ. Quantifying the early immune response and adaptive immune response kinetics in mice infected with influenza A virus. J Virol. 2010;84(13):6687–6698. doi: 10.1128/JVI.00266-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Mideo N, Savill NJ, Chadwick W, Schneider P, Read AF, Day T, Reece SE. Causes of variation in malaria infection dynamics: insights from theory and data. Am Nat. 2011;178(6):E174–88. doi: 10.1086/662670. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Monath T, Staples J, Barrett A. Yellow fever vaccine. 6. Elsevier Saunders; Philadelphia: 2012. pp. 870–968. [Google Scholar]
- 32.Osborne LC, Monticelli LA, Nice TJ, Sutherland TE, Siracusa MC, Hepworth MR, Tomov VT, Kobuley D, Tran SV, Bittinger K, Bailey AG, Laughlin AL, Bouvher JL, Wherry EJ, DBF, EAJ, Virgin HW, Artis D. Virus-helminth coinfection reveals a microbiota-independent mechanism of immunomodulation. Science. 2014;345(6196):578–582. doi: 10.1126/science.1256942. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Painter SD, Ovsyannikova IG, Poland GA. The weight of obesity on the human immune response to vaccination. Vaccine. 2015;33(36):4422–4429. doi: 10.1016/j.vaccine.2015.06.101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Pawelek KA, Huynh GT, Quinlivan M, Cullinane A, Rong L, Perelson AS. Modeling within-host dynamics of influenza virus infection including immune responses. PLoS Comput Biol. 2012;8(6):e1002,588–e1002,588. doi: 10.1371/journal.pcbi.1002588. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Perelson AS. Modelling viral and immune system dynamics. Nature Reviews Immunology. 2002;2(1):28–36. doi: 10.1038/nri700. [DOI] [PubMed] [Google Scholar]
- 36.Phillips AN. Reduction of hiv concentration during acute infection: independence from a specific immune response. Science. 1996 Jan 26;271(5248):497–499. doi: 10.1126/science.271.5248.497. [DOI] [PubMed] [Google Scholar]
- 37.Pinheiro JC, Bates DM. Approximations to the log-likelihood function in the nonlinear mixed-effects model. J Comp Graph Stat. 1995;4(1):12–35. [Google Scholar]
- 38.Poland G, Ovsyannikova I, Jacobson R, Smith D. Heterogeneity in vaccine immune response: the role of immunogenetics and the emerging field of vaccinomics. Clin Pharmacol Ther. 2007;82(6):653–664. doi: 10.1038/sj.clpt.6100415. [DOI] [PubMed] [Google Scholar]
- 39.Rai D, Pham NLL, Harty JT, Badovinac VP. Tracking the total CD8 T cell response to infection reveals substantial discordance in magnitude and kinetics between inbred and outbred hosts. J Immunol. 2009;183(12):7672–7681. doi: 10.4049/jimmunol.0902874. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Regoes RR, Antia R, Garber DA, Silvestri G, Feinberg MB, Staprans SI. Roles of target cells and virus-specific cellular immunity in primary simian immunodeficiency virus infection. J Virol. 2004;78(9):4866–75. doi: 10.1128/JVI.78.9.4866-4875.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Reynolds SR, Celis E, Sette A, Oratz R, Shapiro RL, Johnston D, Fotino M, Bystryn JC. Hla-independent heterogeneity of CD8+ T cell responses to MAGE-3, Melan-A/MART-1, gp100, tyrosinase, MC1R, and TRP-2 in vaccine-treated melanoma patients. J Immunol. 1998;161(12):6970–6976. [PubMed] [Google Scholar]
- 42.Saenz RA, Quinlivan M, Elton D, MacRae S, Blunden AS, Mumford JA, Daly JM, Digard P, Cullinane A, Grenfell BT, McCauley JW, Wood JLN, Gog JR. Dynamics of influenza virus infection and pathology. J Virol. 2010;84(8):3974–3983. doi: 10.1128/JVI.02078-09. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Samson A, Lavielle M, Mentré F. Extension of the saem algorithm to left-censored data in nonlinear mixed-effects model: application to HIV dynamics model. Comput Stat Data An. 2006;51(3):1562–1574. [Google Scholar]
- 44.Smith AM, Adler FR, Ribeiro RM, Gutenkunst RN, McAuley JL, Mc-Cullers JA, Perelson AS. Kinetics of coinfection with influenza A virus and streptococcus pneumoniae. PLoS Pathog. 2013;9(3):e1003,238. doi: 10.1371/journal.ppat.1003238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Smith AM, Adler FR, Ribeiro RM, Gutenkunst RN, McAuley JL, Mc-Cullers JA, Perelson AS. Kinetics of coinfection with influenza a virus and streptococcus pneumoniae. PLoS Pathog. 2013;9(3):e1003,238. doi: 10.1371/journal.ppat.1003238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Stafford MA, Corey L, Cao Y, Daar ES, Ho DD, Perelson AS. Modeling plasma virus concentration during primary hiv infection. J Theor Biol. 2000;203(3):285–301. doi: 10.1006/jtbi.2000.1076. [DOI] [PubMed] [Google Scholar]
- 47.Yap GS, Stevenson MM. Blood transfusion alters the course and outcome of plasmodium chabaudi as infection in mice. Infect Immun. 1994;62(9):3761–3765. doi: 10.1128/iai.62.9.3761-3765.1994. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Table 1: Comparison of goodness of fit to viral load data We compare the loglikelihood, AICc and BIC of each model using both fits to the average data and mixed effects fits. Each row represents a different model and the models are clustered by type. The target cell depletion models are shown first, followed by various immune models found in the literature, and then models that we developed for this paper.
Figure 1: Viral load vs time post vaccination. Each panel represents a different volunteer. Data is represented by dots. Note that the limit of detection is 10 genomes per ml. The curves represent the models simulated using the posterior modes as calculated by monolix. The numbers in each panel represent the sum or square residuals from each model in the following order:Target Cell, Innate immunity, Adaptive immunity, Minimal immunity
Figure 2: Histograms and qq-plots of the posterior means for the target cell depletion model. The number on each qq-plot is the p-value for the Anderson-Darling test of normality, a lower number mean the values are less likely to have come from a normal distribution.
Figure 3: Histograms and qq-plots of the posterior means for the innate immunity model. The number on each qq-plot is the p-value for the Anderson-Darling test of normality, a lower number mean the values are less likely to have come from a normal distribution.
Figure 4: Histograms and qq-plots of the posterior means for the adaptive immunity model. The number on each qq-plot is the p-value for the Anderson-Darling test of normality, a lower number mean the values are less likely to have come from a normal distribution.
Figure 5: Histograms and qq-plots of the posterior means for the minimal model. The number on each qq-plot is the p-value for the Anderson-Darling test of normality, a lower number mean the values are less likely to have come from a normal distribution.





