ABSTRACT
Heterogeneity in host susceptibility is a key determinant of infectious disease dynamics but is rarely accounted for in assessment of disease control measures. Understanding how susceptibility is distributed in populations, and how control measures change this distribution, is integral to predicting the course of epidemics with and without interventions. Using multiple experimental and modeling approaches, we show that rainbow trout have relatively homogeneous susceptibility to infection with infectious hematopoietic necrosis virus and that vaccination increases heterogeneity in susceptibility in a nearly all-or-nothing fashion. In a simple transmission model with an R0 of 2, the highly heterogeneous vaccine protection would cause a 35 percentage-point reduction in outbreak size over an intervention inducing homogenous protection at the same mean level. More broadly, these findings provide validation of methodology that can help to reduce biases in predictions of vaccine impact in natural settings and provide insight into how vaccination shapes population susceptibility.
KEYWORDS: all-or-nothing vaccines, heterogeneity, infectious disease dynamics, mode of vaccine action, partially protective vaccine
IMPORTANCE
Differences among individuals influence transmission and spread of infectious diseases as well as the effectiveness of control measures. Control measures, such as vaccines, may provide leaky protection, protecting all hosts to an identical degree, or all-or-nothing protection, protecting some hosts completely while leaving others completely unprotected. This distinction can have a dramatic influence on disease dynamics, yet this distribution of protection is frequently unaccounted for in epidemiological models and estimates of vaccine efficacy. Here, we apply new methodology to experimentally examine host heterogeneity in susceptibility and mode of vaccine action as distinct components influencing disease outcome. Through multiple experiments and new modeling approaches, we show that the distribution of vaccine effects can be robustly estimated. These results offer new experimental and inferential methodology that can improve predictions of vaccine effectiveness and have broad applicability to human, wildlife, and ecosystem health.
INTRODUCTION
Host heterogeneity influences infection dynamics and thereby the ability to predict the impact of control measures (1, 2). While much attention has been given to host heterogeneity in exposure (e.g., contact rates) (3–7), considerably less attention has been paid to heterogeneity in susceptibility to infection given exposure (8–10). Heterogeneity in susceptibility is typically incorporated into model structure through increased compartmentalization (11). Individuals in different compartments are assumed to have different susceptibilities, while those in the same compartment are presumed identical (12). In nature, heterogeneity in susceptibility is continuous (8, 13–17), and factors influencing susceptibility may be unknown, making assessment of susceptibility to infection a significant challenge in prediction of infectious disease epidemics.
Tools from the field of quantitative microbial risk assessment can aid in estimation of heterogeneity in susceptibility. Dose-response relationships from this field posit that increases in pathogen challenge dose result in an increasing probability of host infection (18). Highly susceptible hosts are likely to become infected at low challenge doses, and as dose increases, more-resistant hosts become increasingly likely to become infected (8, 16). The shape of the relationship between challenge dose and probability of infection allows for estimation of the extent of host heterogeneity in susceptibility (19). A null hypothesis of complete homogeneity (no variation) in susceptibility implies that (i) the per-pathogen probability of establishing infection is the same for each host and (ii) the probability that each host becomes infected through challenge with a particular pathogen dose is independent in repeated challenges (18).
This null hypothesis makes two testable predictions. (i) The increase in the probability of infection with challenge dose will be steep, in accordance with the exponential decline in the Poisson probability of escaping infection as dose increases. Departures from this null hypothesis will result in a less-steep dose-response curve (18), in which the probability of infection increases more slowly with challenge dose. (ii) Over a single inoculation event with a fixed duration, if hosts could be challenged multiple times with the same pathogen without having their immune status modified by each exposure, the result of previous challenges should give no indication of what to expect in a subsequent challenge. Put another way, the success of one challenge in a host is uncorrelated with the success in a subsequent challenge when all hosts are equally susceptible. Therefore, after two challenges, the number of hosts infected zero, one, or two times should be geometrically distributed, with a single unknown parameter corresponding to the probability of infection in a single challenge (20). In a continuous challenge, the frequency of hosts infected over a longer challenge duration should be equivalent to that after challenging hosts with a higher dose for a shorter time period. For example, the fraction of hosts infected in a 1-h challenge at a high dose should be the same as the fraction of hosts infected in a 2-h challenge at half that dose (21).
Heterogeneity in susceptibility to infection, or departure from this null hypothesis, may be present among unvaccinated individuals, vaccinated individuals, or both. Heterogeneity in susceptibility is particularly important when considering vaccine efficacy, because the mode of vaccine action can influence disease dynamics (9) and pathogen evolution (22). Vaccines protecting hosts in a so-called “all-or-nothing” fashion will afford complete protection to some fraction of hosts while leaving other hosts completely unprotected, producing heterogeneous susceptibility in vaccinated hosts. The other extreme is a “leaky” vaccine, which partially protects each host to an equal degree (9). Of course, intermediates between the all-or-nothing and leaky extremes are also possible. Distinguishing the epidemiological mode of action of vaccination is important because an all-or-nothing vaccine has a greater impact in reducing population-wide pathogen transmission than a leaky vaccine of the same overall efficacy (9, 23–25). This is in part because under a given force of infection, the all-or-nothing vaccinated population will experience a susceptibility reduction over time due to cohort selection (more susceptible individuals are infected first and removed from the susceptibility pool). This effect is weaker when susceptibility is more homogeneous (8, 16, 26–28). Despite the importance of the leaky and all-or-nothing distinction, the incorporation of mode of vaccine action into epidemiological models is frequently determined by convenience rather than accuracy criteria.
Infectious hematopoietic necrosis virus (IHNV) is a single-stranded RNA virus endemic to salmonid fishes in the Pacific Northwest of North America (29, 30). The virus is a significant pathogen of wild, farmed, and hatchery salmonids, including rainbow trout (Oncorhynchus mykiss) (30, 31). The pathogen causes acute mortality due to necrosis of the host kidney and spleen (30). Due to the economic importance of rainbow trout, vaccines for IHNV have been developed that reduce mortality from disease and are cross-protective against multiple IHNV strains (32–39). In addition, selective breeding of fish for resistance to the virus has also been pursued (40–42). Multiple genotypes of the virus have also been found to circulate simultaneously (43, 44), and fitness differences among several viral strains have been previously characterized (45, 46). Several pathogen strains (genotypes B and C, described in detail below) have been shown to have nearly equivalent fitnesses with no evidence for strain interference effects (46). Because of the manipulability of rainbow trout, the ability to breed large numbers of pathogen-free individuals in captivity, knowledge of IHNV viral strain fitness, and the range of disease interventions against IHNV, this is an ideal model system for studying heterogeneity in innate and vaccine-induced susceptibility.
Here, we examine the distribution of host susceptibility to IHNV infection in unvaccinated and vaccinated fish using two experimental approaches motivated by the two predictions of the null model listed above. First, we investigate how increases in pathogen concentration influence infection in unvaccinated and vaccinated hosts, testing the first prediction of the null model of homogeneous susceptibility. Second, we test the second prediction of the null model by simultaneously challenging fish with two IHNV strains with similar fitnesses and compare single and dual infection frequencies to independently estimate susceptibility distributions and the mode of vaccine action. We use simultaneous challenge instead of repeated challenges to circumvent development of immunity following a primary exposure. Finally, we examine the impact of excluding vaccine-induced changes in heterogeneity in susceptibility on disease dynamics using a simple transmission model.
RESULTS
We first exposed groups of unvaccinated and vaccinated lab-reared juvenile rainbow trout to increasing concentrations of IHNV through immersion challenge. The probability of infection for unvaccinated fish increased steeply with exposure concentration (proportional to dose), consistent with relatively homogeneous susceptibility (Fig. 1), although a model with modest gamma-distributed heterogeneity in susceptibility in unvaccinated fish (mean = 0.979, variance = 0.656, shape = 1.53, rate = 1.56) (Fig. 2A) received slightly higher support (ΔBIC [Bayesian information criterion] = 2.47) (Fig. 1). The probability of infection at a given exposure concentration was consistently lower for vaccinated fish and increased more slowly with concentration, implying greater heterogeneity in susceptibility (18). There was no support for homogeneous susceptibility among vaccinated individuals (ΔBIC = 59.27) (see Table S1 in the supplemental material).
Assuming that the distribution of vaccine effects in reducing susceptibility was gamma distributed and independent of baseline susceptibility, we obtained the beta distribution for vaccine action that produced the best-fitting combined beta-gamma distribution of susceptibilities for vaccinated hosts (Fig. 2B). The resulting beta distribution indicated a highly heterogeneous and polarized mode of vaccine action that conferred almost total protection on a majority of fish while a smaller fraction of individuals were nearly completely unprotected (α = 0.12, β = 0.45) (Fig. 2B). The estimated beta distribution assuming homogeneity of unvaccinated fish was nearly identical to the estimated beta distribution with gamma-distributed baseline susceptibility (Fig. 2B, black-dashed line). The resulting combined distribution assuming that the vaccine acts multiplicatively and independently on the innate susceptibilities of unvaccinated fish is unimodal with the mass of the distribution centered close to 0. This is due to the much larger mode of the estimated beta distribution of vaccine susceptibility multipliers near 0, as the majority of hosts were nearly completely protected by vaccination (Fig. 2C).
To test the second prediction of the homogeneity model, we designed an experiment to determine whether hosts challenged twice with the same pathogen had independent probabilities of infection among challenges. If hosts were identical, the result of a single pathogen challenge should provide no information about the relative susceptibilities of individual hosts. To assess this, we challenged vaccinated and unvaccinated hosts with two viral strains with similar fitnesses at a single dose sufficient to infect approximately 50% of all vaccinated hosts in a single strain challenge. This was meant to simulate multiple sequential challenges (47) that could distinguish between leaky and all-or-nothing modes of vaccine action (10, 27, 48, 49), such that leaky protection would independently reduce susceptibility of a fish to each challenge while an all-or-nothing vaccine would protect a fish either completely against both challenges or not at all against either. Because challenge with IHNV induces a nonspecific immune response that makes a fish temporarily refractory to further infection (50), we used simultaneous challenges rather than sequential ones. Under a strictly leaky mode of action at a dose where 50% of vaccinated individuals become infected in a dose-response challenge, we would expect that 25% of vaccinated hosts would have no infections, 50% would have single infections, and 25% would have double infections, if the vaccine was exactly 50% effective against each strain. A strictly all-or-nothing mode of action would result in 50% of the hosts with no infections and 50% of hosts with double infections. We found that 48.0% of vaccinated hosts in the simultaneous challenge had no infections, 25.3% had single infections, and 26.7% had double infections (Fig. 3). In unvaccinated fish, 26% had no infections, 41% had single infections, and 34% had double infections. In unvaccinated fish, we found that the homogeneous model had slightly more support (ΔBIC = 0.498) (Fig. 4A; Table S2) than the heterogeneous model. This is consistent with the independent sorting of pathogen strains among identical individuals, although population probabilities were not perfectly leaky (e.g., 25% uninfected, 50% singly infected, and 25% double infected; chi-squared goodness-of-fit test, P = 0.15). Vaccinated fish were more heterogeneous (α = 0.27, β = 0.49, variance = 0.13) (Fig. 4B), and there was no support for homogeneous susceptibility (Table S2). Parameter estimates were within the 95% confidence interval of the distribution of vaccine effects estimated from the first experiment.
We used the estimated distribution of vaccine effects to examine the influence of experimentally estimated heterogeneity in susceptibility on disease dynamics, compared to models where the reduction in susceptibility due to vaccination was either homogeneous or discretely all-or-nothing (Fig. 5). At an R0 of 2, we found that in an epidemic of a vaccinated population, the experimentally estimated polarized distribution of vaccine effects reduced the total number of hosts infected by 35 percentage-points over a model where all individuals were assumed to be homogeneously protected to the same extent by vaccination (e.g., 45% of hosts became infected if vaccine protection was heterogeneous and 80% became infected if protection was homogeneous). However, this reduction was far less than the discrete all-or-nothing model, where only 36% of hosts became infected. The highly polarized mode of vaccine action caused the most susceptible individuals to become infected first and resulted in a reduction in mean susceptibility over the course of the epidemic (Fig. S1). At R0 values of >6, homogeneous vaccine protection resulted in 100% of individuals becoming infected (e.g., a final outbreak size of 100), whereas at an R0 of 25, heterogeneous protection, as estimated by our experiments, still prevented infection in 17% of vaccinated individuals (Fig. S2).
DISCUSSION
Heterogeneity in host susceptibility to infection is an often overlooked but important determinant of infectious disease dynamics (8, 9). In this study, we show that vaccination of rainbow trout increases heterogeneity in susceptibility to infection in a highly polarized fashion. Our findings of nearly identical susceptibility distributions using two independent methodologies affirm the utility of tools from quantitative microbial risk assessment in describing host heterogeneity and provide biological support for some polarized, nearly all-or-nothing modes of vaccine action, as found in this case. Furthermore, we provide evidence that a null model of homogeneous susceptibility does not adequately describe vaccinated host populations. However, unvaccinated hosts had more homogeneous susceptibility, with probability of infection increasing sharply with pathogen dose. We also found that two viral strains of equivalent fitnesses nearly independently sorted among unvaccinated hosts, confirming the null model of primarily homogeneous susceptibility in this group.
The robust estimation of susceptibility distributions using multiple methods provides several potential avenues for including heterogeneity in epidemic models and estimating vaccine effects across disease systems. Frequently, heterogeneity in susceptibility among hosts is unknown or is incorporated into model structure through numerous classes representing factors thought to be important determinants of susceptibility (e.g., age or sex) (51). Models may also incorporate heterogeneity in susceptibility based on risk factors identified in previous studies (e.g., tuberculosis infection in HIV susceptibility). However, even the most rigorously designed studies may overlook important underlying risks that influence host susceptibility. The tools presented here allow for assessment of all underlying variation in susceptibility and do not require understanding of individual risks or a mechanistic understanding of the causes of heterogeneity.
These results build on a large body of literature underscoring the importance of heterogeneity in infectious disease systems, including contact structure heterogeneity and variation in infectiousness (52, 53). Heterogeneity in infectiousness can modify disease dynamics, but importantly must be correlated with susceptibility, contacts, or other parameters (e.g., mortality from disease) to influence the size of epidemics. This is because the mean of the distribution will be identical among infected cohorts unless other model parameters preferentially remove or add individuals that change this mean (e.g., individuals that are more infectious die before they transmit). Conversely, like heterogeneity in susceptibility, heterogeneity in contacts will change dynamically over an epidemic as the individuals with the highest numbers of contacts become infected early in the epidemic and continue to infect others during their infectious period but then exit the infected pool as they recover (for pathogens with a recovered class). Therefore, adding heterogeneity in the encounter rate should further reduce the size of outbreaks, dependent on correlations between model parameters and the relative importance of each host trait in determining infection and mortality (54).
Rectifying diverse estimates of vaccine efficacy across studies is a significant challenge in public health (26). Our study further affirms that heterogeneous susceptibility among groups is a potential explanation for variation in these estimates. As expected, excluding heterogeneity in susceptibility from epidemic models had a significant impact on disease dynamics. Using a polarized mode of vaccine action resulted in fewer infected individuals under a wide range of R0 values, whereas homogeneous protection led to all hosts becoming infected for R0 values of >6. While the fraction of hosts infected will depend on particular parameter estimates, and we have not exhausted all parameter combinations and shape possibilities, this study provides further evidence that heterogeneous susceptibility decreases the size of epidemics. This is because the polarized mode of vaccine action greatly reduced the susceptibility of a fraction of individuals, nearly completely protecting them against infection. Transitions of susceptible individuals into the infected class occurred nonuniformly, with the most susceptible individuals first becoming infected, leaving increasingly resistant individuals in the susceptible class as the epidemic progressed. Conversely, the homogeneous model assumed that the susceptibility of all individuals was identical and therefore did not allow for the effect of cohort selection (55). The discrete all-or-nothing model overestimated vaccine protection compared to the experimentally derived distribution of vaccine protection. This further emphasizes that empirical estimates of vaccine protection can vastly improve epidemiological predictions and provide insight into vaccine programs (56).
In considering the design and interpretation of vaccine trials, it is important to understand the influence that variation in vaccine effects (9) and variation in natural susceptibility (57) will have on vaccine efficacy. In a vaccine trial, there will be a faster reduction in susceptibility in the control group relative to those individuals receiving vaccination, if the vaccine reduces susceptibility and prevents infection. This reduction in susceptibility will result in a reduction in incidence over time in the control group, and this effect can be misconstrued as waning vaccine efficacy (26). Therefore, it is important to consider that variation in susceptibility within and among both vaccinated and unvaccinated populations may contribute to perceived changes in vaccine efficacy over space and time, which highlights the necessity to consider alternative metrics for calculating vaccine efficacy (26, 58). Examination of vaccine study efficacy with epidemiological models can aid in reducing biases that may be overlooked using more static measures of vaccine efficacy (49).
Few studies have sought to investigate the mode of protection of control measures, as separating natural host heterogeneity from control-induced changes in susceptibility is a significant challenge (17). We provide a method for separating natural heterogeneity in susceptibility from changes in susceptibility due to vaccination, assuming that natural and vaccine-induced susceptibilities are independent. It is important to note that we did not explore all possible probability distributions, and the fit of different probability distributions is difficult to distinguish from our data (see Table S1 in the supplemental material). Future studies with larger sample sizes and greater dose ranges may be better able to assess the suitability of specific probability distributions, including the exploration of scaled distributions, or multiple distributions, which would allow for bimodal susceptibility without constraining the values to fall between 0 and 1. Future experiments should also be conducted to help determine whether natural and control measure susceptibility distributions should be treated independently and the influence that this may have on control measure efficacy.
Susceptibility of the unvaccinated hosts was very homogenous relative to those vaccinated. Rainbow trout lines used in this experiment have been selectively bred for disease resistance, among other traits, due to the importance of IHNV in disease outbreaks in aquaculture (42, 59, 60). It is possible that selective breeding may have contributed to decreased variation in susceptibility if hosts with lower susceptibility were selected from a population with greater variance. If selection is strongly directional and uncorrelated with other traits, susceptibility to a specific pathogen would be predicted to decrease and become more homogeneous over time, just as mean susceptibility decreases over the course of an epidemic (Fig. S1). Genetic variation is an important determinant of pathogen transmission and spread (61), and our results offer potential insight into the mechanism by which pathogens may spread more easily through homogeneous host populations. However, more research is needed to determine whether natural selection by pathogens might also select for relatively homogeneous susceptibility, given that hosts naturally exposed to pathogens likely experience more significant tradeoffs than hosts that have undergone purifying artificial selection (62, 63). Nonetheless, if selective breeding for disease resistance reduces variation in susceptibility, this will result in larger epidemics than if mean susceptibility is reduced by the same amount while preserving trait variance, as demonstrated in Fig. 5.
Heterogeneity in susceptibility is a key determinant of disease dynamics and impacts (8, 9, 14, 16, 17, 62). Although the importance of interindividual variation in susceptibility and risk response to disease is widely recognized (51), epidemiological models frequently fail to account for this variation. Our data emphasize the importance of incorporating heterogeneity in susceptibility in estimates of control measure efficacy. Inclusion of this variance will help to improve prediction and allow for better management of infectious diseases of humans and wildlife.
MATERIALS AND METHODS
Experimental methods.
Hosts used for all experiments were 1- to 3-g research-grade rainbow trout (Oncorhynchus mykiss) fry obtained from Clear Springs Foods Inc. Fish were maintained on specific-pathogen-free, sand-filtered, UV-irradiated water at 15 ± 2°C and fed 1.0-mm salmon feed (Skretting) daily at 1 to 2% per body weight. Viruses used in the experiments were IHNV genotypes HV, B, and C, previously referred to as 220:90, FF020-91, and FF030-91, respectively (46, 64). Genotype HV has previously been shown to have high in vivo fitness and virulence (45, 64, 65), and genotypes B and C have been shown to have equal in vivo fitnesses as measured by infectivity and in-host replication and virulence as measured by host mortality (46), in rainbow trout. Virus stocks were generated by culture on epithelioma papulosum cyprini (EPC) cells as previously described (38, 66), measured for infectious virus titer using plaque assays (46, 67), and stored at −80°C until experimental challenges. Prior to vaccination, fish were anesthetized briefly by immersion in 100 mg tricaine methanesulfonate buffered with 300 mg sodium bicarbonate in 1 liter H2O. Fish were vaccinated by intramuscular injection of 0.05 µg of the DNA vaccine pIHNwG, delivered in 25 µl of phosphate-buffered saline (PBS), as previously described (38). Sham-vaccinated fish received an injection of 25 µl of PBS. After vaccination, fish were allowed to fully recover before distribution into holding tanks. Fish were then held for 28 to 30 days prior to experimental exposure to virus to allow for immunity to fully develop (39) and weighed 1 to 3 g at the initiation of pathogen challenge experiments. Previous studies have shown that this vaccination regime is highly protective against IHN disease (38, 68, 69). The dose-response challenge experiment was conducted at the USGS Western Fisheries Research Center, Seattle, WA. The multiple-strain experiment was conducted at the Virginia Institute of Marine Science, Gloucester Point, VA.
For the dose-response experiment, we challenged subgroups of 20 pIHNwG-vaccinated and 20 sham-vaccinated fish with each of seven concentrations (0, 0.01, 0.1, 1, 101, 102, and 103 PFU/μl) of IHNV genotype HV, creating a total of 14 treatment groups. Inocula were prepared in minimal essential medium with 10% fetal bovine serum (Gibco), such that virus was delivered as a 5-ml volume to each group. Fish were exposed to virus in batch, using a 1-h immersion in 1 liter of water containing virus, followed by a 1-h rinse in flowing water to remove exposure virus, as previously described (46). We then isolated fish into 1-liter beakers containing 400 ml of water and held fish under static conditions at 15°C for 3 days, the time period in which previous studies have demonstrated peak viral loads in infected fish (46, 70). Fish were then euthanized with 300 mg of tricaine methanesulfonate buffered with 900 mg of sodium bicarbonate in 1 liter of H2O and stored individually until RNA extraction as outlined below.
For the multiple-strain experiment, 75 vaccinated and 74 unvaccinated fish were simultaneously exposed to IHNV genotypes B and C at a concentration of 2 PFU/μl of each genotype, through an immersion challenge as described above except that the immersion volume was 4 liters and isolation tanks were 0.8 liter. On day 3 postexposure, fish were harvested and stored at −80°C as described above until viral load quantification.
Viral RNA was extracted from whole fish using the QIAamp Cador pathogen minikit (Qiagen) according to the manufacturer’s specifications, with the following modifications. Whole fish were homogenized by placing them in 4.5-ml Tallprep lysing matrix D tubes (MP Bio) with 1 ml guanidinium-thiocyanate solution (45) per gram of fish and then sonicated three times at 4.0 m/s for 20 s on a FastPrep 24 homogenizer (MP Bio) until completely liquefied. Homogenized fish were then centrifuged at 2,000 rpm and 20°C for 3 min, and 200 μl of the supernatant was combined with buffer VXL (Qiagen) and then run through the Cador kit protocol, with 100 μl buffer AVE used for elution. Extracted RNA was stored at −80°C until reverse transcription as previously described (45). Fish infection status was then determined by real-time quantitative PCR targeting the virus nucleoprotein (N) gene with primers IHNV N 796F and IHNV N 875R and TaqMan probe (Applied Biosystems) IHNV N 818MGB as previously described (71). All studies and protocols were approved under Virginia Institute of Marine Science IACUC-2013-02-11-8458-arwargo. This is in compliance with federal regulations (Department of Agriculture 9 CFR parts 1 and 2; Public Health Service 99-158).
Inferential framework.
We modified dose-response models to describe the susceptibility of vaccinated and unvaccinated fish challenged with IHNV (18, 19, 72). We expanded the inferential framework from the conventional dose-response experiment to incorporate multiple viral strains. We fitted the models to data by either minimizing the deviance between the data and the model (dose-response experiment) (18) or minimizing the negative log likelihood using the multinomial distribution with classes zero-strain infections, single-strain infections, and two-strain infection (multiple-strain challenge). We jointly fitted the control and vaccine data by optimizing the parameters to minimize the sum of the deviance or of the negative log likelihood across both groups. We assumed that the baseline susceptibility in unvaccinated hosts followed a gamma distribution (19) and a beta distribution of vaccine effects to allow for bimodal (polarized) distributions (9, 17).
In equation 1, we allowed the unvaccinated control group to have homogeneous susceptibility, and susceptibility of the vaccinated group follows a beta distribution.
(1) |
Here, d (dose) is the exposure concentration over a 1-h immersion challenge, and Ic or IV is the proportion of individuals infected in either the unvaccinated control group or the vaccine group, respectively. The subscript “hom” denotes a model assuming homogenous susceptibility, where “het” assumes that individuals have susceptibility (x) that is distributed according to a beta distribution. p is the per-virus particle concentration rate of host infection in microliters per PFU-hour.
We also fitted models that allowed heterogeneity in susceptibility in the unvaccinated control group.
(2) |
Here, unvaccinated fish have a baseline susceptibility that is distributed according to a gamma distribution. The Laplace transform simplifies the integral in the control (Ic) group (19, 72), where v is the inverse of the shape parameter and b is the mean of the gamma distribution parameterized as shape divided by rate.
For the two-strain challenge experiment, we modified the above equations to reflect differences in the probability of infection with two strains (2), one strain (1), and zero strains (0).
Here, there was no support for unvaccinated fish having any variation in susceptibility, and so we assumed a homogeneous susceptibility constant (p). Vaccinated fish followed a beta distribution f (x), determined by shape parameters α and β.
To evaluate the influence of heterogeneity in susceptibility due to vaccination on disease dynamics, we formulated a hypothetical epidemic through a closed population with similar attributes as IHNV using a simple susceptible-infected-recovered transmission model with disease-induced death and where surviving infected individuals recover with sterilizing immunity. We arbitrarily selected values for the transmission rate, recovery rate, and disease-induced mortality rates and varied the transmission rate to explore the influence of R0 on the size of the outbreak for homogeneous, heterogeneous, and all-or-nothing susceptibility (Fig. S2).
To model this, we assumed that susceptibility lies between 0 and 1. For homogeneous susceptibility, we modeled a vaccinated population where vaccine effectiveness was represented by σ, equal to the mean susceptibility of vaccinated fish from the two-strain experiment.
Here, ν is the per capita rate of infection, δ is disease-induced mortality, and γ is the rate at which infected individuals recover from infection. V, I, and R represent the population sizes of vaccinated, infected, and recovered individuals, respectively. For initial conditions, we arbitrarily set the number of vaccinated individuals to 100 and assumed a single infected individual.
To model continuous heterogeneous susceptibility using susceptibility estimates from our experiments, we discretized susceptibility into 300 bins and used the midpoint xi of the bin to represent the susceptibility of the hosts. By integrating over the lower and upper bounds of each bin, we determined the frequency of individuals in each susceptibility bin or group.
Here, x is susceptibility distributed according to a beta distribution with parameters α = 0.27 and β = 0.49, and each moment of exposure is x times more or less likely to infect a fish of susceptibility equal to 1 because each particle to which it is exposed is x times as infectious.
To model all-or-nothing susceptibility, the vaccine group was composed of two discrete susceptibility states representing an all-or-nothing mode of vaccine action, V1 (individuals with no vaccine protection, σ1 = 1) and V2 (individuals with complete vaccine protection, σ2 = 0). The number of individuals in each vaccine group was determined from the estimate of mean susceptibility from the two-strain experiment.
All models were simulated in continuous time using package deSolve (73) in RStudio v.0.99.484 (74).
ACKNOWLEDGMENTS
We thank Doug McKenney, Claudio Struchiner, Manuel Labee, Zoemma Warshafsky, Tim Leeds, Greg Wiens, Caetano Souto Maior, and Travis Morrison for technical assistance and fruitful discussions. We also thank Scott LaPatra of Clear Springs Foods Inc. for supplying fish.
Any use of trade, firm, or product names is for descriptive purposes only and does not imply endorsement by the U.S. Government.
Funding was provided by the NIH EEID grant R01GM113233, FCT (IF/01346/2014) to M.G.M.G., and the Virginia Institute of Marine Science.
Footnotes
Citation Langwig KE, Wargo AR, Jones DR, Viss JR, Rutan BJ, Egan NA, Sá-Guimarães P, Kim MS, Kurath G, Gomes MGM, Lipsitch M. 2017. Vaccine effects on heterogeneity in susceptibility and implications for population health management. mBio 8:e00796-17. https://doi.org/10.1128/mBio.00796-17.
Contributor Information
Shweta Bansal, Georgetown University.
Melinda M. Pettigrew, Yale School of Public Health.
REFERENCES
- 1.Woolhouse MEJ, Dye C, Etard JF, Smith T, Charlwood JD, Garnett GP, Hagan P, Hii JLK, Ndhlovu PD, Quinnell RJ, Watts CH, Chandiwana SK, Anderson RM. 1997. Heterogeneities in the transmission of infectious agents: implications for the design of control programs. Proc Natl Acad Sci U S A 94:338–342. doi: 10.1073/pnas.94.1.338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Anderson RM, May RM. 1991. Infectious diseases of humans: dynamics and control. Oxford University Press, London, United Kingdom. [Google Scholar]
- 3.Lloyd-Smith JO, Schreiber SJ, Kopp PE, Getz WM. 2005. Superspreading and the effect of individual variation on disease emergence. Nature 438:355–359. doi: 10.1038/nature04153. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Paull SH, Song S, McClure KM, Sackett LC, Kilpatrick AM, Johnson PTJ. 2012. From superspreaders to disease hotspots: linking transmission across hosts and space. Front Ecol Environ 10:75–82. doi: 10.1890/110111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Rifkin JL, Nunn CL, Garamszegi LZ. 2012. Do animals living in larger groups experience greater parasitism? A meta-analysis. Am Nat 180:70–82. doi: 10.1086/666081. [DOI] [PubMed] [Google Scholar]
- 6.Altizer S, Nunn CL, Thrall PH, Gittleman JL, Antonovics J, Cunningham AA, Dobson AP, Ezenwa V, Jones KE, Pedersen AB, Poss M, Pulliam JRC. 2003. Social organization and parasite risk in mammals: integrating theory and empirical studies. Annu Rev Ecol Evol Syst 34:517–547. doi: 10.1146/annurev.ecolsys.34.030102.151725. [DOI] [Google Scholar]
- 7.Hamede R, Bashford J, Jones M, McCallum H. 2012. Simulating devil facial tumour disease outbreaks across empirically derived contact networks. J Appl Ecol 49:447–456. doi: 10.1111/j.1365-2664.2011.02103.x. [DOI] [Google Scholar]
- 8.Dwyer G, Elkinton JS, Buonaccorsi JP. 1997. Host heterogeneity in susceptibility and disease dynamics: tests of a mathematical model. Am Nat 150:685–707. doi: 10.1086/286089. [DOI] [PubMed] [Google Scholar]
- 9.Gomes MGM, Lipsitch M, Wargo AR, Kurath G, Rebelo C, Medley GF, Coutinho A. 2014. A missing dimension in measures of vaccination impacts. PLoS Pathog 10:e1003849. doi: 10.1371/journal.ppat.1003849. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Halloran ME, Longini IM, Struchiner CJ. 1996. Estimability and interpretation of vaccine efficacy using frailty mixing models. Am J Epidemiol 144:83–97. doi: 10.1093/oxfordjournals.aje.a008858. [DOI] [PubMed] [Google Scholar]
- 11.Anderson RM, May RM. 1979. Population biology of infectious diseases I. Nature 280:361–367. doi: 10.1038/280361a0. [DOI] [PubMed] [Google Scholar]
- 12.Kermack WO, McKendrick AG (ed). 1927. A contribution to the mathematical theory of epidemics. Proc R Soc Lond A: Math Phys Eng Sci 115:700-721. doi: 10.1098/rspa.1927.0118. [DOI] [Google Scholar]
- 13.Dwyer G, Levin SA, Buttel L. 1990. A simulation-model of the population-dynamics and evolution of myxomatosis. Ecol Monogr 60:423–447. doi: 10.2307/1943014. [DOI] [Google Scholar]
- 14.Fleming-Davies AE, Dukic V, Andreasen V, Dwyer G. 2015. Effects of host heterogeneity on pathogen diversity and evolution. Ecol Lett 18:1252–1261. doi: 10.1111/ele.12506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Fuller E, Elderd BD, Dwyer G. 2012. Pathogen persistence in the environment and insect-baculovirus interactions: disease-density thresholds, epidemic burnout, and insect outbreaks. Am Nat 179:E70–E96. doi: 10.1086/664488. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Dwyer G, Dushoff J, Elkinton JS, Levin SA. 2000. Pathogen‐driven outbreaks in forest defoliators revisited: building models from experimental data. Am Nat 156:105–120. doi: 10.1086/303379. [DOI] [PubMed] [Google Scholar]
- 17.Pessoa D, Souto-Maior C, Gjini E, Lopes JS, Ceña B, Codeço CT, Gomes MG. 2014. Unveiling time in dose-response models to infer host susceptibility to pathogens. PLoS Comput Biol 10:e1003773. doi: 10.1371/journal.pcbi.1003773. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Haas CN, Rose JB, Gerba CP. 1999. Quantitative microbial risk assessment, 1st ed. John Wiley & Sons, New York, NY. [Google Scholar]
- 19.Ben-Ami F, Ebert D, Regoes RR. 2010. Pathogen dose infectivity curves as a method to analyze the distribution of host susceptibility: a quantitative assessment of maternal effects after food stress and pathogen exposure. Am Nat 175:106–115. doi: 10.1086/648672. [DOI] [PubMed] [Google Scholar]
- 20.van der Werf W, Hemerik L, Vlak JM, Zwart MP. 2011. Heterogeneous host susceptibility enhances prevalence of mixed-genotype micro-parasite infections. PLoS Comput Biol 7:e1002097. doi: 10.1371/journal.pcbi.1002097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Regoes RR. 2012. The role of exposure history on HIV acquisition: insights from repeated low-dose challenge studies. PLoS Comput Biol 8:e1002767. doi: 10.1371/journal.pcbi.1002767. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Read AF, Baigent SJ, Powers C, Kgosana LB, Blackwell L, Smith LP, Kennedy DA, Walkden-Brown SW, Nair VK. 2015. Imperfect vaccination can enhance the transmission of highly virulent pathogens. PLoS Biol 13:e1002198. doi: 10.1371/journal.pbio.1002198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Goldstein E, Paur K, Fraser C, Kenah E, Wallinga J, Lipsitch M. 2009. Reproductive numbers, epidemic spread and control in a community of households. Math Biosci 221:11–25. doi: 10.1016/j.mbs.2009.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Katriel G. 2012. The size of epidemics in populations with heterogeneous susceptibility. J Math Biol 65:237–262. doi: 10.1007/s00285-011-0460-2. [DOI] [PubMed] [Google Scholar]
- 25.Miller JC. 2012. A note on the derivation of epidemic final sizes. Bull Math Biol 74:2125–2141. doi: 10.1007/s11538-012-9749-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Gomes MGM, Gordon SB, Lalloo DG. 2016. Clinical trials: the mathematics of falling vaccine efficacy with rising disease incidence. Vaccine 34:3007–3009. doi: 10.1016/j.vaccine.2016.04.065. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Brunet RC, Struchiner CJ, Halloran ME. 1993. On the distribution of vaccine protection under heterogeneous response. Math Biosci 116:111–125. doi: 10.1016/0025-5564(93)90063-G. [DOI] [PubMed] [Google Scholar]
- 28.O’Hagan JJ, Lipsitch M, Hernán MA. 2014. Estimating the per-exposure effect of infectious disease interventions. Epidemiology 25:134–138. doi: 10.1097/EDE.0000000000000003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Kurath G, Garver KA, Troyer RM, Emmenegger EJ, Einer-Jensen K, Anderson ED. 2003. Phylogeography of infectious haematopoietic necrosis virus in North America. J Gen Virol 84:803–814. doi: 10.1099/vir.0.18771-0. [DOI] [PubMed] [Google Scholar]
- 30.Bootland L, Leong J. 1999. Infectious haematopoietic necrosis virus, p 57–112. In Woo PTK, Bruno DW (ed), Fish diseases and disorders, vol 3 Viral, bacterial and fungal infections. CAB International, Wallingford, United Kingdom. [Google Scholar]
- 31.Winton JR. 1991. Recent advances in detection and control of infectious hematopoietic necrosis virus in aquaculture. Annu Rev Fish Dis 1:83–93. doi: 10.1016/0959-8030(91)90024-E. [DOI] [Google Scholar]
- 32.Anderson ED, Mourich DV, Fahrenkrug SC, LaPatra S, Shepherd J, Leong JA. 1996. Genetic immunization of rainbow trout (Oncorhynchus mykiss) against infectious hematopoietic necrosis virus. Mol Mar Biol Biotechnol 5:114–122. [PubMed] [Google Scholar]
- 33.Sommerset I, Krossøy B, Biering E, Frost P. 2005. Vaccines for fish in aquaculture. Expert Rev Vaccines 4:89–101. doi: 10.1586/14760584.4.1.89. [DOI] [PubMed] [Google Scholar]
- 34.Lorenzen N, LaPatra SE. 2005. DNA vaccines for aquacultured fish. Rev Sci Tech 24:201–213. doi: 10.20506/rst.24.1.1565. [DOI] [PubMed] [Google Scholar]
- 35.Adelmann M, Köllner B, Bergmann SM, Fischer U, Lange B, Weitschies W, Enzmann PJ, Fichtner D. 2008. Development of an oral vaccine for immunisation of rainbow trout (Oncorhynchus mykiss) against viral haemorrhagic septicaemia. Vaccine 26:837–844. doi: 10.1016/j.vaccine.2007.11.065. [DOI] [PubMed] [Google Scholar]
- 36.Anderson E, Clouthier S, Shewmaker W, Weighall A, LaPatra S. 2008. Inactivated infectious haematopoietic necrosis virus (IHNV) vaccines. J Fish Dis 31:729–745. doi: 10.1111/j.1365-2761.2008.00960.x. [DOI] [PubMed] [Google Scholar]
- 37.Biering E, Villoing S, Sommerset I, Christie KE. 2005. Update on viral vaccines for fish. Dev Biol 121:97–113. [PubMed] [Google Scholar]
- 38.Corbeil S, LaPatra SE, Anderson ED, Kurath G. 2000. Nanogram quantities of a DNA vaccine protect rainbow trout fry against heterologous strains of infectious hematopoietic necrosis virus. Vaccine 18:2817–2824. doi: 10.1016/S0264-410X(00)00078-5. [DOI] [PubMed] [Google Scholar]
- 39.Kurath G, Purcell MK, Garver KA. 2007. Fish rhabdovirus models for understanding host response to DNA vaccines. CAB Rev 2:1–12. doi: 10.1079/PAVSNNR20072048. [DOI] [Google Scholar]
- 40.Barroso RM, Wheeler PA, LaPatra SE, Drew RE, Thorgaard GH. 2008. QTL for IHNV resistance and growth identified in a rainbow (Oncorhynchus mykiss) × Yellowstone cutthroat (Oncorhynchus clarki bouvieri) trout cross. Aquaculture 277:156–163. doi: 10.1016/j.aquaculture.2008.03.001. [DOI] [Google Scholar]
- 41.Chevassus B, Dorson M. 1990. Genetics of resistance to disease in fishes. Aquaculture 85:83–107. doi: 10.1016/0044-8486(90)90009-C. [DOI] [Google Scholar]
- 42.Dorson M, Chevassus B, Torhy C. 1991. Comparative susceptibility of three species of char and of rainbow trout × char triploid hybrids to several pathogenic salmonid viruses. Dis Aquat Organ 11:217–224. doi: 10.3354/dao011217. [DOI] [Google Scholar]
- 43.Troyer RM, LaPatra SE, Kurath G. 2000. Genetic analyses reveal unusually high diversity of infectious haematopoietic necrosis virus in rainbow trout aquaculture. J Gen Virol 81:2823–2832. doi: 10.1099/0022-1317-81-12-2823. [DOI] [PubMed] [Google Scholar]
- 44.Troyer RM, Kurath G. 2003. Molecular epidemiology of infectious hematopoietic necrosis virus reveals complex virus traffic and evolution within southern Idaho aquaculture. Dis Aquat Organ 55:175–185. doi: 10.3354/dao055175. [DOI] [PubMed] [Google Scholar]
- 45.Wargo AR, Garver KA, Kurath G. 2010. Virulence correlates with fitness in vivo for two M group genotypes of infectious hematopoietic necrosis virus (IHNV). Virology 404:51–58. doi: 10.1016/j.virol.2010.04.023. [DOI] [PubMed] [Google Scholar]
- 46.Troyer RM, Garver KA, Ranson JC, Wargo AR, Kurath G. 2008. In vivo virus growth competition assays demonstrate equal fitness of fish rhabdovirus strains that co-circulate in aquaculture. Virus Res 137:179–188. doi: 10.1016/j.virusres.2008.07.018. [DOI] [PubMed] [Google Scholar]
- 47.Regoes RR, Longini IM Jr, Feinberg MB, Staprans SI. 2005. Preclinical assessment of HIV vaccines and microbicides by repeated low-dose virus challenges. PLoS Med 2:e249. doi: 10.1371/journal.pmed.0020249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Halloran ME, Haber M, Longini IM. 1992. Interpretation and estimation of vaccine efficacy under heterogeneity. Am J Epidemiol 136:328–343. doi: 10.1093/oxfordjournals.aje.a116498. [DOI] [PubMed] [Google Scholar]
- 49.Longini IM, Halloran ME, Haber M. 1993. Estimation of vaccine efficacy from epidemics of acute infectious agents under vaccine-related heterogeneity. Math Biosci 117:271–281. doi: 10.1016/0025-5564(93)90028-9. [DOI] [PubMed] [Google Scholar]
- 50.Kell AM, Wargo AR, Kurath G. 2013. The role of virulence in in vivo superinfection fitness of the vertebrate RNA virus infectious hematopoietic necrosis virus. J Virol 87:8145–8157. doi: 10.1128/JVI.00089-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Aalen OO, Valberg M, Grotmol T, Tretli S. 2015. Understanding variation in disease risk: the elusive concept of frailty. Int J Epidemiol 44:1408–1421. doi: 10.1093/ije/dyu192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Hollingsworth TD, Anderson RM, Fraser C. 2008. HIV-1 transmission, by stage of infection. J Infect Dis 198:687–693. doi: 10.1086/590501. [DOI] [PubMed] [Google Scholar]
- 53.Wilber MQ, Langwig KE, Kilpatrick AM, McCallum HI, Briggs CJ. 2016. Integral projection models for host-parasite systems with an application to amphibian chytrid fungus. Methods Ecol Evol 7:1182–1194. doi: 10.1111/2041-210X.12561. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Bansal S, Meyers LA. 2012. The impact of past epidemics on future disease dynamics. J Theor Biol 309:176–184. doi: 10.1016/j.jtbi.2012.06.012. [DOI] [PubMed] [Google Scholar]
- 55.Gomes MGM, Barreto ML, Glaziou P, Medley GF, Rodrigues LC, Wallinga J, Squire SB. 2016. End TB strategy: the need to reduce risk inequalities. BMC Infect Dis 16:132. doi: 10.1186/s12879-016-1464-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Magpantay FMG, Riolo MA, de Cellès MD, King AA, Rohani P. 2014. Epidemiological consequences of imperfect vaccines for immunizing infections. SIAM J Appl Math 74:1810–1830. doi: 10.1137/140956695. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Leon AE, Hawley DM. 2017. Host responses to pathogen priming in a natural songbird host. Ecohealth doi: 10.1007/s10393-017-1261-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.van Boven M, Ruijs WLM, Wallinga J, O’Neill PD, Hahné S. 2013. Estimation of vaccine efficacy and critical vaccination coverage in partially observed outbreaks. PLoS Comput Biol 9:e1003061. doi: 10.1371/journal.pcbi.1003061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Dorson M, Quillet E, Hollebecq MG, Torhy C, Chevassus B. 1995. Selection of rainbow trout resistant to viral haemorrhagic septicaemia virus and transmission of resistance by gynogenesis. Vet Res 26:361–368. [PubMed] [Google Scholar]
- 60.Kasai K, Yonezawa J, Ono A, Hasegawa A, Honma T, Fukuda H. 1993. Brood and size dependent variation in susceptibility of rainbow trout, Oncorhynchus mykiss to artificial infection of infectious hematopoietic necrosis virus (IHNV). Fish Pathol 28:35–40. [Google Scholar]
- 61.King KC, Lively CM. 2012. Does genetic diversity limit disease spread in natural host populations? Heredity 109:199–203. doi: 10.1038/hdy.2012.33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Elderd BD, Dushoff J, Dwyer G. 2008. Host-pathogen interactions, insect outbreaks, and natural selection for disease resistance. Am Nat 172:829–842. doi: 10.1086/592403. [DOI] [PubMed] [Google Scholar]
- 63.Norris K, Evans MR. 2000. Ecological immunology: life history trade-offs and immune defense in birds. Behav Ecol 11:19–26. doi: 10.1093/beheco/11.1.19. [DOI] [Google Scholar]
- 64.Garver KA, Batts WN, Kurath G. 2006. Virulence comparisons of infectious hematopoietic necrosis virus U and M genogroups in sockeye salmon and rainbow trout. J Aquat Anim Health 18:232–243. doi: 10.1577/H05-038.1. [DOI] [PubMed] [Google Scholar]
- 65.Wargo AR, Kurath G. 2011. In vivo fitness associated with high virulence in a vertebrate virus is a complex trait regulated by host entry, replication, and shedding. J Virol 85:3959–3967. doi: 10.1128/JVI.01891-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Fijan N, Sulimanović D, Bearzotti M, Muzinić D, Zwillenberg LO, Chilmonczyk S, Vautherot JF, De Kinkelin P. 1983. Some properties of the epithelioma papulosum cyprini (EPC) cell line from carp Cyprinus carpio. Ann Inst Pasteur Virol 134:207–220. doi: 10.1016/S0769-2617(83)80060-4. [DOI] [Google Scholar]
- 67.Batts WN, Winton JR. 1989. Enhanced detection of infectious hematopoietic necrosis virus and other fish viruses by pretreatment of cell monolayers with polyethylene glycol. J Aquat Anim Health 1:284–290. doi:. [DOI] [Google Scholar]
- 68.LaPatra SE, Corbeil S, Jones GR, Shewmaker WD, Lorenzen N, Anderson ED, Kurath G. 2001. Protection of rainbow trout against infectious hematopoietic necrosis virus four days after specific or semi-specific DNA vaccination. Vaccine 19:4011–4019. doi: 10.1016/S0264-410X(01)00113-X. [DOI] [PubMed] [Google Scholar]
- 69.Kurath G. 2008. Biotechnology and DNA vaccines for aquatic animals. Rev Sci Tech 27:175–196. doi: 10.20506/rst.27.1.1793. [DOI] [PubMed] [Google Scholar]
- 70.Peñaranda MMD, Purcell MK, Kurath G. 2009. Differential virulence mechanisms of infectious hematopoietic necrosis virus in rainbow trout (Oncorhynchus mykiss) include host entry and virus replication kinetics. J Gen Virol 90:2172–2182. doi: 10.1099/vir.0.012286-0. [DOI] [PubMed] [Google Scholar]
- 71.Purcell MK, Thompson RL, Garver KA, Hawley LM, Batts WN, Sprague L, Sampson C, Winton JR. 2013. Universal reverse transcriptase real-time PCR for infectious hematopoietic necrosis virus (IHNV). Dis Aquat Organ 106:103–115. doi: 10.3354/dao02644. [DOI] [PubMed] [Google Scholar]
- 72.Ben-Ami F, Regoes RR, Ebert D. 2008. A quantitative test of the relationship between parasite dose and infection probability across different host-parasite combinations. Proc R Soc B Biol Sci 275:853–859. doi: 10.1098/rspb.2007.1544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Soetaert K, Petzoldt T, Setzer RW. 2010. Solving differential equations in R: package deSolve. J Stat Softw 33:1–22. doi: 10.18637/jss.v033.i09.20808728 [DOI] [Google Scholar]
- 74.RStudio 2015. RStudio: integrated development for R. RStudio, Inc, Boston, MA. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.