Abstract
Domestic dog rabies is an endemic disease in large parts of the developing world and also epidemic in previously free regions. For example, it continues to spread in eastern Indonesia and currently threatens adjacent rabies-free regions with high densities of free-roaming dogs, including remote northern Australia. Mathematical and simulation disease models are useful tools to provide insights on the most effective control strategies and to inform policy decisions. Existing rabies models typically focus on long-term control programs in endemic countries. However, simulation models describing the dog rabies incursion scenario in regions where rabies is still exotic are lacking. We here describe such a stochastic, spatially explicit rabies simulation model that is based on individual dog information collected in two remote regions in northern Australia. Illustrative simulations produced plausible results with epidemic characteristics expected for rabies outbreaks in disease free regions (mean R0 1.7, epidemic peak 97 days post-incursion, vaccination as the most effective response strategy). Systematic sensitivity analysis identified that model outcomes were most sensitive to seven of the 30 model parameters tested. This model is suitable for exploring rabies spread and control before an incursion in populations of largely free-roaming dogs that live close together with their owners. It can be used for ad-hoc contingency or response planning prior to and shortly after incursion of dog rabies in previously free regions. One challenge that remains is model parameterisation, particularly how dogs’ roaming and contacts and biting behaviours change following a rabies incursion in a previously rabies free population.
Author Summary
Rabies in domestic dog populations still causes >50,000 human deaths worldwide each year. While its eradication by vaccination of the reservoir population (dogs and wildlife) was successful in many parts of the world, it is still present in the developing world and continues to spread to new regions. Theoretical rabies models supporting control plans do exist for rabies endemic regions; however these models usually provide information for long-term programs. Here, we describe a novel rabies simulation model for application in rabies-free regions experiencing an incursion. The model simulates a rabies outbreak in the free-ranging dog population in remote indigenous communities in northern Australia. Vaccination, dog density reduction and dog confinement are implemented as control strategies. Model outputs suggest that the outbreak lasts for an average of 7 months and typically spreads through all communities of the region. Dog vaccination was found to be the most effective response strategy. The model produces plausible results and can be used to provide information for ad-hoc response planning before and shortly after rabies incursion.
Introduction
Rabies is among the most lethal infectious diseases, present on all populated continents except Australia [1]. The domestic dog remains the most important vector worldwide, causing >95% of all human cases [2–4]. Despite availability of an effective vaccine for more than a century and repeated demonstration that vaccinating the domestic dog population is the most effective way to eliminate the disease [5–8], rabies remains endemic in large areas in Africa and Asia. Moreover, the disease has (re)emerged in areas previously free (such as Bhutan [9,10], Indonesia [11,12], and the Central African Republic [13]).
Rabies continues to spread through the Indonesian archipelago via human mediated domestic dog movements [11,12,14], most recently through the previously rabies-free province of Maluku in eastern Indonesia [11,15]. The risk of incursion into rabies-free areas − Timor, Irian Jaya, Papua New Guinea (PNG) and northern Australia − is therefore high. Possible incursion scenarios into Australia include yachts or fishing boats hosting latently rabies infected dogs traveling from Indonesian islands to remote areas in northern Australia [16]. Also, close cultural ties between PNG and Torres Strait Island communities exist, increasing the risk of movements of dogs incubation rabies from PNG to Australia, if an incursion in PNG occurs [16]. In these regions large, free-roaming domestic dog populations [17,18] increase the risk of rabies establishment, which would subsequently impact human and wildlife populations. Because there are no historical precedents, the spread and final impact of such rabies incursions is difficult to estimate. However, such knowledge is critical to informing preparedness and response plans prior to an incursion, and to design the most effective strategies.
Descriptions and applications of several rabies models in wildlife [19–24], domestic dogs [5,7,25–28] or a combination of these [8,29] have been published. All have been based on empirical field data in rabies endemic regions and typically aim to inform policy on reducing rabies prevalence and thus impacts. However, for a region in which rabies is exotic, predictions of the effectiveness of different interventions following the initial detection of rabies are more relevant. An issue is how rabies behaves when introduced to a previously free population, particular the effect of rabies on contact rates and biting rates. Evidence on these behaviour changes from previous rabies incursion may serve as an approximation but is typically vague and therefore equivocal. To our knowledge, epidemic models simulating rabies invasion in regions never exposed to rabies do not exist, a barrier to rabies preparedness planning.
Here, we describe the development of a novel simulation model of rabies epidemics in domestic, free-roaming dog populations in remote Indigenous communities in northern Australia–as an example of the potential scenario in many regions of the world where rabies is absent but where the risk of a rabies incursion is present and its spread is likely due to large populations of free-roaming domestic dogs. Results of a systematic sensitivity analysis are also presented and model application options are discussed.
Materials and Methods
Ethics statement
Data collection required to estimate model parameters has been approved by the Human Ethical Committee of the University of Sydney, grant no. 2013/757 and the Animal Ethical Committee of the University of Sydney, grant no. N00/7-2013/2/6015.
Study site
The rabies simulation model development was based on data from two distinct regions in northern Australia, the Northern Peninsula Area (NPA) of Cape York, Queensland and Elcho Island, the Top End of the Northern Territory. Characteristics of the two study sites are presented elsewhere [18]. Briefly, in the NPA five Aboriginal and Torres Strait Islander communities are located in close proximity (2−4 km) to each other. On Elcho Island one larger Aboriginal community is present. The dogs are typically owned but unrestrained and build a large population in all communities (human:dog ratio 2.7−8.8 per community, Table 1) [18]. The dog population in the NPA − which informs the simulation model − is based on the most recent dog census conducted by the NPA Regional Council in 2009. As such information was not available from Elcho Island, the number of dogs are calculated based on the average human:dog ratio of the NPA communities and official human census data from Elcho Island in 2011 (http://www.censusdata.abs.gov.au/census_services/getproduct/census/2011/quickstat/SSC30094) and similar household sizes as in the NPA are assumed.
Table 1. Characteristics of the communities included in the rabies simulation model.
Bamaga | Injinoo | New Mapoon | Seisia | Umagico | NPA a | Galiwinku | |
---|---|---|---|---|---|---|---|
Area (km2) | 0.963 | 0.284 | 0.42 | 0.309 | 0.226 | 2.2 | 1.267 |
Human population b | 1046 | 468 | 274 | 203 | 281 | 2272 | 2124 |
Total number of households | 286 | 131 | 176 | 149 | 74 | 816 | 264 |
Number of households with dogs | 71 | 20 | 31 | 21 | 32 | 175 | 163 |
Density of households with dogs (households/km2) | 74 | 70 | 74 | 68 | 142 | 80 | 129 |
Number of dogs | 132 | 53 | 91 | 51 | 102 | 429 | 410 |
Density of dogs (dogs/km2) | 137 | 187 | 217 | 165 | 451 | 195 | 324 |
Average number of dogs per dog-owning household | 1.9 | 2.7 | 2.9 | 2.4 | 3.2 | 2.5 | 2.5 |
aNPA (Northern Peninsula Area) consists of the communities Bamaga, Injinoo, New Mapoon, Seisia and Umagico
bbased on http://www.censusdata.abs.gov.au
The simulation model
The model developed is stochastic, spatially explicit, based on individual dog data and assumes a daily simulation time unit. It starts with the introduction of a latently (non-clinical) infected dog and ends when no infected dog remains. The exact location of each dog’s home is known and a closed dog population within the region is assumed, but dog movements between regional communities are simulated. In the model, 429 and 410 dogs in 175 and 163 households are included in the NPA and on Elcho Island, respectively (137−451 and 68−142 households per km2, respectively, Table 1). The two regions are simulated separately. The average number of dogs per dog holding household ranges from 1.9–3.2 per community.
Input and output values
Information on all dogs included in the model is stored in a single data frame containing their disease states (susceptible, exposed and latently infected, subclinically infectious, rabid and dead) and their status on rabies detection, culling (including reason) and rabies vaccination. Model parameters (S1 Table) are defined as either beta-pert distributions (minimum, mode, maximum; http://www.vosesoftware.com/ModelRiskHelp/index.htm#Distributions/Continuous_distributions/PERT_distribution.htm), uniform distributions (minimum, maximum) or fixed values; except for the distance kernel (see next section).
For each model repetition (i.e. each simulated outbreak), stored output information includes a list of the user defined parameter values, index dog(s) information, a table of the daily number of exposed, rabid, dead, vaccinated and culled dogs and dogs moved between communities and information on contacts within and between households. The history of all dogs infected with rabies, culled, vaccinated or moved, a list of the outbreak’s summary measures (duration, number of rabid, culled (per culling type), vaccinated and moved dogs), daily maps of the location of contacted, exposed, rabid, vaccinated and culled dogs, an epidemic curve and a graph of the number of secondary cases for each dog developing rabies over the duration of the outbreak are also stored.
Disease states and rabies transmission
At the start of the simulation a user defined number of index dogs is chosen randomly, or alternatively a specific dog can be defined as the index dog (to test different control strategies assuming identical starting conditions). Every simulated day, the model chronologically loops through simulation actions (Fig 1) and ends when either the user defined maximum time has been reached (irrespective of whether the outbreak has ended) or when no (latently) infected dog remains.
First, the disease status of all dogs is updated. Each latently infected dog proceeds through the disease states subclinically infectious, rabid (i.e. infectious and clinical) and finally dead (unless culling or vaccination are applied). The time periods from one state to the next are defined (as stochastic parameters) via incubation, subclinical and clinical periods, respectively.
Second, the three types of rabies transmission are simulated. This begins with transmission to susceptible dogs living in the same household as rabid dogs, which depends on the probability of contact with the rabid dog, the probability of being bitten given the contact and the probability of rabies transmission given the bite. While the default values of the first two probabilities are >80%, the rabies transmission rate is about 50% (S1 Table). Only a successfully exposed dog becomes latently infected; dogs with failed exposure remain susceptible and have the same risk of being infected the following day. Next, rabies transmission to dogs living in a different household is simulated, which depends on the distance between the rabid dog and the susceptible dog (Fig 2). The daily probability p c that a susceptible dog living i meters from the rabid dog will be contacted is beta-pert distributed with a mode of
(1) |
and a minimum and maximum of
(2) |
The distance kernel is defined by the variables α (intercept), β (regression coefficient) and βse (standard error of β). α denotes the probability of a daily contact between two dogs living zero meters apart from each other. However, as the contacting (and rabies transmission) of dogs living in the same household is simulated separately as described above, the value of α is only used to determine the highest possible daily contact probability. The regression coefficient β influences the shape of the kernel, while a larger negative value implies a steeper curve with more rapid decrease of contact probabilities with increasing home distances. βse impacts the variance of contact probabilities for a given distance with increasing variability for increasing βse value. Similar to rabies transmission within the same household, the success of disease transmission to a dog contacted outside the household depends on the probability of a bite given a contact (by default, a lower value than within-household contacts, namely 60−80%) and the probability of rabies transmission given a bite. Finally, rabies transmission between communities is simulated reflecting human-mediated movements of dogs, when (latently infected) dogs are transferred from one community to another. Two types of between-community dog movements are incorporated: permanent–for example the sale or gift of a dog or permanent movements of owners together with their dogs − and short term movements, for example during hunting trips or peoples’ visits between communities together with their dogs. The length of stay is user defined but intended to be short with a default value 1 to 2 days. In both types of between-community movements, only latently (non-clinical) infected dogs are considered because only these dogs are relevant for rabies transmission. We assumed that clinical dogs will not be moved to other communities since they show non-normal behaviour. Daily probabilities of rabid dog movement is community-specific and the destination community is chosen randomly with user defined weights (default value: the chance that the destination is a neighbouring community is twice as high as for any another community). Short term movements only have an effect on the outbreak in the situation when the moved dog becomes (or remains) infectious during its stay in the destination community. Only then will the new community become infected. The rabid dog that has been moved is considered to stay in a randomly selected household in the destination community until its death.
Rabies detection and control strategies
Within the model, detection of rabid dogs and application of vaccination and culling are simulated after the spread of rabies, whereas dog confinement measures are implemented directly at the stage of between-household and between-community rabies transmission (Figs 1 and 3). The detection of the first rabid dog in the region is considered to take substantially longer than the cases following, because disease awareness will increase after the confirmation of the first rabies case. Detection of subsequent cases after the confirmation of the first case is assumed to be based on clinical signs with or without subsequent laboratory confirmation. Two vaccination, three culling and two dog confinement strategies − which can be selected either individually or in any combination − are implemented in the model.
Vaccination: Reactive vaccination (RV) starts after the detection of the first rabies case with a user defined delay that includes the decision making process, purchase and delivery of vaccine and organization of the vaccination campaign. As soon as the campaign has commenced, dogs up to a maximum value (limited by personnel resources) are vaccinated with priority given to those dogs in households closest to those in which rabid dogs have been detected. In case the daily limit has been reached, vaccination of the remaining dogs is postponed to the next day. The targeted extent of the campaign (infected community or region) and vaccination coverage level (either % of dogs or % of households vaccinated) can be defined by the user. Only dogs not yet detected as rabid are considered for vaccination. After a user defined time delay the vaccinated dogs are protected against rabies unless they become rabid in the meanwhile. As the vaccine efficacy is not considered to be 100%, protected dogs still have a remaining (although small) risk of being infected. This risk substantially increases (thus vaccine efficacy decreases) in the situation in which the dog was vaccinated a certain time after being exposed to rabies. Alternatively, pre-emptive vaccination (PV) can be chosen as the control strategy. Here, a given % of dogs or households in a targeted community or region are considered to be protected before the index dog with latent rabies infection is introduced. Again, vaccine efficacy is considered to be <100%, consistent with the RV strategy.
Population reduction: Culling of dogs the day they are detected rabid (DC) can be selected as a control strategy, starting after a user defined delay following the first rabies case. Dogs (up to a defined maximum daily number, limited by personnel resources) are culled immediately following detection. This reduces the infectious period in these culled dogs. An alternative approach (starting after a user defined delay) is to randomly select a given % of dogs contacted by detected rabid dogs (CC) to be culled on the day of exposure, as long as the daily culling limit has not been reached. Otherwise, these identified dogs are culled on the next day. Alternatively, or in addition to the culling of contacted dogs, a reactive culling (RC) control strategy can be implemented after a user defined delay. Similar to the reactive vaccination campaign, a defined % of dogs in the infected community or region are culled, with priority given to those dogs living closest to detected rabid dogs. Again, the cumulative number of daily culled dogs is limited so that for the reactive culling strategy, only the dogs remaining after the application of the other activated culling strategies can be culled on a given day. Culling of all other dogs will be postponed to the next day.
Control via movement ban and dog confinement (MB): Two types of dog confinement can be chosen as a control strategy: a ban on dog movements between communities, and confinement of dogs in the yard of the household (e.g. via fence or chain). The dog movement ban between communities starts after a defined delay following the detection of the first rabies case with a given level of compliance, resulting in a random reduction of between-community movements. This is applied to both of the two simulated movements, short term and permanent. The latter option reflects the policy of “keep your dog in your yard” and is implemented by truncation of the distance kernel to the community individual median distance between each household and its closest neighbour. Again, compliance is considered to be <100% so that a randomly selected % of dogs remain free-roaming.
Parameter value estimation
Parameter value definition is a critical component in modelling studies, driving the outcome of any simulation or mathematical model. While some parameter values can be taken from the literature (e.g. disease or vaccine related parameters), other parameter depend on the settings in the specific environment in which the model was developed or applied. Seven out of 37 (19%) parameter values of the model presented here are sourced from the literature (those of rabies virus and vaccine related parameters) and 23 (62%) are based on assumptions (S1 Table). The latter can further be classified as experimental parameters (parameters defining control strategy implementation as e.g. delay in starting control strategies or vaccination coverage, 16/37 [43%]) and parameters for which value information are currently lacking (e.g. bite probability given a contact, owner compliance to cease dog movements, 7/37 [19%]).
The remaining seven (19%) parameter values were estimated based on our field collected data, including contact data within and between communities and mean distance between households used for dog confinement strategy (S1 Table). Data used to calculate the distance kernel function applied for contact rates between dogs of different households was derived from a large scale GPS study on 69 domestic dogs in all of the six communities (S5 and S6 Tables) [18]. The number of contacts between each pair of dogs within the same community was extracted using the definition of contact being within 20 meters during the same minute. As the model runs on a daily basis, the contact information was converted into a binary variable with two dogs having at least one (1) or no (0) contacts within 24 hours. This binary outcome was analysed by a logistic regression model with the known distance between the two dogs’ homes as the explanatory variable. The outcome variables estimated by the logistic regression (intercept α, coefficient β and standard error of the coefficient βse) were further used to build the distance kernel (Eqs 1 and 2). Daily contact probability of two dogs living in the same household was estimated based on the same dataset plus similar data collected during the post-wet season (monsoon) in the same communities. One of 31 (3%) pairs of dog living in the same household was not observed to have at least one contact per 24 hours. This within-household contact probability was implemented as a uniform distributed parameter with 97% as the mean.
Four parameters defining the dog movements between communities − both short term and permanent − were estimated from questionnaire data collected in the NPA (S2 Table, approved by the Human Ethical Committee of the University of Sydney, # 2013/757) together with observations of short term movements by GPS and of permanent movements of dog owners from one NPA community to another during a year. Twenty-nine dog owners were interviewed in September 2013 and one in September 2014, including questions on frequency of dog movements to other NPA communities due to pig hunting or other trips (e.g. visits or work). A daily movement probability of 0.058 per dog was calculated from these reported data, while from the study we observed that only 8 of 81 (10%) dogs were moved during an observation period of 6.2 days, resulting in daily movement probability of 0.016 per dog. Combining these reported and observed data and giving twice the weight to observed data, 0.03 was defined as the beta-pert distribution mode for daily short term movement probability per dog; 2- and 0.5-fold values were used for the minimum and maximum limits of the distribution, respectively. The duration of the short term movements were derived from the questionnaire in which all hunters reported trips of one to two days and observations from the GPS study in which all 8 dogs stayed less than one day in the community visited. The frequency of permanent movements was estimated from questionnaire data and observations of permanent movements during September 2013 and September 2014. Dog owners reported that 18% (6/33) of the NPA dogs originated from a different community within the NPA, which resulted in an estimated probability of permanent movements of 1.64*10−4 per dog per day assuming an average dog life of three years. In addition, owners of 6% (3/49) of the dogs were observed to have permanently moved between NPA communities during the year, resulting in a probability of daily movements of 1.64*10−4 per dog. The sum (3.3*10−4) was selected as the mode of the beta-pert distributed daily probability of permanent movements per dog, with 0.5 and 2-fold values for minimum and maximum. Finally, the destination community for both permanent and short term movements was observed to be more frequently a neighbouring community than any other; consequently a neighbouring community as the destination was assumed to be twice as likely as for any other community in the NPA.
The median distance between each household and its closest neighbour–used in the model to truncate the distance kernel for the dog confinement control strategy–were estimated for each community separately using the coordinates of all households per community. Household coordinates were derived from Google Earth (http://earth.google.com/) where placemarks were set on all private dwellings, identified with the help of community maps. The distances between each household and its closest neighbour were calculated and the mean per community implemented in the model as a fixed value parameter.
Sensitivity analysis
In the first step of the sensitivity analysis (SA), all model parameters used for six different control strategies were tested using the strategy’s default values: a) vaccination with 70% coverage either pre-emptively (PV) or reactive (RV); b) culling of dogs contacted by a rabid dog (CC) or reactive culling (RC) with culling levels of 80 and 50%, respectively; c) dog confinement plus movement bans between communities (MB) with 80% and 90% compliance, respectively; and d) a non-intervention strategy (NI). For all of these strategies, including NI, culling of dogs detected rabid (DC) was applied. The number of index dogs was set to 1 and randomly selected in the region. For each of the 12 combinations of the two regions (NPA and Elcho Island) and six control strategies, 1000 model repetitions were simulated.
For stochastic parameters, the mode or mean (for beta-pert distributed and uniform distributed parameters, respectively) was allowed to range between ±25% around the default value while the difference between the minimum and maximum values was kept fixed (no variation of the distributions’ shape; S3 Table, S1 Fig). Deterministic parameters were allowed to vary ±25% around the default value. Variation of 25% has been chosen to allow enough variation for parameters with wide distributions (e.g. the infectious period) and avoid too large distinction between the lower and upper limit of narrow distributed parameters (e.g. the rabies transmission probability given a bite). The distance kernel was tested using three different shapes representing a minimal kernel and increased probabilities for short and long distance contacts, respectively (S2 Fig). The influence of the index community within the NPA region was investigated by defining one of the five communities hosting the index dog. To explore the sensitivity of the model on the weighting matrix to choose the destination community for between-community movements, an alternative matrix was tested beside the default with equal chance for all communities to be selected as the destination.
The values of all parameters tested were randomly selected from the described ranges so that for each simulation, an individual set of parameter value combination was chosen. For each of the 12 region-strategy combinations, linear multivariable regression analysis was modelled with the outbreak duration and–where applicable–outbreak size as the response variable and the parameter values as explanatory variables. For the stochastic parameters the mode (beta-pert distribution) and mean (uniform distribution) values were modelled as explanatory variable values. Correlations between the parameter values were explored using Kendall’s tau correlation, Chi-Square and Wilcoxon Rank Sum test for two continuous, two categorical and a continuous and categorical parameter, respectively. Because the assumption of a normally distributed response variable was not always met (S3 Fig), logistic regression following the same principle was modelled defining an outbreak with a duration or size above the median as 1 and as 0 otherwise. Based on both the linear and logistic regression analyses, parameters were defined to be highly (statistically significant p-values < 0.05 in ≥ ¾ of all tested regression models), low (statistically significant p-values < 0.05 in < ¼ of all tested regression models) or moderate (otherwise) sensitive to the outbreak duration and size. Additionally, scatter plots of the outbreak duration and size over the range of each parameter value were visually analysed and correlations were calculated between outbreak duration and size and parameter values with continuous scale. A correlation of >|0.1| was considered as a threshold to distinguish between sensitive and non-sensitive parameters.
Parameters found to be highly sensitive in either of the regression analyses during the first step of the SA were further explored in a second step to identify the influence of their mode or mean (default, large, small) and shape (default, narrow, wide) on the model’s outcome. For the beta-pert and uniform distributed parameters nine combinations per parameter with the three values of mode or mean (default and ±10%), and three values of difference to the minimum and maximum (default and ±10%) of the distribution were defined (S4A–S4C Fig). For the vaccine efficacy parameter, the variation of 10% had to be reduced to 4%, which was the highest variability still ensuring a maximal value < 1, a requirement for probabilities (S4D Fig). For each parameter, 1000 repetitions were simulated for the same 12 region-strategy combinations described in step 1 of the SA (in case of the vaccine efficacy only the scenarios for RV and PV), where one of the nine options was randomly chosen while all other parameters in the model were kept at their default value. The distance kernel, defined by the three variables α, β and βse, was explored by varying the three variables around a default value ±50%, resulting in 27 combinations (S5 Fig). Six thousand repetitions were simulated for all 12 region-strategy combinations with a randomly selected distance kernel out of the 27 options while all other model parameters were kept at their default values. The outcome was analysed visually comparing boxplots of the outbreak duration and number of rabid dogs.
Coefficient of variation
A critical question for stochastic models is always, how many repetitions are required to sufficiently reflect the variability of the model? The coefficient of variation (CV = standard deviation/mean) of model outputs’ mean has been proposed as a measurement to determine the critical number of repetitions required [30,31]. The CV of the estimated mean of outcome of interest (e.g. outbreak size or duration) over n model simulations is expected to approach 0 for infinite sample sizes n and a threshold of the CV of 15% has proposed to predict outputs with acceptable precision [30]. We used the same approach, but reduced the CV threshold value to 3%.
Illustrative simulation outcomes
To demonstrate the model’s functionality for the different control strategies, 1000 outbreaks were simulated for the default strategies: 1. reactive vaccination with 70% coverage at the household level (RV); 2. reactive culling with 50% of the dogs culled in affected communities (RC); and 3. dog confinement between and within communities with 90 and 80% compliance, respectively (MB). Culling of dogs detected rabid (DC) was applied for all of these strategies. The model was simulated in both regions, NPA and Elcho Island, separately. As outcome measures, the epidemic duration and size, i.e. the number of rabid dog and the number of dead dogs (including rabid and culled dogs) were calculated and visually compared between the different scenarios.
Results
Outbreak size and duration of example simulations
Two measures of outbreak size are the cumulative number of rabid dogs and cumulative number of dead dogs (due to rabies plus culled). The outbreak duration is defined as the number of days from the introduction of the latently infected index dog until the death of the last infectious dog. The simulation model resulted in plausible results comparing outputs for the three different default control strategies (Fig 4). Rabies spreads through the communities in a wave pattern and, depending on the control strategy, can kill the entire dog population (S6 Fig illustrates an example epidemic curve). The reactive culling (RC) strategy reduces the number of rabid dogs; however the number of dead dogs is only slightly less than the total dog population. For the reactive vaccination (RV) strategy the number of rabid dogs (equal to the number of dead dogs) showed higher variability among the 1000 model simulations compared to RC, but in both regions, the median of RV was lower than for RC. Obviously, vaccination saves the dogs from death in contrast to culling strategies. The movement ban (MB) strategy showed a slight decrease of the outbreak size in the region of Elcho Island whereas no effect was observed in the NPA. However, it was found to be the strategy with the longest durations of outbreaks, demonstrating that movement bans (if not 100% compliant) only slow the speed of spread rather than reducing its size. The reduction in the number of movements between communities for MB was obvious, decreasing from a median of 52 (RV) and 46 (RC) to 19 (S7 Fig). Overall, outbreak duration ranged from 1−20 months (median 6.7 months) and was more homogenous between interventions than the outbreak size (Fig 4). Outbreaks lasting for one month did not spread beyond the index dog. For the RV strategy, the vaccination coverage was set at 70% of the households, producing dog level vaccination coverage of 59−75% and 56−76% for the NPA and Elcho Island region, respectively.
The control strategy with the largest number of simulations required (n = 490) to capture the variability in the model’s output with the defined CV threshold of 3% was found to be the MB strategy in the NPA (S8 Fig).
Basic and effective reproductive ratios R0 and Rt
The number of secondary cases was reported for every rabid dog over the duration of the outbreak. From these records, the basic reproductive ratio R0 was calculated and defined as the mean number of secondary cases for dogs becoming infectious within the first phase–i.e. up to its peak–of an epidemic. The peak of the epidemic is defined as the day with the highest number of newly infectious animals over the entire outbreak. R0 ranged from 0−6.1 (median 1.8) for RV, 0−6.1 (median 1.7) for RC and 0−5.7 (median 1.7) for MB (S9 Fig) with an overall median of 1.7 (Fig 5A). The epidemic peak was reached on average after 93 days (Fig 5B) with a mean of 17 newly infected dogs (Fig 5C). The number of secondary cases derived from each index dog was highly variable and ranged from 0 to 79 (median of 25) for NPA and 4 to 106 (40) for Elcho Island. Over the duration of the outbreak, the effective reproductive ratio Rt and the number of dogs in the susceptible population decreased in a wave pattern (S10 Fig). The value of 1 for mean Rt is reached during the second or third wave. This reflects that Rt depends on the dogs remaining in the population and finally the outbreak dies out because there are no susceptible dogs left that are close enough to the infectious dogs.
Sensitivity analysis
The simulation model outputs were highly sensitive to seven parameters: incubation period (G1 in S4 Table), transmission probability given a bite (G8), distance kernel (G5), bite probability given a contact between dogs of different households (G7), vaccine efficacy (V5), index community (G12) and delay in starting the control strategy of movement restrictions between communities (B2). The same sensitive parameters, in addition to the detection delay of the first clinical case, were also identified via correlation tests, with the exception of B2. These outcomes were also confirmed by scatterplots, which express particularly dependencies between the outbreak duration and the incubation period, distance kernel and index community (S11 Fig). Significant correlations between parameters included in the regression analyses were only observed between categorical and continuous parameters where 2.1−12.1% (mean 5.4%) of all parameter combinations resulted in Wilcoxon Rank Sum test p-values <0.05.
The influence of this subset of parameters was further explored in step 2 of the SA, with the exception of the index community and the delay in commencing movement restrictions because these two parameters directly relate to incursion and intervention scenarios. For all parameters, except the distance kernel, it was found that both the mode and mean (for beta-pert and uniform distributions, respectively) and the shapes influence outbreak duration and number of rabid dogs (S12 Fig). The mean and mode were found to have a greater impact, particularly for the incubation period and rabies transmission probability. For the distance kernel, the regression coefficient β was most influential on both the number of rabid dogs and the outbreak duration, followed by βse (standard error of β), particularly for the Elcho Island region (S13 Fig). Outputs were less sensitive to the intercept α.
Discussion
The model described herein provides insights into short-term rabies epidemics occurring within a small spatial extent in previously rabies-free regions. This is of crucial value for contingency planning in areas where rabies is exotic and the model fills a gap in the published literature on rabies models. The example of Bali, Indonesia demonstrates the impact of a rabies incursion on an under-prepared region [12]. Late detection of the disease, lack of surveillance strategies and an unsuccessful initial response (focused on dog culling) resulted in island-wide disease spread and high impacts on both dog and human populations [7,12,32]. Another example in Indonesia–comparable to communities in northern Australia with a high density of free-roaming dogs and limited veterinary health services − is the island of Flores in East Nusa Tengarra province [14,33,34]. There, one or more latently infected dogs were introduced, developed clinical rabies and transmitted the disease to local dogs. The disease consequently spread throughout island with a considerable impact on dogs and humans. This is another example of a rabies invasion in a new area with very severe impact.
Another novel aspect of the current model is the inclusion of individual susceptible and rabid dogs modelled within a continuous spatial dimension, an approach previously used to simulate highly infectious diseases of livestock (e.g. foot-and-mouth-disease [35,36]) but not rabies. To date, published dog rabies models have been based on mathematical differential equations [5,24,25,27] or spatially explicit models simulating the spread of rabies within grids [7]. Our approach has several advantages, including stochasticity to capture epidemic variability, incorporation of detailed population structure to better represent real target regions of interest, and detailed spatio-temporal model outputs.
By simulating three default control measures–vaccination, culling and dog confinement–our model produced plausible results, suggesting it adequately captures how an epidemic of an infectious disease with a relatively long incubation period would develop in a previously uninfected population. The disease spread temporally in wave-like patterns, peaking on average about three months after an incursion. The average R0 that was estimated from the model outputs was 1.7, consistent with previous estimates of rabies spread in endemic countries [16,37] and estimated from the Bali outbreak [7].
For the calculation of R0 we considered rabid dogs up to the peak of the epidemic, while peak has been defined as the day during the epidemic with the highest number of newly rabies infectious animals. It has been demonstrated that both, clustering within the susceptible population and high number of repetitive contacts among individuals in the population–thus a non-random mixing situation–affects the dynamics of disease spread via depletion of susceptible population within a cluster and therefore also affects R0 [38]. A re-evaluation of R0 of a H1N1 infection revealed that it was overestimated during the early stage of the outbreak when only cases within a cluster has been considered rather than the population-wide epidemic [39]. In our model, random mixing of infectious and susceptible animals has to be rejected as rabies transmission depends on the distance between infectious and susceptible animals. However, neither fixed repetitive contacts (as in network based models) nor significant clusters within communities are included in the model. The only functionally relevant cluster structure is present in the region of the NPA with the five communities building distinct clusters. We respected the cluster structure in the R0 calculation by not only considering cases to the peak within the first cluster, i.e. the community of the index dog, but all cases occurring before to the epidemic peak within the total population at risk in the respective region.
As illustrative examples we simulated the most often discussed and applied control strategies for dog rabies, namely vaccination and culling of dogs as a reactive action, as well as dog movement restrictions. According to the model, the only beneficial measure (based on outbreak size) is vaccination. This is consistent with a range of studies in regions where a rabies incursion has been observed: culling as a single control measure was unsuccessful [7,12,14,33], whereas vaccination was demonstrated to be a successful strategy to control recent rabies invasions [7,10,32,40]. However, success of vaccination campaigns obviously depends on the vaccination coverage, as the example of a unsuccessful rabies control via low level vaccination coverage demonstrated in Flores [34]. Also, culling can lead to an eradication of timely detected outbreaks, as for example in region in Bhutan [9], however might be impractical because of non-acceptance, depending on culture and religion of the community. In Australian Indigenous communities, culling of dogs is unlikely to be culturally acceptable. According to our model, movement bans as a single strategy does not seem to be sufficient to reduce rabies spread from one community to another nor within a community–at least for the simulated dog owner compliance (80–90%) that was simulated here. Movement bans would culturally also be difficult to implement as travel with dogs between communities and regions is common. These results are similar for both regions, the NPA and Elcho Island. Within the NPA, rabies epidemics were able to sustain after incursion in each the five communities, as it does for the one community on Elcho Island, identifying the here considered regions and communities equally susceptible. Targeting surveillance should therefore be based on information revealed by risk assessment pathways exploring high risk regions for a rabies incursion. Further detailed simulations exploring combinations of response measures and their threshold values for effectiveness–including the effect of surveillance intensity [40]–is warranted as future research.
The non-intervention strategy was implemented in the model and applied during the sensitivity analysis as a “baseline” to quantify the benefit of other control strategies, although it will most certainly never be observed in the field. Keeping in mind the assumption of a closed dog population with no influx of new dogs (neither birth nor immigration), the high densities of dogs that roam freely in the modelled community and the assumption of an infectious period of up to 12 days combined with a fully naïve population, it is expected that the epidemic will eventually kill the modelled dog population, in the case of no intervention applied.
Model outputs were sensitive to the assumed distance kernel for rabies transmission between dogs from different households. This highlights that the distance kernels should be empirically developed for the particular regions in which the model is to be applied. In our case, the kernel was estimated from roaming dog data collected within the actual study regions [18]. Model outputs (size and duration of the epidemics) were also sensitive to the assumed rabies incubation period and probability of rabies transmission given a bite. These parameters were derived from previously published field observations in Africa (S1 Table), and are likely applicable to many situations, as is the vaccine efficacy parameter. For the probability of bite given a contact between dogs, no specific published data could be found. We assumed this parameter to be >50% due to the aggressiveness that rabies can cause [41], but we also included a large range of uncertainty (60–80%).
Critical parameter values (as for contact rates and the population structure) in this model are informed by data collected in the field. This guarantees the fit of the model to the intended environment of application, although limitations still do occur. Data informing the distance kernel were based on the roaming behaviour of healthy dogs [18]. A rabid dog might change its normal roaming behaviour, as for example reported for rabid racoons in New Jersey (USA) which moved over significantly larger distances than healthy racoons [42]. Apparently the effect of rabies on the roaming behaviour of domestic dogs has not been reported, but considering the observed changes in racoon behaviour, our model might underestimate the spread of rabies. When comparing contact distances observed in our study (healthy dogs, mean distance = 103 meters) that inform this model with the published spatial infection kernel of contacts between rabid dogs and resulting infection (mean = 880 meters, [37]), rabid dogs might roam up to 8.5 times further than healthy dogs. This again indicates that in our model, although long distance movements have been included otherwise, transmission events might be underestimated. Studies on the nature of roaming, contact rates and biting rates of dogs in rabies-endemic studies–comparing these between infected and apparently uninfected communities in the same environment–are needed to address this gap in our knowledge and to more realistically parameterise models of rabies incursion.
In the model, we have focused on the domestic dog population and ignored possible spread to wildlife (in this region, wild dogs and dingoes) because we were interested in the initial epidemic behaviour of a rabies incursion − and hence its impact on domestic dog health and by implication, human health. We assumed a closed dog population without introductions, births and natural deaths, again because our focus was on exploring initial disease response actions rather than the design of long-term rabies control programs.
Although a critical issue for simulation model development, we have not yet validated the model using real outbreak data. Since Australia is historically rabies-free, a direct validation of the model in the region where it is intended for use is impossible, until an actual rabies incursion occurs. However, outbreak data from regions with similar dog population characteristics and recent rabies epidemics might be used, for example the island of Bali [12] or parts of Bhutan [9,10]. Validation of the model using data from a rabies outbreak in domestic dogs in Bhutan in 2008 is currently being planned.
Global control of rabies is a declared goal of the World Health Organization and the Global Alliance for Rabies Control [43]. Within endemic, mostly developing countries, knowledge of effective control strategies is advanced and the challenge is to transfer this knowledge into successful actions [44]. Effectiveness of control strategies to prevent rabies from establishing in previously free regions–as is currently occurring in several areas with large free-roaming dog populations and limited public health services–has not received the same attention. The model described here is a tool to generate such information for remote northern Australia; and it is flexible enough to be adapted to other regions.
Supporting Information
Acknowledgments
We thank Frank Mau, George Mara and Ron Wapau, NPA; and Philippa Dhagapan, Virginia Barratj, Sharon Wunungmurra and Julie Wulkurrngu, Elcho Island; Emma Kennedy and Sacha Woodburn, East Arnhem Shire Regional Council; Bonny Cumming and Jan Allan, AMRRIC; Clayton Abreu, Queensland Health; and Beth Cookson, Chris Rodwell and Bruce Lansdown, NAQS for facilitating data collection informing parameter values. We acknowledge Rebecca Mancy and Stephen Davis for their critical comments to the earlier version of the manuscript.
Data Availability
All relevant data are within the paper and its Supporting Information files (S2, S5 and S6 Tables).
Funding Statement
The study was funded by the Wildlife and Exotic Disease Preparedness Program, Australian Department of Agriculture and the Swiss National Science Foundation (grant number PASMP3 142737). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. Kaplin C, Turner TS, Warrell DA (1986) Rabies: The facts New York: Oxford University Press. 1–126 p. [Google Scholar]
- 2. Knobel DL, Cleaveland S, Coleman PG, Fevre EM, Meltzer MI, et al. (2005) Re-evaluating the burden of rabies in Africa and Asia. Bull World Health Organ 83: 360–368. [PMC free article] [PubMed] [Google Scholar]
- 3. Frey J, Mindekem R, Kessely H, Doumagoum Moto D, Naïssengar S, et al. (2013) Survey of animal bite injuries and their management for an estimate of human rabies deaths in N’Djaména, Chad. Trop Med Int Health 18: 1555–1562. 10.1111/tmi.12202 [DOI] [PubMed] [Google Scholar]
- 4. Cohen C, Sartorius B, Sabeta C, Zulu G, Paweska J, et al. (2007) Epidemiology and molecular virus characterization of reemerging rabies, South Africa. Emerg Infect Dis 13: 1879–1886. 10.3201/eid1312.070836 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Zinsstag J, Dürr S, Penny MA, Mindekem R, Roth F, et al. (2009) Transmission dynamics and economics of rabies control in dogs and humans in an African city. Proc Natl Acad Sci U S A 106: 14996–15001. 10.1073/pnas.0904740106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Lembo T, Hampson K, Kaare MT, Ernest E, Knobel D, et al. (2010) The feasibility of canine rabies elimination in Africa: dispelling doubts with data. PLoS Negl Trop Dis 4: e626 10.1371/journal.pntd.0000626 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Townsend SE, Sumantra IP, Pudjiatmoko, Bagus GN, Brum E, et al. (2013) Designing programs for eliminating canine rabies from islands: Bali, Indonesia as a case study. PLoS Negl Trop Dis 7: e2372 10.1371/journal.pntd.0002372 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Fitzpatrick MC, Hampson K, Cleaveland S, Meyers LA, Townsend JP, et al. (2012) Potential for rabies control through dog vaccination in wildlife-abundant communities of Tanzania. PLoS Negl Trop Dis 6: e1796 10.1371/journal.pntd.0001796 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Tenzin, Sharma B, Dhand NK, Timsina N, Ward MP (2010) Reemergence of rabies in Chhukha district, Bhutan, 2008. Emerg Infect Dis 16: 1925–1930. 10.3201/eid1612.100958 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Tenzin, Dhand NK, Dorjee J, Ward MP (2011) Re-emergence of rabies in dogs and other domestic animals in eastern Bhutan, 2005–2007. Epidemiol Infect 139: 220–225. 10.1017/S0950268810001135 [DOI] [PubMed] [Google Scholar]
- 11. Ward MP (2014) Rabies in the Dutch East Indies a century ago—a spatio-temporal case study in disease emergence. Prev Vet Med 114: 11–20. 10.1016/j.prevetmed.2014.01.009 [DOI] [PubMed] [Google Scholar]
- 12. Putra AAG, Hampson K, Girardi J, Hiby E, Knobel D, et al. (2013) Response to a rabies epidemic, Bali, Indonesia, 2008–2011. Emerg Infect Dis 19: 648–651. 10.3201/eid1904.120380 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Nakouné E, Digol M, Konamna X, Selekon B, Le Faou A (2012) New introduction and spread of rabies among dog population in Bangui. Acta Trop 123: 107–110. 10.1016/j.actatropica.2012.04.005 [DOI] [PubMed] [Google Scholar]
- 14. Windiyaningsih C, Wilde H, Meslin FX, Suroso T, Widarso HS (2004) The rabies epidemic on Flores Island, Indonesia (1998–2003). J Med Assoc Thai 87: 1389–1393. [PubMed] [Google Scholar]
- 15.Ward MP, Hernández-Jover M (2014) A generic rabies risk assessment tool to support surveillance. Prev Vet Med. [DOI] [PubMed]
- 16.Sparkes J, Fleming PJS, Ballard G, Scott-Orr H, Durr S, et al. (2014) Canine Rabies in Australia: A Review of Preparedness and Research Needs. Zoonoses Public Health. [DOI] [PubMed]
- 17. Amaral AC, Ward MP, da Costa Freitas J (2014) Estimation of roaming dog populations in Timor Leste. Prev Vet Med 113: 608–613. 10.1016/j.prevetmed.2013.11.012 [DOI] [PubMed] [Google Scholar]
- 18. Dürr S, Ward MP (2014) Roaming behaviour and home range estimation of domestic dogs in Aboriginal and Torres Strait Islander communities in northern Australia using four different methods. Prev Vet Med 117: 340–357. 10.1016/j.prevetmed.2014.07.008 [DOI] [PubMed] [Google Scholar]
- 19. Prager KC, Woodroffe R, Cameron A, Haydon DT (2011) Vaccination strategies to conserve the endangered African wild dog (Lycaon pictus). Biol Conserv 144: 1940–1948. [Google Scholar]
- 20. Childs JE, Curns AT, Dey ME, Real LA, Feinstein L, et al. (2000) Predicting the local dynamics of epizootic rabies among raccoons in the United States. Proc Natl Acad Sci U S A 97: 13666–13671. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Russell CA, Real LA, Smith DL (2006) Spatial control of rabies on heterogeneous landscapes. PLoS One 1: e27 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Vial F, Cleaveland S, Rasmussen G, Haydon DT (2006) Development of vaccination strategies for the management of rabies in African wild dogs. Biol Conserv 131: 180–192. [Google Scholar]
- 23. Smith GC, Cheeseman CL (2002) A mathematical model for the control of diseases in wildlife populations: culling, vaccination and fertility control. Ecol Modell 150: 45–53. [Google Scholar]
- 24. Anderson RM, Jackson HC, May RM, Smith AM (1981) Population dynamics of fox rabies in Europe. Nature 289: 765–771. [DOI] [PubMed] [Google Scholar]
- 25. Hampson K, Dushoff J, Bingham J, Brückner G, Ali YH, et al. (2007) Synchronous cycles of domestic dog rabies in sub-Saharan Africa and the impact of control efforts. Proc Natl Acad Sci U S A 104: 7717–7722. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Hou Q, Jin Z, Ruan S (2012) Dynamics of rabies epidemics and the impact of control efforts in Guangdong Province, China. J Theor Biol 300: 39–47. 10.1016/j.jtbi.2012.01.006 [DOI] [PubMed] [Google Scholar]
- 27. Kitala PM, McDermott JJ, Coleman PG, Dye C (2002) Comparison of vaccination strategies for the control of dog rabies in Machakos District, Kenya. Epidemiol Infect 129: 215–222. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Zhang J, Jin Z, Sun G-Q, Sun X-D, Ruan S (2012) Modeling seasonal rabies epidemics in China. Bull Math Biol 74: 1226–1251. 10.1007/s11538-012-9720-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Gordon ER, Curns AT, Krebs JW, Rupprecht CE, Real LA, et al. (2004) Temporal dynamics of rabies in a wildlife host and the risk of cross-species transmission. Epidemiol Infect 132: 515–524. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Cowled BD, Garner MG, Negus K, Ward MP (2012) Controlling disease outbreaks in wildlife using limited culling: modelling classical swine fever incursions in wild pigs in Australia. Vet Res 43: 3 10.1186/1297-9716-43-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Abdi H (2010) Coefficient of variation. In: Salkind NJ, Dougherty DM, Frey B, editors. Encyclopedia of Research Design. Thousand Oaks (CA). pp. 169–171.
- 32. Susilawathi NM, Darwinata AE, Dwija IBNP, Budayanti NS, Wirasandhi GAK, et al. (2012) Epidemiological and clinical features of human rabies cases in Bali 2008–2010. BMC Infect Dis 12: 81 10.1186/1471-2334-12-81 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Wera E, Velthuis AGJ, Geong M, Hogeveen H (2013) Costs of rabies control: an economic calculation method applied to Flores Island. PLoS One 8: e83654 10.1371/journal.pone.0083654 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Wera E, Mourits MCM, Hogeveen H (2015) Uptake of rabies control measures by dog owners in flores island, indonesia. PLoS Negl Trop Dis 9: e0003589 10.1371/journal.pntd.0003589 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Bates TW, Thurmond MC, Carpenter TE (2003) Description of an epidemic simulation model for use in evaluating strategies to control an outbreak of foot-and-mouth disease. AmJ Vet Res 64: 195–204. [DOI] [PubMed] [Google Scholar]
- 36. Stevenson MA, Sanson RL, Stern MW, O’Leary BD, Sujau M, et al. (2013) InterSpread Plus: a spatial and stochastic simulation model of disease in animal populations. Prev Vet Med 109: 10–24. 10.1016/j.prevetmed.2012.08.015 [DOI] [PubMed] [Google Scholar]
- 37. Hampson K, Dushoff J, Cleaveland S, Haydon DT, Kaare M, et al. (2009) Transmission Dynamics and Prospects for the Elimination of Canine Rabies. Plos Biol 7: 462–471. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Smieszek T, Fiebig L, Scholz RW (2009) Models of epidemics: when contact repetition and clustering should be included. TheorBiolMedModel 6: 11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Nishiura H, Chowell G, Safan M, Castillo-Chavez C (2010) Pros and cons of estimating the reproduction number from early epidemic growth rate of influenza A (H1N1) 2009. Theor Biol Med Model 7: 1 10.1186/1742-4682-7-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Townsend SE, Lembo T, Cleaveland S, Meslin FX, Miranda ME, et al. (2013) Surveillance guidelines for disease elimination: a case study of canine rabies. Comp Immunol Microbiol Infect Dis 36: 249–261. 10.1016/j.cimid.2012.10.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Niezgoda M, Hanlon CA, Rupprecht C (2002) Animal Rabies In: Jackson AC, Wunner WH, editors. Rabies. Academic Press; pp. 163–207. [Google Scholar]
- 42. Roscoe DE, Holste WC, Sorhage FE, Campbell C, Niezgoda M, et al. (1998) Efficacy of an oral vaccinia-rabies glycoprotein recombinant vaccine in controlling epidemic raccoon rabies in New Jersey. J Wildl Dis 1: 752–763. [DOI] [PubMed] [Google Scholar]
- 43. Lembo T, Attlan M, Bourhy H, Cleaveland S, Costa P, et al. (2011) Renewed global partnerships and redesigned roadmaps for rabies prevention and control. Vet Med Int 2011: 923149 10.4061/2011/923149 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Zinsstag J (2013) Towards a science of rabies elimination. Infect Dis poverty 2: 22 10.1186/2049-9957-2-22 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All relevant data are within the paper and its Supporting Information files (S2, S5 and S6 Tables).