Abstract
During summer 2007 Italy has experienced an epidemic caused by Chikungunya virus – the first large outbreak documented in a temperate climate country – with approximately 161 laboratory confirmed cases concentrated in two bordering villages in North–Eastern Italy comprising 3,968 inhabitants. The seroprevalence was recently estimated to be 10.2%. In this work we provide estimates of the transmission potential of the virus and we assess the efficacy of the measures undertaken by public health authorities to control the epidemic spread. To such aim, we developed a model describing the temporal dynamics of the competent vector, known as Aedes albopictus, explicitly depending on climatic factors, coupled to an epidemic transmission model describing the spread of the epidemic in both humans and mosquitoes. The cumulative number of notified cases predicted by the model was 185 on average (95% CI 117–278), in good agreement with observed data. The probability of observing a major outbreak after the introduction of an infective human case was estimated to be in the range of 32%–76%. We found that the basic reproduction number was in the range of 1.8–6 but it could have been even larger, depending on the density of mosquitoes, which in turn depends on seasonal meteorological effects, besides other local abiotic factors. These results confirm the increasing risk of tropical vector–borne diseases in temperate climate countries, as a consequence of globalization. However, our results show that an epidemic can be controlled by performing a timely intervention, even if the transmission potential of Chikungunya virus is sensibly high.
Introduction
During summer 2007 Italy has experienced the first large outbreak caused by Chikungunya virus (CHIKV) documented in a temperate climate country [1]. CHIKV is an arthropod–borne virus which can be transmitted to humans by Aedes mosquitoes [2], widespread in some tropical regions [3]–[8]. Aedes albopictus is highly competent for CHIKV [9], [10]. In Italy, the presence of this mosquito was first documented in Genoa and Padua (Northern Italy) in the earliest 1990's [11], [12]. Over the following years, Aedes albopictus expanded its distribution and is now well established in Northern and Central Italy [13], [14]. Having the potential to colonize the Mediterranean basin [15], the species has been reported from most Mediterranean European countries [16]. Samples of Aedes albopictus from the two villages were found to be positive for CHIKV sequences [1].
Sustained transmission of CHIKV was mainly observed in two neighboring villages in Emilia–Romagna region (North–Eastern Italy), namely Castiglione di Cervia and Castiglione di Ravenna [1], comprising 3,968 inhabitants in a built–up area of about 70 ha. The two villages are separated by a river with relatively stagnant water resulting from the presence of a lock. Houses are typically low (two storeys), surrounded by small gardens with many flowers, plants and flower pots. During the outbreak in the streets, drainage systems were visible, indicating open stagnant water underground [17].
A total of 161 laboratory confirmed cases were reported to the enhanced surveillance system developed in the two villages [1]. Sporadic cases, probably due to travel towards the most affected villages and not leading to sustained transmission, were also observed in other areas of the same region [1].
Moreover, a seroprevalence study, conducted on a random sample of residents in the village with the largest number of reported cases, shows a 10.2% of protected individuals [18]. Specifically, 82% were symptomatic – similar to 72.3% estimated in Mayotte, Indian Ocean [19] −85% of which satisfied the surveillance case definition, 63% of which were identified by the active surveillance system [18]. Higher prevalences were observed in La Reunion Island and in Mayotte, Indian Ocean, 38.2% and 37.2% respectively [19], [20].
The index case was recorded on June 23 2007 (a man who had arrived in Italy from India on June 21, [1]). On August 23, after the identification of CHIKV as the pathogen responsible for the ongoing epidemic, a set of interventions were undertaken to control the epidemic spread [1]: breeding sites and eggs removal on August 23; use of adulticides from August 23 to August 25 (3 days) and antilarval measures. Breeding sites were attempted to be removed in the entire area (house–to–house interventions were performed and community participation was encouraged as well) while insecticide interventions were undertaken within a radius of 100 m of each suspected case's residence (300 m for clusters of cases).
In this study we investigate the transmission potential of CHIKV in Italy, to provide insight into the possible impact of future outbreaks in temperate climate regions, and the effectiveness of the interventions performed during the outbreak, to provide insight into the epidemic control. To such aim, we developed a model describing the temporal dynamics of the competent vector, known as Aedes albopictus, explicitly depending on climatic factors, coupled to an epidemic transmission model describing the spread of the disease in both humans and mosquitoes, which allowed us to reproduce several observed features of the epidemic.
Methods
In Italy the competent vector for the transmission of CHIKV is Aedes albopictus [1]. CHIKV can spread from human to human through bites of adult female mosquitoes. As the dynamics of the vector depends, among several abiotic factors, on meteorological parameters, a population dynamics model accounting for seasonal temperature variations was used to estimate vector abundance. In particular, temperature plays a very significant role as it affects development and mortality rates of Aedes albopictus [10], [21], influencing vector abundance and distribution over time [22]. The population dynamics model was then coupled to an epidemic transmission model describing the spread of the epidemic in both humans and mosquitoes (see Fig. 1), allowing the estimate of the crucial parameters of the epidemic (e.g. basic reproduction number, effective reproduction number, probability that a major outbreak of the disease would occur after the introduction of a single infective host) and the assessment of intervention strategies.
Modeling mosquito dynamics
The main purpose for modeling the dynamics of the vector is to give an approximate estimation of the abundance of female adult mosquitoes during the CHIKV epidemic outbreak in order to get a reasonable value of the ratio of mosquitoes to humans over time, a crucial factor for the calculation of the fundamental parameters of the epidemic and for the assessment of intervention measures. To achieve this goal, a differential equation model, structurally similar to those analyzed in [23]–[25], was introduced.
The dynamics of the mosquitoes over a land surface of about 70 ha (the extension of the study area) is described by a homogeneous mixing model. Briefly, the model simulates the abundance of the vector in the four life stages of Aedes albopictus, namely eggs (), larvae (), pupae (), female adults (), as follows:
(1) |
where , , and are the temperature dependent developmental rates; , , and are the temperature dependent mortality rates; is the average number of eggs laid in one oviposition; is the carrying capacity of eggs; the term in the fourth equation accounts for the sex ratio (sex ratio is 1∶1, as reported in [21]). The four developmental rates correspond to egg hatching (), pupation (), adult emergence () and gonotrophic cycle (). Length of the gonotrophic cycles subsequent to the first one and number of eggs laid at each gonotrophic cycles are not significantly different within a range of temperature between and [21]. Therefore, we consider only one equation for modeling adults (and not a set of equations, describing transitions through gonotrophic cycles of different length, as in [23] for Aedes Aegypti) and the number of eggs laid in one oviposition does not depend on temperature.
Modeling epidemic transmission
Human host population is assumed to be constant during the epidemic outbreak, given the brief duration of the epidemic compared to the lifespan of humans. We indicate with the number of humans [1]. As for the epidemic transmission model, hosts are classified as susceptible (), latent (), infectious symptomatic () or asymptomatic (), and recovered (). As only adult female mosquitoes are responsible for virus transmission, adult males are not explicitly represented in the transmission model. Female adult vectors are classified as susceptible (), latent () and infectious (). A susceptible vector enters the latent class after biting an infectious host at the per capita rate , where represents the biting rate of the vector (i.e., the number of bites to humans per mosquito per day) and is the susceptibility to infection of the vectors (i.e., the probability that a mosquito get infected after biting an infectious host). A latent vector enters the infectious class after an average latent period of days and remains infectious for the rest of its life [26]. Thus, to account for the epidemic transmission process, the 4th Eq. of system (1) is replaced by the following three equations:
(2) |
where
(3) |
Moreover, as we assume that the infection does not affect oviposition, the first Eq. of system (1) becomes:
(4) |
A susceptible host enters the latent class following the bite of an infectious vector at the per capita rate , where is the susceptibility to infection of humans. A latent host becomes infectious after an average latent period of days, develops symptoms with probability and then, after an average infectious period of days, recovers.
The epidemic transmission process in humans can be modeled by the following system of ordinary differential equations, which has been added to system (1) as modified above (see Eq. 2 and 4):
(5) |
where . In what follows we refer to the full system coupling dynamics of the vector and epidemic transmission process as model .
Basic reproduction number
The basic reproduction number of host–vector infectious diseases is the number of secondary infections that arise when a single infective host is introduced into a fully susceptible host population through pathogen transmission by the vector [27]. The average number of hosts directly infected by the introduction of a single infective vector into a fully susceptible host population is given by the transmission probability multiplied by the adult mosquito infectious lifespan (that is, the entire lifespan) :
(6) |
The average number of vectors directly infected by the introduction of a single infective host into a fully susceptible vector population is given by the transmission probability multiplied by the initial number of mosquitoes per human ( is the sum of all female adult mosquitoes, regardless of the epidemic status) that survive the latent period (probability: ), multiplied by the human infectious period :
(7) |
Thus, the number of secondary infections generated by an infective host in a fully susceptible host population over the entire transmission cycle is:
(8) |
Eq. (8), however, is the threshold parameter of a simplified model (with constant ). Therefore, to compute we assume a constant population of vectors, equal to the average value as predicted by the model in the initial phase of the epidemic, i.e. from June 21 to July 26 2007.
By employing the next–generation matrix method [28]–[30], one obtains the number of secondary cases generated either in hosts or vectors [31], that is the square root of Eq. (8).
Moreover, as shown in [32], the probability that a major outbreak of the disease would occur after the introduction of a single infective host is given by
(9) |
where the terms and are defined in Eq. (6) and (7).
Model parametrization
On the basis of data presented in [21], we estimated the length of the developmental stages (egg hatching, larval and pupal development) and of the gonotrophic cycle as a function of temperature. To estimate, for instance, the length of the egg hatching period we used the following procedure: let be the length of the egg hatching period for temperatures , as reported in [21]. We assume that where is a parametric function of the temperature ( indicate the set of parameters) in a suitable set of functions, comprising exponential and parabolic functions, and is a random sample of a 0 mean normal distribution with unknown variance . The square error between predicted and observed length of the egg hatching period is defined as . Parameters were estimated by minimizing . The variance was computed as the average of the estimated residuals of the model (i.e., the average of the quadratic differences of between the observed data and the best model fit ). The uncertainty of the parameters was estimated by using a technique similar to that used in [33]. Specifically, we simulated 1000 different , obtained by perturbing the best-fit by adding a simulated error sampled from a normal distributed and we repeated the optimization procedure described above. Finally, the rate of eggs hatching is defined as . The same technique was used to estimate the length of larval and pupal development and the length of the gonotrophic cycle. Results are reported in Table 1. Fig. 2b shows a comparison between observed and modeled data.
Table 1. Length of the developmental stages.
development cycle | (95% CI) | (95% CI) | (95% CI) | |
1.03 | 6.9 (5.7,9.9) | 4.0 (1.8,7.2) | 4.1 (0.2,17.2) | |
1.65 | 0.12 (0.08,0.15) | −6.6 (−8.3,−4.8) | 98 (76.6,118.8) | |
0.44 | 0.027 (0.018,0.038) | −1.7 (−2.2,−1.26) | 27.7 (22.2,32.7) | |
0.11 | 0.046 (0.038,0.049) | −2.77 (−2.96,−2.36) | 45.3 (39.7,47.8) |
We estimated mortality rates of eggs, larvae and pupae as a function of temperature on the basis of data on the survival rates presented in [21]. To estimate, for instance, the mortality rate of eggs we used the following procedure: let be the survival rates of eggs (19 days after oviposition) for temperatures , as reported in [21]. For a fixed value of temperature , the following differential equation system describes the transition from eggs to larvae:
(10) |
where is the development rate as estimated above and is the (unknown) mortality rate at the chosen temperature . We chose in such a way that, after 19 days, the survival rate as estimated through simulation of model (10) (i.e. the fraction of eggs that successfully develop into larvae) coincides with . This procedure allowed the estimation of the mortality rate of eggs at temperatures . Fig. 2c shows that the estimated mortality rates of eggs at different temperatures lead to values of the survival rates compliant with the observed ones. The same procedure was used to estimate the mortality rates of larvae and pupae for temperatures . Mortality rates of adults for temperatures were directly available from [21]. The procedure described above for estimating the length of the developmental stages was used to estimate the mortality rates of all stages as a function of temperature in the range . Results are reported in Table 2. Fig. 2d shows a comparison between observed and modeled data.
Table 2. Mortality rates.
stage | (95% CI) | (95% CI) | (95% CI) | |
0.092 | 506 (43.4,925) | 506 (43.4,925) | 27.3 (18.3,30.8) | |
0.012 | 0.029 (0.017,0.041) | 858 (20.6,973) | 43.4 (39.7,43.5) | |
0.005 | 0.021 (0.018,0.026) | 37 (14.8,57) | 36.8 (35.8,37.2) | |
0.003 | 0.031 (0.028,0.04) | 95820 (2954,98553) | 50.4 (46.9,50.6) |
Mortality rates as computed above depend only on temperature. Since parasitism and deficient nutrients have been found to cause a 35% increase in the rate of larval mortality [34] and adult Aedes albopictus females have been found to survive an average of only days (probability of daily survival = days) in the natural environment [35], mortality rates for immature stages ( and ) and adults () were multiplied by a factor and respectively.
The average number of eggs per oviposition is not significantly different at each gonotrophic cycle between and and in our simulations was uniformly chosen in the interval eggs eggs, according to [21].
The carrying capacity of eggs was estimated on the basis of data collected in the 2008 in the study area on the number of eggs per ovitrap per week as resulting from the analysis of 2741 ovitraps from week 21 to week 42 [36]. The mean egg density for the region of interest was found to be in the interval per ovitrap per week. Firstly, we estimated the carrying capacity of a single breeding site as the value giving rise (through simulation of model (1), where all other parameters are known) to an estimated weekly incidence of eggs in the observed range () at temperatures observed in June and July. We estimated to be 19 in average (95% CI 14–27). The carrying capacity of the study region can be computed as , where is the density of breeding sites (number per ha) and ha is the surface of the study area. The exact number of breeding sites (public and private catch basins, stagnant pools of water, etc.) in the area at the time of the epidemic is unknown. Hence, in this study we considered different values of , namely 50, 100, 150 and 200 ha, in order to describe different (high) densities of mosquitoes, as those observed in the study area [1]. These different scenarios are thus characterized by average values of of the carrying capacity in the range .
As for the dependence of rates on temperature, the developmental rates of the aquatic stages, namely egg hatching, larval and pupal developments, and the mortality rates of eggs, pupae and larvae, are daily calculated as a function of the water mean temperature, while the length of the gonotrophic cycle and the mortality rate of adults are calculated as a function of air mean temperature. Since 2008 a monitoring activity has been carried out in order to estimate the water temperature (a key parameter in the developmental stages) of breeding sites. In fact, most of Aedes albopictus life stages develop in aquatic micro–environment. Specifically, a linear regression model was used to estimate the daily mean water temperature as a function of daily mean, maximum and minimum air temperature and daily mean air relative humidity (see Fig. 2a). This allowed us to get estimates of the water temperature for the 2007 season in order to get a more truthful calculation of developmental rates for eggs hatching and immature stages (larvae and pupae), impossible to obtain otherwise.
Plausible ranges for parameters most related to the epidemic transmission process were taken from literature (see Table 3), except for the biting rate – it may vary a lot depending on human and mosquitoes populations, climatic and environmental factors [37]. We explored values of in the range days.
Table 3. Epidemic parameters.
parameter | description | value | reference |
Latent period in humans | 2–4 days | [3], [58]–[60] | |
Infectious period in humans | 2–7 days | [58], [59], [61] | |
Human susceptibility to infections | 50%–80% | [58] | |
Symptomatic ratio | 82% | [18] | |
Notification ratio | 54% | [18] | |
Latent period in mosquitoes | 2–3 days | [26], [58] | |
Mosquito susceptibility to infections | 70%–100% | [62] |
Implementation and parameters optimization
To account for the stochastic nature of the processes regulating both dynamics of mosquito and epidemic transmission, we used a discrete–time stochastic version of model , with time–step days. The time step was chosen short enough to obtain, on average, results comparable with those obtained by simulating the deterministic version of the model. Infections (either in vectors or hosts) occur with probability
where is the force of infection (see for instance [38]–[40]). For instance, to simulate the number of new infections in mosquitoes at a given time of the simulation, we sample from a binomial distribution with probability , where is given in Eq. (3), and sample size , where is the number of susceptible mosquitoes. Other transitions, e.g. through different life stages of the mosquito or through different epidemic classes, occur at the rate where is the suitable rate (e.g. inverse of infectious period, inverse of the eggs hatching period, etc.).
All model parameters were calibrated to minimize the score function , where is the observed daily number of notified cases at time and is the daily number of notified cases as predicted by the model at time (times represent days before the intervention). Model outputs the daily incidence of symptomatic cases, , and asymptomatic cases, . Notified cases at time were estimated by sampling from a binomial distribution of size and probability , where is the notification ratio ( [18]).
Latin Hypercube Sampling (LHS) allows an efficient sampling of the parameter space which requires a smaller sample size than simple sampling to achieve the same accuracy [41]. LHS was used to build sets of parameters (uniform sampling was used to determine the values of each model parameter) and thus, through model simulations, time series of predicted notified cases . The optimal parameter set was chosen as the one minimizing the score function, i.e. . We repeated the above described procedure 100 times. This allowed us to estimate distributions of model parameters and, consequently, of the other quantities of interest (e.g. , probability of major outbreak, attack rate). The index case was recorded on June 23 2007 (a man who had arrived in Italy from India on June 21, [1]) and thus we initialized all simulations with 1 infected individual on June 23. Results of the optimization procedure are shown in Fig. S1. Fig. S2 shows that 100 simulations are sufficient to obtain meaningful distributions of parameters and quantities of interest.
Results and Discussion
In summer 2007, an outbreak of chikungunya fever affected the Italian provinces of Ravenna, Cesena-Forli, Rimini and Bologna [1], [42]–[44]. Health authorities identified 214 laboratory-confirmed cases with date of onset from July 15 to September 28 2007. Most cases (161) occurred in the two neighboring villages of Castiglione di Cervia and Castiglione di Ravenna, but five smaller clusters of local transmission were also detected in five towns in the same region (i.e., Cervia, Cesena, Ravenna, Rimini, and Bologna) which are located 9 to 75 km from the initially affected villages [1], [42]–[44], see Fig. 3.
Model was parametrized to describe epidemic spread only in Castiglione di Cervia and Castiglione di Ravenna. Daily estimates of the number of vectors over time were obtained by the vector dynamics model. The ratio of mosquitoes to humans was estimated to be in the range of 10–35 during the peak mosquito activity (Fig. S3 show the predicted dynamics of the vector for different numbers of breeding sites ). By fitting model to notification data up to August 23 (the day before intervention) and by assuming = 200 ha we estimated to be 0.09 days (95% CI 0.05–0.16 days, see Fig. 4b). We recall that the explored range for through the LHS procedure was . Good fit to data were obtained for values in the entire range explored for all the other model parameters (see Fig. S4).
The uncertainty of depends on the uncertainty of all model parameters. Unfortunately, no field data are available for the study area to validate these results. In [37], plausible values for the biting rate and the ratio of mosquitoes to humans in Europe are considered to be days and (based on published and non published data, e.g. [10]). However, we acknowledge that it might be misleading to compare these results with others carried out in other localities. In fact, abundance and biting rate of Aedes Albopictus are strongly affected by abiotic factors, both climatic and environmental (e.g. presence of other hosts).
Estimates of the biting rate and its uncertainty allowed us to estimate and its uncertainty from Eq. (8). Besides parameters more strictly related to the infectious process, is an increasing function of the square of , as the biting rate controls transmission from humans to mosquitoes and from mosquitoes to humans, and the ratio of vectors to humans (see Fig. S5). However, it should be considered that Eq. (8) depends on the number of vectors which substantially varies over time as a results of seasonal meteorological factors. Thus, as for models explicitly considering seasonal variations in transmission, it is difficult to precisely define . Therefore, we computed by considering the average value of from June 21 to July 26 2007 (i.e. the initial phase of the epidemic), as predicted by the vector dynamics model. We estimated to be 3.3 on average (95% CI 1.8–6, see Fig. 4e). The estimated biting rate increases by decreasing the number of breeding sites and, consequently, estimates of do not change substantially by varying the number of breeding sites ( = 50 ha: days, 95% CI 0.1–0.26 days, , 95% CI 1.9–5.5; = 100 ha: days, 95% CI 0.08–0.2 days, , 95% CI 1.9–5.2; = 150 ha: days, 95% CI 0.06–0.15 days, , 95% CI 2.1–5, see Fig. 4b and Fig. 4e). Fig. 4d shows that is below the critical threshold for all vales of and thus the epidemic is mainly determined by , i.e. by transmission from humans to vectors. As for the effective reproduction number (i.e., the average number of secondary cases generated per primary case at a given time), which accounts for both depletion of susceptible individuals and mosquito dynamics, its value over time is shown in Fig. 4c and Fig. 4f (by considering or not interventions). It emerges that , which does not change much by varying the number of breeding sites, can vary substantially over time as an effect of mosquito dynamics. This suggests that could have been even larger, depending on the time of epidemic seeding.
Recently, it has been demonstrated using mathematical modeling in the context of dengue that it is possible to generate outbreaks even in cases when provided that the vector-to-human component of is greater than one and that a certain number of infected vectors are introduced into the affected population [45]. However, it has been demonstrated that the index case was a man of Indian origin from Kerala living in Castiglione di Cervia, without history of traveling during the previous year [1]. He only reported contact with a relative of his, who had arrived in Italy on June 21 2007 from Kerala, India (a region of India affected by the CHIKV epidemic), and visited him in Castiglione di Cervia village on June 23, while feverish. Therefore, having the human index case being identified, we can reasonably exclude the contemporaneous introduction of infected vectors in the two villages. Moreover, our estimates show that is well below the critical threshold.
As several cases were reported in Italy among travelers returning from endemic areas [46] (only one, however, in the study area; additional imported cases throughout the duration of the outbreaks were not detected), the question arises why no previous outbreaks of CHIKV occurred in other Italian regions. By assuming = 200 ha, we estimated the probability (see Eq. 9) that a major outbreak of the disease would occur after the introduction of a single infective host to be 0.59 (95% CI 0.35–0.76, see Fig. 4a). Estimates do not change substantially by varying the number of breeding sites ( = 50 ha: , 95% CI 0.29–0.7, see Fig. 4a; = 100 ha: , 95% CI 0.32–0.71, see Fig. 4a; = 150 ha: , 95% CI 0.4–0.73, see Fig. 4a). For values of the biting rate in a given range, results indicate that major outbreaks are possible only for large enough values of (see Fig. S5) and, by assuming the same density of mosquitoes, epidemic outbreaks are more likely in rural areas with respect to urban areas – as the human population density is much lower in the former. This could explain why cities like Cesena (96,000 inhabitants), Rimini (141,000 inhabitants) and Bologna (377,000 inhabitants) and Ravenna (157,000 inhabitants) located in the same region of the two most affected villages did not experience any epidemic outbreak, though sporadic CHIKV cases were recorded in the same period [1], [42]–[44]. These results support the hypothesis that outbreaks of Chikungunya virus in those temperate climate countries characterized by high density of Aedes albopictus are probable after the importation of an index case from abroad.
The potential epidemic trajectory in the absence of interventions by assuming ha is shown in Fig. 5a. The resulting cumulative attack rate (i.e., the percentage of symptomatic cases in the population at the end of the epidemic) was estimated to be 73.4% of the population (95% CI 57.8%–81.5%, see also Fig. 5b). Results do not change much by varying ( = 50 ha: , 95% CI 55.3%–81.6%, see also Fig. S6; = 100 ha: , 95% CI 55.8%–81.5%; = 150 ha: , 95% CI 57.3%–81.3%). Much lower prevalence values have been estimated in La Reunion Island and in Mayotte, namely 38.2% and 37.2% respectively. However, these estimates are hardly comparable with our model predictions as these territories have benefited from high resource allocation to mitigate the epidemic [19].
As for the undertaken interventions, breeding sites and eggs were removed on August 23 2007, larvicides were used on August 23 (effect lasting 30 days), and adulticides were used from August 23 to August 25 2007. Through model simulations, we evaluated the effects of strategies mimicking the timing of the actual interventions undertaken in Italy. As for the effects in terms of reduction of breeding sites, eggs, larvae and adults, likely values are: 20% to 60% as for reduction breeding sites and eggs, 80% to 95% as for reduction of larvae and 80% to 95% as for reduction of adults. We discuss first results obtained by assuming 40% as for reduction of breeding sites and eggs, 90% as for reduction of larvae and 95% as for reduction of adults. The effects of such an intervention are shown in Fig. 5c. The resulting cumulative attack rate, by assuming ha, was estimated to be 8.7% (95% CI 5.6%–12.7%, see Fig. 5d), in good agreement with the observed value, namely 8.4%, computed by multiplying the overall observed prevalence, 10.2% [18], by the symptomatic ratio [18]. Results are similar for other choices of (for instance, for = 50 ha the figure becomes , 95% CI 5.3%–13%; see also Fig. S6). To keep track of the number of symptomatic cases identified by the active surveillance system, we assume that human symptomatic cases are identified with probability and this allows fitting notification data in model simulations. According to model estimates, the number of notified cases would have been about 185 on average (95% CI 117–278), in good agreement with the number as reported to the surveillance system, namely 161 cases [1]. The number of cases drastically decreased in late August while the effective reproduction number, in the absence of interventions, would have fallen below the epidemic threshold in late September (see Fig. 4c and Fig. 4f). This proves that a combined strategy resulted in a drastic reduction of the epidemic impact, despite the relatively large value of .
Let us now consider two aspects of the control strategy. Firstly, we assume different efficacy in terms of reduction of breeding sites, eggs, larvae and adults to evaluate the robustness of the estimated effects of the interventions undertaken in Italy. As shown in Fig. 6b, results are robust for small variations of the efficacy of the vectors control. In a fully susceptible population the time from primary index case to secondary infections was estimated to be 11 days on average (95% CI 3–20). This allows public health authorities to gain time to put in place control measures.
Secondarily, we investigate the efficacy of the single interventions (breeding sites removal, larvicides, adulticides). Results are shown only for ha. As shown in Fig. 6a, reduction of eggs and breeding sites could be effective only by hypothesizing a massive intervention (cumulative attack rate is reduced on average from 73% to 55% by reducing eggs and breeding sites of 60%); adulticides do not contribute much to reducing the overall number of cases (cumulative attack rate is reduced on average from 73% to 60%); larvicides contribute to a substantial reduction of the overall number of cases (cumulative attack rate is reduced on average from 73% to 40%); In fact, larvicides are effective for a prolonged period of time and thus can contribute to decrease systematically the number of adults for a long period of time and, consequently, to substantially reduce the overall attack rate. Quite the contrary, adulticides were used for a very limited period of time (3 days) and thus their effect is limited due to the rapid increase of adults suddenly after the intervention. Overall, these results suggest that only a combined intervention, as the one performed during the outbreak, can result in a drastic decrease of the number of cases.
Five smaller clusters of local transmission were detected in five towns in the same region (i.e., Ravenna, Cervia, Cesena, Rimini, and Bologna). Cervia and Ravenna are the main towns of the municipalities where the two most affected villages (Castiglione di Cervia and Castiglione di Ravenna) are located. The two affected villages account for the 2.1% of the population of the municipalities of Cervia (27,000 inhabitants) and Ravenna (157,000 inhabitants). By analyzing commuting data of the Emilia–Romagna region [47], we found that the number of individuals traveling daily to Cervia and Ravenna for work or study is 8,787 (from 249 different municipalities), and the number of persons traveling daily from Cervia and Ravenna to other municipalities is 10,861 (towards 139 different municipalities). The exact number of commuters for Castiglione di Cervia and Castiglione di Ravenna is unknown but it should not exceed 2.1% of the overall number of commuters. However, the probability of traveling from/to a certain municipality should be similar to that observed for the two municipalities as a whole and we found that clusters of local transmission were recorded in municipalities well connected with the municipalities of Ravenna and Cervia (see Table 4). For at least four of the five clusters, population movement (i.e., persons who visited the area that was primarily affected or persons from the primarily affected area who visited one of the four towns) can be reasonably assumed to have been the main determinant of local transmission. Another possible explanation is passive vector mobility (e.g. infected mosquitoes transported by car from the initial cluster), since the flight range (active mobility) is usually considered to be less than 1 km [35], [48], [49].
Table 4. Commuting patterns.
municipality | origin (rank) | destination (rank) | cases [63] |
Cesena | 18% (2) | 10% (3) | 15 |
Rimini | 2.9% (10) | 3.1% (10) | 6 |
Bologna | 9.5% (3) | 1.6% (13) | 5 |
Cervia | - | - | 19 |
Ravenna | - | - | 9 |
Probability of origin and destination (and rank over all possible origins/destinations) of individuals commuting daily for work or school from/to other municipalities were local clusters of transmission were observed. The two most affected villages are located in the municipalities of Cervia and Ravenna.
Our results suggest that the transmission potential of CHIKV in Italy was similar to the one observed in tropical regions where Chikungunya fever is widespread (e.g., Reunion Island, where the best estimate for the initial was 3.7 [3]). Specifically, we estimated to be in the range of 1.8–6. However, being the reproduction number strongly dependent on the density of mosquitoes, which in turn varies a lot over time as a consequence of seasonal meteorological effects, different (even larger) values of could be observed in future outbreaks, depending on the time of epidemic seeding. In [3], by adapting a method originally introduced in [50] for human–to–human infections, was estimated from the generation interval probability distribution function and the number of gonotrophic cycles of the mosquito. This method can not be applied in our study, as the undertaken control measures have contributed to alter the gonotrophic cycles of the mosquito in a indeterminable manner. We found that the probability of observing a major outbreak after the introduction of an index case depends on the ratio of mosquitoes to humans and was estimated to be in the range of 32%–76%. These results confirm the high risk to Europe of tropical vector–borne diseases as a consequence of globalization, which has been modifying the mobility of humans and vectors. Climate changes could have been playing a role, as the geographical limits of mosquito–borne diseases can be influenced by climate [51], [52], but this is still debated [53]–[55].
Moreover, our analysis strongly support the efficacy of the disinfestation strategy performed during the Italian outbreak, which drastically contributed to reduce the cumulative attack rate (of about 88%), though the application of self–protection preventive measures (insect repellents and window screens) could also have played a role [18]. Therefore, even if the transmission potential of Chikungunya virus could be sensibly high also in temperate climate countries, the epidemic can be controlled by performing timely interventions.
The proposed model has several limitations. We assume exponential distribution for all parameters of model related to the length of the different periods (e.g. latency, infectiousness, etc.), though it would be preferable to use multiple classes within each group to give more realistic gamma distributed lifetimes (see for instance [56]). We assume density–dependent growth only in eggs, though other density–dependent regulating processes should be considered for other lifestages of the mosquitoes, e.g. larvae and pupae [25]. These modeling choices are due to the lack of data for parametrizing the model. The lack of information on the actual number of breeding sites – it could be assessed only by performing a field study – prevent us to give precise estimates on the density of mosquitoes over time in the study area. However, we would note that our estimates of , attack rates and probability of major outbreak are robust with respect to assumptions on the number of breeding sites. Moreover, the temporal dynamics of the vector is qualitatively well captured by model (though not in terms of absolute abundance) and this allowed us to clarify whether or not the sharp decrease in the number of cases observed after the intervention was due to the intervention itself or to the spontaneous reduction of adults due to decrease of temperature. Definitely, a key lesson learnt from the analysis of the Chikungunya outbreak in Italy is the necessity to improve tools for obtaining reliable, though costly, estimates of the vector density (see for instance [57]) – thus bypassing the necessity of developing ad-hoc models. The proposed model, describing the temporal dynamics of Aedes albopictus, provides a valid alternative in the absence of reliable field data.
Supporting Information
Acknowledgments
We thank Thomas Seyler for helpful comments and discussion. We thank the Public Health Service of Emilia–Romagna Region and the CHIKV study group for monitoring and data collection activities. We wish to thank the anonymous reviewers for their valuable suggestions.
Footnotes
Competing Interests: The authors have declared that no competing interests exist.
Funding: This work was funded by the Italian Ministry of Health “Chikungunya virus infection: epidemiological and clinical features” project. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Rezza G, Nicoletti L, Angelini R, Romi R, Finarelli AC, et al. Infection with chikungunya virus in Italy: an outbreak in a temperate region. Lancet. 2007;370:1840–1846. doi: 10.1016/S0140-6736(07)61779-6. [DOI] [PubMed] [Google Scholar]
- 2.Reiter P, Fontenille D, Paupy C. Aedes albopictus as an epidemic vector of chikungunya virus: another emerging problem? Lancet Infect Dis. 2006;6:463–464. doi: 10.1016/S1473-3099(06)70531-X. [DOI] [PubMed] [Google Scholar]
- 3.Boëlle PY, Thomas G, Vergu E, Renault P, Valleron AJ, et al. Investigating transmission in a two–wave epidemic of Chikungunya fever, R'eunion Island. Vector Borne Zoonotic Dis. 2008;8:207–217. doi: 10.1089/vbz.2006.0620. [DOI] [PubMed] [Google Scholar]
- 4.Mavalankar D, Shastri P, Raman P. Chikungunya epidemic in India: a major public–health disaster. Lancet Infect Dis. 2007;7:306–307. doi: 10.1016/S1473-3099(07)70091-9. [DOI] [PubMed] [Google Scholar]
- 5.Pialoux G, Gaüzère BA, Jauréguiberry S, Strobel M. Chikungunya, an epidemic arbovirosis. Lancet Infect Dis. 2007;7:319–327. doi: 10.1016/S1473-3099(07)70107-X. [DOI] [PubMed] [Google Scholar]
- 6.Renault P, Solet JL, Sissoko D, Balleydier E, Larrieu S, et al. A major epidemic of chikungunya virus infection on Reunion Island, France, 2005–2006. Am J Trop Med Hyg. 2007;77:727–731. [PubMed] [Google Scholar]
- 7.Laras K, Sukri NC, Larasati RP, Bangs MJ, Kosim R, et al. Tracking the re–emergence of epidemic chikungunya virus in Indonesia. Trans R Soc Trop Med Hyg. 2005;99:128–141. doi: 10.1016/j.trstmh.2004.03.013. [DOI] [PubMed] [Google Scholar]
- 8.Woodruff AW, Bowen ET, Platt GS. Viral infections in travellers from tropical Africa. Br Med J. 1978;1:956–958. doi: 10.1136/bmj.1.6118.956. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Vazeille M, Moutailler S, Coudrier D, Rousseaux C, Khun H, et al. Two Chikungunya Isolates from the Outbreak of La Reunion (Indian Ocean) Exhibit Different Patterns of Infection in the Mosquito, Aedes albopictus. PLoS ONE. 2007;2:e1168. doi: 10.1371/journal.pone.0001168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Hawley WA. The biology of Aedes albopictus. J Am Mosq Control Assoc. 1988;(Suppl 1):1–39. [PubMed] [Google Scholar]
- 11.Sabatini A, Raineri V, Trovato G, Coluzzi M. Aedes albopictus in Italy and possible diffusion of the species into the Mediterranean area. Parassitologia. 1990;32:301–304. [PubMed] [Google Scholar]
- 12.Dalla Pozza G, Majori G. First record of Aedes albopictus establishment in Italy. J Am Mosq Control Assoc. 1992;8:318–320. [PubMed] [Google Scholar]
- 13.Romi R. History and updating on the spread of Aedes albopictus in Italy. Parassitologia. 1995;37:99–103. [PubMed] [Google Scholar]
- 14.Romi R, Luca MD, Majori G. Current status of Aedes albopictus and Aedes atropalpus in Italy. J Am Mosq Control Assoc. 1999;15:425–427. [PubMed] [Google Scholar]
- 15.Knudsen AB, Romi R, Majori G. Occurrence and spread in Italy of Aedes albopictus, with implications for its introduction into other parts of Europe. J Am Mosq Control Assoc. 1996;12:177–183. [PubMed] [Google Scholar]
- 16.Gratz NG. Critical review of the vector status of Aedes albopictus. Med Vet Entomol. 2004;18:215–227. doi: 10.1111/j.0269-283X.2004.00513.x. [DOI] [PubMed] [Google Scholar]
- 17.European Centre for Disease Prevention and Control. Mission report chikungunya in Italy. 2007. Joint ECDC/WHO visit for a European risk assessment 17–21 September 2007.
- 18.Moro ML, Gagliotti C, Silvi G, Angelini R, Sambri V, et al. Chikungunya virus in North–Eastern Italy: a seroprevalence survey. Am J Trop Med Hyg. 2010;82:508–511. doi: 10.4269/ajtmh.2010.09-0322. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Sissoko D, Moendandze A, Malvy D, Giry C, Ezzedine K, et al. Seroprevalence and risk factors of chikungunya virus infection in Mayotte, Indian Ocean, 2005–2006: a population–based survey. PLoS ONE. 2008;3:e3066. doi: 10.1371/journal.pone.0003066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Gérardin P, Guernier V, Perrau J, Fianu A, Roux KL, et al. Estimating Chikungunya prevalence in La Réunion Island outbreak by serosurveys: two methods for two critical times of the epidemic. BMC Infect Dis. 2008;8:99. doi: 10.1186/1471-2334-8-99. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Delatte H, Gimonneau G, Triboire A, Fontenille D. Influence of temperature on immature development, survival, longevity, fecundity, and gonotrophic cycles of Aedes albopictus, vector of chikungunya and dengue in the Indian Ocean. J Med Entomol. 2009;46:33–41. doi: 10.1603/033.046.0105. [DOI] [PubMed] [Google Scholar]
- 22.Roiz D, Rosà R, Arnoldi D, Rizzoli A. Effects of Temperature and Rainfall on the Activity and Dynamics of Host–Seeking Aedes albopictus Females in Northern Italy. Vector Borne Zoonotic Dis. 2010;10:811–816. doi: 10.1089/vbz.2009.0098. [DOI] [PubMed] [Google Scholar]
- 23.Otero M, Solari HG, Schweigmann N. A stochastic population dynamics model for Aedes aegypti: formulation and application to a city with temperate climate. Bull Math Biol. 2006;68:1945–1974. doi: 10.1007/s11538-006-9067-y. [DOI] [PubMed] [Google Scholar]
- 24.Erickson R, Presley S, Allen L, Long K, Cox S. A stage–structured, Aedes albopictus population model. Ecological Modeling. 2010;221:1273–1282. [Google Scholar]
- 25.Moulay D, Aziz–Alaoui MA, Cadivel M. The chikungunya disease: modeling, vector and transmission global dynamics. Math Biosci. 2011;229:50–63. doi: 10.1016/j.mbs.2010.10.008. [DOI] [PubMed] [Google Scholar]
- 26.Dubrulle M, Mousson L, Moutailler S, Vazeille M, Failloux AB. Chikungunya virus and Aedes mosquitoes: saliva is infectious as soon as two days after oral infection. PLoS ONE. 2009;4:e5895. doi: 10.1371/journal.pone.0005895. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Anderson R, May RM. Infectious diseases of humans: dynamics and control. Oxford, UK: Oxford University Press; 1992. [Google Scholar]
- 28.Diekmann O, Heesterbeek JA, Metz JA. On the definition and the computation of the basic reproduction ratio R0 in models for infectious diseases in heterogeneous populations. J Math Biol. 1990;28:365–382. doi: 10.1007/BF00178324. [DOI] [PubMed] [Google Scholar]
- 29.Roberts MG, Heesterbeek JAP. A new method for estimating the effort required to control an infectious disease. Proc Biol Sci. 2003;270:1359–1364. doi: 10.1098/rspb.2003.2339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Diekmann O, Heesterbeek JAP, Roberts MG. The construction of next–generation matrices for compartmental epidemic models. J R Soc Interface. 2009;7:873–885. doi: 10.1098/rsif.2009.0386. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Chowell G, Diaz–Dueas P, Miller JC, Alcazar–Velazco A, Hyman JM, et al. Estimation of the reproduction number of dengue fever from spatial epidemic data. Math Biosci. 2007;208:571–589. doi: 10.1016/j.mbs.2006.11.011. [DOI] [PubMed] [Google Scholar]
- 32.Lloyd AL, Zhang J, Root AM. Stochasticity and heterogeneity in host–vector models. J R Soc Interface. 2007;4:851–863. doi: 10.1098/rsif.2007.1064. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Chowell G, Miller MA, Viboud C. Seasonal influenza in the United States, France, and Australia: transmission and prospects for control. Epidemiol Infect. 2007;136:852–864. doi: 10.1017/S0950268807009144. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Comiskey NM, Lowrie RC, Wesson DM. Role of habitat components on the dynamics of Aedes albopictus (Diptera: Culicidae) from New Orleans. J Med Entomol. 1999;36:313–320. doi: 10.1093/jmedent/36.3.313. [DOI] [PubMed] [Google Scholar]
- 35.Niebylski ML, Craig GB. Dispersal and survival of Aedes albopictus at a scrap tire yard in Missouri. J Am Mosq Control Assoc. 1994;10:339–343. [PubMed] [Google Scholar]
- 36.Albieri A, Carrieri M, Agelini P, Baldacchini F, Venturelli C, et al. Quantitative monitoring of Aedes albopictus in Emilia–Romagna, Northern Italy: cluster investigation and geostatistical analysis. B Insectol. 2010;63:209–216. [Google Scholar]
- 37.Fontenille D, Failloux A, Romi R. 2007. pp. 169–184. Emerging pests and vector–borne diseases in Europe, Wageningen: Wageningen Academic Publishers, chapter Should we expect chikungunya and dengue in Southern Europe?
- 38.Allen LJ, Burgin AM. Comparison of deterministic and stochastic SIS and SIR models in discrete time. Math Biosci. 2000;163:1–33. doi: 10.1016/s0025-5564(99)00047-4. [DOI] [PubMed] [Google Scholar]
- 39.Merler S, Ajelli M. The role of population heterogeneity and human mobility in the spread of pandemic influenza. Proc Biol Sci. 2010;277:557–565. doi: 10.1098/rspb.2009.1605. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Ajelli M, Gonalves B, Balcan D, Colizza V, Hu H, et al. Comparing large–scale computational approaches to epidemic modeling: agent–based versus structured metapopulation models. BMC Infect Dis. 2010;10:190. doi: 10.1186/1471-2334-10-190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Marino S, Hogue IB, Ray CJ, Kirschner DE. A methodology for performing global uncertainty and sensitivity analysis in systems biology. J Theor Biol. 2008;254:178–196. doi: 10.1016/j.jtbi.2008.04.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Angelini R, Finarelli AC, Angelini P, Po C, Petropulacos K, et al. Chikungunya in north–eastern Italy: a summing up of the outbreak. Euro Surveill. 2007;12:pii = 3313. doi: 10.2807/esw.12.47.03313-en. [DOI] [PubMed] [Google Scholar]
- 43.Angelini R, Finarelli AC, Angelini P, Po C, Petropulacos K, et al. An outbreak of chikungunya fever in the province of Ravenna, Italy. Euro Surveill. 2007;12:pii = 3260. doi: 10.2807/esw.12.36.03260-en. [DOI] [PubMed] [Google Scholar]
- 44.Seyler T, Rizzo C, Finarelli AC, Po C, Alessio P, et al. Autochthonous chikungunya virus transmission may have occurred in Bologna, Italy, during the summer 2007 outbreak. Euro Surveill. 2008;13:pii = 8015. doi: 10.2807/ese.13.03.08015-en. [DOI] [PubMed] [Google Scholar]
- 45.Massad E, Coutinho FAB, Burattini MN, Amaku M. Estimation of R0 from the initial phase of an outbreak of a vector–borne infection. Trop Med Int Health. 2010;15:120–126. doi: 10.1111/j.1365-3156.2009.02413.x. [DOI] [PubMed] [Google Scholar]
- 46.Beltrame A, Angheben A, Bisoffi Z, Monteiro G, Marocco S, et al. Imported Chikungunya Infection, Italy. Emerg Infect Dis. 2007;13:1264–1266. doi: 10.3201/eid1308.070161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Emilia–Romagna Region website. 2001 census data and commuting matrices. Available: http://sasweb.regione.emilia-romagna.it/cgi-bin/broker.exe?service=areadl&program=prog.selezion Accessed 2011 Mar 31.
- 48.Reiter P, Sprenger D. The used tire trade: a mechanism for the worldwide dispersal of container breeding mosquitoes. J Am Mosq Control Assoc. 1987;3:494–501. [PubMed] [Google Scholar]
- 49.Honorio NA, da Costa Silva W, Leite PJ, Goņcalves JM, Lounibos LP, et al. Dispersal of Aedes aegypti and Aedes albopictus (Diptera: Culicidae) in an Urban Endemic Dengue Area in the State of Rio de Janeiro, Brazil. Memorias do Instituto Oswaldo Cruz. 2003;98:191–198. doi: 10.1590/s0074-02762003000200005. [DOI] [PubMed] [Google Scholar]
- 50.Wallinga J, Teunis P. Different epidemic curves for severe acute respiratory syndrome reveal similar impacts of control measures. Am J Epidemiol. 2004;160:509–516. doi: 10.1093/aje/kwh255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Hales S, de Wet N, Maindonald J, Woodward A. Potential effect of population and climate changes on global distribution of dengue fever: an empirical model. Lancet. 2002;360:830–834. doi: 10.1016/S0140-6736(02)09964-6. [DOI] [PubMed] [Google Scholar]
- 52.Tilston N, Skelly C, Weinstein P. Pan–European Chikungunya surveillance: designing risk stratified surveillance zones. Int J Health Geogr. 2009;8:61. doi: 10.1186/1476-072X-8-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Reiter P. Climate change and mosquito–borne disease. Environ Health Perspect. 2001;109:141–161. doi: 10.1289/ehp.01109s1141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Patz JA, Campbell–Lendrum D, Holloway T, Foley JA. Impact of regional climate change on human health. Nature. 2005;438:310–317. doi: 10.1038/nature04188. [DOI] [PubMed] [Google Scholar]
- 55.Reiter P. Climate change and mosquito–borne disease: knowing the horse before hitching the cart. Rev Sci Tech. 2008;27:383–398. [PubMed] [Google Scholar]
- 56.Wearing HJ, Rohani P, Keeling MJ. Appropriate models for the management of infectious diseases. PLoS Med. 2005;2:e174. doi: 10.1371/journal.pmed.0020174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Griffin JT, Hollingsworth TD, Okell LC, Churcher TS, White M, et al. Reducing Plasmodium falciparum malaria transmission in Africa: a model–based evaluation of intervention strategies. PLoS Med. 2010;7:e1000324. doi: 10.1371/journal.pmed.1000324. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Dumont Y, Chiroleu F, Domerg C. On a temporal model for the Chikungunya disease: modeling, theory and numerics. Math Biosci. 2008;213:80–91. doi: 10.1016/j.mbs.2008.02.008. [DOI] [PubMed] [Google Scholar]
- 59.Chhabra M, Mittal V, Bhattacharya D, Rana U, Lal S. Chikungunya fever: a re–emerging viral infection. Indian J Med Microbiol. 2008;26:5–12. doi: 10.4103/0255-0857.38850. [DOI] [PubMed] [Google Scholar]
- 60.Centers for Disease Control and Prevention website. Chikungunya fever. Available: http://www.cdc.gov/ncidod/dvbid/chikungunya. Accessed 2011 Mar 31.
- 61.Parola P, de Lamballerie X, Jourdan J, Rovery C, Vaillant V, et al. Novel chikungunya virus variant in travelers returning from Indian Ocean islands. Emerg Infect Dis. 2006;12:1493–1499. doi: 10.3201/eid1210.060610. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Vazeille M, Jeannin C, Martin E, Schaffner F, Failloux AB. Chikungunya: a risk for Mediterranean countries? Acta Trop. 2008;105:200–202. doi: 10.1016/j.actatropica.2007.09.009. [DOI] [PubMed] [Google Scholar]
- 63.Liumbruno GM, Calteri D, Petropulacos K, Mattivi A, Po C, et al. The Chikungunya epidemic in Italy and its repercussion on the blood system. Blood Transfus. 2008;6:199–210. doi: 10.2450/2008.0016-08. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.