Abstract
Q fever, a worldwide zoonotic disease caused by Coxiella burnetii, is a looming concern for livestock and public health. Epidemiological features of inter-herd transmission of C. burnetii in cattle herds by wind and trade of cows are poorly understood. We present a novel dynamic spatial model describing the inter-herd regional spread of C. burnetii in dairy cattle herds, quantifying the ability of airborne transmission and animal trade in C. burnetii propagation in an enzootic region. Among all the new herd infections, 92% were attributed to airborne transmission and the rest to cattle trade. Infections acquired following airborne transmission were shown to cause relatively small and ephemeral intra-herd outbreaks. On the contrary, disease-free herds purchasing an infectious cow experienced significantly higher intra-herd prevalence. The results also indicated that, for short duration, both transmission routes were independent from each other without any synergistic effect. The model outputs applied to the Finistère department in western France showed satisfactory sensitivity (0.71) and specificity (0.80) in predicting herd infection statuses at the end of one year in a neighbourhood of 3 km around expected incident herds, when compared with data. The model developed here thus provides important insights into the spread of C. burnetii between dairy cattle herds and paves the way for implementation and assessment of control strategies.
Electronic supplementary material
The online version of this article (doi:10.1186/s13567-016-0330-4) contains supplementary material, which is available to authorized users.
Introduction
Changes in social-economical, environmental and ecological factors are driving forces for the emergence of zoonotic infections [1]. In Europe, Q fever, a re-emerging zoonosis caused by the bacterium Coxiella burnetii, has seen a sharp rise in recent years, especially in the Netherlands with a large number of human cases which were attributed to livestock [2–4]. C. burnetii infections are common and subclinical in cattle, and generally result in reduced reproductive performance and abortions in primiparous cows [5, 6]. Infection in cattle herds is known to be widespread and enzootic [7]. Even though most of the recent human outbreaks are known to originate from small ruminants, intensive cattle farming with high prevalence could become a concern for public health [7]. Hence, investigation of infection dynamics in cattle herds at the first sign of its emergence is essential in the emergence-to-control continuum [8].
Cows acquire the infection through inhalation of C. burnetii. Various quantities of bacteria are shed by infectious animals through different routes [9]. Intra-herd infection dynamics of a dairy herd is mainly influenced by the heterogeneity of the shedding routes [10]. One of the important uncertainties concerning dynamics of infection lies in the contributions of the different routes in transmitting C. burnetii between livestock herds. Although airborne transmission of C. burnetii is a well-documented phenomenon [11–17], its precise contribution to the regional spread of C. burnetii between dairy cattle herds is poorly understood.
The same uncertainty holds for cattle trade. That is, no formal testing is conducted for the determination of the infection status of cows before sale or purchase. Recent studies have identified a risk of infection of dairy herds through airborne dispersion of bacteria and cattle trade [18, 19], but their respective quantitative contributions to the transmission are still unknown.
Here we present a novel individual-based metapopulation model in a stochastic framework including both spatial and temporal spread of C. burnetii between dairy cattle herds. Infection status and trade movement of animals between herds were individually tracked through time. The model has been applied to the case study of the Finistère department located in north-western France, characterised by a high density of dairy cattle, a windy marine west coast climate and a relatively flat terrain. The accuracy of model predictions was assessed based on meteorological, cattle trade and epidemiological data. Subsequently, the contributions of transmission routes to the regional spread of C. burnetii and their impact on the intra-herd infection dynamics were evaluated through the analysis of simulated scenarios.
Materials and methods
Summary of study approach and modelling framework
The different steps of the study approach and the modelling framework are summarised in Figure 1. The spread of C. burnetii between the dairy cattle herds of the Finistère department between May 2012 and May 2013 (data described in “Data” sub-section) was simulated using a metapopulation model (“Metapopulation model for regional spread of C. burnetii” sub-section). The initial conditions for simulations were generated according to the observed seroprevalence in tested herds in 2012.
The metapopulation model has three distinct components. The first one describes the spread of C. burnetii within each dairy cattle herd (intra-herd scale) along with their demographics (“Intra-herd dynamics of C. burnetii” sub-section). The second one describes C. burnetii transmission between the dairy cattle herds of the metapopulation due to cattle trade (“Inter-herd transmission due to cattle trade” sub-section). The third one describes C. burnetii between-herd transmission due to airborne dispersion (“Inter-herd infection dynamics due to airborne dispersion” sub-section).
Trade was incorporated into the model based on available data (details on data in “Data” sub-section). Airborne dispersion of C. burnetii was modelled using a Gaussian dispersion model (“Inter-herd infection dynamics due to airborne dispersion” sub-section) incorporating meteorological data (described in “Data” sub-section). The assessment of the accuracy of model predictions was performed by comparing model outputs and epidemiological data in 2013, using receiver operating characteristic analysis (“Assessment of model predictions” sub-section). Finally, the assessment of the relative contribution of cattle trade and airborne dispersion as transmission pathways between herds was performed through simulations. This final stage (not represented in Figure 1) is described in the “Assessment of the relative impact of transmission routes on the intra-herd and regional spread of C. burnetii” sub-section.
Data
Coxiella burnetii infections are known to be enzootic in the cattle population of the Finistère department (north-western France). In May 2012, 2799 dairy cattle herds (69% of all the cattle herds in Finistère), were tested for antibodies against C. burnetii in bulk tank milk (BTM) using LSI Q fever enzyme—linked immunosorbent assay (ELISA) kit® (LSI; Lissieu, France). Herds detected as seronegative in 2012 were retested again in May 2013. Data on geographical coordinates and number of cows in herds were also collected.
Furthermore, data on the movements of individual cows between dairy cattle herds and through markets of the Finistère department were extracted for the time period of May 2012–2013 from the national register (source: Groupements de Défense Sanitaire de Bretagne, France). In total, 835 out of 2799 dairy herds were involved (as a source or destination) in 2234 movements of cows (i.e. one movement corresponds to one cow being sold and purchased). In 182 herds, at least one animal during the study period was purchased and was not infected in May 2012. The mean number of animals sold per herd was equal to 4.7 (n = 474), the mean number of purchased animals was 5.3 (n = 491), the mean number of partners for selling was 1.4 and for buying animals was 1.6.
Wind speed data required for dispersion modelling were procured from the open access database of the European Centre for Medium Range Weather Forecasts [20]. Data on northward and eastward wind components for the Finistère department for the period of May 2012–2013 were extracted. Daily data were converted to weekly averages. Details of incorporation of the data into the model are given in Additional file 1.
Metapopulation model for regional spread of C. burnetii
The metapopulation model, describing within-herd infection and demographic dynamics and between-herd transmission of C. burnetii, is made of three sub-models: an intra-herd dynamics model (“Intra-herd dynamics of C. burnetii” sub-section), an inter-herd model incorporating cattle trade (“Inter-herd transmission due to cattle trade” sub-section), and an inter-herd model incorporating airborne dispersion (“Inter-herd infection dynamics due to airborne dispersion” sub-section). The metapopulation model is a stochastic model in discrete time with one-week simulation time steps. Individual tracking of changes in infectious status and displacement between herds was performed for each animal in the metapopulation. It was restricted only to cows, since a previous study showed that nulliparous heifers and female calves were not observed to be infected [21]. Bulls and male calves were also excluded.
Intra-herd dynamics of C. burnetii
The intra-herd dynamic model is an adapted version of the model of Courcoul et al. [10], whose transition parameters between health statuses were estimated from a longitudinal observational study using Bayesian estimation methods [22, 23]. It tracks individual health statuses of cows and accounts for the heterogeneity in shedding routes and levels of bacterial shedding. Moreover, the population dynamics of the herd was also incorporated through probabilities for culling events and the explicit representation of cow lactation cycles.
After infection, cows of the herd undergo transitions between health statuses (Figure 2, with parameters defined in Table 1) [10]. These health statuses were defined according to the seropositivity and shedding characteristics: susceptible, non-shedder, sero-negative cows (S); infectious shedder, sero-negative cows (I−); shedder, with antibodies (I+) and permanently shedding in milk at higher levels (I+milk pers); carriers non-shedders, with antibodies (C+); and previously infected cows, without antibodies (C−). Shedding cows could shed the bacteria through milk, mucus/faeces, or through both routes at low, medium, or high levels of shedding (Qty), with probability distributions of shedding levels depending on the infection status. The quantities of the bacteria reaching the environment, shed by all the shedders in statuses I−, I+, and (I+milk pers), respectively, through all the shedding routes were denoted by ε1, ε2 and ε3. All the parameters related to the heterogeneity of shedding are presented in Table 2 [10].
Table 1.
Parameter | Definition | Value |
---|---|---|
m | Transition probability I − ⇒ S | 0.7 |
q | Transition probability I − ⇒ I + | 0.02 |
pIp | Proportion of cows going from I − to I + and becoming I milk pers | 0.5 |
r1 | Transition probability I − ⇒ C + | 0.2 |
r2 | Transition probability I milk pers ⇒ C + | 0.02 |
s | Transition probability C + ⇒ I + | 0.15 |
τ | Transition probability C + ⇒ C − | 0.0096 |
μ | Proportion of bacteria eliminated due to death and plume generation (can be written as ) | 0.2 |
p | Infection probability | 1−e −E |
ρ m/f | Proportion of bacteria shed through mucus/faeces filling the environment compartment | 0.28 |
ρ m | Proportion of bacteria shed through milk filling the environment compartment | 0.125ρ m/f |
Table 2.
Parameter | Definition | Value | |
---|---|---|---|
α | α 1, milk | Probability distribution of the shedding routes for the I − cows | 0.31 |
α 2, mucus/faeces | 0.62 | ||
α 3, milk + mucus/faeces | 0.07 | ||
β | β 1, milk | Probability distribution of the shedding routes for the I + cows after 4 weeks post-calvingss | 0.61 |
β 2, mucus/faeces | 0.33 | ||
β 3, milk + mucus/faeces | 0.06 | ||
β calv | β calv1, milk | Probability distribution of the shedding routes for the I + cows in the 4 first weeks post-calving | 0.14 |
β calv3, mucus/faeces | 0.5 | ||
β calv3, milk + mucus/faeces | 0.36 | ||
γ | γ 1, milk | Probability distribution of the shedding routes for the cows after 4 weeks post-calving | 0.83 |
γ 3, milk + mucus/faeces | 0.17 | ||
γ calv | γ calv1, milk | Probability distribution of the shedding routes for the cows in the 4 first weeks post-calving | 0.25 |
γ calv3, milk + mucus/faeces | 0.75 | ||
Q1 | Low level | Probability distribution of the shedding levels for all the I − and for the I + shedding in mucus/faeces after 4 weeks post-calving | 0.85 |
Mid-level | 0.15 | ||
High level | 0 | ||
Q2 | Low level | Probability distribution of the shedding levels for the I + shedding in milk after 4 weeks post-calving | 0.4 |
Mid-level | 0.5 | ||
High level | 0.1 | ||
Q3 | Low level | Probability distribution of the shedding levels for all the I + in the 4 first weeks post-calving | 0.25 |
Mid-level | 0.25 | ||
High level | 0.5 | ||
Q4 | Low level | Probability distribution of the shedding levels for the shedding in mucus/faeces after 4 weeks post-calving | 0.6 |
Mid-level | 0.4 | ||
High level | 0 | ||
Q5 | Low level | Probability distribution of the shedding levels for all the shedding in milk and for the in the 4 first weeks post-calving | 0.15 |
Mid-level | 0.6 | ||
High level | 0.25 |
The probability of transition from S to I−, i.e. the probability of a susceptible cow of herd i to acquire a C. burnetii infection at time t was defined as
1 |
In Equation 1, Ei(t) [number of bacteria/s] is the force of infection related to the bacterial contamination of the environment at time t and is equal to:
2 |
Furthermore, Ei(t) corresponds to the bacterial load at time t (expressed in infectious doses), times the contact rate between animals and the environment, times the probability that a contact of a susceptible animal with an environment contaminated by one infectious dose leads to a successful infection event. A similar formulation of the probability of infection has been proposed previously for aerosol infection of C. burnetii [24]. Equation 2, which is the main adaptation of the model of Courcoul et al. [10], allowed us to account for contributions to the force of infection from three different sources: bacteria shed by internal animals (Ei,internal); bacteria shed by external animals, introduced into the herd by purchase (Ei,external); and bacteria coming from the environment of all other neighbouring herds j, imported through airborne dispersion (Ei,j,dep). Cows born in the same herd or susceptible (S) at the time of purchase were called internal animals. Cows which were infected outside the herd and that were shedders () or carriers (C+) at the time of purchase were called external animals. The infection dynamics of the internal and external animals were assumed to be identical.
The loss of bacteria from the environment (μ) encompasses natural death (μdeath) and loss of bacteria that are transmitted airborne to the outdoor environment (μplumesource):
3 |
The complete system of equations describing the infection dynamics at herd level is provided in Additional file 1.
Inter-herd transmission due to cattle trade
When an infectious cow moves from one herd to another, it contributes to the spread of C. burnetii within the destination herd (i.e. to the term Ei,external in Equation 2 for herd i). All movements of cows between dairy cattle herds in the Finistère department were modelled according to observed trade data on the source and destination herds, the movement date, and the age of moved cows. The only information not present in the data was the animal health status. Hence, while modelling cattle trade, for each individual movement observed between May 2012 and May 2013, an animal in the same lactation year (parity) as the one recorded in the dataset was randomly chosen from the source (selling) herd to move to the destination herd. The probability of trading an infectious cow therefore was related to the proportion of infectious animals in the given lactation year in the source herd. Because of the relatively low time spent by cows in markets (less than 24 h) during trading and the lack of information about such events, it was assumed that there was no transmission between cows following any possible interaction between them in markets. Due to the lack of information about the prevalence outside the concerned study region, only movements of cows between the herds within the study region were considered.
Inter-herd infection dynamics due to airborne dispersion
In infected herds, part of the environmental bacterial contamination represented by E compartment (μplumesource), becomes airborne and thus is transmitted to the outdoor environment (Equation 3). The small cell variant (SCV) of C. burnetii is known to be resistant to various environmental conditions [25]. Plume transportation was modelled using a Gaussian dispersion equation which accounts for phenomena such as transportation, settling, and gravitation, presented in Ermak [26] and Stockie [27].
4 |
The concentration Ci,j,(x,y,z) is defined as the number of bacteria [m−3] reaching herd i from source herd j (where x, y are differences in respective coordinates of herds i and j on x-axis and y-axis, and z the height at which the plume is generated in source herd j).
Furthermore, the emission rate Qj [number of bacteria/s] = Ejμplumesource is the part of force of infection which becomes source for plume generation in source herd j; U [m/s] is the wind velocity; σy [m] and σz [m] are the standard deviations for dispersion coefficients, parameterised as and with ay, az, by, bz corresponding to the atmospheric stability class C (3-5 m/s wind velocity, slightly unstable environment); W0 [m/s] = W − 0.5Wset, where W [m/s] is the deposition velocity due to gravitation and Wset[m/s] is the settling velocity, fixed to with φ [kg/m3] the particle density, r [m] the particle radius, η [kg/m s] the dynamic viscosity of air, and g [m/s2] the gravitational acceleration; h [m] is the height of reception at destination herd; and Kz [m2/s] is the coefficient of eddy diffusivity set to . In the last term of Equation 4, erfc is the complementary error function (erfc (x) = 1 − erf(x)) resulting from the approximation of the solution of the partial differential equation of advection–diffusion. Parameters were taken from the standard model presented in Stockie [27]. Additional details on these dispersion related parameters are given in Table 3.
Table 3.
Parameter | Definition | Estimation | Unit |
---|---|---|---|
g | Gravitational acceleration | 9.8 | m s−2 |
z | Height of plume generation | 4 | m |
h | Height of plume reception | 4 | m |
η | Dynamic viscosity of air | 1.8 × 10−5 | kg m−1 s−1 |
φ | Density of particles | 1150 [42] | kg m−3 |
r | Radius of particle | 10−6 a | ma |
W | Deposition velocity | 0.01 [27] | m s−1 |
a y, a z | Guifford–Pasquill stability | 0.34, 0.27 [27] | m(1−b) |
b y, b z | Class “C” stability parameters | 0.82, 0.82 [27] |
a Approximated from [43].
Bacteria arriving from a neighbouring herd j through airborne transmission accumulate in compartment Ei,j,dep, given by Ei,j,dep = areaiW Ci,j,(x,y,z), where the area for each herd (areai) was approximated using average space recommendation for a cow and the number of cows in a given herd. W and Ci,j,(x,y,z) were presented in Equation 4.
Initial conditions and outputs
Initial conditions were simulated according to the distribution of intra-herd seroprevalence observed in May 2012 in the Finistère department (“Data” sub-section). For all the positive herds in May 2012, an intra-herd model was run, thereby neglecting between-herd contacts and starting from one initially infected cow. Each of these intra-herd models was run until the herd-specific simulated seroprevalence reached a value ranging in the interval of the expected mean ± 1 standard deviation of the herd-specific observed seroprevalence, as provided in Taurel et al. [28]. Once the initial conditions were obtained for each herd initially infected, the between-herd spread of C. burnetii by both trade and airborne dispersion was simulated over 1 year, to assess if the model can predict similar spread of C. burnetii as observed in May 2013.
The metapopulation model was used to predict the statuses in May 2013 of herds initially susceptible in May 2012 (where introduction of C. burnetii in herds was defined as the generation of the first infection among internal animals). Herds purchasing infectious animals previous to the generation of the first local infection were designated as being infected by cattle trade, the rest of the incident herds were attributed to airborne transmission. The probability of infection (PI) was also estimated for each incident herd, based on the proportion of runs it experienced with infection: PI = (number of runs with at least one local infection)/(total number of runs). Herds were predicted positive by the model if their predicted PI was higher than a threshold, which was calibrated according to the available data, as described in “Assessment of model predictions” sub-section. Moreover, for each incident herd, intra-herd seroprevalence, proportion of shedders (defined in Additional file 1, Eqs. 7 and 8), extinction rate (proportion of runs with no shedding and no seropositive cow at the end of the simulation among the runs where the herd was infected), and herd incubation period (time elapsed between exposure to the identified cause and generation of the first local infection) were also recorded as model outputs. Descriptive statistical measures (mean, median, standard deviation, and percentiles) of seroprevalence and proportion of shedders in incident herds were calculated over runs in which herds experienced an infection.
All the outputs of the study were generated after 100 iterations (which proved to suffice in terms of mean stabilisation) of the metapopulation model.
Assessment of model predictions
The accuracy of the metapopulation model in predicting the infection status in May 2013 for all of the initially susceptible herds as observed in May 2012 was assessed by receiver operating characteristics (ROC) analysis. A ROC analysis consists in evaluating the performance of a classifier, in terms of Sensitivity (Se) and Specificity (Sp), in detecting binary behaviour (here infected/non-infected) for different discrimination thresholds. For each initially susceptible herd, the simulated PI (our classifier) provided a prediction of the herd infection status after comparison to a threshold. This predicted status was compared against the herd observed status in 2013 (herd level analysis).
To assess possible improvements in prediction, we relaxed the spatial precision in the ROC analysis and compared the output for a neighbourhood around an expected incident herd (neighbourhood level analysis). The comparison was done for neighbourhood distances of multiple radii (1, 2, 3 or 4 km). Specificity (Sp) for the neighbourhood level analysis was considered as equal to that of herd level analysis. AUC (Area Under the Curve) was used to assess the model performance.
The optimum cut-off (threshold) values for PI to classify herds as positive or negative were selected based on three criteria: (i) equality of sensitivity (Se) and specificity (Sp), Se = Sp; (ii) maximum accuracy (Accmax), where Acc = (true positive herds + true negative herds)/(total population of herds), or, equivalently, Acc = Se × Prevalence + Sp × (1−Prevalence); and (iii) maximum Youden index (Jmax), where J = Se + Sp − 1 [29].
To identify regions with high risk of incidence, a spatial cluster analysis for predicted positive herds was done using a Poisson model (SatScan®) with a null hypothesis of expected number of cases in each area proportional to its population size, thus adjusting the model for cow density. Definition of a positive herd was based on the optimum PI cut-off suggested by the ROC analysis.
A preliminary sensitivity analysis was done to assess the robustness of the model predictions with respect to parameter variations. In a detailed sensitivity analysis conducted on the intra-herd model by Courcoul et al. [10], three significantly sensitive parameters were found: Q1, ρ, and µ. Along with these three parameters, we tested three additional parameters from the dispersion model (κ, r, W). The values chosen to be tested in the sensitivity analysis (parameter definition and values in Table 4) were those used in [10] for Q1, ρ, and µ. For κ, r, and W, the standard value was varied by fifty percent, in the limits of biological plausibility. Each parameter was varied independently of other parameters (univariate sensitivity analysis) and the effect of these variations was evaluated on three model outputs (the relative contribution of airborne transmission to new herd infections, the number of incident herds, and the proportion of shedders in incident herds).
Table 4.
Parameter | Definition | Standard value | Values tested in sensitivity analysis | |||
---|---|---|---|---|---|---|
Q1 | Probability distribution of the shedding levels of all the I − and for the I + shedding in mucus/faeces after 4 weeks post calving | Distribution I | Distribution II | Distribution III | Distribution IV | |
Low-level | 0.85 | 0.6 | 0.25 | 0.15 | ||
Mid-level | 0.15 | 0.4 | 0.25 | 0.6 | ||
High-level | 0.0 | 0 | 0.5 | 0.25 | ||
ρ | Proportion of bacteria shed through mucus and faeces filling the compartment | 0.28 | 0.05 | 0.15 | 0.35 | 0.5 |
µ | Elimination rate of C. burnetii from the herd environment | 0.2 | 0.1 | 0.5 | 0.8 | |
κ | Ratio between µ plume source. and µ | 0.5 | 0.25 | 0.75 | ||
r | Radius of a fomite particle | 1e−6 | 0.5e−6 | 1.5e−6 | ||
W | Deposition velocity due to gravitation | 0.01 | 0.005 | 0.015 |
Assessment of the relative impact of transmission routes on the intra-herd and regional spread of C. burnetii
We tested four scenarios to understand the role of cattle trade and airborne dispersion both independently and in association with one another: absence of inter-herd transmission (scenario A), transmission only by movement of animals (scenario B), airborne transmission only (scenario C), and both transmission routes (scenario D). Incidence dynamics at the herd level, the total number of incident herds, and the dynamics of shedder cows in incident herds were the outputs of interest. We further focused on scenario D and evaluated the relative roles of the two transmission pathways in introducing C. burnetii in herds. We used a Mann–Whitney U test to compare PI, extinction rate, and herd incubation period between herds infected solely by airborne transmission and herds infected solely by trade. A similar analysis was done on a subset of herds at risk of acquiring C. burnetii through both routes, i.e. those herds that purchased animals and were also exposed to C. burnetii due to airborne transmission.
Results
Incidence prediction and agreement with observed data
According to the epidemiological data, in May 2012, 69.3% (n = 1941) of the herds were found seropositive (referred hereafter as prevalent herds). Among the 858 initially negative herds, 826 were retested one year later in May 2013, and 306 were found positive (they represent the observed incident herds in the study). According to the model, out of 858 susceptible herds at the beginning of the simulation, 768 got infected at least once over the total number of runs. The PI predicted for incident herds showed spatial heterogeneity (Figure 3A). Most of incident herds had low values of PI. Out of 768 herds, 38.8% of herds had PI < 0.1, while only 1.5% of herds had PI ≥ 0.9 (Figure 3B).
The model had moderate agreement with data at herd level. It performed better for predictions at the neighbourhood level (Figure 4A). In the radius of 2, 3, 4 km, there were on average respectively 1.7, 3.8, and 6.6 initially susceptible neighbour herds around an expected incident herd in the Finistère department. The gain in the model predictive ability in terms of AUC with the increase in the neighbourhood radius was weighed against the loss in the accuracy of model predictions arising because of an increase in the number of susceptible herds the calculations rely on. This resulted in a subjective compromise where a neighbourhood of 3 km was retained for further analyses of model results.
Optimum cut-off values for PI were estimated based on three criteria, as described in the “Assessment of model predictions” sub-section and illustrated in Figure 4B, C. At herd level, the model performed better at PI cut-off = 0.11 for the first and third criteria (Se = Sp = 0.58, Jmax = 0.15), and at PI cut-off = 0.61 for the second one (Se = 0.1, Sp = 0.95, Accmax = 0.64). For a radius of 3 km, the optimal cut-off was found to be 0.21 based on the first criterion (Se = Sp = 0.75) 0.25 based on the second one (Se = 0.71, Sp = 0.80, Accmax = 0.76), and 0.15 according to the third one (Se = 0.86, Sp = 0.66). Details of the Se, Sp, Acc, J, predicted incidence, contribution of airborne transmission to the incidence, and the spatial distribution of incident herds at these cut-offs are given in Additional files 2 and 3.
We performed the subsequent cluster analysis using a cut-off value of 0.25 (i.e. herds were declared as positive if PI ≥ 0.25), which provided the best results with respect to the three criteria at the selected radius. According to the cluster analysis, herds predicted as positive by the model at the cut-off of 0.25 had seven non-overlapping statistical clusters: three in the north and four in the south of the Finistère department (Figure 5). A small cluster (cluster 1, Figure 5) in northern Finistère department had the highest relative risk of 7.7, when compared with herds outside the cluster.
Model outputs were sensitive to Q1, ρ, µ, and κ, whereas very little perturbations were induced by variations of particle size, r, and deposition velocity, W (Figure 6). The results of the sensitivity analysis suggested that, despite a considerable sensitivity of the model to the parameters tested (except for r), the relative contribution of airborne transmission in the simulated incidence remained higher than the contribution of cattle trade, regardless of the parameter values tested, except for some values of κ and µ for which this trend was reversed in the last 6 months of the simulation duration.
Contribution of transmission pathways to the regional spread
Airborne transmission was responsible for the infection of the majority of incident herds as predicted by the model at all the optimum PI cut-offs derived in the ROC analysis. The contribution to the total number of infections as a function of these cut-offs varied from 57 to 86% at the herd level, and from 75 to 83% with a radius of 3 km (see Additional file 2). The sensitivity analyses showed that airborne transmission contributed to more than 50 and 70% of the new herd infections in 88 and 63% of the tested situations, respectively (Figure 6).
Figure 7 illustrates the effect of airborne transmission and cow trade on the regional spread of C. burnetii. More incident herds were seen in scenarios comprising airborne transmission (C and D, at least five times more incident herds on average than in scenario B; Figure 7A, B). Further analysis of scenario D carried out in the second approach provided similar results for the predicted incidence. In all of the 100 iterations of the standard stochastic model, 92% of all the new herd infections were attributed to airborne transmission, while the rest (8%) was attributed to cattle trade. The incidence dynamics over the time period attributed to these two transmission routes when acting simultaneously exhibit close coherence with the incidence predicted in scenarios B and C, where each transmission route was considered separately (Figure 7B). Incidence attributed to airborne transmission (scenario C and deconvolution of scenario D) shows an initial rapid increase followed by a steady growth, while the incidence attributed to cattle trade was comparatively low and constant throughout the simulation period (scenario B and deconvolution of scenario D). The analysis performed on the subset of herds at risk from getting infected through both routes, with parameter values corresponding to the standard scenario, led to results consistent to those obtained for the whole population of initially susceptible herds. On average, the majority of the new herd infections were due to airborne transmission (65%).
Impact of transmission pathways on the intra-herd dynamics
The impact of presence and absence of a transmission route on the intra-herd infection dynamics was highlighted in the four scenarios. The scenario involving only trade (B) shows higher proportion of shedders (Figure 7C) and intra-herd seroprevalence (not shown) in incident herds, than scenarios involving airborne transmission only (C) or both transmission pathways (D). When both transmission routes were accounted for, herds infected due to airborne transmission showed significantly lower levels of shedding animals than those infected after purchasing an infectious cow (Figure 7C inset). Other representative parameters of the infection dynamics were also found statistically significantly different (p < 0.05, Figure 8). PI was higher in herds infected by cattle trade, while the extinction rate was higher in airborne infected herds. These latter also took significantly longer time to generate the first local infection after exposure to the respective cause than herds infected by cattle trade.
Variation in the intra-herd dynamics (proportion of shedders) followed similar trends when performed on the subset of herds exposed to both transmission routes as seen in the analysis done on all susceptible herds. Also, for all outputs considered (PI, time after infection and extinction rate), statistically significant difference in herds infected by airborne transmission and herds infected by cattle trade was found.
Discussion
Our findings showed that airborne transmission and movement of cows both affected the regional spread of C. burnetii, but with different capacities. On the one hand, airborne transmission had the ability to introduce C. burnetii in a large number of herds, but the generated outbreaks were generally predicted to be ephemeral and small. On the other hand, animal trade was predicted to result in only 8% of new infections; however, purchasing an infectious cow could instigate comparatively larger outbreaks. The differences in the impact of each transmission route on the intra-herd infection dynamics arose from the intrinsic nature of these transmission routes in spreading C. burnetii.
Regardless the route, the first generated local infection was always a cow with health status I− as shown in Figure 2. Such a seronegative shedding cow is a transient shedder, which can become susceptible again. Therefore, in herds in which cows were infected by airborne transmission, infection might go extinct if the transient first local infection does not shed enough to generate subsequent infections, which are essential for infection persistence. In herds introducing infectious cows by trade, the animal purchased could be either a transient shedder (I−) or a permanent shedder (I+ or Imilk pers). Hence, after the generation of the first local infection, there are at least two shedding cows in herds purchasing infectious animals, leading to potentially higher bacterial contamination and increasing the probability of intra-herd infection persistence.
Our results were consistent with those of a previous study [18] based on a statistical regression model. This study indicated that airborne transmission and cattle trade are both risk factors for the dairy cattle herds in the Finistère department. It also attributed higher proportion of infections to airborne transmission than to animal movements in areas with high cattle density. A cluster analysis performed in the same study for the 2012 seroprevalence in dairy herds showed a high-risk cluster in the north-western corner of the Finistère department [18]. According to our findings, predicted probabilities of herd infection in 2013 exhibit two high-risk clusters in the same area, known to have a high density in cattle.
The contribution of animal trade to livestock pathogen transmission is known to vary considerably. For Q fever, cattle trade seems to explain quite a low proportion of incidence compared to airborne transmission, at least in areas with a high cattle density and high prevalence. However, trade is known to play an important role in the regional spread of other pathogens, such as the foot-and-mouth disease virus (FMDV) and the bovine viral diarrhoea virus [30, 31]. For bovine tuberculosis—as here for Q fever, trade is correlated to a low number of infections [32] compared to other transmission routes.
While these studies focused on the regional contribution of transmission pathways, we also highlighted differences in intra-herd infection dynamics depending on these pathways. The simulated differences in the intensity of intra-herd outbreaks experienced by herds acquiring infection by cattle trade and by airborne transmission, and the capacities of these routes to affect infection-free herds provide valuable insights for risk assessment. Even if cattle trade does not seem to contribute largely to new infections, preventing the purchase of infected animals is still a relevant measure to limit infection spread at the intra-herd scale. In addition, new infections could be caused by airborne transmission from herds infected by import of infected livestock.
From the model perspective, it is the first time, to our knowledge, that a Gaussian dispersion model for infectious particles is coupled with an intra-herd infection dynamics model to describe the spread of an enzootic livestock disease. Gaussian dispersion models have been employed previously in the description of the spread of livestock-related viruses such as FMDV and the avian influenza virus [33, 34]. In another study, a dispersion model was used to quantify the possible risk of Q fever in humans from nearby infected sheep farms [35].
One of the main advantages of using mechanistic models is that they allow identifying the source of infection, and subsequently help implementing targeted intervention measures [36]. The mechanistic model presented here allowed identifying the cause of infection of susceptible herds based on the dominant contributory route, at the time of generation of the first local infection. Moreover, according to our investigations, the combined effect of the two processes (airborne transmission and animal trade) at a regional scale is additive and not synergistic, at least over a short period of time.
Performance measures of the model at the neighbourhood level can be interpreted as the model’s ability to predict an observed herd infection within a given area. The increase in the AUC for the comparisons done at different neighbourhood radii also indicates the model’s ability to capture the spatial nature of the dispersion. Assuming that the neighbourhood range and the accuracy of the model depend on the herd density and the clustering of the infection in the region studied, selection of a neighbourhood range becomes case-specific. The ROC analysis performed for different neighbourhoods is an effort to increase the sensitivity of the model without altering its specificity, with more weight given to the capacity of the model to identify positive herds. The sensitivity of the model hence increases with the decreasing spatial granularity.
Irrespective of the benefits, mechanistic models are generally difficult to fit to data. Spatio-temporal outcome of FMDV models, when tested against the 2001 outbreak data, have shown about 10–15% accuracy [37]. In the current Q fever model, higher accuracy of the model is probably due to the high prevalence and the enzootic nature of the infection in the study region. Models are generally used to simulate the overall spread of pathogens to produce expected epidemic curve, and are often difficult to be judged for their relevance, especially in the absence of detailed and accurate data. Since many models are increasingly depicting the spatial spread of pathogens in livestock in enzootic regions, more refined evaluation of their ability to produce spatial patterns in agreement with field observation needs to be performed. Analysis based on ROC spatial analysis, like the one used here, can be useful in understanding the complex spatial behaviours of such models.
Although we cannot deny the possible existence of interactions between the tested parameters with potential impact on model outputs, the univariate sensitivity analysis performed supports the relative robustness of model predictions at the elementary level. The main output of the model concerning the relative contributions of the transmission routes in the regional spread of C. burnetii showed moderate perturbations to parameter variations, especially when the plume was generated at rates high enough (allowing airborne transmission) compared to death rate of bacteria (parameter κ related to the ratio between these two rates). To reduce the uncertainty on these parameters and hence on their effect on the infection dynamics, more data collection is essential to estimate the bacterial quantities generally found in and leaving farm buildings. The possible effects of super shedders were indirectly assessed using sensitivity analysis of the model to Q1, which is the probability distribution of the shedding levels for all the I− and for the I+ shedding in mucus/faeces after four weeks post-calving. Two of the probability distributions tested (described in Table 4) assumed proportions of high shedders of 0.25 (distribution IV) and 0.5 (distribution III), whereas the reference scenario assumed no high shedders in these classes. It seems that in scenarios corresponding to distributions III and IV for Q1 the contribution of trade was diminished, but this needs to be confirmed in further refined analysis.
The model is expected to underestimate the spread of C. burnetii as we ignore beef herds in the study region, which can transmit C. burnetii to dairy cattle herds by airborne transmission, and also as we consider cattle trade within the concerned department only. Indeed, according to the analysis of a larger database over the period 2005–2009, 22% of all the concerned transactions of cows involving dairy herds located in the Finistère department corresponded to purchases from outside the department (personal communication: B. L. Dutta). However, no epidemiological information was available for these herds. Similarly, the impact of small ruminant flocks was also neglected as very few such flocks are present in the region. Accuracy of the model could be further improved if epidemiological data about beef herds and other livestock flocks in and around the region were available.
The time-varying nature of the network describing cattle trade, in particular the large variability in the trade relationships between herds from one year to the next (as described by Dutta et al. [38]), suggests that the transmission route due to trade could have a lager impact on the regional dynamics over a longer duration. Indeed, new susceptible target herds could be linked to the network of herds by enlarging the time window of the study. Similarly, the capacity of airborne transmission of the bacteria is relatively unhindered and all herds get exposed in a very densely populated region without any geographical barriers such as in the Finistère. Hence, the regional spread and corresponding control strategies predominantly depend on the prevalence of infection, characteristics of the cattle trade network, and cattle density. On the backdrop of these, the model presented here can become a useful tool to control the regional spread of C. burnetii by assessing the impact of relevant interventions such as vaccination of cows [39] and testing of cows for the presence of C. burnetii before trading.
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
Conceptualisation of the mathematical model, interpretation of simulation outputs, writing and critical review of the manuscript were performed by PP, TH, PE, FB and EV. Computational experiments were designed by PP, TH, PE, and EV, and performed by PP. Inputs in the biology and epidemiology of Q fever were provided by PP and FB. All authors read and approved the final manuscript.
Acknowledgements
This work was carried out with the financial support of the French Research Agency (ANR), Program Investments for the Future; project ANR-10-BINF-07 (MIHMES), by the European Union through the European fund for the regional development (FEDER) of the Pays-de-la-Loire, and by Oniris. Data for the cattle trade was provided by the Groupements de Défense Sanitaire de Bretagne, France. We thank the reviewers for their careful reading and their helpful comments.
Abbreviations
- AUC
area under the curve
- BTM
bulk tank milk
- ELISA
enzyme-linked immunosorbent assay
- FMD
foot and mouth disease
- ROC
receiver operating characteristic
Additional files
Footnotes
Thierry Hoch and Pauline Ezanno contributed equally to this work
Contributor Information
Pranav Pandit, Email: pranav.pandit@oniris-nantes.fr.
Thierry Hoch, Email: thierry.hoch@oniris-nantes.fr.
Pauline Ezanno, Email: pauline.ezanno@oniris-nantes.fr.
François Beaudeau, Email: francois.beaudeau@oniris-nantes.fr.
Elisabeta Vergu, Email: elisabeta.vergu@jouy.inra.fr.
References
- 1.Jones KE, Patel NG, Levy MA, Storeygard A, Balk D, Gittleman JL, Daszak P. Global trends in emerging infectious diseases. Nature. 2008;451:990–993. doi: 10.1038/nature06536. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Georgiev M, Afonso A, Neubauer H, Needham H, Thiery R, Rodolakis A, Roest H, Stark K, Stegeman J, Vellema P, van der Hoek W, More S. Q fever in humans and farm animals in four European countries, 1982 to 2010. Euro Surveill. 2013;18:20407. [PubMed] [Google Scholar]
- 3.Schimmer B, Morroy G, Dijkstra F, Schneeberger PM, Weers-Pothoff G, Timen A, Wijkmans C, van der Hoek W. Large ongoing Q fever outbreak in the south of The Netherlands, 2008. Euro Surveill. 2008;13:18939. [PubMed] [Google Scholar]
- 4.Roest HI, Tilburg JJ, van der Hoek W, Vellema P, van Zijderveld FG, Klaassen CH, Raoult D. The Q fever epidemic in The Netherlands: history, onset, response and reflection. Epidemiol Infect. 2011;139:1–12. doi: 10.1017/S0950268810002268. [DOI] [PubMed] [Google Scholar]
- 5.Hässig M, Lubsen J. Relationship between abortions and seroprevalences to selected infectious agents in dairy cows. Zentralbl Veterinarmed B. 1998;45:435–441. doi: 10.1111/j.1439-0450.1998.tb00813.x. [DOI] [PubMed] [Google Scholar]
- 6.Arricau-Bouvery N, Rodolakis A. Is Q fever an emerging or re-emerging zoonosis? Vet Res. 2005;36:327–349. doi: 10.1051/vetres:2005010. [DOI] [PubMed] [Google Scholar]
- 7.Guatteo R, Seegers H, Taurel AF, Joly A, Beaudeau F. Prevalence of Coxiella burnetii infection in domestic ruminants: a critical review. Vet Microbiol. 2011;149:1–16. doi: 10.1016/j.vetmic.2010.10.007. [DOI] [PubMed] [Google Scholar]
- 8.Murphy FA. Emerging zoonoses. Emerg Infect Dis. 1998;4:429–435. doi: 10.3201/eid0403.980324. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Guatteo R, Beaudeau F, Joly A, Seegers H. Coxiella burnetii shedding by dairy cows. Vet Res. 2007;38:849–860. doi: 10.1051/vetres:2007038. [DOI] [PubMed] [Google Scholar]
- 10.Courcoul A, Monod H, Nielen M, Klinkenberg D, Hogerwerf L, Beaudeau F, Vergu E. Modelling the effect of heterogeneity of shedding on the within herd Coxiella burnetii spread and identification of key parameters by sensitivity analysis. J Theor Biol. 2011;284:130–141. doi: 10.1016/j.jtbi.2011.06.017. [DOI] [PubMed] [Google Scholar]
- 11.Tissot-Dupont H, Amadei MA, Nezri M, Raoult D. Wind in November, Q fever in December. Emerg Infect Dis. 2004;10:1264–1269. doi: 10.3201/eid1007.030724. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Tissot-Dupont H, Torres S, Nezri M, Raoult D. Hyperendemic focus of Q fever related to sheep and wind. Am J Epidemiol. 1999;150:67–74. doi: 10.1093/oxfordjournals.aje.a009920. [DOI] [PubMed] [Google Scholar]
- 13.Hawker JI, Ayres JG, Blair I, Evans MR, Smith DL, Smith EG, Burge PS, Carpenter MJ, Caul EO, Coupland B, Desselberger U, Farrell ID, Saunders PJ, Wood MJ. A large outbreak of Q fever in the West Midlands: windborne spread into a metropolitan area? Commun Dis Public Health. 1998;1:180–187. [PubMed] [Google Scholar]
- 14.EFSA Panel on Animal Health and Welfare (AHAW) Scientific opinion on Q fever. EFSA J. 2010;8:114. [Google Scholar]
- 15.Angelakis E, Raoult D. Q Fever. Vet Microbiol. 2010;140:297–309. doi: 10.1016/j.vetmic.2009.07.016. [DOI] [PubMed] [Google Scholar]
- 16.Ladbury GA, Van Leuken JP, Swart A, Vellema P, Schimmer B, Ter Schegget R, Van der Hoek W. Integrating interdisciplinary methodologies for One Health: goat farm re-implicated as the probable source of an urban Q fever outbreak, the Netherlands, 2009. BMC Infect Dis. 2015;15:372. doi: 10.1186/s12879-015-1083-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.van Leuken JP, van de Kassteele J, Sauter FJ, van der Hoek W, Heederik D, Havelaar AH, Swart AN. Improved correlation of human Q fever incidence to modelled C. burnetii concentrations by means of an atmospheric dispersion model. Int J Health Geogr. 2015;14:14. doi: 10.1186/s12942-015-0003-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Nusinovici S, Hoch T, Widgren S, Joly A, Lindberg A, Beaudeau F. Relative contributions of neighbourhood and animal movements to Coxiella burnetii infection in dairy cattle herds. Geospat Health. 2014;8:471–477. doi: 10.4081/gh.2014.36. [DOI] [PubMed] [Google Scholar]
- 19.Nusinovici S, Frössling J, Widgren S, Beaudeau F, Lindberg A. Q fever infection in dairy cattle herds: increased risk with high wind speed and low precipitation. Epidemiol Infect. 2015;143:3316–3326. doi: 10.1017/S0950268814003926. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.European Centre for Medium-Range Weather Forecasts www.ecmwf.int. Accessed Aug 2013
- 21.Guatteo R, Seegers H, Joly A, Beaudeau F. Prevention of Coxiella burnetii shedding in infected dairy herds using a phase I C. burnetii inactivated vaccine. Vaccine. 2008;26:4320–4328. doi: 10.1016/j.vaccine.2008.06.023. [DOI] [PubMed] [Google Scholar]
- 22.Guatteo R, Beaudeau F, Joly A, Seegers H. Performances of an ELISA applied to serum and milk for the detection of antibodies to Coxiella burnetii in dairy cattle. Rev Med Vet. 2007;158:250–252. [Google Scholar]
- 23.Courcoul A, Vergu E, Denis JB, Beaudeau F. Spread of Q fever within dairy cattle herds: key parameters inferred using a Bayesian approach. Proc Biol Sci. 2010;277:2857–2865. doi: 10.1098/rspb.2010.0575. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Jones RM, Nicas M, Hubbard AE, Reingold AL. The infectious dose of Coxiella burnetii (Q fever) Appl Biosaf. 2006;11:32–41. doi: 10.1177/153567600601100106. [DOI] [Google Scholar]
- 25.McCaul TF, Williams JC. Developmental cycle of Coxiella burnetii structure and morphogenesis of vegetative and sporogenic differentiations. J Bacteriol. 1981;147:1063–1076. doi: 10.1128/jb.147.3.1063-1076.1981. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Ermak DL. An analytical model for air pollutant transport and deposition from a point source. Atmos Environ. 1967;11:231–237. doi: 10.1016/0004-6981(77)90140-8. [DOI] [Google Scholar]
- 27.Stockie JM. The mathematics of atmospheric dispersion modeling. Siam Rev. 2011;53:349–372. doi: 10.1137/10080991X. [DOI] [Google Scholar]
- 28.Taurel AF, Guatteo R, Joly A, Beaudeau F. Relationship between the level of antibodies in bulk tank milk and the within-herd seroprevalence of Coxiella burnetii in cows. Epidemiol Infect. 2012;140:1710–1713. doi: 10.1017/S0950268811002275. [DOI] [PubMed] [Google Scholar]
- 29.Greiner M, Pfeiffer D, Smith RD. Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. Prev Vet Med. 2000;45:23–41. doi: 10.1016/S0167-5877(00)00115-X. [DOI] [PubMed] [Google Scholar]
- 30.Green DM, Kiss IZ, Kao RR. Modelling the initial spread of foot-and-mouth disease through animal movements. Proc Biol Sci. 2006;273:2729–2735. doi: 10.1098/rspb.2006.3648. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Courcoul A, Ezanno P. Modelling the spread of Bovine Viral Diarrhoea Virus (BVDV) in a managed metapopulation of cattle herds. Vet Microbiol. 2010;142:119–128. doi: 10.1016/j.vetmic.2009.09.052. [DOI] [PubMed] [Google Scholar]
- 32.Green DM, Kiss IZ, Mitchell AP, Kao RR. Estimates for local and movement-based transmission of bovine tuberculosis in British cattle. Proc Biol Sci. 2008;275:1001–1005. doi: 10.1098/rspb.2007.1601. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Gloster J, Champion HJ, Mansley LM, Romero P, Brough T, Ramirez A. The 2001 epidemic of foot-and-mouth disease in the United Kingdom: epidemiological and meteorological case studies. Vet Rec. 2005;156:793–803. doi: 10.1136/vr.156.25.793. [DOI] [PubMed] [Google Scholar]
- 34.Ssematimba A, Hagenaars TJ, de Jong MC. Modelling the wind-borne spread of highly pathogenic avian influenza virus between farms. PLoS One. 2012;7:e31114. doi: 10.1371/journal.pone.0031114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Wallensten A, Moore P, Webster H, Johnson C, van der Burgt G, Pritchard G, Ellis-Iversen J, Oliver I. Q fever outbreak in Cheltenham, United Kingdom, in 2007 and the use of dispersion modelling to investigate the possibility of airborne spread. Euro Surveill. 2010;15:19521. [PubMed] [Google Scholar]
- 36.Brooks-Pollock E, Roberts GO, Keeling MJ. A dynamic model of bovine tuberculosis spread and control in Great Britain. Nature. 2014;511:228–231. doi: 10.1038/nature13529. [DOI] [PubMed] [Google Scholar]
- 37.Tildesley MJ, Deardon R, Savill NJ, Bessell PR, Brooks SP, Woolhouse ME, Grenfell BT, Keeling MJ. Accuracy of models for the 2001 foot-and-mouth epidemic. Proc Biol Sci. 2008;275:1459–1468. doi: 10.1098/rspb.2008.0006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Dutta BL, Ezanno P, Vergu E. Characteristics of the spatio-temporal network of cattle movements in France over a 5-year period. Prev Vet Med. 2014;117:79–94. doi: 10.1016/j.prevetmed.2014.09.005. [DOI] [PubMed] [Google Scholar]
- 39.Taurel AF, Guatteo R, Joly A, Beaudeau F. Effectiveness of vaccination and antibiotics to control Coxiella burnetii shedding around calving in dairy cows. Vet Microbiol. 2012;159:432–437. doi: 10.1016/j.vetmic.2012.04.027. [DOI] [PubMed] [Google Scholar]
- 40.World Health Organization. Infection prevention and control of epidemic-and pandemic-prone acute respiratory diseases in health care. WHO interim guidelines; 2007 [PubMed]
- 41.Schimmer B, Ter Schegget R, Wegdam M, Züchner L, de Bruin A, Schneeberger PM, Veenstra T, Vellema P, van der Hoek W. The use of a geographic information system to identify a dairy goat farm as the most likely source of an urban Q-fever outbreak. BMC Infect Dis. 2010;10:69. doi: 10.1186/1471-2334-10-69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Godin M, Bryan AK, Burg TP, Babcock K, Manalis SR. Measuring the mass, density, and size of particles and cells using a suspended microchannel resonator. Appl Phys Lett. 2007;91:123121. doi: 10.1063/1.2789694. [DOI] [Google Scholar]
- 43.Clean Air Solutions Database www.camfilfarr.com. Accessed Aug 2013