Abstract
A high-throughput TaqMan PCR assay for detection of bovine paratuberculosis was evaluated by using fecal samples from 1,808 dairy cattle in seven naturally infected herds and 347 dairy cattle in seven herds considered free of paratuberculosis. Fecal, blood, and milk samples were submitted to laboratories where the PCR-based assay, three different fecal culture procedures for Mycobacterium avium subsp. paratuberculosis (centrifugation, sedimentation, and the BACTEC filter concentration method), two serologic enzyme-linked immunosorbent assays (ELISAs), and one milk ELISA were performed. Results from testing of dairy cattle in herds free of M. avium subsp. paratuberculosis showed that the PCR assay's specificity was 99.7%. Twenty-three percent of the dairy cows that were fecal culture positive by at least one of the three methods were positive by the PCR assay. By Bayesian non-“gold standard” analysis methods, the TaqMan PCR assay had a higher specificity than the serum ELISAs (99.3%; 95% confidence interval [CI] = 98.6 to 99.7%) and a test sensitivity similar to that of the serum ELISAs (29%; 95% CI = 24 to 35%). By classical methods, the estimated relative sensitivity of the fecal PCR assay was 4% for light and moderate fecal shedders (compared to 12 to 13% for the ELISAs) and 76% for heavy fecal shedders (compared to 67% for the milk ELISA). The PCR assay has higher sensitivity for detection of heavy fecal shedders than the evaluated milk ELISA but lower sensitivity than a serum or milk ELISA for detection of light and moderate fecal shedders. This assay can be used as a quick test for detection of cattle with heavy fecal shedding, those cattle with the highest risk of transmitting infection to susceptible cattle.
Johne's disease (JD), also called paratuberculosis, is one of the most economically important diseases of dairy cattle, costing over $250 per cow in inventory per year in highly infected herds (15). This disease causes enteritis, weight loss, reduced milk production, and premature culling in dairy cattle and other ruminant species. Transmission occurs primarily through the fecal-oral route, and most herds are infected through introduction of subclinically infected cattle. Results from a 1996 USDA study showed that an estimated 20 to 40% of dairy herds are infected with paratuberculosis, depending upon herd size, by a herd-testing method designed to detect herds with 10% seroprevalence with 90% confidence (20), with annual losses in U.S. dairy cattle herds exceeding $220 million (15). Because of ongoing expansion of dairy herds and widespread movement of cattle between herds, paratuberculosis transmission to uninfected herds is likely to continue. Additionally, concern has arisen that Mycobacterium avium subsp. paratuberculosis may be a cause of Crohn's disease in humans. The importance of controlling this disease has been recognized through a recent National Research Council report (1) yet will be difficult to achieve. Treatment of infected cattle producing dairy products for human consumption is not cost-effective, and vaccination is not widely used.
Diagnosis of M. avium subsp. paratuberculosis infection is challenging because of the pathogen's slow growth and the lack of diagnostic tests sensitive enough to detect most subclinically infected cattle, many of which intermittently shed the pathogen, thus serving as sources of infection of susceptible cattle. Detection of the pathogen itself is the most definitive method of diagnosis since the pathogen can often be detected during both subclinical and clinical stages of the disease, but the typical method of pathogen detection (bacterial culture of feces) requires up to 16 weeks of incubation and is labor-intensive. Contamination of cultures is an added problem because of the frequent inability of current decontamination protocols to inactivate all of the nonmycobacterial microflora in feces, resulting in contamination of some cultures during the lengthy incubation period. These issues have led to the widespread use of diagnostic methods to detect the host immune response to M. avium subsp. paratuberculosis. Available serologic assays, however, are problematic as well, both in detecting infected cattle and in misclassifying uninfected cattle (23). Because no rapid diagnostic test to detect most subclinically infected cattle prior to fecal shedding is currently available, test-and-cull strategies for control of JD are not, by themselves, cost-effective (12) and cattle producers must implement lengthy (up to 10 years) herd control programs. Currently needed are high-volume diagnostic tests suitable for detection of this pathogen in dairy and beef herds to facilitate efficient operation of state and national control programs, including animal movement controls. As new diagnostic tests and testing methods become available, rational design of herd “certification” programs for noninfected herds and paratuberculosis control programs for M. avium subsp. paratuberculosis-infected herds require precise, objective estimation of the sensitivity and specificity of available diagnostic tests to define which tests are most cost-effective for use in these programs (5, 6).
Cattle shed M. avium subsp. paratuberculosis in feces at various levels, depending upon the stage of disease of individual animals (14). Quantification of fecal shedding is routinely performed by certain laboratories, especially those using Herrold's egg yolk (HEY) medium, and animals are commonly categorized into levels (light, moderate, and heavy fecal shedding) corresponding to the number of colonies observed per tube. This quantification provides an estimate of the risk of transmission from cattle at various stages of clinical disease through the fecal-oral route. In addition, this information helps to estimate the risk of transmission through other routes (milk, colostrum, and placenta) because cattle at later stages of infection are more likely to be infectious to susceptible cattle than are cattle at earlier stages. Rapid identification of these high-risk cattle enables management of cattle by risk category to reduce transmission, thereby contributing to overall JD control.
High-throughput PCR tests have the potential to provide rapid (less than 1 week) detection of M. avium subsp. paratuberculosis at a cost comparable to or less than that of conventional culture. Estimation of the sensitivity and specificity of these assays is necessary, however, before they are implemented routinely for JD diagnosis. The objective of this study was to evaluate the validity of a TaqMan-based PCR assay compared to those of other available assays for detection of M. avium subsp. paratuberculosis in infected and uninfected dairy cattle.
MATERIALS AND METHODS
Development of PCR diagnostic assay.
A previously identified target gene (MAV2, an insertion sequence from M. avium subsp. paratuberculosis) (17) was systematically analyzed for optimal oligonucleotide primer and TaqMan probe sequences by computational methods by ABI Primer Express software (Foster City, CA) and tested for uniqueness by BLAST (Basic Local Alignment Search Tool) analysis against all of the identified genes deposited in GenBank (24). M. avium subsp. paratuberculosis and other control microorganisms were identified and cultured at the Minnesota Veterinary Diagnostic Laboratory (MVDL) for use as positive and negative controls. DNAs were extracted from cultured M. avium subsp. paratuberculosis and negative control microorganisms (M. avium subsp. avium, M. terrae complex, M. avium-M. intracellulare-M. scrofulaceum, and M. avium complex). The optimal conditions for amplification and detection of the M. avium subsp. paratuberculosis ISMAV2 gene were refined. The primers ISMav2 Forward (5′-GATGAGTGGGTCGAGGACTACAA; 40 mM) and ISMav2 Reverse (5′-CCGTTGAGCCGGTGTGAT; 40 mM) were used to amplify the target gene from 5 μl of template DNA in the presence of a TaqMan fluorescent probe (6-FAM-CCAAGCCCTAAAGAT-MGB; 5 mM; ABI, Foster City, CA). The MGB (minor groove binder) probe was utilized to increase the melting temperature of the probe, which allows clearer differentiation between positive and negative diagnostic samples. The cycling conditions for amplification and detection were 1 cycle of 15 min at 95°C, 50 cycles of 94°C for 15 s, followed by 1 min at 57°C, and then holding at 4°C. Extraction of 1 g of fecal material was completed with the QIAamp DNA Stool Mini Kit (QIAGEN) and supplemented with bacterial lysis (FastPrep System; QBiogene, MP Biomedicals). The PCR kit used was the TaqMan Universal PCR Master Mix (Applied Biosystems). M. avium subsp. paratuberculosis-negative fecal matter spiked with selected agents known to be present in uninfected herds and with M. avium subsp. paratuberculosis was used to confirm specificity. The MAV2 TaqMan PCR test was then repeated with spiked feces in tandem with the existing experimental Johne's IS900 TaqMan PCR test based on the detection of a known insertion sequence (IS900).
Two types of controls were used for the fecal PCR assay. Extraction controls were tested once per extraction. For negative extraction controls, DNA was extracted from fecal samples from cattle from dairy herds known to be uninfected (level 4 of the Voluntary Johne's Disease Test Negative Program for Cattle) and tested with the MAV2 TaqMan PCR assay. Positive extraction controls were created by extracting DNA from fecal samples from cattle known to be uninfected that was then spiked with M. avium subsp. paratuberculosis and tested with the MAV2 TaqMan PCR assay. In the MAV2 TaqMan PCR assay, positive template controls consisted of dilutions of M. avium subsp. paratuberculosis DNA (previously extracted), with two positive template controls per plate. Eight no-template controls (NTC) consisting of nuclease-free water were tested per test plate. To determine the threshold above which diagnostic samples were considered positive, the high and low NTC values were first deleted and the mean of the remaining six values was determined for use in analyses described below.
The reactions in the plates were preread at 518 nm (6-carboxyfluorescein [6-FAM]). After the reactions were analyzed by PCR as outlined above, the reactions were postread at the same wavelength. ABI 7000 System Detector Software normalized the reporter dye (6-FAM) and calculated Rn, the fluorescence emission intensity of the reporter dye divided by the fluorescence emission intensity of the passive reference dye. The degree of fluorescence due to probe hydrolysis (interpreted as the degree of amplification) was determined by calculating the delta Rn, the difference between the Rn value after the PCR took place and the Rn value before the PCR for each sample. The cut point was calculated from the following equation: 6 × (standard deviation of the NTC × t) + average NTC value. The value t (5.894) was provided by ABI. The Johne's ISMAV2 TaqMan PCR assay detection limit was 7.5 × 103 CFU/ml of isolated M. avium subsp. paratuberculosis, estimated at 7.5 × 103 CFU/g of feces.
Sample collection for validation of PCR assay.
The sensitivity and specificity of the PCR test for detection of M. avium subsp. paratuberculosis were estimated by using fecal samples collected from dairy cattle in U.S. dairy herds and sampling methods previously described by the study investigators (7). To estimate test specificity, we used fecal samples from dairy herds known to be free of paratuberculosis. The study herds included seven dairy herds at level 4 of the Voluntary Johne's Disease Test Negative Program for Cattle (n = 347 cows). Fecal samples from each cow were tested by three bacterial culture methods to provide further evidence of lack of infection. To estimate test sensitivity, we collected fecal samples from 1,808 cattle in seven dairy herds known to be infected. Criteria for herd selection included an M. avium subsp. paratuberculosis seroprevalence of >10% and no regular testing and culling for JD, to provide a natural spectrum of infected cattle in a study population not artificially influenced by prior culling of test-positive cattle.
From each cow that had calved at least once within the study herds, fecal, blood, and milk samples were collected simultaneously, labeled, and transported with refrigeration for processing. Fecal samples were submitted fresh, within 48 h of collection, to three different laboratories for laboratory testing, including the MVDL, the University of Wisconsin School of Veterinary Medicine, and the University of Pennsylvania. The MVDL performed conventional bacterial culture by the HEY agar sedimentation method (21) and performed the fecal PCR assays. The University of Wisconsin School of Veterinary Medicine cultured fecal samples by the BACTEC filter concentration method (BACTEC) (4), and the University of Pennsylvania performed M. avium subsp. paratuberculosis culture by the HEY-centrifugation technique (CENT) (9, 22, 23). Blood samples were centrifuged, and sera were harvested to perform ELISAs at the University of Wisconsin Johne's Testing Center with two different kits for serum antibody detection (ELISA A [IDEXX Laboratories, Inc., Westbrook, ME] and ELISA B [CSL/Biocor, Omaha, NE]). Milk samples were refrigerated and sent to a testing laboratory to perform a milk ELISA (ELISA E [Antel Biosystems, Inc., Lansing, MI]). All antibody assays were performed by each laboratory according to the manufacturers' instructions and interpreted as prescribed.
Classical analysis.
PCR assay specificity was defined as the percentage of samples yielding a negative PCR assay result among the M. avium subsp. paratuberculosis-free fecal samples from noninfected herds. PCR assay relative sensitivity was estimated (with 95% confidence intervals [CIs]) within the infected cattle population by comparing fecal PCR results to the M. avium subsp. paratuberculosis status of each sample defined by all three culture methods collectively. Differences in relative specificity and sensitivity between the PCR assay and the ELISAs were evaluated with McNemar's tests of association. Because of the variability in fecal culture results among laboratories and culture methods, we defined a fecal sample as positive for M. avium subsp. paratuberculosis if at least one of three laboratories performing a fecal culture procedure designated the sample positive.
The relative sensitivity of the PCR assay was also estimated by M. avium subsp. paratuberculosis fecal shedding level by comparing the mean M. avium subsp. paratuberculosis culture score of each fecal sample to the PCR assay result. Each laboratory using solid medium ranked the number of M. avium subsp. paratuberculosis bacteria recovered as 1+ (fewer than 10 colonies per tube), 2+ (mean of 10 to 49 colonies per tube), 3+ (mean of 50 to 99 colonies per tube), or 4+ (>100 colonies per tube), considering all of the culture tubes inoculated. The laboratory using liquid medium also developed a comparable ranking system (1+, 2+, 3+, and 4+) for test results by categorization of time to detection. A composite M. avium subsp. paratuberculosis score based on reports from the three independent laboratories was calculated from the arithmetic mean of scores. PCR test results were compared to results of fecal culture and serum and milk serologic assays. Standard errors (SE) for CI estimation were calculated with the formula SE = pq/n, where p is the proportion of samples test negative, q is the proportion of samples not test negative, and n is the sample size. We evaluated assay differences in relative sensitivity between fecal shedding levels with McNemar's test of association after collapsing data into categories based on the fecal culture shedding levels described above (no shedding, light-to-moderate shedding [1+ to 2+], and heavy shedding [3+ to 4+]).
Bayesian analysis.
The true sensitivity and specificity of the PCR assay, CENT fecal culture, serum ELISA A, and serum ELISA B were estimated by the Bayesian method. The Bayesian method can be used to estimate the accuracy of diagnostic tests in the absence of a “gold standard.” The method takes into account the uncertainty in the estimated sensitivities and specificities of the tests and allows prior information or expert knowledge to be incorporated into the analysis. Moreover, the parameter estimate based on Bayesian analysis has a probability distribution which allows direct probability interpretation (13). The analysis by the Bayesian method involves three main components: likelihood function L(y|θ), prior distribution g(θ), and posterior distribution f(θ|y). These three components are combined through Bayes' rule, f(θ|y) ∝ L(y|θ) × g(θ), where ∝ denotes proportionality (3). In the present study, the likelihood function was derived from the test results from the seven infected dairy herds, the prior distributions presented prior knowledge of the sensitivity and specificity of each testing method, and the posterior distributions combined all information about the parameters of interest (sensitivity and specificity) from the likelihood function and the prior distributions. Then, the estimation of the parameters of interest from the posterior distributions was carried out with the Gibbs sampler, an iterative algorithm that constructs a Markov chain and permits empirical estimation of posterior distributions (3).
In the present study, we used a Bayesian model for estimation of the sensitivities and specificities of four tests of multiple populations, which was modified from a model for estimation of the validity of two correlated tests of multiple populations as described elsewhere (2). Our model accounted for the possible effect of conditional dependence between two tests that measured similar biological processes by including sensitivity covariance (Covse) and specificity covariance (Covsp) for bacterial culture and fecal PCR assay and for the two serum assays in the model. The magnitudes of Covse and Covsp are affected by the magnitudes of the test sensitivities and test specificities, respectively, and their limits were defined previously (10).
The prior information about test sensitivities and specificities was provided by a consensus of five experts selected by USDA-APHIS for development of optimal testing strategies for control of JD in cattle (Michael Collins, Ian Gardner, Franklyn Garry, Allen Roussel, and Scott Wells). The experts provided the most likely value and either the lowest or the highest possible value for all parameters in the model with 95% confidence. Uncertainty about the prior information was represented by use of beta (α, β) distributions, where the values of α and β determine the shape of the distribution. In this study, the prior beta distributions were assessed by use of software called Betabuster (version 1; downloadable at http://www.epi.ucdavis.edu/diagnostictests/). Elicitations of prior information for all parameters in the models and the corresponding beta distributions are presented in Table 1.
TABLE 1.
Parameter and assay | Prior distribution estimate
|
Posterior distribution estimate
|
||||
---|---|---|---|---|---|---|
Mode | ULa | LLb | Beta | Median | 95% PI | |
Sensitivity | ||||||
Fecal PCR | 0.30 | 0.50 | 6.28, 13.32 | 0.29 | 0.24-0.35 | |
CENT | 0.60 | 0.80 | 7.04, 5.03 | 0.75 | 0.66-0.83 | |
ELISA A | 0.30 | 0.50 | 6.28, 13.32 | 0.27 | 0.23-0.32 | |
ELISA B | 0.30 | 0.50 | 6.28, 13.32 | 0.26 | 0.22-0.31 | |
Specificity | ||||||
Fecal PCR | 0.995 | 0.990 | 1,137.51, 6.71 | 0.993 | 0.986-0.997 | |
CENT | 0.999 | 0.995 | 919.87, 1.91 | 0.998 | 0.994-0.999 | |
ELISA A | 0.960 | 0.940 | 384.13, 16.96 | 0.949 | 0.938-0.960 | |
ELISA B | 0.990 | 0.970 | 212.12, 3.13 | 0.980 | 0.971-0.987 |
UL (upper limit), value considered by the experts (with 95% confidence) to be the highest possible value for that variable.
LL (lower limit), value considered by the experts (with 95% confidence) to be the lowest possible value for that variable.
All Bayesian analyses were performed with WinBUGS (1996 to 2001, version 1.4, Imperial College and MRC, United Kingdom, available at www.mrc-bsu.cam.ac.uk/bugs). Model convergence was assessed through visual examination of trace plots, by assessment of Monte Carlo error, and by running multiple chains from dispersed starting values (11). We generated two parallel runs of 50,000 iterations of each model, and the first 10,000 were discarded as the burn-in period. Posterior inferences were based on summaries of the final 40,000 iterations and are presented as a median and a 95% probability interval (PI; percentiles 2.5 and 97.5) of each parameter estimate. In addition to the estimation of test sensitivities and specificities, the probability that the differences in sensitivity or specificity between the PCR assay and the other tests (CENT, ELISA A, and ELISA B) were significant was assessed with the step function in WinBUGS. If the probability was <0.05, we concluded that the sensitivity (or specificity) of the PCR assay was significantly lower than that of the compared test. On the other hand, if the probability was >0.95, we concluded that the sensitivity (or specificity) of the PCR assay was significantly higher than that of the compared test. If the value fell between 0.05 and 0.95, no significant difference between the test sensitivities (or specificities) could be concluded.
RESULTS
Evaluation of extraction control data showed that all 33 positive extraction controls were positive at 1 to 7 standard deviations (SD) above the mean negative template control value. All negative extraction controls were negative with a cut point of 6 SD above the mean negative template control value. At 1 SD above the mean negative template control value on each plate, 36% (12/33) of the plates were positive, 12% (4/33) were positive at 2 SD, 6% (2/33) were positive at 3 SD, and 3% (1/33) were positive at 4 and 5 SD.
With samples from noninfected herds, the PCR test specificity varied with the cut point used. At a cut point of 1 SD above the mean negative template control, the test specificity was 48.4% (95% CI = 43.2 to 53.7%). At cut points of 2, 3, 4, 5, and 6 SD above the mean negative template control, the test specificities were 80.4% (95% CI = 76.2 to 84.6%), 94.0% (95% CI = 91.4 to 96.5%), 98.3% (95% CI = 96.9 to 99.6%), 99.1% (95% CI = 98.2 to 100%), and 99.7% (95% CI = 99.1 to 100%). While recognizing that a high cut point leads to a high test specificity at the expense of sensitivity, our objective was a highly specific test, and the 6-SD cut point was used to categorize test results in further data analyses. In comparison to antibody detection tests (Table 2), the fecal PCR assay specificity was higher (99.7%) than that of one of the currently available serum ELISAs (A) and similar to those of the other serum ELISA (B) and the milk ELISA (E).
TABLE 2.
Test | No. of cows test negative/total no. tested | % Specificitya | 95% CI |
---|---|---|---|
Fecal PCR | 346/347 | 99.7 (a) | 99.1-100 |
Serum ELISA A | 342/359 | 95.3 (b) | 84.0-100.0 |
Serum ELISA B | 358/359 | 99.7 (a) | 98.5-100.0 |
Milk ELISA | 359/360 | 99.7 (a) | 98.5-100.0 |
Different letters in parentheses indicate differences in specificity (P < 0.05). The source of ELISA specificity estimates was reference 7.
In the infected dairy herds, 25% of the cows were culture positive by at least one of the three culture-based tests but only 5% of the cows were culture positive by all three culture-based methods (Table 3). Approximately 10% of the cows in these herds were test positive by two of the culture methods, while 18% were test positive by the most sensitive method (CENT). Study cows reflected cows at various stages of infection with M. avium subsp. paratuberculosis, including 5% heavy fecal shedders. More than 300 BACTEC culture tests were invalid because of bacterial or fungal overgrowth, limiting the test comparisons for this method to 1,481 observations. In addition, approximately 100 test results were missing from each of the serum ELISA results and more than 200 test results were not available for the milk ELISA since these cows were not lactating at the time of collection.
TABLE 3.
Test method | No. of cows tested | % Test positive | % Heavy fecal sheddersa |
---|---|---|---|
At least 1 culture test positive | 1,553 | 25.4 | 5.3 |
All 3 culture tests positive | 1,777 | 5.0 | NAb |
Culture using centrifugation | 1,808 | 18.4 | 5.6 |
Culture using sedimentation | 1,807 | 10.1 | 3.9 |
Culture using BACTEC | 1,481 | 9.6 | 4.5 |
Fecal PCR | 1,808 | 7.6 | NA |
Serum ELISA A | 1,706 | 10.5 | NA |
Serum ELISA B | 1,704 | 7.9 | NA |
Milk ELISA | 1,576 | 7.9 | NA |
Heavy fecal shedder defined as 3+ to 4+ (see Materials and Methods).
NA, not applicable.
Classical analysis results.
Overall, 23% of the cows positive by at least one of the three culture methods were positive by the fecal PCR assay (Table 4). This relative sensitivity was slightly lower than that of the serum ELISAs (28%) although not significantly different from that of the milk ELISA (26%). A comparison of results among tests by fecal shedding level indicated that the relative sensitivity of the fecal PCR assay as defined by the composite fecal culture level of shedding was much lower in light and moderate fecal shedders (4%) than that of the serum and milk ELISAs (12 to 13%). On the other hand, the fecal PCR assay had a relative sensitivity for heavy fecal shedders of 76%, which was higher than that of the milk ELISA (67%) although not statistically significantly different from that of the serum ELISAs.
TABLE 4.
Test | No. positive/total (%), P valuea
|
||
---|---|---|---|
All fecal shedders | Light-to-moderate fecal sheddersb | Heavy fecal sheddersc | |
Fecal PCR | 91/395 (23.0) | 10/244 (4.1) | 60/79 (76.0) |
Serum ELISA A | 102/367 (27.8), 0.04 | 29/234 (12.4), 0.002 | 56/77 (72.7), 0.72 |
Serum ELISA B | 101/367 (27.5), 0.06 | 31/234 (13.2), 0.001 | 53/77 (68.8), 0.34 |
Milk ELISA | 84/327 (25.7), 0.31 | 27/202 (13.4), 0.002 | 44/66 (66.7), 0.059 |
P value from McNemar's test to detect differences in M. avium subsp. paratuberculosis detection between fecal PCR assay and other assays.
Light-to-moderate fecal shedders defined as 1+ to 2+ (see Materials and Methods).
Heavy fecal shedders defined as 3+ to 4+ (see Materials and Methods).
Bayesian analysis results.
For each parameter estimate, the Monte Carlo error was small, autocorrelation values indicated that iterates were not overly correlated with subsequent values, and visual examination of the trace plots indicated convergence of the models. Bayesian analysis indicated conditional independence between PCR and CENT (Covse median of −0.02 with a 95% PI between −0.06 and 0.001; Covsp median of −0.0003 with a 95% PI between −0.00006 and 0.002). The Covse between ELISA A and ELISA B was small and positively correlated (Covse median of 0.15 with a 95% PI between 0.13 and 0.17), whereas the Covsp between the tests was clustered around zero (Covsp median of 0.0004 with a 95% PI between −0.0009 and 0.005).
From Bayesian analyses, the estimated sensitivity of the fecal PCR assay (29%) was much lower than the estimated sensitivity of bacterial culture by CENT (75%) and similar to those of ELISA A (26%) and ELISA B (27%). The probabilities that the sensitivity of the fecal PCR assay was greater than the sensitivities of CENT, ELISA A, and ELISA B were 0, 0.74, and 0.49, respectively, which indicated that the sensitivity of the PCR assay was significantly lower than the sensitivity of CENT but not significantly different from the sensitivities of ELISA A and ELISA B. The estimated specificity of the fecal PCR assay was 99.3%, compared to the estimated specificities of CENT (99.8%), ELISA A (94.9%), and ELISA B (98.0%). The probabilities that the specificity of the fecal PCR assay was greater than the specificities of CENT, ELISA A, and ELISA B were 0.04, 1.0, and 0.99, respectively, which indicated that the specificity of the PCR assay was significantly lower than the specificity of CENT and significantly higher than the specificity of either ELISA A or ELISA B.
DISCUSSION
This study presents the most thorough field validation of a fecal PCR assay for detection of M. avium subsp. paratuberculosis to date. The study design included large samples of well-characterized naturally infected and noninfected cattle characterized by multiple tests, including three different culture methods used to characterize fecal shedding levels of cattle. Our specificity estimates derived from sampling of herds known (and confirmed) not to be paratuberculosis infected.
One of our objectives was to estimate the sensitivity of the fecal PCR assay for detection of M. avium subsp. paratuberculosis. Our estimate from classical methods indicated an overall relative sensitivity of 23%, which was slightly lower than that of serum ELISAs. Because of the lack of a perfect gold standard test to identify all infected cattle, we also estimated the sensitivity of the fecal PCR test by using a Bayesian approach. From Bayesian analyses, the true sensitivity estimate of the PCR assay was 29% and not significantly different from that of serum ELISAs.
The sensitivities of all of the assays evaluated in this study for detection of M. avium subsp. paratuberculosis-infected cattle are dependent on the stage of infection. Cattle that shed large numbers of M. avium subsp. paratuberculosis organisms in their feces are more likely to have positive test results. Our results agree with another study using serum ELISA B (18) that showed an overall ELISA sensitivity of 45% ± 5% and a specificity of 99% ± 1%. The sensitivity of the test in that study was highest for cows with clinical paratuberculosis (87% ± 8%) and was lowest for cattle with subclinical, light fecal shedding (15% ± 7%). A study evaluating serum ELISA A with the same sera (8) similarly estimated the sensitivity varying from 15% in light shedders to 88% in cattle with clinical signs. The specificity of this test was 97% overall across several groups of cattle presumed to be uninfected.
A further goal of this study was to estimate the sensitivity of the fecal PCR assay to detect cattle shedding M. avium subsp. paratuberculosis in their feces (relative sensitivity), especially in cattle with heavy fecal shedding. Identification of cattle with heavy fecal shedding is important because these cattle are the most infectious in terms of risk of transmission to susceptible cattle. While fecal shedding is the primary route of transmission of infection, cows shedding high numbers of M. avium subsp. paratuberculosis bacteria in their feces are more likely than light fecal shedders to transmit infection to calves transplacentally (19) and through milk and colostrum (16). Cattle in this study were present in the study herds at various stages of infection, including heavy fecal shedders (Table 3). For this study, we used the mean bacterial culture score across the three culture methods to create M. avium subsp. paratuberculosis concentration categories for test evaluations, since different bacterial culture methods have different sensitivities.
On the basis of results from this study, the fecal TaqMan PCR assay can be used as a quick test for detection of subclinically infected cattle with heavy fecal shedding (76% relative sensitivity), those cattle at highest risk of transmitting infection to susceptible cattle. It is not an effective assay for detection of other, subclinically infected, cattle shedding fewer M. avium subsp. paratuberculosis bacteria (4% relative sensitivity). While lack of sensitivity in light-to-moderate shedders is a limitation of this PCR assay, detection of heavy fecal shedders is more critical for herd control. A proportion of light fecal shedders may be passing M. avium subsp. paratuberculosis bacteria directly through the gastrointestinal tract after oral ingestion (e.g., passive fecal shedders). Identification of light fecal shedders, especially in heavily infected high-prevalence herds, can be problematic to herd managers, as actively infected cattle and passive shedders cannot currently be differentiated. The fecal PCR assay is more sensitive for detection of high-risk cattle (heavy fecal shedders) than the milk ELISAs and at least as sensitive for detection of these cattle as serum ELISAs while less sensitive for light fecal shedders.
Veterinary practitioners must always interpret test results for paratuberculosis in light of the estimated within-herd prevalence of M. avium subsp. paratuberculosis infection, as well as the performance characteristics of the diagnostic test. Predictive values of positive and negative tests provide interpretive context and vary depending upon the within-herd prevalence of infection, as well as the sensitivity and specificity of the diagnostic tests used. Cost-benefit is another important aspect of diagnostic test utility and must be considered before incorporation into disease control programs. Currently, the cost per fecal PCR assay is approximately 80% of the cost of the traditional HEY fecal culture and more than three times that of serum ELISAs. At the decision level, the critical issues to consider are tradeoffs in validity and cost among available tests. The fecal PCR assay is a faster and cheaper replacement for fecal culture and, although less sensitive, is good at detection of heavy fecal shedders. In comparison to ELISAs, the fecal PCR assay has higher sensitivity than the milk ELISA for detection of heavy fecal shedders (and lower sensitivity for detection of light fecal shedders) at a much higher cost.
In summary, these results demonstrate that the sensitivity of a novel high-throughput molecular diagnostic test for paratuberculosis is less than that of fecal culture and an overall sensitivity similar to those of ELISAs while less sensitive than ELISAs for detection of light-to-moderate fecal shedders. It is particularly effective for rapid detection of cattle with heavy fecal shedding. Rapid identification of cattle actively shedding high numbers of M. avium subsp. paratuberculosis bacteria in their feces can allow removal of highest-risk cattle from the herd or segregation of the susceptible cattle, thereby avoiding further environmental contamination.
Acknowledgments
This work was supported by the USDA-Animal and Plant Health Inspection Service-Veterinary Services, the Minnesota Rapid Agricultural Response Fund, the Minnesota Board of Animal Health, and the Johne's Disease Integrated Project funded by the Animal Biosecurity program of the USDA-CSREES National Research Initiative.
Footnotes
Published ahead of print on 23 August 2006.
REFERENCES
- 1.Animal Health Association. 2003. Diagnosis and control of Johne's disease. National Academies Press, Washington, D.C. [PubMed]
- 2.Branscum, A. J., I. A. Gardner, and W. O. Johnson. 2005. Estimation of diagnostic-test sensitivity and specificity through Bayesian modelling. Prev. Vet. Med. 68:145-163. [DOI] [PubMed] [Google Scholar]
- 3.Carlin, P. B., and T. A. Louis. 2000. The Bayes approach. Bayes and empirical Bayes methods for data analysis. Chapman & Hall, New York, N.Y.
- 4.Collins, M. T., K. B. Kenefick, D. C. Sockett, R. S. Lambrecht, J. McDonald, and J. B. Jorgensen. 1990. Enhanced radiometric detection of Mycobacterium paratuberculosis by using filter-concentrated bovine fecal specimens. J. Clin. Microbiol. 28:2514-2519. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Collins, M. T., and I. R. Morgan. 1991. Economic decision analysis model of a paratuberculosis test and cull program. J. Am. Vet. Med. Assoc. 199:1724-1729. [PubMed] [Google Scholar]
- 6.Collins, M. T., and D. C. Sockett. 1993. Accuracy and economics of the USDA-licensed enzyme-linked immunosorbent assay for bovine paratuberculosis. J. Am. Vet. Med. Assoc. 203:1456-1463. [PubMed] [Google Scholar]
- 7.Collins, M. T., S. J. Wells, K. R. Petrini, J. E. Collins, R. D. Schultz, and R. H. Whitlock. 2005. Evaluation of five antibody detection tests for diagnosis of bovine paratuberculosis. Clin. Diagn. Lab. Immunol. 12:685-692. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Dargatz, D. A., B. A. Byrum, L. K. Barber, R. W. Sweeney, R. H. Whitlock, W. P. Shulaw, R. H. Jacobson, and J. R. Stabel. 2001. Evaluation of a commercial ELISA for diagnosis of paratuberculosis in cattle. J. Am. Vet. Med. Assoc. 218:1163-1166. [DOI] [PubMed] [Google Scholar]
- 9.Eamens, G. J., R. J. Whittington, I. B. Marsh, M. J. Turner, V. Saunders, P. D. Kemsley, and D. Rayward. 2000. Comparative sensitivity of various faecal culture methods and ELISA in dairy cattle herds with endemic Johne's disease. Vet. Microbiol. 77:357-367. [DOI] [PubMed] [Google Scholar]
- 10.Gardner, I. A., H. Stryhn, P. Lind, and M. T. Collins. 2000. Conditional dependence between tests affects the diagnosis and surveillance of animal diseases. Prev. Vet. Med. 45:107-122. [DOI] [PubMed] [Google Scholar]
- 11.Gelman, A., and D. B. Rubin. 1992. Inference from iterative simulation using multiple sequences. Stat. Sci. 7:457-472. [Google Scholar]
- 12.Groenendaal, H., and D. T. Galligan. 2003. Economic consequences of control programs for paratuberculosis in midsize dairy farms in the United States. J. Am. Vet. Med. Assoc. 223:1757-1763. [DOI] [PubMed] [Google Scholar]
- 13.Joseph, L., T. W. Gyorkos, and L. Coupal. 1995. Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. Am. J. Epidemiol. 141:263-272. [DOI] [PubMed] [Google Scholar]
- 14.Nielsen, S. S., and N. Toft. 2006. Age-specific characteristics of ELISA and fecal culture for purpose-specific testing for paratuberculosis. J. Dairy Sci. 89:569-579. [DOI] [PubMed] [Google Scholar]
- 15.Ott, S. L., S. J. Wells, and B. A. Wagner. 1999. Herd-level economic losses associated with Johne's disease on US dairy operations. Prev. Vet. Med. 40:179-192. [DOI] [PubMed] [Google Scholar]
- 16.Streeter, R. N., G. F. Hoffsis, S. Bech-Nielsen, W. P. Shulaw, and D. M. Rings. 1995. Isolation of Mycobacterium paratuberculosis from colostrum and milk of subclinically infected cows. Am. J. Vet. Res. 56:1322-1324. [PubMed] [Google Scholar]
- 17.Strommenger, B., K. Stevenson, and G. F. Gerlach. 2001. Isolation and diagnostic potential of ISMav2, a novel insertion sequence-like element from Mycobacterium avium subspecies paratuberculosis. FEMS Microbiol. Lett. 196:31-37. [DOI] [PubMed] [Google Scholar]
- 18.Sweeney, R. W., R. H. Whitlock, C. L. Buckley, and P. A. Spencer. 1995. Evaluation of a commercial enzyme-linked immunosorbent assay for the diagnosis of paratuberculosis in dairy cattle. J. Vet. Diagn. Investig. 7:488-493. [DOI] [PubMed] [Google Scholar]
- 19.Sweeney, R. W., R. H. Whitlock, and A. E. Rosenberger. 1992. Mycobacterium paratuberculosis isolated from fetuses of infected cows not manifesting signs of the disease. Am. J. Vet. Res. 53:477-480. [PubMed] [Google Scholar]
- 20.Wells, S. J., and B. A. Wagner. 2000. Herd-level risk factors for infection with Mycobacterium paratuberculosis in US dairies and association between familiarity of the herd manager with the disease or prior diagnosis of the disease in that herd and use of preventive measures. J. Am. Vet. Med. Assoc. 216:1450-1457. [DOI] [PubMed] [Google Scholar]
- 21.Wells, S. J., R. H. Whitlock, C. J. Lindeman, and T. Fyock. 2002. Evaluation of bacteriologic culture of pooled fecal samples for detection of Mycobacterium paratuberculosis. Am. J. Vet. Res. 63:1207-1211. [DOI] [PubMed] [Google Scholar]
- 22.Whipple, D. L., D. R. Callihan, and J. L. Jarnagin. 1991. Cultivation of Mycobacterium paratuberculosis from bovine fecal specimens and a suggested standardized procedure. J. Vet. Diagn. Investig. 3:368-373. [DOI] [PubMed] [Google Scholar]
- 23.Whitlock, R. H., S. J. Wells, R. W. Sweeney, and J. Van Tiem. 2000. ELISA and fecal culture for paratuberculosis (Johne's disease): sensitivity and specificity of each method. Vet. Microbiol. 77:387-398. [DOI] [PubMed] [Google Scholar]
- 24.Zhang, J., and T. L. Madden. 1997. PowerBLAST: a new network BLAST application for interactive or automated sequence analysis and annotation. Genome Res. 7:649-656. [DOI] [PMC free article] [PubMed] [Google Scholar]