Abstract
Background
Point‐of‐care (POC) diagnostic tests with good sensitivity and specificity are needed for diagnosing failure of transfer of passive immunity (FTPI) in foals. Turbidimetric immunoassays (TIA) have these characteristics and provide quantitative results. A commercially available TIA‐based POC test (POC‐TIA) has not been validated in horses.
Objective
To validate a POC‐TIA and compare results of POC‐TIA, a POC‐ELISA, and radial immunodiffusion (RID).
Animals
Heparinized blood samples (n = 127) from 48 hospitalized foals (<12 hour to 48 days).
Methods
Prospective validation study. IgG concentrations were measured using RID (gold standard), POC‐TIA, and POC‐ELISA. Agreement between assays was assessed using Bland–Altman analysis. Sensitivity and specificity were calculated using ROC curves. Inter‐ and intra‐assay coefficients of variation (CVs) and linearity were evaluated for POC‐TIA.
Results
The mean bias (95% limits of agreement) between RID and POC‐TIA was −4 (−185 to 176), 27 (−201 to 255), and 308 (−377 to 993) mg/dL for samples with IgG concentrations of <400, 400–800, and >800 mg/dL, respectively. Sensitivity and specificity at optimal cutoff were 94 and 100% for the POC‐TIA and 94 and 100% for the POC‐ELISA to detect IgG <400 mg/dL, and 85 and 87% (POC‐TIA) and 69 and 79% (POC‐ELISA) to detect IgG ≤800 mg/dL. Intra‐ and interassay CVs for POC‐TIA ranged between 1.6–3.8 and 11.9–18.8%, respectively. Linearity of the dilution series was preserved (R 2 > 0.96).
Conclusions and Clinical Importance
The POC‐TIA provided unambiguous results and had sufficient sensitivity, specificity, accuracy, and precision to be used as an alternative to other POC tests to assess FTPI in foals.
Keywords: Failure of transfer of passive immunity, Foal, Horse, Radial immunodiffusion
Abbreviations
- AUC
area under the curve
- CV
coefficient of variation
- FTPI
failure of transfer of passive immunity
- IgG
immunoglobulin G
- LR
likelihood ratio
- POC‐ELISA
point‐of‐care ELISA
- POC‐TIA
point‐of‐care turbidimetric assay
- RID
radial immunodiffusion
- ROC
receiver operator characteristics
- SD
standard deviation
Failure of transfer of passive immunity (FTPI) is common in neonatal foals and predisposes them to severe infections.1, 2 Early detection of FTPI is therefore important to ensure adequate and timely treatment.1, 3, 4 Immunoglobulin G (IgG) concentrations of >800 mg/dL measured 12–48 hour postnatum are generally considered adequate,2 and FTPI is commonly defined as partial FTPI at IgG concentrations of 400–800 mg/dL or total FTPI at IgG concentrations <400 mg/dL.1, 2
A variety of quantitative and semiquantitative methods have been used to determine IgG concentrations in neonatal foals,5, 6, 7 but radial immunodiffusion (RID) is considered the gold standard for the diagnosis of FTPI. However, RID has a long turnaround time, requires expertise in result interpretation, and is costly.3, 8 Serum electrophoresis has been suggested as an alternative gold standard to RID and may be more accurate and reliable in interpretation, but electrophoresis also requires specialized laboratory equipment and has a relatively long turnaround time.3, 5, 9, 10
Several rapid, inexpensive point‐of‐care tests for clinical use, including an ELISA1, zinc sulfate turbidity test, glutaraldehyde coagulation tests, and latex agglutination tests, have been shown to have acceptable sensitivity and specificity.6, 7, 9, 11 However, these tests provide only semiquantitative results and are subject to interpretation error. Estimates of IgG concentrations based on serum total protein concentrations are considered unreliable,1, 5, 6, 12 and serum total globulins have limited sensitivity and specificity.2, 3, 13
An automated turbidimetric immunoassay developed for quantitative IgG measurements in horses has adequate sensitivity and specificity, but testing requires a laboratory chemistry analyzer and is not convenient for use in daily practice.8 More recently, point‐of‐care analyzers that use the turbidimetric immunoassay technique have been developed. One of these analyzers has good sensitivity and specificity, but is no longer available.14 Another point‐of‐care turbidimetric analyzer (POC‐TIA2) is currently marketed, but there are thus far no published validation studies.
The objective of this study was to validate the POC‐TIA2 and compare the performance of the POC‐TIA2 and of a widely used point‐of‐care ELISA (POC‐ELISA1) to the gold standard RID assay.
Materials and Methods
Animals
Foals presented to the Equine Hospitals of the Universities of Zurich and Bern between February and July 2015 were included in the study. Foals were included if testing for FTPI was considered indicated by the attending clinicians. Multiple samples from the same foal were included when IgG concentrations were measured on multiple occasions throughout the course of treatment. The study was performed in accordance with the animal use guidelines of the Swiss legislation and approved by Cantonal Veterinary offices in Zurich and Bern. The “Standards for the Reporting of Diagnostic Accuracy guidelines” were followed.15
Samples
Blood samples were obtained from the jugular vein by direct venipuncture or from an indwelling intravenous catheter. 6 mL of native blood and 3 mL of heparinized blood were collected from each foal. Native blood was allowed to clot at room temperature for 60 minutes before centrifugation at 1341 g for 11 minutes. The serum was then transferred to cryotubes and frozen at −80°C. Heparinized blood was centrifuged at 1341 g for 11 minutes at room temperature, and plasma was used immediately to perform POC‐TIA2 and POC‐ELISA.1 The remainder of the plasma was transferred to a cryotube and frozen at −80°C.
Laboratory Analyses
The POC‐TIA2 and POC‐ELISA1 were run according to the manufacturers' recommendations on heparinized plasma and evaluated by an experienced clinician. Results from POC‐ELISA1 were read before the results from POC‐TIA2. Quality control of the POC‐TIA2 analyzer was carried out as recommended by the manufacturer throughout the study period. Linearity of the POC‐TIA2 dilution series was determined by linear regression using 2 plasma samples of high concentration measured undiluted and diluted with phosphate‐buffered saline at concentrations of 1:2, 1:4, 1:8, and 1:16. Intra‐assay variability of the POC‐TIA2 was assessed by the coefficient of variation of ten replicate measurements of each of 3 samples, analyzed on the same setup of the assay. Interassay variability of the POC‐TIA2 was assessed by the CV of 5 replicate measurements of each of 3 samples (low, medium, and high concentration), analyzed on different setups of the experiment. Coefficients of variation of <25% were considered acceptable.16 Samples for intra‐assay and interassay variability were randomly selected based on low (<400 mg/dL), medium (400–800 mg/dL), and high concentration (>800 mg/dL).
The frozen serum samples were shipped as a single batch on dry ice to MAI P/S laboratory (Spring Valley, WI) for RID analyses that were conducted with a commercial RID test kit.3 The laboratory personnel were blinded to the results of the POC‐TIA2 and POC‐ELISA1 tests. Standard curves were performed on each individual RID plate using the manufacturer's suggested protocol with serial dilutions of a commercial USDA certified Equine IgG4 prepared with sterile goat serum.5 In addition to standards and unknowns, all RID plates included 3 control samples (high, 1900 mg/dL; mid, 950 mg/dL; and low, 475 mg/dL), standards supplied by the manufacturer of the RID plates and, on 3 plates, interassay (between plates) and intra‐assay (with‐in the same plate) replicates of 3 test samples chosen to represent high, mid, and low levels of IgG. The same 3 laboratory technicians processed all samples to reduce subjectivity. The average of the 3 reads was reported as the result of RID. The same USDA approved standard was used for all RID plates to reduce variability.
Statistical Analyses
Descriptive statistics were used to summarize data. Agreement of the POC‐TIA2 with RID assay was evaluated using Bland–Altman analysis, whereby data were analyzed separately for samples with RID IgG concentrations of <400, 400–800, and >800 mg/dL, respectively. The mean bias, the 95% confidence interval (CI) of the mean bias, and the 95% limits of agreement (LOA) were calculated. Samples were categorized based on RID as ≤800 mg/dL (partial or total FTPI), and <400 mg/dL (total FTPI) to evaluate the performance of the POC‐TIA2 and POC‐ELISA1. Receiver operator characteristics (ROC) were used to determine the accuracy of POC‐TIA2. The area under the ROC curve (AUC) was calculated, and the Youden index (=maximum {sensitivity + specificity – 1}) was used to identify the optimal cutoff points for both sensitivity and specificity of the POC‐TIA2 to detect IgG concentrations <400 mg/dL (total FTPI) and ≤800 mg/dL (partial or total FTPI), respectively. Other cutoffs were chosen to maximize either specificity or sensitivity of the assay. Test characteristics at the respective cutoff values were summarized by reporting sensitivity, specificity, and positive (+LR) and negative (−LR) likelihood ratios. Similarly, the performance of the POC‐ELISA1 was evaluated after generating ROC curves from the predicted probabilities from logistic regression. In addition, classification agreement of samples with IgG >800 mg/dL, 400–800 mg/dL, and <400 mg/dL between POC‐TIA2 and RID assay and between POC‐ELISA1 and RID assay was evaluated using the Kappa statistic with linear weights. The level of significance was set at P < 0.05. Analyses were performed by commercial software.6 , 7
Results
Animals
A total of 127 samples were collected from 48 foals (87 samples from 20 foals presented to the Equine Hospital of University of Zurich and 40 samples from 28 foals presented to the Equine Hospital of the University of Bern). The sex of the foals was female in 18/48 (37.5%) and male in 30/48 (62.5%) of cases. The age at sampling ranged from <12 hours to 38 days, with a median of 4 days. Breeds included 19 Warmblood horses, 10 Freiberger, 8 ponies, 2 donkeys, 2 draft horses, 2 Lusitanos and one each of Standardbred, Thoroughbred, Friesian, Quarter Horse, and Paso Fino.
Presenting complaints recorded were FTPI (7/48), colic (7/48), sepsis (5/48), noninfectious orthopedic disease (5/48), healthy foals accompanying their sick mare (5/48), omphalitis (3/48), pneumonia (3/48), weakness (2/48), uroabdomen (2/48) and one each of prematurity, white muscle disease, inguinal hernia, soft tissue trauma, wry nose, fever, and esophageal obstruction. The presenting complaint was not recorded for 2/48 foals.
Samples
A single blood sample was collected from 29 foals. Foals from which more than one sample was collected were as follows: 2 samples (n = 7), 3 samples (n = 3), 4 samples (n = 1), 5 samples (n = 1), 6 samples (n = 2), 7 samples (n = 1), 9 samples (n = 1), eleven samples (n = 1), thirteen samples (n = 1), and 14 samples (n = 1). A total of 67/127 samples were taken after plasma transfusion. Based on RID analyses, IgG concentrations were >800 mg/dL in 75/127 (59%) samples, 400–800 mg/dL (partial FTPI) in 36/127 (28%) samples, and <400 mg/dL (total FTPI) in 16/127 (13%) samples. Any FTPI (partial or total) was present in 52//127 (41%) of samples.
Evaluation of POC‐TIA2
Linearity of the dilution series was preserved for the POC‐TIA2 assay (Fig 1, Table 1). Intra‐assay variability was within acceptable limits with CVs between 1.6 and 3.8% (Table 2). Interassay variability was higher (CVs between 11.9 and 18.8%) than intra‐assay variability for all IgG concentrations (Table 2), but still within acceptable limits.
Figure 1.
Regression lines (solid lines) and 95% confidence intervals (dashed lines) showing the relation between observed and expected IgG concentrations measured using the point‐of‐care turbidimetric assay (POC‐TIA) assay obtained after dilution of 2 plasma samples (A and B) with high IgG concentrations.
Table 1.
Analytic accuracy of POC‐TIA2 assessed by linear regression of dilution series in spiked plasma samples
Sample | Starting concentration (mg/dL) | Regression line | ||||
---|---|---|---|---|---|---|
Slope (95% CI) | Y‐intercept (95% CI) | P | R 2 | P (deviation from line of equality) | ||
A | 3,379 | 1.013 (0.74–1.28) | −183.5 (−649.7 to 282.8) | 0.0012 | 0.97 | 1.000 |
B | 2,906 | 0.9948 (0.706–1.283) | −110.6 (−543.6 to 322.5) | 0.0016 | 0.96 | 1.000 |
CI, confidence interval.
Table 2.
Intra‐ and interassay variability of the point‐of‐care turbidimetric assay (POC‐TIA2)
Evaluation | Sample | Mean (SD) concentration (mg/dL) | CV (%) |
---|---|---|---|
Intra‐assay variability | High | 2267 (86.5) | 3.8 |
Medium | 658.8 (10.6) | 1.6 | |
Low | 361.3 (9.9) | 2.7 | |
Interassay variability | High | 1653 (285.1) | 17.2 |
Medium | 720 (135.4) | 18.8 | |
Low | 515.6 (61.5) | 11.9 |
CV, coefficient of variation.
Low: <400 mg/dL, medium: 400–800 mg/dL, high concentration >800 mg/dL.
Agreement between POC‐TIA2 and RID using the Bland–Altman analyses revealed a mean bias of −4 mg/dL (95% CI, −53 to 45), 27 mg/dL (95% CI, −13 to 66), and 308 mg/dL (95% CI, −515 to −239) for samples with RID IgG concentrations of <400, 400–800, and >800, respectively (Fig 2). For samples with RID IgG concentrations of >800 mg/dL, a proportional error was evident with POC‐TIA2 showing a greater tendency to underestimate IgG concentrations as measured by RID assay at higher concentrations (Fig 2).
Figure 2.
Bland–Altman plots showing agreement of the point‐of‐care turbidimetric assay (POC‐TIA) with radial immunodiffusion (RID) for IgG concentrations in samples with RID concentrations <400 mg/dL (A), 400–800 mg/dL, (B) and >800 mg/dL (C). The solid line represents the mean bias; the 2 dashed lines represent the 95% limits of agreement, and the dotted line is the line of equality. The numbers in brackets represent the 95% CI of the mean.
The AUC of the ROC curves for the POC‐TIA was 0.99 and 0.92 to detect IgG concentrations of <400 and ≤800 mg/dL, respectively, when compared to the RID assay as the gold standard (Fig 3). The Youden index for detecting RID IgG concentrations of <400 and ≤800 mg/dL was associated with POC‐TIA2 cutoff concentrations of 299 and 687 mg/dL, respectively. Cutoff concentrations for detecting RID IgG concentrations with highest sensitivity and specificity are given in Tables 3 and 4.
Figure 3.
Receiver operator characteristic curves for the point‐of‐care turbidimetric assay (POC‐TIA) to detect IgG concentrations of <400 mg/dL (A) and ≤800 mg/dL (B) measured with radial immunodiffusion.
Table 3.
Sensitivities, specificities, and likelihood ratios of a point‐of‐care turbidimetric assay (POC‐TIA2) and point‐of‐care ELISA (POC‐ELISA1) to detect IgG concentrations <400 mg/dL (total FTPI, n = 16/127) as determined by the RID assay as the gold standard)
Assay | AUC (95% CI) | Associated cutoff (mg/dL) | Sensitivity (95% CI) | Specificity (95% CI) | +LR (95% CI) | −LR (95% CI) |
---|---|---|---|---|---|---|
POC‐TIA2 | 0.99 (0.96–1.00) | ≤299a | 93.8 (69.8–99.8) | 100.0 (96.7–100.0) | 0.06 (0.01–0.40) | |
≤399 | 93.8 (69.8–99.8) | 95.5 (89.8–98.5) | 20.81 (8.8–48.5) | 0.07 (0.01–0.40) | ||
≤488 | 100.0 (79.4–100.0) | 90.1 (83.0–94.9) | 10.09 (5.8–17.7) | |||
POC‐ELISA1 | 0.97 (0.92–0.99) | ≤400 | 93.8 (69.8–99.8) | 100 (96.7–100.0) | 0.06 (0.01–0.42) |
AUC, area under the curve of ROC curve analysis; CI, confidence intervals; LR, likelihood ratio; RID, radial immunodiffusion; FTPI,, failure of transfer of passive immunity.
Optimal cutoff as determined by the Youden index.
Table 4.
Sensitivities, specificities, and likelihood ratios of a point‐of‐care turbidimetric assay (POC‐TIA2) and point‐of‐care ELISA (POC‐ELISA1) to detect RID IgG concentrations ≤800 mg/dL (partial or total FTPI, n = 52/127) as determined by the RID assay as the gold standard)
Assay | AUC (95% CI) | Associated cutoff (mg/dL) | Sensitivity (95% CI) | Specificity (95% CI) | +LR (95% CI) | −LR (95% CI) |
---|---|---|---|---|---|---|
POC‐TIA2 | 0.92 (0.86–0.96) | ≤391 | 36.4 (23.6–51) | 100 (95.2–100) | 0.63 (0.5–0.8) | |
≤595 | 69.2 (54.9–81.3) | 96 (88.8–99.2) | 17.31 (5.6–53.2) | 0.32 (0.2–0.5) | ||
≤687a | 84.6 (71.9–93.1) | 86.7 (76.8–93.4) | 6.35 (3.5–11.4) | 0.18 (0.1–0.3) | ||
≤804 | 98.1 (89.7–100.0) | 62.7 (50.7–73.6) | 2.63 (2.0–3.5) | 0.03 (0.00–0.20) | ||
≤864 | 100 (93.2–100) | 49.3 (37.6–61.1) | 1.97 (1.6–2.5) | |||
POC‐ELISA1 | 0.74 (0.65–0.81) | ≤800 | 69.2 (54.9–81.3) | 78.7 (67.7–87.3) | 3.25 (2.0–5.2) | 0.39 (0.26–0.60) |
AUC, area under the curve of ROC curve analysis; CI, confidence intervals; LR, likelihood ratio; RID, radial immunodiffusion; FTPI,, failure of transfer of passive immunity.
Optimal cutoff as determined by the Youden index.
The weighted Kappa value characterizing agreement between POC‐TIA2 and RID assay for the classification of samples as IgG <400, 400–800, and >800 mg/dL, respectively, was 0.64 (95% CI, 0.53–0.75). Total FTPI (<400 mg/dL) was falsely diagnosed by POC‐TIA2 in 5/20 (25%) samples, and 1/16 (6%) samples with total FTPI based on RID was missed by POC‐TIA2; IgG concentrations ≤800 mg/dL (partial or total FTPI) were falsely diagnosed by POC‐TIA2 in 2/50 (4%) samples, and 27/75 (36%) samples with IgG concentrations ≤800 mg/dL (partial or total FTPI) based on RID were missed by POC‐TIA2.
Evaluation of POC‐ELISA1
Based on the POC‐ELISA1 results, 15/127 (12%) samples were classified as <400 mg/dL (total FTPI) and 52/127 (41%) as ≤800 mg/dL (partial or total FTPI). The AUC of the ROC curves for the POC‐ELISA was 0.97 and 0.74 to detect IgG concentrations of <400 mg/dL (total FTPI) and ≤800 mg/dL (partial or total FTPI), respectively, when compared to the RID as the gold standard (Fig 4). Sensitivity, specificity, and associated likelihood ratios to detect FTPI based on IgG concentrations <400 mg/dL (total FTPI) and ≤800 mg/dL (partial or total FTPI), respectively, are presented in Tables 3 and 4. The Kappa value characterizing agreement between POC‐ELISA1 and RID for the classification of samples as IgG <400, 400–800, and >800 mg/dL was 0.63 (95% CI, 0.50–0.76). No samples were falsely diagnosed as total FTPI by POC‐ELISA1, and 1/16 (6%) samples with total FTPI based on RID was missed by POC‐ELISA1; IgG concentrations ≤800 mg/dL (partial or total FTPI) were falsely diagnosed by POC‐ELISA in 16/52 (31%) samples, and 16/52 (31%) samples with IgG concentrations ≤800 mg/dL (partial or total FTPI) based on RID were missed by POC‐ELISA.1
Figure 4.
Receiver operator characteristic (ROC) curves for the point‐of‐care ELISA (POC‐ELISA) to detect IgG concentrations of <400 mg/dL (A) and ≤800 mg/dL (B) measured with radial immunodiffusion. ROC curves for were calculated from the predicted probabilities from logistic regression.
Discussion
A quantitative point‐of‐care test offers a great advantage compared to most currently available assays marketed for the assessment of FTPI in foals that give only semiquantitative results. In particular, semiquantitative tests giving a result between 400 and 800 mg/dL do not allow clinicians to distinguish animals with IgG concentrations bordering on total FTPI from those with concentrations close to adequate levels. Moreover, the effects of treatment cannot be as closely monitored by semiquantitative tests. The purpose of this study was to validate a quantitative POC‐TIA2 and compare IgG concentrations measured with RID and both the POC‐TIA2 and a widely used semiquantitative POC‐ELISA1. The POC‐TIA2 showed both good linearity in dilution series and good precision, based on intra‐ and interassay CV. The test showed fair to good agreement with the gold standard RID and had better sensitivity and specificity than the POC‐ELISA1 in this study.
The POC‐TIA2 evaluated in this study showed good linearity in dilution series. Intra‐assay variability (CVs, 1.6–3.8%) was similar to that reported in a previous study (CV, 3%) evaluating an automated TIA performed on a routine laboratory chemistry analyzer.8 Interassay variability (CVs, 11.9–18.8%) was considerably higher than that reported using an automated TIA (CVs, 1–4%).8 However, the range of values measured for interassay CVs in the current study was greater than that evaluated in the previous study. Moreover, both intra‐ and interassay CVs were well within acceptable limits of 25%.16, 17 Several factors can influence the analytic performance of an assay. Small differences in sample handling and test setup can lead to variations. The more steps included in a protocol, the higher the chance for variation.17, 18, 19 This explains the slightly better coefficient of variation in the intra‐assay experiment where measurements were carried out repeatedly compared to the interassay experiment, where the actual setup was repeated. The good analytic performance of the POC‐TIA2 suggests that small differences in manipulation are not likely to lead to clinically relevant error in IgG measurement, and precise measurements of IgG at clinically relevant concentrations are possible.
Agreement between POC‐TIA2 and the gold standard RID was good for samples with RID IgG concentrations of <400 and 400–800 mg/dL. For samples with RID IgG concentrations of >800 mg/dL, both considerable bias and proportional error were evident with the POC‐TIA2, measuring increasingly lower than RID assay with increasing IgG concentrations. However, as IgG concentrations above 800 mg/dL are considered to be adequate to protect foals against infections, this increasing bias is likely to be of little clinical importance.
A test with high sensitivity is desirable when assessing FTPI,, as failure to diagnose (and treat) FTPI may have serious sequela.14, 20, 21 Conversely, high specificity is necessary to avert unnecessary treatment of foals with plasma transfusions, which carries a risk of adverse effects and is associated with higher costs.22 The AUC of ROC curve analyses for POC‐TIA2 to detect RID IgG concentrations <400 mg/dL (total FTPI) and ≤800 mg/dL (partial or total FTPI) was both very high and considerably higher than that of POC‐ELISA1. Moreover, optimal cutoff points based on the Youden index (i.e, 299 and 687 mg/dL) achieved a sensitivity and specificity similar or superior to those found with the POC‐ELISA1, and those previously reported using a different POC‐TIA assay (80 and 100%, respectively)14 and an automated TIA (63 and 92%, respectively).8 Likewise, optimal cutoff points achieved sensitivities and specificities similar or superior to those of the POC‐ELISA1, and those previously reported using a different POC‐TIA assay (76 and 100%, respectively)14 and using an automated TIA (81 and 86%, respectively).8 Although cutoff values determined by the Youden index resulted in some foals with FTPI being missed by POC‐TIA2, this can be averted by selecting higher cutoff values of 488 and 804 mg/dL to detect IgG concentrations <400 (total FTPI) and ≤800 mg/dL (total or partial FTPI,, as measured by RID), respectively. These higher cutoff values result in sensitivities of 100 and 98.1%, respectively, decreasing the false‐negative rate at the expense of lower specificities. Results of the present study therefore suggest that the POC‐TIA2 provides sufficient diagnostic accuracy to assess FTPI in foals.
Although the overall Kappa agreement to classify samples as <400, 400–800, and >800 mg/dL was similar for the POC‐TIA2 and POC‐ELISA1, results of ROC curve analyses suggest that POC‐TIA2 is superior to POC‐ELISA1. However, as the POC‐TIA2 measured lower than RID, assay‐specific cutoffs are necessary to achieve optimal performance. Indeed, use of 400 and 800 mg/dL as cutoffs for the POC‐TIA2 would result in lower specificities than those achieved with Youden index‐based cutoffs.
Previous studies evaluating the POC‐ELISA1 have reported sensitivities and specificities ranging of 89–90 and 79–96%, respectively, to detect RID <400 mg/dL, and 81–95 and 52–95%, respectively to detect RID ≤800 mg/dL.6, 12 However, differences in prevalences of FTPI between studies and use of different RID assays make direct comparison with other studies difficult.
Multiple samples from foals were included in the study as samples were used to monitor the foal IgG concentrations over time after plasma transfusion. These samples were not considered repeated measures, as most of them received plasma for treatment of FTPI between sampling points.
As evaluation of the POC‐ELISA1 is somewhat subjective and both the POC‐TIA2 and POC‐ELISA1 were run by the same operator at the same time, results of the POC‐ELISA1 were read before performing the POC‐TIA2. Therefore, results of POC‐TIA2 should not have influenced subjective reading of the POC‐ELISA1. The POC‐TIA2 can be performed with both serum and plasma. In this study, plasma was used for convenience although serum was used for RID assays. However, as a previous study showed no difference in IgG concentrations between serum and plasma using an automated TIA assay, no significant effect of matrix is expected.21
From a practical standpoint, the POC‐TIA2 was found to be easy to perform, rapid (run time of approximately 15 minutes) and the measured concentrations are displayed digitally, giving unambiguous results that are not subject to individual interpretation bias.
In conclusion, the POC‐TIA2 showed fair to good overall performance and its use in practice can be considered as an alternative to other point‐of‐care tests for the diagnosis of FTPI in foals. Assay‐specific cutoffs are necessary to achieve optimal accuracy compared to RID.
Acknowledgments
The study was not supported by a grant.
Conflict of Interest Declaration
MAI Animal Health the company that produces and distributes the test we validated in this study (Rapid DVM) provided the test kits and reagents. The internal laboratory of the company also performed the radial immunodiffusion test we used as gold standard to compare the point‐of‐care test to. The company (and laboratory) had no influence on study design, data analysis, and writing of the manuscript. The laboratory of the company was blinded to the results of the point‐of‐care we validated when the RID was run and afterward. Dr. Colin Schwarzwald serves as Associate Editor for the Journal of Veterinary Internal Medicine. He was not involved in the review of this manuscript.
Off‐label Antimicrobial Declaration
Authors declare no off‐label use of antimicrobials.
The work was performed at the University of Zurich and the University of Bern.
Presented as a poster at the 2nd International Congress of the German Equine Veterinary Association (GEVA), Berlin, October 28, 2016–October 29, 2016.
Footnotes
SNAP Foal IgG Test Kit, IDEXX Laboratories Inc, Westbrook, ME
Rapid DVM test™ II, Value Diagnostics™, MAI Animal Health, Melksham, Wiltshire, UK
RID Test for Equine IgG, product number 828411, Triple J Farms, Bellingham, WA
Secondary Reference Serum (SRS), Product Number 2011, Midland BioProducts, Boone, IA
Equitech‐Bio, Kerrville, TX
MedCalc, version 16.4.1 MedCalc Software bvba, Ostend, Belgium
GraphPad Prism, version 5.03, GraphPad Software, San Diego, CA, USA, www.graphpad.com
References
- 1. Koterba AM, Brewer BD, Tarplee FA. Clinical and clinicopathological characteristics of the septicaemic neonatal foal: Review of 38 cases. Equine Vet J 1984;16:376–382. [DOI] [PubMed] [Google Scholar]
- 2. Liepman RS, Dembek KA, Slovis NM, et al. Validation of IgG cut‐off values and their association with survival in neonatal foals. Equine Vet J 2015;47:526–530. [DOI] [PubMed] [Google Scholar]
- 3. Fouche N, Graubner C, Howard J. Correlation between serum total globulins and gamma globulins and their use to diagnose failure of passive transfer in foals. Vet J 2014;202:384–386. [DOI] [PubMed] [Google Scholar]
- 4. Robinson JA, Allen GK, Green EM, et al. A prospective study of septicaemia in colostrum‐deprived foals. Equine Vet J 1993;25:214–219. [DOI] [PubMed] [Google Scholar]
- 5. Rumbaugh GE, Ardans AA, Ginno D, et al. Measurement of neonatal equine immunoglobulins for assessment of colostral immunoglobulin transfer: Comparison of single radial immunodiffusion with the zinc sulfate turbidity test, serum electrophoresis, refractometry for total serum protein, and the sodium sulfite precipitation test. J Am Vet Med Assoc 1978;172:321–325. [PubMed] [Google Scholar]
- 6. Davis R, Giguere S. Evaluation of five commercially available assays and measurement of serum total protein concentration via refractometry for the diagnosis of failure of passive transfer of immunity in foals. J Am Vet Med Assoc 2005;227:1640–1645. [DOI] [PubMed] [Google Scholar]
- 7. Clabough DL, Conboy HS, Roberts MC. Comparison of four screening techniques for the diagnosis of equine neonatal hypogammaglobulinemia. J Am Vet Med Assoc 1989;194:1717–1720. [PubMed] [Google Scholar]
- 8. Davis DG, Schaefer DM, Hinchcliff KW, et al. Measurement of serum IgG in foals by radial immunodiffusion and automated turbidimetric immunoassay. J Vet Intern Med 2005;19:93–96. [DOI] [PubMed] [Google Scholar]
- 9. Bauer JE, Brooks TP. Immunoturbidimetric quantification of serum immunoglobulin G concentration in foals. Am J Vet Res 1990;51:1211–1214. [PubMed] [Google Scholar]
- 10. Tscheschlok L, Venner M, Howard J. Comparison of IgG concentrations by radial immunodiffusion, electrophoretic gamma globulin concentrations and total globulins in neonatal foals. Equine Vet J 2016;49:149–154. [DOI] [PubMed] [Google Scholar]
- 11. Kent JE, Blackmore DJ. Measurement of IgG in equine blood by immunoturbidimetry and latex agglutination. Equine Vet J 1985;17:125–129. [DOI] [PubMed] [Google Scholar]
- 12. Metzger N, Hinchcliff KW, Hardy J, et al. Usefulness of a commercial equine IgG test and serum protein concentration as indicators of failure of transfer of passive immunity in hospitalized foals. J Vet Internal Med/Am College Vet Internal Med 2006;20:382–387. [DOI] [PubMed] [Google Scholar]
- 13. Hurcombe SD, Matthews AL, Scott VH, et al. Serum protein concentrations as predictors of serum immunoglobulin G concentration in neonatal foals. J Vet Emerg Crit Care (San Antonio) 2012;22:573–579. [DOI] [PubMed] [Google Scholar]
- 14. Wong DM, Giguere S, Wendel MA. Evaluation of a point‐of‐care portable analyzer for measurement of plasma immunoglobulin G, total protein, and albumin concentrations in ill neonatal foals. J Am Vet Med Assoc 2013;242:812–819. [DOI] [PubMed] [Google Scholar]
- 15. Bossuyt PM, Reitsma JB, Bruns DE, et al. STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies. BMJ 2015;351:h5527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Valentin MA, Ma S, Zhao A, et al. Validation of immunoassay for protein biomarkers: Bioanalytical study plan implementation to support pre‐clinical and clinical studies. J Pharm Biomed Anal 2011;55:869–877. [DOI] [PubMed] [Google Scholar]
- 17. Chan DW. Technical Evaluation In: Science E, ed. Immunoassay Automation: A Practical Guide. Saint Louis: Elsevier Science; 2012:31–44. [Google Scholar]
- 18. Wild D. Immunoassay Development In: Science E, ed. The Immunoassay Handbook: Theory and Applications of Ligand Binding, ELISA and Related Techniques, 4th ed Jordon Hill: Elsevier Science; 2013. [Google Scholar]
- 19. Tate J, Ward G. Interferences in immunoassay. Clin Biochem Rev 2004;25:105–120. [PMC free article] [PubMed] [Google Scholar]
- 20. Wilkins PA, Dewan‐Mix S. Efficacy of intravenous plasma to transfer passive immunity in clinically healthy and clinically ill equine neonates with failure of passive transfer. Cornell Vet 1994;84:7–14. [PubMed] [Google Scholar]
- 21. McCue PM. Evaluation of a turbidimetric immunoassay for measurement of plasma IgG concentration in foals. Am J Vet Res 2007;68:1005–1009. [DOI] [PubMed] [Google Scholar]
- 22. Liu IK, Brown C, Myers RC, et al. Evaluation of intravenous administration of concentrated immunoglobulin G to colostrum‐deprived foals. Am J Vet Res 1991;52:709–712. [PubMed] [Google Scholar]