Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2018 Jul 10.
Published in final edited form as: J Thromb Haemost. 2017 May 11;15(6):1203–1212. doi: 10.1111/jth.13692

Diagnostic accuracy of IgG-specific versus polyspecific enzyme-linked immunoassays in heparin-induced thrombocytopenia: a systematic review and meta-analysis

H D HUSSEINZADEH *, P A GIMOTTY , A M PISHKO *, M BUCKLEY , T E WARKENTIN , A CUKER *,§
PMCID: PMC6039095  NIHMSID: NIHMS975906  PMID: 28374939

Summary

Background

There are conflicting data on whether the IgG-specific or polyspecific antiplatelet factor 4/heparin (PF4/H) enzyme-linked immunosorbent assay (ELISA) is preferred for the laboratory diagnosis of heparin-induced thrombocytopenia (HIT).

Objectives

To directly compare diagnostic accuracy of IgG-specific versus polyspecific ELISA in HIT.

Patients/Methods

A systematic search yielded nine studies comprising 1948 patients with suspected HIT tested by both IgG-specific and polyspecific ELISAs and a reference standard against which the diagnostic accuracy of the ELISAs could be measured. Study quality was assessed by QUADAS-2 criteria.

Results

There was identical sensitivity for IgG-specific and polyspecific ELISAs (0.97; 95% confidence interval (CI), 0.95–0.99) and superior specificity of IgG-specific compared with polyspecific ELISA (0.87 [0.85–0.88] vs. 0.82 [0.80–0.84], respectively). Performance was similar in subgroups using the serotonin release assay and a single commercial ELISA manufacturer. The negative predictive values of IgG-specific and polyspecific ELISA were similarly high (0.99, [0.99–1.00], but the positive predictive value was superior with IgG-specific compared with polyspecific ELISA (0.56 [0.52–0.61] vs. 0.32 [0.28–0.35], respectively). The positive likelihood ratio (LR) was higher in IgG-specific than polyspecific ELISA, although negative LRs were similar. There was high risk of quality concerns in domains of index test and reference standard.

Conclusions

The superior diagnostic accuracy of IgG-specific ELISA reinforces the ISTH-SSC recommendation for standardization of laboratory testing for HIT. Likelihood ratios of individual assays may be used in combination with clinical scoring systems as part of an integrated diagnostic algorithm for HIT.

Keywords: diagnosis, enzyme-linked immunosorbent assay, heparin, thrombocytopenia, thrombosis

Introduction

Heparin-induced thrombocytopenia (HIT) is a prothrombotic complication of heparin therapy. This potentially life-threatening syndrome results from formation of platelet-activating antibodies against multi-molecular complexes of platelet factor 4 (PF4) and heparin (PF4/H). Enzyme-linked immunosorbent assays (ELISAs) that detect antibodies against PF4/H complexes are widely used in the laboratory diagnosis of HIT [1,2]. These assays have high sensitivity but limited specificity because they are unable to distinguish platelet-activating antibodies from their more numerous non-pathogenic (i.e. non-platelet-activating) counterparts. Although anti-PF4/H immunoglobulins may be of the IgG, IgA or IgM class [3], IgG antibodies are thought to have the predominant, if not sole, capacity for triggering platelet activation responsible for the clinical manifestations of HIT [4,5].

Early anti-PF4/H ELISAs were exclusively polyspecific in nature, detecting IgG, IgA and IgM antibodies. IgG-specific ELISA kits became commercially available in the late-2000s in the hopes of improving diagnostic specificity. Currently, both IgG-specific and polyspecific ELISAs are in use, and there is conflicting information on whether one should be preferred. The International Society on Thrombosis and Haemostasis (ISTH) Scientific and Standardization Committee (SSC) stated a preference for the IgG-specific ELISA because of its basis in the pathobiology of HIT and superior specificity demonstrated in some studies [6]. At variance with ISTH recommendations, a recent meta-analysis of the diagnostic accuracy of immunoassays for HIT [7] reported no significant difference in specificity between the IgG-specific and polyspecific ELISAs. In fact, the polyspecific ELISA with intermediate optical density (OD) cut-off (and not the IgG-specific ELISA) was found to be one of only five immunoassays with both high sensitivity (> 95%) and high specificity (> 90%).

We hypothesized that the unexpected results of this meta-analysis may have arisen as a consequence of pooling data from heterogeneous studies with different study populations and reference standards. To minimize the effects of study heterogeneity on estimates of diagnostic accuracy, we conducted a systematic review and meta-analysis of only studies in which the polyspecific and IgG-specific ELISAs were directly compared within the same study, against the same reference standard, and from blood samples of the same patient.

Methods

Study identification

A literature search was performed of PubMed, EMBASE and The Cochrane Library databases from inception to 1 December 2015 using the following keywords: [(ELISA OR EIA OR enzyme linked immunosorbent assay OR enzyme immunoassay) AND (heparin induced thrombocytopenia OR HIT OR HITT OR heparin induced thrombocytopenia with thrombosis OR heparin associated thrombocytopenia.)] An additional review of the first 100 results using the above search terms in Google Scholar was performed, as was a manual search of reference lists of eligible studies. The search was restricted to English-language articles. References were screened for eligibility by title, abstract and full text as indicated by a single reviewer (HDH).

Study selection

Studies were eligible for inclusion if: (i) patients in whom there was clinical suspicion for HIT were enrolled (thus, serosurveillance studies were excluded); (ii) both polyspecific (IgG/A/M) and IgG-specific anti-PF4/H ELISAs were performed on aliquots from the same patient samples; (iii) a reference standard (which, at a minimum, included a functional HIT assay) was performed against which the performance of the polyspecific and IgG-specific ELISAs could be compared; and (iv) the study was published as a full-length manuscript. Studies were excluded if the numbers of true-positive (TP), false-positive (FP), true-negative (TN) and false-negative (FN) results for each assay could not be extracted or calculated.

Data extraction

Key characteristics of eligible studies were extracted by two independent reviewers (HDH and AMP). Data collected included author, year of publication, study design, single-versus multi-center design, country of study center (s), study population (e.g. medical, surgical, cardiovascular surgery, critically ill, etc.), median age, gender distribution, heparin agent (unfractionated heparin and/or low-molecular-weight heparin), reference standard, type of IgG-specific and polyspecific ELISA, and OD thresh-old. If available, pretest clinical probability of HIT (low, intermediate or high probability) was noted. The number of TP, FP, TN and FN results for both the polyspecific and IgG-specific assay were extracted or calculated from data provided in the manuscripts of eligible studies and underwent evaluation by a third reviewer (MB) to confirm the accuracy of calculations. Any discrepancies were discussed between the reviewers in an attempt to reach consensus. If a consensus could not be reached among the three reviewers, the discrepancy was brought to the principal investigator (AC) for final determination.

Data analysis

Primary outcome data for each ELISA included the number of TP, TN, FP and FN results as compared with the reference standard. Individual and pooled sensitivity and specificity values, positive and negative predictive values, and positive and negative likelihood ratios (LRs) were calculated.

We prespecified several subgroup and sensitivity analyses. Because the incidence of HIT varies by patient population (e.g. medical vs. surgical) [812], we planned subgroup analyses by patient population. Additionally, we planned subgroup analyses of patients with varying pretest clinical probabilities of HIT. We prespecified sensitivity analyses of studies that used a reference standard that included both a clinical assessment and washed platelet functional assay, in accordance with recommendations of the ISTH SSC [6]. Because different kits may vary in their operating characteristics, we also prespecified sensitivity analyses of studies using ELISA kits from the same manufacturer.

A positive immunoassay was defined by a threshold optical density (OD) value specified by each study’s authors. One study investigated two different OD thresholds, a standard and an ‘optimized’ threshold [13]. In this case, the standard threshold was used. Three studies (14–16) reported results from overlapping datasets. In this case, only the study with the largest number of evaluable patients was included [15].

Individual and pooled sensitivity and specificity values, positive and negative predictive values, and prevalence, and associated 95% confidence intervals were estimated using a fixed-effect model [17] within the full cohort and subgroups. Positive and negative LRs were generated from the pooled estimates of sensitivity and specificity. Stata13 software was used for statistical analyses (Stata-Corp. 2013; Stata Statistical Software: Release 13; Stata-Corp LP, College Station, TX, USA).

Quality assessment

The methodological quality of included studies was assessed by two independent reviewers (HDH and AMP) using QUA-DAS-2, a standardized tool that evaluates risk of bias and concerns regarding applicability to clinical practice in tests of diagnostic accuracy [18]. We developed signaling questions specific to our particular study (available in Data S1) addressing risk of bias and concerns regarding applicability in the four domains of patient selection, index test, reference standard, and flow and timing, as well as detailed decision criteria according to published guidelines.

Results

Study selection

Results of the comprehensive literature search are illustrated in the accompanying PRISMA diagram (Fig. 1). The search strategy yielded a total of 882 articles: 590 articles from PubMed, 292 from EMBASE and 0 from Cochrane. One additional relevant manuscript was identified through bibliography search. No additional articles were identified after review of the top 100 results of a Google Scholar search. Of the total number of articles (883), 363 were duplicates, leaving 520 articles for review. After exclusion of 401 articles by title and abstract, 119 articles underwent full-text review. Of the full-text articles, 102 were excluded because IgG-specific and polyspecific ELISAs were not performed on the same samples (n = 81), patients without clinical suspicion of HIT were enrolled (n = 8), the article was a review or editorial and did not report primary data (n = 8), the study was published as an abstract only (n = 3), or a confirmatory functional assay was not performed (n = 2). Of the remaining 17 studies, six were excluded because of inability to extract relevant data (n = 4) or use of patient datasets overlapping with those of an included study (n = 2). Nine studies met eligibility criteria and were included in the final meta-analysis [13,15,1925].

Fig. 1.

Fig. 1

PRISMA diagram. Selection of studies included in systematic review and meta-analysis.

Study characteristics

The nine eligible studies collectively enrolled 1948 patients and were performed in seven countries. Characteristics of these studies are summarized in Table 1. Patient populations included a mixture of medical, surgical, cardiovascular surgery, hemodialysis and critically ill patients. The prevalence of HIT among included studies ranged from 0.04 to 0.40, with a weighted pooled prevalence of 0.08 (95% CI, 0.07–0.09). Among nine included studies, six utilized a serotonin-release assay (SRA), one used the heparin-induced platelet activation (HIPA) test and one used a functional flow cytometric assay as part of the reference standard. Seven of the nine included studies made use of washed platelet assays.

Table 1.

Characteristics of studies

References Setting (n) Population (%) Heparin agent Median age (years) No. (%) female Use of washed platelets? Prevalence of HIT Index test
Reference standard
IgG-ELISA [cut-off OD] Poly-ELISA [cut-off OD] IgG-ELISA [cut-off OD] Poly-ELISA [cut-off OD]
Warkentin 2013 [19] Canada, Australia, New Zealand (409*) Mixed medical/surgical from PROTECT trial UFH or dalteparin NR NR Yes 0.04 In-house (McMaster) [> 0.45] Hologic Gen-Probe [> 0.4] 4T score ≥ 4 SRA ≥ 50% release
Cuker 2013 [20] United States (58 samples polyspecific ELISA-positive CV surgery (28), non-CV surgery (14), medical (15), other (1) NR 64 28 (48.2%) No 0.36 Hologic Gen-Probe [> 0.4] Hologic Gen-Probe [> 0.4] Clinical suspicion of HIT. 4T score assigned retrospectively by chart review. Considered true HIT if 4T score ≥ 4. SRA ≥ 50% release
Galea 2013 [21] France (200) Not specified UFH or LMWH NR NR Yes 0.11 Zymutest HIA [> 0.3] Zymutest HIA [> 0.5] Clinical suspicion of HIT. 4T score assigned but all clinical probabilities tested. SRA ≥ 20% release
McFarland 2012 [22] US (116) CV surgery (41), other surgery (14), 0ther medical (45) UFH (92), LMWH (15), both (6), NR (3) 63 54 (46.6%) Yes 0.22 In-house ELISA [≥ 0.4] In-house ELISA [≥ 0.4] Clinical suspicion of HIT. 4T score assigned retrospectively. SRA ≥ 75% release and inhibition with high-dose heparin
Van Hoecke 2012 [13] Belgium (87) CV surgery, hemodialysis, medical (critically ill and treated for thrombosis) UFH or LMWH NR NR No 0.09 Zymutest HIA IgG, calculated cut-off [0.24-0.39] Zymutest HIA IgGAM, calculated cut-off [0.41-0.46] Clinical suspicion of HIT; development of thrombocytopenia with exposure to heparin. Functional flow cytometry (% platelet activation ≥ 2 times control)
Morel-Kopp 2010 [23] Australia (107 samples from 97 individuals) Medical (51), surgical (56); majority low risk by 4T score (75) NR 69 39 (40.2%) Yes 0.11 Zymutest IgG [> 0.4] Zymutest IgGAM [> 0.4] Clinical suspicion of HIT. 4T score assigned, but all clinical probabilities tested. SRA ≥ 20% release
Pouplard 2010 [24] France (101) Medical (32), surgical (42), CV surgical (27) UFH or LMWH NR 44 (43.6%) Yes 0.40 Zymutest HIA IgG, [≥ 0.5] Zymutest HIA IgGAM, [≥ 0.5] Clinical suspicion of HIT SRA ≥ 20% release
Bakchoul 2009 [25] Germany (500) Mixed medical and surgical UFH or LMWH NR NR Yes 0.07 In-house IgG-ELISA [> 0.40] Poly-ELISA GTI [> 0.4] 4T score ≥ 4 HIPA (loss of turbidity in 30 min in at least two suspensions of 0.2 U mL−1 but not 100 U mL−1)
Warkentin 2008 [15] Canada (405) Mixed medical, surgical, including ICU and CV surgery NR NR NR Yes 0.10 In-house IgG-ELISA [≥ 0.45] Poly-ELISA GTI [≥ 0.4] Clinical suspicion of HIT. 4T score assigned at time of enrollment, but all clinical probabilities tested. SRA ≥ 50% release
*

One patient not tested by polyspecific ELISA because of insufficient sample.

Mean value.

Six patients underwent IgG-specific but not polyspecific testing because of insufficient sample. HIT, heparin-induced thrombocytopenia; NR, not reported; UFH, unfractionated heparin; OD, optical density; SRA, serotonin-release assay; CV, cardiovascular; LMWH, low-molecular- weight heparin; ICU, intensive care unit.

Among the polyspecific ELISAs, six utilized a cut-off OD of ≥ 0.4 and two a cut-off OD of ≥ 0.5 [21,24]. Among the IgG-specific ELISAs, one study utilized a cut-off OD of ≥ 0.3 [21], four utilized ≥ 0.4 [20,22,23,25], two utilized ≥ 0.45 [15,19] and one utilized ≥ 0.5 [24]. In the study by van Hoecke et al. [13], a calculated cut-off OD developed by the manufacturer was used for both IgG-specific and polyspecific ELISA. This ‘calculated cut-off’ was defined as percentage of the OD of the positive control minus OD of the blank. The reported ranges of calculated OD cut-offs were 0.24–0.39 for IgG-specific and 0.41–0.46 for polyspecific ELISA.

For one study [23], two different IgG (Zymutest and GTI-PF4-IgG) and polyspecific (Zymutest and Asserachrom® IgGAM) ELISA pairs were analyzed per patient sample. In this case, data from the Zymutest IgG and Zymutest polyspecific ELISA comparison were included with exclusion of results from the alternate assays (GTI-PF4-IgG and Asserachrom® IgGAM) to minimize heterogeneity and maintain independency of observations. Although all studies included patients in whom there was ‘clinical suspicion of HIT’, only three [19,20,25] of the nine studies included a clinical assessment (e.g. 4T score ≥ 4) as part of the reference standard in accordance with ISTH-SSC recommendations.

Study quality

Quality assessment as judged by the QUADAS-2 tool highlighted several significant limitations of included studies in both risk of bias and concerns regarding applicability to clinical practice. Three of nine studies had a high risk of bias with regards to patient selection because of non-consecutive patient sampling [20,22,24]. In the study by Cuker et al. [20], only patients in whom there was clinical suspicion of HIT who had a positive polyspecific ELISA result subsequently underwent testing by IgG-specific ELISA and SRA. In the study by McFarland et al. [22], patients were selected for inclusion based upon their ELISA OD result. Pouplard et al. [24] described patient sampling as ‘non-consecutive’.

Regarding the index test, one study carried a low risk of bias because it stated that results of ELISA testing were reported without knowledge of results of the reference standard [23]. The remaining studies made no mention of blinding to reference standard results and therefore carried uncertain risk. In regards to the reference standard, four studies carried high risk of bias because the reference standard either did not use washed platelets [13,20] or did not clearly include clinical criteria [15,23]. Additionally, in the study by McFarland et al. [22], the authors acknowledged that 4T scores were assigned retrospectively, and both treating clinicians and researchers had knowledge of laboratory assay results at the time of scoring. In the remaining studies, exact clinical assessment was unclear or there was no mention of whether reference standard results were interpreted without knowledge of the index test results; in these cases, risk of bias was classified as uncertain. Regarding flow and timing, there were risks of bias identified in studies where it was presumed but not unequivocally stated that all patients received the same reference standard (in particular, the same clinical scoring system) [25] or where not all patients were included in the analysis [15,22,23].

All studies carried a low concern for applicability in patient selection, as inclusion criteria mandated clinical suspicion for HIT in all tested subjects. All studies carried a high concern for clinical applicability in regards to the reference standard, as the functional laboratory assay utilized in each study was developed by and performed within individual institutions and not commercially available for widespread use. Concern for applicability of index tests was considered low for the five studies utilizing commercially available ELISAs [13,20,21,23,24] and high for the remaining four studies that utilized in-house ELISAs [15,19,22,25]. Additional details of study quality assessment scoring can be found in Table 2.

Table 2.

Study quality assessment by QUADAS-2 criteria

Risk of bias
Applicability concerns
References Patient selection Index test Reference standard Flow and timing Patient selection Index test Reference standard
Warkentin* 2013 [19] Low Unclear Low Low Low High High
Cuker 2013 [20] High Unclear High Low Low Low High
Galea 2013 [21] Low Unclear Unclear Low Low Low High
McFarland 2012 [22] High Unclear High High Low High High
Van Hoecke 2012 [13] Low Unclear High Low Low Low High
Morel-Kopp 2010 [23] Low Low High High Low Low High
Pouplard 2010 [24] High Unclear Low Low Low Low High
Bakchoul 2009 [25] Low Unclear Unclear Low Low High High
Warkentin 2008 [15] Low Unclear High High Low High High
*

Determined from data reported in original article, the PROTECT trial, and discussions with Dr. Theodore Warkentin.

Primary analysis: diagnostic accuracy of IgG versus polyspecific ELISA

Pooled data from all nine studies demonstrated identical sensitivity for the IgG-specific and polyspecific ELISAs (0.97; 95% confidence interval (CI), 0.95–0.99) and superior specificity of the IgG-specific compared with the polyspecific ELISA (0.87 [0.85–0.88] vs. 0.82 [0.80-0.84]) at standard cut-offs. Individual and pooled sensitivity and specificity data for the full cohort are shown in Table 3 and presented as Forest plots in Fig. 2. The negative predictive values (NPVs) for both IgG-specific and polyspecific immunoassays were equally high (0.99 [0.99–1.00] for both). The positive predictive value (PPV) for IgG-specific ELISA (0.56 [0.52–0.61]) was superior to that of polyspecific ELISA (0.32 [0.28–0.35]). Positive LR was higher for the IgG-specific compared with the polyspecific ELISA (7.38 vs. 5.07) and negative LRs were equivalent for both assays (Table 4).

Table 3.

Sensitivity and specificity of IgG-specific and polyspecific ELISA

Sensitivity (95% CI)
Specificity (95% CI)
Subgroup (n) IgG-specific Polyspecific IgG-specific Polyspecific
Full cohort (9) 0.97 (0.97–0.99) 0.97 (0.97–0.99) 0.87 (0.85–0.88) 0.82 (0.80–0.84)
Serotonin-release assay as confirmatory assay (7) 0.97 (0.94–0.99) 0.97 (0.94–0.99) 0.87 (0.85–0.88) 0.82 (0.80–0.84)
Zymutest IgG and polyspecific commercial assay (4) 0.96 (0.92–1.00) 0.96 (0.92–1.00) 0.91 (0.88–0.94) 0.86 (0.82–0.89)
Other IgG and polyspecific commercial assay or in-house assay (4) 0.98 (0.95–1.00) 0.98 (0.95–1.00) 0.85 (0.83–0.87) 0.79 (0.77–0.81)

Fig. 2.

Fig. 2

Forest plots of sensitivity and specificity of IgG-specific and polyspecific antiplatelet factor 4/heparin enzyme-linked immunoassays for eligible studies.

Table 4.

Operating characteristics of IgG-specific and polyspecific ELISA

Sensitivity (95% CI) Specificity (95% CI) PPV (95% CI) NPV (95% CI) PLR* NLR*
IgG-specific 0.97 (0.97–0.99) 0.87 (0.85–0.88) 0.56 (0.52–0.61) 0.99 (0.99–1.00) 7.38 0.03
Polyspecific 0.97 (0.97–0.99) 0.82 (0.80–0.84) 0.32 (0.28–0.35) 0.99 (0.99–1.00) 5.07 0.03

CI, confidence interval; PPV, positive predictive value; NPV, negative predictive value; PLR, positive likelihood ratio; NLR, negative likelihood ratio.

*

Calculated as point estimates from sensitivity and specificity.

Sensitivity and subgroup analyses

Seven studies utilized an SRA as the functional assay included in their reference standard. As in the overall cohort, sensitivities of the IgG-specific and polyspecific ELISA tests were identical (0.97 [0.94–0.99]) in these seven studies, and specificity of the IgG ELISA was superior to that of the polyspecific ELISA (0.87 [0.85–0.88] vs. 0.82 [0.80–0.84]). The heterogeneity of the SRAs used in this subgroup should be noted: six studies used washed platelets [15,19,2124] and one used platelet-rich plasma [20]. Additionally, three different positivity thresholds were used: ≥ 20% [20,21,23,24], ≥ 50% [15,19] and ≥ 75% serotonin release [22].

Four studies utilized the Zymutest IgG-specific and polyspecific ELISAs [13,21,23,24]. The remaining studies used either in-house immunoassays [22], an alternate commercial ELISA (Hologic-GTI) [20] or a combination of in-house and commercial assays [15,19,25]. Among the studies that used the Zymutest assays, sensitivity was identical for IgG-specific and polyspecific ELISAs (0.96 [0.92–1.00]) and was similar to the sensitivity observed in the full cohort. Also consistent with the full cohort, the Zymutest IgG-specific ELISA exhibited greater specificity compared with the Zymutest polyspecific assay, although the confidence intervals overlapped (0.91 [0.88–0.94] vs. 0.86 [0.82–0.89]).

Of the nine eligible studies, only two [19,25] used a reference standard that included both clinical criteria and a washed platelet functional assay in accordance with ISTH-SSC recommendations. Only one study [19] stratified a subset of SRA-positive patients (n = 17) by 4T score. Therefore, the prespecified sub-analyses by either alignment with ISTH-SSC testing recommendations or by pretest clinical probability score could not be performed.

Discussion

Key findings

IgG-specific and polyspecific ELISAs demonstrated equally high sensitivity across various reference standards and subgroups; specificity of the polyspecific assay, however, was consistently lower than that of the IgG-specific ELISA. The IgG-specific ELISA also conferred a higher PPV than the polyspecific ELISA, although both modalities retained high NPV. Sensitivity analyses among studies utilizing an SRA as part of the reference standard showed similar results. These findings imply that the IgG-specific ELISA has superior diagnostic accuracy compared with the polyspecific ELISA at standard OD thresholds.

Strengths and limitations

The greater specificity of the IgG-specific ELISA is consistent with the notion that IgG antibodies carry the primary, if not sole, potential for pathogenicity in HIT and supports the ISTH-SSC recommendation to use IgG-specific antibody testing in preference to a polyspecific assay. However, our results are inconsistent with a recent meta-analysis by Nagler and colleagues [7], which did not demonstrate an appreciable difference in specificity between the polyspecific and IgG-specific ELISAs. A potential explanation for this discrepancy may be the incorporation of very different studies into the polyspecific and polyspecific and IgG-specific ELISA subgroups. The disparate assays, study populations, study designs and reference standards among groups the analysis could have contributed to misleading results. For example, in one study of patients in the medical intensive care unit, the point estimate of specificity for the polyspecific ELISA was 93.3%, higher than that observed in most studies [26]. This study did not include an IgG-specific ELISA and therefore contributed data to the pooled estimates of the diagnostic accuracy of the polyspecific but not the IgG-specific ELISA [7]. To minimize the potential effects of study heterogeneity, we limited our analysis to studies in which the polyspecific and IgG-specific ELISAs were directly compared with one another using the same patient samples and reference standard.

Nearly all eligible studies used a cut-off of 0.4–0.5 OD units (Table 1). Although cut-offs in this range are consistent with manufacturer-recommended thresholds for commercial kits and are in wide clinical use, multiple studies suggest that both ‘intermediate’ (0.8–1.4) and ‘high’ (≥ 1.4) OD cut-offs may improve diagnostic accuracy [7,15,2527]. We were not able to assess the diagnostic accuracy of the polyspecific and IgG-specific ELISAs at higher cut-offs because these thresholds were not investigated in all but one of the eligible studies [13]. We cannot exclude the possibility that a somewhat higher cut-off for the polyspecific ELISA would yield operating characteristics similar to those of the IgG-specific ELISA.

We included secondary pooled point estimates of predictive values and likelihood ratios because these data are often sought by clinicians weighing the performance merits of a diagnostic test [28]. However, we acknowledge these parameters are not only challenging to assess and interpret in a meta-analysis, but their validity and reporting are controversial [29]. Predictive values depend on disease prevalence [30,31], which differed among included studies. Pooled estimates of predictive value should therefore be interpreted with caution. Furthermore, meta-analysis of LRs is mathematically complex. Often when meta-analysis of LRs is performed it does not accurately represent this test characteristic [29]. Thus, some experts suggest exclusion of LRs in meta-analysis of diagnostic accuracy. An alternative is to derive LRs from pooled sensitivity and specificity estimates. We chose this second approach in our study [29].

The quality of included studies varied and was often difficult to assess because of incomplete reporting of methodology. Inclusion of exclusively published studies and English-language studies raises the possibility of publication bias and language bias, although the impact, if any, is expected to be small in meta-analyses of diagnostic accuracy [32,33].

Implications for clinical practice

Test characteristics reported here can be used as part of a diagnostic algorithm to aid in clinical decision-making. The LRs generated for both the IgG-specific and polyspecific ELISAs at low-threshold ODs (Table 4) can be combined with clinical estimates of the pretest probability of disease using tools such as the 4Ts score, HIT Expert Probability (HEP) score or other standardized means of pretest probability assessment to estimate the post-test probability of disease [3437].

For clinical laboratories establishing immunoassay testing for HIT, this study offers direct comparison of test performance to inform choice of assay. For coagulation laboratories experienced in using either IgG-specific or polyspecific ELISA, these results may either reinforce confidence or highlight limitations in local testing practices. The superior diagnostic accuracy of IgG-specific ELISA demonstrated in this study suggests that IgG-specific ELISA, compared with polyspecific ELISA, should reduce the number of false-positive results in initial screening for HIT without compromising sensitivity. These results are aligned with the ISTH-SSC recommendations in favor of IgG-specific testing.

Addendum

H. D. Husseinzadeh designed the study protocol, conducted the literature search, reviewed eligible studies, abstracted data, conducted statistical analysis, and wrote the manuscript. P. Gimotty assisted with statistical analysis, and revised the manuscript. A. M. Pishko reviewed eligible studies, abstracted data, and revised the manuscript. M. Buckley confirmed extracted data values included in meta-analysis. T. E. Warkentin provided critical data and revised the manuscript. A. Cuker developed the study concept, designed the study protocol and wrote the manuscript.

Supplementary Material

Supplement 1

Data S1. QUADAS-2 quality assessment questions.

Essentials.

  • Immunoassay specificity varies in heparin-induced thrombocytopenia (HIT) testing.

  • This meta-analysis examined 9 studies that tested samples by both IgG and polyspecific methods.

  • IgG-specific assays confer superior diagnostic accuracy compared with polyspecific assays.

  • These results further support recommendations in favor of IgG-specific testing.

Acknowledgments

The authors would like to thank M. Z. Levy and M. Mitchell for additional methodological advice and input. H. D. Husseinzadeh received salary support from the National Institute of Health (T32 HL007971-13) and the 2016 HTRS/Novo Nordisk Clinical Fellowship Award in Hemophilia and Rare Bleeding Disorders.

Footnotes

Disclosure of Conflict of Interests

A. Cuker has served as a consultant for Amgen, BiogenIdec, Genzyme, and Diagnostica Stago, and has received research support from Biogen-Idec and T2 Biosystems. T. E. Warkentin has received royalties from Informa (Taylor & Francis) and lecture honoraria from Instrumentation Laboratory and Pfizer Canada; has provided consulting services to and/or has received research funding from Aspen Global, Instrumentation Laboratory, Medtronic Diabetes, and W.L. Gore; and has provided expert witness testimony relating to HIT and non-HIT thrombocytopenic and coagulopathic disorders. The other authors state that they have no conflict of interest.

Supporting Information

Additional Supporting Information may be found in the online version of this article:

References

  • 1.Amiral J, Bridey F, Dreyfus M, Vissoc AM, Fressinaud E, Wolf M, Meyer D. Platelet factor 4 complexed to heparin is the target for antibodies generated in heparin-induced thrombocytopenia. Thromb Haemost. 1992;68:95–6. [PubMed] [Google Scholar]
  • 2.Amiral J, Bridey F, Wolf M, Boyer-Neumann C, Fressinaud E, Vissac AM, Peynaud-Debayle E, Dreyfus M, Meyer D. Antibodies to macromolecular platelet factor 4-heparin complexes in heparin-induced thrombocytopenia: a study of 44 cases. Thromb Haemost. 1995;73:21–8. [PubMed] [Google Scholar]
  • 3.Chong BH, Fawaz I, Chesterman CN, Berndt MC. Heparin-induced thrombocytopenia: mechanism of interaction of the heparin-dependent antibody with platelets. Br J Haematol. 1989;73:235–40. doi: 10.1111/j.1365-2141.1989.tb00258.x. [DOI] [PubMed] [Google Scholar]
  • 4.Greinacher A, Juhl D, Strobel U, Wessel A, Lubenow N, Selleng K, Eichler P, Warkentin TE. Heparin-induced thrombocytopenia: a prospective study on the incidence, platelet-activating capacity and clinical significance of antiplatelet factor 4/heparin antibodies of the IgG, IgM, and IgA classes. J Thromb Haemost. 2007;5:1666–73. doi: 10.1111/j.1538-7836.2007.02617.x. [DOI] [PubMed] [Google Scholar]
  • 5.Greinacher A, Potzsch B, Amiral J, Dummel V, Eichner A, Mueller-Eckhardt C. Heparin-associated thrombocytopenia: isolation of the antibody and characterization of a multimolecular PF4-heparin complex as the major antigen. Thromb Haemost. 1994;71:247–51. [PubMed] [Google Scholar]
  • 6.Warkentin TE, Greinacher A, Gruel Y, Aster RH, Chong BH. Scientific and Standardization Committee of the International Society on Thrombosis and Haemostasis. Laboratory testing for heparin-induced thrombocytopenia: a conceptual framework and implications for diagnosis. J Thromb Haemost. 2011;9:2498–500. doi: 10.1111/j.1538-7836.2011.04536.x. [DOI] [PubMed] [Google Scholar]
  • 7.Nagler M, Bachmann LM, ten Cate H, ten Cate-Hoek A. Diagnostic value of immunoassays for heparin-induced thrombocytopenia: a systematic review and meta-analysis. Blood. 2016;127:546–57. doi: 10.1182/blood-2015-07-661215. [DOI] [PubMed] [Google Scholar]
  • 8.Pierce W, Mazur J, Greenberg C, Mueller J, Foster J, Lazarchick J. Evaluation of heparin-induced thrombocytopenia (HIT) laboratory testing and the 4Ts scoring system in the intensive care unit. Ann Clin Lab Sci. 2013;43:429–35. [PubMed] [Google Scholar]
  • 9.Crowther MA, Cook DJ, Albert M, Williamson D, Meade M, Granton J, Skrobik Y, Langevin S, Mehta S, Hebert P, Guyatt GH, Geerts W, Rabbat C, Douketis J, Zytaruk N, Sheppard J, Greinacher A, Warkentin TE. The 4Ts scoring system for heparin-induced thrombocytopenia in medical-surgical intensive care unit patients. J Crit Care. 2010;25:287–93. doi: 10.1016/j.jcrc.2009.12.006. [DOI] [PubMed] [Google Scholar]
  • 10.Warkentin TE, Sheppard JA, Horsewood P, Simpson PJ, Moore JC, Kelton JG. Impact of the patient population on the risk for heparin-induced thrombocytopenia. Blood. 2000;96:1703–8. [PubMed] [Google Scholar]
  • 11.Bauer TL, Arepally G, Konkle BA, Mestichelli B, Shapiro SS, Cines DB, Poncz M, McNulty S, Amiral J, Hauck WW, Edie RN, Mannion JD. Prevalence of heparin-associated antibodies without thrombosis in patients undergoing cardiopulmonary bypass surgery. Circulation. 1997;95:1242–6. doi: 10.1161/01.cir.95.5.1242. [DOI] [PubMed] [Google Scholar]
  • 12.Trossaert M, Gaillard A, Commin PL, Amiral J, Vissac AM, Fressinaud E. High incidence of anti-heparin/platelet factor 4 antibodies after cardiopulmonary bypass surgery. Br J Haematol. 1998;101:653–5. doi: 10.1046/j.1365-2141.1998.00750.x. [DOI] [PubMed] [Google Scholar]
  • 13.Van Hoecke F, Devreese K. Evaluation of two new automated chemiluminescent assays (HemosIL(R) AcuStar HIT-IgG and HemosIL(R) AcuStar HIT-Ab) for the detection of heparin-induced antibodies in the diagnosis of heparin-induced thrombocytopenia. Int J Lab Hematol. 2012;34:410–6. doi: 10.1111/j.1751-553X.2012.01413.x. [DOI] [PubMed] [Google Scholar]
  • 14.Lo GK, Sigouin CS, Warkentin TE. What is the potential for overdiagnosis of heparin-induced thrombocytopenia? Am J Hematol. 2007;82:1037–43. doi: 10.1002/ajh.21032. [DOI] [PubMed] [Google Scholar]
  • 15.Warkentin TE, Sheppard JI, Moore JC, Sigouin CS, Kelton JG. Quantitative interpretation of optical density measurements using PF4-dependent enzyme-immunoassays. J Thromb Haemost. 2008;6:1304–12. doi: 10.1111/j.1538-7836.2008.03025.x. [DOI] [PubMed] [Google Scholar]
  • 16.Warkentin TE, Sheppard JI, Moore JC, Kelton JG. The use of well-characterized sera for the assessment of new diagnostic enzyme-immunoassays for the diagnosis of heparin-induced thrombocytopenia. J Thromb Haemost. 2010;8:216–8. doi: 10.1111/j.1538-7836.2009.03645.x. [DOI] [PubMed] [Google Scholar]
  • 17.Borenstein M, Hedges L, Higgins J, Rothstein H. A basic introduction to fixed-effect and random-effects models for meta-analysis. Res Synth Methods. 2010;1:97–111. doi: 10.1002/jrsm.12. [DOI] [PubMed] [Google Scholar]
  • 18.Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155:529–36. doi: 10.7326/0003-4819-155-8-201110180-00009. [DOI] [PubMed] [Google Scholar]
  • 19.Warkentin TE, Sheppard JA, Heels-Ansdell D, Marshall JC, McIntyre L, Rocha MG, Mehta A, Davies AR, Bersten AD, Crozier TM, Ernest D. Heparin-induced thrombocytopenia in medical surgical critical illness. Chest. 2013;144:848–58. doi: 10.1378/chest.13-0057. [DOI] [PubMed] [Google Scholar]
  • 20.Cuker A, Rux AH, Hinds JL, Cruz MD, Yarovoi SV, Brown IA, Yang W, Konkle BA, Arepally GM, Watson SP, Cines DB. Novel diagnostic assays for heparin-induced thrombocytopenia. Blood. 2013;121:3727–32. doi: 10.1182/blood-2013-01-479576. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Galea V, Khaterchi A, Robert F, Gerotziafas G, Hatmi M, Elalamy I. Heparin-induced multiple electrode aggregometry is a promising and useful functional tool for heparin-induced thrombocytopenia diagnosis: confirmation in a prospective study. Platelets. 2013;24:441–7. doi: 10.3109/09537104.2012.724736. [DOI] [PubMed] [Google Scholar]
  • 22.McFarland J, Lochowicz A, Aster R, Chappell B, Curtis B. Improving the specificity of the PF4 ELISA in diagnosing heparin-induced thrombocytopenia. Am J Hematol. 2012;87:776–81. doi: 10.1002/ajh.23248. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Morel-Kopp MC, Aboud M, Tan CW, Kulathilake C, Ward C. Heparin-induced thrombocytopenia: evaluation of IgG and IgGAM ELISA assays. Int J Lab Hematol. 2011;33:245–50. doi: 10.1111/j.1751-553X.2010.01276.x. [DOI] [PubMed] [Google Scholar]
  • 24.Pouplard C, Leroux D, Regina S, Rollin J, Gruel Y. Effectiveness of a new immunoassay for the diagnosis of heparin-induced thrombocytopenia and improved specificity when detecting IgG antibodies. Thromb Haemost. 2010;103:145–50. doi: 10.1160/TH09-04-0253. [DOI] [PubMed] [Google Scholar]
  • 25.Bakchoul T, Giptner A, Najaoui A, Bein G, Santoso S, Sachs UJ. Prospective evaluation of PF4/heparin immunoassays for the diagnosis of heparin-induced thrombocytopenia. J Thromb Haemost. 2009;7:1260–5. doi: 10.1111/j.1538-7836.2009.03465.x. [DOI] [PubMed] [Google Scholar]
  • 26.Andrews DM, Cubillos GF, Paulino SK, Seckinger DL, Kett DH. Prospective observational evaluation of the particle immunofiltration anti-platelet factor 4 rapid assay in MICU patients with thrombocytopenia. Crit Care. 2013;17:R143. doi: 10.1186/cc12822. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Raschke RA, Curry SC, Warkentin TE, Gerkin RD. Improving clinical interpretation of the anti-platelet factor 4/heparin enzyme-linked immunosorbent assay for the diagnosis of heparin-induced thrombocytopenia through the use of receiver operating characteristic analysis, stratum-specific likelihood ratios, and Bayes theorem. Chest. 2013;144:1269–75. doi: 10.1378/chest.12-2712. [DOI] [PubMed] [Google Scholar]
  • 28.Steurer J, Fischer JE, Bachmann LM, Koller M, ter Riet G. Communicating accuracy of tests to general practitioners: a controlled study. BMJ. 2002;324:824–6. doi: 10.1136/bmj.324.7341.824. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Zwinderman A, Bossuyt P. We should not pool diagnostic likelihood ratios in systematic reviews. Stat Med. 2008;27:687–97. doi: 10.1002/sim.2992. [DOI] [PubMed] [Google Scholar]
  • 30.Leeflang MM, Bossuyt PM, Irwig L. Diagnostic test accuracy may vary with prevalence: implications for evidence-based diagnosis. J Clin Epidemiol. 2009;62:5–12. doi: 10.1016/j.jclinepi.2008.04.007. [DOI] [PubMed] [Google Scholar]
  • 31.Leeflang MM, Deeks JJ, Rutjes AW, Reitsma JB, Bossuyt PM. Bivariate meta-analysis of predictive values of diagnostic tests can be an alternative to bivariate meta-analysis of sensitivity and specificity. J Clin Epidemiol. 2012;65:1088–97. doi: 10.1016/j.jclinepi.2012.03.006. [DOI] [PubMed] [Google Scholar]
  • 32.Juni P, Holenstein F, Sterne J, Bartlett C, Egger M. Direction and impact of language bias in meta-analyses of controlled trials: empirical study. Int J Epidemiol. 2002;31:115–23. doi: 10.1093/ije/31.1.115. [DOI] [PubMed] [Google Scholar]
  • 33.Moher D, Klassen TP, Schulz KF, Berlin JA, Jadad AR, Liberati A. What contributions do languages other than English make on the results of meta-analyses? J Clin Epidemiol. 2000;53:964–72. doi: 10.1016/s0895-4356(00)00188-8. [DOI] [PubMed] [Google Scholar]
  • 34.Lo GK, Juhl D, Warkentin TE, Sigouin CS, Eichler P, Greinacher A. Evaluation of pretest clinical score (4 T’s) for the diagnosis of heparin-induced thrombocytopenia in two clinical settings. J Thromb Haemost. 2006;4:759–65. doi: 10.1111/j.1538-7836.2006.01787.x. [DOI] [PubMed] [Google Scholar]
  • 35.Cuker A, Arepally G, Crowther MA, Rice L, Datko F, Hook K, Propert KJ, Kuter DJ, Ortel TL, Konkle BA, Cines DB. The HIT Expert Probability (HEP) Score: a novel pre-test probability model for heparin-induced thrombocytopenia based on broad expert opinion. J Thromb Haemost. 2010;8:2642–50. doi: 10.1111/j.1538-7836.2010.04059.x. [DOI] [PubMed] [Google Scholar]
  • 36.Cuker A, Gimotty PA, Crowther MA, Warkentin TE. Predictive value of the 4Ts scoring system for heparin-induced thrombocytopenia: a systematic review and meta-analysis. Blood. 2012;120:4160–7. doi: 10.1182/blood-2012-07-443051. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Cuker A. Clinical and laboratory diagnosis of heparin-induced thrombocytopenia: an integrated approach. Semin Thromb Hemost. 2014;40:106–14. doi: 10.1055/s-0033-1363461. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement 1

Data S1. QUADAS-2 quality assessment questions.

RESOURCES