Skip to main content
Clinical and Vaccine Immunology : CVI logoLink to Clinical and Vaccine Immunology : CVI
letter
. 2007 Oct;14(10):1389–1391. doi: 10.1128/CVI.00280-07

Biased Report on the IMMY ALPHA Histoplasma Antigen Enzyme Immunoassay for Diagnosis of Histoplasmosis

Joann L Cloud 1,2,3,*, Sean K Bauman 1,2,3, Joy M Pelfrey 1,2,3, Edward R Ashwood 1,2,3
PMCID: PMC2168118  PMID: 17923498

Histoplasmosis can be difficult to diagnose, as patients with the disease present with symptoms similar to those of other endemic mycoses (2, 5, 6). The causative agent, Histoplasma capsulatum, is a dimorphic fungus that can be cultured from patient specimens only after several weeks of incubation. Serology is diagnostic only for immunocompetent patients given appropriate time for an immune response. Histopathology can be diagnostic but requires a tissue sample collected invasively (1, 7). Histoplasma antigen detection using polyclonal antibodies is nonspecific but can be a useful method performed on easy-to-obtain urine samples (8, 9).

We read with interest the study by the investigators at MiraVista Diagnostics (MVD) and MiraBella Technologies (4) evaluating the IMMY ALPHA histoplasma antigen enzyme immunoassay (EIA). Working together, IMMY and ARUP Laboratories developed this test, which has been used in production at ARUP daily since March 2006. Our experience (J.L.C. and E.R.A.) with this assay gives us insights that others may not have. We believe that the MVD study suffers from both technical and clinical flaws.

First, the assay results with control specimens reported by the MVD group are vastly different from those from our experience. In clinical specimens, our positivity rate is 2.9% (based on over 10,000 patient specimens tested), yet LeMonte et al. (4) reported that 16% of control specimens were positive by the IMMY assay. We suspect that lack of experience in using the IMMY reagents allowed the authors to accept technically flawed runs. At ARUP, the IMMY stock calibrator is diluted to make a working calibration set of 2, 10, 30, 100, 300, and 1,000 units. A typical absorbance for the 2.0-unit calibrator is 0.020 and is highly reproducible. The calibration absorbances are fitted to a four-parameter log-logit curve having typical R2 values of 0.998 to 1.000 (1a). Specimens are run in duplicate, and results must agree within 10%. Only specimens having an absorbance greater than the average 2.0-unit calibrator absorbance are considered positive.

Second, the values of the positive results in the LeMonte study appear to be overly rounded (e.g., four values at 2, seven values at 5, and two values at 10, etc., instead of 2.1, 2.5, 3.6, 4.8, 4.9, and 5.0, etc.). This observation and the figure in MVD's poster on this topic (4a) showing a very flat calibration curve lead us to conclude that the IMMY reagents may have been stored improperly or that the substrate color was not allowed to develop properly. Furthermore, IMMY has no records of MVD purchasing reagents, so reagent delivery may have been circuitous enough to compromise their stability. Thus, we suspect that the MVD laboratory used the IMMY reagents in a technically flawed fashion. We (J.L.C. and E.R.A.) would be pleased to test all of the MVD study specimens in the IMMY assay to help resolve the discrepancies. In addition, if MVD would allow ARUP to purchase the MVD reagents, we would be willing to perform the MVD EIA.

On the clinical side, MVD has used one immunoassay to define a true positive without the benefit of other supporting evidence (PCR, serology, or clinical condition and course). Only 22 of 50 cases were positive using the IMMY assay. The authors assumed that any sample that tested positive by their MVD EIA was definitively positive for histoplasmosis. However, the authors had previously reported that specimens from patients confirmed positive for coccidioidomycosis, blastomycosis, penicilliosis, aspergillosis, or paracoccidioidomycosis had tested positive for the histoplasma antigen using the MVD polyclonal EIA (3, 11, 12). The histoplasma antigen-positive specimens were determined to be positive solely on the basis that they generated a positive result using the MVD EIA, which could have been false positive due to cross-reactivity. Culture, serology, histopathology, and clinical information might have been used to definitively assess infection and ultimately confirm histoplasmosis, but these alternative tests were not included in this study. Furthermore, the MVD EIA has been reported to have a false-negative rate of 15 to 30% for urine specimens (10, 13). It is possible that the MVD EIA may have a lower limit of detection (LOD) than the IMMY assay, but studies to determine the LOD were not reported (e.g., the dilution of a moderate positive below the limit of the lowest calibrator in both assays.) An LOD experiment would be valuable but would require parallel testing of a dilution series in both assays.

Third, LeMonte et al. (4) obtained a set of data that included several discrepancies, yet they did not report how the discrepancies were resolved. A new lot number of IMMY reagents should have been tested to see if there was reagent degradation. Aside from the reagent issue, there remains the issue of competency. How was competency for performing the IMMY EIA validated? ARUP Laboratories has had over 1.5 years of experience performing the IMMY EIA after completing an extensive validation. It is advisable that MVD validate the IMMY assay before drawing the conclusions that they have.

We strongly suspect a conflict of interest for MVD, which introduces a significant bias in their study. We would welcome any reagents, regardless of manufacturer, that would lead to an improved histoplasma antigen assay. At this time, both the MVD and IMMY assays have shortcomings, but the LeMonte study does not demonstrate which is best. Currently, if either the MVD EIA or the IMMY EIA is performed, clinical information and patient history are a necessary component of test interpretation. Alternative testing, such as serology, histopathology, and culture, may be suggested as well, if the samples are available. Because antigen testing is fast and requires noninvasive specimens, we will continue working to build a better assay for antigen detection and welcome any research collaborations to make this happen. Until then, we encourage transparency of information and broad collaborations to discover better targets and improved technology for a specific and sensitive antigen detection assay.

Finally, we comment on the philosophy of tightly holding the intellectual property of laboratory tests. Refusing to provide reagents for purchase so that an unbiased evaluation can be performed stifles the advancement of test improvement and stifles the demand for clinically useful tests. We support a philosophy of licensing technology to all interested clinical laboratories and encourage test improvement for those willing to invest the resources. The current histoplasma antigen assays are in need of improvement. That task is best enhanced by the collaboration of interested investigators.

REFERENCES

  • 1.Bialek, R., A. Feucht, C. Aepinus, G. Just-Nübling, V. J. Robertson, J. Knobloch, and R. Hohle. 2002. Evaluation of two nested PCR assays for detection of Histoplasma capsulatum DNA in human tissue. J. Clin. Microbiol. 40:1644-1647. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 1a.Cloud, J. L., S. K. Bauman, B. P. Neary, K. G. Ludwig, and E. R. Ashwood. 2007. Performance characteristics of a polyclonal enzyme immunoassay for the quantitation of Histoplasma antigen in human urine samples. Am. J. Clin. Pathol. 128:18-22. [DOI] [PubMed] [Google Scholar]
  • 2.Kauffman, C. A. 2006. Endemic mycoses: blastomycosis, histoplasmosis, and sporotrichosis. Infect. Dis. Clin. N. Am. 20:645-662. [DOI] [PubMed] [Google Scholar]
  • 3.Kuberski, T., R. Myers, L. J. Wheat, M. Durkin, P. Connolly, B. M. Kubak, D. Bruckner, and D. Pegues. 2007. Diagnosis of coccidioidomycosis by antigen detection using cross-reaction with a Histoplasma antigen. Clin. Infect. Dis. 44:e50-e54. [DOI] [PubMed] [Google Scholar]
  • 4.LeMonte, A., L. Egan, P. Connolly, M. Durkin, and L. J. Wheat. 2007. Evaluation of the IMMY ALPHA Histoplasma antigen enzyme immunoassay for diagnosis of histoplasmosis marked by antigenuria. Clin. Vaccine Immunol. 14:802-803. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4a.LeMonte, A. M., L. L. Egan, P. A. Connoly, M. M. Durkin, and L. J. Wheat. 2007. Abstr. 107th Gen. Meet. Am. Soc. Microbiol., abstr. F-039. American Society for Microbiology, Washington, DC.
  • 5.Lortholary, O., D. W. Denning, and B. Dupont. 1999. Endemic mycoses: a treatment update. J. Antimicrob. Chemother. 43:321-331. [DOI] [PubMed] [Google Scholar]
  • 6.McNeil, M. M., S. L. Nash, R. A. Hajjeh, M. A. Phelan, L. A. Conn, B. D. Plikaytis, and D. W. Warnock. 2001. Trends in mortality due to invasive mycotic diseases in the United States, 1980-1997. Clin. Infect. Dis. 33:641-647. [DOI] [PubMed] [Google Scholar]
  • 7.Weydert, J. A., T. L. Van Natta, and B. R. DeYoung. 2007. Comparison of fungal culture versus surgical pathology examination in the detection of Histoplasma in surgically excised pulmonary granulomas. Arch. Pathol. Lab. Med. 131:780-783. [DOI] [PubMed] [Google Scholar]
  • 8.Wheat, L. J. 1994. Histoplasmosis: recognition and treatment. Clin. Infect. Dis. 19:19-27. [DOI] [PubMed] [Google Scholar]
  • 9.Wheat, L. J. 2001. Laboratory diagnosis of histoplasmosis: update 2000. Semin. Respir. Infect. 16:131-140. [DOI] [PubMed] [Google Scholar]
  • 10.Wheat, L. J., T. Garringer, E. Brizendine, and P. Connolly. 2002. Diagnosis of histoplasmosis by antigen detection based upon experience at the histoplasmosis reference laboratory. Diagn. Microbiol. Infect. Dis. 43:29-37. [DOI] [PubMed] [Google Scholar]
  • 11.Wheat, L. J., E. Hackett, M. Durkin, P. Connolly, R. Petraitiene, T. J. Walsh, K. Knox, and C. Hage. 2007. Histoplasmosis-associated cross-reactivity in the BioRad Platelia Aspergillus enzyme immunoassay. Clin. Vaccine Immunol. 14:638-640. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Wheat, L. J., H. Wheat, P. Connolly, M. Kleiman, K. Supparatpinyo, K. Nelson, R. Bradsher, and A. Restrepo. 1997. Cross-reactivity in Histoplasma capsulatum variety capsulatum antigen assays of urine samples from patients with endemic mycoses. Clin. Infect. Dis. 24:1169-1171. [DOI] [PubMed] [Google Scholar]
  • 13.Williams, B., M. F. Fojtasek, P. Connolly-Stringfield, and L. J. Wheat. 1994. Diagnosis of histoplasmosis by antigen detection during an outbreak in Indianapolis, Ind. Arch. Pathol. Lab. Med. 118:1205-1208. [PubMed] [Google Scholar]
Clin Vaccine Immunol. 2007 Oct;14(10):1389–1391.

Authors’ Reply

L Joseph Wheat 1,*, Ann LeMonte 1

Cloud et al. “suspect that lack of experience in using the reagents allowed the authors to accept technically flawed runs.” The test kits were received promptly and stored refrigerated. Two separate kits were tested to check for inconsistencies related to a defective kit. A highly experienced laboratory supervisor (>20 years of experience with the Histoplasma antigen immunoassay and other commercial EIAs) performed the tests. The IMMY calibrators were run in the IMMY kit on seven different occasions, and the R2s were always between 0.9955 and 0.9997. Also, the optical densities (ODs) of the IMMY calibrators (ODs were 0.016 to 0.02 for the 2-unit calibrator) and duplicate variability (the differences between duplicate results were always <10% of the means) in our experiments were nearly identical to those reported by Cloud et al.

They claim that the false-positive rate that we observed (16%) (3) is inconsistent with their positivity rate of 2.9% in over 10,000 specimens. Please note that they reported an 8% false-positive rate, similar to our 16% rate considering the small sample size (n = 50), when testing specimens that were negative at MVD (1). We were surprised at the low sensitivity and specificity, prompting us to repeat the experiment, at which time we verified the earlier findings using a different kit.

They claim that “the MVD EIA has been reported to have a false-negative rate of 15 to 30% for urine specimens.” In fact, the sensitivity with urine in our second-generation assay has been 98% or greater in specimens from patients with AIDS and disseminated histoplasmosis, the only group studied to date (6).

They further claim that “the MVD EIA may have a lower limit of detection (LOD) than the IMMY assay, but studies to determine the LOD were not reported.” We have reported that the antigen detected in patients with histoplasmosis is a galactomannan, which can be quantified in the MVD Histoplasma antigen EIA. The LOD for Histoplasma galactomannan is about 0.3 ng/ml in the MVD assay, compared to 29 ng/ml in the IMMY kit (Fig. 1).

FIG. 1.

FIG. 1.

Detection of Histoplasma galactomannan in the MVD EIA compared to that of the IMMY ALPHA Histoplasma antigen EIA kit. The galactomannan concentrations of the urine calibrators are shown on the horizontal axis, and the ODs in the antigen assay are shown on the vertical axis. The galactomannan concentrations in the urine calibrators were 39, 28, 19, 14, 10, 6, 3.4, 1.7, and 0.6 ng/ml.

They also state that “we strongly suspect a conflict of interest… which introduces a significant bias in their study” and that “refusing to provide reagents… stifles the demand for clinically useful tests.” We have devoted considerable resources to developing the expertise to produce a highly trusted assay. We reported false-positive results in our original assay in 2002 (2), determined their cause in 2003 (5), created a new assay with improved accuracy in 2004 (6), and further adapted our method to quantitate antigen in 2007 (P. Connolly, submitted for publication). These improvements (4) are the basis for a new technology (L. J. Wheat, fungal-antigen immunoassay, U.S. patent application 20070020711) that could not be replicated by supplying only antibody, as suggested by the authors. For an unbiased analysis, the IMMY kit should be evaluated by several independent laboratories with the proper numbers of cases and appropriate controls, which is required for FDA clearance of complex diagnostic devices intended for use in the United States.

REFERENCES

  • 1.Cloud, J. L., S. K. Bauman, B. P. Neary, K. G. Ludwig, and E. R. Ashwood. 2006. Evaluation of an enzyme immunoassay for the quantitative detection of histoplasma antigen in human urine samples, abstr. C-345, p. 171. Abstr. 106th Gen. Meet. Am. Soc. Microbiol. American Society for Microbiology, Washington, DC.
  • 2.Garringer, T. O., L. J. Wheat, and E. J. Brizendine. 2000. Comparison of an established antibody sandwich method with an inhibition method of Histoplasma capsulatum antigen detection. J. Clin. Microbiol. 38:2909-2913. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.LeMonte, A., L. Egan, P. Connolly, M. Durkin, and L. J. Wheat. 2007. Evaluation of the IMMY ALPHA Histoplasma antigen enzyme immunoassay for diagnosis of histoplasmosis marked by antigenuria. Clin. Vaccine Immunol. 14:802-803. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Wheat, L. J. 2006. Improvements in diagnosis of histoplasmosis. Expert Opin. Biol. Ther. 6:1207-1221. [DOI] [PubMed] [Google Scholar]
  • 5.Wheat, L. J., P. Connolly, M. Durkin, B. K. Book, A. J. Tector, J. Fridell, and M. D. Pescovitz. 2004. False-positive Histoplasma antigenemia caused by antithymocyte globulin antibodies. Transpl. Infect. Dis. 6:23-27. [DOI] [PubMed] [Google Scholar]
  • 6.Wheat, L. J., J. Witt III, M. Durkin, and P. Connolly. 2007. Reduction in false antigenemia in the second generation Histoplasma antigen assay. Med. Mycol. 45:169-171. [DOI] [PubMed] [Google Scholar]

Articles from Clinical and Vaccine Immunology : CVI are provided here courtesy of American Society for Microbiology (ASM)

RESOURCES