Abstract
The sensitivity and specificity of the human immunodeficiency virus (HIV) type 1-specific immunoglobulin G capture enzyme-linked immunosorbent assay (BED-CEIA) were compared with those of the avidity index method to identify recent HIV infection using a panel of 148 samples (81 patients) representing durations of infection ranging from 0 to 222 weeks. The results from the two tests were similar (sensitivity of 80% versus 74% [P = 0.53]; specificity of 86% versus 82% [P = 0.67]).
In Germany, surveillance of the human immunodeficiency virus (HIV) epidemic is based on newly diagnosed HIV infections that are reported to the Robert Koch Institute. The duration of HIV infection in newly diagnosed individuals is usually unknown and can be highly variable. The ability to differentiate recent from chronic HIV type 1 (HIV-1) infections among newly diagnosed patients would greatly improve estimates of incidence.
Janssen et al. (6) first described the use of a serological testing algorithm for recent HIV seroconversion by comparing the enzyme-linked immunosorbent assay (ELISA) reactivity of undiluted serum samples to that of diluted serum samples based on the increase of HIV-specific immunoglobulin G (IgG) antibodies early after infection (“detuned” ELISA). Recently, a commercially available test, the BED-CEIA (Calypte), was approved by the FDA for epidemiological studies. In the BED-CEIA, the increase in antibodies specific for HIV-1 gp41 (branched gp41 peptide derived from subtype B, CRF01_AE, and D) is determined in relation to IgG levels (2, 14). Barin et al. (1) previously developed a test algorithm that uses a mixture of defined HIV antigens (IDE-V3 enzyme immunoassay); however, this test is not commercially available.
The increase of antibody avidity resulting from the somatic hypermutation of IgG genes in B cells early in infection was examined previously by Suligoi et al. (20, 21). An avidity index (AI) that scores the stability of antibody binding in the presence or absence of a chaotropic reagent (guanidine hydrochloride [G]) using an automated ELISA (AxSym HIV1/2gO; Abbott, Delkenheim, Germany) was established. All methods have been used in epidemiological studies (1, 4, 5, 7, 9-13, 15, 16, 18, 19).
The aim of our study was to compare the sensitivity and specificity of BED-CEIA and the AI method for the differentiation of recent (incident) and chronic (prevalent) HIV-1 infections. Both are commercially available or are based on a commercially available test format but rely on different test parameters. The final goal was to identify the test most appropriate for studying HIV incidence in Germany.
Eighty-one adult patients with a defined date of infection and zero to four follow-up samples per patient were selected from the German HIV seroconverter study (3, 8), giving 148 plasma samples to be used for defining optimal sensitivity and specificity and to compare these data to previously reported data. HIV seroconverters are defined as having a documented last negative and first immunoblot-confirmed antibody test or by a first reactive test before completion of seroconversion (ELISA negative/indeterminate and viral load positive or ELISA positive and immunoblot negative/indeterminate).
Samples for the reference panel were selected from the seroconverter cohort according to the following criteria: (i) a maximum time interval between the last negative and first positive antibody test dates of 3 months (n = 9) or an immunoblot-positive follow-up sample from a seroconverter defined by a first reactive test (n = 72), (ii) an antiretrovirally naïve patient, (iii) no AIDS-defining disease, and (iv) HIV-1 subtype B infection (pol subtype). The first reactive test date or the arithmetic mean between the last negative test and the first positive test date was considered to be the best proxy for the date of infection. Samples were collected 0 to 56 months after infection (73 samples in ≤6 months and 75 samples in >6 months). Sample aliquots were stored at −70°C until use.
All samples were tested in duplicate by both methods according to the manufacturers' specifications. For the BED-CEIA testing, samples were diluted 1:100, and a normalized optical density (ODn) was determined using an internal calibrator. An ODn of ≤0.8 indicated duration of infection of ≤6 months (155 days per the package insert).
To determine the AI, samples were prediluted 1:10 in 1 M G (Sigma-Aldrich, Wiesbaden, Germany) or in phosphate-buffered saline (20) before testing with the automated immunoassay (AxSYM HIV1/2gO). Sample/cutoff (S/CO) ratios and AIs were calculated from the ratio of the two measurements [AI = (S/CO) G/(S/CO) phosphate-buffered saline]. An AI of ≤0.8 indicated a duration of infection of less than 6 months (20).
Cutoff values of AI, ODn, and the duration of infection (window period) defining “incident” and “prevalent” samples to determine optimal sensitivity and specificity for the seroconverter sample panel were varied.
Optimal sensitivity (80% [95% confidence interval {CI}, 68, 89]) and specificity (86% [95% CI, 76, 92]) were obtained in the BED-CEIA if an ODn of ≤0.8 and a duration of infection of 5 months (20 weeks) were considered to be the cutoffs separating incident and prevalent samples of the reference sample panel (Fig. 1 and 2). The positive and negative predictive values of the BED-CEIA were 81% and 85%, respectively. For the avidity method, a sensitivity of 74% (95% CI, 61, 84) and a specificity of 82% (95% CI, 72, 89) were optimal if cutoff values of an AI of ≤0.8 and also a duration of infection of less than 5 months were used to define recent infections (Fig. 1 and 2). Using these conditions, the predictive value was 76% (positive) or 80% (negative). Ten incident and six prevalent samples were misclassified by both methods, whereas 9 were misclassified by BED-CEIA alone and 16 were classified by the avidity method alone.
FIG. 1.
Comparison of BED-CEIA and the AI method using the HIV-1 seroconverter reference sample panel. (a) BED-CEIA, with ODn as a function of duration of infection. (b) AI method, with AI as a function of duration of infection. Dashed lines indicate the cutoff values resulting in optimal sensitivity and specificity (ODn of 0.8 [a] and AI of 0.8 [b], with a time window of 5 months [20 weeks] [identical in a and b]). The AI could not be calculated for five incident samples because the extinction in the presence of G was zero.
FIG. 2.
Differentiation of incident and prevalent samples using the BED-CEIA and AI methods. Boxes extend from the 25th percentile to the 75th percentile. The lines inside the boxes represent the median values. Samples of the reference panel are grouped according to ≤5 months or >5 months of duration of infection. Using this cutoff, the best sensitivity and specificity were obtained if combined with the optimal cutoff values of an ODn of 0.8 for BED-CEIA (a) and an AI of 0.8 for the AI method (b) (dashed lines). The AI could not be calculated for five incident samples because the extinction in the presence of G was zero.
The sensitivity and specificity of both methods for detecting incident infections did not differ significantly (P = 0.53 for sensitivity; P = 0.67 for specificity) (Table 1), and combining the results of both tests improved neither sensitivity nor specificity. No parameter correlating with misclassification (viral load, CD4 cell count, and titer of HIV-1-neutralizing antibodies) could be identified (data not shown). We compared specificity and sensitivity with the values reported previously by Parekh et al. (14) and Suligoi et al. (20) because they used similarly well-defined study panels of HIV seroconverters. The sensitivities and specificities of both tests were lower when applied to a sample panel of the German seroconverter cohort, but the difference was not significant (Table 1). The slightly lower sensitivity and specificity could be due to differences in the sample panels. The seroconverter sample panel used here included more samples collected between 6 and 12 months after infection than those used in other studies (14, 20), and most misclassifications were obtained with samples collected close to the cutoff time period between the incident and prevalent categories. Similar results were described previously by Sakarovitch et al. (17), who compared four different assays for detecting recent HIV-1 infections in a West African population and found that all tests, including BED-CEIA, failed to give reliable estimates of HIV incidence. In agreement with our data, this underscores the need to assess serological testing assays for the detection of recent HIV seroconversion using reference panels that are relevant to the study populations with respect to geographical origin and subtype distribution if reliable cutoff values are to be defined. Because antiretroviral treatment and AIDS at later stages of infection might contribute to reduced avidity and low IgG levels (6, 19), thereby increasing the false-incident proportion, such samples were excluded from our panel.
TABLE 1.
Comparison of sensitivities and specificitiesa
Source and test | % Sensitivity (95% CI) | % Specificity (95% CI) | Duration of infection (wk) |
---|---|---|---|
Robert Koch Institut reference panel | |||
BED-CIA (n = 148) | 80 (68-89) | 86 (76-92) | 20 |
Avidity method (n = 148) | 74 (62-84) | 82 (72-89) | 20 |
Previously published data | |||
BED-CIA (n = 622) | 82 (77-86) | 89 (85-92) | 22b |
Avidity method (n = 216) | 88 (71-96) | 86 (80-91) | 24c |
P values were 0.53 for the sensitivity and 0.67 for the specificity of BED-CEIA compared to the avidity method using the Robert Koch Institut reference panel. P values were 0.90 for the sensitivity and 0.47 for the specificity of BED-CEIA reported previously by Parekh et al. (13) compared to data reported in this study; P values were 0.18 for the sensitivity and 0.47 for the specificity of avidity method data reported previously by Suligoi et al. (19) compared to data reported in this study.
One hundred fifty-five days.
Six months.
In contrast to reports claiming that BED-CEIA results in an overestimation of incidence rates (7, 22), fewer samples from the seroconverter panel were classified as being false incident by the BED-CEIA than by the AI method (20% and 26%, respectively) (difference not significant). The optimal window period for incident samples is 5 months based on the seroconverter sample panel, compared to 6 months as indicated using other sample panels (14, 20). Since 89% of the study samples were derived from patients with a first reactive test date, we feel that the sample panel used in this study reflects the true duration of infection very closely.
In conclusion, comparable results were obtained using two methods to differentiate recent from long-standing HIV infection in a sample panel derived from HIV-1 seroconverters with a well-defined date of infection. The major drawback of the AI method is the need to use the automated test version, which, although a standard in commercial diagnostic laboratories, is more expensive than the BED-CEIA in a research setting.
HIV incidence estimations observed through seroconversion in a longitudinal cohort study conducted in North America and The Netherlands correlated well with results of cross-sectional serology-based HIV-1-specific IgG capture ELISA (BED-CEIA) measurements in the same study population from a multicenter vaccine trial (10). However, these results were obtained in regions where HIV subtype B infections are prevalent and might not be unrestrictedly valid in regions where the HIV epidemic is characterized by other subtypes. Furthermore, options for analytical adjustments (such as changing the window period or using more restrictive cutoff values with respect to the predictive values) to improve incidence estimations were described previously (10, 16, 17). Quality assessment of the different assays using well-characterized serum panels would be very useful for evaluating the feasibility of national HIV incidence surveillance programs involving multicenter studies. Monitoring of the trends of HIV incidence is important if populations at increased risk for HIV infection are to be identified and specific preventive measures are to be applied accordingly.
Acknowledgments
We thank all private practitioners and clinic physicians who contributed to this study by providing samples and data from HIV patients.
The study was funded by a grant from the German Federal Ministry of Health.
Footnotes
Published ahead of print on 31 October 2007.
REFERENCES
- 1.Barin, F., L. Meyer, R. Lancar, C. Deveau, M. Gharib, A. Laporte, J. C. Desenclos, and D. Costagliola. 2005. Development and validation of an immunoassay for identification of recent human immunodeficiency virus type 1 infections and its use on dried serum spots. J. Clin. Microbiol. 434441-4447. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Dobbs, T., S. Kennedy, C.-P. Pau, J. S. McDougal, and B. S. Parekh. 2004. Performance characteristics of the immunoglobulin G-capture BED-enzyme immunoassay, an assay to detect recent human immunodeficiency virus type 1 seroconversion. J. Clin. Microbiol. 422623-2628. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Duwe, S., M. Brunn, D. Altmann, O. Hamouda, B. Schmidt, H. Walter, G. Pauli, and C. Kucherer. 2001. Frequency of genotypic and phenotypic drug-resistant HIV-1 among therapy-naive patients of the German Seroconverter Study. J. Acquir. Immune Defic. Syndr. 26266-273. [DOI] [PubMed] [Google Scholar]
- 4.Gouws, E., B. G. Williams, H. W. Sheppard, B. Enge, and S. A. Karim. 2002. High incidence of HIV-1 in South Africa using a standardized algorithm for recent HIV seroconversion. J. Acquir. Immune Defic. Syndr. 29531-535. [DOI] [PubMed] [Google Scholar]
- 5.Hu, D. J., S. Vanichseni, P. A. Mock, N. L. Young, T. Dobbs, R. H. Byers, Jr., K. Choopanya, F. van Griensven, D. Kitayaporn, J. S. McDougal, J. W. Tappero, T. D. Mastro, and B. S. Parekh. 2003. HIV type 1 incidence estimates by detection of recent infection from a cross-sectional sampling of injection drug users in Bangkok: use of the IgG capture BED enzyme immunoassay. AIDS Res. Hum. Retrovir. 19727-730. [DOI] [PubMed] [Google Scholar]
- 6.Janssen, R. S., G. A. Satten, S. L. Stramer, B. D. Rawal, T. R. O'Brien, B. J. Weiblen, F. M. Hecht, N. Jack, F. R. Cleghorn, J. O. Kahn, M. A. Chesney, and M. P. Busch. 1998. New testing strategy to detect early HIV-1 infection for use in incidence estimates and for clinical and prevention purposes. JAMA 28042-48. [DOI] [PubMed] [Google Scholar]
- 7.Karita, E., M. Price, E. Hunter, E. Chomba, S. Allen, L. Fei, A. Kamali, E. J. Sanders, O. Anzala, M. Katende, and N. Ketter. 2007. Investigating the utility of the HIV-1 BED capture enzyme immunoassay using cross-sectional and longitudinal seroconverter specimens from Africa. AIDS 21403-408. [DOI] [PubMed] [Google Scholar]
- 8.Kuecherer, C., G. Poggensee, K. Korn, J. Werning, S. Somogyi, O. Hamouda, and the HIV/AIDS Competence Net. 2006. High level of resistant HIV-1 in newly diagnosed patients both with documented seroconversion and with unknown date of infection, abstr. 10. Abstr. 4th Eur. HIV Drug Resist. Workshop, Monte Carlo, France, 29 to 31 March 2006.
- 9.Martro, E., B. Suligoi, V. Gonzalez, V. Bossi, A. Esteve, J. Mei, and V. Ausina. 2005. Comparison of the avidity index method and the serologic testing algorithm for recent human immunodeficiency virus (HIV) seroconversion, two methods using a single serum sample for identification of recent HIV infections. J. Clin. Microbiol. 436197-6199. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.McDougal, J. S., B. S. Parekh, M. L. Peterson, B. M. Branson, T. Dobbs, M. Ackers, and M. Gurwith. 2006. Comparison of HIV type 1 incidence observed during longitudinal follow-up with incidence estimated by cross-sectional analysis using the BED capture enzyme immunoassay. AIDS Res. Hum. Retrovir. 22945-952. [DOI] [PubMed] [Google Scholar]
- 11.McFarland, W., M. P. Busch, T. A. Kellogg, B. D. Rawal, G. A. Satten, M. H. Katz, J. Dilley, and R. S. Janssen. 1999. Detection of early HIV infection and estimation of incidence using a sensitive/less-sensitive enzyme immunoassay testing strategy at anonymous counseling and testing sites in San Francisco. J. Acquir. Immune Defic. Syndr. 22484-489. [DOI] [PubMed] [Google Scholar]
- 12.Murphy, G., A. Charlett, L. F. Jordan, N. Osner, O. N. Gill, and J. V. Parry. 2004. HIV incidence appears constant in men who have sex with men despite widespread use of effective antiretroviral therapy. AIDS 18265-272. [DOI] [PubMed] [Google Scholar]
- 13.Nesheim, S., B. Parekh, K. Sullivan, M. Bulterys, T. Dobbs, M. Lindsay, M. Cashat-Cruz, B. Byers, and F. Lee. 2005. Temporal trends in HIV type 1 incidence among inner-city childbearing women in Atlanta: use of the IgG-capture BED-enzyme immunoassay. AIDS Res. Hum. Retrovir. 21537-544. [DOI] [PubMed] [Google Scholar]
- 14.Parekh, B. S., M. S. Kennedy, T. Dobbs, C. P. Pau, R. Byers, T. Green, D. J. Hu, S. Vanichseni, N. L. Young, K. Choopanya, T. D. Mastro, and J. S. McDougal. 2002. Quantitative detection of increasing HIV type 1 antibodies after seroconversion: a simple assay for detecting recent HIV infection and estimating incidence. AIDS Res. Hum. Retrovir. 18295-307. [DOI] [PubMed] [Google Scholar]
- 15.Puchhammer-Stockl, E., B. Schmied, A. Rieger, M. Sarcletti, M. Geit, R. Zangerle, and H. Hofmann. 2005. Low proportion of recent human immunodeficiency virus (HIV) infections among newly diagnosed cases of HIV infection as shown by the presence of HIV-specific antibodies of low avidity. J. Clin. Microbiol. 43497-498. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Rehle, T., O. Shisana, V. Pillay, K. Zuma, A. Puren, and W. Parker. 2007. National HIV incidence measures—new insights into the South African epidemic. S. Afr. Med. J. 97194-199. [PubMed] [Google Scholar]
- 17.Sakarovitch, C., F. Rouet, G. Murphy, A. K. Minga, A. Alioum, F. Dabis, D. Costagliola, R. Salamon, J. V. Parry, and F. Barin. 2007. Do tests devised to detect recent HIV-1 infection provide reliable estimates of incidence in Africa? J. Acquir. Immune Defic. Syndr. 45115-122. [DOI] [PubMed] [Google Scholar]
- 18.Saphonn, V., B. S. Parekh, T. Dobbs, C. Mean, L. H. Bun, S. P. Ly, S. Heng, and R. Detels. 2005. Trends of HIV-1 seroincidence among HIV-1 sentinel surveillance groups in Cambodia, 1999-2002. J. Acquir. Immune Defic. Syndr. 39587-592. [PMC free article] [PubMed] [Google Scholar]
- 19.Schwarcz, S., T. Kellogg, W. McFarland, B. Louie, R. Kohn, M. Busch, M. Katz, G. Bolan, J. Klausner, and H. Weinstock. 2001. Differences in the temporal trends of HIV seroincidence and seroprevalence among sexually transmitted disease clinic patients, 1989-1998: application of the serologic testing algorithm for recent HIV seroconversion. Am. J. Epidemiol. 153925-934. [DOI] [PubMed] [Google Scholar]
- 20.Suligoi, B., C. Galli, M. Massi, F. Di Sora, M. Sciandra, P. Pezzotti, O. Recchia, F. Montella, A. Sinicco, and G. Rezza. 2002. Precision and accuracy of a procedure for detecting recent human immunodeficiency virus infections by calculating the antibody avidity index by an automated immunoassay-based method. J. Clin. Microbiol. 404015-4020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Suligoi, B., M. Massi, C. Galli, M. Sciandra, F. Di Sora, P. Pezzotti, O. Recchia, F. Montella, A. Sinicco, and G. Rezza. 2003. Identifying recent HIV infections using the avidity index and an automated enzyme immunoassay. J. Acquir. Immune Defic. Syndr. 32424-428. [DOI] [PubMed] [Google Scholar]
- 22.UNAIDS Reference Group on Estimates, Modelling and Projections. 2006. Statement on the use of the BED assay for the estimation of HIV-1 incidence for surveillance or epidemic monitoring. Wkly. Epidemiol. Rec. 8140. [PubMed] [Google Scholar]