Abstract
We evaluated an ultrasensitive p24 antigen enzyme immunosorbent assay on 802 plasma specimens from 582 infants and children of 0 to 180 days of age. Overall sensitivity and specificity were 91.7% and 98.5%, respectively. After exclusion of infants of less than 7 days of age, the sensitivity and specificity were 93.7% and 98.3%, respectively.
Antibody assays cannot be used to diagnose perinatal human immunodeficiency virus (HIV) infection until after maternal antibodies have waned at 12 to 18 months. In industrialized countries, infants are tested repeatedly during the first 12 to 18 months of life with nucleic acid amplification tests such as HIV DNA or RNA PCRs (2, 5, 15, 20, 28, 32). However, PCR assays are technologically complex, requiring expensive kits and equipment as well as highly trained technologists. Limited budgets and infrastructure in resource-constrained settings require the cost-effective use of laboratory tests. Given these concerns, the WHO strongly encourages the development of technologically simpler, less expensive assays that can be used to diagnose HIV infection in early infancy (31).
One simpler method that is gaining support for the detection of HIV infection in infants is the heat-denatured, signal-amplified p24 (ultrasensitive p24 [Up24]) antigen assay (26). The assay requires only an enzyme immunosorbent assay washer, a reader, a heat block, and an incubator, as opposed to the thermocycler required by nucleic acid technologies. We evaluated the sensitivity and specificity of this assay for early-infancy diagnosis of HIV infection using stored plasma specimens from HIV-exposed infants of 0 to 180 days of age from two U.S. cohorts: the North Carolina Children's AIDS Network cohort (9-11) (n = 154) and the New York City Pediatric AIDS Collaborative Transmission Study (PACTS) cohort (1, 4, 13, 28, 29) (n = 648). Selection criteria included sufficient volume to perform the testing. The children's HIV status had been previously determined by a combination of criteria, including Roche Amplicor HIV DNA testing (version 1.0) and/or HIV culture, as previously described (4, 9-11, 13, 20, 28). Nine of 125 (7%) children in the North Carolina cohort were known to be infected, along with 100 of 457 (22%) children in the PACTS cohort.
(Institutional review boards of Columbia University, the Medical and Health Research Association of New York City, and the Centers for Disease Control and Prevention approved the original PACTS study, which included blood storage for future studies. Specimens from North Carolina were obtained for clinical diagnostic purposes. This work was considered exempt by the institutional review boards of the University of North Carolina and the Centers for Disease Control and Prevention, as excess samples were stripped of identifying information and delinked prior to receipt at the University of North Carolina.)
Plasma specimens were tested for HIV-1 p24 antigen with the Perkin Elmer (Boston, MA) Life Science NEK 050B HIV-1 p24 ELISA kit, the Perkin Elmer NEP116VL ELAST amplification system, and Quanti-Kin Detection System software (Diagnostica Ligure s.r.l, Genoa, Italy), according to the Up24 assay protocol provided by the manufacturer. Sensitivity, specificity, and positive and negative predictive values for the Up24 and HIV DNA assays were determined (25). The final infection status of the child was used as the “gold standard.” Given that multiple specimens per child were tested, these results were computed from repeated measures models fit with generalized estimating equations (GEE) (33). Sensitivity and specificity were computed from a GEE model with the assay result as the dependent variable; positive and negative predictive values were computed from a GEE model with final infection status as the dependent variable. An exchangeable correlation structure was used for all models. All data analyses were performed with SAS software, version 9.1 (SAS Institute Inc., Cary, NC).
We tested 802 specimens from 582 children ranging in age from 0 to 180 days of life (Table 1) in the Up24 antigen assay and 691 specimens from 524 infants in the DNA assay. Overall sensitivity and specificity were 91.7% and 98.5%, respectively, for the Up24 antigen assay, compared to 88.3% and 99.4% for the DNA assay (Table 2). Excluding infants of less than 1 week of age improved the sensitivity (93.7%) and positive and negative predictive values and decreased the specificity slightly (98.3%) for the Up24 antigen assay and improved the sensitivity of the DNA assay. The sensitivity and negative predictive value were slightly better for the Up24 antigen assay, while the specificity and positive predictive value were somewhat better for the DNA assay, though these differences were insignificant.
TABLE 1.
Subject age (days) | HIV DNA result
|
Up24 antigen result
|
||||||
---|---|---|---|---|---|---|---|---|
No. of positive samples/total no. tested
|
Sensitivity | Specificity | No. of positive samples/total no. tested
|
Sensitivity | Specificity | |||
HIV+ | HIV− | HIV+ | HIV− | |||||
0-7 | 2/5 | 0/109 | 0.387 | 0.9995 | 0/5 | 1/109 | —a | 0.999 |
8-30 | 21/25 | 1/141 | 0.857 | 0.995 | 25/29 | 3/151 | 0.900 | 0.987 |
31-90 | 74/83 | 2/226 | 0.897 | 0.993 | 88/94 | 5/273 | 0.933 | 0.980 |
91-180 | 32/33 | 0/69 | 0.943 | 0.988 | 44/45 | 1/96 | 0.941 | 0.977 |
—, could not be determined accurately due to the small numbers of samples tested.
TABLE 2.
Subject age (days) | Result (95% confidence interval)a
|
|||||||
---|---|---|---|---|---|---|---|---|
Up24 with kit buffer
|
HIV DNA assay
|
|||||||
Sensitivity | Specificity | PPV | NPV | Sensitivity | Specificity | PPV | NPV | |
0-180 | 0.917 (0.852-0.955) | 0.985 (0.971-0.992) | 0.940 (0.891-0.968) | 0.975 (0.951-0.987) | 0.883 (0.821-0.926) | 0.994 (0.984-0.998) | 0.977 (0.931-0.993) | 0.970 (0.950-0.982) |
8-180 | 0.937 (0.876-0.970) | 0.983 (0.968-0.991) | 0.946 (0.898-0.972) | 0.979 (0.955-0.990) | 0.900 (0.842-0.938) | 0.993 (0.979-0.998) | 0.977 (0.930-0.993) | 0.969 (0.948-0.981) |
Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were all estimated from a repeated-measures model with GEE. The numbers of samples tested are as follows: Up24 with subjects of 0 to 180 days old, 802; Up24 with subjects of 8 to 180 days old, 688; HIV DNA assay with subjects of 0 to 180 days old, 691; HIV DNA assay with subjects of 8 to 180 days old, 577.
There were 16 false-negative results from 11 individual children among 173 samples from infected infants tested with the Up24 antigen assay. Two children had two specimens each and one child had four different specimens from different time points that were negative in the assay. The median age for specimens with false-negative results was 24 days (range, 0 to 145 days). Specimens with false-positive results in the Up24 antigen assay came from children with a median age of 37 days (range, 3 to 111 days), although most (8 of 10) were in the 19- to 41-day range. In the DNA assay, there were 17 false negatives from 16 individual children among 146 samples tested from children who were infected. The median age for specimens with false-negative results in the DNA assay was 35 days (range, 1 to 104 days). Only three false positives were observed in the DNA assay.
Lyamuya et al. (16) demonstrated that even an early research version of the heat-denatured p24 antigen assay was 99% sensitive and 100% specific in diagnosing HIV subtype A and D infections in 231 samples from 177 children in Tanzania. Similar results have been observed with subtype B in Switzerland (87% sensitivity and 99% specificity [n = 873]) (19), subtype E in Thailand (100% sensitivity and 100% specificity in 142 samples) (30), subtype C in South Africa (n, 203 [27] and 141 [21]) and Zimbabwe (n = 164 [34] [97 to 98% sensitivity and 97 to 99% specificity]), and multiple subtypes from the Democratic Republic of Congo with either plasma (n = 150) (sensitivity, 92.3%; specificity, 100%) or dried plasma spots (n = 87) (sensitivity and specificity, 100%) (6). Our data confirm these previous studies in a very large group (802 samples) of HIV-exposed infants in the United States.
There has been some concern about the specificity of the Up24 assay with very young (less than 1 month old) infants, as the p24 antigen might cross the placenta and be detected (24). However, this may primarily be a problem with the acid-dissociated immune complex-disrupted assay and was not observed by other investigators (3, 17, 18, 22, 23). Many of the previous studies assessing the Up24 antigen assay sampled only children who were at least 6 weeks old (27) or did not discuss in detail the number of samples from those less than 1 month old (6, 30, 34). We tested 109 specimens from infants of 0 to 7 days of age and 151 specimens from infants of 8 to 30 days of age and had only four false positives. Sensitivity increased with age (Table 1), similar to the increased sensitivity observed in both HIV nucleic acid assays and HIV cultures (3, 7, 8). Given limited resources, the most useful time for using virologic assays to diagnose pediatric HIV infection is between 6 and 14 weeks of age, which corresponds to regularly scheduled immunization visits and allows early diagnosis for entry into treatment.
Many field investigators cite the ease of collecting and transporting dried blood spots (DBS) (12), as opposed to phlebotomy of very young children and transportation of whole blood or plasma. Although nucleic acid extraction, amplification, and detection become technologically more complex and expensive with DBS than with whole blood or plasma specimens, widespread access for infant testing will undoubtedly require their use. Patton et al. (21) and Knuchel (14) have recently demonstrated that DBS can be used for Up24 antigen detection. Optimization of this assay for DBS in order to make infant diagnosis of HIV infection feasible in district and provincial hospitals and clinics in all resource-limited countries should be a high priority.
The limitations of this study include the fact that only children with subtype B infection were tested, although, as mentioned above, the assay has performed well with a variety of subtypes (16, 27, 30, 34), with the possible exception of subtype D (14). In addition, all tests were performed in the United States by a technologist with 10 years of experience with different versions of the assay. However, others have successfully transferred this technology to several resource-limited settings (16, 28, 31, 34). The strengths of the study include its very large sample size (802 specimens from 582 children), especially of infants less than 30 days of age.
We found the commercially available Up24 antigen assay to be sensitive and specific for diagnosing perinatal HIV infection in infants. These results and those of others (6, 16, 19, 21, 27, 30, 34) support the use of the assay in regions where DNA PCR is not readily available.
(This work was presented in part at the 12th Conference on Retroviruses and Opportunistic Infections, Boston, MA, 22 to 25 February 2005.)
Acknowledgments
This work was supported in part by PACTG contract 202PVCL04, UNC Center for AIDS Research (CFAR) contract P30 AI50410, and the Centers for Disease Control and Prevention's Perinatal AIDS Collaborative Transmission Study (PACTS). Other members of the New York City PACTS group include the following: from Bronx Lebanon Hospital, Saroj Bakshi, Genevieve Lambert, Elizabeth Adams, and Delia Grant; from Harlem Hospital Center, Susan Champion, Julia Floyd, Cynthia Freeland, Margaret Heagarty, Pamela Prince, Desiree Minnott, and Aretha Bellmore; from Jacobi Hospital Center, Joanna Dobroszycki, Adell Harris, and Andrew Wiznia; from Metropolitan Hospital Center, Mahrukh Bamji, Grace Canillas, Lynn Jackson, and Nancy Cruz; from the Medical and Health Research Association of New York City, Inc., Tina Alford, Rosalind Carter, Mary Ann Chiasson, Eileen Rillamas-Sun, Donald Thea, and Jeremy Weedon; and from Montefiore Medical Center, Ellie Schoenbaum and Marcelle Naccarato. Members of the PACTS group at the Centers for Disease Control and Prevention include April Bell, Linda Koenig, Mary Glenn Fowler, and R. J. Simonds.
We acknowledge helpful discussions with Bernard Branson, Tim Dondero, David Withum, and Dan Newman of the Centers for Disease Control and Prevention in Atlanta, GA. None of the authors have any commercial or other associations that might pose a conflict of interest.
Footnotes
Published ahead of print on 2 May 2007.
REFERENCES
- 1.Abrams, E. J., J. Weiner, R. Carter, L. Kuhn, P. Palumbo, S. Nesheim, F. Lee, P. Vink, and M. Bulterys. 2003. Maternal health factors and early pediatric antiretroviral therapy influence the rate of perinatal HIV-1 disease progression in children. AIDS 17:867-877. [DOI] [PubMed] [Google Scholar]
- 2.Benjamin, D. K., Jr., W. C. Miller, S. A. Fiscus, D. K. Benjamin, M. Morse, M. Valentine, and R. E. McKinney, Jr. 2001. Rational testing of the HIV-exposed infant. Pediatrics 108:E3. [DOI] [PubMed] [Google Scholar]
- 3.Borkowsky, W., K. Krasinski, H. Pollack, W. Hoover, A. Kaul, and T. Hmet-Moore. 1992. Early diagnosis of human immunodeficiency virus infection in children less than 6 months of age: comparison of polymerase chain reaction, culture, and plasma antigen capture. J. Infect. Dis. 166:616-619. [DOI] [PubMed] [Google Scholar]
- 4.Bulterys, M., S. Nesheim, E. Abrams, P. Palumbo, J. Farley, M. Lampe, and M. G. Fowler. 2000. Lack of evidence of mitochondrial dysfunction in the offspring of HIV infected women: retrospective review of perinatal exposure to antiretroviral drugs in the Perinatal AIDS Collaborative Transmission Study. Ann. N. Y. Acad. Sci. 918:212-221. [DOI] [PubMed] [Google Scholar]
- 5.Cunningham, C. K., T. T. Charbonneau, K. Song, D. Patterson, T. Sullivan, T. Cummins, and B. Poiesz. 1999. Comparison of human immunodeficiency virus 1 DNA polymerase chain reaction and qualitative and quantitative RNA polymerase chain reaction in human immunodeficiency virus 1-exposed infants. Pediatr. Infect. Dis. J. 18:30-35. [DOI] [PubMed] [Google Scholar]
- 6.De Baets, A. J., B. S. Edidi, M. J. Kasali, G. Beelaert, W. Schrooten, A. Litzroth, P. Kolsteren, D. Denolf, and K. Fransen. 2005. Pediatric human immunodeficiency virus screening in an African district hospital. Clin. Diagn. Lab. Immunol. 12:86-92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Dunn, D. T., C. D. Brandt, A. Krivins, S. A. Cassol, P. Roques, W. Borkowsky, A. De Rossi, E. Denamur, A. Ehrnst, and C. Loveday. 1995. The sensitivity of HIV-1 DNA polymerase chain reaction in the neonatal period and the relative contributions of intra-uterine and intra-partum transmission. AIDS 9:F7-F11. [DOI] [PubMed] [Google Scholar]
- 8.Dunn, D. T., R. J. Simonds, M. Bulterys, L. A. Kalish, J. Mote, A. de Maria, C. Kind, C. Rudin, E. Denamur, A. Krivine, C. Loveday, and M. L. Newell. 2000. Interventions to prevent vertical transmission of HIV-1: effect on viral detection rate in early infant samples. AIDS 14:1421-1428. [DOI] [PubMed] [Google Scholar]
- 9.Fiscus, S. A., A. A. Adimora, V. J. Schoenbach, W. Lim, R. McKinney, D. Rupar, J. Kenny, C. Woods, and C. Wilfert. 1996. Perinatal HIV infection and the effect of zidovudine therapy on transmission in rural and urban counties. JAMA 275:1483-1488. [PubMed] [Google Scholar]
- 10.Fiscus, S. A., A. A. Adimora, V. J. Schoenbach, R. McKinney, W. Lim, D. Rupar, J. Kenny, C. Woods, C. Wilfert, and V. A. Johnson. 1999. Trends in HIV counseling, testing, and anti-retroviral treatment of HIV-infected women and perinatal transmission in North Carolina. J. Infect. Dis. 180:99-105. [DOI] [PubMed] [Google Scholar]
- 11.Fiscus, S. A., A. A. Adimora, M. L. Funk, V. J. Schoenbach, D. Tristram, W. Lim, R. McKinney, D. Rupar, C. Woods, and C. Wilfert. 2002. Trends in interventions to reduce perinatal HIV-1 transmission in North Carolina. Pediatr. Infect. Dis. J. 21:664-668. [DOI] [PubMed] [Google Scholar]
- 12.Hannon, W. H., J. Boyle, B. Davin, A. Marsden, E. R. B. McCabe, M. Schwartz, et al. 1997. Blood collection on filter paper for neonatal screening programs, 3rd ed. Approved standard LA4-A3. NCCLS, Wayne, PA.
- 13.Kuhn, L., E. J. Abrams, M. Chinchilla, W. Y. Tsai, D. M. Thea, and the New York City Perinatal HIV Transmission Collaborative Study Group. 1996. Sensitivity of HIV-1 DNA polymerase chain reaction in the neonatal period. AIDS 10:1181-1182. [PubMed] [Google Scholar]
- 14.Kunchel, M. C., B. Jullu, C. Shah, Z. Tomasik, M. P. Stoekle, R. F. Speck, D. Nadal, H. Mshinsi, J. Boni, M. Tanner, and J. Schupbach. 2007. Adaptation of the ultrasensitive Up24 antigen assay to dried blood spot testing. J. Acquir. Immune Defic. Syndr. 44:247-253. [DOI] [PubMed] [Google Scholar]
- 15.Lambert, J. S., D. R. Harris, E. R. Stiehm, J. Moye, Jr., M. G. Fowler, W. A. Meyer III, J. Bethel, and L. M. Mofenson. 2003. Performance characteristics of HIV-1 culture and HIV-1 DNA and RNA amplification assays for early diagnosis of perinatal HIV-1 infection. J. Acquir. Immune Defic. Syndr. 34:512-519. [DOI] [PubMed] [Google Scholar]
- 16.Lyamuya, E., U. Bredberg-Raden, A. Massawe, E. Urassa, G. Kawo, G. Msemo, T. Kazimoto, A. Ostborn, K. Karlsson, F. Mhalu, and G. Biberfeld. 1996. Performance of a modified HIV-1 p24 antigen assay for early diagnosis of HIV-1 infection in infants and prediction of mother-to-infant transmission of HIV-1 in Dar es Salaam, Tanzania. J. Acquir. Immune Defic. Syndr. 12:421-426. [DOI] [PubMed] [Google Scholar]
- 17.Mangano, A., G. Pittis, C. Galindez, R. Bologna, and L. Sen. 1998. Reliability of laboratory markers of HIV-1 infection in Argentinean infants at risk of perinatal infection. AIDS Patient Care STDs 12:691-696. [DOI] [PubMed] [Google Scholar]
- 18.Miles, S. A., E. Balden, L. Magpantay, L. Wei, A. Leiblein, D. Hofheinz, G. Toedter, E. R. Steihm, and Y. Bryson. 1993. Rapid serologic testing with immune-complex dissociated HIV p24 antigen for early detection of HIV infection in neonates. N. Engl. J. Med. 328:297-302. [DOI] [PubMed] [Google Scholar]
- 19.Nadal, D., J. Boni, C. Kind, O. E. Varinier, F. Steiner, Z. Tomasik, and J. Schupbach. 1999. Prospective evaluation of amplification-boosted ELISA for heat-denatured p24 antigen for diagnosis and monitoring of pediatric HIV-1 infections. J. Infect. Dis. 180:1089-1095. [DOI] [PubMed] [Google Scholar]
- 20.Nesheim, S., P. Palumbo, K. Sullivan, F. Lee, P. Vink, E. Abrams, and M. Bulterys. 2003. Quantitative RNA testing for diagnosis of HIV-infected infants. J. Acquir. Immune Defic. Syndr. 32:192-195. [DOI] [PubMed] [Google Scholar]
- 21.Patton, J. C., G. G. Sherman, A. H. Coovadia, W. S. Stevens, and T. M. Meyers. 2006. Ultrasensitive human immunodeficiency virus type 1 p24 antigen assay modified for use on dried whole-blood spots as a reliable, affordable test for infant diagnosis. Clin. Vaccine Immunol. 13:152-155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Paul, M. O., G. Toedter, D. Hofheinz, S. Tetali, S. Pelton, M. Marecki, A. Brena, E. J. Abrams, S. Landesman, and S. Pahwa. 1997. Diagnosis of human immunodeficiency virus type 1 infection in infants by immune complex dissociation p24 assay. Clin. Diagn. Lab. Immunol. 4:75-78. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Quinn, T. C., R. Kline, M. W. Moss, R. A. Livingston, and N. Hutton. 1993. Acid dissociation of immune complexes improves diagnostic utility of p24 antigen detection in perinatally acquired human immunodeficiency virus infection. J. Infect. Dis. 167:1193-1196. [DOI] [PubMed] [Google Scholar]
- 24.Rich, K. C., W. Janda, L. A. Kalish, J. Lew, D. Hofheinz, S. Landesman, J. Pitt, C. Diaz, J. Moye, and J. L. Sullivan. 1997. Immune complex-dissociated p24 antigen in congenital or perinatal HIV infection: role in the diagnosis and assessment of risk of infection in infants. J. Acquir. Immune Defic. Syndr. 12:198-203. [DOI] [PubMed] [Google Scholar]
- 25.Rothman, K. J., and S. Greenland. 1998. Modern epidemiology, 2nd ed. Lippincott Williams & Wilkins, Philadelphia, PA.
- 26.Schupbach, J., and J. Boni. 1993. Quantitative and sensitive detection of immune-complexed and free HIV antigen after boiling of serum. J. Virol. Methods 43:247-256. [DOI] [PubMed] [Google Scholar]
- 27.Sherman, G. G., G. Stevens, and W. Stevens. 2004. Affordable diagnosis of HIV infection in infants by p24 antigen detection. Pediatr. Infect. Dis. J. 23:173-176. [DOI] [PubMed] [Google Scholar]
- 28.Simonds, R. J., T. M. Brown, D. M. Thea, S. L. Orloff, R. W. Steketee, F. K. Lee, P. E. Palumbo, and M. L. Kalish. 1998. Sensitivity and specificity of a qualitative RNA detection assay to diagnose HIV infection in young infants. AIDS 12:1545-1549. [DOI] [PubMed] [Google Scholar]
- 29.Stetekee, R. W., E. J. Abrams, D. M. Thea, T. M. Brown, G. Lambert, S. Orloff, J. Weedon, M. Bamji, E. E. Schoenbaum, J. Rapier, and M. L. Kalish. 1997. Early detection of perinatal human immunodeficiency virus (HIV) type 1 infection using HIV RNA amplification and detection. J. Infect. Dis. 175:707-711. [DOI] [PubMed] [Google Scholar]
- 30.Sutthent, R., N. Gaudart, K. Chokpaibulkit, N. Tanliang, C. Kanoksinsombath, and P. Chaisilwatana. 2003. p24 antigen detection assay modified with a booster step for diagnosis and monitoring of HIV-1 infection. J. Clin. Microbiol. 41:1016-1022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.World Health Organization. 2003. Scaling up antiretroviral therapy in resource-limited settings: treatment guidelines for a public health approach. World Health Organization, Geneva, Switzerland. http://www.who.int/3by5/publications/documents/arv_guidelines/en/.
- 32.Young, N. L., N. Shaffer, T. Chaowanachan, T. Chotpitayasunondh, N. Vanparapar, P. A. Mock, N. Waranawat, K. Chokephaibulkit, R. Chuachoowong, P. Wasinrapee, T. D. Mastro, R. J. Simonds, and the Bangkok Collaborative Perinatal HIV Transmission Study Group. 2000. Early diagnosis of HIV-1-infected infants in Thailand using RNA and DNA PCR assays sensitive to non-B subtypes. J. Acquir. Immune Defic. Syndr. 24:401-407. [DOI] [PubMed] [Google Scholar]
- 33.Zeger, S. L., and K. Y. Liang. 1986. Longitudinal data analysis for discrete and continuous outcomes. Biometrics 42:121-130. [PubMed] [Google Scholar]
- 34.Zijenah, L. S., O. Tobaiwa, S. Rusakaniko, K. J. Nathoo, M. Nhembe, P. Matibe, and D. A. Katzenstein. 2005. Signal-boosted qualitative ultrasensitive p24 antigen assay for diagnosis of subtype C HIV-1 infection in infants under the age of 2 years. J. Acquir. Immune Defic. Syndr. 39:391-394. [DOI] [PubMed] [Google Scholar]