Abstract
Objective
To develop and validate an HIV risk assessment tool to predict HIV acquisition among African women.
Design
Data were analyzed from three randomized trials of biomedical HIV prevention interventions among African women (VOICE, HPTN 035 and FEM-PrEP).
Methods
We implemented standard methods for the development of clinical prediction rules to generate a risk-scoring tool to predict HIV acquisition over the course of one year. Performance of the score was assessed through internal and external validation.
Results
The final risk score resulting from multivariable modeling included age, married/living with a partner, partner provides financial or material support, partner has other partners, alcohol use, detection of a curable sexually transmitted infection, and herpes simplex virus-2 serostatus. Point values for each factor ranged from 0 to 2, with a maximum possible total score of 11. Scores ≥5 were associated with HIV incidence >5 per 100 person-years and identified 91% of incident HIV infections from among only 64% of women. The area under the curve (AUC) for predictive ability of the score was 0.71 (95% confidence interval [CI] 0.68, 0.74), indicating good predictive ability. Risk score performance was generally similar with internal cross-validation (AUC=0.69; 95% CI 0.66, 0.73), and external validation in HPTN 035 (AUC=0.70; 95% CI 0.65, 0.75) and FEM-PrEP (AUC=0.58; 95% CI 0.51, 0.65).
Conclusions
A discrete set of characteristics that can be easily assessed in clinical and research settings were predictive of HIV acquisition over one year. Use of a validated risk score could improve efficiency of recruitment into HIV prevention research and inform scale-up of HIV prevention strategies in women at highest risk.
Keywords: HIV-1 acquisition, African women, clinical prediction rules, AIDS, risk score
Introduction
Globally, women account for more than half of all new HIV infections, with the greatest burden among African women [1]. Several recently completed HIV prevention trials in women have reported high incidence rates, 4-5% per year overall and up to 10% at some sites, despite the provision of comprehensive HIV risk reduction services [2-5]. Given this persistent high HIV incidence, there is an urgent need to develop and deliver effective novel prevention interventions to women at high risk of acquiring HIV.
Risk assessment tools generated using prediction models are commonly used in clinical practice to simplify the identification of individuals at increased risk for a particular health outcome. Empiric HIV risk assessment tools have been developed for several populations, including African heterosexual HIV serodiscordant couples [6] and men who have sex with men (MSM) in the United States [7, 8]. However, despite >20 years of research to define individual correlates of HIV acquisition in African women, an effective, validated tool to identify African women at highest risk of HIV acquisition has not been developed. Such tools could be used in HIV prevention research settings to inform study designs and improve recruitment efficiency, and guide the implementation of HIV prevention activities, such as pre-exposure prophylaxis (PrEP) by prioritizing those at highest risk [9, 10]. Using data from several recently completed HIV biomedical prevention trials, we developed and validated a risk score to predict HIV acquisition in the next year among African women.
Methods
Study Populations
We used data from three clinical trials of biomedical HIV prevention interventions to assess the relationship between demographic, behavioral, partnership and clinical characteristics assessed at enrollment and HIV-1 acquisition risk in the year following assessment.
VOICE [derivation cohort]
Between September 2009 and June 2011, 5,029 women from South Africa, Uganda and Zimbabwe were enrolled into the VOICE study, a randomized, double-blind, placebo controlled trial that assessed the safety and effectiveness of daily oral tenofovir disoproxil fumarate (TDF), oral TDF/emtricitabine (FTC) and 1% vaginal tenofovir gel (TFV) as PrEP for HIV prevention (NCT00705679) [11]. Healthy women were eligible to participate in the trial if they were 18-45 years old, HIV-uninfected, sexually active within the last three months, not pregnant or breastfeeding, willing to use an effective method of contraception, hepatitis B negative and had no evidence of abnormal hepatic or renal function. Planned follow-up was for a minimum of 12 months; however, the TDF and TFV arms were discontinued early for futility. Participants in the TDF/FTC arm and its corresponding placebo comparator continued participation until planned study exit (August 2012). In intent to treat analyses, HIV incidence in the intervention arms did not differ from that in the respective placebo arms.
HIV Prevention Trials Network (HPTN) 035 (validation cohort)
HPTN 035 was a randomized placebo-controlled trial that assessed the safety and effectiveness of BufferGel and 0.5% PRO2000 microbicidal gels for HIV prevention in women (NCT00074425) [5]. Between February 2005 and January 2009, 3,101 women from Malawi, South Africa, United States (US), Zimbabwe, and Zambia were enrolled and randomized to receive BufferGel, 0.5% PRO2000 gel, hydroxyethylcellulose (HEC) placebo gel or condoms alone (no study product); US participants were excluded from the present analysis. Participants who were at least 18 years old, HIV-uninfected, sexually active within the last three months and not pregnant were enrolled and followed for a minimum of 12 months. Neither microbicide significantly reduced the incidence of HIV compared to either control arm.
FEM-PrEP (validation cohort)
Between June 2009 and April 2011, 2,120 women from Kenya, South Africa, and Tanzania were enrolled into the FEM-PrEP trial, a randomized, double-blind, placebo-controlled trial that assessed the safety and effectiveness of daily oral TDF/FTC for HIV prevention (NCT00625404) [3]. Eligible women were 18-35 years old, HIV-uninfected, not pregnant or breastfeeding, willing to use an effective contraceptive method at enrollment and at high-risk for becoming HIV-infected (defined by the study protocol as having one or more vaginal sex acts in the last 2 weeks or more than one sex partner in the previous month). Women were excluded if they tested positive for hepatitis B or had evidence of abnormal hepatic or renal function. Participants were followed for up to one year. In April 2011, the trial was stopped early due to futility.
Protection of Human Subjects
All studies provided participants with comprehensive HIV prevention services during the trial, including risk reduction counseling, free condoms, and treatment of sexually transmitted infections (STI). Participants provided written informed consent and study protocols were approved by applicable local and national ethical and regulatory authorities.
HIV Testing and Laboratory Methods
Participants in all three studies underwent regular HIV testing using standard algorithms, which included HIV rapid testing using Determine HIV 1/2 (Abbott Diagnostic Division; Hoofddorp, Netherlands), OraQuick® (Orasure Technologies; Bethlehem, Pennsylvania, USA), Uni-Gold Recombigen® HIV test (Trinity Biotech; Wicklow, Ireland) SD Bioline HIV-1/2 (Standard Diagnostics Inc., Suwon city, Korea). In VOICE and HPTN 035, confirmatory testing was performed on samples with any positive HIV-1 rapid result using Western blot (Genetics Systems HIV-1 Western Blot kit, BioRad Laboratories; Hercules, CA, USA). Participants in VOICE and FEM-PrEP received monthly HIV testing, while HPTN 035 participants underwent quarterly testing.
Risk Score Development and Validation
Our objective was to develop a simple risk score based on a discrete set of characteristics that could be easily assessed in variety of settings to identify African women at highest risk of HIV acquisition within the following year. We employed methods frequently used to develop prediction rules, which have been used to develop HIV prediction risk scores for other populations [6, 8]. We conducted internal and external validation to ensure the robust performance of the score. Participant follow-up was censored at one year since we hypothesized that characteristics assessed at enrollment would be predictive up to one year from assessment; in addition, prevention strategies typically emphasize that HIV risk be reassessed at least annually (as recommended for PrEP [12]).
Baseline characteristics assessed in VOICE considered for the risk score included demographic, behavioral, clinical and self-reported male partner characteristics that could be easily collected in clinical and research settings. All characteristics were parameterized as categorical variables. Age was dichotomized as less than 25 years versus 25 years or greater as this categorization is frequently used in HIV prevention policy and programmatic settings [13]. We analyzed the relationship between these characteristics and HIV acquisition using univariate Cox proportional hazards among participants who had complete data. Potential predictors that were significantly associated with HIV acquisition in univariate models (p<0.05) were evaluated in a multivariable model. To identify the combination of factors that best predicted HIV risk, we used forwards and backwards stepwise Cox proportional hazards model that evaluated the inclusion or exclusion of potential predictors at each step. All models were stratified by study site. The model with the lowest Akaike Information Criterion (AIC) was chosen as the final model for the risk score [14]. Individual predictors included in the final model were assigned a score by dividing the coefficient for the predictor in the final model by the lowest coefficient among all predictors in the model and rounding to the nearest integer. The sum of the values for each predictor represented the total score for each participant and the HIV incidence for each total score category was calculated. The predictive ability of the total score and each predictor was assessed by calculating area under the receiver operating characteristic (ROC) curve [15]. The score was internally validated using 10-fold cross-validation and the area under the curve (AUC) for the final model was compared with the mean AUC of the 10 different models. Additional performance characteristics (sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV)) were calculated using risk score cut-points that corresponded to an HIV incidence in the risk score category of approximately ≥3% and ≥5%. Incidence curves were generated to assess cumulative HIV incidence by risk score cut-point.
The risk score was externally validated by separately applying it to the HPTN 035 and FEM-PrEP study populations. Since the interventions evaluated in HPTN 035 and FEM-PrEP did not significantly reduce HIV infection risk, the score was applied to all enrolled participants with complete data for key predictors. We calculated the HIV incidence within each score category and determined the AUC (as described above) in order to assess the performance of the risk score in the two study populations. There were slight differences in the availability of baseline data for each study; therefore, the full risk score was adapted to accommodate these differences. The performance of the adapted risk scores was re-assessed in VOICE using the methods described above and then applied to the HPTN 035 and FEM-PrEP populations for external validation.
Although diagnostics for STI detection, including herpes simplex virus type-2 (HSV-2), are available in many resource-limited settings, they may not be accessible in all settings where assessments of HIV risk are likely to occur. With those settings in mind, we planned a priori to assess the performance of a modified risk score that excluded laboratory–based testing using the same methods described above. All analyses were conducted using Stata v12.1 (StataCorp, College Station, TX) and R v2.15.1 (The R Project for Statistical Computing).
Results
Among 5,029 women enrolled in VOICE, 22 had acute HIV infection at baseline, 38 never returned for follow-up, and 142 had incomplete baseline predictor data and were excluded from this analysis. Baseline characteristics of the remaining 4,834 women are presented in Table 1. The majority of women were young (<25 years old), not married or living with a partner, and were from South Africa. Most women (91%) reported vaginal sex in the 4 weeks prior to enrollment, with 1,047 (22%) reporting unprotected sex in the last 7 days. Anal sex in the 3 months prior to enrollment was reported by 842 (17%) participants. There were 263 seroconversions during 4,348 person-years of follow-up (HIV incidence=6.05%; 95% confidence interval [CI] 5.36, 6.83). HIV incidence was highest in South Africa (7.34%), followed by Uganda (2.07%) and Zimbabwe (0.50%).
Table 1. Participant characteristics of women in VOICE, HPTN 035 and FEM-PrEP*.
| Baseline characteristics | Derivation cohort | Validation cohorts | ||||
|---|---|---|---|---|---|---|
|
|
|
|||||
| VOICE N=4,834 |
HPTN 035 N=2,848 |
FEM-PrEP N=1,804 |
||||
| Age, years | 24 | (21, 29) | 25 | (22, 29) | 23 | (20, 27) |
| Age <25 years | 2,446 | (51) | 1,344 | (47) | 1,049 | (58) |
| Married | 1,034 | (21) | 1,869 | (66) | 560 | (31) |
| Living with husband or primary partner | 1,562 | (32) | 2,010 | (71) | 648 | (36) |
| Some secondary school education or higher | 4,454 | (92) | 1,726 | (61) | 1,224 | (68) |
| Participant earns her own income1 | 2,785 | (58) | 1,133 | (40) | 568 | (32) |
| Number of live births | ||||||
| None | 727 | (15) | 145 | (5) | 529 | (29) |
| One | 2,085 | (43) | 877 | (31) | 581 | (32) |
| More than one | 2,022 | (42) | 1,826 | (64) | 694 | (39) |
| Any alcohol use in the past 3 months | 1,269 | (26) | -- | -- | -- | -- |
| Country of enrollment | ||||||
| Kenya | -- | -- | -- | -- | 618 | (34) |
| Malawi | -- | -- | 1,014 | (36) | -- | -- |
| South Africa | 3,901 | (81) | 1,038 | (36) | 1,136 | (63) |
| Tanzania | -- | -- | -- | -- | 50 | (3) |
| Uganda | 307 | (6) | -- | -- | -- | -- |
| Zambia | -- | -- | 316 | (11) | -- | -- |
| Zimbabwe | 626 | (13) | 480 | (17) | -- | -- |
| Partner provides financial or material support | 4,008 | (83) | 2,488 | (87) | -- | -- |
| Primary sex partner has other partners | ||||||
| Yes | 744 | (15) | 370 | (13) | 186 | (10) |
| Don't know | 2,902 | (60) | 913 | (32) | 1,010 | (56) |
| Primary partner is circumcised | ||||||
| Yes | 1,480 | (31) | -- | -- | 902 | (50) |
| Don't know | 571 | (12) | -- | -- | 80 | (4) |
| Any curable STI2 | 946 | (20) | 366 | (13) | 404 | (22) |
| HSV-2 seropositive3 | 2,198 | (45) | 1,194 | (42) | 216 | (34) |
| Family planning method4 | ||||||
| Injectable | 3,432 | (71) | 1,446 | (51) | 1,205 | (67) |
| Oral contraceptive pills | 1,083 | (22) | 593 | (21) | 533 | (30) |
| Implant | 227 | (5) | 35 | (1) | 28 | (1) |
| IUD | 7 | (<1) | -- | -- | 7 | (<1) |
| Bilateral tubal ligation | 134 | (3) | 130 | (5) | 31 | (2) |
| Male condoms | 1,050 | (22) | 547 | (19) | -- | -- |
Data presented as N (%) or median (interquartile range). “--“ = no data were available for the question (not asked or no respondents).
In VOICE and HPTN 035, participants were asked if they earned their own income. In FEM-PrEP, participants were asked about their occupation and those that reported being daily wage earners or salaried wage earners were considered to earn their own income in this analysis.
Chlamydia, gonorrhea, trichomoniasis or syphilis detected at screening.
In FEM-PrEP, HSV-2 testing performed was only performed for the participants enrolled at the Pretoria site (N=628).
VOICE and FEM-PrEP required use of a highly effective method of contraception as a criterion for enrollment. VOICE and HPTN 035, participants could choose more than one option. In FEM-PrEP, participants reported their primary method of contraception. Since participants were required to be on a highly effective contraceptive method at enrollment, male condoms could not be reported as the primary method.
Risk score models
More than 20 baseline characteristics were evaluated for possible inclusion in the risk score, and results from univariate, multivariable and stepwise modeling are presented in Table 2. In the stepwise analysis, the following factors were retained in the final full prediction model: participant age, married or living with husband/primary partner, any alcohol use in the past three months, partner provides financial or material support, partner has other sexual partners, curable STI detected at baseline (C. trachomatis, N. gonorrhoeae, T. vaginalis or syphilis), and HSV-2 serostatus. Although number of live births was associated with HIV acquisition in the univariate analysis, it was not an independent predictor in multivariable analysis. Since the final full model included two laboratory-based factors that could not be evaluated in many clinical settings, we constructed a model for a modified risk score that excluded covariates for any curable STI and HSV-2 serostatus (Table 2). The effect estimates for the each of the factors in modified risk score model were similar to those in the full risk score model.
Table 2. Analysis of select baseline predictors and calculation of the primary and modified risk score.
| Baseline characteristics1 | Univariate analysis | Multivariate analysis | Stepwise Analysis2 | Reg. coef. | Risk score | Modified stepwise analysis3 | Reg. coef. | Risk score | ||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
|
|
|
|
|
|
|
|||||
| HR (95% CI) | HR (95% CI) | HR (95% CI) | ||||||||||
| Age category | ||||||||||||
| <25 years | 1.87 | (1.43, 2.45) | 1.66 | (1.22, 2.24) | 1.70 | (1.28, 2.27) | 0.53 | 2 | 1.57 | (1.19, 2.07) | 0.45 | 2 |
| ≥25 years | 1.00 | --- | 1.00 | --- | 1.00 | --- | --- | 0 | 1.00 | --- | --- | 0 |
| Married or living with husband or primary partner | ||||||||||||
| No | 2.50 | (1.66, 3.75) | 1.82 | (1.18, 2.80) | 1.80 | (1.18, 2.75) | 0.59 | 2 | 1.81 | (1.19, 2.77) | 0.60 | 2 |
| Yes | 1.00 | --- | 1.00 | --- | 1.00 | --- | --- | 0 | 1.00 | --- | --- | 0 |
| Participant earns her own incomes | ||||||||||||
| No | 1.35 | (1.04, 1.75) | 1.28 | (0.95, 1.73) | ||||||||
| Yes | 1.00 | --- | 1.00 | --- | ||||||||
| Number of live births | ||||||||||||
| None | 1.54 | (1.06, 2.23) | 0.88 | (0.56, 1.37) | ||||||||
| One | 1.44 | (1.08, 1.92) | 1.03 | (0.75, 1.41) | ||||||||
| More than one | 1.00 | --- | 1.00 | --- | ||||||||
| Alcohol use in the past 3 months | ||||||||||||
| Yes | 1.66 | (1.26, 2.18) | 1.41 | (1.07, 1.86) | 1.41 | (1.07, 1.87) | 0.35 | 1 | 1.51 | (1.15, 2.00) | 0.41 | 1 |
| No | 1.00 | --- | 1.00 | --- | 1.00 | --- | --- | 0 | 1.00 | --- | --- | 0 |
| Partner provides financial or material support | ||||||||||||
| No | 1.51 | (1.14, 2.00) | 1.37 | (1.03, 1.82) | 1.38 | (1.04, 1.83) | 0.32 | 1 | 1.34 | (1.01, 1.77) | 0.29 | 1 |
| Yes | 1.00 | --- | 1.00 | --- | 1.00 | --- | --- | 0 | 1.00 | --- | --- | 0 |
| Primary sex partner has other partners | ||||||||||||
| Yes | 1.87 | (1.18, 2.95) | 1.65 | (1.04, 2.61) | 1.63 | (1.03, 2.58) | 0.49 | 2 | 1.73 | (1.09, 2.73) | 0.55 | 2 |
| Don't know | 2.05 | (1.45, 2.88) | 1.82 | (1.29, 2.56) | 1.81 | (1.28, 2.54) | 0.59 | 2 | 1.87 | (1.33, 2.64) | 0.63 | 2 |
| No | 1.00 | --- | 1.00 | --- | 1.00 | --- | --- | 0 | 1.00 | --- | --- | 0 |
| Primary partner is circumcised | ||||||||||||
| Yes | 0.88 | (0.66, 1.16) | ||||||||||
| Don't know | 1.33 | (0.92, 1.94) | ||||||||||
| No | 1.00 | --- | ||||||||||
| Any curable STI2 | ||||||||||||
| Yes | 1.81 | (1.40, 2.35) | 1.47 | (1.13, 1.91) | 1.49 | (1.14, 1.93) | 0.40 | 1 | ||||
| No | 1.00 | --- | 1.00 | --- | 1.00 | --- | --- | 0 | ||||
| HSV-2 seropositive | ||||||||||||
| Yes | 1.41 | (1.10, 1.80) | 1.65 | (1.28, 2.14) | 1.63 | (1.27, 2.11) | 0.49 | 2 | ||||
| No | 1.00 | --- | 1.00 | --- | 1.00 | --- | --- | 0 | ||||
HR = hazard ratio. CI = confidence interval.
Additional factors assessed included participant education level, primary male partner circumcision status, vaginal sex in the past 4 weeks, vaginal sex in the past week, unprotected sex in the past week, number of sex partners in the past 3 months, anal sex in the past 3 months, curable STIs as separate factors, intravaginal washing with water in the past 3 months, and intravaginal washing with soap in the past 3 months.
Stepwise analysis – Fully stepwise Cox proportional hazards model stratified by site.
Modified stepwise analysis – Stepwise Cox proportional hazards model stratified by site, but excluding variables for laboratory–based testing.
The total risk score for each participant was calculated by taking the sum of the values for each predictor, with maximum scores of 11 and 8 for the full and modified scores, respectively (Table 2). The HIV incidence by risk score value for the full and modified risk scores is presented in Figure 1. For the full risk score, we observed a sharp increase in HIV incidence among participants with risk scores ≥5. Risk score sensitivity and specificity at this cut-off were 91% and 38%, respectively (Figure 2). A similar trend was observed for the modified risk score that excluded assessment of any curable STI and HSV-2 serostatus (Figure 1b).
Figure 1. HIV incidence and 95% confidence intervals by risk score using the full risk score (A) and modified risk score that excludes variables for any curable STI at baseline and HSV-2 serostatus (B).
Figure 2. Cumulative incidence curves of HIV acquisition stratified by HIV risk score cut-point.
Risk score validation
ROC curves for the full and modified scores as well as the individual categorical variables included in each score are presented in Supplemental Figure 1. The AUC for the full score to correctly predict HIV acquisition was 0.71 (95% CI 0.68, 0.74) and the combination of factors included in the score performed better than each individual factor alone (Supplemental Figure 1a). The mean AUC based on 10-fold internal cross-validation was similar to the AUC using the full dataset (AUC=0.69; 95% CI 0.66, 0.72), demonstrating the robustness of the full risk score within the VOICE dataset. The AUC for the modified score was lower than for the full score (AUC=0.68; 95% CI 0.65, 0.71); however, similar to the full score, the modified score performed better than each individual factors included in the score (Supplemental Figure 1b) and the mean AUC from 10-cross validation supported the robust generalizability of the score across the VOICE dataset (AUC= 0.67; 95% CI 0.64, 0.70).
Data from HPTN 035 and FEM-PrEP were used to perform external validations of the full risk score. In HPTN 035, data were not collected on alcohol use at baseline; therefore, in order to accommodate these missing data, we re-evaluated the performance of the full risk score when alcohol use was not included in the model and then applied this version of the score to women who participated in HPTN 035 (maximum score = 10). The performance characteristics of the full score with alcohol use excluded were similar to that of the full score (Supplemental Figure 2). Among 2,848 women enrolled in HPTN 035 who had complete data for key baseline characteristics, there were 98 HIV seroconversions during 2,903 person-years of follow-up (HIV incidence=3.38%). HIV incidence by risk score is presented in Figure 3. When applied to HPTN 035 participants, the risk score had an AUC of 0.70 (95% CI 0.65, 0.75). A score cut-off of ≥3 had a sensitivity and specificity of 84% and 46%, respectively (Figure 2). Results were generally similar for external validation of the modified risk score that did not include any curable STI, HSV-2 serostatus or alcohol use (see Supplemental Figure 3).
Figure 3. HIV incidence and 95% confidence intervals by risk score for HPTN 035 (A) and FEM-PrEP (B).
HPTN 035 score includes variables for age, marital/co-habiting status, partner provides financial support, partner has other partners, any curable STI at baseline and HSV-2 status. Point values for each variable are the same as in the full risk score. FEM-PrEP score includes variables for age (<25 =1 point), marital/co-habiting status (no=1 point), partner has other partners (yes or don't know=1 point), and any curable STI at baseline (yes=1 point).
In FEM-PrEP, data were not collected on alcohol use and whether partners provided financial or material support. In addition, HSV-2 testing was performed only for participants enrolled at the Pretoria, South Africa site. We similarly adapted the full risk score from VOICE for validation in FEM-PrEP by re-evaluating the score after excluding alcohol use, partner providing financial support and HSV-2 serostatus (see Supplemental Figure 2 for performance characteristics of this score in VOICE). Among 1,804 women enrolled into FEM-PrEP with complete data for the remaining risk score characteristics, there were 59 HIV seroconversions during 1,231 person-years of follow-up (HIV incidence=4.79%). This modified score had a maximum value of 4 and an AUC=0.58 (95% CI 0.51, 0.65) (Figure 3). Using a cut-off of ≥2, the risk score had a sensitivity and specificity of 83% and 31%, respectively (Figure 2). We re-evaluated this score including HSV-2 status and assessed its performance among the subgroup of women with data on baseline HSV-2 serostatus. Among 628 women with HSV-2 testing at baseline, the risk score AUC was 0.63 (Supplemental Figure 3).
Discussion
In this analysis that included data from women enrolled in three HIV prevention trials across Eastern and Southern Africa, we identified a discrete set of easily measured characteristics that predicted HIV infection in the year following risk assessment. A risk score that included self-reported demographic, partnership and behavioral factors as well as biologic factors (detection of curable STIs and HSV-2 serostatus) had the highest predictive ability; however, a modified score that excluded biologic factors also performed well. Many of the factors included in the full risk score have demonstrated associations with HIV acquisition, including younger age, marital/co-habitation status, alcohol use, detection of curable STIs and HSV-2 seropositivity [1, 16-27]; nevertheless, the combination of factors we defined predicted incident HIV better than any one factor alone. Thus, by focusing on a combination of factors rather than individual factors, our scoring tool achieves good predictive ability and can be easily implemented in a variety of settings to identify women at high risk of acquiring HIV in the next year who will most benefit from priority access to HIV prevention interventions.
Our analysis adds to the growing body of risk assessment literature that provides specific tools to predict HIV acquisition in different populations [6-8, 28, 29]. Our risk scores for African women performed well and had prediction performance characteristics similar to those of three other risk scores developed for HIV serodiscordant couples and MSM using similar methods (AUCs ranging from 0.67 to 0.74) [6-8]. Our score was designed with community, research and public health settings in mind, with the hope that the score would have robust applicability across these settings. In community settings, such as at voluntary counseling and testing centers, the risk score could be used to help counsel women about their HIV risk. In research settings, it could be used as a screening tool to improve recruitment efficiency by targeting enrollment of high-risk women. Finally, the risk score could be used by public health professionals and policy makers to assist in the prioritization of women for scale-up of new HIV prevention interventions, such as PrEP.
Use of population-specific validated risk scores allows for efficient and cost-effective implementation of HIV prevention interventions by targeting those that are most likely to benefit from PrEP and other novel HIV prevention interventions [29, 31, 32]. A PrEP demonstration project conducted among heterosexual serodiscordant couples in Africa is utilizing an empiric HIV risk score to guide enrollment in order to target those at highest risk of HIV acquisition [65]. Based on the risk score, eligible couples would have had an expected incidence of >5% in the absence of HIV prevention interventions [30]. Similarly, a risk score for MSM is recommended when conducting assessments for potential PrEP initiation among MSM in the US [7, 10]. We assessed the performance of the risk score at different cut-offs in the context of potentially using a risk score cut-off to target PrEP implementation efforts for women. In both a higher incidence population (VOICE) and a slightly lower incidence population (HPTN 035), having a risk score of 5 or above for the full risk score was associated with an HIV incidence of ∼5 per 100 person-years or greater and had good sensitivity. A risk score of 3 was associated with incidences between ∼2-4 per 100 person-years or greater, depending on population (VOICE versus HPTN 035) and also had good sensitivity although more limited specificity. The selection of a risk score cut-off may depend on the resources available for targeted implementation of HIV prevention methods.
In many settings, women seek health care independent of their partner; therefore, it is important to evaluate relationships between self-reported partner characteristics and HIV acquisition risk. Male partner HIV status, viral load and circumcision status are central factors related to HIV transmission potential [6, 33-37]. Despite the absence of definitive information on partner HIV status, several participant-reported male partner characteristics were predictive of HIV acquisition and included in the final risk score models. The question of whether primary partners provided financial or material support was assessed as we hypothesized that women who reported receiving financial or material support would be at increased risk of HIV [38, 39]. However, the opposite association was observed. Women engaged in more stable partnerships could be more likely to report that their partner provides financial or material support; therefore, this question may be a proxy for partnership stability rather than an indicator of higher risk transactional sex.
Hormonal contraceptive use has been associated with increased HIV acquisition risk in several studies [40-42]. Independent of a potential biological relationship between contraceptive use and HIV susceptibility, hormonal contraceptive use in a risk assessment tool could operate as a surrogate marker of HIV risk due to higher rates of unprotected sex compared to women not using hormonal contraception [43, 44]. In VOICE and FEM-PrEP, use of a highly effective method of contraception was an enrollment criterion, thus there were not sufficient numbers of women participating in these studies who were not using hormonal contraception to effectively assess hormonal contraceptive use versus non-use as a predictor of HIV acquisition. Near universal hormonal contraceptive use in these populations may somewhat limit the generalizability of these findings; however, family planning clinics are one potential location for delivery of HIV prevention services, such as PrEP, and our data would be highly applicable in those settings.
The development and validation of our risk score was based on data from three recent prospective studies that enrolled women from 7 African countries. Although our analysis includes geographic diversity, our population consisted of women participating in biomedical HIV prevention trials, which may not be representative of all African women at high risk of HIV acquisition. Further evaluation of the risk score is needed to assess its performance among women in the broader population. Since the majority of participants enrolled into VOICE were from South Africa, we attempted to improve the geographic diversity of the analysis by validating the score using data from HPTN 035 and FEM-PrEP. Still, 65% of all participants in the analysis were from South Africa, and our findings may be driven by characteristics of the epidemic that are specific to that region. Data collection instruments were similar between the studies; however, some of the factors assessed in VOICE and included in the final risk score were not assessed in HPTN 035 and FEM-PrEP. As a result, we were unable to fully perform external validation of the most predictive scores. Adaptations of the full and modified score were generated instead and these scores performed similarly in HPTN 035, but had more modest predictive ability in FEM-PrEP.
To have the greatest impact on reducing new HIV infections, high risk individuals should be targeted for access to existing effective prevention interventions, including PrEP, as well as for roll-out of future prevention modalities. Use of screening tools, including the risk score presented here, could improve efficiency in identifying high risk women and enable priority access to highly effective HIV prevention methods to those who would benefit most.
Supplementary Material
Acknowledgments
Funding: This research was funded in part by a grant from the U.S. National Institutes of Health (NIH) (R03MH106352) and a 2014 developmental grant from the University of Washington Center for AIDS Research (CFAR), an NIH funded program under award number P30AI027757 which is supported by the following NIH Institutes and Centers (NIAID, NCI, NIMH, NIDA, NICHD, NHLBI, NIA, NIGMS, NIDDK). The Microbicide Trials Network (MTN) is funded by NIAID (UM1AI068633, UM1AI068615, UM1AI106707), with co-funding from NICHD and NIMH, all components of the NIH. HIV Prevention Trials Network (HPTN) 035 was funded by the NIH. The trial was designed and implemented by the HPTN and the MTN. FEM-PrEP was funded by grants from the U.S. Agency for International Development (GPO-A-00-05-00022-00 andGHO-A-00-09-00016-00) with early support from the Bill and Melinda Gates Foundation. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
The authors gratefully acknowledge the contributions of the women who participated in the VOICE, HPTN 035 and FEM-PrEP studies. The authors express their sincere appreciation to the study teams for their dedicated work on data and sample collection and to the MTN Statistical and Data Management Center for their work on data management for VOICE and HPTN 035 and FHI 360 for their work on FEM-PrEP. Special thanks to Amy Corneli, PhD,MPH, Jen Deese, PhD, MPH, and Doug Taylor, PhD from the FEM-PrEP study team for facilitating the incorporation of the FEM-PrEP data and their review of an earlier version of this manuscript.
Footnotes
These data were presented in part at the HIV Research for Prevention Conference, held 28th – 31st October 2014 in Cape Town, South Africa.
Potential Conflicts of Interest: All authors declare no commercial or other associations that might pose a conflict of interest relevant to the submitted work.
References
- 1.UNAIDS. UNAIDS report on the global AIDS epidemic. 2013 [Google Scholar]
- 2.Marrazzo JM, Ramjee G, Nair G, Palanee T, Mkhize B, Nakabiito C, et al. Conference on Opportunistic Infections and Retroviruses. Boston, MA: 2013. Pre-exposure prophylaxis for HIV in women: daily oral tenofovir, oral tenofovir-emtricitabine, or vaginal tenofovir gel in the VOICE Study (MTN 003) [Google Scholar]
- 3.Van Damme L, Corneli A, Ahmed K, Agot K, Lombaard J, Kapiga S, et al. Preexposure prophylaxis for HIV infection among African women. N Engl J Med. 2012;367:411–422. doi: 10.1056/NEJMoa1202614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.McCormack S, Ramjee G, Kamali A, Rees H, Crook AM, Gafos M, et al. PRO2000 vaginal gel for prevention of HIV-1 infection (Microbicides Development Programme 301): a phase 3, randomised, double-blind, parallel-group trial. Lancet. 2010;376:1329–1337. doi: 10.1016/S0140-6736(10)61086-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Abdool Karim SS, Richardson BA, Ramjee G, Hoffman IF, Chirenje ZM, Taha T, et al. Safety and effectiveness of BufferGel and 0.5% PRO2000 gel for the prevention of HIV infection in women. AIDS. 2011;25:957–966. doi: 10.1097/QAD.0b013e32834541d9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Kahle E, Hughes J, Lingappa J, John-Stewart G, Celum C, Naku-Joloba E, et al. An Empiric Risk Scoring Tool for Identifying High-Risk Heterosexual HIV-1-Serodiscordant Couples for Targeted HIV-1 Prevention. J Acquir Immune Defic Syndr. 2013;62:339–347. doi: 10.1097/QAI.0b013e31827e622d. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Smith DK, Pals SL, Herbst JH, Shinde S, Carey JW. Development of a clinical screening index predictive of incident HIV infection among men who have sex with men in the United States. J Acquir Immune Defic Syndr. 2012;60:421–427. doi: 10.1097/QAI.0b013e318256b2f6. [DOI] [PubMed] [Google Scholar]
- 8.Menza TW, Hughes JP, Celum CL, Golden MR. Prediction of HIV acquisition among men who have sex with men. Sex Transm Dis. 2009;36:547–555. doi: 10.1097/OLQ.0b013e3181a9cc41. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Irungu EM, Heffron R, Mugo N, Ngure K, Katabira E, Bulya N, et al. HIV Research for Prevention Conference. Cape Town, South Africa: 2014. Evaluation of a Risk Score Tool to Identify Higher-risk HIV-1 Serodiscordant Couples for Antiretroviral-based HIV-1 Prevention. (Abstract #0A28 02) [Google Scholar]
- 10.CDC. Pre-exposure prophylaxis for the prevention of HIV infection in the United States - 2014. [10 July 2015];Clinical providers' supplement. http://www.cdc.gov/hiv/pdf/prepprovidersupplement2014.pdf.
- 11.Marrazzo JM, Ramjee G, Richardson BA, Gomez K, Mgodi N, Nair G, et al. Tenofovir-based preexposure prophylaxis for HIV infection among African women. N Engl J Med. 2015;372:509–518. doi: 10.1056/NEJMoa1402269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Centers for Disease Control and Prevention. [22 April 2014];PrEP: A New Tool for HIV Prevention. 2012 http://www.cdc.gov/hiv/pdf/prevention_PrEP_factsheet.pdf.
- 13.UNAIDS. [17 August 2015];The Gap Report. 2014 http://www.unaids.org/sites/default/files/media_asset/UNAIDS_Gap_report_en.pdf.
- 14.Akaike H. Information theory and an extension of the maximum likelihood principle. In: Petrov B, Csaki F, editors. Second International Symposium on Inference Theory. Budapest, Hungary: Akademiai Kiado; 1973. pp. 267–281. [Google Scholar]
- 15.Heagerty PJ, Lumley T, Pepe MS. Time-dependent ROC curves for censored survival data and a diagnostic marker. Biometrics. 2000;56:337–344. doi: 10.1111/j.0006-341x.2000.00337.x. [DOI] [PubMed] [Google Scholar]
- 16.Pettifor AE, van der Straten A, Dunbar MS, Shiboski SC, Padian NS. Early age of first sex: a risk factor for HIV infection among women in Zimbabwe. AIDS. 2004;18:1435–1442. doi: 10.1097/01.aids.0000131338.61042.b8. [DOI] [PubMed] [Google Scholar]
- 17.Ramjee G, Wand H, Whitaker C, McCormack S, Padian N, Kelly C, et al. HIV incidence among non-pregnant women living in selected rural, semi-rural and urban areas in KwaZulu-Natal, South Africa. AIDS Behav. 2012;16:2062–2071. doi: 10.1007/s10461-011-0043-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Wand H, Ramjee G. The relationship between age of coital debut and HIV seroprevalence among women in Durban, South Africa: a cohort study. BMJ Open. 2012;2:e000285. doi: 10.1136/bmjopen-2011-000285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Mavedzenge SN, Weiss HA, Montgomery ET, Blanchard K, de Bruyn G, Ramjee G, et al. Determinants of differential HIV incidence among women in three southern African locations. J Acquir Immune Defic Syndr. 2011;58:89–99. doi: 10.1097/QAI.0b013e3182254038. [DOI] [PubMed] [Google Scholar]
- 20.Glynn JR, Carael M, Auvert B, Kahindo M, Chege J, Musonda R, et al. Why do young women have a much higher prevalence of HIV than young men? A study in Kisumu, Kenya and Ndola, Zambia. AIDS. 2001;15(Suppl 4):S51–60. doi: 10.1097/00002030-200108004-00006. [DOI] [PubMed] [Google Scholar]
- 21.Chersich MF, Rees HV. Causal links between binge drinking patterns, unsafe sex and HIV in South Africa: its time to intervene. Int J STD AIDS. 2010;21:2–7. doi: 10.1258/ijsa.2000.009432. [DOI] [PubMed] [Google Scholar]
- 22.Chersich MF, Bosire W, King'ola N, Temmerman M, Luchters S. Effects of hazardous and harmful alcohol use on HIV incidence and sexual behaviour: a cohort study of Kenyan female sex workers. Global Health. 2014;10:22. doi: 10.1186/1744-8603-10-22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.WHO. Alcohol use and sexual risk behaviour : a cross-cultural study in eight countries. 2005 http://www.who.int/substance_abuse/publications/alcohol_sexual_risk_crosscultural.pdf?ua=1.
- 24.Kalichman SC, Simbayi LC, Kaufman M, Cain D, Jooste S. Alcohol use and sexual risks for HIV/AIDS in sub-Saharan Africa: systematic review of empirical findings. Prev Sci. 2007;8:141–151. doi: 10.1007/s11121-006-0061-2. [DOI] [PubMed] [Google Scholar]
- 25.White RG, Orroth KK, Glynn JR, Freeman EE, Bakker R, Habbema JD, et al. Treating curable sexually transmitted infections to prevent HIV in Africa: still an effective control strategy? J Acquir Immune Defic Syndr. 2008;47:346–353. doi: 10.1097/QAI.0b013e318160d56a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Korenromp EL, White RG, Orroth KK, Bakker R, Kamali A, Serwadda D, et al. Determinants of the impact of sexually transmitted infection treatment on prevention of HIV infection: a synthesis of evidence from the Mwanza, Rakai, and Masaka intervention trials. J Infect Dis. 2005;191(Suppl 1):S168–178. doi: 10.1086/425274. [DOI] [PubMed] [Google Scholar]
- 27.Steen R, Wi TE, Kamali A, Ndowa F. Control of sexually transmitted infections and prevention of HIV transmission: mending a fractured paradigm. Bull World Health Organ. 2009;87:858–865. doi: 10.2471/BLT.08.059212. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Kagaayi J, Gray RH, Whalen C, Fu P, Neuhauser D, McGrath JW, et al. Indices to measure risk of HIV acquisition in Rakai, Uganda. PLoS One. 2014;9:e92015. doi: 10.1371/journal.pone.0092015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Buchbinder SP, Glidden DV, Liu AY, McMahan V, Guanira JV, Mayer KH, et al. HIV pre-exposure prophylaxis in men who have sex with men and transgender women: a secondary analysis of a phase 3 randomised controlled efficacy trial. Lancet Infect Dis. 2014;14:468–475. doi: 10.1016/S1473-3099(14)70025-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Baeten J, Heffron R, Kidoguchi L, Celum C, Mugo N, Bukusi E, et al. Conference on Opportunitic Infections and Retroviruses. Seattle, WA: 2015. Near Elimination of HIV Transmission in a Demonstration Project of PrEP and ART (O1-24) [Google Scholar]
- 31.Verguet S, Stalcup M, Walsh JA. Where to deploy pre-exposure prophylaxis (PrEP) in sub-Saharan Africa? Sex Transm Infect. 2013;89:628–634. doi: 10.1136/sextrans-2012-050891. [DOI] [PubMed] [Google Scholar]
- 32.Cremin I, Hallett TB. Estimating the range of potential epidemiological impact of pre-exposure prophylaxis: run-away success or run-away failure? AIDS. 2015;29:733–738. doi: 10.1097/QAD.0000000000000591. [DOI] [PubMed] [Google Scholar]
- 33.Donnell D, Baeten JM, Kiarie J, Thomas KK, Stevens W, Cohen CR, et al. Heterosexual HIV-1 transmission after initiation of antiretroviral therapy: a prospective cohort analysis. Lancet. 2010;375:2092–2098. doi: 10.1016/S0140-6736(10)60705-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Baeten JM, Kahle E, Lingappa JR, Coombs RW, Delany-Moretlwe S, Nakku-Joloba E, et al. Genital HIV-1 RNA predicts risk of heterosexual HIV-1 transmission. Sci Transl Med. 2011;3 doi: 10.1126/scitranslmed.3001888. 77ra29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Auvert B, Taljaard D, Lagarde E, Sobngwi-Tambekou J, Sitta R, Puren A. Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: the ANRS 1265 Trial. PLoS Med. 2005;2:e298. doi: 10.1371/journal.pmed.0020298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Bailey RC, Moses S, Parker CB, Agot K, Maclean I, Krieger JN, et al. Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial. Lancet. 2007;369:643–656. doi: 10.1016/S0140-6736(07)60312-2. [DOI] [PubMed] [Google Scholar]
- 37.Gray RH, Kigozi G, Serwadda D, Makumbi F, Watya S, Nalugoda F, et al. Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial. Lancet. 2007;369:657–666. doi: 10.1016/S0140-6736(07)60313-4. [DOI] [PubMed] [Google Scholar]
- 38.Dunkle KL, Jewkes RK, Brown HC, Gray GE, McIntryre JA, Harlow SD. Transactional sex among women in Soweto, South Africa: prevalence, risk factors and association with HIV infection. Soc Sci Med. 2004;59:1581–1592. doi: 10.1016/j.socscimed.2004.02.003. [DOI] [PubMed] [Google Scholar]
- 39.Jewkes R, Dunkle K, Ndunda M, Jama Shafi N. Transactional Sex and HIV Incidence in a Cohort of Young Women in the Stepping Stones Trial. J AIDS Clinic Res. 2012;3:158. doi:110.4172/2155-6113.1000158. [Google Scholar]
- 40.Polis CB, Curtis KM. Use of hormonal contraceptives and HIV acquisition in women: a systematic review of the epidemiological evidence. Lancet Infect Dis. 2013 doi: 10.1016/S1473-3099(13)70155-5. [DOI] [PubMed] [Google Scholar]
- 41.Marrazzo JM, del Rio C, Holtgrave DR, Cohen MS, Kalichman SC, Mayer KH, et al. HIV prevention in clinical care settings: 2014 recommendations of the International Antiviral Society-USA Panel. JAMA. 2014;312:390–409. doi: 10.1001/jama.2014.7999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Herold BC, Dezzutti CS, Richardson BA, Marrazzo J, Mesquita PM, Carpenter C, et al. Antiviral activity of genital tract secretions after oral or topical tenofovir pre-exposure prophylaxis for HIV-1. J Acquir Immune Defic Syndr. 2014;66:65–73. doi: 10.1097/QAI.0000000000000110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.McCoy SI, Zheng W, Montgomery ET, Blanchard K, van der Straten A, de Bruyn G, et al. Oral and injectable contraception use and risk of HIV acquisition among women in sub-Saharan Africa. AIDS. 2013;27:1001–1009. doi: 10.1097/QAD.0b013e32835da401. [DOI] [PubMed] [Google Scholar]
- 44.Baeten JM, Nyange PM, Richardson BA, Lavreys L, Chohan B, Martin HL, Jr, et al. Hormonal contraception and risk of sexually transmitted disease acquisition: results from a prospective study. Am J Obstet Gynecol. 2001;185:380–385. doi: 10.1067/mob.2001.115862. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.