Abstract
Sexual transmission is the principal driver of the human immunodeficiency virus (HIV) pandemic. Understanding HIV vaccine-induced immune responses at mucosal surfaces can generate hypotheses regarding mechanisms of protection, and may influence vaccine development. The RV144 (ClinicalTrials.gov NCT00223080) efficacy trial showed protection against HIV infections but mucosal samples were not collected, therefore, the contribution of mucosal antibodies to preventing HIV-1 acquisition is unknown. Here, we report the generation, magnitude and persistence of antibody responses to recombinant gp120 envelope and antigens including variable one and two loop scaffold antigens (gp70V1V2) previously shown to correlate with risk in RV144. We evaluated antibody responses to gp120 A244gD and gp70V1V2 92TH023 (both CRF01_AE) and Case A2 (subtype B) in cervico-vaginal mucus (CVM), seminal plasma (SP) and rectal secretions (RS) from HIV-uninfected RV144 vaccine recipients, who were randomized to receive two late boosts of ALVAC-HIV/AIDSVAX®B/E, AIDSVAX®B/E, or ALVAC-HIV alone at 0 and 6 months. Late vaccine boosting increased IgG geometric mean titers (GMT) to gp120 A244gD in AIDSVAX®B/E and ALVAC-HIV/AIDSVAX®B/E CVM (28 and 17 fold, respectively), followed by SP and RS. IgG to gp70V1V2 92TH023 increased in AIDSVAX®B/E and ALVAC-HIV/AIDSVAX®B/E CVM (11–17 fold) and SP (2 fold) two weeks post first boost. IgG to Case A2 was only detected in AIDSVAX®B/E and ALVAC-HIV/AIDSVAX®B/E CVM. Mucosal IgG to gp120 A244gD (CVM, SP, RS), gp70V1V2 92TH023 (CVM, SP), and Case A2 (CVM) correlated with plasma IgG levels (p<0.001). Although the magnitude of IgG responses declined after boosting, anti-gp120 A244gD IgG responses in CVM persisted for 12 months post final vaccination. Further studies in localization, persistence and magnitude of envelope specific antibodies (IgG and dimeric IgA) in anogenital secretions will help determine their role in preventing mucosal HIV acquisition.
Introduction
Despite numerous recent advances in HIV prevention, a preventive vaccine remains a high priority to prevent ongoing transmission of the virus [1]. Sexual acquisition occurs across the genital and rectal mucosa surfaces following sexual activity with HIV-infected partners [2]. In humans, innate mucosal immune factors have been associated with protection from HIV infection, and mucosal HIV-specific antibodies exhibit viral neutralization and/or inhibition of HIV infection [3–6]. Concentrations of IgG in cervico-vaginal mucus (CVM) and semen are higher than IgA, whereas rectal secretions (RS) contain higher levels of secretory IgA than IgG [7–9]. Furthermore, half of the antibodies in female genital secretions are produced systemically by plasma cells in peripheral blood and transported, while more than 90% of intestinal antibodies are locally produced in the lamina propria [10]. Studies in animal models have demonstrated the successful generation of mucosal HIV-specific antibodies by immunizing with HIV antigens either systemically, mucosally, or a combination of both routes [11–13].
The RV144 trial of a prime-boost vaccine regimen consisting of recombinant canarypox priming immunogen, ALVAC-HIV (vCP1521), and bivalent AIDSVAX®B/E glycoprotein (gp)120 (MN and A244) protein boosting demonstrated a modest 31.2% protective efficacy against HIV infection at 42 months of follow-up; however, vaccine efficacy was 60.5% at 12 months after initial vaccination [14, 15]. Post hoc analysis revealed two factors correlated to HIV infection risk: plasma IgG binding antibodies to variable loops 1 and 2 (V1V2) of gp120 envelope (Env) protein inversely correlated with HIV infection risk among RV144 vaccine recipients, while plasma monomeric IgA binding antibodies to viral Envs directly correlated with risk [16–19]. Additionally, a sieve analysis identified vaccine-associated genetic signatures in the V2 region, further providing evidence that vaccination-induced immune responses directed against the V2 loop were associated with protection conferred by the RV144 regimen [20]. However, HIV-specific immune responses in anogenital secretions were not characterized because mucosal specimens were not collected in RV144.
In the current study, RV305 (ClinicalTrials.gov NCT01435135), we report the presence of HIV-specific antibodies in anogenital secretions after intramuscular immunizations with RV144 vaccine components. One hundred and sixty two HIV-uninfected RV144 vaccine recipients were randomized to receive two late boosts of either a combination of ALVAC-HIV/AIDSVAX®B/E or AIDSVAX®B/E alone or ALVAC-HIV alone [21]. Antibody responses in anogenital secretions were collected and assessed at five different time points throughout the study. We demonstrate a strong correlation of antibody responses in anogenital secretions with those in plasma. Our results provide evidence that intramuscular immunizations induced anogenital IgG to gp120 that might have contributed to prevention of HIV infection.
Materials and methods
Study design
In the RV305 clinical trial, 162 healthy HIV-uninfected vaccine recipients who completed all vaccination series from RV144 [14] 6.0 to 8.3 years earlier (mean = 7.2 years since last RV144 vaccination) were randomized into three groups, each composed of 45 vaccine and 9 placebo recipients, to receive two intramuscular immunizations at 0 and 6 months of one of three booster options or placebo products. Group 1 received ALVAC-HIV/AIDSVAX®B/E or ALVAC/AIDSVAX placebo, Group 2 received AIDSVAX®B/E or AIDSVAX placebo, and Group 3 received ALVAC-HIV or ALVAC placebo (Fig 1) [21]. The protocol received approval from ethics committees and institutional review boards of the Walter Reed Army Institute of Research, the Thai Ministry of Public Health, the Royal Thai Army Medical Department, the Faculty of Tropical Medicine, Mahidol University, the Faculty of Medicine, Chulalongkorn University, and Siriraj Hospital. Written informed consent was obtained from all participants.
Clinical specimen collection, processing and storage
Venous blood, CVM, seminal plasma (SP) and RS were collected and tested at study entry (week 0), 2 weeks post first (week 2) and second boosts (week 26), and weeks 48 and 72. All participants were HIV-uninfected throughout the study.
Venous blood collected in Acid Citrate Dextrose (ACD) tubes from each participant were centrifuged at 800 g for 15 minutes to obtain plasma.
Optional CVM was collected from 61 consenting female participants (Group 1: 21 vaccine and 1 placebo recipients, Group 2: 17 vaccine recipients, and Group 3: 18 vaccine and 4 placebo recipients) (Fig 1) using Instead Softcup™ (Evofem, San Diego, CA). Participants were asked to refrain from sexual activities for at least 72 hours prior to CVM collection. Wherever possible, collections were timed to avoid menses. Softcups were inserted and removed by participants and time of intravaginal retention was recorded ranging from 4.02 to 12.35 hours. Secretions were processed by placing Softcups in 50 mL conical tubes and centrifuged at 500 g for 10 minutes at +4°C. To ensure that antibodies in secretions were not derived from blood contamination, CVM was tested for the presence of blood using Hemoccult® SENSA® test kit (Beckmann Coulter, Brea, CA). When possible, the participant was asked to provide another sample when blood was detected in CVM. Secretions were suspended in two volumes of phosphate-buffered saline (PBS) (Life Technologies, Grand Island, NY) containing 1X Calbiochem protease inhibitor cocktail set I (EMD Millipore Corp., Billerica, MA) to prevent antibody proteolysis.
SP was isolated from semen collected from 81 male participants (Group 1: 21 vaccine and 6 placebo recipients, Group 2: 21 vaccine and 7 placebo recipients, and Group 3: 23 vaccine and 3 placebo recipients) (Fig 1) by masturbation without lubricants. Participants were asked to refrain from sexual activities for at least 72 hours prior to semen donation and specimens were kept at 2–6°C during transport for processing. Specimens were kept for at least one hour at 4°C± 2°C prior to processing to liquefy semen. Semen was diluted 1:1 with PBS (Life Technologies, Grand Island, NY), mixed and centrifuged for 10 minutes (1,200 g) to separate cells from SP. Supernatant was mixed with 10% extraction solution containing protease inhibitor cocktail tablets (cOmplete™ ULTRA Tablets, Mini, Roche Diagnostics, Mannheim, Germany).
RS were collected from 26 male participants (Group 1: 10 vaccine and 1 placebo recipients, Group 2: 6 vaccine and 2 placebo recipients, and Group 3: 7 vaccine recipients) (Fig 1) by placing Merocel® Schindler ear packing sponges (Medtronic Xomed, Jacksonville, FL) anterior to the dentate line for 2–5 minutes, avoiding sponge placement in locations containing fecal matter. Sponges were weighed before and after collection to determine sample weight. RS were extracted three times with 0.8mL of PBS (Life Technologies, Grand Island, NY) containing Calbiochem protease inhibitor cocktail set I (EMD Millipore Corp., Billerica, MA) and centrifuged at 2,300 g for 5 minutes at +4°C. Supernatant was tested for blood contamination using Hemoccult® SENSA® test kit (Beckmann Coulter, Brea, CA), and pooled for each participant.
All plasma and anogenital specimens were aliquoted and stored at <-80°C until testing.
Recombinant proteins
Recombinant gp120 HIV-1 CRF01_AE A244gD protein (A244gD) with identical amino acid sequence to the one used in RV144 was purified using Galanthous nivalis lectin columns as described previously [22]. Subtype B Case A2 (Case A2) and CRF01_AE 92TH023 (92TH023) gp70V1V2 scaffold proteins were synthesized as previously described [23].
Antibody binding ELISA assays
IgG and IgA antibody responses to A244gD protein [17], and gp70V1V2 92TH023 and Case A2 [18, 24, 25] were assessed by ELISA as previously described [17]. Briefly, ELISA for all proteins was performed in 96-well U-bottom Immulon 2HB plates (Thermos Scientific, Rochester, NY) coated with 1 μg/mL of proteins in D-PBS (Sigma-Aldrich, Saint Louis, MO) at 4°C overnight. Plates were washed and serial two-fold dilutions of all secretions were added to wells with initial dilutions of CVM and SP of 1:100 (gp120 A244gD) and 1:25 for gp70V1V2 scaffolds. The initial dilution for RS was 1:5 for all antigens. Plates were incubated at room temperature for 2 hours. Plates were washed and color was developed with horseradish peroxidase (HRP) conjugated either to goat anti-human IgG or goat anti-human IgA (Bethyl Laboratories, Montgomery, TX) at 1:25,000 dilution and ABTS ELISA HRP substrate (KPL, Gaithersburg, MD). Plates were read at an absorbance of A405 nm (Spectramax 340 PC ELISA reader, Molecular Devices, Downingtown, PA). Human reference serum (Bethyl Laboratories, Montgomery, TX) was used as a positive control.
Total IgG and IgA antibody specific to goat anti-human IgG-Fc antibody (Bethyl Laboratories, Montgomery, TX) and goat anti-human IgA antibody (Bethyl Laboratories, Montgomery, TX) were assessed on all anogenital secretions following above ELISA procedure.
Statistical analysis
Data analysis and graphs were generated using GraphPad Prism version 7.01 for Windows (GraphPad Software, La Jolla, CA). Titers were expressed as the reciprocal of the highest dilutions that yielded an absorbance value of A405 nm greater than 0.25 (2.5-fold the absorbance of wells without capture antigen). The positive reciprocal titers were above the cut-off level (0.5-fold the reciprocal titers of the initial dilution of specimens). Descriptive results are presented as medians with minimum and maximum ranges. Antibody concentration results are presented as geometric mean titers (GMT) which were calculated with associated 95% confidence intervals. Statistical comparisons were assessed using non-parametric Mann-Whitney U tests. Correlation of antibody responses was assessed using Spearman’s Rank Correlation Coefficient test. A 2-sided p-value of <0.05 was considered significant.
Results
Determination of total IgG and IgA concentrations in anogenital secretions
Total IgG and IgA concentrations in anogenital secretions were measured at study entry, and 2 weeks post first and second boosts (Table 1). Median (range) concentrations of total IgG in CVM (602.6 (68.3–5,037.0) μg/mL) and SP (44.5 (11.5–154.1) μg/mL) were approximately two-fold higher than those of total IgA (376.4 (7.1–1,576) and 22.1 (1.4–221.5) μg/mL, respectively). Conversely, total IgG (29.5 (1.8–484.8) μg/mL) in RS was approximately five-fold lower than total IgA (142.2 (2.0–3,677.0) μg/mL). Of 301 CVM and 117 RS samples collected, 44 (14.6%) and 17 (14.5%) were positive for blood contamination, respectively (Fig 1). Although intravaginal retention time of Instead SoftCup ranged from 4.02–12.35 hours (median hours = 6.07), it did not correlate with yield of collected CVM (p = 0.283).
Table 1. Concentration of total IgG and IgA in anogenital secretions that did not contain blood.
Cervico-vaginal mucus (CVM) | Seminal plasma (SP) | Rectal secretions (RS) | |
---|---|---|---|
No. of collected specimens | 301 | 394 | 117 |
Median (range) total IgG (μg/mL) | 602.6 (68.3–5,037.0), n = 156 | 44.5 (11.5–154.1), n = 238 | 29.5 (1.8–484.8), n = 65 |
Median (range) total IgA (μg/mL) | 376.4 (7.1–1,576.0), n = 156 | 22.1 (1.4–221.5), n = 238 | 142.2 (2.0–3,677.0), n = 65 |
Total IgG and IgA in samples without blood and blood-contaminated samples were compared to determine if the presence of blood increased the concentration of antibodies in secretions. We observed significantly higher concentrations of IgG in blood-contaminated CVM (p = 0.018) and RS (p = 0.022) and of IgA in blood-contaminated CVM only (p = 0.048). Although there was a trend in RS for higher IgA in blood containing samples, significance was not reached (p = 0.431). However, the number of matched RS samples used for the analysis was small (N = 5–7). We excluded all blood-contaminated samples from analysis to avoid inclusion of antibody responses normally found in blood. SP samples were not tested for blood contamination.
HIV-specific antibody responses in anogenital secretions
HIV-specific IgG antibody responses were not detected in any secretions from placebo recipients at baseline (Fig 2), which could be due to the low number of samples collected (1–7 samples). IgA responses to all HIV antigen tested were not detected in any secretions of both vaccine and placebo recipients.
IgG antibody responses to gp120 A244gD protein and gp70V1V2 scaffolds in CVM
Responses to gp120 A244gD were measured in ALVAC-HIV/AIDSVAX®B/E (23.5%, 4/17), AIDSVAX®B/E (21.4%, 3/14) and ALVAC-HIV (17.6%, 3/17) groups at week 0 (GMT: 61–69) (Fig 2). ALVAC-HIV immunization did not increase HIV-specific antibody levels relative to baseline responses (p = 0.657; Fig 3A). ALVAC-HIV/AIDSVAX®B/E and AIDSVAX®B/E vaccinations induced significant increases in antibody levels that were similar in magnitude. Two weeks post first immunization (week 2), antibody responses to gp120 A244gD increased significantly from baseline (p<0.001) in both ALVAC-HIV/AIDSVAX®B/E (GMT: 1,083) and AIDSVAX®B/E (GMT: 1,745) groups. However, an additional boost did not increase the magnitude of the response (GMT: 652 and 993, respectively) (Fig 3A). Although antibody responses after the second boost were lower than post first boost, the magnitude was not significant (p = 0.114 and 0.206, respectively). At week 48, GMT declined significantly in the ALVAC-HIV/AIDSVAX®B/E (161, p = 0.011) and AIDSVAX®B/E (264, p = 0.002) groups. GMT remained stable and approximately the same at week 72, GMT = 124 (p = 0.643) and 219 (p = 0.744), respectively. In general, positive responders at week 48 remained above cutoff at week 72.
CVM IgG responses to gp70V1V2 92TH023 and Case A2 scaffolds in all vaccination groups were at baseline level (GMT = 13) at study entry (Fig 3B and 3C). Following the first immunization, antibody responses to gp70V1V2 92TH023 were induced in both the ALVAC-HIV/AIDSVAX®B/E (GMT: 154, p<0.001) and AIDSVAX®B/E (GMT: 228, p<0.001) groups, but the responses were not significantly different between groups (p = 0.673, Fig 3B). As seen with gp120, immunizations in the ALVAC-HIV group induced responses similar to study entry and significantly lower than those in the other two groups (p<0.02). Additional boosting with AIDSVAX®B/E or ALVAC-HIV/AIDSVAX®B/E did not further increase V1V2-specific responses (GMT: 65 (p = 0.015) and 54 (p = 0.069), respectively). Antibody levels decreased significantly but remained above baseline levels (week 0) in both groups at weeks 48 (GMT: 20 and 18; p<0.005) and 72 (GMT: 30 and 18; p<0.05).
CVM antibody responses to gp70V1V2 Case A2 scaffold were lower than those to gp70V1V2 92TH023. Following the first boost, GMT of ALVAC-HIV/AIDSVAX®B/E and AIDSVAX®B/E groups increased similarly from 13 and 13 to 30 and 35, respectively, and the responses remained approximately the same after the second boost (GMT: 35 and 40) (Fig 3C). In both ALVAC-HIV/AIDSVAX®B/E and AIDSVAX®B/E groups, the responses declined significantly and were close to study baseline levels at weeks 48 (GMT: 13 and 14; p>0.48) and 72 (GMT: 13 and 14; p>0.48).
IgG antibody responses to gp120 A244gD protein and gp70V1V2 scaffolds in SP
Prior to immunization, IgG antibody responses in SP to all antigens were at baseline level (gp120 A244gD, GMT = 50; gp70V1V2 92TH023 and Case A2, GMT = 13). Boosting immunizations did not induce the responses in the ALVAC-HIV group for all HIV antigens tested (Fig 4A–4C). IgG responses to gp120 A244gD were detected after the first vaccination in both ALVAC-HIV/AIDSVAX®B/E and AIDSVAX®B/E groups with GMT = 174 and 170, respectively (Fig 4A). After the second boost, GMT did not increase further and were lower than post first boost, 78 (p = 0.001) and 68 (p<0.001), respectively. Antibody responses declined in both groups at weeks 48 (GMT: 55 and 50; p = 0.04 and 0.118, respectively) and 72 reaching baseline levels (GMT: 50 and 50; p = 0.231 and 0.487, respectively) (Fig 4A).
IgG responses to gp70V1V2 92TH023 scaffold were also detected in SP after the first vaccination with ALVAC-HIV/AIDSVAX®B/E and AIDSVAX®B/E groups (GMT: 38 and 37; p<0.001) (Fig 4B). However, after the second boost, the responses did not increase and were similar to study baseline (GMT: 14 and 15; p = 0.107). Antibodies in both groups were identical at week 72 to those at baseline. IgG responses to gp70V1V2 subtype B (Case A2) in SP were undetectable in all groups (Fig 4C).
IgG antibody responses to gp120 A244gD protein and gp70V1V2 scaffolds in RS
At baseline, IgG to gp120 A244gD was detected in one RS sample in the ALVAC-HIV group but vaccinations in this group did not induce antibody responses (Fig 5A–5C). Following the first boost (week 2), IgG responses to gp120 A244gD were detected in ALVAC-HIV/AIDSVAX®B/E and AIDSVAX®B/E groups (GMT: 13 and 15; p = 0.002 and 0.015, respectively) (Fig 5A). A second boost did not increase these responses further. Rectal antibody responses declined rapidly and were undetected in all groups at week 72. Low IgG responses to gp70V1V2 92TH023 were detected in RS of ALVAC-HIV/AIDSVAX®B/E group at week 2 and AIDSVAX®B/E group at weeks 2 and 26 (Fig 5B). These responses were transient and declined to baseline at week 48. IgG responses to gp70V1V2 Case A2 were undetectable in RS (Fig 5C).
Correlation of IgG responses between plasma and anogenital secretions
Anogenital secretion IgG responses to HIV proteins tested showed similar patterns to plasma responses [21]. We therefore, investigated the correlation of IgG responses in plasma and all anogenital secretions collected at different time points after the first immunization until the end of study (weeks 2, 26, 48 and 72). HIV-specific IgG titers in CVM showed a significant positive correlation with those in plasma (p<0.001) for gp120 A244gD and both scaffolds, (Fig 6A–6C). A significant correlation of IgG antibody responses for gp120 A244gD and gp70V1V2 92TH023 was also found between SP and plasma (p<0.001) (Fig 6D and 6E). In RS, only IgG responses to gp120 A244gD had a significant positive correlation with plasma levels (p<0.001) (Fig 6F).
Discussion
Mucosal surfaces are a major route for HIV infection but the precise mechanisms by which the virus penetrates mucosal barriers to establish infection are not completely understood. Similarly, because no highly efficacious HIV vaccine has been developed, vaccinologists are considering multiple potential mechanisms of protection including neutralization and non-neutralizing functions [26, 27]. However, in order for vaccine-induced antibody-mediated protection to occur at the mucosal surfaces, antibodies must be present at the time of viral encounter. This study demonstrates the induction of HIV-specific antibodies by using immunogens of the RV144 regimen as late boosts 6–8 years following RV144 immunization, including responses to antigens that inversely correlated with risk in the RV144 trial [28].
Collection of vaginal and rectal secretions for the characterization of antibodies in vaccine and natural infections has been technically challenging because samples collected using lavage introduce dilution factors that were difficult to determine [29, 30]. In RV305, we used Merocel® sponges and Instead Softcup™ to collect undiluted RS and CVM, respectively, thereby eliminating dilution factor differences. With regard to total immunoglobulins, in CVM and SP, IgG was predominant with a mean concentration twice that of IgA, although the latter was the predominant isotype in RS. Higher concentrations of IgG in CVM and SP, and higher IgA concentrations in RS have been reported previously [7–10].
Low levels of residual antibody responses to gp120 A244gD were detected in CVM at week 0. It was reported previously that immunoglobulins in female genital secretions originate from either local production or antibody transport from blood circulation to mucosal compartments [10]. Following immunization, we detected IgG Env-specific antibodies in all secretions except the ALVAC-HIV alone where they were either very weak (CVM, gp120 antigen only) or undetectable (SP and RS). Antibody responses in the ALVAC-HIV/AIDSVAX®B/E and AIDSVAX®B/E groups were indistinguishable, suggesting that the AIDSVAX®B/E proteins were necessary in driving the antibody response. It remains to be determined whether the presence of ALVAC-HIV impacts the quality of antibodies generated in anogenital secretions. Overall, antibody levels in CVM and SP in the ALVAC-HIV/AIDSVAX®B/E and AIDSVAX®B/E groups two weeks post first immunization were higher than those after the second immunization, as previously reported for plasma [21], whereas in RS, responses were similar between the first and second immunizations. Notably, IgG to gp70V1V2 Case A2, which correlated inversely to risk of HIV infection in RV144 [28], was only detected in CVM but not in SP and RS. This difference could be related to the detection sensitivity, levels and quality of antibodies in these samples. Antibody levels in both SP and RS were transient and dropped to baseline levels at week 48. In CVM, antibody titers declined significantly at weeks 48 and 72 after the second immunization but remained above baseline indicating that HIV-specific responses were more persistent in this compartment. Naturally, CVM contains higher concentrations of IgG than SP and RS [31] providing an explanation for the higher concentrations of antigen-specific antibodies detected in CVM.
CVM contained the highest HIV-specific antibodies compared to SP and RS. Antibody titers to gp120 A244gD were 6–14 fold higher than SP, and 83–163 fold higher than RS. Similarly, CVM titers to gp70V1V2 92TH023 were 4–6 fold higher than SP, and 20–60 fold higher than RS. Although the level and specificity of antibodies in mucosal secretions that are needed to provide protection are unknown, higher levels of HIV-specific IgG antibodies in CVM may provide better protection via this route of infection. Though intrarectal HIV transmission could be due to microtrauma during sexual intercourse leading to direct inoculation of HIV in the blood [32], vaccine development that generates higher levels of HIV-specific IgG and/or secretory IgA antibodies in RS may provide additional protection.
Antibody concentrations in mucosal secretions positively correlated with those in plasma, suggesting transudation of antibodies between systemic and mucosal compartments. It has been reported previously that antibodies in female genital mucosa and intestine are derived from the systemic circulation [10]. Neonatal Fc receptors (FcRn) on intestinal and genital epithelium were shown to mediate trans-epithelial transport of IgG into the lumen of intestinal and genital tracts where IgG could acquire antigens and form immune complexes [33–35]. Macrophages and monocytes expressing FcRs for IgG and IgA abundantly below human vaginal epithelium might also mediate both IgG and IgA effector functions [36]. In CVM, there was a positive correlation for gp120 A244gD and gp70V1V2 scaffold proteins. In SP, correlation was detected for gp120 A244gD and to gp70V1V2 92TH023 but no correlation was found for Case A2 scaffold. In RS, positive correlation was only observed for gp120 A244gD but not the scaffold proteins. This is likely due to the low number of responders and magnitude of antibody response (limit of detection of weak signals by ELISA) in RS. Taken together, correlation of antibody titers in plasma and mucosal secretions indicates that systemic antibodies likely contributed to the levels of IgG gp120-specific antibodies detected in anogenital secretions.
Monomeric IgA is predominantly found in plasma, whereas either dimeric or polymeric IgA is found in mucosal compartments [37]. Monomeric IgA to gp120 has been detected in plasma from RV144 vaccine recipients [38]. However, monomeric IgA cannot be transported by the polymeric immunoglobulin receptor (pIgR), which only transports dimeric IgA (secretory IgA) [39]. Though CVM and SP contain monomeric IgA generated by local production, it cannot be transported from plasma to secretions explaining lack of IgA to gp120 in CVM and SP following intramuscular administration with this vaccine. Dimeric IgA is the predominant IgA form in RS [10] but we did not detect dimeric IgA to any antigen we tested. Anogenital secretions were not collected as part of the RV144 trial, so dimeric IgA levels in mucosal specimens could not be evaluated. Naturally low IgG concentrations in RS and rapid decline of antibodies to immunization antigens may pose a challenge in generating robust IgG responses to HIV in the rectum. Developing vaccine regimens that induce dimeric IgA to HIV antigens in secretions may increase protection of HIV-1 transmissions via the mucosal routes [40].
Preclinical trials in animal models revealed that mucosal immunization with HIV antigens could induce both systemic and mucosal protective antibodies [41–45]. Other studies demonstrated the generation of mucosal immune responses and protective anti-HIV antibodies by systemic immunization and/or mucosal administration of HIV immunogens. Intramuscular immunized macaques were completely protected from intra-rectal challenge with simian-human immunodeficiency virus (SHIV) when vaccinated with a vaccine regimen consisting of alphavirus replicon particles (prime) and trimeric envelope glycoprotein boosts. Mucosal HIV-specific IgG or IgA was not detected in rectal or vaginal secretions [11]. Dimeric IgAs delivered directly into the rectal lumen have been reported to prevent SHIV acquisition [46]. Another study demonstrated induction of vaginal gp120-specific IgA in mice following immunization with DNA prime and gp120 boost vaccine via either intranasal or intramuscular administrations [13]. Monkeys immunized with HIV gp41 antigens by both intramuscular and intranasal administrations were completely protected from intravaginal challenge with SHIV and elicited gp41-specific vaginal IgAs with HIV transcytosis-blocking properties and vaginal IgGs with neutralizing and/or antibody-dependent cellular-cytotoxicity (ADCC) activities [12]. It is apparent that the development and optimization of mucosal collection procedures to characterize antibodies induced by HIV vaccines at mucosal surfaces and establishment of correlates of mucosal protection are essential for evaluating vaccine candidates advancing to efficacy trials.
The following shortcomings in this study must be considered. First, participants had highly variable rest intervals from the last RV144 immunization to RV305 boosting which was much longer than ideal for a vaccine regimen to maintain antibody responses. Second, sample size, particularly for RS collections, was small. The RV306 trial (ClinicalTrials.gov NCT01931358) immunized Thai HIV-uninfected with RV144 regimen plus ALVAC-HIV/AIDSVAX®B/E or AIDSVAX®B/E boosts at week 48, or ALVAC-HIV/AIDSVAX®B/E at week 60 or 72. Humoral immune response assessments of the trial with bigger sample size of mucosal collection will help elucidate HIV vaccine-induced immune responses in mucosal compartments. Third, functional characterizations of antibody neutralization activity, binding affinity, avidity, and other effector functions such as ADCC, antibody-dependent cell-mediated virus inhibition (ADCVI), antibody-dependent cellular phagocytosis (ADCP) are not reported here and remain ongoing.
We showed that mucosal collection methodologies were successful in collecting and characterizing IgG and IgA immunoglobulins from anogenital secretions and that the RV144 regimen induced IgG antibodies to gp120 and gp70V1V2 scaffolds derived from CRF01_AE (92TH023) and subtype B (Case A2). Absence of IgA gp120 specific responses suggests that protection of mucosal surfaces in RV144 is likely IgG-mediated. The presence of HIV-specific IgG mucosal antibodies might have contributed to the modest protective effect against HIV acquisition in the RV144 trial in a population with mostly heterosexual transmission. Presence of IgG in CVM and rectal fluid could prevent HIV acquisition by several mechanisms but the protective role of IgG in seminal fluid is unclear. Immunoglobulins induced by HIV vaccines that are localized at the vascular epithelium of anogenital surfaces could be protective by sequestering and neutralizing viruses that penetrate the epithelial barrier. Collection and characterization of mucosal secretions would advance our understanding of the immune responses at mucosal surfaces to design and select efficacious HIV-1 vaccines in the future.
Acknowledgments
Disclaimer: Material has been reviewed by the Walter Reed Army Institute of Research. There is no objection to its presentation and/or publication. The opinions or assertions contained herein are the private views of the authors, and are not to be construed as official, or as reflecting true views of the Department of the Army or the Department of Defense. The investigators have adhered to the policies for protection of human subjects as prescribed in AR 70–25.
We gratefully thank the volunteers for their dedication and active participation in this study. We thank Dr. Abraham Pinter for gp70V1V2 scaffold proteins.
The RV305 Study Group included the following: Ministry of Public Health: S. R. N., Nakorn Premsri, Narongsak Ekwattanakul, Thanakorn Arunngamwong, Chawetsan Namwat, Prayura Kunasol, Prasert Thongcharoen, and Attaya Limwattanayingyong; Mahidol University: P. P., Jittima Dhitavat, and Benjaluck Phonrat; Center of Excellence for Biomedical and Public Health Informatics: Jaranit Kaewkungwal and Pawinee Jarujareet; Armed Forces Research Institute of Medical Sciences: R. J. O., S. V., N. K., Alexandra Schuetz, Susan Mason, V. N., Nampueng Churikanont, Nongluck Sangnoi, Saowanit Getchalarat, Patricia Morgan, Pornsuk Visudhiphan, M. D. S., S. A., Bessara Nuntapinit, Rapee Trichavaroj, Kirsten S. Smith, and C. K.; Royal Thai Army–Armed Forces Research Institute of Medical Sciences: Sorachai Nitayaphan and Chirapa Eamsila; US Military HIV Research Program: J. H. K., M. L. R., J. L. E., Jintanat Ananworanich, Silvia Ratto-Kim, N. L. M., Charla Andrews, Robert Gramzinski, Poonam Pegu, and Michael Eller.; US Army Medical Materiel Development Activity: Elizabeth Heger; Emmes Corporation: Don Stablein and Peter Dawson; Global Solutions for Infectious Diseases: F. S., Carter Lee, and D. P. F.; Sanofi Pasteur: J. T., Sanjay Garunathan, S. P., and Carlos DiazGranados.
Data Availability
All relevant data are within the paper and its Supporting Information files.
Funding Statement
This work was supported by the US Army Medical Research and Materiel Command (Military Infectious Diseases Research Program) (cooperative agreements W81XWH-11-2-0174 and W81XWH-07-2-0067 with the Henry M. Jackson Foundation for the Advancement of Military Medicine); the National Institute of Allergy and Infectious Disease (interagency agreement Y1-AI-2642-12 with the US Army Medical Research and Materiel Command and an F31 fellowship), and the Bill & Melinda Gates Foundation (CAVIMC grants OPP1032144 and OP1146996). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The funder (Sanofi Pasteur and Global Solutions for Infectious Diseases (GSID)) provided support in the form of investigational products and salaries for authors (Sanofi Pasteur: S.P. and J.T.; GSID: F.S.), but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the 'authors contributions' section.
References
- 1.Fauci AS, Marston HD. Ending AIDS—Is an HIV Vaccine Necessary? N Engl J Med. 2014;370(6):495–8. doi: 10.1056/NEJMp1313771 [DOI] [PubMed] [Google Scholar]
- 2.Kaul R, Pettengell C, Sheth PM, Sunderji S, Biringer A, MacDonald K, et al. The genital tract immune milieu: an important determinant of HIV susceptibility and secondary transmission. J Reprod Immunol. 2008;77(1):32–40. doi: 10.1016/j.jri.2007.02.002 [DOI] [PubMed] [Google Scholar]
- 3.Ghosh M, Fahey JV, Shen Z, Lahey T, Cu-Uvin S, Wu Z, et al. Anti-HIV Activity in Cervical-Vaginal Secretions from HIV-Positive and -Negative Women Correlate with Innate Antimicrobial Levels and IgG Antibodies. PLoS ONE. 2010;5(6):e11366 doi: 10.1371/journal.pone.0011366 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Stax MJ, van Montfort T, Sprenger RR, Melchers M, Sanders RW, van Leeuwen E, et al. Mucin 6 in seminal plasma binds DC-SIGN and potently blocks dendritic cell mediated transfer of HIV-1 to CD4+ T-lymphocytes. Virology. 2009;391(2):203–11. doi: 10.1016/j.virol.2009.06.011 [DOI] [PubMed] [Google Scholar]
- 5.Devito C, Broliden K, Kaul R, Svensson L, Johansen K, Kiama P, et al. Mucosal and Plasma IgA from HIV-1-Exposed Uninfected Individuals Inhibit HIV-1 Transcytosis Across Human Epithelial Cells. J Immunol. 2000;165(9):5170–6. [DOI] [PubMed] [Google Scholar]
- 6.Devito C, Hinkula J, Kaul R, Kimani J, Kiama P, Lopalco L, et al. Cross-Clade HIV-1-Specific Neutralizing IgA in Mucosal and Systemic Compartments of HIV-1-Exposed, Persistently Seronegative Subjects. J Acquir Immune Defic Syndr. 2002;30(4):413–20. [DOI] [PubMed] [Google Scholar]
- 7.Kozlowski PA, Lynch RM, Patterson RR, Cu-Uvin S, Flanigan TP, Neutra MR. Modified Wick Method Using Weck-Cel Sponges for Collection of Human Rectal Secretions and Analysis of Mucosal HIV Antibody. J Acquir Immune Defic Syndr. 2000;24(4):297–309. [DOI] [PubMed] [Google Scholar]
- 8.Kutteh WH, Prince SJ, Hammond KR, Kutteh CC, Mestecky J. Variations in immunoglobulins and IgA subclasses of human uterine cervical secretions around the time of ovulation. Clin Exp Immunol. 1996;104(3):538–42. doi: 10.1046/j.1365-2249.1996.36742.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Moldoveanu Z, Huang W-Q, Kulhavy R, Pate MS, Mestecky J. Human Male Genital Tract Secretions: Both Mucosal and Systemic Immune Compartments Contribute to the Humoral Immunity. J Immunol. 2005;175(6):4127–36. [DOI] [PubMed] [Google Scholar]
- 10.Mestecky J, Moldoveanu Z, Smith PD, Hel Z, Alexander RC. Mucosal immunology of the genital and gastrointestinal tracts and HIV-1 infection. J Reprod Immunol. 2009;83(1):196–200. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Barnett SW, Burke B, Sun Y, Kan E, Legg H, Lian Y, et al. Antibody-Mediated Protection against Mucosal Simian-Human Immunodeficiency Virus Challenge of Macaques Immunized with Alphavirus Replicon Particles and Boosted with Trimeric Envelope Glycoprotein in MF59 Adjuvant. J Virol. 2010;84(12):5975–85. doi: 10.1128/JVI.02533-09 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Bomsel M, Tudor D, Drillet A-S, Alfsen A, Ganor Y, Roger M-G, et al. Immunization with HIV-1 gp41 Subunit Virosomes Induces Mucosal Antibodies Protecting Nonhuman Primates against Vaginal SHIV Challenges. Immunity. 2011;34(2):269–80. doi: 10.1016/j.immuni.2011.01.015 [DOI] [PubMed] [Google Scholar]
- 13.Cristillo AD, Ferrari MG, Hudacik L, Lewis B, Galmin L, Bowen B, et al. Induction of mucosal and systemic antibody and T-cell responses following prime–boost immunization with novel adjuvanted human immunodeficiency virus-1-vaccine formulations. J Gen Virol. 2011;92(1):128–40. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Rerks-Ngarm S, Pitisuttithum P, Nitayaphan S, Kaewkungwal J, Chiu J, Paris R, et al. Vaccination with ALVAC and AIDSVAX to Prevent HIV-1 Infection in Thailand. N Engl J Med. 2009;361(23):2209–20. doi: 10.1056/NEJMoa0908492 [DOI] [PubMed] [Google Scholar]
- 15.Robb ML, Rerks-Ngarm S, Nitayaphan S, Pitisuttithum P, Kaewkungwal J, Kunasol P, et al. Risk behaviour and time as covariates for efficacy of the HIV vaccine regimen ALVAC-HIV (vCP1521) and AIDSVAX B/E: a post-hoc analysis of the Thai phase 3 efficacy trial RV 144. Lancet Infect Dis. 2012;12(7):531–7. doi: 10.1016/S1473-3099(12)70088-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Haynes BF, Gilbert PB, McElrath MJ, Zolla-Pazner S, Tomaras GD, Alam SM, et al. Immune-Correlates Analysis of an HIV-1 Vaccine Efficacy Trial. N Engl J Med. 2012;366(14):1275–86. doi: 10.1056/NEJMoa1113425 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Karasavvas N, Billings E, Rao M, Williams C, Zolla-Pazner S, Bailer RT, et al. The Thai Phase III HIV Type 1 Vaccine Trial (RV144) Regimen Induces Antibodies That Target Conserved Regions Within the V2 Loop of gp120. AIDS Res Hum Retroviruses. 2012;28(11):1444–57. doi: 10.1089/aid.2012.0103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Zolla-Pazner S, deCamp A, Gilbert PB, Williams C, Yates NL, Williams WT, et al. Vaccine-Induced IgG Antibodies to V1V2 Regions of Multiple HIV-1 Subtypes Correlate with Decreased Risk of HIV-1 Infection. PLoS ONE. 2014;9(2):e87572 doi: 10.1371/journal.pone.0087572 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Zolla-Pazner S, deCamp AC, Cardozo T, Karasavvas N, Gottardo R, Williams C, et al. Analysis of V2 Antibody Responses Induced in Vaccinees in the ALVAC/AIDSVAX HIV-1 Vaccine Efficacy Trial. PLoS ONE. 2013;8(1):e53629 doi: 10.1371/journal.pone.0053629 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Rolland M, Edlefsen PT, Larsen BB, Tovanabutra S, Sanders-Buell E, Hertz T, et al. Increased HIV-1 vaccine efficacy against viruses with genetic signatures in Env V2. Nature. 2012;490(7420):417–20. doi: 10.1038/nature11519 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Rerks-Ngarm S, Pitisuttithum P, Excler J-L, Nitayaphan S, Kaewkungwal J, Premsri N, et al. Randomized, Double-Blind Evaluation of Late Boost Strategies for HIV-Uninfected Vaccine Recipients in the RV144 HIV Vaccine Efficacy Trial. J Infect Dis. 2017;215(8):1255–63. doi: 10.1093/infdis/jix099 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Karnasuta C, Akapirat S, Madnote S, Savadsuk H, Puangkaew J, Rittiroongrad S, et al. Comparison of Antibody Responses Induced by RV144, VAX003, and VAX004 Vaccination Regimens. AIDS Res Hum Retroviruses. 2017;33(5):410–23. doi: 10.1089/AID.2016.0204 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Kayman SC, Wu Z, Revesz K, Chen H, Kopelman R, Pinter A. Presentation of native epitopes in the V1/V2 and V3 regions of human immunodeficiency virus type 1 gp120 by fusion glycoproteins containing isolated gp120 domains. J Virol. 1994;68(1):400–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Pinter A, Honnen WJ, Kayman SC, Trochev O, Wu Z. Potent neutralization of primary HIV-1 isolates by antibodies directed against epitopes present in the V1V2 domain of HIV-1 gp120. Vaccine. 1998;16(19):1803–11. [DOI] [PubMed] [Google Scholar]
- 25.Karasavvas N, Karnasuta C, Savadsuk H, Madnote S, Inthawong D, Chantakulkij S, et al. IgG Antibody Responses to Recombinant gp120 Proteins, gp70V1/V2 Scaffolds, and a CyclicV2 Peptide in Thai Phase I/II Vaccine Trials Using Different Vaccine Regimens. AIDS Res Hum Retroviruses. 2015;31(11):1178–86. doi: 10.1089/AID.2015.0034 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Hsu DC, O'Connell RJ. Progress in HIV vaccine development. Hum Vaccin Immunother. 2017;13(5):1018–30. doi: 10.1080/21645515.2016.1276138 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Excler J-L, Ake J, Robb ML, Kim JH, Plotkin SA. Nonneutralizing Functional Antibodies: a New “Old” Paradigm for HIV Vaccines. Clin Vaccine Immunol. 2014;21(8):1023–36. doi: 10.1128/CVI.00230-14 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Haynes BF, Gilbert PB, McElrath MJ, Zolla-Pazner S, Tomaras GD, Alam SM, et al. Immune-Correlates Analysis of an HIV-1 Vaccine Efficacy Trial. N Engl J Med. 2012;366(14):1275–86. doi: 10.1056/NEJMoa1113425 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Mohamed AS, Becquart P, Hocini H, Métais P, Kazatchkine M, Bélec L. Dilution assessment of cervicovaginal secretions collected by vaginal washing to evaluate mucosal shedding of free human immunodeficiency virus. Clin Diagn Lab Immunol. 1997;4(5):624–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Dezzutti CS, Hendrix CW, Marrazzo JM, Pan Z, Wang L, Louissaint N, et al. Performance of Swabs, Lavage, and Diluents to Quantify Biomarkers of Female Genital Tract Soluble Mucosal Mediators. PLoS ONE. 2011;6(8):e23136 doi: 10.1371/journal.pone.0023136 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Mestecky J. Humoral immune responses to the human immunodeficiency virus type-1 (HIV-1) in the genital tract compared to other mucosal sites. J Reprod Immunol. 2007;73(1):86–97. [DOI] [PubMed] [Google Scholar]
- 32.Geist RF. Sexually related trauma. Emerg Med Clin North Am. 1988;6(3):439–66. [PubMed] [Google Scholar]
- 33.Knee RA, Hickey DK, Beagley KW, Jones RC. Transport of IgG across the Blood-Luminal Barrier of the Male Reproductive Tract of the Rat and the Effect of Estradiol Administration on Reabsorption of Fluid and IgG by the Epididymal Ducts. Biol Reprod. 2005;73(4):688–94. doi: 10.1095/biolreprod.105.041079 [DOI] [PubMed] [Google Scholar]
- 34.Li Z, Palaniyandi S, Zeng R, Tuo W, Roopenian DC, Zhu X. Transfer of IgG in the female genital tract by MHC class I-related neonatal Fc receptor (FcRn) confers protective immunity to vaginal infection. Proc Natl Acad Sci U S A. 2011;108(11):4388–93. doi: 10.1073/pnas.1012861108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Yoshida M, Claypool SM, Wagner JS, Mizoguchi E, Mizoguchi A, Roopenian DC, et al. Human Neonatal Fc Receptor Mediates Transport of IgG into Luminal Secretions for Delivery of Antigens to Mucosal Dendritic Cells. Immunity. 2004;20(6):769–83. doi: 10.1016/j.immuni.2004.05.007 [DOI] [PubMed] [Google Scholar]
- 36.Astronomo RD, Santra S, Ballweber-Fleming L, Westerberg KG, Mach L, Hensley-McBain T, et al. Neutralization Takes Precedence Over IgG or IgA Isotype-related Functions in Mucosal HIV-1 Antibody-mediated Protection. EBioMedicine. 2016;14:97–111. doi: 10.1016/j.ebiom.2016.11.024 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Woof JM, Mestecky J. Mucosal immunoglobulins. Immunol Rev. 2005;206(1):64–82. [DOI] [PubMed] [Google Scholar]
- 38.Tomaras GD, Ferrari G, Shen X, Alam SM, Liao H-X, Pollara J, et al. Vaccine-induced plasma IgA specific for the C1 region of the HIV-1 envelope blocks binding and effector function of IgG. Proc Natl Acad Sci U S A. 2013;110(22):9019–24. doi: 10.1073/pnas.1301456110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Johansen F-E, Braathen R, Brandtzaeg P. The J Chain Is Essential for Polymeric Ig Receptor-Mediated Epithelial Transport of IgA. J Immunol. 2001;167(9):5185 [DOI] [PubMed] [Google Scholar]
- 40.Zhou M, Ruprecht RM. Are anti-HIV IgAs good guys or bad guys? Retrovirology. 2014;11(1):109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Cranage MP, Fraser CA, Stevens Z, Huting J, Chang M, Jeffs SA, et al. Repeated vaginal administration of trimeric HIV-1 clade C gp140 induces serum and mucosal antibody responses. Mucosal Immunol. 2009;3(1):57–68. doi: 10.1038/mi.2009.110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Kaneko H, Bednarek I, Wierzbicki A, Kiszka I, Dmochowski M, Wasik TJ, et al. Oral DNA Vaccination Promotes Mucosal and Systemic Immune Responses to HIV Envelope Glycoprotein. Virology. 2000;267(1):8–16. doi: 10.1006/viro.1999.0093 [DOI] [PubMed] [Google Scholar]
- 43.Lu L, Palaniyandi S, Zeng R, Bai Y, Liu X, Wang Y, et al. A Neonatal Fc Receptor-Targeted Mucosal Vaccine Strategy Effectively Induces HIV-1 Antigen-Specific Immunity to Genital Infection. J Virol. 2011;85(20):10542–53. doi: 10.1128/JVI.05441-11 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Sakaue G, Hiroi T, Nakagawa Y, Someya K, Iwatani K, Sawa Y, et al. HIV Mucosal Vaccine: Nasal Immunization with gp160-Encapsulated Hemagglutinating Virus of Japan-Liposome Induces Antigen-Specific CTLs and Neutralizing Antibody Responses. J Immunol. 2003;170(1):495–502. [DOI] [PubMed] [Google Scholar]
- 45.Zhang H, Huang Y, Fayad R, Spear GT, Qiao L. Induction of Mucosal and Systemic Neutralizing Antibodies against Human Immunodeficiency Virus Type 1 (HIV-1) by Oral Immunization with Bovine Papillomavirus-HIV-1 gp41 Chimeric Virus-Like Particles. J Virol. 2004;78(15):8342–8. doi: 10.1128/JVI.78.15.8342-8348.2004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Watkins JD, Sholukh AM, Mukhtar MM, Siddappa NB, Lakhashe SK, Kim M, et al. Anti-HIV IgA Isotypes: Differential Virion Capture and Inhibition of Transcytosis are Linked to Prevention of Mucosal R5 SHIV Transmission. AIDS. 2013;27(9):F13–F20. doi: 10.1097/QAD.0b013e328360eac6 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All relevant data are within the paper and its Supporting Information files.