In the past decade, behavioral HIV prevention has labored under the presumption that it is not very effective. This presumption may be justified, but at best only partly so. Our team, with support from the National Institute of Mental Health (R01MH090173), has spent a decade summarizing evidence of the effectiveness of behavioral HIV prevention interventions [1–19]. Clearly the various interventions for HIV prevention do not have the effectiveness expected of a vaccine – the still-elusive single, one-time intervention to prevent HIV – but the presumption that they have no or limited effectiveness is not justified. Undoubtedly these interventions have contributed to the decline of HIV over the past two decades [20]. On the other hand, the promise of biomedical interventions for HIV – whether treatment or prevention – imagined in many randomized controlled trials is rarely fully realized in real-life application. Common thinking about HIV prevention through behavior change may be characterized by unfounded pessimism, while biomedical interventions may be rewarded by unreal optimism.
Our systematic reviews have convinced us of two things: that HIV prevention through behavior change has an effect in containing the further spread of HIV infection, and that abandoning behavioral HIV prevention efforts entirely and replacing them with biomedical interventions alone would be a risky bet.
Our belief in HIV prevention through behavior change has been strengthened by a close examination of the trials of oral pre-exposure prophylaxis, or PrEP. These trials of the effectiveness of tenofovir disproxil fumarate (TDF), with and without emtracitibine (FTC), as a daily oral preventive medication proved effectiveness, with sufficient adherence nearly completely blocking HIV transmission [21].
On careful review, we observed that, in some studies, both the treatment and control groups reduced risk behaviors, changes which cannot be attributed to PrEP alone. We present this evidence and why we think the behavioral interventions in these trials were effective.
We focused our attention on the initial six Phase 3 randomized controlled trials of oral PrEP [22–27] (one assessed topical and oral PrEP). We reviewed the articles that reported primary trial results and all supplementary materials also made available, including study protocols obtained online, as well as subsequent published analyses.
The history and context of the oral PrEP trials
The trials of oral PrEP were born in controversy. Skeptics raised numerous objections. Some of these focused on the biological aspects: that the risk of providing potent drugs with possible side effects to HIV-uninfected people was unacceptable [28], or that using FTC/TDF for prevention could result in drug resistance, compromising its use for treatment [29]. Others focused on the possible behavioral effects: that people might increase risk taking, believing they were protected from HIV [30]. Still others focused on what they perceived as the exploitation of people at risk of HIV in low-income countries, doubting these participants would ever be recipients of the expensive drug if it were found to be effective [31]. While the first two fears have largely proved to be baseless, the last objection does have some merit: many people at risk in the countries where these trials were conducted are still waiting for their chance to use PrEP.
Against this background, initial feasibility and acceptability studies of oral PrEP were undertaken in Cambodia [32], Cameroon, Ghana, and Nigeria [33], primarily among female sex workers. These studies faced intense criticism from community groups in three of these sites [34]. All but the Ghana study were stopped [35]. The results of one initial study showed some promise [33], but Phase 3 effectiveness trials were stalled following this controversy [36]. Once Phase 3 trials did start, it was with intense scrutiny from both an academic and a community perspective.
PrEP trials were eventually initiated among men who have sex with men (largely in Latin America but with participants from Thailand and the United States) [22], serodiscordant couples in Kenya and Uganda [23], high-risk heterosexuals in Botswana [24], people who inject drugs in Thailand [25], and high-risk women in sub-Saharan Africa [26,27]. These trials began with equipoise on the question of PrEP effectiveness, making double-blind placebo-controlled trials necessary. All participants were to receive the standard HIV prevention package available in their countries. In reality, they received much more.
The trials were “event-driven”: investigators calculated the number of incident HIV infections needed to detect a significant difference between the treatment and control arms. They then calculated the total number of participants assumed to be needed to reach that number of events in the shortest time possible, based on available data on HIV incidence. The calculated number of participants were then recruited and followed until the targeted number of events was reached, when the studies were unblinded and examined for differences. With the number of events and the number of participants both fixed, the only variable subject to change once a trial started was the time needed for recruitment and for follow-up and completion of the trial.
The number of events needed was based on the difference between the expected HIV incidence and the observed HIV incidence in the trial. The number of new infections needed to detect a difference in these trials seemed modest, ranging from as few as 40 to roughly 300 in the largest. The estimated number of participants recruited for these studies to reach this number of events ranged from 1200 to 5000. Some of these trials experienced prolonged follow-up periods, as the targeted number of events occurred more slowly than originally envisioned. In the most extreme case, a trial began enrollment in June 2005 and continued enrolling until July 2010, following some participants as long as 72 months, though only 40 events were targeted [25]. The HIV incidence in the placebo arm of this trial, 0.68 per 100 person years, was far less than the 3.4 per 100 person years used in trial planning, a seemingly reasonable estimate based on a previous HIV vaccine trial in the same research clinics [37]. The number of events needed in another trial was based on estimated HIV incidence of 2.75 per 100 person years, ultimately finding 1.99 per 100 person years in the placebo arm [23]. An assumed annual incidence of 5 per 100 person years was used in another trial, but the measured HIV incidence in the placebo arm at study completion was only 3.1 per 100 person years [24].
Behavior changes in the PrEP trials
Some differences between projected and observed HIV incidence in these trials could be simple miscalculation: investigators may have used overestimates of HIV incidence to calculate the number of events needed. It is also possible that the behavioral HIV prevention interventions provided in these trials to both arms may have decreased risk-taking behaviors and made HIV infections less likely. Data found in results of these trials, challenging to disentangle, appear to support this latter explanation.
In assessing PrEP effectiveness, the investigators needed equivalency of the treatment and control groups. Any major difference would jeopardize the investigators’ ability to reject their null hypotheses. Investigators paid close attention to the “between-group” comparisons at baseline and over time to demonstrate equivalency. In this regard, the studies were generally exemplary. The investigators were able to recruit high risk people, randomize them to two (or more) conditions without introducing any potentially distorting differences, and follow the majority to the conclusion. The two trials that did not obtain conclusive results encountered difficulties in promoting adherence to the study medication [38,39], not in these other aspects of good trial conduct.
One result of this close focus on demonstrating equivalency of the arms was a focus on “between-group” comparisons in the analyses, to the near exclusion of any examination of changes over time experienced by both groups equally. Nonetheless, some elements of these changes can be detected.
In the iPrex trial, for example, observed rates of syphilis among study participants dropped by half in both arms, and other STIs decreased even more [22,40]. The reported number of partners with whom participants engaged in receptive anal sex dropped by half as well, again in both arms. Likewise, the reported percentage using condoms for receptive sex increased from approximately 50% at baseline to around 80% at follow-up. While self-reported behavioral data can always be questioned, the correlation between the reported decreased risk behavior and observed decreases in sexually transmitted infections makes these data difficult to doubt.
In the Partners PrEP trial, more than a quarter of all participants at enrollment reported sex without condoms with their HIV-infected partner in the prior month; this decreased to 13% at 12 months and 9% at 24 months [23]. Even a trial that did not demonstrate effectiveness of PrEP showed modest but significant reductions in some key behaviors: number of sex partners, vaginal sex acts, and sex acts without a condom all decreased over time [26].
Some subsequent analyses of behavior changes in these trials were published, primarily focused on the possible effect of PrEP on subsequent risk-taking, or disinhibition. Results compared three different conditions under which behavior changes may have occurred: by participants’ perception of to which arm they were randomized in the iPrEx trial [40], before and after unmasking of the Partners PrEP trial [41], or over time in one extended study [42]. In the third case, investigators reported marked decreases in sexual risk-taking behaviors over the course of the study. For example, the percentage of participants who reported sex with more than one partner in the previous three months dropped by two thirds from baseline to the 72-month follow-up (21.7% to 6.5%). Casual partner sex declined from 38% at baseline to 14.5% at 72 months [42]. The limited behavioral data reported suggest a pattern of decreasing risk-taking behaviors over the course of the double-blind studies regardless of trial arm, perhaps in response to the comprehensive, behaviorally based package of HIV prevention interventions provided to all participants. Behavioral changes reported in studies are sometimes believed to be a product of the Hawthorne effect [43], in which awareness of being studied alters the natural behaviors of research subjects, or of social desirability bias [44]. In the latter, the desire for social approval is thought to affect accurate reporting of sensitive behaviors. Both of these sources of bias exist in these PrEP trials, though the thoroughness of the protocols and the care taken in data collection suggest these biases were not a major threat.
What made these studies effective, in addition to the PrEP effect?
In trying to understand what made the HIV prevention packages apparently more effective than they are generally believed to be, we examined the content of the interventions offered. Trial participants actually received considerably more than the standard prevention provided in their countries. A key difference was the frequency of the interventions: participants were seen monthly for risk-reduction counseling and support, free condoms, adherence support, and follow-up.
Contrast this to the current WHO recommendations for HIV testing and counseling [45], the key element of HIV prevention used in most countries. This intervention consists of testing those at risk of HIV, identifying those who are infected, with referral to care and treatment, including antiretroviral therapy, but little for the uninfected: “Individuals who test HIV-negative should receive brief health information about their test results. Research to date has not demonstrated that a lengthy counselling session is needed or is beneficial” (p.24). The recommended frequency of contact – an opportunity to provide the type of counseling and support that was part of the standard prevention package in most of these PrEP trials – is also limited: “WHO recommends that people in high-risk categories retest at least annually” (p.24).
In standard practice, then, the opportunity to intervene more meaningfully with those not infected but at risk of HIV infection is often missed. A comparison of some of the key components of behavioral prevention provided in the PrEP trials and the current WHO guidelines is shown in Table 1.
| HIV testing and counseling | Risk reduction counseling | Condom provision | STI assessment and treatment | PrEP adherence counseling | |
|---|---|---|---|---|---|
| Partners PrEP [23,41] | Monthly | Monthly | Monthly | Every 3 months | Monthly |
| Bangkok Tenofovir [25,42] | Monthly | Monthly | Monthly or every 3 months | N/A | Monthly or more frequently |
| iPrEX [22,40] | Monthly | Monthly | Monthly | Every 24 weeks | Monthly |
| VOICE [27] | Monthly | monthly | Monthly | At enrollment, annually, or when indicated | Monthly |
| Botswana TDF-FTC [24] | Monthly | Every 3 months (or on request) | Each visit | Monthly | Monthly |
| FemPrEP [26] | Monthly | Monthly | Monthly | On entry and final visit | Monthly |
| WHO Consolidated guidelines on HIV testing services 2015 [45] | Annually | Brief information on test results | N/A | N/A | N/A |
| WHO PrEP Implementation Tool 2017 [46] | Every 3 months | First visit | First visit | Every 3 to 6 months | Every visit (or every 3 months) |
Trial participants received more frequent and more intense behavioral interventions than the standard HIV prevention package offered in the countries where these trials took place.
Though they appear to have been effective in the PrEP trials, one of the criticisms of behavioral interventions is effectiveness requires intensity and reinforcement. It is also becoming clear, however, that biomedical interventions too require reinforcement to be effective, either to achieve the adherence that makes PrEP effective and or the retention in treatment that leads to viral suppression. Effective HIV prevention through any of the means currently available, behavioral or biomedical, requires a greater intensity of efforts than is often allocated to the task.
Perhaps because they were concerned about loss to follow up and potential criticism like that levelled at the initial feasibility studies, trial investigators provided higher quality of HIV prevention than current guidance recommends. We contend that these trials, beyond proving PrEP to be effective, have also demonstrated that the HIV prevention model used in most countries can be more effective if provided with greater frequency and intensity.
It has become a truism in HIV that the dichotomy between biomedical and behavioral prevention is false, and that all biomedical prevention interventions require a behavioral response. We could be criticized for making a distinction between the two that many would like to believe is passé. In response, we would point out that the integral nature of the biomedical and behavioral is not well conveyed in the presentation of these and many other studies: as can be seen, extracting the behavioral components of these trials’ outcomes is difficult to do. Including a more robust presentation of all data, behavioral as well as biomedical, not limited to “between-group” comparisons, would make evaluation of trial results fairer and more balanced. As a result, a more robust picture of the potential impact of behavioral interventions to prevent HIV may emerge.
We admit that none of the evidence we have gleaned from these studies is conclusive. We present it as highly suggestive that behavioral HIV prevention deserves more credit for effectiveness. This realization is not new: during the (often long) course of these PrEP trials, a common joke was, “We know how to prevent HIV… Just enroll people in PrEP trials!” In the intervening years since these trials were published, it appears that the kernel of truth in that joke has been forgotten and that purely behavioral HIV prevention is afforded less and less prominence in HIV priorities worldwide. It is time for that to change.
Acknowledgments
Conflicts of interest and source of funding
We declare no conflicts of interest. This work was funded through the National Institute of Mental Health (R01MH090173).
References
- 1.Zajac K, Kennedy CE, Fonner VA, Armstrong KS, O’Reilly KR, Sweat MD. A systematic review of the effects of behavioral counseling on sexual risk behaviors and HIV/STI prevalence in low- and middle-income countries. AIDS Behav 2015; 19(7):1178–1202. doi: 10.1007/s10461-014-0893-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Sweat MD, Yeh T, Kennedy C, O’Reilly K, Armstrong K, Fonner V. Condom social marketing effects in low- and middle-income countries: A systematic review update, 1990 to 2019. Am J Health Promot 2020; 34(1):91–95. doi: 10.1177/0890117119864921. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.O’Reilly KR, d’Aquila E, Fonner V, Kennedy C, Sweat M. Can policy interventions affect HIV-related behaviors? A systematic review of the evidence from low- and middle-income countries. AIDS Behav 2017; 21(3):626–642. doi: 10.1007/s10461-016-1615-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Kennedy CE, Fonner VA, Armstrong KA, et al. The Evidence Project risk of bias tool: assessing study rigor for both randomized and non-randomized intervention studies. Syst Rev 2019; 8(1):3. doi: 10.1186/s13643-018-0925-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Bertrand JT, O’Reilly K, Denison J, Anhang R, Sweat M. Systematic review of the effectiveness of mass communication programs to change HIV/AIDS-related behaviors in developing countries. Health Educ Res 2006; 21(4):567–597. doi: 10.1093/her/cyl036. [DOI] [PubMed] [Google Scholar]
- 6.Kennedy C, O’Reilly K, Medley A, Sweat M. The impact of HIV treatment on risk behaviour in developing countries: a systematic review. AIDS Care 2007; 19(6):707–720. doi: 10.1080/09540120701203261. [DOI] [PubMed] [Google Scholar]
- 7.Sweat M, O’Reilly K, Kennedy C, Medley A. Psychosocial support for HIV-infected populations in developing countries: a key yet understudied component of positive prevention. AIDS 2007; 21(8):1070–1071. doi: 10.1097/QAD.0b013e3280f774da. [DOI] [PubMed] [Google Scholar]
- 8.Denison JA, O’Reilly KR, Schmid GP, Kennedy CE, Sweat MD. HIV voluntary counseling and testing and behavioral risk reduction in developing countries: a meta-analysis, 1990−−2005. AIDS Behav 2008; 12(3):363–373. doi: 10.1007/s10461-007-9349-x. [DOI] [PubMed] [Google Scholar]
- 9.Medley A, Kennedy C, O’Reilly K, Sweat M. Effectiveness of peer education interventions for HIV prevention in developing countries: a systematic review and meta-analysis. AIDS Educ Prev 2009; 21(3):181–206. doi: 10.1521/aeap.2009.21.3.181. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Kennedy CE, Medley AM, Sweat MD, O’Reilly KR. Behavioural interventions for HIV positive prevention in developing countries: a systematic review and meta-analysis. Bull World Health Organ 2010; 88(8):615–623. doi: 10.2471/BLT.09.068213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Fonner VA, Denison J, Kennedy CE, O’Reilly K, Sweat M. Voluntary counseling and testing (VCT) for changing HIV-related risk behavior in developing countries. Cochrane Database Syst Rev 2012; (9):CD001224. doi: 10.1002/14651858.CD001224.pub4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Sweat MD, Denison J, Kennedy C, Tedrow V, O’Reilly K. Effects of condom social marketing on condom use in developing countries: a systematic review and meta-analysis, 1990–2010. Bull World Health Organ 2012; 90(8):613–622a. doi: 10.2471/BLT.11.094268. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Kennedy CE, Fonner VA, Sweat MD, Okero FA, Baggaley R, O’Reilly KR. Provider-initiated HIV testing and counseling in low- and middle-income countries: a systematic review. AIDS Behav 2013; 17(5):1571–1590. doi: 10.1007/s10461-012-0241-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.O’Reilly KR, Kennedy CE, Fonner VA, Sweat MD. Family planning counseling for women living with HIV: a systematic review of the evidence of effectiveness on contraceptive uptake and pregnancy incidence, 1990 to 2011. BMC Public Health 2013; 13:935. doi: 10.1186/1471-2458-13-935. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Fonner VA, Armstrong KS, Kennedy CE, O’Reilly KR, Sweat MD. School based sex education and HIV prevention in low- and middle-income countries: a systematic review and meta-analysis. PloS One 2014; 9(3):e89692. doi: 10.1371/journal.pone.0089692. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Fonner VA, Kennedy CE, O’Reilly KR, Sweat MD. Systematic assessment of condom use measurement in evaluation of HIV prevention interventions: need for standardization of measures. AIDS Behav 2014; 18(12):2374–2386. doi: 10.1007/s10461-013-0655-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Kennedy CE, Fonner VA, O’Reilly KR, Sweat MD. A systematic review of income generation interventions, including microfinance and vocational skills training, for HIV prevention. AIDS Care 2014; 26(6):659–673. doi: 10.1080/09540121.2013.845287. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.O’Reilly KR, Fonner VA, Kennedy CE, Sweat MD. Free condom distribution: what we don’t know may hurt us. AIDS Behav 2014; 18(11):2169–2171. doi: 10.1007/s10461-014-0742-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Kennedy CE, Fonner VA, Armstrong KA, O’Reilly KR, Sweat MD. Increasing HIV serostatus disclosure in low and middle-income countries: a systematic review of intervention evaluations. AIDS 2015; 29(Suppl 1):S7–S23. doi: 10.1097/QAD.0000000000000671. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.UNAIDS. UNAIDS Data 2019 Reference. 2019. https://www.unaids.org/sites/default/files/media_asset/2019-UNAIDS-data_en.pdf (accessed Feb 8, 2020).
- 21.Fonner VA, Dalglish SL, Kennedy CE, et al. Effectiveness and safety of oral pre-exposure prophylaxis for all populations: a systematic review and meta-analysis. AIDS 2016; 30(12):1973–1983. doi: 10.1097/QAD.0000000000001145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Grant RM, Lama JR, Anderson PL, et al. Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N Engl J Med 2010; 363(27):2587–2599. doi: 10.1056/NEJMoa1011205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Baeten JM, Donnell D, Ndase P, et al. Antiretroviral prophylaxis for HIV prevention in heterosexual men and women. N Engl J Med 2012; 367(5):399–410. doi: 10.1056/NEJMoa1108524. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Thigpen MC, Kebaabetswe PM, Paxton LA, et al. Antiretroviral preexposure prophylaxis for heterosexual HIV transmission in Botswana. N Engl J Med 2012; 367(5):423–434. doi: 10.1056/NEJMoa1110711. [DOI] [PubMed] [Google Scholar]
- 25.Choopanya K, Martin M, Suntharasamai P, et al. Antiretroviral prophylaxis for HIV infection in injecting drug users in Bangkok, Thailand (the Bangkok Tenofovir Study): a randomised, double-blind, placebo-controlled phase 3 trial. Lancet 2013; 381(9883):2083–2090. doi: 10.1016/S0140-6736(13)61127-7. [DOI] [PubMed] [Google Scholar]
- 26.Van Damme L, Corneli A, Ahmed K, et al. Preexposure prophylaxis for HIV infection among African women. N Engl J Med 2012; 367(5):411–422. doi: 10.1056/NEJMoa1202614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Marrazzo JM, Ramjee,G, Richardson, BA, et al. Tenofovir-based preexposure prophylaxis for HIV infection among African women. N Engl J Med 2015; 372(6):509–518. doi: 10.1056/NEJMoa1402269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Ahmad K Trial of antiretroviral for HIV prevention on hold. Lancet Infect Dis 2004; 4(10):597. doi: 10.1016/s1473-3099(04)01159-4. [DOI] [PubMed] [Google Scholar]
- 29.Youle M, Wainberg MA. Pre-exposure chemoprophylaxis (PrEP) as an HIV prevention strategy. J Int Assoc Physicians AIDS Care 2003; 2(3):102–105. doi: 10.1177/154510970300200302. [DOI] [PubMed] [Google Scholar]
- 30.Cassell MM, Halperin DT, Shelton JD, Stanton D. Risk compensation: the Achilles’ heel of innovations in HIV prevention? BMJ 2006; 332(7541):605–607. doi: 10.1136/bmj.332.7541.605. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Eaton LA, Kalichman S. Risk compensation in HIV prevention: implications for vaccines, microbicides, and other biomedical HIV prevention technologies. Curr HIV/AIDS Rep 2007; 4(4):165–172. doi: 10.1007/s11904-007-0024-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Cohen J Can a drug provide some protection? Science 2003; 301(5640):1660–1661. doi: 10.1126/science.301.5640.1660. [DOI] [PubMed] [Google Scholar]
- 33.Peterson L, Taylor D, Roddy R, et al. Tenofovir disoproxil fumarate for prevention of HIV infection in women: a phase 2, double-blind, randomized, placebo-controlled trial. PLoS Clin Trials 2007; 2(5):e27. doi: 10.1371/journal.pctr.0020027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.The New Humanitarian. Clinical trial of anti-HIV drug on sex workers in question. 2005. http://www.thenewhumanitarian.org/fr/node/220442 (accessed Feb 8, 2020).
- 35.Singh JA, Mills EJ. The abandoned trials of pre-exposure for HIV: What went wrong? PLoS Med 2005; 2(9):e234. doi: 10.1371/journal.pmed.0020234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Grant RM, Buchbinder S, Cates W Jr, et al. AIDS: Promote HIV chemoprophylaxis research, don’t prevent it. Science 2005; 309(5744):2170–2171. doi: 10.1126/science.1116204. [DOI] [PubMed] [Google Scholar]
- 37.Pitisuttithum P, Gilbert P, Gurwith M, et al. Randomized, double-blind, placebo-controlled efficacy trial of a bivalent recombinant glycoprotein 120 HIV-1 vaccine among injection drug users in Bangkok, Thailand. J Infect Dis 2006; 194:1661–1671. doi: 10.1086/508748. [DOI] [PubMed] [Google Scholar]
- 38.Corneli AL, Deese J, Wang M, et al. FEM-PrEP: adherence patterns and factors associated with adherence to a daily oral study product for pre-exposure prophylaxis. J Acquir Immune Defic Syndr 2014; 66(3):324–331. doi: 10.1097/QAI.0000000000000158. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.van der Straten A, Brown ER, Marrazzo JM, et al. Divergent adherence estimates with pharmacokinetic and behavioural measures in the MTN‐003 (VOICE) study. J Int AIDS Soc 2016; 19:20642. doi: 10.7448/IAS.19.1.20642. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Marcus JL, Glidden DV, Mayer KH, et al. No evidence of sexual risk compensation in the iPrEx trial of daily oral HIV preexposure prophylaxis. PLoS One 2013; 8(12):e81997. doi: 10.1371/journal.pone.0081997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Mugwanya KK, Donnell D, Celum C, et al. Sexual behaviour of heterosexual men and women receiving antiretroviral pre-exposure prophylaxis for HIV prevention: a longitudinal analysis. Lancet Infect Dis 2013; 13:1021–28. doi: 10.1016/S1473-3099(13)70226-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Martin M, Vanichseni S, Suntharasamai P, et al. Risk behaviors and risk factors for HIV infection among participants in the Bangkok Tenofovir Study, an HIV pre-exposure prophylaxis trial among people who inject drugs. PLoS One 2014; 9(3):e92809. doi: 10.1371/journal.pone.0092809. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. J Clin Epidemiol 2014; 67(3):267–277. doi: 10.1016/j.jclinepi.2013.08.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Krumpal I Determinants of social desirability bias in sensitive surveys: a literature review. Qual Quant 2013; 47:2025–2047. doi: 10.1007/s11135-011-9640-9. [DOI] [Google Scholar]
- 45.World Health Organization. Consolidated Guidelines on HIV Testing Services. Geneva, Switzerland: 2015. https://www.who.int/hiv/pub/guidelines/hiv-testing-services/en/ (accessed Feb 8, 2020). [Google Scholar]
- 46.World Health Organization. WHO Implementation Tool for pre-exposure prophylaxis (PrEP) of HIV infection. Module 1: Clinical. Geneva, Switzerland: 2017. https://apps.who.int/iris/bitstream/handle/10665/255889/WHO-HIV-2017.17-eng.pdf?sequence=1 (accessed July 15, 2020). [Google Scholar]
