Skip to main content
Journal of Medical Internet Research logoLink to Journal of Medical Internet Research
. 2019 Aug 1;21(8):e14145. doi: 10.2196/14145

An Internet-Based HIV Self-Testing Program to Increase HIV Testing Uptake Among Men Who Have Sex With Men in Brazil: Descriptive Cross-Sectional Analysis

Raquel Brandini De Boni 1,, Valdilea Gonçalves Veloso 1, Nilo Martinez Fernandes 1, Flavia Lessa 1, Renato Girade Corrêa 2, Renato De Souza Lima 2, Marly Cruz 3, Juliane Oliveira 4, Simone Muniz Nogueira 4, Beto de Jesus 3, Toni Reis 5, Nena Lentini 6, Raquel Lima Miranda 6, Trista Bingham 7, Cheryl C Johnson 8, Aristides Barbosa Junior 6, Beatriz Grinsztejn 1
Editor: Gunther Eysenbach
Reviewed by: Kate Wilson, Jenevieve Opoku
PMCID: PMC6694730  PMID: 31373276

Abstract

Background

Approximately 30% of people living with HIV worldwide are estimated to be unaware of their infection. HIV self-testing (HIVST) is a strategy recommended by the World Health Organization to increase access to and uptake of testing among key populations who are at high risk for HIV infection.

Objective

This study aimed to describe the development and feasibility of a free, anonymous, internet-based HIVST strategy designed for men who have sex with men in Curitiba, Brazil (electronic testing [e-testing]).

Methods

The project was developed under the scope of the “A Hora é Agora” (The Time is Now) program. Individuals aiming to request an HIVST package (two tests each) answered an anonymous 5-minute questionnaire regarding inclusion criteria and sexual risk behavior. Eligible individuals could receive one package every 6 months for free. Website analytics, response to online questionnaires, package distribution, and return of test results were monitored via a platform-integrated system.

Results

Between February 2015 and January 2016, the website documented 17,786 unique visitors and 3218 completed online questionnaires. Most individuals self-reported being white (77.0%), young (median age: 25 years, interquartile range: 22-31 years), educated (87.3% completed secondary education or more), and previously tested for HIV (62.5%). Overall, 2526 HIVST packages were delivered; of those, 542 (21.4%) reported a result online or by mail (23 reactive and 11 invalid). During the study period, 37 individuals who reported using e-testing visited the prespecified health facility for confirmatory testing (30 positive, 7 negative).

Conclusions

E-testing proved highly feasible and acceptable in this study, thus supporting scale-up to additional centers for men who have sex with men in Brazil.

Keywords: HIV/AIDS, HIV self-testing, key populations, mobile health, men

Introduction

In 2016, it was estimated that 30% of people living with HIV worldwide were unaware of their infection [1]. This gap represents a major challenge to achieving the targets of the Joint United Nations Programme on HIV/AIDS (UNAIDS) “90-90-90,” which aims to ensure that 90% of all people living with HIV are aware of their status by 2020 [2].

Unknown HIV status is associated with late entry into care and increased mortality rates and is a key driver of the epidemic [3-5]. An HIV test result is the first step in engaging in the HIV treatment continuum for those who test positive or in the HIV prevention continuum for those who test negative. Nonetheless, many barriers to expand HIV testing coverage persist, such as stigma, difficulty in accessing testing facilities, and inconvenient clinic hours [6,7].

HIV self-testing (HIVST) allows individuals to perform an HIV test and interpret their own results [8]. Different strategies for HIVST distribution worldwide have been proposed, such as through peers [9], nongovernment organizations (NGOs) [10], and mobile/social media apps [11]. Randomized controlled trials have shown that HIVST increases uptake and frequency of HIV testing overall, without adverse events, social harm, or increased risk behaviors [12]. Nevertheless, a review of HIVST implementation studies by Estem et al [13] concluded that despite the many potential benefits of HIVST, dissemination strategies need to be improved and the high cost of HIVST kits needs to be reduced to scale-up this strategy.

Key populations, including gay and other men who have sex with men (MSM), are greatly affected by HIV in Latin America and other regions [14,15]. Such populations have continued high HIV incidence and encounter multiple structural barriers, including stigma and discrimination, which increase their risk of HIV exposure and acquisition and inhibit access to evidence-based HIV prevention and treatment services [16]. In Brazil, the prevalence of HIV among MSM, estimated at 14% in 2009 [17] and 17.5% in 2016 [18], requires sustained prevention and treatment efforts. Furthermore, despite an increased proportion of MSM reporting annual testing (from 21.2% in 2009 to 43.3% in 2016) [19], innovations are needed to increase MSM testing coverage in the country. The convenience and discreet approach of self-testing would be particularly useful to increase first-time HIV testing and frequency among this vulnerable population.

Internet-based and mobile phone technologies are promising tools to overcome HIVST delivery barriers among MSM [20]. In the United Kingdom and United States, both online and social media–based promotion and delivery of free HIVST kits effectively increased the frequency of testing and reached MSM who were not previously tested [21,22]. In accordance with international data [23,24], a previous Brazilian study suggested that HIVST would be well accepted among MSM [25]. Thus, providing HIVST using these technologies may represent a step forward in increasing testing access in Brazil, where free HIV testing is already provided by the Brazilian Public Health System (“Sistema Unico de Saúde”).

Considering the limited access to and uptake of HIV testing among MSM in Brazil and the evidence supporting its acceptability, this paper reports on the development and feasibility of an internet-based HIVST (electronic testing [e-testing]) approach. E-testing was designed to promote HIV prevention by providing free anonymous HIVST and to enhance linkage to HIV care for those with a confirmed HIV positive status. We describe the results from the e-testing program’s first year, when HIVST was not available in Brazil outside the research studies.

Methods

Design

This cross-sectional analysis describes the results obtained from the e-testing strategy between February 2015 and January 2016.

E-testing was developed as part of the broader initiative “A Hora é Agora” (AHA; or “The Time is Now”), which included three community-based strategies to deliver rapid HIV testing: a mobile testing unit, an NGO site, and e-testing. AHA was implemented in partnership with the Oswaldo Cruz Foundation (FIOCRUZ); the Department of STI, AIDS, and Viral Hepatitis of the Brazilian Ministry of Health; the Municipal Health Secretariat of Curitiba; the Federal University of Paraná; Grupo Dignidade (a local Lesbian Gay Bisexual Transgender and Queer/Questioning NGO); and Centers for Disease Control and Prevention (CDC) - Brazil. Implementation of the AHA program was focused in Curitiba, a city with 1.75 million inhabitants in southern Brazil and an estimated HIV prevalence of 19.9% (95% CI 14.2-27.2) among MSM [18].

Recruitment

The AHA program counted on an extensive communications plan to increase HIV testing and target young MSM [26]. The appropriateness of the communications strategy was piloted in focus groups including the target population, conducted in the preformative research (which also mapped the main MSM gathering sites and possible community partners to the program). The communication plan was continuously monitored and evaluated during the entire program via independent focus groups conducted in 2016 and Google Analytics.

Briefly, the communications included printed handouts distributed via in-person outreach events in places where MSM socialize in the city; partnerships with gay and MSM-friendly establishments such as saunas, movie theatres, cafes, and bars; and virtual messages disseminated trough a Facebook page and gay online sites such as ManHunt and Grindr. Examples of the materials used for AHA are presented in Figure 1.

Figure 1.

Figure 1

Sample of the “A Hora é Agora” communications strategy for Curitiba, Brazil (2015-2016).

Study Population

Participants were eligible to receive an HIVST package if they were male at birth, were at least 18 years of age, resided in Curitiba, were HIV-negative or had an unknown HIV status, had access to the internet, and agreed to participate in the study after reading the online informed consent form.

E-Testing Web Platform

The internet platform was made available to all at www.ahoraeagora.org and could be accessed via personal computer, smartphones, or tablets (apps were available for IOS and Android). This platform contained four modules (ie, website sections presenting different access credentials): general information, HIVST order, management, and monitoring. The general information module contained HIV prevention information targeted to MSM, a step-by-step video, written instructions for using HIVST, geocoded options for HIV testing locations in Curitiba, and a personal risk assessment calculator (Figure 2).

Figure 2.

Figure 2

E-testing Web platform: general information module.

The risk assessment calculator was adapted from the HIV incidence risk for MSM scale, a 7-item questionnaire developed to predict HIV seroconversion among MSM [27] and recommended by the CDC to screen individuals for eligibility for pre-exposure prophylaxis [28]. Individuals could check their risk status and receive feedback, but data were not collected/saved in the platform. (Figure 3).

Figure 3.

Figure 3

E-testing Web platform: risk assessment calculator.

The HIVST order module included an online questionnaire and the option to request HIVST. This module evaluated eligibility criteria and enabled test kit delivery via standard Brazilian mail or self-pick up at a central pharmacy within 2 weeks. After completing the mandatory section of the questionnaire and selecting a delivery option, a random personal identification number (PIN) was assigned by the automated system. The PIN was used to track future HIVST requests, collect self-reported HIVST results, and monitor subsequent linkage to further testing and HIV care.

The management module encompassed the administration and logistics functions of HIVST package delivery (including central and pharmacy inventory control) and generated management reports for authorized staff. Finally, the fourth module monitored access and usability statistics of the AHA website (using Google Analytics), aggregated data from the order module, and generated routine reports.

HIV Self-Testing Package

MSM who met the eligibility criteria and accessed the e-testing website could order an HIVST package. The package included two OraQuick Advanced HIV-1/2 HIVST kits, (OraSure Technologies, Inc, Bethlehem, PA, adapted and repackaged for self-testing in Brazil), condoms, lubricants, written self-test instruction, an anonymous prepaid card for returning test results (for those preferring to return the results by mail), and information about health facilities that provided free confirmatory HIV testing. Between March 7, 2015, and May 4, 2015, and between August 14, 2015, and February 29, 2016, only one HIVST was sent in each package. Using their PIN, individuals could order a new package every 6 months.

Measures

Website Analytics, HIV Self-Testing Distribution, and Platform Usability

Website analytics were measured using Google Analytics. Data on HIVST distribution were retrieved from the management module. Platform usability was measured using the following questions:

  • Question: “Overall, did you find this platform easy to use?” Response: Yes/No

  • Question: “What were the major difficulties you find in the platform?” Responses: “I was not able to find the links I was looking for” / “I would like to have access to more tests” / “I would like to retrieve the tests in other places” / “I did not find any difficulties” / “Other-specify”

  • Question: “Did you find the testing instructions clear?” Response: Yes/No.

Characteristics of the Study Population

Individuals requesting an HIVST package were encouraged to answer the online questionnaire available in the HIVST order module. The questionnaire comprised two parts: the first was mandatory to initiate the HIVST request and included the eligibility criteria (eg, participant’s age, city, and unknown or negative HIV status). The second part was optional and evaluated demographic characteristics (eg, schooling, color/race, gender and sexual orientation, and steady partner), risk perception (using the question “What is your likelihood of getting HIV in the next 12 months?”) [29], and risk behavior for HIV infection (using the HIV incidence risk for the MSM scale) [27].

HIV Self-Testing Result Return

Individuals were asked to return their results either by directly entering result information into the website (using their PINs) or via the prepaid postal card. Additionally, when uploading results to the website, individuals were invited to answer a questionnaire regarding their experience and any possible social harm (using three dichotomous questions regarding coercion, feelings of shame, or violent reactions of partners).

Confirmatory Testing

Individuals with a reactive or invalid test result were instructed to seek confirmatory testing at Curitiba’s reference center for HIV Counseling and Testing (COA) and to bring their PIN. The COA follows the HIV testing algorithm of the 2014 Brazilian Ministry of Health guidelines [30], and those confirmed to be HIV-positive were offered immediate HIV care. A question regarding the AHA testing strategies was included in the regular COA form, and staff reported the number of tests performed as a result of referrals from specific AHA project strategies.

Feasibility Outcomes

Project success was defined a priori as ≥60% individuals ordering HIVST after starting the online request process; ≥50% individuals picking up the HIVST at the pharmacy within 2 weeks; 1000 HIVST packages (2000 HIVST kits) distributed in 12 months; 20% HIVST results returned via mail or the online platform; and ≥50% individuals, who self-reported a reactive HIVST, accessing the COA for confirmatory testing and HIV care. There were no a priori outcomes related to the second HIVST kit included in the package.

Although there was scarce evidence to determine all the feasibility outcomes at the time of the study design (2014), a limited-advertised Brazilian Web survey was able to reach 629 MSM in around 10 days, of whom 82 were from the South region of the country. The vast majority (89.8%) of them reported high interest in using HIVST [25]. As the South of the country has three state capitals, and this project had a strong communications plan, we expected to distribute around 80 HIVST per month (rounded to 1000/year) in the selected South Capital (Curitiba). For the outcomes that we had no previous data on, we considered the most conservative estimate (50%) to be acceptable. Finally, regarding return of the testing results, we considered the general low response of mail and email surveys conducted in different areas of knowledge [31-34] and the additional absence of incentives; as such, we expected that 20% of the results would be returned to the project.

Statistical Analysis

We present the results of the online questionnaires and HIVST results returned using descriptive statistics, including both absolute counts and relative frequencies and 95% CIs. Data were analyzed using SPSS software (IBM Corp, Armonk, NY).

Ethical Issues

Details of informed consent were displayed in pop-up windows preceding the online questionnaire. No personally identifying information was collected in the informed consent forms or questionnaires to preserve users’ anonymity.

Personal information necessary for HIVST delivery was saved in the Web server and was restricted to trained staff in charge of package mail delivery. All staff members signed a confidentiality agreement. Identification for HIVST delivery was not linked to individuals’ questionnaire responses. To ensure information security and confidentiality, the website used verified access to the original site, data encryption between personal computers and the website, and encryption of database tables. Information was only available to users registered with a login and a safe password.

Trained counselors at a 24/7 hotline were available to assist in the event of any psychological crisis. Social harm, such as coercion or violent reactions of partners, was considered an adverse event and was assessed in the feedback questionnaire.

The e-testing study protocol was approved by the Evandro Chagas National Institute of Infectious Diseases/FIOCRUZ Institutional Review Board (CAAE number: 37848114.9.0000.5262). The study was reviewed according to the Centers for Disease Control and Prevention human research protection procedures and was determined to be research but the CDC was not engaged.

Results

The detailed frequencies and data sources of the e-testing study during its first year of implementation are provided in Figure 4.

Figure 4.

Figure 4

E-testing project flowchart for Curitiba, Brazil (2015-2016). *Between March 7, 2015, and May 4, 2015, and between August 14, 2015, and February 29, 2016, only one HIVST was sent in each package; therefore, the total number of unique HIVST kits distributed is 4342. HIVST: HIV self-testing.

Website Analytics, HIV Self-Testing Distribution, and Platform Usability

During the study period, the AHA website had 67,225 page views from 17,786 unique visitors. The most frequently viewed pages were those in which users could order an HIVST package by mail (9.7%), all pages containing information on HIV prevention (6.6%), and the page on risk self-assessment (6.5%; Table 1). The e-testing app had 2571 downloads (1780 downloads at Google Play and 791 at Apple Store).

Table 1.

Pages viewed (n=67,225) on the A Hora é Agora e-testing website in Curitiba, Brazil (February 6, 2015, to January 31, 2016).

Pages viewed Value, n (%)a
Any of the following links on HIV prevention information 4425 (6.6)

Viral load and treatment as prevention 337 (0.5)

Circumcision 750 (1.1)

Sexual transmitted diseases 280 (0.4)

Interrupted intercourse 746 (1.1)

Pre-exposure prophylaxis 418 (0.6)

Postexposure prophylaxis 583 (0.9)

Oral sex 946 (1.4)

Condom use 365 (0.5)
Link for risk self-assessment 4398 (6.5)
Link to HIV-testing facilities map 3420 (5.1)
Link to HIVSTb request by mail 6546 (9.7)
Link to pick up HIVST in the pharmacy 1917 (2.9)
Link to step-by-step video 4118 (6.1)

aProportion of hits in a specific link over total hits for the website.

bHIVST: HIV self-testing.

Overall, 3885 questionnaire respondents initiated an HIVST request, of which 2526 packages were delivered (215 requests were returned by mail, 124 were cancelled by the users, 884 were not picked up at the pharmacy within 2 weeks, 128 were not sent due to incomplete addresses, and 8 were in the process of delivery at the time the present dataset was closed; Figure 4). Most deliveries were made by the Brazilian mail (n=1943, 77%), and 583 (23%) packages were picked up at the pharmacy. A total of 66 PINs (of 3885, 1.7%) requested at least one additional HIVST package during the study period.

Of all individuals accessing the website, 362 answered questions about the usability of the website. Most respondents found the site “Very easy” (n=260, 71.8%) or “Easy” (n=71, 19.6%) to use. Furthermore, 72% (262/362) stated that they did not have difficulties navigating the website, and only 21 (5.8%) stated that they did not find the pages they were searching for. The vast majority (n=339, 93.6%) also found that the website’s instructions for performing HIVST were clear.

Characteristics of the Study Population

During the study period, 65% (4800/7300) of individuals who initiated an HIVST request met the eligibility criteria. Of the men who completed the online questionnaire (n=3218), most were young (median: 25 years; interquartile range [IQR]: 22-31 years), were of white race/ethnicity (n=2478, 77%), had completed at least secondary school (n=2810, 87%), and had never had an HIV test (n=1206, 37.5%; Table 2). The frequency of possible reasons for never testing were “I am afraid of having a positive result” (27.6%), “I feel ashamed” (21.7%), “It is inconvenient to go to a health care clinic” (15.7%), “I am not at risk of being infected” (10.4%), and “I feel lazy” (7.4%); 17.3% did not want to answer this question.

Table 2.

Demographic and behavioral characteristics of men who completed the online questionnaire at the A Hora é Agora e-testing website in Curitiba, Brazil 2015-2016 (N=3218).

Characteristic Value, n (%)
Demographics  
  Age (years), median (IQRa) 25 (22-31)
  Race/ethnicity  
    White 2478 (77.0)
    Black 103 (3.2)
    Mixed 495 (15.4)
    Native 22 (0.7)
    Asian 49 (1.5)
    Don’t know/don’t want to answer 71 (2.2)
  Schooling
    No schooling/incomplete primary school 85 (2.6)
    Complete primary/incomplete secondary school 261 (8.1)
    Complete secondary/incomplete college 1549 (48.1)
    Complete college/graduate/professional school 1261 (39.2)
    Don’t know/don’t want to answer 62 (1.9)
  Sexual identity/orientation  
    Gay/homosexual 1953 (60.7)
    Bisexual 370 (11.5)
    Heterosexual 649 (20.2)
    Transvestite, transsexual, transgender 22 (0.7)
    Other 25 (0.8)
    Don’t know/don’t want to answer 199 (6.2)
  Steady partner  
    Yes 1334 (41.5)
    No 1677 (52.1)
    Don’t want to answer 207 (6.4)
Risk perception
  Perceived likelihood of acquiring HIV in the next 12 months
    None/little chance 1973 (61.3)
    Some chance/high chance/certainly 266 (8.3)
    Don’t want to answer 978 (30.4)
  Had a previous HIV test in lifetime
    Yes 2012 (62.5)
    No 1206 (37.5)
Risk behavior for HIV infection
  Number of male sexual partners (6 months)
    0-5 1486 (46.2)
    6-10 345 (10.7)
    >10 197 (6.1)
    Don’t know/don’t want to answer 1190 (37.0)
  Number of times participant was receptive to partner without condom (6 months)
    None 14 (0.4)
    Once or more 1097 (34.1)
    Don’t know/don’t want to answer 2107 (65.5)
  Number HIV-positive partners (6 months)
    None 34 (1.0)
    1 231 (7.2)
    >1 37 (1.2)
    Don’t know/don’t want to answer 2916 (90.6)
  Number of times participant had condomless insertive anal sex with HIV-positive partner (6 months)
    0-4 419 (13.0)
    ≥5 149 (4.7)
    Don’t know/don’t want to answer 2650 (82.3)
  Stimulant use (6 months)b
    Yes 525 (16.3)
    No 2466 (76.6)
    Don’t know/don’t want to answer 227 (7.1)
  STIc diagnosis in prior 6 months
    Yes 249 (7.8)
    No 2728 (84.7)
    Don’t know/don’t want to answer 241 (7.5)

aIQR, interquartile range.

bStimulants include cocaine, crack, poppers, and ecstasy.

cSTI: sexually transmitted infection.

Return of HIV Self-Testing Results

Of the 2526 packages delivered, 21.4% (n=542) returned an HIVST result on the website or by mail. Of these, 19 reactive and 11 invalid test results were entered into the website platform and 4 reactive results were returned by mail (as of February 29, 2016).

There were 91 responses to the feedback survey on self-testing, but we received no reports (questionnaire or hotline) of psychological crises or violent reactions from partners. However, one individual reported feeling ashamed because someone saw him self-testing.

Confirmatory Testing

As of February 2016, 37 individuals were tested at the COA reporting to have used the e-testing: 30 had HIV-positive results and 7 had negative results.

Feasibility Outcomes

Project success was achieved for most of the previously defined outcomes (Table 3).

Table 3.

Feasibility outcomes defined in the study protocol and achievements in the A Hora é Agora e-testing project in Curitiba, Brazil (2015-2016).

Measurement Proportion Indicator A priori success indicator
Individuals who got an HIVSTa package after starting the online request process 2526/3885 65.0% ≥60%
Individuals who collected the HIVST at the distribution pharmacy, within 2 weeks of ordering 544/1417 38.4% ≥50%
HIVST packages distributed during the initial 12-month timeframe (either sent by mail or retrieved at the pharmacy)b Not applicable 2526c ≥1000c
Proportion of HIVST packages with a test result returnedd via mail or the website up to February 29, 2016 (82e+460f)/2526 21.4% ≥20%
Proportion of those with a positive result who accessed the Counseling and Testing Center for confirmatory testing up to February 29, 2016 30g/34h 88.2% ≥50%

aHIVST: HIV self-testing.

bBetween March 7, 2015, and May 4, 2015, and between August 14, 2015, and February 29, 2016, only one HIVST was sent in each package; therefore, the total number of unique HIVST kits distributed is 4342.

cThe N value is presented.

dDifferent date (February 29, 2016) was considered in this indicator to provide enough time for individuals to receive/retrieve tests and include the results on the platform.

eOverall, there were 90 results returned by mail, but 8 were also included on the site (n=82 test results returned by mail). Four unique reactive results were returned by mail.

f460 test results returned on the website.

gOverall, 37 individuals went to Counseling and Testing Center to access confirmatory testing: 30 were positive and 7 were negative. Given the absence of identification, we cannot confirm that these are the same individuals who reported their results into the site or by mail.

h19 reactive+11 invalid inserted in the platform+4 reactive returned by mail up to February 29, 2016.

Over the study period, the telephone hotline received 70 calls: two were questions regarding what to do following a reactive result, three were related to assistance with interpreting the self-test result, five were related to queries on test performance, six were related to problems with HIVST delivery, and the remaining were about HIV testing in general and not about self-testing/e-testing.

Discussion

We describe an internet-based strategy to provide HIV prevention information and HIVST to MSM in Curitiba, Brazil. In the first year, we delivered 2526 HIVST packages, substantially more than predicted in the study design (1000 packages). Our findings are similar to reports from previous studies that have shown good uptake and use of websites containing information on HIV prevention, self-assessment of risk, and HIVST among MSM [35,36]. Such high uptake is likely due to the significant number of MSM who use social media and the internet to look for sexual partners [37]. A previous Web-based survey in 10 Brazilian cities [38] found that 1798 (35.6%) and 678 (13.4%) of responding MSM reported daily and weekend use of websites and smart phone apps to seek sexual partners.

The use of internet and social media approaches for health promotion and behavioral interventions has become more routine according to international literature and already includes smoking cessation [39] and heart disease prevention programs [40]. The internet and social media are particularly promising ways to offer testing to MSM at high ongoing risk of HIV [41], as those using social media and the internet to meet sexual partners also have high-risk behavior and increased HIV risk [42,43]. Thus, internet-based health initiatives can help overcome health disparities to access prevention and care, particularly among MSM, and can help facilitate uptake of HIV testing, prevention, and treatment services.

E-testing appeared to appeal to never-tested MSM who reported a fear of having a positive result, shame (which is probably related to stigma), and unfriendly health facilities. These results are consistent with reports showing that HIVST is highly acceptable to MSM [25,44] and can facilitate uptake and frequency of testing. This demand was likely driven by the privacy of e-testing, which systematic reviews have highlighted as a priority for MSM [23]. Similarly, the large number of HIVST packages delivered by mail, compared to packages retrieved in the public pharmacy, was likely related to introducing delivery models that addressed challenges such as travel distances, wait times at facilities, and confidentiality issues [45,46], all of which have been previously cited as barriers to testing.

Of the individuals who answered the entire online questionnaire, most identified as young, white, well-educated, and without a steady partner. Although these characteristics were similar to those reported in other studies among MSM in the country [38,47], there were some differences as compared to a recent household probability survey conducted among men from Curitiba [48]: In our study, participants were younger, more likely to be white (77% vs 64%), less likely to perceive high risk for HIV infection (8% vs 52%), and less likely to have ever had an HIV test (62.5% vs 75.7%) than found in the survey [48].

However, the latest Brazilian estimates have shown an increase in the HIV prevalence among young MSM [18], who also showed riskier sexual behavior than older MSM [19]. This new evidence reinforces the importance of strategies to successfully reach this key population. Our findings suggest that, at least for young MSM, important subpopulations are open to new HIV testing strategies and understand the need for frequent or risk-based HIV testing.

In our study, HIVST was provided for free but without the provision of any incentives (the Brazilian Ethic regulations do not allow the provision of incentives for research participants or patients). We received 21.4% of HIVST results (18.2% through the website and 3.2% by mail). This was a substantially lower proportion than presented in China by Zhong et al [49], who reported 97% of self-testers returning results when HIVST kit costs were refunded upon return of results. We believe that this difference is related to the provision of incentives, and not providing incentives was one of the reasons why we estimated a low return rate when designing this feasibility study. However, the World Health Organization recommends self-testing as an additional HIV testing tool [8], not as an HIV surveillance tool, meaning that a low return rate may not represent a major drawback. On the other hand, confirmatory testing and rapid linkage to care are essential after a reactive HIVST result. A study conducted in Brazil reported that of 131 MSM who tested positive, only 95 (72.5%) were linked to care [50]. Because of the anonymity of the e-testing strategy, the proportion of study participants who sought confirmatory testing is uncertain. Furthermore, although users were instructed to bring their PIN to the COA when seeking confirmatory testing, no one accessing services at COA provided a PIN. Therefore, we could not match the HIVST results and confirmatory results. Other programs seeking ways to track users’ confirmatory testing and linkage to HIV services following HIVST should be aware of this limitation and the challenges with monitoring HIVST implementation. Other potential caveats of self-testing discussed in the literature are psychological crises and social harm. In our study, neither of these events were reported, which is consistent with the international literature [12,23].

E-testing was largely successful during its first year: E-testing achieved most of the previously defined study outcomes, and demand for HIVST was twice that initially anticipated. However, our study had limitations. The anonymous, self-reported nature of data collection and the low proportion of users who reported their HIVST results prevented us from validating individual HIVST results with confirmatory tests and from estimating the HIV prevalence (due to the inability to exclude multiple answers from the same individuals). Additionally, because we did not track the second test distributed in the package, it is possible that the test requestor gave the second test to a friend or partner, which would increase the number of individuals tested during the study period. We likely also missed MSM who may be fearful of HIV testing and those who did not have access to the internet, which limits the generalizability of our findings. Despite these limitations, we achieved our primary goal, which was to reach individuals who do not access traditional HIV testing services.

In conclusion, our findings show that an internet-based strategy to provide free, anonymous HIVST kits was acceptable and feasible in Brazil. Lessons learned from this study may also be applied to other countries in Latin America with similar cultural and epidemiological contexts. The discretion and convenience of HIVST may increase testing among MSM who are not reached through existing services. Future investigation is needed, however, to identify strategies to support linkage to prevention and treatment services and to determine the potential public health impact and cost-effectiveness of HIVST in Brazil.

Acknowledgments

This project was supported (in part) by the President’s Emergency Plan for AIDS Relief (PEPFAR) through the CDC under the terms of the Key Population Implementation Science (KPIS) initiative (Grant number: NU2GGH01152). The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the funding agencies.

Abbreviations

AHA

“A Hora é Agora” (The Time is Now) program

CDC

Centers for Disease Control and Prevention

COA

HIV Counseling and Testing Center

FIOCRUZ

Oswaldo Cruz Foundation

HIVST

HIV self-testing

IQR

interquartile range

MSM

men who have sex with men

NGO

nongovernmental organization

PEPFAR

President’s Emergency Plan for AIDS Relief

PIN

personal identification number

STI

sexually transmitted infection

UNAIDS

Joint United Nations Programme on HIV/AIDS

WHO

World Health Organization

Footnotes

Conflicts of Interest: None declared.

References

  • 1.UNAIDS. Geneva: Joint United Nations Programme on HIV/AIDS (UNAIDS); 2017. [2018-04-18]. Ending AIDS: Progress towards the 90-90-90 targets http://www.unaids.org/sites/default/files/media_asset/Global_AIDS_update_2017_en.pdf. [PubMed] [Google Scholar]
  • 2.UNAIDS. Geneva: Joint United Nations Programme on HIV/AIDS (UNAIDS); 2014. [2018-04-24]. 90-90-90 An ambitious treatment target to help end the AIDS epidemic https://www.unaids.org/sites/default/files/media_asset/90-90-90_en.pdf. [PubMed] [Google Scholar]
  • 3.Mocroft A, Lundgren JD, Sabin ML, Monforte AD, Brockmeyer N, Casabona J, Castagna A, Costagliola D, Dabis F, De Wit S, Fätkenheuer G, Furrer H, Johnson AM, Lazanas MK, Leport C, Moreno S, Obel N, Post FA, Reekie J, Reiss P, Sabin C, Skaletz-Rorowski A, Suarez-Lozano I, Torti C, Warszawski J, Zangerle R, Fabre-Colin C, Kjaer J, Chene G, Grarup J, Kirk O, Collaboration of Observational HIV Epidemiological Research Europe (COHERE) study in EuroCoord Risk factors and outcomes for late presentation for HIV-positive persons in Europe: results from the Collaboration of Observational HIV Epidemiological Research Europe Study (COHERE) PLoS Med. 2013;10(9):e1001510. doi: 10.1371/journal.pmed.1001510. http://dx.plos.org/10.1371/journal.pmed.1001510. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Fisher M, Pao D, Brown A, Sudarshi D, Gill O, Cane P, Buckton Andrew J, Parry John V, Johnson Anne M, Sabin Caroline, Pillay Deenan. Determinants of HIV-1 transmission in men who have sex with men: a combined clinical, epidemiological and phylogenetic approach. AIDS. 2010 Jul 17;24(11):1739–47. doi: 10.1097/QAD.0b013e32833ac9e6. [DOI] [PubMed] [Google Scholar]
  • 5.Rutstein S, Ananworanich J, Fidler S, Johnson C, Sanders E, Sued O, Saez-Cirion Asier, Pilcher Christopher D, Fraser Christophe, Cohen Myron S, Vitoria Marco, Doherty Meg, Tucker Joseph D. Clinical and public health implications of acute and early HIV detection and treatment: a scoping review. J Int AIDS Soc. 2017 Dec 28;20(1):21579. doi: 10.7448/IAS.20.1.21579. http://europepmc.org/abstract/MED/28691435. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Golub S, Gamarel K. The impact of anticipated HIV stigma on delays in HIV testing behaviors: findings from a community-based sample of men who have sex with men and transgender women in New York City. AIDS Patient Care STDS. 2013 Nov;27(11):621–7. doi: 10.1089/apc.2013.0245. http://europepmc.org/abstract/MED/24138486. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Meyerson B, Barnes P, Emetu R, Bailey M, Ohmit A, Gillespie A. Institutional and structural barriers to HIV testing: elements for a theoretical framework. AIDS Patient Care STDS. 2014 Jan;28(1):22–7. doi: 10.1089/apc.2013.0238. [DOI] [PubMed] [Google Scholar]
  • 8.World Health Organization. 2016. [2018-04-24]. Guidelines on HIV self-testing and partner notification https://apps.who.int/iris/bitstream/handle/10665/251655/9789241549868-eng.pdf;jsessionid=375E7E7B8BC009D0836193B4E5961AAF?sequence=1.
  • 9.Lippman S, Lane T, Rabede O, Gilmore H, Chen Y, Mlotshwa N, Maleke Kabelo, Marr Alexander, McIntyre James A. High Acceptability and Increased HIV-Testing Frequency After Introduction of HIV Self-Testing and Network Distribution Among South African MSM. J Acquir Immune Defic Syndr. 2018 Dec 01;77(3):279–287. doi: 10.1097/QAI.0000000000001601. http://europepmc.org/abstract/MED/29210826. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Carey J. HIV self-testing: feasibilityacceptability of a large scale national service delivery by a community organization. 9th International AIDS Society; 2017; Paris. 2017. https://www.iasociety.org/Web/WebContent/File/IAS2017_conference_report.pdf. [Google Scholar]
  • 11.Rosengren A, Huang E, Daniels J, Young S, Marlin R, Klausner J. Feasibility of using Grindr to distribute HIV self-test kits to men who have sex with men in Los Angeles, California. Sex Health. 2016 May 23;:na. doi: 10.1071/SH15236. (forthcoming) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Johnson C, Kennedy C, Fonner V, Siegfried N, Figueroa C, Dalal S, Sands Anita, Baggaley Rachel. Examining the effects of HIV self-testing compared to standard HIV testing services: a systematic review and meta-analysis. J Int AIDS Soc. 2017 Dec 15;20(1):21594. doi: 10.7448/IAS.20.1.21594. http://europepmc.org/abstract/MED/28530049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Estem K, Catania J, Klausner J. HIV Self-Testing: a Review of Current Implementation and Fidelity. Curr HIV/AIDS Rep. 2016 Apr;13(2):107–15. doi: 10.1007/s11904-016-0307-y. [DOI] [PubMed] [Google Scholar]
  • 14.De Boni Raquel, Veloso V, Grinsztejn B. Epidemiology of HIV in Latin America and the Caribbean. Curr Opin HIV AIDS. 2014 Mar;9(2):192–8. doi: 10.1097/COH.0000000000000031. [DOI] [PubMed] [Google Scholar]
  • 15.Ackers M, Greenberg A, Lin C, Bartholow B, Goodman A, Longhi M, Gurwith Marc. High and persistent HIV seroincidence in men who have sex with men across 47 U.S. cities. PLoS One. 2012;7(4):e34972. doi: 10.1371/journal.pone.0034972. http://dx.plos.org/10.1371/journal.pone.0034972. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Beyrer C, Baral S, van Griensven Frits, Goodreau S, Chariyalertsak S, Wirtz A, Brookmeyer Ron. Global epidemiology of HIV infection in men who have sex with men. Lancet. 2012 Jul 28;380(9839):367–77. doi: 10.1016/S0140-6736(12)60821-6. http://europepmc.org/abstract/MED/22819660. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Kerr L, Mota R, Kendall C, Pinho AA, Mello M, Guimarães Mark D C, Dourado Inês, de Brito Ana M, Benzaken Adele, McFarland Willi, Rutherford George, HIVMSM Surveillance Group HIV among MSM in a large middle-income country. AIDS. 2013 Jan 28;27(3):427–35. doi: 10.1097/QAD.0b013e32835ad504. [DOI] [PubMed] [Google Scholar]
  • 18.Kerr L, Kendall C, Guimarães Mark Drew Crosland, Salani Mota Rosa, Veras M, Dourado M, Maria de Brito Ana, Merchan-Hamann Edgar, Pontes Alexandre Kerr, Leal Andréa Fachel, Knauth Daniela, Castro Ana Rita Coimbra Motta, Macena Raimunda Hermelinda Maia, Lima Luana Nepomuceno Costa, Oliveira Lisangela Cristina, Cavalcantee Maria do Socorro, Benzaken Adele Schwartz, Pereira Gerson, Pimenta Cristina, Pascom Ana Roberta Pati, Bermudez Ximena Pamela Diaz, Moreira Regina Célia, Brígido Luis Fernando Macedo, Camillo Ana Cláudia, McFarland Willi, Johnston Lisa G. HIV prevalence among men who have sex with men in Brazil: results of the 2nd national survey using respondent-driven sampling. Medicine (Baltimore) 2018 May;97(1S Suppl 1):S9–S15. doi: 10.1097/MD.0000000000010573. http://Insights.ovid.com/pubmed?pmid=29794604. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Guimarães Mark Drew Crosland, Kendall C, Magno L, Rocha G, Knauth D, Leal A, Dourado Ines, Veras Maria Amélia, Brito Ana Maria de, Kerr Ligia Regina Franco Sansigolo, Brazilian HIV/MSM Surveillance Group Comparing HIV risk-related behaviors between 2 RDS national samples of MSM in Brazil, 2009 and 2016. Medicine (Baltimore) 2018 May;97(1S Suppl 1):S62–S68. doi: 10.1097/MD.0000000000009079. http://Insights.ovid.com/pubmed?pmid=29912816. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.LeGrand S, Muessig K, Horvath K, Rosengren A, Hightow-Weidman L. Using technology to support HIV self-testing among MSM. Curr Opin HIV AIDS. 2017 Sep;12(5):425–431. doi: 10.1097/COH.0000000000000400. http://europepmc.org/abstract/MED/28617712. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.MacGowan R. The impact of HIV self-testing among internetrecruited MSM, eSTAMP. 9th International AIDS Society; 2017; Paris. IAS; 2017. [Google Scholar]
  • 22.James C. HIV self-testing: feasibilityacceptability of a large scale national service delivered by a community organization. 9th International AIDS Society; 2017; Paris. IAS; 2017. [Google Scholar]
  • 23.Figueroa C, Johnson C, Verster A, Baggaley R. Attitudes and Acceptability on HIV Self-testing Among Key Populations: A Literature Review. AIDS Behav. 2015 Nov 9;19(11):1949–65. doi: 10.1007/s10461-015-1097-8. http://europepmc.org/abstract/MED/26054390. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Oldenburg C, Biello K, Perez-Brumer A, Rosenberger J, Novak D, Mayer K, Mimiaga Matthew J. HIV testing practices and the potential role of HIV self-testing among men who have sex with men in Mexico. Int J STD AIDS. 2017 Dec;28(3):242–249. doi: 10.1177/0956462416641556. http://europepmc.org/abstract/MED/27020081. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Lippman S, Périssé André R S, Veloso V, Sullivan P, Buchbinder S, Sineath R, Grinsztejn Beatriz. Acceptability of self-conducted home-based HIV testing among men who have sex with men in Brazil: data from an on-line survey. Cad Saude Publica. 2014 Apr;30(4):724–34. doi: 10.1590/0102-311x00008913. http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-311X2014000400724&lng=en&nrm=iso&tlng=en. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.De Boni Raquel B, Lentini N, Santelli A, Barbosa JA, Cruz M, Bingham Trista, Cota Vanda, Correa R, Veloso V, Grinsztejn B. Self-testing, communication and information technology to promote HIV diagnosis among young gay and other men who have sex with men (MSM) in Brazil. J Int AIDS Soc. 2018 Jul;21 Suppl 5:e25116. doi: 10.1002/jia2.25116. http://europepmc.org/abstract/MED/30033612. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Smith D, Pals S, Herbst J, Shinde S, Carey J. Development of a clinical screening index predictive of incident HIV infection among men who have sex with men in the United States. J Acquir Immune Defic Syndr. 2012 Aug 01;60(4):421–7. doi: 10.1097/QAI.0b013e318256b2f6. [DOI] [PubMed] [Google Scholar]
  • 28.Centers for Disease Control and Prevention. 2014. [2018-04-24]. Preexposure Prophylaxis for the Prevention of HIV Infection in the United States? 2017 Update https://www.cdc.gov/hiv/pdf/risk/prep/cdc-hiv-prep-provider-supplement-2017.pdf.
  • 29.Hoagland B, De Boni Raquel B, Moreira R, Madruga J, Kallas E, Goulart S, Cerqueira Natalia, Torres Thiago S, Luz Paula M, Fernandes Nilo Martinez, Liu Albert Y, Grinsztejn Beatriz, Veloso Valdilea G, PrEP Brasil Study Team Awareness and Willingness to Use Pre-exposure Prophylaxis (PrEP) Among Men Who Have Sex with Men and Transgender Women in Brazil. AIDS Behav. 2017 May;21(5):1278–1287. doi: 10.1007/s10461-016-1516-5. [DOI] [PubMed] [Google Scholar]
  • 30.Manual técnico para o diagnóstico da infecção pelo HIV [in Spanish] Brasilia: Ministério da Saúde; 2013. p. 74. [Google Scholar]
  • 31.Carpe Carpe Bienvenida, Hernando Arizaleta Lauro, Monteagudo Piqueras Olga, Abellán Perpiñán José M, Palomar Rodríguez Joaquín A, Alonso J. Response bias in a population postal survey on Health-Related Quality of Life (sf-12v2) [in Spanish] Rev Esp Salud Publica. 2014;88(3):327–37. doi: 10.4321/S1135-57272014000300003. http://www.mscbs.gob.es/biblioPublic/publicaciones/recursos_propios/resp/revista_cdrom/vol88/vol88_3/RS883C_BCC.PDF. [DOI] [PubMed] [Google Scholar]
  • 32.Krska J, du Plessis Ruth, Chellaswamy Hannah. Views and experiences of the NHS Health Check provided by general medical practices: cross-sectional survey in high-risk patients. J Public Health (Oxf) 2015 Jun;37(2):210–7. doi: 10.1093/pubmed/fdu054. [DOI] [PubMed] [Google Scholar]
  • 33.Nota S, Strooker J, Ring D. Differences in response rates between mail, e-mail, and telephone follow-up in hand surgery research. Hand (N Y) 2014 Dec;9(4):504–10. doi: 10.1007/s11552-014-9618-x. http://europepmc.org/abstract/MED/25414613. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Yarris L, Fu R, Duby R, Frakes B, Brooks H, Norton R. Comparison of mailed vs. on-site emergency department patient satisfaction surveys. J Emerg Med. 2014 Dec;47(6):702–9. doi: 10.1016/j.jemermed.2014.06.057. [DOI] [PubMed] [Google Scholar]
  • 35.Anand T, Nitpolprasert C, Ananworanich J, Pakam C, Nonenoy S, Jantarapakde J, Sohn Annette H, Phanuphak Praphan, Phanuphak Nittaya. Innovative strategies using communications technologies to engage gay men and other men who have sex with men into early HIV testing and treatment in Thailand. J Virus Erad. 2015 Apr 01;1(2):111–5. http://europepmc.org/abstract/MED/27482400. [PMC free article] [PubMed] [Google Scholar]
  • 36.Zou H, Wu Z, Yu J, Li M, Ablimit M, Li F, Poundstone Katharine. Internet-facilitated, voluntary counseling and testing (VCT) clinic-based HIV testing among men who have sex with men in China. PLoS One. 2013;8(2):e51919. doi: 10.1371/journal.pone.0051919. http://dx.plos.org/10.1371/journal.pone.0051919. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Liau A, Millett G, Marks G. Meta-analytic examination of online sex-seeking and sexual risk behavior among men who have sex with men. Sex Transm Dis. 2006 Sep;33(9):576–84. doi: 10.1097/01.olq.0000204710.35332.c5. [DOI] [PubMed] [Google Scholar]
  • 38.Torres T, De Boni Raquel Brandini, de Vasconcellos Mauricio Tl, Luz P, Hoagland B, Moreira R, Veloso Valdilea Gonçalves, Grinsztejn Beatriz. Awareness of Prevention Strategies and Willingness to Use Preexposure Prophylaxis in Brazilian Men Who Have Sex With Men Using Apps for Sexual Encounters: Online Cross-Sectional Study. JMIR Public Health Surveill. 2018 Jan 22;4(1):e11. doi: 10.2196/publichealth.8997. http://publichealth.jmir.org/2018/1/e11/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Bottorff J, Oliffe J, Sarbit G, Sharp P, Caperchione C, Currie L, Schmid Jonathan, Mackay Martha H, Stolp Sean. Evaluation of QuitNow Men: An Online, Men-Centered Smoking Cessation Intervention. J Med Internet Res. 2016 Apr 20;18(4):e83. doi: 10.2196/jmir.5076. http://www.jmir.org/2016/4/e83/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Devi R, Singh S, Powell J, Fulton E, Igbinedion E, Rees K. Internet-based interventions for the secondary prevention of coronary heart disease. Cochrane Database Syst Rev. 2015 Dec 22;(12):CD009386. doi: 10.1002/14651858.CD009386.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Mustanski B, Lyons T, Garcia S. Internet use and sexual health of young men who have sex with men: a mixed-methods study. Arch Sex Behav. 2011 Apr;40(2):289–300. doi: 10.1007/s10508-009-9596-1. http://europepmc.org/abstract/MED/20182787. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Bull S, McFarlane M, Rietmeijer C. HIV and sexually transmitted infection risk behaviors among men seeking sex with men on-line. Am J Public Health. 2001 Jun;91(6):988–9. doi: 10.2105/ajph.91.6.988. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Garofalo R, Herrick A, Mustanski B, Donenberg G. Tip of the Iceberg: young men who have sex with men, the Internet, and HIV risk. Am J Public Health. 2007 Jun;97(6):1113–7. doi: 10.2105/AJPH.2005.075630. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Volk J, Lippman S, Grinsztejn B, Lama J, Fernandes N, Gonzales P, Hessol Nancy A, Buchbinder Susan. Acceptability and feasibility of HIV self-testing among men who have sex with men in Peru and Brazil. Int J STD AIDS. 2016 Dec;27(7):531–6. doi: 10.1177/0956462415586676. http://europepmc.org/abstract/MED/25971262. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Gonçalves Valéria Freire, Kerr L, Mota. Macena Raimunda Hermelinda Maia, Almeida Rosa Lívia de, Freire Deborah Gurgel, Brito Ana Maria de, Dourado Inês, Atlani-Duault Laëtitia, Vidal Laurent, Kendall Carl. Incentives and barriers to HIV testing in men who have sex with men in a metropolitan area in Brazil. Cad Saude Publica. 2016 May 31;32(5)::e00049015. doi: 10.1590/0102-311X00049015. http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-311X2016000500705&lng=en&nrm=iso&tlng=en. [DOI] [PubMed] [Google Scholar]
  • 46.Sharma M, Ying R, Tarr G, Barnabas R. Systematic review and meta-analysis of community and facility-based HIV testing to address linkage to care gaps in sub-Saharan Africa. Nature. 2015 Dec 03;528(7580):S77–85. doi: 10.1038/nature16044. http://europepmc.org/abstract/MED/26633769. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Grinsztejn B, Hoagland B, Moreira R, Kallas E, Madruga J, Goulart S, Leite Iuri C, Freitas Lucilene, Martins Luana M S, Torres Thiago S, Vasconcelos Ricardo, De Boni Raquel B, Anderson Peter L, Liu Albert, Luz Paula M, Veloso Valdiléa G, PrEP Brasil Study Team Retention, engagement, and adherence to pre-exposure prophylaxis for men who have sex with men and transgender women in PrEP Brasil: 48 week results of a demonstration study. Lancet HIV. 2018 Dec;5(3):e136–e145. doi: 10.1016/S2352-3018(18)30008-0. [DOI] [PubMed] [Google Scholar]
  • 48.Szwarcwald C, Damacena G, Miranda R, Pascom A, Júnior Aristides Barbosa. HIV Testing among men in Curitiba, Brazil. AIDS Care. 2018 Jan;30(1):56–58. doi: 10.1080/09540121.2017.1363370. http://europepmc.org/abstract/MED/28934867. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Zhong F, Tang W, Cheng W, Lin P, Wu Q, Cai Y, Tang S, Fan L, Zhao Y, Chen X, Mao J, Meng G, Tucker J D, Xu H. Acceptability and feasibility of a social entrepreneurship testing model to promote HIV self-testing and linkage to care among men who have sex with men. HIV Med. 2017 Dec;18(5):376–382. doi: 10.1111/hiv.12437. doi: 10.1111/hiv.12437. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Castro R, Ribeiro-Alves M, Corrêa Renato Girade, Derrico M, Lemos K, Grangeiro J, Jesus Beto de, Pires Denise, Veloso Valdilea G, Grinsztejn Beatriz. The Men Who Have Sex with Men HIV Care Cascade in Rio de Janeiro, Brazil. PLoS One. 2016;11(6):e0157309. doi: 10.1371/journal.pone.0157309. http://dx.plos.org/10.1371/journal.pone.0157309. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Medical Internet Research are provided here courtesy of JMIR Publications Inc.

RESOURCES