Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2017 Dec 20.
Published in final edited form as: Urban Soc Work. 2017 Mar 1;1(1):36–52. doi: 10.1891/2474-8684.1.1.36

Using Facebook as a Platform to Direct Young Black Men Who Have Sex With Men to a Video-Based HIV Testing Intervention: A Feasibility Study

Thomas Alex Washington a, Sheldon Applewhite b, Wendell Glenn c
PMCID: PMC5737932  NIHMSID: NIHMS902293  PMID: 29276800

Abstract

Objective

A randomized control pilot study was conducted with Black men who have sex with men (BMSM; N = 42) aged 18–30 years to examine the feasibility of implementing a video intervention delivered using Facebook to motivate HIV testing.

Methods

At baseline, participants were unaware of their HIV status and had not tested for HIV in the past 6 months, residing in Los Angeles County. The intervention content included topics such as social influence, HIV knowledge, stigma, HIV positive knowledge, and benefits of knowing one’s HIV status.

Findings

Logistic regression revealed that those receiving the video intervention were 7 times more likely to have tested for HIV than those in the control group at 6-week follow-up (odds ratio [OR] = 7.00, 95% confidence interval [1.72, 28.33], p = .006).

Conclusion

Data suggest that the intervention was feasible for motivating HIV testing.

Keywords: HIV testing, men who have sex with men (MSM), Black men’s health, social media, HIV intervention


HIV prevention and testing remain a high priority for reducing HIV infections among young Black men who have sex with men (BMSM; Centers for Disease Control and Prevention [CDC], 2015; Fenton, 2007). The number of new infections among young BMSM was nearly twice that of young White MSM and more than twice that of young Hispanic/Latino MSM (CDC, 2010a, 2010c, 2015). Moreover, young BMSM ages 13–29 accounted for new HIV infections (52%) among all BMSM (CDC, 2015). This disproportionate representation of new infections is greater than any other racial or ethnic age group of MSM (CDC, 2015). Previous research (CDC, 2010b) indicated that one in five (19%) MSM in 21 major U.S. cities were infected with HIV, and nearly half (44%) were unaware of their infection; BMSM (28%) accounted for the highest prevalence (CDC, 2010c). Knowledge of HIV status is of major importance for several reasons. Those who are HIV negative may be provided knowledge of current advances for prevention, such as preexposure prophylaxis (PrEP; Pérez-Figueroa, Kapadia, Barton, Eddy, & Halkitis, 2015). Knowing one’s HIV positive status allows the individual to link to treatment, reducing viral load and the likelihood of progression of the disease (Kitahata et al., 2009; Robbins et al., 2009). In addition, reduced viral load reduces the risk of transmission to uninfected partners (Castilla et al., 2005; Porco et al., 2004; Quinn et al., 2000; Reynolds, Makumbi, & Kayaagi, 2009; Sullivan et al., 2010). Furthermore, previous research suggests that men who are unaware of their HIV-positive status are more likely to engage in risky behavior, putting their HIV-negative partners at-risk for HIV-infection, than those men who are aware of their positive status (Millet, Peterson, Wolitski, & Stall, 2006; Reynolds et al., 2009; Washington, Robles, & Malotte, 2013).

Given the aforementioned facts, prevention efforts and interventions for motiving HIV testing for young BMSM still remain urgent. The CDC has encouraged and funded HIV prevention programs (i.e., diffusion of effective behavioral interventions) focusing on gay men, young MSM, and other programs geared toward MSM, including ethnic MSM (CDC, 2009b). Although some of these and other HIV prevention programs have encouraged HIV testing (CDC, 2010c; Phillips et al., 1995), and others may have required HIV testing as a precursor to program enrollment, these programs have not focused primarily on motivating HIV testing among BMSM. Many of these programs have focused solely on HIV prevention among injection drug-using MSM (CDC, 2009a). Because of their elevated risk of infection and prevalence of new HIV infections among BMSM, it is critical to ensure that sexually active young BMSM get tested for HIV every 3–6 months (Campsmith, Rhodes, Hall, & Green, 2010; CDC, 2011). Consequently, there is a need to have innovative interventions that aim to encourage HIV testing tailored specifically for BMSM aged 18–29 years. Most studies that have focused on encouraging testing among MSM were not developed as HIV prevention programs tailored specifically for BMSM aged 18–29 years, and did not focus on specific barriers to HIV testing as perceived by these men (Erbelding & Zenilman, 2005).

CDC launched a public campaign, “Testing Makes Us Stronger,” to encourage HIV testing among BMSM (Prejean et al., 2011). In addition to promotional material, the campaign features online and print ads. Nonetheless, because of the elevated risk of infection and prevalence of new HIV infections among BMSM aged 18–29 years, it is critical to explore innovative multimedia interventions including videos with social networking chat features to ensure that sexually active young BMSM get tested for HIV every 3–6 months. There is evidence that gay men who have disclosed their sexual orientation with a supportive peer network have reduced internalized homophobia, and thereby, reduced risk behavior (Newman & Zimmerman, 2000; Washington et al., 2006). However, many young BMSM are not in this position and HIV prevention and intervention methods are needed that may be accessible to them.

Social networking technology, such as Facebook and text messaging, is a widely used feature, particularly among youths; more than 3.5 billion text messages are sent every day worldwide (Kline et al., 2001; Tsirulink, 2008). This technology is being used already in other sectors, such as social networking and sex seeking websites (e.g., Grindr mobile, adam4adam.com; Chiasson, Hirshfield, & Rietmeijer, 2010; Klein, Lambing, Moskowitz, Washington, & Gilbert, 2010; Washington & Thomas, 2010). Recent health related research indicated that multimedia is a feasible method to deliver health intervention (Blas et al., 2007; Cornelius, Cato, St. Lawrence, Boyer, & Lightfoot, 2011; Levine, Madsen, Barar, Wright, & Bull, in press; Whittaker et al., 2011; Whittaker et al., 2008; Wright, Fortune, Juzang, & Bull, 2011; Ybarra & Bull, 2007). As online and mobile text messaging evolve, it is critical to examine the utility of highly used technology and social networking sites, such as Facebook, as a method for delivering HIV prevention information, and interventions to motivate HIV testing among young BMSM (Holt et al., 2011; Kline et al., 2001; Rosser et al., 2011; Wilkerson, Danilenko, Smolenski, Myer, & Rosser, 2011).

Previous studies have examined the impact of online video-based interventions on different outcomes, such as acquisition of new sexually transmitted disease (STD) infections among patients attending STD clinics (Myint et al., 2010; Warner et al., 2008); future planning behaviors among HIV concordant positive and discordant couples in Zambia (Stephenson et al., 2008) and self-disclosure of HIV status and HIV risk behaviors (Chiasson, Shaw, Humberstone, Hirshfield, & Hartel, 2009). One study examined the effectiveness of an online HIV video intervention to increase intentions to test among Peruvian MSM (Caetano, Clark, & Tam, 1998). Although the study included HIV testing intentions as an outcome to assess the efficacy of the intervention, the video intervention did not address specific barriers to HIV testing identified by Black males, aged 18–29, who reside in the United States.

The use of web-based programs has grown, and this growth will most likely continue (Caetano & Clark, 1998; Grimley & Hook, 2009; Kline et al., 2001; Mikolajczak, Hospers, & Kok, 2006). Furthermore, online video-based interventions have been used for HIV prevention and testing (Caetano & Clark, 1998; Stephenson et al., 2008; Warner et al., 2008). Likewise, online campaigns have been used to promote sexual health among MSM (Gilbert, Levandowski, Scanlon, & Peterson, 2010). One study (Caetano & Clark, 1998) provides evidence that a video-based intervention increases intentions to test for HIV in a sample of nongay males in South America. To the best of our knowledge, few studies have examined the efficacy of delivering an online HIV-testing intervention (Lorenc et al., 2011; S. D. Rhodes et al., 2011). Nevertheless, findings from the few studies suggest that chat room–based HIV testing intervention may increase testing among MSM who may be difficult to reach in traditional physical spaces (S. D. Rhodes et al., 2010). For example, S. D. Rhodes et al. (2011) culturally congruent intervention designed to promote HIV testing among MSM within existing Internet chat rooms. The findings from the intervention revealed a significant increase in self-reported HIV testing among chatters overall, increasing rates from 44.5% at pretest to nearly 60% at posttest. Furthermore, a database search revealed few studies that have explored the use of Facebook (Bull et al., 2011). The studies using Facebook have focused on topics, such as sexual health, HIV education, influence of religion on behaviors, recruitment strategies, and social networks (Bull et al., 2011; Bull, Levine, Black, Schmiege, & Santelli, 2012; Hunter et al., 2014; Vial, Starks, & Parsons, 2014; Washington, Patel, & Meyer-Adams, 2015; Young, Dutta, & Dommety, 2009; Young, Holloway, et al., 2014; Young & Jordan, 2013; Young, Shakiba, Kwok, & Montazeri, 2014). No studies were revealed that aimed to deliver a motivational video intervention to increase HIV testing uptake among young BMSM with preintervention and postintervention assessment of risk behaviors and HIV testing uptake.

The present study sought to address this gap by examining the feasibility of implementing a video intervention to motivate HIV testing uptake among BMSM using Facebook. It is distinct from previous research in that the content was informed by, and focused explicitly on, young BMSM. The intervention content was developed using qualitative findings from a previous study involving young BMSM. The content was then pretested by young BMSM and finalized using feedback from young BMSM. Facebook features were used to direct participants to the intervention.

The HIV intervention was guided by the integrative model of behavior change, which has been expanded into an intervention-oriented model of behavioral action (Fishbein & Ajzen, 1975; Fishbein et al., 2001; F. Rhodes & Malotte, 1996). Theoretical elements and social and environmental factors are linked together in a single conceptual framework emphasizing the components that are most susceptible to change. The elements in this model are considered to be directly influenced by an intervention are as follows: (a) HIV knowledge (including substance use as risk), (b) behavioral beliefs, (c) self-regulation skill and ability, (d) social supports (social network including online peer influences), and (e) engagement in self-management behavior.

METHOD

Participants and Procedure

BMSM in Los Angeles County were recruited for this study. The inclusion criteria included the following: Black/African American male, aged 18–30 years, had sex with a man in the past 3 months by self-report, HIV status unknown and have not tested for HIV at least within the past six months, resident of Los Angeles County, California, had comdomless receptive or insertive anal sex at least once in lifetime, English speaking, and a valid e-mail address. Potential participants were excluded if they self-reported having received an HIV test (and results) within the past 6 months or if they reported known HIV-positive status. In an effort to recruit BMSM who may not frequent gay-identified spaces, and to reduce the role of stigmatization and bias of recruiting a diverse group of BMSM, the study was advertised as the “TIM Project: A Young Black Men’s Health Study.” Participants were recruited in person at community-based organizations serving Black males at high risk and online via social media (e.g., Facebook, Twitter, Black Gay Chat). There was a cost for the social media banner ads. The online recruitment was limited; the majority of the participants who used the Internet for screening were not eligible because of the strict HIV testing history criterion. The in-person recruitment efforts were more yielding than the online recruitment. The study was approved by the institutional review board, and all participants consented to participate.

Enrollment occurred after screening, and randomization occurred after completion of the baseline survey. Recruitment, enrollment, and follow-up occurred between April 2014 to October 2014 (Figure 1). Follow-up occurred 6 weeks after enrollment. All advertisements included the project’s URL link to access the study’s page from their personal computers, smart phones, or tablets were available for those recruited at community-based organizations and community events. Participants were asked to sign in to their Facebook account to complete the screening process. Participants were screened for eligibility online. Eligible participants were given instructions and sent an e-mail to the e-mail associated with their Facebook account. The e-mail included further details about the study and informed consent material. Once the participants had completed the informed consent, they were directed to complete the baseline survey online and were then randomly assigned to either the testing intervention model (TIM) Project group (video intervention) or the Health Information group (control). A final eligibility requirement was to “like” the Facebook group page to which they have been assigned. After clicking the “like” feature, the participant began to receive weekly messages and updates about the study when they logged on to their Facebook page. Both groups were asked to post comments on the group page in reaction or response to the content they viewed. A private space was set-up on Facebook that participants could “like.” Setting a private space on Facebook to use the like feature, and sending participants messages via Facebook message feature, allowed for greater privacy; participants could access the study information from their own page, which kept the study information from appearing on their personal pages (Bull et al., 2011).

Figure 1.

Figure 1

Illustration of flow of the study.

Intervention

The intervention was conducted online with monitoring by a systems analyst and the research team. The intervention group participants were asked to review five 60-second intervention videos, weekly. The content was informed by findings from a formative project with young BMSM regarding barriers and challenges to, and recommendations for, motivating HIV testing uptake among young BMSM. Each video’s scene included young BMSM character actors/peers delivering the content: (Video 1) the content focused on HIV prevention knowledge, risk behaviors and practices, including substance abuse and risky sex practices; (Video 2) the content focused on behavioral beliefs, the benefits of HIV testing and early detection, and treatment available for a person living with HIV; (Video 3) the content focused on self-regulation, the importance knowing HIV risks, the influence of peer-support for testing uptake; (Video 4) the content focused on coping with HIV disclosure to friends and family, and the importance of social support for HIV prevention or HIV treatment and management; and (Video 5) the content focused on engagement in self-management, and testing facilities. At the end of each video clip, participants were asked to post comments on the group page in reaction or response to the video content about HIV prevention and HIV testing uptake messages. A staff member monitored the discussion/responses daily to remove incorrect and inappropriate messages.

Participants in the control group viewed standard HIV text information. Control participants received the information weekly. The content focused on the following: (Week 1) HIV prevention knowledge; (Week 2) sexually transmitted infections; (Week 3) drug use and sexual risk behavior; (Week 4) the importance of social support for HIV testing and HIV related stigma; (Week 5) what to expect at HIV testing facilities. As part of the Health information group (control) on Facebook, participants were asked to post comments on the group page in reaction or response to the content about HIV prevention messages. A staff member monitored the discussion/responses daily to remove incorrect and inappropriate messages.

All participants received daily updates via email about the study. Participants also received a reminder message 6 weeks following the initial enrollment to complete the follow-up assessment survey, including questions regarding HIV testing uptake and behavior. Project staff conducted follow-up calls to participants who provided a phone number agreeing for telephone contact regarding the follow-up survey. Only the participants who had not completed the follow-up survey within 7 days of receiving the reminder message on Facebook were contacted. The Facebook/TIM Project web page included the location of free HIV testing sites in Los Angeles and Orange County. Participants received a $20 gift card for the initial survey and intervention part of the study and a $25 gift card for the 6-week follow-up survey. Additionally, the names of participants who completed the study was entered into a drawing for a chance to receive an Apple iPad.

Data Collection

The study was accessed from Facebook.com/TIM Project. The traffic was managed using a simple computer with a GSM modem attached for programmed e-mail delivery, a LimeSurvey account, a project secure website, and a registered Facebook account with a private space. Facebook allows the host to set security settings, and manage access criteria. The computer modem received the prompt once a participant accessed the link sent to their Facebook e-mail account. Then the modem sent the prompt to the computer and a custom script parsed the consent form, returned the link for the survey to the participant who consented, logged the activity and waited for the next prompt. A “LAMP” web server with a database backend was running the survey, which was hosted by LimeSurvey. The survey data were managed solely on LimeSurvey and was not accessible on Facebook for security and confidentiality measures. Streaming video was used for the multimedia intervention, and a commercial web host was used for streaming the video. The systems analyst managed the programming and development effort for the automated delivery as the system had to be verified on more than one device. For the 6-week follow-up survey, a script was run daily, checked the logs, and checked to see if the recipient completed the survey, and if not, then an automated message was sent as a reminder.

Assessment

Baseline assessment of demographics and screening for HIV testing history were completed. Data collection for the dependent variable was HIV testing history and occurred at baseline and again at follow-up. Participants were asked, “Have you had an HIV test in the past six months?” Response options were “no” and “yes.” Responses were dichotomized to indicate whether a respondent was untested within the past 6 months. To further assess the consistency of HIV testing history, participants were also asked, “In the past six months, how many times have you been tested for HIV?”

There were eight demographic variables included. Age was self-reported continuous-level variable. Level of education was a categorical variable and the response options were less than high school, high school/general educational development (GED), some college, or more. Employment status was categorized as “full-time/part-time employment” and “no employment.” Lastly, the recruitment venue variable was measured using two categories: “online” or “community agency/event.”

The survey also included items assessing the frequency of two types of sexual practices (condomless insertive anal sex, condomless receptive anal sex) during the past 3 months. Response options were “yes” and “no.” HIV knowledge was measured using 14 questions; for example, “HIV can be transmitted through the saliva of an infected person?” and “People must be sexually promiscuous in order to get infected with HIV?” Response options were “true,” “false,” and “don’t know.” One point was assigned for each accurate response with don’t know scored as inaccurate. The responses were coded as 1 for a correct response and 0 for an incorrect or don’t know response. Overall scores could range from 0 to 14, with 14 being high HIV-related knowledge. The HIV knowledge scale was developed by a team of renowned researchers with expertise in HIV/AIDS prevention interventions and research, and test–retest reliability are reported elsewhere (Aarø et al., 2011).

Drug using behavior was measured using a four-part item. First, participants were asked, “During the last 3 months, have you consumed drugs that were not prescribed by a doctor? Response options were “yes” and “no.” Participants who responded “yes” were asked, “Please indicate which ones.” Response options were marijuana, crack, crystal meth, cocaine, poppers, heroin, ecstasy, ketamine, GHB, Viagra/Cialis, and other. The remaining two questions asked about problems from drugs use, and risk for acquiring or transmitting HIV because of drug use, during the last 3 months. The “drug use risky sex” variable was measured using the following question: “During the last three months, were you at risk for acquiring or transmitting HIV because of your drug use (e.g., sex without a condom using drugs that were not prescribed by a doctor before or during sex)?” The response options were “yes” and “no.” Similarly, for the “alcohol use risky sex” variable, participants were asked, “During the last three months, were you at risk for acquiring or transmitting HIV because of your alcohol use (e.g., sex without a condom using alcoholic beverages, such as beer, wine, liquor before or during sex)?” The response options were “yes” and “no.” Furthermore, participants were asked questions about the use of the following to seek sex during the last 3 months: “Internet to look for sex,” “sex phone lines,” and “public place (e.g., sex clubs, parks, bookstores, porn stores).” Response options were “yes” and “no.”

Statistical Analyses

To determine the effectiveness of randomization, we compared the demographic characteristics based on the random group assignments using t test for continuous variables or chi-square for dichotomous variables. Considering power (1−β) set at .80 and α = .05, and the effect size of 0.205 by using GPower software (Faul, Erdfelder, Buchner, & Lang, 2009), we estimated the total sample size would be at least 40.

The primary outcome was change in self-report HIV testing history at follow-up. Because all participants were screened based on HIV testing history in the past 6 months, chi-square tests were performed to determine whether there was significant difference for testing history at follow-up between those in the intervention and control groups. Furthermore, logistic regression was used to examine the HIV testing outcome. A repeated measures analysis of variance (ANOVA) was conducted to compare the effect of the online HIV prevention knowledge component of the intervention on participants’ HIV knowledge at baseline and 6 weeks later. The p value < .05 was considered statistically significant. All analyses were performed using the statistical package PASW Statistics Version 22 (SPSS).

RESULTS

Fifty-six participants were enrolled in the study (n = 28 randomized in the intervention group and n = 28 in the control group). Because 14 did not complete the follow-up, only 42 participants are in the final reporting. Attrition was similar for both groups (n = 8 intervention, n = 6 control). At baseline, the control and intervention group were comparable in all demographic characteristics and baseline HIV knowledge (Table 1).

TABLE 1.

Sample Characteristics, Pretest/Posttest Measure of HIV Knowledge, and Posttest Only Self-Report HIV Test

Total
N = 42
N (%) or M
Intervention
Control
p
N % or M (SD) N % or M (SD)
Age 23.1 (3.4) 20 23.2 (3.4) 22 22.9 (3.3) .23
Education
 Less than HS 12 (29) 6 30 6 27 .95
 HS grad or GED 22 (52) 10 50 12 55
 Some or more college 8 (19) 4 20 4 18
Employment
 No employment 12 (29) 6 30 6 27 .55
 PT or FT employment 30 (71) 14 70 16 73
Recruitment type
 Online 9 (21) 4 20 5 23 .56
 Community agency 33 (79) 16 80 17 77
Insertive condomless sexa
 Yes 14 (33) 6 30 8 36 .75
 No 28 (67) 14 70 14 64
Receptive condomless sexa
 Yes 15 (36) 6 30 9 41 .53
 No 27 (64) 14 70 13 59
Drug use HIV riska
 Yes 23 (55) 11 55 12 54 .89
 No 19 (45) 9 54 10 46
Alcohol use HIV riska
 Yes 25 (60) 14 70 11 50 .22
 No 17 (40) 6 30 11 50
Self-report HIV testing at 6-week follow-up
 No 18 (43) 4 20 14 64 .01*
 Yes 24 (57) 16 80 8 36

Note. HS = high school; GED = general educational development; PT = part-time; FT = full-time.

a

Past 3 months.

*

p < .01.

Briefly, as shown in Table 1, participants were aged 18–30 years (M = 23 years, SD = 3.4 years). Majority of the participants (52%) had a high school diploma or GED, 29% had less than high school education, and 8% had some college or more. Majority of the participants (71%) had part-time or full-time employment, and 29% were not employed. Of participants, 79% were recruited through a community agency and 21% were recruited through online advertisements. Sixty-seven percent of participants reported no insertive condomless anal sex, and 33% reported having had insertive condomless anal sex in the past 3 months. As for receptive condomless sex, 64% reported none, and 36% reported having had receptive condomless anal sex in the past 3 months. Fifty-five percent of participants reported HIV risk due to drug use, and 45% reported no risk due to drug use. Majority of the participants (60%) reported HIV risk due to alcohol use before or during sex, and 40% reported no risk.

Table 2 shows the primary outcome, self-report HIV testing. At screening and baseline, all participants reported not having tested for HIV in the last 6 months. Participants were asked about HIV testing again at 6-week follow-up. Logistic regression revealed that the intervention group had a 7 times greater odds of testing for HIV at 6-week follow-up than those in the control group (odds ratio [OR] = 7.00, 95% confidence interval [1.72, 28.33], p = .006). A secondary outcome was HIV testing knowledge. HIV testing knowledge was measured at baseline and 6 weeks follow-up for both the control and intervention groups. As shown in Table 3, the repeated measures ANOVA with Greenhouse-Geisser correction determined that the effect of the online HIV testing intervention was significantly different between time points, F(1, 40) = 68.44, p = .001. There was a significant interaction between the intervention group and time (baseline/follow-up), F(1, 40) = 9.62, p = .004. This effect indicated that the increase in HIV knowledge significantly differed in the intervention as compared to the control group.

TABLE 2.

Outcome at 6-Week Follow-Up (HIV Testing Self-Report)

Variable OR 95% CI p
Condition
 Control 1.00 Reference
 Intervention 7.00 [1.72, 28.33] .006

TABLE 3.

Source Table for 2 (Baseline and 6-Week Follow-Up) × 2 (Intervention-Control) Within Subjects, Within–Between Subject Analysis of Variance of the Study

Sources Sum of Squares df Mean Square F Siga
HIV knowledge 7.093 1 7.093 68.44 .001
HIV Know × Group 0.997 1 0.997 9.62 .004
Error (knowledge) 4.145 40 0.104
Between group (know) 0.997 1 0.997 9.62 .004
a

Calculated based on Greenhouse-Geisser correction.

DISCUSSION

We evaluated the feasibility of implementing a video intervention to motivate HIV testing uptake among BMSM using Facebook. The intervention is distinct as the content was informed by, and focused explicitly on, young BMSM. Given the disproportionate representation of new HIV infections among young BMSM, and the high rate of those who are unaware of their infection, having a culturally-centered intervention to motivate HIV testing uptake tailored for this group is a high priority. Our intervention using short video clips delivered a social media platform was tested because such an intervention is cost-effective and useful for engaging young BMSM. Overall our findings suggest that the video-based intervention delivered using Facebook with chat features is feasible provided that it (1) includes short clips about HIV prevention knowledge and the importance of HIV testing uptake for BMSM, (2) share stories from and images of young BMSM, and (3) is available for use in community-based agencies who serve high-risk young BMSM. As previously mentioned, majority of the participants who used the internet for screening were not eligible because of the strict HIV testing history criterion. The in-person recruitment efforts at community-based agencies, particularly substance abuse treatment agencies, were more yielding than the online recruitment. The video intervention was feasible for motivating HIV testing uptake among a high-risk population. The fact that there were small to moderate effect sizes in favor of the intervention in the selected outcome measures indicates that this HIV testing intervention may be promising. This small feasibility pilot study was not expected to show significance because of low power.

Our study suggests that social media platforms such as Facebook may be an effective tool in increasing BMSM’s HIV knowledge and HIV testing. This has important implications to the delivery of messaging using wireless technology to young men overall and particularly BMSM to improve health. Our study found that the participants who dropped out of the study and did not complete the intervention, we were unable to reach them because their phones were out of service. Recent literature on the digital divide shows that Black young adults access the Internet primarily through the use of smart phones. The demographics of our sample are similar to those who are negatively impacted by the digital divide, young BMSM who are low income and possess relatively low education attainment. Future studies should take the digital divide and type of devices used to access health information and delivery into consideration (“Who Are Smartphone Users?” 2012).

Similar to other programs and studies including social media to improve health (Blas et al., 2007; Chiasson et al., 2010; Kline et al., 2001; Cornelius et al., 2011; Holt et al., 2011; Klein et al., 2010; Levine et al., in press; Rosser et al., 2011; Tsirulink, 2008; Washington & Thomas, 2010; Whittaker et al., 2011; Wilkerson et al., 2011; Wright et al., 2011; Ybarra & Bull, 2007), our findings indicated that multimedia is a feasible method to deliver a health intervention. Furthermore, consistent with previous research (Caetano & Clark, 1998; Stephenson et al., 2008; Warner et al., 2008), our findings provide evidence that online video-based interventions are useful for providing HIV prevention knowledge and knowledge about the importance of testing. At the same time, our findings suggest that in an effort to engage high-risk young BMSM in interventions using technology and social media platforms must not rely only on social media platforms for outreach. It is important to have technology available in community agencies who serve high-risk young BMSM. Those young BMSM who are untested or infrequently test for HIV (every 3–6 months) may not frequent or yield to social media sites seeking HIV education. However, the use of social media to deliver short video clips with chat features in a community agency or treatment setting can be engaging and effective for motivating HIV testing uptake. Having this available in agencies may be helpful for providers who are busy, or do not have time to provide, or participate in lengthy interventions.

The increase in the use of social media platforms offer an opportunity for HIV prevention service providers and researchers to actively engage young BMSM, increase testing uptake among this population, increase their engagement in their own care, connect with other young BMSM on health-related issues (i.e., HIV testing, PrEP use), and to address health disparities issues among this population such as access, quality, and stigma. However, additional research and practice among clinicians and service providers must address the health disparities within the context of social media platforms as a matter of social justice. While racial/ethnic minorities, such as BMSM use their cell phones to access the Internet and health information, young BMSM may not be able to access the Internet because of the costs of cell phones and phone plans. Therefore, future research should address the use of multimodalities of social media to interact and provide health information such as HIV testing (i.e., texting, SnapChat/Periscope videos, Podcast).

Social media platforms present a unique opportunity for HIV researchers and practitioners to address other social justice issues such as health literacy, which is a major issue with providing health promotion information. Health literacy is a major deterrent to health promotion information, both face to face and online. The expansive use of social media such as the video clips we designed for providing HIV prevention information such as testing, allows BMSM to receive information that is accessible to them, and removes the hindrance of health literacy problems. Research shows that 43% of U.S. adults had basic or below health literacy skills, and typical health materials are written at levels that surpass the average high school students reading skills (CDC, 2017). This results in participants knowing less about their health problems and less engagement in preventive health practices. Future research on social media platforms for health information and interventions should acknowledge and incorporate measures to address health literacy issues, especially among BMSM, who are more likely to have these problems.

Because of its omnipresence, social media platforms like Facebook present health researchers with a real chance to finally address and decrease health disparities. Moreover, by addressing social justice issues such as access, health literacy, and quality, we may be able to make some real strides in the effort to increase HIV testing among BMSM and decrease those who become infected.

Limitations of this study include the small sample and attrition in both groups. In addition, the majority of the sample was recruited at a substance abuse community agency in Los Angeles County and cannot be generalized to other recruitment settings. Also, the findings cannot be generalized to the young BMSM who may not frequent community agencies. Further research is needed in a larger population to further assess to what extent our findings are replicated. Despite these limitations, the findings have implications for health professionals aiming to impact the HIV/AIDS health disparity that exists among young BMSM. An intervention that is informed by, and explicitly tailored for, young BMSM, to increase HIV testing is an important contribution. The intervention may be sustained through, and adopted by, community organizations and institutions with websites oriented to motivate HIV testing among BMSM and similar populations at high risk for HIV.

We did not ask about HIV status at follow-up. Future research should consider providing an HIV testing home kit or partner with an HIV testing unit to assess HIV testing uptake. Retention rates were adequate for both the intervention and control groups, 71% and 78%, respectively. Nonetheless, it is important to improve retention. We were not able to assess reasons for those who did not complete the study. Future research should assess specific barriers to retention. Having that information would be helpful for addressing retention for retaining high-risk young BMSM.

Acknowledgments

The research reported in this publication was supported by the National Institute on Drug Abuse under Award Number 1R21DA033874-01A1, an institute of the National Institutes of Health. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. A special thanks to Stella Corrales for her administrative support during the duration of the project.

References

  1. Aarø LE, Breivik K, Klepp KI, Kaaya S, Onya HE, Wubs A, Flisher AJ. An HIV/AIDS knowledge scale for adolescents: Item response theory analyses based on data from a study in South Africa and Tanzania. Health Education Research. 2011;26(2):212–224. doi: 10.1093/her/cyq086. http://dx.doi.org/10.1093/her/cyq086. [DOI] [PubMed] [Google Scholar]
  2. Blas MM, Alva IE, Cabello R, Garcia PJ, Carcamo C, Redmon M, Kurth AE. Internet as a tool to access high-risk men who have sex with men from a resource-constrained setting: A study from Peru. Sexually Transmitted Infections. 2007;83(7):567–570. doi: 10.1136/sti.2007.027276. http://dx.doi.org/10.1136/sti.2007.027276. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Bull SS, Breslin LT, Wright EE, Black SR, Levine D, Santelli JS. Case study: An ethics case study of HIV prevention research on Facebook: The Just/Us Study. Journal of Pediatric Psychology. 2011;36:1082–1092. doi: 10.1093/jpepsy/jsq126. http://dx.doi.org/10.1093/jpepsy/jsq126. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bull SS, Levine DK, Black SR, Schmiege SJ, Santelli J. Social media–delivered sexual health intervention: A cluster randomized controlled trial. American Journal of Preventive Medicine. 2012;43(5):467–474. doi: 10.1016/j.amepre.2012.07.022. http://dx.doi.org/10.1016/j.amepre.2012.07.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Caetano R, Clark CL. Trends in alcohol consumption patterns among whites, blacks and Hispanics: 1984 and 1995. Journal of Studies on Alcohol and Drugs. 1998;59(6):659–668. doi: 10.15288/jsa.1998.59.659. [DOI] [PubMed] [Google Scholar]
  6. Caetano R, Clark CL, Tam T. Alcohol consumption among racial/ethnic minorities. Alcohol Health and Research World. 1998;22(4):233–241. [PMC free article] [PubMed] [Google Scholar]
  7. Campsmith ML, Rhodes PH, Hall HI, Green TA. Undiagnosed HIV prevalence among adults and adolescents in the United States at the end of 2006. Journal of Acquired Immune Deficiency Syndromes. 2010;53(5):619–624. doi: 10.1097/QAI.0b013e3181bf1c45. http://dx.doi.org/10.1097/QAI.0b013e3181bf1c45. [DOI] [PubMed] [Google Scholar]
  8. Castilla J, Del Romero J, Hernando V, Marincovich B, Garcia S, Rodriguez C. Effectiveness of highly active antiretroviral therapy in reducing heterosexual transmission of HIV. Journal of Acquired Immune Deficiency Syndromes. 2005;40(1):96–101. doi: 10.1097/01.qai.0000157389.78374.45. [DOI] [PubMed] [Google Scholar]
  9. Centers for Disease Control and Prevention. HIV infection among injection-drug users—34 states, 2004–2007. Morbidity and Mortality Weekly Report. 2009a;58(46):1291–1295. [PubMed] [Google Scholar]
  10. Centers for Disease Control and Prevention. Racial and Ethnic Approaches to Community Health (REACH U.S.) Finding solutions to health disparities. 2009b Retrieved from https://www.cdc.gov/nccdphp/dnpao/state-local-programs/reach/
  11. Centers for Disease Control and Prevention. HIV surveillance report, 2008. Vol 20. Atlanta, GA: Author; 2010a. [Google Scholar]
  12. Centers for Disease Control and Prevention. Prevalence and awareness of HIV infection among men who have sex with men—21 cities, United States, 2008. Morbidity and Mortality Weekly Report. 2010b;59:1201–1207. [PubMed] [Google Scholar]
  13. Centers for Disease Control and Prevention. Trends in reportable sexually transmitted diseases in the United States: 2009 National surveillance data on chlamydia, gonorrhea, and syphilis. 2010c Retrieved from http://www.cdc.gov/std/stats09/trends2009.pdf.
  14. Centers for Disease Control and Prevention. HIV surveillance report, 2009. Atlanta, GA: Author; 2011. [Google Scholar]
  15. Centers for Disease Control and Prevention. HIV among Black/African American gay, bisexual, & other men who have sex with men. Atlanta, GA: Author; 2015. [Google Scholar]
  16. Centers for Disease Control and Prevention. Health literacy basics. 2017 Retrieved from https://www.cdc.gov/healthliteracy/index.html.
  17. Chiasson MA, Hirshfield S, Rietmeijer C. HIV prevention and care in the digital age. Journal Acquired Immune Deficiency Syndrome. 2010;55(Suppl. 2):S94–S97. doi: 10.1097/QAI.0b013e3181fcb878. http://dx.doi.org/10.1097/QAI.0b013e3181fcb878. [DOI] [PubMed] [Google Scholar]
  18. Chiasson MA, Shaw FS, Humberstone M, Hirshfield S, Hartel D. Increased HIV disclosure three months after an online video intervention for men who have sex with men (MSM) AIDS Care. 2009;21(9):1081–1089. doi: 10.1080/09540120902730013. http://dx.doi.org/10.1080/09540120902730013. [DOI] [PubMed] [Google Scholar]
  19. Cornelius JB, Cato M, St Lawrence J, Boyer CB, Lightfoot M. Development and pretesting multimedia HIV-prevention text messages for mobile cell phone delivery. Journal of the Association of Nurses in AIDS Care. 2011 doi: 10.1016/j.jana.2010.11.007. http://dx.doi.org/10.1016/j.jana.2010.11.007. [DOI] [PMC free article] [PubMed]
  20. Erbelding EJ, Zenilman JM. Towards better control of sexually transmitted diseases. New England Journal of Medicine. 2005;352:720–721. doi: 10.1056/NEJMe048321. [DOI] [PubMed] [Google Scholar]
  21. Faul F, Erdfelder E, Buchner A, Lang AG. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods. 2009;41(4):1149–1160. doi: 10.3758/BRM.41.4.1149. http://dx.doi.org/10.3758/BRM.41.4.1149. [DOI] [PubMed] [Google Scholar]
  22. Fenton KA. Changing epidemiology of HIV/AIDS in the United States: Implications for enhancing and promoting HIV testing strategies. Clinical Infectious Diseases. 2007;45(Suppl. 4):S213–S220. doi: 10.1086/522615. http://dx.doi.org/10.1086/522615. [DOI] [PubMed] [Google Scholar]
  23. Fishbein M, Ajzen I. Belief, attitude, intention and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley; 1975. [Google Scholar]
  24. Fishbein M, Hennessy M, Kamb M, Bolan G, Hoxworth T, Iatesta M, Zenilman J. Using intervention theory to model factors influencing behavior change. Evaluation & the Health Professions. 2001;24(4):363–384. doi: 10.1177/01632780122034966. [DOI] [PubMed] [Google Scholar]
  25. Gilbert LK, Levandowski BA, Scanlon KE, Peterson RS. A comparison of hepatitis A and hepatitis B measures among vaccinated and susceptible online men who have sex with men. International Journal of STD & AIDS. 2010;21(6):400–405. doi: 10.1258/ijsa.2009.009010. http://dx.doi.org/10.1258/ijsa.2009.009010. [DOI] [PubMed] [Google Scholar]
  26. Grimley DM, Hook EW. A 15 minute interactive, computerized condom use intervention with biological endpoints. Sexually Transmitted Diseases. 2009;36(2):73–78. doi: 10.1097/OLQ.0b013e31818eea81. [DOI] [PubMed] [Google Scholar]
  27. Holt M, Rawstorne P, Wilkinson J, Worth H, Bittman M, Kippax S. HIV testing, gay community involvement and internet USE: Social and behavioural correlates of HIV testing among Australian men who have sex with men. AIDS and Behavior. 2011;16:13–22. doi: 10.1007/s10461-010-9872-z. http://dx.doi.org/10.1007/s10461-010-9872-z. [DOI] [PubMed] [Google Scholar]
  28. Hunter P, Oyervides O, Grande KM, Prater D, Vann V, Reitl I, Biedrzycki PA. Facebook-augmented partner notification in a cluster of syphilis cases in Milwaukee. Public Health Reports. 2014;129:43–49. doi: 10.1177/00333549141291S107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Kitahata MM, Gange SJ, Abraham AG, Merriman B, Saag MS, Justice AC, Moore RD. Effect of early versus deferred antiretroviral therapy for HIV on survival. New England Journal of Medicine. 2009;360(18):1815–1826. doi: 10.1056/NEJMoa0807252. http://dx.doi.org/10.1056/NEJMoa0807252. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Klein H, Lambing TP, Moskowitz DA, Washington TA, Gilbert LK. Recommendations for performing Internet-based research on sensitive subject matter with “hidden” or difficult-to-reach populations. Journal of Gay & Lesbian Social Services. 2010;22(4):371–398. doi: 10.1080/10538720.2010.491742. http://dx.doi.org/10.1080/10538720.2010.491742. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Kline MW, Boyle RJ, Futterman D, Havens PL, King S, Whitley-Williams PN. Adolescents and human immunodeficiency virus infection: The role of the pediatrician in prevention and intervention. Pediatrics. 2001;107:188–190. doi: 10.1542/peds.107.1.188. [DOI] [PubMed] [Google Scholar]
  32. Levine D, Madsen A, Barar R, Wright E, Bull S. Asynchronous focus groups on MySpace: Creating cultural and environmental relevance for hard to reach populations. Journal of Health Communication. doi: 10.1080/10810730.2010.546486. (in press) [DOI] [PubMed] [Google Scholar]
  33. Lorenc T, Marrero-Guillamon I, Aggleton P, Cooper C, Llewellyn A, Lehmann A, Lindsay C. Promoting the uptake of HIV testing among men who have sex with men: systematic review of effectiveness and cost-effectiveness. Sexually Transmitted Infections. 2011;87(4):272–278. doi: 10.1136/sti.2010.048280. http://dx.doi.org/10.1136/sti.2010.048280. [DOI] [PubMed] [Google Scholar]
  34. Mikolajczak J, Hospers HJ, Kok G. Reasons for not taking an HIV-test among untested men who have sex with men: An Internet study. AIDS and Behavior. 2006;10(4):431–435. doi: 10.1007/s10461-006-9068-8. http://dx.doi.org/10.1007/s10461-006-9068-8. [DOI] [PubMed] [Google Scholar]
  35. Millet GA, Peterson JL, Wolitski RJ, Stall R. Greater risk for HIV infection of Black men who have sex with men: A critical literature review. American Journal of Public Health. 2006;96(6):1008–1019. doi: 10.2105/AJPH.2005.066720. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Myint UA, Bull S, Greenwood GL, Patterson J, Rietmeijer CA, Vrungos S, O’Donnell LN. Safe in the city: Developing an effective video-based intervention for STD clinic waiting rooms. Health Promotion Practice. 2010;11(3):408–417. doi: 10.1177/1524839908318830. http://dx.doi.org/10.1177/1524839908318830. [DOI] [PubMed] [Google Scholar]
  37. Newman PA, Zimmerman MA. Gender differences in HIV-related sexual behavior among urban African-American youth: A multivariate approach. AIDS Education and Prevention. 2000;12:308–325. [PubMed] [Google Scholar]
  38. Pérez-Figueroa RE, Kapadia F, Barton SC, Eddy JA, Halkitis PN. Acceptability of PrEP uptake among racially/ethnically diverse young men who have sex with men: The P18 study. AIDS Education & Prevention. 2015;27(2):112–125. doi: 10.1521/aeap.2015.27.2.112. http://dx.doi.org/10.1521/aeap.2015.27.2.112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Phillips KA, Paul J, Kegeles S, Stall R, Hoff C, Coates TJ. Predictors of repeat HIV testing among gay and bisexual men. AIDS. 1995;9(7):769–775. doi: 10.1097/00002030-199507000-00015. [DOI] [PubMed] [Google Scholar]
  40. Porco TC, Martin JN, Page-Shafer KA, Cheng A, Charlebois E, Grant RM, Osmond DH. Decline in HIV infectivity following the introduction of highly active antiretroviral therapy. AIDS. 2004;18(1):81–88. doi: 10.1097/01.aids.0000096872.36052.24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Prejean J, Song R, Hernandez A, Ziebell R, Green T, Walker F, Hall I. Estimated HIV incidence in the United States, 2006–2009. PLoS ONE. 2011;6(8):e17502. doi: 10.1371/journal.pone.0017502. http://dx.doi.org/10.1371/journal.pone.0017502. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Quinn TC, Wawer MJ, Sewankambo N, Serwadda D, Li C, Wabwire-Mangen F, Gray RH. Viral load and heterosexual transmission of human immunodeficiency virus type 1. Rakai Project Study Group. New England Journal of Medicine. 2000;342(13):921–929. doi: 10.1056/NEJM200003303421303. http://dx.doi.org/10.1056/NEJM200003303421303. [DOI] [PubMed] [Google Scholar]
  43. Reynolds S, Makumbi F, Kayaagi J. ART reduced the rate of sexual transmission of HIV in HIV-discordant couples in rural Rakai, Uganda. Paper presented at the 16th Conference on Retroviruses and Opportunistic Infections; Montreal, Quebec. 2009. Feb, [Google Scholar]
  44. Rhodes F, Malotte CK. HIV risk interventions for active drug users: Experience and prospects. In: Oskamp S, Thompson S, editors. Understanding and preventing HIV risk behavior: Safer sex and drug use. Thousand Oaks, CA: Sage; 1996. pp. 207–236. [Google Scholar]
  45. Rhodes SD, Hergenrather KC, Duncan J, Vissman AT, Miller C, Wilkin AM, Eng E. A pilot intervention utilizing Internet chat rooms to prevent HIV risk behaviors among men who have sex with men. Public Health Reports. 2010;125:29–37. doi: 10.1177/00333549101250S105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Rhodes SD, Vissman AT, Stowers J, Miller C, McCoy TP, Hergenrather KC, Eng E. A CBPR partnership increases HIV testing among men who have sex with men (MSM): Outcome findings from a pilot test of the CyBER/testing Internet intervention. Health Educ Behav. 2011 doi: 10.1177/1090198110379572. http://dx.doi.org/10.1177/1090198110379572. [DOI] [PMC free article] [PubMed]
  47. Robbins GK, Spritzler JG, Chan ES, Asmuth DM, Gandhi RT, Rodriguez BA, Pollard RB. Incomplete reconstitution of T cell subsets on combination antiretroviral therapy in the AIDS Clinical Trials Group Protocol 384. Clinical Infectious Diseases. 2009;48(3):350–361. doi: 10.1086/595888. http://dx.doi.org/10.1086/595888. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Rosser BR, Wilkerson JM, Smolenski DJ, Oakes JM, Konstan J, Horvath KJ, Morgan R. The future of Internet-based HIV prevention: A report on key findings from the Men’s INTernet (MINTS-I, II) Sex Studies. AIDS and Behavior. 2011;15(Suppl. 1):S91–100. doi: 10.1007/s10461-011-9910-5. http://dx.doi.org/10.1007/s10461-011-9910-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Stephenson R, Mendenhall E, Muzizi L, Vwalika B, Chomba E, Ahmed Y, Allen S. The influence of motivational messages on future planning behaviors among HIV concordant positive and discordant couples in Lusaka, Zambia. AIDS Care. 2008;20(2):150–160. doi: 10.1080/09540120701534681. http://dx.doi.org/10.1080/09540120701534681. [DOI] [PubMed] [Google Scholar]
  50. Sullivan P, Kayitenkore K, Chomba E, Karita E, Mwananyanda L, Vwalika C, Allen S. Reduction of HIV transmission risk while prescribed antiretroviral therapy (ARVT): Misclassification of ARVT status as a methodological issue. Aids Research and Human Retroviruses. 2010;26(10):A19–A19. [Google Scholar]
  51. Tsirulink G. 1 Trillion text messages sent in 2008. 2008 Retrieved from http://www.mobilemarketer.com/cms/trackback/2969-1.
  52. Vial AC, Starks TJ, Parsons JT. Finding and recruiting the highest risk HIV-negative men who have sex with men. AIDS Education & Prevention. 2014;26(1):56–67. doi: 10.1521/aeap.2014.26.1.56. http://dx.doi.org/10.1521/aeap.2014.26.1.56. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Warner L, Klausner JD, Rietmeijer CA, Malotte CK, O’Donnell L, Margolis AD, Borkowf CB. Effect of a brief video intervention on incident infection among patients attending sexually transmitted disease clinics. PLoS Medicine. 2008;5(6):919–927. doi: 10.1371/journal.pmed.0050135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Washington TA, Galai N, Cohn S, Celentano DD, Vlahov D, Strathdee SA. The relationship between self-reported sexual orientation and behavior in a sample of middle-aged male injection drug users. Archives of Sexual Behavior. 2006;35(1):67–74. doi: 10.1007/s10508-006-8995-9. http://dx.doi.org/10.1007/s10508-006-8995-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Washington TA, Patel S, Meyer-Adams N. Drinking patterns and HIV risk behaviors among Black and Latino men who have sex with men in Los Angeles County. (Advance online publication).American Journal of Men’s Health. 2015 doi: 10.1177/1557988315605894. http://dx.doi.org/10.1177/1557988315605894. [DOI] [PMC free article] [PubMed]
  56. Washington TA, Robles G, Malotte CK. Factors associated with HIV-testing history among Black men who have sex with men in Los Angeles County. Behavioral Medicine. 2013;39:52–59. doi: 10.1080/08964289.2013.779565. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Washington TA, Thomas C. Exploring the use of web-based HIV prevention for injection-drug-using black men who have sex with both men and women: A feasibility study. Journal of Gay & Lesbian Social Services. 2010;22(4):432–445. [Google Scholar]
  58. Whittaker R, Dorey E, Bramley D, Bullen C, Denny S, Elley CR, Salmon P. A theory-based video messaging mobile phone intervention for smoking cessation: randomized controlled trial. Journal of Medical Internet Research. 2011;13(1):e10. doi: 10.2196/jmir.1553. http://dx.doi.org/10.2196/jmir.1553. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Whittaker R, Maddison R, McRobbie H, Bullen C, Denny S, Dorey E, Rodgers A. A multimedia mobile phone–based youth smoking cessation intervention: Findings from content development and piloting studies. Journal of Medical Internet Research. 2008;10(5):e49. doi: 10.2196/jmir.1007. http://dx.doi.org/10.2196/jmir.1007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Who Are Smartphone Users? Library Technology Reports. 2012;48(1):5–8. [Google Scholar]
  61. Wilkerson JM, Danilenko GP, Smolenski DJ, Myer BB, Rosser BR. The role of critical self-reflection of assumptions in an online HIV intervention for men who have sex with men. AIDS Educ Prev. 2011;23(1):13–24. doi: 10.1521/aeap.2011.23.1.13. http://dx.doi.org/10.1521/aeap.2011.23.1.13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Wright E, Fortune T, Juzang I, Bull S. Text messaging for HIV prevention with young Black men: Formative research and campaign development. AIDS Care. 2011:1–8. doi: 10.1080/09540121.2010.524190. http://dx.doi.org/10.1080/09540121.2010.524190. [DOI] [PubMed]
  63. Ybarra ML, Bull SS. Current trends in Internet- and cell phone-based HIV prevention and intervention programs. Current HIV/AIDS Reports. 2007;4(4):201–207. doi: 10.1007/s11904-007-0029-2. [DOI] [PubMed] [Google Scholar]
  64. Young SD, Dutta D, Dommety G. Extrapolating psychological insights from Facebook profiles: A study of religion and relationship status. CyberPsychology & Behavior. 2009;12(3):347–350. doi: 10.1089/cpb.2008.0165. http://dx.doi.org/10.1089/cpb.2008.0165. [DOI] [PubMed] [Google Scholar]
  65. Young SD, Holloway I, Jaganath D, Rice E, Westmoreland D, Coates T. Project HOPE: Online social network changes in an HIV prevention randomized controlled trial for African American and Latino men who have sex with men. American Journal of Public Health. 2014;104(9):1707–1712. doi: 10.2105/AJPH.2014.301992. http://dx.doi.org/10.2105/ajph.2014.301992. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Young SD, Jordan AH. The Influence of social networking photos on social norms and sexual health behaviors. CyberPsychology, Behavior & Social Networking. 2013;16(4):243–247. doi: 10.1089/cyber.2012.0080. http://dx.doi.org/10.1089/cyber.2012.0080. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Young SD, Shakiba A, Kwok J, Montazeri MS. The influence of social networking technologies on female religious veil-wearing behavior in Iran. CyberPsychology, Behavior & Social Networking. 2014;17(5):317–321. doi: 10.1089/cyber.2013.0338. http://dx.doi.org/10.1089/cyber.2013.0338. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES