ABSTRACT
We sought to understand young men who have sex with men (YMSM) perspectives and preferred features for a mobile health (mHealth) tool designed to facilitate human papillomavirus (HPV) vaccination. YMSM were recruited on a popular social/sexual networking app to participate in online focus groups. Discussions were designed to elicit what the men would want in a mHealth tool specific for sexual health and HPV. Demographic data were analyzed using descriptive statistics and focus group data were analyzed using conventional content analysis. Forty-eight YMSM participated. Mean age was 23.4 years, and 70.0% reported their race as Black. Qualitative themes included general HPV knowledge and awareness, current patterns in technology use, desired app qualities, and desired app content. Youth described varying levels of HPV knowledge, utilized apps to engage socially, and for travel, banking, gaming, news and entertainment, and few used apps to facilitate personal health or engage with healthcare systems. Participants desired credible, relatable, secure, and easy to use interfaces that provided sexual health and HPV information in a positive context. They described ways to creatively engage and directly connect youth to health providers. We identified a culturally relevant youth driven approach to facilitate HPV vaccination and sexual health among YMSM.
KEYWORDS: Mobile health tool, mHealth, app, human papillomavirus, HPV, vaccine, YMSM, sexual health
Introduction
At the time of this study, the human papillomavirus (HPV) vaccine was recommended for men up through age 21 and young men who have sex with men (YMSM) up through age 26.15 This recommendation, first made in 2011 (for the quadravalent vaccine and now for the nine-valent vaccine), was based on the high prevalence of HPV disease (specifically, genital warts and anal cancers) in men who have sex with men (MSM) (overall HPV prevalence: 64%, and above 90% for MSM who are also infected with HIV) as compared to men in general (40 to 50%).1-4 National rates of anal cancers are increasing,5 and rates of anogenital HPV infection and cancers are the highest among YMSM.2,6 Of additional concern is the rapidly increasing rate of HPV-related oropharyngeal cancer (OPCs) among men in the U.S.7,8 In fact, OPC has overtaken cervical cancer as the most frequently diagnosed HPV-related cancer in the U.S.8 Although prevention of OPC is not a label indication for HPV vaccine, there is indirect evidence that the vaccine may be effective.9-12 However, disparities in rates for HPV vaccination are evident for YMSM, with a recent article reporting on data from 2014, indicating that 17.2% of MSM 18–26 years of age had received one or more (≥1) doses of HPV vaccine.13 These findings are echoed by 2013 data indicating only 13% HPV vaccine initiation among MSM 18–26 years of age.14 In contrast, 2014 National Immunization Survey-Teen results show that 70.6% of 17 year old girls and 50.4% of 17 year old boys had received ≥1 dose of HPV vaccine.15
Research on barriers to vaccination indicate that both attitudinal (e.g. health beliefs) and structural (e.g. health care provider recommendation and concerns about cost) factors can interfere with vaccine uptake.16-18 Studies that examined acceptance/rejection of vaccination by gay and/or gay and bisexual men have found that vaccination was related to provider recommendation as well as health beliefs (i.e. low perception of barriers to vaccination, worries about getting HPV-related diseases, and perceived social norms in favor of vaccination).14,19,20 Additionally, work from this team and others describes YMSM lack of awareness of vaccine availability for men, lack of HPV knowledge,21-24 and stigma related to sexual orientation and seeking care, results reflected in a 2014 systematic review.25 Many YMSM do not disclose their sexual orientation to their health care providers26,27 and that lack of disclosure decreases the likelihood that appropriate health services are offered,28-31 particularly when there have been differences in routine recommendations for YMSM. However, research indicates that YMSM are interested in receiving HPV vaccination.23,32
Possibly due to societal stigma and lack of comprehensive and sexual minority inclusive sexual health education in schools, YMSM often utilize online resources, including mobile application (app) technologies to obtain information about sexual health, as well as seek out sexual partners.33-36 The community of YMSM who utilize mobile social network apps for seeking social or sexual interactions (~6 million nationally) is dramatically on the rise,35,36 and this use has been associated with increased sexual risk (HPV risk) behaviors.35,37 In a recent study of YMSM, youth believed that use of mobile app technology could be a facilitator for HPV vaccination as well as access to MSM-affirming care.22 Additionally, a recent pilot of a YMSM focused web-based HPV educational intervention found that those who utilized the website had higher subsequent vaccine initiation rates than those who did not.38 The intervention also increased awareness of the risk for anal cancers among MSM and HPV vaccination self-efficacy, while at the same time decreasing perceived harms associated with the vaccine.39 Another study noted that YMSM who searched for health information online had an increased odds of HPV vaccination.29
Given prior research indicating interest in HPV vaccination among YMSM25 and preliminary research on effectiveness of an HPV-focused app,38 we were interested in examining preferences for an HPV and HPV vaccination app among YMSM users of a social/sexual networking app. Therefore, the aim of this qualitative study utilizing an online focus group methodology was to elicit YMSM’s interest, and preferred features, in an easy-to-use mHealth tool (web-enabled mobile app) which is being developed to provide HPV and HPV vaccine information as well as referral information and linkage to care. We specifically targeted YMSM who were users of a commonly used social/sexual networking app, as these young men represent a group at potentially high risk for HPV-related diseases.
Results
Demographic characteristics
The final sample consisted of 48 YMSM (13 to 19 per state; New York, Pennsylvania, Massachusetts). The mean age was 23.4 years, and 70% reported race/ethnicity as Black, 12% White, 4% Asian, 8% more than one race, 6% other, and 22% reported Hispanic ethnicity. Over 90% reported having health insurance and 53% had some college education (see Table 1).
Table 1.
Participant Characteristics (N = 48) | ||
---|---|---|
Age |
M 23.4 |
SD |
Race/Ethnicity | n | % |
White | 6 | 12 |
Black | 33 | 70 |
Asian | 2 | 4 |
American Indian | 0 | 0 |
Multiracial | 4 | 8 |
Other | 3 | 6 |
Hispanic | 10 | 21 |
Non-Hispanic | 37 | 79 |
Health Insurance | ||
Yes | 43 | 92 |
No | 2 | 4 |
I don’t know | 2 | 4 |
Type of Insurance | ||
Private | 18 | 39 |
Public | 21 | 46 |
College | 1 | 2 |
Other | 6 | 13 |
State | ||
New York | 19 | 40 |
Pennsylvania | 13 | 28 |
Massachusetts | 15 | 32 |
Highest Level of Education | ||
< High School | 1 | 2 |
High School Graduate | 14 | 30 |
Some College | 25 | 53 |
College Graduate | 7 | 25 |
Employment Status | ||
Full Time | 17 | 32 |
Part Time | 19 | 36 |
Full Time Student | 12 | 23 |
Part Time Student | 5 | 9 |
Qualitative analysis
Four main categories emerged from the data: 1) general HPV knowledge and awareness, 2) current patterns of technology use, 3) desired qualities for a mHealth Tool, and 4) preferred content for a mHealth Tool. The youth were energized and engaged in the discussions, voiced excitement to be asked about their thoughts and desires related to a mHealth Tool, and over half desired to engage further by volunteering to test the mHealth Tool during its development. See Table 2 for illustrative quotations across all categories.
Table 2.
Categories | Illustrative Quotations |
---|---|
General HPV Knowledge and Awareness | |
Female focused | “I don’t know, it’s more dangerous in women” “not much at all, all of the advertisements around it are targeted at women” “I know it can lead to cervical cancer and something about warts” “men are common carriers with little to no symptoms. Women have a higher cancer risk from HPV” |
Risk for men/gay men | “I don’t think much of it [HPV] to be honest, I am more worried about HIV/AIDs” “I feel like gay men are at risk for almost everything” “It’s not something you hear about much in the gay community” “I don’t know much, but I think I remember hearing that gay men have higher rates than straight men do for some reason” |
HPV and HPV Cancer knowledge | “I know you can get warts from HPV” “I don’t know, I head there is no cure or prevention meds for that” “I don’t know a lot about it [HPV] I do know that I’m tested for it every year” “I think anal cancer potentially if I am not mistaking” “I don’t know, colon cancer? LOL” “I believe it is anal, colon, and prostate specific” |
HPV vaccine knowlege | “I know I get vaccines for it, that’s about it” “It is something that you are vaccinated for over a series of a few shots” “I got this shot, but I didn’t get the last one tho” “I have had every vaccine available” “We can get the vaccine but only if we don’t have hpv already” “It’s a shot that comes in like 3 series?” |
Current Patterns of Technology Use | |
Apps used | “I use snapchat, Facebook, soundcloud, holy bible” “Social media apps, ie. Twitter, Instagram & Snapchat” “Uber, Hulu, Netflix, Youtube, etc. and google calendar is my favorite app. I use Instagram a lot as well as Facebook” “Dating sites” “Dating apps like Grindr, Jack’d, Tinder, social media apps like Facebook, Tumblr, Twitter, and other random apps like horoscopes, shazam, lyft, weather apps” “I use dating and gaming apps mostly in my phone. Besides those just social media apps like Twitter and Facebook.” |
Thoughts on health apps | “I’ve used a meditation app before which actually worked great” “Headspace and Centered are good for meditation” “Bodyspace is good for fitness. You have access to a bunch of fitness routines and nutrition suggestions” “I think health related apps are so resourceful” “I don’t use any health apps” “Not sure if I would use them, when it is easier to Google things” “I have a 100 apps the question is what would make me look at it after I douwnload it” “I would not download an app if it is strictly for HPV vaccines and where to get them” “Google is my main go to for health” |
Desired Qualities for a mHealth Tool | |
Positive engagement | “LGBT friendly” “user friendly”; “Something with a straight forward user interface, not too complicated. Something simple and to the point” “I would like to see people that look like me as far as image” “real images and videos” “OK, ain’t nobody watchin no video unless it is funny as @!#%” “everything tailored to the different kinds of queerness I could be” “ethnic affirming and sensitive” “People wanna feel that where ever they go they will have people that represent them self like age, race, sex, gender” “young people who are content creaters” [not like the app if] “boring graphics”, “people who don’t relate to the generation they are trying to appeal to”, “hospital feel” |
Credibility | “[regarding partnering with a LGBT health center] that would be trustworthy and give it [the app] more credibility” “id like them [apps] as long as information is up to date and backed by real medical professionals” “Just because it is from a health center doesn’t make it safer, however I would click on it quicker if it were from a recognized health center” “I think having a live chat section with someone who is trained/educated would make it trustworthy” |
Security | “I worry about confidentiality and not wanting too much of my personal information going out [online]” “A lock or code to protect my privacy” “I would hate for someone looking at my phone and see a health app” |
Preferred Content for a mHealth Tool | |
Sexual health/health information | “Everything about gay sex” “Even in sex ed, gay sex was never really discussed. So having an app to help sexually active young men would be helpful” “I don’t think it needs to only be focused around HPV, but it should be focused for the view any sexually transmitted disease” “If it’s geared to HPV, that’s cool but it should also provide general health info about other STDs” “Proper ways to have sex, like how to properly clean yourself when bottoming” “I want information on sex toys, LOL” “I feel like we need more information on safety” “Dangers of unprotected anal and oral sex, proper sex toy/tools guides or links to find more info on different methods of STD contraction” “How to have safe anal sex” “A health app… young gay males!?! Absolutely! There is so much going on in the gay community and young gay community, so much unprotected sex” “Specifically for young men that identify as gay, I think it would be important to include proper anal sex preparations” Ttips about talking to partners about getting tested” “Symptoms to look out for, where to get tested, better sex practices” “Info on HPV and reminder system for when to get the next shot” “Some way to help me track my [HPV] shots” “A reminder of when to get the next shots either via the app, email, or text” “The app could include info on PrEP, reminders for PrEP” “HIV prevention” |
Linkages to care/health providers | “Partner with a clinic so you can schedule appointments through the app” “Something that made it really simple to schedule appointments” “Maps [on how to get to health center]” “Locations of clinics or physicians to go to” “Reminder systems, local resources to get tested” “[Regarding partnering with a LGBT health center] I that helps ease a bit of the anxiety that naturally comes along with these types of things” |
General HPV knowledge and awareness
The youth described variable levels of HPV knowledge and awareness. When asked what they knew about HPV, many youth stated “not much at all”, “I would like to know more”, and “not much, all the advertisements around it are targeted at women”; while others stated, “Men are common carriers with little to no symptoms. Women have a high cancer risk from HPV”, “I know you can get warts from HPV”, and “It can cause cancer and other diseases”. However, the majority were unaware that HPV was associated with cancer risks for men, MSM, or the types of HPV cancers that are prevalent among men. Overwhelmingly, the men were surprised to learn that HPV could cause cancers of the oropharynx, one stated “WOW!! Head/throat/neck cancer! I’m on my way to my doctor TOMORROW [to get vaccinated]”.
The participants expressed positive vaccine beliefs, describing that all men and women, no matter their sexual orientation, should and/or could get vaccinated for HPV, and that the vaccine required multiple doses. Several noted that they had been vaccinated, however many of the vaccinated men could not remember how many doses they had received. The belief that HPV affects women more than men was evident, and the men described experiences that reinforced this belief. For example, one youth stated, “I remember my health teacher stressing for the girls to get tested”. Additionally, men were surprised to learn that HPV was the most common sexually transmitted infection (STI) and voiced that they had always been more concerned about HIV.
Current patterns of technology use
Youth utilized mobile technology to stay engaged socially. The majority used multiple social and dating apps, described the strengths and weaknesses of these apps, and expressed partiality to dating apps that had a reputation for racial diversity. They also used apps for email, travel, banking, gaming, news and entertainment. Few used apps to enhance their personal health or engage with the healthcare system. The few health-associated apps they used included ones developed for fitness or meditation. One participant said he used an app developed by a health center and stated, “I have one for my doctor but never used it because it’s too complicated”. YMSM participants often described utilizing Google searches to seek information or find answers to health or sexual health questions, “I’m real quick to google anything health related”, one man noted. Participants said that if they were to use a health app, it needed to be easy to use, provide information about multiple health needs, be relevant to them as a user, overcome any fears they had about losing confidentiality, and connect them with health providers.
Desired qualities for a mHealth tool
They desired credible, relatable, secure, and easy to use interfaces that provided basic general and sexual health information in a positive context. The men described three primary qualities that a developed mHealth tool would need: 1) positive engagement, 2) a sense of credibility, and 3) a sense of security.
Participants thought the tool should have a very positive context that was non-judgmental and affirming for sexual minorities. They wanted sexual health information provided in a positive, direct, and engaging way. They expressed interest in an interactive platform that provided the latest health information via weekly updates, videos, or a way to blog or post questions with experts or peers. They also thought the tool engagement should be easy to use, simple, and to the point, one stated “[regarding an app] something with a straight forward interface. Not too complicated. Something simple and to the point”. They wanted a tool to be relatable with imagery representative of diverse races/ethnicities.
Perceived credibility was also deemed very important. The participants thought a tool would be more credible if it was associated with reputable health centers where providers were known to be knowledgeable about health for sexual minority groups. Additionally, if actual providers from a partner health center posted educational videos, or if there were opportunities for real-time engagement, the youth thought that would be very useful. Highlighting up-to-date statistics from well-known sources and educational information in a professional, but friendly and inclusive, manner was also viewed as desirable, “I like them [an app] as long as the information is up to date and backed by real medical professionals”. The participants desired a tool that was peer driven and relevant. Participants noted “I would like to see people that look like me as far as image”. They felt that developers should “[use] young people who are content creators”. When discussing potential videos, they wanted “stories of people that maybe others can relate to”.
Finally, a sense of security was imperative. The men described wanting a tool that could have a passcode and/or other markers of security including assurances of anonymity, icons to verify trust/security, or other confidentiality statements within the tool. The men were also concerned for themselves or other men in terms of making sure a mHealth tool on their phone would not mistakenly “out” someone. In particular, they voiced concerned regarding the name or icon on their phone itself not appearing “LGBT [lesbian, gay, bisexual, transgender] or health related”, “I would hate for someone looking at my phone and see a health app”, one man stated. The men thought that partnering with a MSM dating app would help with a sense of comfort and security, on participant stated “I think a health related app on Grindr or Jack’d or the like would ease the stigma- I know I never tell my doctor the exact truth [referring to his sexual practices]”. Additionally, when asked about what would make them want to download a mHealth tool, men agreed that the way in which it was advertised was important, and if it was advertised on a MSM dating app with youthful, fun, and culturally relevant ads they would be more likely to download it.
Preferred content for a mHealth tool
The participants detailed two aspects of content that they would desire in a tool: 1) sexual health/health information, and 2) linkages to care/health providers. The men described wanting educational information about HPV, HPV-associated diseases, and HPV vaccination including vaccination scheduling. They wanted practical guidance on cost as well as ways a partnered health center could support them via cost assistance programs or setting up health insurance. Additionally, they wanted other general sexual health information including information on safe sex practices, condom use and where to go for free condoms, and recommended lubricants or safe sexual toys. They thought a tool would be useful if it provided information other STIs and HIV prevention including pre-exposure prophylaxis (PrEP) and HIV testing. One participant described wanting a “guide to all STDs”. Participants also desired practical tips to promote sexual health, including how to talk to partners about condoms or testing. Lastly, fewer also desired information about what other resources a partnered health center could provide, including social support, housing, and mental health services.
The men described ways to creatively engage and directly connect youth to sexual minority affirming/friendly health providers. The young men wanted a tool that could book appointments (so they would not have to make a phone call), have a reminder system, and facilitate their connection to a local health center. They wanted maps, options for transportation, times the health center is open, and lists for all of the resources available at the local health center. They viewed geolocation capabilities as positive and perceived them to be a facilitator for access to care (via maps) as well as reminders for care (geo-locating men and sending a message via the tool if they are within a select distance to the health center for a drop in appointment). They also described wanting connections and information about other health or social events in the local community.
Discussion
Many of our findings can help to inform future mHealth development for YMSM, and to meet their sexual health needs. The YMSM in this study identified using their mobile technology primarily for socializing/networking, dating, and entertainment. Social apps and websites are also potentially a novel way to recruit and engage youth for health promotion interventions or research, and this method has been found to be an effective way to reach YMSM.16,20,39-41 The young men in this study were less likely to utilize health related apps, but when they did, the apps were likely focused on fitness or meditation. Similarly, among a national sample of adults (mean age 40 years), participants who downloaded health apps tended to by younger and utilize fitness or nutrition apps.42
Participants were excited by the opportunity to help shape the content and look/feel of a mHealth tool focused on the sexual health needs of YMSM. Youth were open to the idea of having a sexual health focused app on their phones and did not yet know of any available applications that provided this type of content, especially YMSM-focused health content. They described wanting tools that 1) were affirming, credible, and secure, and 2) provided culturally competent sexual health education in positive and youth driven approach. The YMSM described wanting connections to facilitate obtaining care from local health centers for vaccination. Previously reported barriers to vaccination among YMSM and transgender women have included not knowing where to go for vaccination.43 Lastly, youth also identified a need to obtain care from competent and affirming health providers.
Sexual and gender minority affirming care and health education appear to be mediators for HPV vaccination. Among YMSM, disclosure of same-sex behaviors to health providers and providers’ open and inclusive communication about sexual orientation and sexual behaviors have been noted as facilitators of HPV vaccination.29,30,43 Additionally, provider sexual minority-competent care and access to affirming and inclusive health settings have been described by youth [inclusive of women who have sex with women (WSW)] as facilitators to HPV vaccine initiation and completion.31 HPV vaccine initiation rates among WSW aged 18 to 26 years are higher than MSM, ranging from 35.2 to 45%.44-46 However, one study similarly indicated that WSW more likely to vaccinate if they perceived positive LGBT community vaccination norms.44
Web and app based tools have emerged as useful way to disseminate health information or meet informational needs for targeted groups;47,48 however, credibility and security of apps, in particular sexual health apps, appear to be imperative for youth.49 In this study, the young men described wanting information from sources that were reputable and legitimate (i.e. information from a health provider or health center ensured trust and credibility). This reflects findings to-date reporting that a health provider recommendation is a major factor in vaccine acceptance,16,18,50 and potentially a provider recommendation online or within an app might be an effective approach. In work by Gatzido et al, credibility and legitimacy were also highlighted as a concern for youth, indicating that design and content were cues to determine credibility as well as expertise for those providing content or services.49 Additionally, security and confidentiality were of equal importance in the design of mHealth tools in our study and in previous research.48,49 YMSM described wanting their information safeguarded, they did not want others to know the types of apps or content of apps they had on their mobile device, nor did they want an app to “out” them.
Lastly, consistent with prior research this study highlights the continued lack of knowledge and awareness about HPV infection and diseases among YMSM, despite the importance of HPV vaccination for men.23,24 Others have reported findings in which men believed HPV was principally a concern for females, and were unable to accurately articulate the negative health outcomes for men, including implications for penile, anal, or oral/pharyngeal cancers.21,22,25 Clearly, ongoing novel efforts are needed disseminate HPV and HPV vaccine education among males and YMSM.
The online focus group methodology provided a confidential and safe space for YMSM to discuss their sexual health knowledge, needs, and desires for a HPV and sexual health focused mHealth tool. The sample was strengthened by the racial diversity, particularly with the majority being from ethnic and racial minorities, and the recruitment approach provides evidence that novel strategies can facilitate representation of young Black MSM in sexual health research. Despite these strengths, findings from our sample are limited by a potential for bias as we limited recruitment to one geographic (Northeast) region and participants were recruited entirely online from the same social/sexual networking dating app. In addition, our participants had relatively high levels of health insurance and education; however, we did not assess current health seeking behaviors, vaccine status, or level of engagement in care. Results from this study should be viewed in terms of our limitations and may not be generalizable to other groups of YMSMs.
Materials & methods
Study population and procedures
A purposive sample of YMSM, aged 18 to 26 years, were recruited across 3 northeastern states (Massachusetts, New York, & Pennsylvania) in April, 2017, for 6 online focus groups (2 groups per state). English speaking participants were recruited via pop-up advertisements on a popular mobile app oriented to men of color seeking social and sexual interactions with other men. When the youth activated (touched) the advertisement, potential participants were taken to a separate webpage that explained the study purpose and procedures, provided an electronic informed consent, and included a survey to assess eligibility (including availability for the planned focus groups). Eligible and consenting participants were invited to attend one 60-minute online focus group. Participants were given instructions on how to attend the group (e.g. date, time, and login instructions) and were sent email plus telephone or text reminders on the day of the focus group. Up to 20 invitations were sent for each focus group, with a goal of 10 participants per group (20 per state; 60 total participants).
The online focus group discussions were conducted in a secure virtual focus group web platform. Participants logged in to the study specific chat room interface with chosen pseudonyms. The discussions were text based only (interactive real time typed questions and answers) with each participant on their own computer or cell phone in a place of their choosing. These discussions provided rich data and our participants freely engaged with each other during the discussions. This methodology has demonstrated effectiveness yielding high quality, in-depth data, with high levels of open and direct participant engagement. In addition this online method is known to overcomes barriers to participation such as 1) feeling of safe and anonymous for sexual health discussions and 2) scheduling difficulties, particularly for young adults.51-53
All data collected remained anonymous and de-identified. As participants arrived for the discussion, the study purpose and procedures were reviewed, questions were answered, and each participant privately completed his demographic questionnaire (via a link to our secure Qualtrics® questionnaire). The principal investigator, experienced in online focus group methods, moderated all discussions. During the discussions, all participants were actively involved, responded to question prompts, and engaged with each other by posting text. If a participant had not answered a question or commented on another’s post, the online platform allowed the moderator to privately message any participant to continue engaging if necessary. Study protocols and procedures were approved by the Fenway Health IRB, and participants received $50 as remuneration.
Measures and analysis
The focus groups utilized a semi-structured script primarily designed to elicit what the YMSM would like to see in a mHealth tool related to sexual health in general and HPV specifically. Questions were guided by results from previous work22 and included questions on what preferred features and information the men may like in a tool. We also included questions on look and feel, ease of use, as well as ease of download (See Table 3 for examples of questions developed for this study). Demographic characteristics collected included: age, race/ethnicity, and educational, employment, and health insurance status.
Table 3.
Tell me about the kinds of apps you use and like? |
What are your thoughts on health related apps? What would make you want to download a health related app? What types of information would you want from a health related app? |
Let’s say, your health care provider or health center made an app. What would you like to see from that app? |
Tell me what you know about the human papillomavirus (HPV)? Tell me what you know about the HPV vaccine? |
We are planning on developing an app that would provide young men who have sex with men information about HPV and where to go to get the HPV vaccine. What do you feel would be important to include as part of this app? |
Focus group data were downloaded from the secure online platform onto the investigator’s research computer. Data were managed with HyperResearch version 3.0.3 (Research-Ware, Randolph, MA), and were analyzed using conventional content analysis.54,55 Three study investigators reduced the raw data into preliminary codes. Investigators discussed the emerging codes, concepts, and developed a final code book with definitions. The principal investigator and a research assistant then coded the complete data set independently and reviewed data for accuracy across coders. The entire team met again to review the coded data, examine relationships in the data and combine codes to broader categories and themes. Exemplar quotes were extracted and are highlighted in this report. Demographic questionnaire data was downloaded to SPSS version 22 (IBM, Armonk, NY) for management and analysis. Descriptive analyses included mean and standard deviations for continuous variables and percentages for nominal data.
Conclusion
This study was the first step in the development a novel app-based approach to promote sexual health and facilitate HPV vaccination. The recruitment methodology led to success in capturing the voice of a racially diverse sample of YMSM, an underrepresented population in sexual health research. Findings suggest mHealth tools are acceptable and a culturally relevant and youth driven approach to provide sexual health information to YMSM. We gained insight into YMSM’s unique needs and desires for a mHealth tool, and learned that this tool might help to facilitate youth’s connection to health resources for HPV vaccination. The youth were energized by the idea and engaged in our focus group discussions. They shared key insights and specific ideas for important content and features that will be incorporated in the larger project’s next phase. This next phase will include mHealth Tool development and trial in one Northeast city to determine if YMSM recruitment on a social/sexual networking app for our mHealth Tool will facilitate HPV vaccine initiation at a local LGBT focused health center.
Funding Statement
National Institutes of Health (NIH): National Institute of Allergy and Infectious Diseases, 1R21AI130447
Disclosure of potential conflicts of interest
No potential conflicts of interest were disclosed
Financial disclosure
Within the last year GZ received an honorarium from Sanofi Pasteur for work on the Adolescent Immunization Initiative.
References
- 1.Petrosky E, Bocchini JA, Hariri S, Chesson H, Curtis CR, Saraiya M, Unger ER, Markowitz LE.. Vaccination recommendations of the advisory committee on immunization practices (ACIP). MMWR Morb Mort Wkly Rep. 2015;64:300–04. [PMC free article] [PubMed] [Google Scholar]
- 2.Giuliano AR, Anic G, Nyitray AG. Epidemiology and pathology of HPV disease in males. Gynecol Oncol. 2010;117:S15–S19. doi: 10.1016/j.ygyno.2010.01.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Giuliano AR, Lazcano-Ponce E, Villa LL, Flores R, Salmeron J, Lee J-H, Papenfuss MR, Abrahamsen M, Jolles E, Nielson CM, et al. The human papillomavirus infection in men study: human papillomavirus prevalence and type distribution among men residing in Brazil, Mexico, and the United States. Cancer Epidemiol Biomarkers Prev. 2008;17:2036–43. doi: 10.1158/1055-9965.EPI-08-0151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Machalek DA, Grulich AE, Jin F, Templeton DJ, Poynten IM. The epidemiology and natural history of anal human papillomavirus infection in men who have sex with men. Sex Health. 2012. December;9:527–37. doi: 10.1071/SH12043. [DOI] [PubMed] [Google Scholar]
- 5.Jemal A, Simard EP, Dorell C, Noone A-M, Markowitz LE, Kohler B, Eheman C, Saraiya M, Bandi P, Saslow D, et al. Annual report to the nation on the status of cancer, 1975–2009, featuring the burden and trends in human papillomavirus(HPV)-associated cancers and HPV vaccination coverage levels. J Natl Cancer Inst. 2013;105(3):175–201. doi: 10.1093/jnci/djs491. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Cranston RD. Young gay men and the quadrivalent human papillomavirus vaccine–much to gain (and lose). J Infect Dis. 2014;209(5):635–38. doi: 10.1093/infdis/jit627. [DOI] [PubMed] [Google Scholar]
- 7.Osazuwa-Peters N, Simpson M, Boakye EA, Antisdel JL, Varvares MA. 40-year incidence trends for oropharyngeal squamous cell carcinoma in the United States. Oral Oncol. 2017;74:90–97. doi: 10.1016/j.oraloncology.2017.09.015. [DOI] [PubMed] [Google Scholar]
- 8.Van Dyne EA, Henley SJ, Saraiya M, Thomas CC, Markowitz LE, Benard VB. Trends in human papillomavirus-associated cancers- United States, 1999–2015. MMWR. 2018;67:918–24. doi: 10.15585/mmwr.mm6733a2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Beachler DC, Kreimer AR, Schiffman M, Herrero R, Wacholder S, Rodriguez AC, Lowy DR, Porras C, Schiller JT, Quint W, et al. Multisite HPV16/18 vaccine efficacy against cervical, anal, and oral HPV infection. JNCI. 2016;108:djv302. doi: 10.1093/jnci/djv302. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Pinto LA, Kemp TJ, Torres BN, Isaac-Soriano K, Ingles D, Abrahamsen M, Pan Y, Lazcano-Ponce E, Salmeron J, Giuliano AR. Quadrivalent human papillomavirus (HPV) vaccine induces HPV-specific antibodies in the oral cavity: results from the mid-adult male vaccine trail. J Infect Dis. 2016;214:1276–83. doi: 10.1093/infdis/jiw359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Hirth JM, Chang M, Resto VA. Prevalence of oral human papillomavirus by vaccination status among young adults (18–30 years old). Vaccine. 2017;35:3446–51. doi: 10.1016/j.vaccine.2017.05.025. [DOI] [PubMed] [Google Scholar]
- 12.Chaturvedi AK, Graubard BI, Broutian T, Pickard RK, Tong Z-Y, Xiao W, Kahle L, Gillison ML. Effect of prophylactic human papillomavirus (HPV) vaccination on oral HPV infections among young adults in the United States. J Clin Oncol. 2018;36:262–67. doi: 10.1200/JCO.2017.75.0141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Oliver SE, Hoots BE, Paz-Bailey G, Markowitz LE, Meites E; NHBS Study Group . Increasing human papillomavirus vaccine coverage among men who have sex with men- national HIV behavioral surveillance, United States, 2014. J Acquir Immune Defic Syndr. 2017;75(3):S370–S374. doi: 10.1097/QAI.0000000000001413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Reiter PL, McRee AL, Katz ML, Paskett ED. HPV vaccination among young adult gay and bisexual men in the United States. Am J Public Health. 2015;105::96–102. doi: 10.2105/AJPH.2014.302095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Reagan-Steiner S, Yankey D, Jeyarajah J, Elam-Evans LD, Curtis CR, MacNeil J, Markowitz LE, Singleton JA. National, regional, state and selected local area vaccination coverage among adolescents aged 13–17 years- United States, 2015. MMWR. 2016;65(33):850–58. doi: 10.15585/mmwr.mm6533a4. [DOI] [PubMed] [Google Scholar]
- 16.Cummings T, Kasting M, Rosenberger J, Rosenthal S, Zimet GD, Stupiansky N. Catching up or missing out? Human papillomavirus vaccine acceptability among 18–26 year old men who have sex with men in a U.S. national sample. Sex Transm Dis. 2015;42:601–06. doi: 10.1097/OLQ.0000000000000358. [DOI] [PubMed] [Google Scholar]
- 17.Rambout L, Tashkandi M, Hopkins L, Tricco AC. Self-reported barriers and facilitators to preventive human papillomavirus vaccination among adolescent girls and young women: a systematic review. Prev Med. 2014;58:22–32. doi: 10.1016/j.ypmed.2013.10.009. [DOI] [PubMed] [Google Scholar]
- 18.Holman DM, Benard V, Roland KB, Watson M, Liddon N, Stokley S. Barriers to human papillomavirus vaccination among US adolescents: a systematic review of the literature. JAMA Pediatr. 2014;168(1):76–82. doi: 10.1001/jamapediatrics.2013.2752. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Wheldon CW, Daley EM, Walsh-Buhi ER, Baldwin JA, Nyitray AG, Giuliano AR. An integrative theoretical framework for HPV vaccine promotion among male sexual minorities. Am J Mens Health. 2018;12:1409–20. doi: 10.1177/1557988316652937. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Gerend M, Madkins K, Phillips G, Mustanski B. Predicators of human papillomavirus vaccination among young men who have sex with men. Sex Transm Dis. 2016;43:185–91. doi: 10.1097/OLQ.0000000000000408. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Fontenot HB, Fantasia HC, Charyk A, Sutherland MA. Human papillomavirus (HPV) risk factors, vaccination patterns, and vaccine perceptions among a sample of male college students. J Am Coll Health. 2014;62(3):186–92. doi: 10.1080/07448481.2013.872649. [DOI] [PubMed] [Google Scholar]
- 22.Fontenot HB, Fantasia HC, Vetters R, Zimet G. Increasing HPV vaccination and eliminating barriers: recommendations from young men who have sex with men. Vaccine. 2016;34:6209–16. doi: 10.1016/j.vaccine.2016.10.075. [DOI] [PubMed] [Google Scholar]
- 23.Nadarzynski T, Smith H, Richardson DR, Jones CJ, Llewellyn CD. Human papillomavirus and vaccine-related perceptions among men who have sex with men: a systematic review. Sex Transm Infect. 2014;90:515–23. doi: 10.1136/sextrans-2013-051357. [DOI] [PubMed] [Google Scholar]
- 24.Wheldon CW, Daley EM, Buhi ER, Baldwin JA, Nyitray AG, Giuliano AR. HPV vaccine decision-making among young men who have sex with men. Health Educ J. 2017;76:52–65. doi: 10.1177/0017896916647988. [DOI] [Google Scholar]
- 25.Nadarzynski T, Smith H, Richardson D, Pollard A, Llewellyn C. Perceptions of HPV and attitudes towards HPV vaccination amongst men who have sex with men: A qualitative analysis. Br J Health Psychol. 2017;22:345–61. doi: 10.1111/bjhp.12233. [DOI] [PubMed] [Google Scholar]
- 26.Bernstein KT, Liu K-L, Begier EM, Koblin B, Karpati A, Murrill C. Same-sex attraction disclosure to health care providers among New York city men who have sex with men: implications for HIV testing approaches. Arch Intern Med. 2008;168(13):1458–64. doi: 10.1001/archinte.168.13.1458. [DOI] [PubMed] [Google Scholar]
- 27.Meites E, Krishna NK, Markowitz LE, Oster AM. Health care use and opportunities for human papillomavirus vaccination among young men who have sex with men. Sex Transm Dis. 2013;40(2):154–57. doi: 10.1097/OLQ.0b013e31827b9e89. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Petroll AE, Mosack KE. Physician awareness of sexual orientation and preventive health recommendations to men who have sex with men. Sex Transm Dis. 2011;38(1):63–67. doi: 10.1097/OLQ.0b013e3181ebd50f. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Stupinsky N, Liau A, Rosenberger J, Rosenthal S, Tu W, Xiao S, Fontenot H, Zimet G. Young men’s disclosure of same sex behaviors to health care providers and the impact on health: results from a U.S. national sample of young men who have sex with men. AIDS Patient Care STDS. 2017;31:342–47. doi: 10.1089/apc.2017.0011. [DOI] [PubMed] [Google Scholar]
- 30.Wheldon C, Sutton S, Fontenot H, Quinn G, Giuliano A, Vadaparampil S. Physician communication practices as a barrier to risk-based HPV vaccine uptake among men who have sex with men. J Cancer Educ. 2017. doi: 10.1007/s13187-017-1223-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Apaydin K, Fontenot HB, Shtasel D, Dale S, Borba C, Lathan CS, Panther L, Mayer KH, Keuroghlian AS. Facilitators and barriers for HPV vaccination among sexual and gender minority patients at a Boston community health center. Vaccine. 2018;36:3868–75. doi: 10.1016/j.vaccine.2018.02.043. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Rank C, Gilbert M, Ogilvie G, Jayaraman GC, Marchand R, Trussler T, Hogg RS, Gustafson R, Wong T. Acceptability of human papillomavirus vaccination and sexual experience prior to disclosure to health care providers among men who have sex with men, Vancouver, Canada: implications for targeted vaccine programs. Vaccine. 2012;30:5755–60. doi: 10.1016/j.vaccine.2012.07.001. [DOI] [PubMed] [Google Scholar]
- 33.Holloway IW, Rice E, Gibbs J, Winetrobe H, Dunlap S, Rhoades H. Acceptability of smartphone application-based HIV prevention among young men who have sex with men. AIDS Behav. 2014. February;18(2):285–96. doi: 10.1007/s10461-013-0671-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Kubicek K, Carpineto J, McDavitt B, Weiss G, Kipke MD. Use and perceptions of the internet for sexual information and partners: a study of young men who have sex with men. Arch Sex Behav. 2011;40(4):803–16. doi: 10.1007/s10508-010-9666-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Landovitz RJ, Tseng CH, Weissman M, Haymer M, Mendenhall B, Rogers K, Veniegas R, Gorbach PM, Reback CJ, Shoptaw S. Epidemiology, sexual risk behavior, and HIV prevention practices of men who have sex with men using GRINDR in Los Angeles, California. J Urban Health. 2013;90(4):729–39. doi: 10.1007/s11524-012-9766-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Grov C, Breslow AS, Newcomb ME, Rosenberger JG, Bauermeister JA. Gay and bisexual men’s use of the internet: research from the 1990s through 2013. J Sex Res. 2014;51(4):390–409. doi: 10.1080/00224499.2013.871626. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Winetrobe H, Rice E, Bauermeister J, Petering R, Holloway I. Associations of unprotected anal intercourse with Grindr-met partners among Grindr-using young men who have sex with men in Los Angeles. AIDS Care. 2014;26:1304–08. doi: 10.1080/09540121.2014.911811. [DOI] [PubMed] [Google Scholar]
- 38.Reiter PL, Katz ML, Bauermeister JA, Shoben AB, Pasket ED, McRee AL. Increasing human papillomavirus vaccination among young gay and bisexual men: A randomized pilot trial of the outsmart HPV intervention. LGBT Health. 2018;5:325–29. doi: 10.1089/lgbt.2018.0059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.McRee AL, Shoben A, Bauermeister JA, Katz ML, Paskett ED, Reiter PL, Outsmart HPV. Acceptability and short-term effects of a web-based HPV vaccination intervention for young adult gay and bisexual men. Vaccine. Available online. doi: 10.1016/j.vaccine.2018.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Reiter P, Katz M, Bauermeister J, Shoben A, Paskett E, McRee AL. Recruiting young gay and bisexual men for a human papillomavirus vaccination intervention through social media: the effects of advertisement content. JMIR Public Health Surveill. 2017;3:e33. doi: 10.2196/publichealth.7545. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Prescott T, Phillips G, DuBois LZ, Bull S, Mustanski B, Ybarra M. Reaching adolescent gay, bisexual, and queer men online: development and refinement of a national recruitment strategy. J Med Internet Res. 2016;18:e200. doi: 10.2196/jmir.5602. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Krebs P, Duncan D. Health app use among US mobile phone owners: A national survey. JMIR mHealth uHealth. 2015;3:e101. doi: 10.2196/mhealth.4924. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Gorbach P, Cook R, Gratzer B, Collins T, Parris A, Moore J, Kerndt PR, Crosby RA, Markowitz LE, Meites E. Human papillomavirus vaccination among young men who have sex with men and transgender women in 2 US cities, 2012–2014. Sex Transm Dis. 2017;44:436–41. doi: 10.1097/OLQ.0000000000000626. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.McRee AL, Katz M, Pasket E, Peiter P. HPV vaccination among lesbian and bisexual women: findings from a national survey of young adults. Vaccine. 2014;32:4736–42. doi: 10.1016/j.vaccine.2014.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Bernat D, Gerend M, Chevallier K, Zimmerman M, Bauermeister J. Characteristics associated with initiation of the human papillomavirus vaccine among a national sample of male and female young adults. J Adolesc Health. 2013;53:630–36. doi: 10.1016/j.jadohealth.2013.07.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Makris N, Vena C, Paul S. Rate and predictors of human papillomavirus vaccine uptake among women who have sex with women in the United States, the national health and nutrition examination survey, 2009–2011. J Clin Nurs. 2016;25:3619–27. doi: 10.1111/jocn.13491. [DOI] [PubMed] [Google Scholar]
- 47.Brown W, Yen PY, Rojas M, Schnall R. Assessment of the health IT usability evaluation model (Health-ITUEM) for evaluating mobile health (mHealth) technology. J Biomed Inform. 2013;46:1080–87. doi: 10.1016/j.jbi.2013.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.LEngle K, Mangone E, Parcesepe A, Agarwal S, Ippoliti N. Mobile phone interventions for adolescent sexual and reproductive health: A systematic review. Pediatrics. 2016;138:e20160884. doi: 10.1542/peds.2016-0884. [DOI] [PubMed] [Google Scholar]
- 49.Gkatzidou V, Hone K, Sutcliffe L, Gibbs J, Sadiq ST, Szczepura A, Sonnenberg P, Estcourt C. User interface design for mobile-based sexual health interventions for young people: design recommendations from a qualitative study on an online chlamydia clinical care pathway. BMC Med Inform Decis Mak. 2015;15:72. doi: 10.1186/s12911-015-0197-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Newman P, Logie C, Doukas N, Asakura K. HPV vaccine acceptability among men: a systematic reivew and meta-analysis. Sex Transm Infect. 2013;89:568–74. doi: 10.1136/sextrans-2012-050980. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Ybarra ML, DuBois LZ, Parsons JT, Prescott TL, Mustanski B. Online focus groups as an HIV prevention program for gay, bisexual, and queer adolescent males. AIDS Educ Prev. 2014;26:554–64. doi: 10.1521/aeap.2014.26.6.554. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.van Eeden-Moorefield B, Proulx C, Pasley K. A comparison of internet and face-to-face (FTF) qualitative methods in studying the relationships of gay men. J GLBT Fam Stud. 2008;4:181–204. doi: 10.1080/15504280802096856. [DOI] [Google Scholar]
- 53.Fontenot H, Domush V, Zimet G. Parental attitudes and beliefs regarding the nine-valent HPV vaccine. J Adolesc Health. 2015;57:595–600. doi: 10.1016/j.jadohealth.2015.09.003. [DOI] [PubMed] [Google Scholar]
- 54.Cresswell J. Qualitative inquiry & research design: choosing among five approaches. 2nd Thousand Oaks (CA): Sage Publications; 2007. [Google Scholar]
- 55.Hsieh H, Shannon S. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–88. doi: 10.1177/1049732305276687. [DOI] [PubMed] [Google Scholar]