Skip to main content
Journal of Medical Internet Research logoLink to Journal of Medical Internet Research
. 2016 Mar 15;18(3):e51. doi: 10.2196/jmir.5258

Including Online-Recruited Seeds: A Respondent-Driven Sample of Men Who Have Sex With Men

Nathan John Lachowsky 1,2, Allan Lal 1, Jamie I Forrest 3, Kiffer George Card 1,4, Zishan Cui 1, Paul Sereda 1, Ashleigh Rich 4, Henry Fisher Raymond 5,6, Eric A Roth 7,8, David M Moore 1,2, Robert S Hogg 1,4,
Editor: Gunther Eysenbach
Reviewed by: Paula Frew, Laura Salazar
PMCID: PMC4812046  PMID: 26980147

Abstract

Background

Technology has changed the way men who have sex with men (MSM) seek sex and socialize, which may impact the implementation of respondent-driven sampling (RDS) among this population. Initial participants (also known as seeds) are a critical consideration in RDS because they begin the recruitment chains. However, little information is available on how the online-recruited seeds may effect RDS implementation.

Objective

The objectives of this study were to compare (1) online-recruited versus offline-recruited seeds and (2) subsequent recruitment chains of online-recruited versus offline-recruited seeds.

Methods

Between 2012 and 2014, we recruited MSM using RDS in Vancouver, Canada. RDS weights were used with logistic regression to address each objective.

Results

A total of 119 seeds were used, 85 of whom were online-recruited seeds, to recruit an additional 600 MSM. Compared with offline-recruited seeds, online-recruited seeds were less likely to be HIV-positive (OR 0.34, 95% CI 0.13-0.88), to have attended a gay community group (AOR 0.33, 95% CI 0.12-0.90), and to feel gay community involvement was “very important” (AOR 0.16, 95% CI 0.03-0.93). Online-recruited seeds were more likely to ask a sexual partner’s HIV status always versus <50% of the time (AOR 5.21, 95% CI 1.17-23.23), to have watched the Pride parade (AOR 6.30, 95% CI 1.69-23.45), and to have sought sex online (AOR 4.29, 95% CI 1.53-12-12.05). Further, compared with recruitment chains started by offline-recruited seeds, recruits from chains started by online-recruited seeds (283/600, 47.2%) were less likely to be HIV-positive (AOR 0.25, 95% CI 0.16-0.40), to report “versatile” versus “bottom” sexual position preference (AOR 0.56, 95% CI 0.35-0.88), and to be in a relationship lasting >1 year (AOR 1.65, 95% CI 1.06-2.56). Recruits of online seeds were more likely to be out as gay for longer (eg, 11-21 vs 1-4 years, AOR 2.22, 95% CI 1.27-3.88) and have fewer Facebook friends (eg, 201-500 vs >500, AOR 1.69, 95% CI 1.02-2.80).

Conclusions

Online-recruited seeds were more prevalent, recruited fewer participants, but were different from those recruited offline. This may therefore help create a more diverse overall sample. Our work has shown the value of geosocial networking apps for aiding RDS recruitment efforts, especially when faced with slow participation uptake by other means. Understanding the degree to which networks interact will be an important next step in confirming the efficacy of online RDS recruitment strategies.

Keywords: men who have sex with men, respondent driven sampling, HIV/AIDS, online recruitment, Internet

Introduction

Respondent driven sampling (RDS), a form of peer referral-based sampling, has become a popular strategy to recruit “hidden” or “marginalized populations” [1,2]. This rise in use has led some researchers to critically assess both theoretical and operational components of the methodology. RDS implementation resembles snowball sampling with several critical caveats [3-6]. Initial participants are purposefully recruited to be “seeds” as long as they fit the study’s eligibility criteria. After completing the study procedures, seeds are offered a limited number of vouchers to recruit their peers to participate. When vouchers are redeemed, eligible participants also complete the same study procedures and are asked to recruit their peers, and this continues until recruitment goals are met. Using specially formulated statistical programs, sampling weights are developed and applied to estimate population parameters. For the purpose of RDS, effective seeds generate large recruitment chains and samples, which has been shown to be associated with motivation and a commitment to the research goals [7].

While many researchers have pointed to the issues around the statistical accuracy and precision of estimates generated from this sampling methodology [2,8,9], few have discussed the practice, innovation, and implementation of RDS. There is growing interest in online-based methods to address the prevalence of Internet use among men who have sex with men (MSM) and acknowledge the growth of online social and sexual networking [10,11]. Innovation around RDS can be helpful in mitigating some of the challenges of implementing the methodology, notably slow recruitment rates [5,12].

The Internet and the rise of online communities of gay and bisexual men remains an underutilized tool for population health researchers. In only a few decades, there has been a rapid uptake of the Internet among gay and bisexual men to facilitate new connections [13,14]. As many as 90% of gay and bisexual men have reported using the Internet for information seeking and socializing [14]. Other reports estimate that between 40% and 97% use the Internet to seek sex [15,16]. With a high prevalence of Internet usage among this population, new connections and networks are formed online now more than ever before [13,17]. As such, the use of traditional venue-based and time-location sampling may reach different segments of the study population at different times [18].

Prior formative research related to implementing RDS identified the importance of having diverse seeds to generate a sample with a greater ability to penetrate harder-to-reach subgroups of the population [1]. Furthermore, previous work has shown that diversity in seed selection methods can produce varying samples but more importantly differing recruitment rates [18,19]. Given increased utilization of specific online virtual spaces among MSM in Vancouver, Canada [20], we supplemented our RDS strategy by recruiting seeds online through a popular geolocation social networking mobile phone app, Grindr, used by MSM to seek sex with other men. The objectives of this analysis were to determine whether there were any meaningful differences in the seeds that we recruited online compared with those recruited through other community venues, and whether participants recruited in network chains that started with an online-recruited seed differed from those participants recruited from other seeds.

Methods

Recruitment

The Momentum Health Study is a longitudinal cohort of gay, bisexual, and other men who have sex with men in Metro Vancouver, British Columbia, Canada, recruited by RDS. The study aims to report on the effect of expanded access to antiretroviral therapy for the treatment of human immunodeficiency virus (HIV) and is the first study to use RDS in the greater Vancouver area to obtain a diverse sample of MSM. Prior to recruitment, we conducted systematic qualitative formative research to map the network structure of MSM in Vancouver and the surrounding area [20].

In February 2012, we began recruitment using 10 initial seeds selected from various community agency partners. Each seed was given three RDS coupons (electronic or laminated card or combination). Initial seeds were instructed to distribute RDS vouchers to other MSM in their social or sexual networks who could then redeem the card to participate in the study. Like many previous studies, we initially distributed three RDS coupons to each participant, but after encountering substantially slow recruitment rates in the first 6 months, we increased the number of RDS coupons from three to six. However, we observed no significant difference in rate of recruitment. Since seeds can be purposively selected [21,22], we decided to utilize a popular networking app for gay and bisexual men (ie, Grindr) to recruit additional seeds. Advertisements in the form of pop-up messages were sent to users within a 25 km radius to downtown Vancouver. The message contained a link to information about the study and an opportunity to leave a message for study staff to contact them by email or phone. In total, study staff sent out nine broadcast messages during the recruitment period.

A CAN $50 honorarium or equivalent entries into a draw for electronics or travel gift cards (CAN $10/entry) was provided to participants who completed the study protocol. A CAN $10 honorarium was provided for each additional recruit who successfully completed the study protocol (to a maximum of 6 recruits/CAN $60).

Independent Variables

In comparing the characteristics and recruitment efficacy of online-recruited seeds with other seeds, we classified each seed as either “online” if they were recruited through the sociosexual networking app advertisement, or as “offline” if they were selected as part of the initial study protocol. Among all study seeds, we compared “online” with “offline” seeds. We also compared the subsequent recruitment chains of “online” with “offline” seeds to compare the sample derived from online versus offline seeds.

Dependent Variables

We investigated a number of sociodemographic, community, and sexual behavioral factors thought to be associated with recruitment RDS dynamics. Sociodemographic variables included age (continuous in years), sexual identity (gay vs all other identity options collapsed: bisexual, queer, questioning, straight, etc), race/ethnicity (white vs all other identity options collapsed: Asian, Aboriginal, Latino, Black, other), birthplace (Canada vs any other country), formal educational attainment (any post-secondary education versus none), current student (or not), currently employed (or not), and annual income (<CAN $30,000 vs ≥$30,000). Living in a house, apartment, or student residence were collapsed together and considered being stably housed versus those who reported being homeless or in temporary housing. HIV status was determined using a point-of-care rapid HIV test administered at the time of the study visit (HIV-positive vs HIV-negative).

Community factors included questions about the gender of those they socialize most with (mostly or only men vs mostly or only women), how many years they consider themselves to have been “out” categorized into quartiles for those who were gay-identified (1-4, 5-10, 11-21, >21, or bisexual-identified, or not out), participation on a gay sports team in the past 6 month (yes vs no), having attended a group or club for gay men in the past 6 months (yes vs no), having attended the Pride parade in the past year (as a volunteer or in the parade vs as a spectator vs not at all), and having used a smartphone/mobile app to seek sex with another man in the past 6 months (yes vs no). Participants were asked to indicate “how important is it to be connected to and involved in the gay community” on a 4-point ordinal scale (not at all, not very or somewhat important, very important). Finally, participants were asked to indicate how many Facebook friends they had on a continuous measure, which was used as a proxy for (online) social network (0-30, 31-200, 201-500, >500).

Sexual behavioral factors included any sex with any females in the past 2 years (yes vs no), male anal sex position preference (bottom, versatile, top, or prefer no anal), marital or common law status as indicated by living together for at least 1 year (not married or common law, married or common law, no regular partner), number of male anal sex partners in the past 6 months measured continuously but categorized into quartiles (0-1, 2-3, 4-7, >7), if they had received any income for sex in the past 6 months (or not), how often they ask their partner’s HIV status (less than half the time, more than half the time, or always), whether they had ever been tested for HIV (or not), and whether they have engaged in any “risk sex” defined as any condomless anal intercourse with a partner of opposite or unknown HIV status in the past 6 months.

Statistical Analysis

For all analyses, including the descriptive statistics, RDS-weighted adjustments were generated using RDSAT version 7.1.46, taking into account the network size and homophily. The RDS-derived weights were then imported into SAS (version 9.3) for inclusion in the bivariate and multivariable logistic regression analyses. Two final multivariable logistic regression models were built using backward selection criteria that minimized the Aikaike Information Criterion. The first model compared differences between online-recruited and offline-recruited seeds. The second model compared differences between the samples recruited from online-recruited seeds and offline-recruited seeds. All tests were two-sided and performed with alpha set at the .05 significance level.

Ethical approval for this study was been granted by the research ethics boards of Simon Fraser University, University of British Columbia Providence Healthcare Research Institute, and the University of Victoria.

Results

A total of 119 seeds were used; 85 were recruited online (71.4%). These 119 seeds recruited a subsequent 600 participants for a total sample size of 719 MSM. Most of these seeds cited the following reasons for wanting to participate: help the community (40/119, 33.6%), had an interest in sexual health and HIV (35/119, 29.4%), and interested in gay men’s issues (23/119, 19.3%). Online-recruited seeds had significantly smaller networks than other seeds (median 10 vs 15, P=.006).

Table 1 provides descriptive statistics and bivariate associations with being an online-recruited seed compared with being an in-person recruited seed. Online recruited seeds were less likely to be HIV-positive (OR 0.34, 95% CI 0.13-0.88), report attending gay-community meetings in the past 6 months (OR 0.27, 95% CI 0.12-0.63), and report that being involved in the gay community was very important vs not important (OR 0.11, 95% CI 0.02-0.54), but were more likely to attend a Pride parade in the past 12 months as a spectator (OR 2.84, 95% CI 1.05-7.69), use apps to seek sex in the past 6 months (OR 3.41, 95% CI 1.49-7.82), and have 31-200 Facebook friends compared to over 500 (OR 3.47, 95% CI 1.07-11.19).

Table 1.

Descriptive statistics of and bivariate associations with being an online-recruited seed compared with in-person-recruited seed.


Offline seeds
(n=34)
Online seeds
(n=85)
OR 95% CI
n % (of row) n % (of row)
Demographic factors

Age: mean (Q1,Q3) 28.5 (24,38) 31 (25,45) 1.020 0.985-1.056

Gay-identified


Yes 31 28.2 79 71.8 Ref


No 3 33.3 6 66.7 0.785 0.185-3.335

White race/ethnicity


Yes 28 82.4 63 69.2 Ref


No 6 17.7 22 78.6 1.629 0.595-4.457

Born in Canada


Yes 28 32.2 59 67.8 Ref


No 6 18.8 26 81.3 2.056 0.760-5.563

Formal education


High school or less 4 23.5 13 76.5 Ref


Any post-secondary training 30 30.0 70 70.0 0.718 0.216-2.383

Current student


No 25 29.4 60 70.6 Ref


Yes 9 26.5 25 73.5 1.157 0.474-2.828

Annual income, CAD


<$30,000 21 30.4 48 69.6 Ref


≥$30,000 13 26.0 37 74.0 1.245 0.552-2.810

Currently employed


No 10 33.3 20 66.7 Ref


Yes 24 27.0 65 73.0 1.354 0.555-3.304

Currently stably housed


Yes 33 29.5 79 70.5 Ref


No 1 14.3 6 85.7 2.506 0.290-21.637

HIV test result


Negative 23 24.0 73 76.0 Ref


Positive 11 47.8 12 52.2 0.344a 0.134-0.882
Community factors

Only/Mostly socialize with men


Yes 21 32.3 44 67.7 Ref


No 13 24.1 41 75.9 1.505 0.668-3.390

Play on gay sports team, past 6 months


No 25 25.0 75 75.0 Ref


Yes 9 47.4 10 52.6 0.370 0.135-1.015

Attend gay-specific groups, past 6 months


No 13 18.1 59 81.9 Ref


Yes 21 44.7 26 55.3 0.273a 0.119-0.627

Pride parade participation, past 12 months


No 12 34.3 23 65.7 Ref


Yes, spectator 9 15.5 49 84.5 2.841a 1.049-7.692


Yes, in or volunteer 13 50.0 13 50.0 0.522 0.185-1.474

Use apps to seek sex, past 6 months


No 19 45.2 23 54.8 Ref


Yes 15 19.5 62 80.5 3.414a 1.490-7.823

Importance of being connected to and involved in gay community


Not important 2 8.0 23 92.0 Ref


Somehow important 14 26.4 39 73.6 0.242 0.050-1.163


Very important 18 43.9 23 56.1 0.111a 0.023-0.535

# of Facebook friends


>500 14 40.0 21 60.0 Ref


201-500 10 29.4 24 70.6 1.600 0.588-4.353


31-200 5 16.1 26 83.9 3.467a 1.074-11.191


0-30 5 26.3 14 73.7 1.867 0.548-6.353
Sex & HIV factors

Any sex with females


No 32 28.6 80 71.4 Ref


Yes 2 28.6 5 71.4 1.000 0.184-5.421

Male anal sex position preference


Bottom 13 32.5 27 67.5 Ref


Versatile 8 29.6 19 70.4 1.144 0.397-3.295


Top 12 25.0 36 75.0 1.444 0.570-3.660


No anal 1 25.0 3 75.0 1.444 0.137-15.266

Common law (lived together 1 year)


No 8 42.1 11 57.9 Ref


Common Law/Married 6 30.0 14 70.0 1.697 0.453-6.358


No regular partner 20 25.0 60 75.0 2.182 0.770-6.186

# Male anal sex partners, past 6 months


0-1 11 35.5 20 64.5 Ref


2-3 9 32.1 19 67.9 1.161 0.394-3.425


4-7 6 20.0 24 80.0 2.200 0.691-7.006


>7 8 26.7 22 73.3 1.513 0.507-4.515

Any income from sex work, past 6 months


No 32 28.3 81 71.7 Ref


Yes 2 33.3 4 66.7 0.790 0.138-4.529

Asks partner’s HIV status


<50% of time 16 34.8 30 65.2 Ref


>50% of time 14 31.1 31 68.9 1.181 0.492-2.834


100% of time 4 14.3 24 85.7 3.200 0.945-10.839

HIV test, ever


No 2 40.0 3 60.0 Ref


Yes 32 28.1 82 71.9 1.709 0.273-10.707

Any risky sex b , past 6 months


No 22 26.5 61 73.5 Ref


Yes 12 34.3 23 65.7 0.691 0.295-1.619

aIndicates statistical significance at P<.05.

bAny condomless anal intercourse with a partner of opposite or unknown HIV status.

Table 2 shows the results of the multivariable model identifying factors associated with being an online-recruited seed. In these analyses, online recruited seeds were less likely to feel it was “very important” to be involved in the gay community versus finding it not important (AOR 0.16, 95% CI 0.03-0.93), to have attended gay specific groups in the past 6 months (AOR 0.33, 95% CI 0.12-0.90), and more likely to have been a spectator at the Pride parade in the prior 12 months versus not (AOR 6.30, 95% CI 1.69-23.45), to ask a sexual partners HIV status 100% of the time versus less than 50% of the time (AOR 5.21, 95% CI 1.17-23.23), and to have used an online application to seek sex in the past 6 months than not (AOR 4.29, 95% CI 1.53-12.05).

Table 2.

Multivariable analyses of factors associated with being an online-recruited seed compared with in-person-recruited seed.


AOR 95% CI
Attend gay-specific groups, past 6 months

No Ref

Yes 0.331a 0.122-0.900
Pride parade participation, past 12 months

No Ref

Yes, spectator 6.303a 1.694-23.454

Yes, in or volunteer 1.192 0.325-4.369
Use apps to seek sex, past 6 months

No Ref

Yes 4.293a 1.530-12.048
Importance of being connected to and involved in gay community

Not important Ref

Somehow important 0.380 0.072-2.016

Very important 0.163a 0.029-0.929
Asks partner’s HIV status

<50% of time Ref

>50% of time 1.032 0.343-3.104

100% of time 5.211a 1.169-23.232

aIndicates statistical significance at P<.05.

Although online-recruited seeds comprised 71.4% of all seeds, their subsequent recruitment chains generated only 47.2% of the remaining sample (283/600). Table 3 shows the descriptive statistics and bivariate associates with being recruited from an online-recruited seed chain compared with an in-person-recruited seed’s chain.

Table 3.

Descriptive statistics of and bivariate associations with being recruited in a chain started from an online seed compared with a recruitment chain started with an in-person-recruited seed.


Offline seed’s recruitment chain
(n=317)
Online seed’s recruitment chain (n=283) OR 95% CI
n % (of row) n % (of row)
Demographic factors

Age: mean (Q1,Q3) 40 (28,49) 31 (25,41) 0.962a 0.949-0.976

Gay-identified


Yes 265 52.8 237 47.2 Ref


No 52 53.1 46 46.9 0.989 0.641-1.526

White race/ethnicity


Yes 240 53.6 208 46.4 Ref


No 77 50.7 75 49.3 1.124 0.778-1.624

Born in Canada


Yes 258 54.9 212 45.1 Ref


No 59 45.4 71 54.6 1.465 0.991-2.163

Formal education


High school or less 88 58.3 63 41.7 Ref


Any post-secondary training 224 51.3 213 48.7 1.328 0.914-1.930

Current student


No 268 55.5 215 44.5 Ref


Yes 49 42.2 67 57.8 1.704a 1.131-2.568

Annual income, CAD


<30,000 216 55.7 172 44.3 Ref


≥$30,000 101 47.6 111 52.4 1.380 0.986-1.931

Currently employed


No 144 61.5 90 38.5 Ref


Yes 173 47.3 193 52.7 1.785a 1.278-2.492

Currently stably housed


Yes 262 51.5 247 48.5 Ref


No 55 60.4 36 39.6 0.694 0.441-1.094

HIV test result


Negative 182 42.9 242 57.1 Ref


Positive 135 76.7 41 23.3 0.228a 0.153-0.340
Community factors

Only/mostly socialize with men


Yes 187 55.5 150 44.5 Ref


No 130 49.4 133 50.6 1.275 0.923-1.762

Years out


1-4 52 52.0 48 48.0 Ref


5-10 56 45.5 67 54.5 1.296 0.764-2.200


11-21 61 40.7 89 59.3 1.581 0.949-2.632


>21 107 71.8 42 28.2 0.425a 0.250-0.723


Bisexual 35 55.6 28 44.4 0.867 0.460-1.632


Not out 6 40.0 9 60.0 1.625 0.538-4.906

Play on gay sports team, past 6 months


No 287 53.4 250 46.6 Ref


Yes 30 47.6 33 52.4 1.263 0.749-2.131

Attend gay-specific groups, past 6 months


No 193 52.7 173 47.3 Ref


Yes 124 53.0 110 47.0 0.990 0.712-1.375

Pride parade participation, past 12 months


No 125 54.1 106 45.9 Ref


Yes, spectator 159 54.1 135 45.9 1.001 0.709-1.415


Yes, in or volunteer 33 44.0 42 56.0 1.501 0.888-2.535

Use apps to seek sex, past 6 months


No 177 59.6 120 40.4 Ref


Yes 140 46.2 163 53.8 1.717a 1.243-2.374

Importance of being connected to and involved in gay community


Not important 62 45.3 75 54.7 Ref


Somehow important 168 54.7 139 45.3 0.684 0.456-1.025


Very important 87 55.8 69 44.2 0.656 0.413-1.040

# of Facebook friends


>500 77 51.3 73 48.7 Ref


201-500 53 40.2 79 59.8 1.572 0.980-2.523


31-200 73 49.0 76 51.0 1.098 0.698-1.728


0-30 114 67.5 55 32.5 0.509a 0.323-0.801
Sex & HIV factors

Any sex with females


No 266 52.7 239 47.3 Ref


Yes 51 53.7 44 46.3 0.960 0.619-1.490

Male anal sex position preference


Bottom 96 47.8 105 52.2 Ref


Versatile 98 59.0 68 41.0 0.634a 0.419-0.961


Top 107 52.2 98 47.8 0.837 0.567-1.236


No anal 16 57.1 12 42.9 0.686 0.309-1.523

Common law (lived together 1 year)


No 56 43.4 73 56.6 Ref


Common law/Married 54 51.4 51 48.6 0.725 0.432-1.215


No regular partner 207 56.6 159 43.4 0.589a 0.393-0.883

# Male anal sex partners, past 6 months


0-1 90 54.5 75 45.5 Ref


2-3 71 46.1 83 53.9 1.403 0.903-2.180


4-7 68 50.7 66 49.3 1.165 0.738-1.839


>7 87 59.6 59 40.4 0.814 0.519-1.277

Any income from sex work, past 6 months


No 296 52.9 264 47.1 Ref


Yes 21 52.5 19 47.5 1.014 0.534-1.928

Asks partner’s HIV status


<50% of time 137 51.9 127 48.1 Ref


>50% of time 98 49.0 102 51.0 1.123 0.777-1.622


100% of time 82 60.3 54 39.7 0.710 0.467-1.081

HIV test, ever


No 13 38.2 21 61.8 Ref


Yes 304 53.7 262 46.3 0.534 0.262-1.086

Any risky sex b , past 6 months


No 180 50.3 178 49.7 Ref


Yes 129 56.8 98 43.2 0.768 0.550-1.073

aIndicates statistical significance at P<.05.

bAny condomless anal intercourse with a partner of opposite or unknown HIV status.

These aforementioned associations show that participants recruited from an online-recruited seeds’ chains were less likely to be older (OR 0.96, 95% CI 0.95-0.98), HIV-positive (OR 0.23, 95% CI 0.15-0.34), be versatile than a bottom with regards to sexual position preferences (OR 0.63, 95% CI 0.42-0.96), be in a relationship lasting more than 1 year versus being single (OR 0.59, 95% CI 0.39-0.88), to have between 0 and 30 Facebook friends compared with having more than 500 Facebook friends (OR 0.51, 95% CI 0.32-0.80), been “out” for over 22 years compared with between 1 and 4 years (OR 0.43, 95% CI 0.25-0.72), but were more likely to be currently employed (OR 1.79, 95% CI 1.28-2.49), be a current student (OR 1.70; 95% CI 1.13-2.57), and use apps to seek sex in the past 6 months (OR 1.72, 95% CI 1.24-2.37).

Table 4 reports the results of the multivariable analysis of factors associated with being recruited in a network chain that originated from an online-recruited seed. These results also showed that participants who were recruited from online-recruited seeds’ chains were less likely to be HIV-positive (AOR 0.25, 95% CI 0.16-0.40), be versatile as their sexual position preference (AOR 0.56, 95% CI 0.35-0.88), be in a relationship lasting ˃1 year versus being single (AOR 1.65, 95% CI 1.06-2.56). However, these participants were more likely to be have been “out” for 11-21 versus 1-4 years (AOR 2.22, 95% CI 1.27-3.88) and to have between 201-500 Facebook friends versus over 500 (AOR 1.69, 95% CI 1.02-2.80).

Table 4.

Multivariable analyses of factors associated with being recruited in a chain started from an online seed compared with a recruitment chain started with an in-person-recruited seed.


AOR 95% CI
HIV test result

Negative Ref

Positive 0.250a 0.158-0.396
Years out

1-4 Ref

5-10 1.300 0.749-2.256

11-21 2.215a 1.266-3.877

22 0.929 0.500-1.724

Bisexual-identified 1.492 0.738-3.015

Not out 2.182 0.662-7.192
# of Facebook friends

>500 Ref

201-500 1.689a 1.020-2.796

31-200 1.430 0.864-2.367

0-30 0.910 0.536-1.544
Male anal sex position preference

Bottom Ref

Versatile 0.556a 0.352-0.877

Top 0.708 0.459-1.091

No anal 0.552 0.226-1.346
Common law (lived together 1 year)

No Ref

Common law/Married 0.711 0.401-1.259

No regular partner 0.605a 0.390-0.939

aIndicates statistical significance at P<.05.

Discussion

Principal Results

In this RDS study of MSM in Vancouver, a total of 119 seeds were used to recruit a subsequent 600 participants. Nearly three-quarters of the seeds used were recruited online, which was meant to address limitations of slow recruitment rates [5,12], but the online seeds recruited less than half of the subsequent sample. As such, these online-recruited seeds were not able to generate as large recruitment chains as those seeds recruited more traditionally through community agencies, which may be a result of different motivations and social networks [7]. Our findings demonstrated that online-recruited seeds who favored using hook-up apps to seek sex were less likely to attend gay-specific groups and felt less importance with respect to participating in the larger gay community. These findings are consistent with previous work indicating that gay men recruited online tend to be different with regard to behavioral and even personal characteristics in comparison with those recruited at other venues [23-25].

Online-recruited seeds and their subsequent recruits were more likely to be HIV-negative, to use apps to seek sex with other men, and to report fewer Facebook friends, a proxy for (online) social network size. We also found that men recruited online were more likely to inquire about a sex partner’s HIV status before sex. This suggests that men who participate in online sex seeking may have better communication opportunities to inform and/or interest to adopt more seroadaptive behaviors (ie, sex that uses knowledge of HIV status to inform practices that reduce the risk of HIV transmission) into their sexual practices [26]. This includes serosorting and strategic positioning decisions, which can help reduce HIV transmission. In San Francisco, researchers reported that seroadaptive behaviors are common and have increased in the last decade [27]. This may reflect the changing ways that gay and bisexual men seek and integrate sexual health knowledge that is related to the rise in seeking sex in online spaces.

Comparison With Prior Work

Importantly for the consideration of implementing RDS among urban gay and bisexual men, we found that neither online-recruited seeds nor their recruits were significantly different than the comparator with respect to demographic factors. This is in contrast to previous RDS work that also implemented online or innovative recruitment protocols. Previous studies using RDS recruitment combined with online or self-selected innovations found significant differences with regards to ethnicity, economic status, and education [19,28,29]. This key difference in findings may suggest that online and offline networks are increasingly overlapped as greater numbers of MSM now socialize and seek sex online. It may also reflect regional and national differences in community (both physical and virtual) participation and sex seeking norms.

Limitations

The novel use of a sociosexual mobile app to recruit seeds for RDS allowed us to reach a wider non–location-based audience of the target population interested in participating in a sexual health research study. However, it is important to note that these findings do not compare the characteristics of MSM who self-selected into the study and those who saw our mobile app advertisement but did not respond. Therefore, we cannot be certain whether there are differences among the general online and offline populations and how these differences potentially introduce self-selection biases into our recruitment efforts. RDS employs peer recruitment that requires participants to know someone else’s eligibility status for the study and to disclose their own sexual minority behavior, which also limits generalizability. Our results may also be limited by the fact that online seeds were recruited through an app used for sex seeking, while offline seeds were recruited through community partners whose mission and purpose go far beyond sex seeking. Therefore, it is difficult to assess what differences are attributable to the nature of the recruitment site versus the actual medium of recruitment.

Conclusions

In conclusion, our work has shown the value of geosocial networking apps for aiding RDS recruitment efforts, especially when faced with slow participation uptake by other means. Understanding the degree to which networks interact will be an important next step in confirming the efficacy of online RDS recruitment strategies. Our findings highlighted some differences between online and offline seeds, indicating that, in the current sociosexual milieu, using both online- and traditionally recruited seeds may provide the most diverse sample of MSM in urban areas.

Acknowledgments

The authors would like to thank the Momentum Study participants, office staff and community advisory board, as well as our community partner agencies, Health Initiative for Men, YouthCo HIV and Hep C Society, and Positive Living Society of BC. Momentum is funded through the National Institute on Drug Abuse (R01DA031055-01A1) and the Canadian Institutes for Health Research (MOP-107544). NJL is supported by a CANFAR/CTN Postdoctoral Fellowship Award. DMM is supported by a Scholar Award from the Michael Smith Foundation for Health Research (#5209).

Abbreviations

HIV

human immunodeficiency virus

MSM

men who have sex with men

RDS

respondent-driven sampling

Footnotes

Conflicts of Interest: None declared.

References

  • 1.Johnston LG, Whitehead S, Simic-Lawson M, Kendall C. Formative research to optimize respondent-driven sampling surveys among hard-to-reach populations in HIV behavioral and biological surveillance: lessons learned from four case studies. AIDS Care. 2010 Jun;22(6):784–792. doi: 10.1080/09540120903373557. [DOI] [PubMed] [Google Scholar]
  • 2.White RG, Lansky A, Goel S, Wilson D, Hladik W, Hakim A, Frost SDW. Respondent driven sampling--where we are and where should we be going? Sex Transm Infect. 2012 Oct;88(6):397–399. doi: 10.1136/sextrans-2012-050703. http://sti.bmj.com/cgi/pmidlookup?view=long&pmid=23012492. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Heckathorn DD. SNOWBALL VERSUS RESPONDENT-DRIVEN SAMPLING. Sociol Methodol. 2011 Aug 1;41(1):355–366. doi: 10.1111/j.1467-9531.2011.01244.x. http://europepmc.org/abstract/MED/22228916. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Gile KJ, Handcock MS. Respondent-Driven Sampling: An Assessment of Current Methodology. Sociol Methodol. 2010 Aug;40(1):285–327. doi: 10.1111/j.1467-9531.2010.01223.x. http://europepmc.org/abstract/MED/22969167. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Bryant J. Using respondent-driven sampling with ‘hard to reach’ marginalised young people: problems with slow recruitment and small network size. International Journal of Social Research Methodology. 2013 Jul 04;17(6):599–611. doi: 10.1080/13645579.2013.811921. [DOI] [Google Scholar]
  • 6.Goel S, Salganik MJ. Assessing respondent-driven sampling. Proc Natl Acad Sci U S A. 2010 Apr 13;107(15):6743–6747. doi: 10.1073/pnas.1000261107. http://www.pnas.org/cgi/pmidlookup?view=long&pmid=20351258. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Reisner SL, Mimiaga MJ, Johnson CV, Bland S, Case P, Safren SA, Mayer KH. What makes a respondent-driven sampling "seed" productive? Example of finding at-risk Massachusetts men who have sex with men. J Urban Health. 2010 May;87(3):467–479. doi: 10.1007/s11524-010-9439-3. http://europepmc.org/abstract/MED/20354911. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Rudolph AE, Fuller CM, Latkin C. The importance of measuring and accounting for potential biases in respondent-driven samples. AIDS Behav. 2013 Jul;17(6):2244–2252. doi: 10.1007/s10461-013-0451-y. http://europepmc.org/abstract/MED/23515641. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.McCreesh N, Frost SDW, Seeley J, Katongole J, Tarsh MN, Ndunguse R, Jichi F, Lunel NL, Maher D, Johnston LG, Sonnenberg P, Copas AJ, Hayes RJ, White RG. Evaluation of respondent-driven sampling. Epidemiology. 2012 Jan;23(1):138–147. doi: 10.1097/EDE.0b013e31823ac17c. http://europepmc.org/abstract/MED/22157309. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Bengtsson L, Lu X, Nguyen QC, Camitz M, Hoang NL, Nguyen TA, Liljeros F, Thorson A. Implementation of web-based respondent-driven sampling among men who have sex with men in Vietnam. PLoS One. 2012;7(11):e49417. doi: 10.1371/journal.pone.0049417. http://dx.plos.org/10.1371/journal.pone.0049417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Homan C, Silenzio V, Sell R. Respondent-driven sampling in online social networks. In: Greenberg AM, Kennedy WG, Bos ND, editors. Social Computing, Behavioral-Cultural Modeling and Prediction Internet. Berlin Heidelberg: Springer; 2013. [Google Scholar]
  • 12.Clark JL, Konda KA, Silva-Santisteban A, Peinado J, Lama JR, Kusunoki L, Perez-Brumer A, Pun M, Cabello R, Sebastian JL, Suarez-Ognio L, Sanchez J. Sampling methodologies for epidemiologic surveillance of men who have sex with men and transgender women in Latin America: an empiric comparison of convenience sampling, time space sampling, and respondent driven sampling. AIDS Behav. 2014 Dec;18(12):2338–2348. doi: 10.1007/s10461-013-0680-0. http://europepmc.org/abstract/MED/24362754. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Grov C, Breslow AS, Newcomb ME, Rosenberger JG, Bauermeister JA. Gay and bisexual men's use of the Internet: research from the 1990s through 2013. J Sex Res. 2014;51(4):390–409. doi: 10.1080/00224499.2013.871626. http://europepmc.org/abstract/MED/24754360. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Holloway IW, Dunlap S, Del Pino HE, Hermanstyne K, Pulsipher C, Landovitz RJ. Online Social Networking, Sexual Risk and Protective Behaviors: Considerations for Clinicians and Researchers. Curr Addict Rep. 2014 Sep;1(3):220–228. doi: 10.1007/s40429-014-0029-4. http://europepmc.org/abstract/MED/25642408. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Liau A, Millett G, Marks G. Meta-analytic examination of online sex-seeking and sexual risk behavior among men who have sex with men. Sex Transm Dis. 2006 Sep;33(9):576–584. doi: 10.1097/01.olq.0000204710.35332.c5. [DOI] [PubMed] [Google Scholar]
  • 16.Mustanski BS. Are sexual partners met online associated with HIV/STI risk behaviours? Retrospective and daily diary data in conflict. AIDS Care. 2007 Jul;19(6):822–827. doi: 10.1080/09540120701237244. [DOI] [PubMed] [Google Scholar]
  • 17.Grov C, Rendina HJ, Parsons JT. Comparing three cohorts of MSM sampled via sex parties, bars/clubs, and Craigslist.org: implications for researchers and providers. AIDS Educ Prev. 2014 Aug;26(4):362–382. doi: 10.1521/aeap.2014.26.4.362. http://europepmc.org/abstract/MED/25068182. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Shi L, Wei C, McFarland W, Yan H, Li J, Raymond H. Comparing samples of men who have sex with men recruited online and in cenues, Jiangsu Province, China, 2013. LGBT Health. 2015 doi: 10.1089/lgbt.2014.0129. http://online.liebertpub.com/doi/abs/10.1089/lgbt.2014.0129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Wylie JL, Jolly AM. Understanding recruitment: outcomes associated with alternate methods for seed selection in respondent driven sampling. BMC Med Res Methodol. 2013;13:93. doi: 10.1186/1471-2288-13-93. http://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-13-93. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Forrest JI, Stevenson B, Rich A, Michelow W, Pai J, Jollimore J, Raymond HF, Moore D, Hogg RS, Roth EA. Community mapping and respondent-driven sampling of gay and bisexual men's communities in Vancouver, Canada. Cult Health Sex. 2014 Feb 10;:-. doi: 10.1080/13691058.2014.881551. http://europepmc.org/abstract/MED/24512070. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Heckathorn DD. Respondent-Driven Sampling: A New Approach to the Study of Hidden Populations. Social Problems. 1997 May;44(2):174–199. http://www.respondentdrivensampling.org/reports/RDS1.pdf. [Google Scholar]
  • 22.Heckathorn D, Semaan S, Broadhead R, Hughes J. Extensions of respondent-driven sampling: A new approach to the study of injection drug users Aged 18-25. AIDS Behav Mar. 2002;6(1):55–67. doi: 10.1023/A:1014528612685. [DOI] [Google Scholar]
  • 23.Zhang D, Bi P, Lv F, Zhang J, Hiller JE. Differences between Internet and community samples of MSM: implications for behavioral surveillance among MSM in China. AIDS Care. 2008 Oct;20(9):1128–1137. doi: 10.1080/09540120701842829. [DOI] [PubMed] [Google Scholar]
  • 24.Raymond HF, Rebchook G, Curotto A, Vaudrey J, Amsden M, Levine D, McFarland W. Comparing internet-based and venue-based methods to sample MSM in the San Francisco Bay Area. AIDS Behav. 2010 Feb;14(1):218–224. doi: 10.1007/s10461-009-9521-6. [DOI] [PubMed] [Google Scholar]
  • 25.Kendall C, Kerr LRFS, Gondim RC, Werneck GL, Macena RHM, Pontes MK, Johnston LG, Sabin K, McFarland W. An empirical comparison of respondent-driven sampling, time location sampling, and snowball sampling for behavioral surveillance in men who have sex with men, Fortaleza, Brazil. AIDS Behav. 2008 Jul;12(4 Suppl):S97–104. doi: 10.1007/s10461-008-9390-4. [DOI] [PubMed] [Google Scholar]
  • 26.Lewnard JA, Berrang-Ford L. Internet-based partner selection and risk for unprotected anal intercourse in sexual encounters among men who have sex with men: a meta-analysis of observational studies. Sex Transm Infect. 2014 Jun;90(4):290–296. doi: 10.1136/sextrans-2013-051332. [DOI] [PubMed] [Google Scholar]
  • 27.Snowden JM, Wei C, McFarland W, Raymond HF. Prevalence, correlates and trends in seroadaptive behaviours among men who have sex with men from serial cross-sectional surveillance in San Francisco, 2004-2011. Sex Transm Infect. 2014 Sep;90(6):498–504. doi: 10.1136/sextrans-2013-051368. [DOI] [PubMed] [Google Scholar]
  • 28.Burrell ER, Pines HA, Robbie E, Coleman L, Murphy RD, Hess KL, Anton P, Gorbach PM. Use of the location-based social networking application GRINDR as a recruitment tool in rectal microbicide development research. AIDS Behav. 2012 Oct;16(7):1816–1820. doi: 10.1007/s10461-012-0277-z. http://europepmc.org/abstract/MED/22851153. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Bauermeister JA, Zimmerman MA, Johns MM, Glowacki P, Stoddard S, Volz E. Innovative recruitment using online networks: lessons learned from an online study of alcohol and other drug use utilizing a web-based, respondent-driven sampling (webRDS) strategy. J Stud Alcohol Drugs. 2012 Sep;73(5):834–838. doi: 10.15288/jsad.2012.73.834. http://europepmc.org/abstract/MED/22846248. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Medical Internet Research are provided here courtesy of JMIR Publications Inc.

RESOURCES