Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2013 May 1.
Published in final edited form as: Ann Epidemiol. 2012 Mar 14;22(5):354–363. doi: 10.1016/j.annepidem.2012.02.012

Evaluating consistency in repeat surveys of injection drug users recruited by respondent-driven sampling in the Seattle area: Results from the NHBS-IDU1 and NHBS-IDU2 surveys

Richard D Burt 1,2, Hanne Thiede 1
PMCID: PMC3338897  NIHMSID: NIHMS365075  PMID: 22420929

Abstract

Purpose

We compared data from two respondent-driven sampling (RDS) surveys of Seattle-area injection drug users (IDU) to evaluate consistency in repeat RDS surveys.

Methods

The RDS-adjusted estimates for 16 key sociodemographic, drug-related, sexual behavior, and HIV- and HCV-related variables were compared in the 2005 and the 2009 National HIV Behavioral Surveillance system surveys (NHBS-IDU1 and NHBS-IDU2). Time trends that might influence the comparisons were assessed using data from reported HIV cases in IDU, surveys of needle exchange users, and two previous IDU studies.

Results

NHBS-IDU2 participants were more likely than NHBS-IDU1 participants to report older age, heroin as their primary injection drug, male-to-male sex, unprotected sex with a partner of non-concordant HIV status, and to self-report HIV-positive status. NHBS-IDU2 participants were less likely to report residence in downtown Seattle, amphetamine injection, and a recent HIV test. Time trends among Seattle-area IDU in age, male-to-male sex and HIV testing could have influenced these differences.

Conclusions

The number and magnitude of the estimated differences between the two RDS surveys appeared to describe materially different populations. This could be a result of changes in the characteristics of Seattle-area IDU over time, of accessing differing subpopulations of Seattle IDU, or of high variability in RDS measurements.

Introduction

Surveys of injection drug users (IDU) can provide information on the status of the HIV epidemic in this population and on behaviors that affect the likelihood of HIV transmission that can be useful in guiding prevention efforts. However, it is difficult to recruit a survey population that can be said with confidence to represent the IDU in any particular community.1;2 In the late 1990’s respondent-driven sampling (RDS) was introduced as a variation on traditional snowball sampling as a means of obtaining unbiased estimates of characteristics of hidden study populations.3;4

In RDS, participants are issued coupons with which to recruit their peers and are paid for each person recruited. The new recruits are in turn given coupons with which to recruit further waves of participants. Using data obtained during interview, RDS incorporates adjustments for its estimates of population characteristics based on the size of participants’ networks and by differential recruitment patterns within and across groups of interest, based on information of who recruited whom. Mathematical theory and results from modeling studies have asserted that statistically unbiased estimates of population characteristics can be calculated in an RDS-recruited study population.5;6

RDS estimates necessarily incorporate certain assumptions, notably that each member of participants’ relevant social networks is recruited into the study with equal probability and that participants describe the size of their social networks accurately and consistently. However, the assumptions underlying both modeling and theoretical results may not be fulfilled in practice. Modeling studies have suggested potential for bias in RDS-adjusted estimates,7 and found high variance, and thus low power, in RDS results.8 A study modeling the effects of deviations from RDS assumptions found that RDS estimators are subject to error insofar as participants are more likely to recruit persons in their networks who they are closer to or whom they more closely resemble, both likely propositions in practice.9

Empirical results assessing RDS in real world settings can offer a useful complement to the evaluation or RDS methodology. One means of evaluation is to investigate the consistency of RDS measurements in repeated surveys. In 2005 and 2009, the National HIV/AIDS Behavior Surveillance (NHBS) system used RDS to recruit IDU in several U.S. cities, including Seattle.10 We report here a comparison of results from the two surveys in the Seattle area for sociodemographic and HIV transmission-associated variables commonly used to describe IDU populations. To help assess the potential influence of time trends on our findings, we include data from the HIV/AIDS Reporting System (HARS) on newly-diagnosed HIV cases in IDU, from repeat surveys of Seattle-area needle exchange users and from two previous local studies of IDU: the RAVEN and Kiwi studies.

Methods

Recruitment in NHBS-IDU2

Recruitment methods in NHBS-IDU2 have been described in print.11 Initial seeds were chosen to broadly represent the racial, gender, MSM status, drug preference and residential diversity of Seattle-area IDU. Eligibility requirements mandated that participants be 18 years of age or older, demonstrate evidence of injection by physical signs or detailed knowledge of injection practices, be able to complete the survey in English and reside in King or Snohomish Counties.

A 30–40 minute face-to-face interview was conducted in study offices in downtown Seattle using a hand-held computer. HIV testing was performed using a rapid test on a finger stick sample (OraSure Technologies, Bethlehem PA) or a standard test on a venous blood sample (Biorad, Hercules CA). Confirmatory testing by Western Blot was performed on a blood sample (Biorad, Hercules CA) for those with reactive initial tests. Participants were paid $25 for the interview, $15 for the HIV test and $10 for each coupon returned by an eligible participant. Study procedures were reviewed and approved by the Washington State Institutional Review Board.

Differences in recruitment methods between NBHS-IDU1 and NHBS-IDU2

NHBS-IDU1 followed a protocol similar to that of NHBS-IDU2.12 The primary interview site in NHBS-IDU1 was also in downtown Seattle, though in a different location. NHBS-IDU1 also recruited one or two days a week in offices in south King County, which produced only 10% of participants. All participants in NHBS-IDU1 were issued 3 coupons. NHBS-IDU2 employed schemes of offering from 1 to 5 coupons to participants based on their age and residence to enhance participation of younger IDU and IDU living outside of downtown, a tactic with precedent in the RDS literature.13 The NHBS-IDU1 study questionnaire was quite similar (and in most variables identical) to that of NHBS-IDU2 for the variables we are reporting. Neither HIV nor hepatitis C (HCV) testing was offered in NHBS-IDU1, while all NHBS-IDU2 participants were offered an HIV test and those recruited after 7/22/2009 were offered HCV testing.

Data from HIV surveillance and local studies

We assessed consistency across data sources and time trends in variables of interest using data from HARS on persons reported with HIV in King County 1990–2009, the RAVEN study (recruited from a collection of institutional settings 1994–1997),14 the Kiwi study (recruited from King County jails 1998–2002),15 and from five Public Health surveys (in 2003, 2004, 2006, 2009 and 2011) of persons exchanging needles at King County needle exchanges.16 Because there were no participants in NHBS-IDU1 from Snohomish County and only 2 in NHBS-IDU2, analysis was restricted to King County residents in all data sources, and to persons 18 years of age or older. All data sources include MSM/IDU.

Statistical analysis

We used RDSAT to produce adjusted estimates of the population proportions of characteristics of interest.17 For statistical evaluation of our results, we compared overlap in RDSAT-derived 95% confidence intervals.18 We also evaluated significance in univariate logistic regression analyses incorporating individual weights for study participants. These weights reflect adjustments for differential recruitment characteristics and network size. We combined the two study populations, with RDSAT-generated individual weights, and conducted logistic regression analyses using study (NHBS-IDU1 or NHBS-IDU2) as the dependent variable and the variable of interest as the independent variable. Multivariate weighted logistic regression analyses used a dichotomized variable of interest as the dependent variable with study and potentially confounding variables as independent variables.

Where the graphical representation suggested the existence of long terms across data sources, we used a linear-by-linear χ2 statistic to evaluate the trend across all years covered by available data. Because our statistical measures may well overestimate significance,8 we present exact p-values, even when very small, as a means of judging the likelihood that the differences observed would truly attain significance. A p-value less than 10−3 was used as a threshold to identify results to highlight. With two exceptions (noted in the text) the RDSAT 95% confidence intervals of these highlighted results overlapped in the two surveys. Analyses were conducted in SPSS.19

Results

NHBS-IDU2 Recruitment

In NHBS-IDU2, 497 participants were recruited who met the eligibility requirements for the current analysis between June 17 and November 25, 2009. These derived from six initial seeds (Figure 1). The majority of participants (70%) derived from one seed. There were 16 waves of recruitment. Six participants reported being recruited by a stranger. Of the 1333 coupons distributed, 652 (49%) were returned by a potential participant.

Figure 1.

Figure 1

NHBS-IDU2 recruitment chains. Participants reporting male-to-male sex in the previous 12 months are in filled circles, those not so reporting are in open circles; seeds (with number) are enlarged circles

The difference between the sample population proportions and the estimated equilibrium proportions (an indication of the degree to which the sample is independent of the characteristics of the seeds) was ≤ 0.02 for each category of the variables listed in Tables 1 and 2 (Tables S1 and S2). The most pronounced levels of homophily (which measures the extent to which participants with a certain characteristic preferentially recruited persons sharing that characteristic) were seen for amphetamine injection (0.72), having an HIV test in the previous 3 months (−0.56), male-to-male sex (0.53), heroin injection (0.43) and Black race (0.41). The design effect, which evaluates the proportionate difference between the RDSAT-derived variance for a variable and the variance that would be expected of a simple random sample, ranged from 1.91 to 8.88, with a median value of 3.22.

Table 1.

Comparing sociodemographic characteristics of Seattle-area IDU participating in the NHBS-IDU1 and NHBS-IDU2 surveys

NHBS-IDU1 RDS-adjusted estimate NHBS-IDU2 RDS-adjusted estimate p-value (with RDS weighting)1

Year 2005 2009
% 95 % C.I. % 95 % C.I.
Age, in years
 18 – 29 12 (6 – 21) 9 (5 – 13) 4 × 10−4
 30 – 39 21 (13 – 31) 21 (15 – 27)
 40 – 49 38 (29 – 49) 28 (21 – 36)
 ≥ 50 28 (19 – 37) 42 (33 – 52)
Race
 White 53 (41 – 65) 58 (48 – 66) .04
 Black 21 (10 – 30) 21 (13 – 30)
 Hispanic 12 (4 – 22) 7 (3 – 13)
 Native American 2 (0.2 – 1) 4 (2 –17)
 Asian or other race 1 (0.2 – 1.4) 02 -
 Multiple races 12 (7 – 19) 10 (6 – 15)
Sex
 Male 76 (66 – 84) 66 (59 – 73) .002
 Female 24 (16 – 34) 34 (27 – 41)
Area of residence
 North Seattle 7 (3 – 11) 14 (8 – 21) 1 × 10−4
 Downtown Seattle 52 (41 – 65) 39 (30 – 48)
 South Seattle 25 (15 – 35) 27 (21 – 37)
 South King County 11 (3 – 22) 10 (6 – 15)
 East King County 6 (1 – 12) 9 (3 – 14)
Education
 < High school grad. 23 (16 – 33) 25 (18 – 32) .07
 High school grad. 40 (31 – 50) 43 (35 – 50)
 Post high school 37 (26 – 47) 32 (25 – 40)

N (total) 368 497
1

Based univariate logistic regression incorporating RDSAT generated individual weights.

2

A single Asian in NHBS-IDU2 was excluded from the racial analysis (only) as RDSAT failed due to a lack of cross-group recruitment for the Asians/other race category; other race was not a response offered in NHBS-IDU2.

Table 2.

Comparing risk behavior variables among Seattle-area IDU participating in the NHBS-IDU1 and NHBS-IDU2 surveys

NHBS-IDU1 RDS adjusted estimate NHBS-IDU2 RDS adjusted estimate p-value (with RDS weighting)1

Year 2005 2009
% 95% C.I. % 95% C.I.
Drug-associated behavior2
 Drug most frequently injected
  Heroin 68 (64 – 82) 81 (71 – 88) 1 × 10−5
  Speedballs 8 (5 – 13) 8 (4 – 12)
  Cocaine 8 (3 – 14) 4 (1 – 9)
  Amphetamines 17 (4 – 19) 7 (2 – 16)
 Shared syringe 34 (26 – 42) 25 (19 – 33) .05
 Shared cooker 62 (52 – 72) 53 (46 – 61) .01
 Backloaded 28 (20 – 37) 34 (28 – 42) .50
Sexual behavior
 Male-to-male sex2 6 (3 – 8) 15 (7 – 24) 3 × 10−5
 Number sex partners2
  0 17 (12 – 24) 21 (15 – 28) .32
  1 38 (28 – 47) 33 (26 – 40)
  2 – 4 30 (21 – 41) 32 (25 – 40)
  5 – 9 7 (4 – 10) 7 (3 – 10)
  10 + 8 (4 – 13) 7 (4 – 14)
 Unprotected, non-concordant anal or vaginal sex at last sexual contact3 19 (9 – 26) 32 (24 – 44) 5 × 10−4
HIV and HCV-related variables
 HIV testing4
  In previous 12 months 65 (55 – 74) 48 (39 – 56) 2 × 10−6
  In previous 3 months 29 (20 – 38) 14 (8 – 18) 4 × 10−7
 Self-reported HIV status
  Negative 94 (91 – 97) 79 (72 – 85) 9 × 10−14
  Positive 0.4 (0.1 – 1) 7 (3 – 12)
  Unknown 6 (3 – 8) 15 (10 – 21)
 Self-reported HCV status
  Negative 28 (19 – 38) 30 (23 – 38) 0.20
  Positive 59 (48 – 69) 58 (50 – 66)
  Unknown 14 (7 – 22) 12 (8 – 16)
N (total) 368 497
1

Based univariate logistic regression incorporating RDSAT generated individual weights.

2

In the previous 12 months

3

Among participants reporting sexual contact in the previous 12 months.

4

Among participants not self-reporting HIV-positive status.

Sociodemographics

There were differences in the age distribution of the NHBS-IDU1 and NHBS-IDU2 populations (p=4×10−4), with NHBS-IDU2 participants estimated to be more likely to be 50 years of age or older compared to NHBS-IDU1 participants (42% vs. 28%). After introduction of differential coupon distribution in NHBS-IDU2, the estimated proportion of participants older than 50 declined from 58% to 37%. Thus, if anything, the difference in the proportion of older participants between NHBS-IDU1 and NHBS-IDU2 was reduced by the differential coupon distribution scheme.

There was evidence of a long term trend towards older age among Seattle-area IDU; a linear regression of age against year in all non-NHBS data sources was significant (β=0.09; p<10−3) (Figure 2). The figure demonstrates an apparent concordance in the time trend in the HARS, RAVEN, Kiwi and the needle exchange survey data. The proportions from the NBHS surveys appear higher than would be expected from the trend in the other data sources and the difference between the two NHBS surveys more pronounced than the differences within the other data sources.

Figure 2.

Figure 2

Time trends in the percent population 50 years of age or older: among Seattle-area IDU 1990–2011

Differences in residential distribution were seen between NHBS-IDU1 and NHBS-IDU2 (p=1×10−4), motivated in large part by NHBS-IDU2 participants’ lower likelihood of living in downtown Seattle (39% vs. 52% in NHBS-IDU1). After introduction of differential coupon distribution in NHBS-IDU2 the estimated proportion of downtown participants decreased from 65% to 26%. This could have influenced the lower proportion of downtown residents in NHBS-IDU2. The proportions of downtown residents in both NHBS surveys were higher than seen in the other data sources (Figure 3). As the overwhelming majority of participants in both NHBS surveys were interviewed in offices downtown, this raises the question whether RDS might preferentially recruit participants residing near interview sites.

Figure 3.

Figure 3

Time trends in the percent population residing in downtown Seattle: among Seattle-area IDU 1990–2011

Drug-related behavior

NHBS-IDU2 participants reported a different pattern of drug preference compared to NHBS-IDU1 participants (p=1×10−5). NHBS-IDU2 participants were more likely than NHBS-IDU1 participants to report heroin as the drug they injected most often (81% vs. 68%) and less likely to report amphetamines (7% vs. 17%). The tendency to report less amphetamine injection in NHBS-IDU2 runs counter to the higher proportion of participants in NHBS-MSM2 reporting male-to-male sex (see below). Amphetamine injection was more commonly reported by MSM/IDU than non-MSM/IDU in both NHBS surveys (46% vs. 5% overall).

Sexual behavior

NHBS-IDU2 participants were more likely to report male-to-male sex within the previous 12 months than NHBS-IDU1 participants (15% vs. 6%; p=3×10−5). The proportion of MSM/IDU was much higher among HARS cases than in the other data sources (Figure 4). The figure suggests an increase over time in the proportion of MSM/IDU in combined data from the RAVEN, Kiwi and needle exchange surveys, and this tests as statistically significant (p= 3×10−13). While the proportions of MSM/IDU in the two NHBS surveys appeared generally consistent with this trend, the variation between the two NHBS surveys appeared substantially more pronounced than seen in the other data sources.

Figure 4.

Figure 4

Time trends in the percent reporting male-to-male sex: among Seattle-area IDU 1990–2011

There were notable differences in the representation of MSM/IDU in the different NHBS-IDU2 recruitment chains (Figure 1). The chain deriving from seed 4 consisted predominantly of MSM/IDU, while MSM/IDU representation in the most prolific chain was sparse. Excluding participants from chain 4, the estimated proportion of MSM in NHBS-IDU2 dropped from 15% to 9%. There was evidence of isolation between MSM/IDU and non-MSM/IDU in NHBS-IDU2: the homophily was 0.61 for MSM/IDU and 0.53 for non-MSM-IDU (Table S2). It appears that RDS-adjusted estimates can be influenced by seed selection, perhaps as a consequence of substantial network isolation.

We constructed a composite variable for sexual HIV transmission risk: vaginal or anal sex without a condom with a partner of unknown or opposite HIV status (unprotected non-concordant sex) at last sexual contact. This was more likely to be reported by NHBS-IDU2 participants than those in NHBS-IDU1 (32% vs. 19%; p=5×10−4).

HIV and HCV-related variables

NHBS-IDU2 participants were less likely than NHBS-IDU1 participants to report an HIV test both within the previous 12 months (48% vs. 65%; p=2×10−6) and within the previous 3 months (14% vs. 29%; p=4×10−7). The RDSAT 95% confidence intervals did not overlap for the 3-month time frame. The variability in time trends of HIV testing in the past 12 months appears higher between the two NHBS surveys than within the other studies (Figure 5). Both the needle exchange and NHBS surveys indicate higher testing levels than seen in older data and both show a decline in the interval 2005–2011.

Figure 5.

Figure 5

Time trends in the percent reporting an HIV test in the previous 12 months: among Seattle-area IDU 1994–2011

Self-reported HIV status differed strikingly between the two NHBS surveys (p= 9×10−14), with NHBS-IDU2 participants strikingly more likely than NHBS-IDU1 participants to self-report being HIV positive (7% vs. 0.4%). The 95% confidence intervals around the two estimates did not overlap. Higher levels of HIV infection in NHBS-IDU2 than in NHBS-IDU1 were reported both among MSM/IDU (37% vs. 3%) and among non-MSM/IDU (2.5% vs. 0.6%). In contrast, similar proportions of participants in both surveys were estimated to self-report HCV positive status (58% vs. 59%). The 58% figure in NHBS-IDU2 was unchanged if consideration was restricted to NHBS-IDU2 participants who (like NHBS-IDU1 participants) were not offered HCV testing.

Multivariate control for confounding in differences between NHBS-IDU1 and NHBS-IDU2

We evaluated the extent to which the difference between NHBS-IDU1 and NHBS-IDU2 in HIV testing in the past 12 months could be a product of confounding by sociodemographic characteristics, drug preference, and MSM status. In logistic regression analyses there was a significant, independent association between HIV testing and race (p=1×10−9) and area of residence (p=0.01). There was no significant association with age (p=0.19), sex (p=0.59), education (p=0.69), drug most frequently injected (p=0.16) or male-to-male sex in the previous 12 months (p=0.15). After control for race and area of residence, NHBS-IDU2 participants remained less likely than NHBS-IDU1 participants to report an HIV test in the previous 12 months (odds ratio=0.49; p=4×10−6). In analogous models investigating the effects of the same collection of potential confounders, significant differences between NBHS-IDU1 and NHBS-IDU2 persisted for: heroin as the drug most frequently injected, amphetamines as the drug most frequently injected, male-to-male sex in the previous 12 months, unprotected non-concordant sex at last sexual contact, and self-reported HIV positive status (p≤ 10−5 in each case).

Discussion

Among the 16 variables we compared, we found significant differences between the NHBS-IDU1 and NHBS-IDU2 populations in two variables based on a criterion of non-overlapping RDSAT 95% confidence intervals: HIV testing in the past 3 months and self-reported HIV status. In a further six variables differences between the studies attained a significance of <10−3 in weighted logistic regression analyses: age, area of residence, drug most frequently injected, male-to-male sex in the previous 12 months, unprotected non-concordant sex, and HIV testing in the past 12 months. In our judgment the magnitude of the differences seen in these variables was sufficient to materially affect the characterization of the study population.

We found strikingly different levels of statistical significance in our data depending on whether evaluation was based on non-overlapping confidence intervals or weighted logistic regression. Recent publications are reporting findings based on both these methods.2024 The discrepancy between methods highlights an urgent need for the development of reliable methods to allow the use of the conventional statistical tools in RDS-recruited study populations. We suggest, however, that statistical measures, structured as they are to reject a difference between groups being compared in the absence of conclusive evidence to the contrary, do not provide a definitive guide to evaluating the comparisons of this study; rather, we use them to direct attention to the most divergent results.

Temporal trends could account for some of the differences we observed between NHBS surveys. The difference between NHBS-IDU1 and NHBS-IDU2 in the proportion of participants over 50 appears to be only partially accounted for by an overall increase in age among Seattle-area IDU. Differences in the proportion of MSM/IDU seem to be more a product of variability in the two RDS studies than of their accessing distinct populations. It is difficult to determine with confidence the role of temporal trends and variation in study populations play in the differences seen in HIV testing, given the more complicated temporal pattern among the different studies. Investigation of truly replicate RDS samples would require contemporaneous recruitment of parallel RDS-recruited study populations.

Differences in self-reported HIV-positive status between NHBS-IDU1 and NHBS-IDU2 were particularly pronounced. The number of IDU presumed to be living with HIV increased by 6% from 2005 to 2009,25 so the difference does not reflect a drastic rise in diagnosed HIV infections. The higher levels of HIV testing in NHBS-IDU1 is inconsistent with a hypothesis that their lower rate of self-reported HIV-positive status is a product of having a higher proportion of HIV-positives unaware of their status. NHBS-IDU2 participants were offered an HIV test while those in NHBS-IDU1 were not, so the difference in self-reported status could be a product of inaccurate reporting among participants not subject to HIV testing. Arguing against this is the observation that participants in both surveys self-reported considerable levels of other stigmatized behavior (sharing injection equipment, unprotected sex) and similar levels of HCV infection. In national NHBS data the proportion of IDU self-reporting HIV-positive status was actually somewhat higher in NHBS-IDU1 (8%) than in NHBS-IDU2 (5%).26;27 On the other hand, if the difference in self-reported status were a product of accessing distinctly different subpopulations of IDU in the two surveys, it is surprising that the difference is seen among both MSM/IDU and non-MSM/IDU, groups which appear to be substantially isolated from one another.

Two published reports, one surveying heterosexuals in Cape Town,23 the other among MSM in Beijing,28 found material differences between the populations surveyed at different time points, which the authors interpreted as evidence for changes over time. The possibility of variation attributable to RDS methodology is also worth consideration. The question has been raised by us and others whether RDS may access only a subset of a target population.12;29 Alternately, RDS-derived estimates of population characteristics may be statistically unbiased but still have such high variance that attaining estimates with adequate precision is difficult.8 It has been suggested that sample size calculations be multiplied by the magnitude of the design effect.18 Given the design effect of around three in our data, this would require that 1500 participants be surveyed rather than the 500 which had been calculated by CDC to have adequate power. Insofar as they do not reflect real change over time, we cannot distinguish in our data whether differences we observe between NHBS-IDU1 and -IDU2 are a product of intrinsically high variance or recruitment of only a limited subset of the target population. Both possibilities would substantially impact the utility of RDS methodology.

Alternatives to RDS recruitment have well recognized disadvantages. Venue-based and institutionally-based recruitment will not access members of the target population who do not frequent the points of recruitment. These biases are easy to understand, if not to satisfactorily adjust for. Inaccuracies in an RDS-derived population are less overt and may escape the attention of researchers. Nonetheless, RDS offers the opportunity to access hidden populations. It has clear advantages in the simplicity and standardization of its methods, and is particularly advantageous in environments where researchers have limited prior knowledge of how to access a target population. We do not by any means conclude that our data suggest that RDS methodology is fatally flawed, but rather urge that its advantages and disadvantages continue to be realistically evaluated and weighed against those of alternative recruitment methods.

Supplementary Material

01

Supplemental Table S1. RDS measures for sociodemographic characteristics; among Seattle participants in the 2009 NHBS-IDU2 survey

Supplemental Table S2. RDS measures for sexual, drug-associated and HIV- and HCV-related variables in the Seattle area NHBS-IDU2 population

Acknowledgments

Funding for this research came from a grant from the National Institutes of Health (1 R03 DA031072-01A1) and a cooperative agreement with the Centers for Disease Control and Prevention (U62/CCU006260). The contents are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Reference List

  • 1.Magnani R, Sabin K, Saidel T, Heckathorn D. Review of sampling hard-to-reach and hidden populations for HIV surveillance. AIDS. 2005;19 (Suppl 2):S67–S72. doi: 10.1097/01.aids.0000172879.20628.e1. [DOI] [PubMed] [Google Scholar]
  • 2.Semaan S, Lauby J, Liebman J. Street and network sampling in evaluation studies of HIV risk-reduction interventions. AIDS Rev. 2002;4:213–23. [PubMed] [Google Scholar]
  • 3.Heckathorn DD. Respondent-driven sampling: A new approach to the study of hidden populations. Social Problems. 1997;44:174–99. [Google Scholar]
  • 4.Heckathorn DD. Respondent-driven sampling II: Deriving valid population estimates from chain-referral samples of hidden populations. Social Problems. 2002;29:11–34. [Google Scholar]
  • 5.Salganik M, Heckathorn DD. Sampling and estimation in hidden populations using respondent-driven sampling. Sociological Methodology. 2004;34:193–240. [Google Scholar]
  • 6.Volz E, Heckathorn DD. Probability based estimation theory for respondent driven sampling. J of Official Statistics. 2011;24:79–97. [Google Scholar]
  • 7.Gile KJ, Handcock MS. Respondent-driven sampling: An assessment of current methodology. Sociological Methodology. 2010 doi: 10.1111/j.1467-9531.2010.01223.x. Published on-line. Available at: http://arxiv.org/PS_cache/arxiv/pdf/0904/0904.1855v1.pdf. [DOI] [PMC free article] [PubMed]
  • 8.Goel S, Salganik MJ. Assessing respondent-driven sampling. Proc Natl Acad Sci U S A. 2010;107:6743–7. doi: 10.1073/pnas.1000261107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Lu X, Bengtsson L, Britton T, Camitz M, Kim VJ, Thorson A, et al. The sensitivity of respondent-driven sampling method. 2010 Available on line at ArXiv.ogr. [Google Scholar]
  • 10.Lansky A, Abdul-Quader AS, Cribbin M, Hall T, Finlayson TJ, Garfein RS, et al. Developing an HIV behavioral surveillance system for injecting drug users: the National HIV Behavioral Surveillance System. Public Health Rep. 2007;122 (Suppl 1):48–55. doi: 10.1177/00333549071220S108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lansky A, Drake A, Pham H. HIV-associated behaviors among injecting-drug users--23 Cities, United States, May 2005-February 2006. MMWR Morb Mortal Wkly Rep. 2009;58:329–32. [PubMed] [Google Scholar]
  • 12.Burt RD, Hagan H, Sabin K, Thiede H. Evaluating respondent-driven sampling in a major metropolitan area: Comparing injection drug users in the 2005 Seattle area national HIV behavioral surveillance system survey with participants in the RAVEN and Kiwi studies. Ann Epidemiol. 2010;20:159–67. doi: 10.1016/j.annepidem.2009.10.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Heckathorn DD, Semaan S, Broadhead RS, Hughes J. Extensions of respondent-driven sampling: A new approach to the study of injection drug users aged 18–25. AIDS and Behavior. 2002;6:55–67. [Google Scholar]
  • 14.Hagan H, McGough JP, Thiede H, Weiss NS, Hopkins S, Alexander ER. Syringe exchange and risk of infection with hepatitis B and C viruses. Am J Epidemiol. 1999;149:203–13. doi: 10.1093/oxfordjournals.aje.a009792. [DOI] [PubMed] [Google Scholar]
  • 15.Thiede H, Romero M, Bordelon K, Hagan H, Murrill CS. Using a jail-based survey to monitor HIV and risk behaviors among Seattle area injection drug users. J Urban Health. 2001;78:264–78. doi: 10.1093/jurban/78.2.264. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Jenkins LM, Banta-Green CJ, Maynard D, Kingston S, Hanrahan M, Merrill JO, et al. Risk factors for nonfatal overdose at Seattle-area syringe exchanges. J Urban Health. 2012;88:118–28. doi: 10.1007/s11524-010-9525-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Volz E, Wejnert C, Degani I, Heckathorn DD. Respondent-Driven Sampling Analysis Tool (RDSAT) Version 5.6. Ithaca, NY: Cornel University; 2007. [Google Scholar]
  • 18.Salganik MJ. Variance estimation, design effects, and sample size calculations for respondent-driven sampling. J Urban Health. 2006;83:i98–112. doi: 10.1007/s11524-006-9106-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.SPSS version 14. SPSS; Chicago, IL: 2004. [Google Scholar]
  • 20.Kajubi P, Kamya MR, Raymond HF, Chen S, Rutherford GW, Mandel JS, et al. Gay and bisexual men in Kampala, Uganda. AIDS Behav. 2008;12:492–504. doi: 10.1007/s10461-007-9323-7. [DOI] [PubMed] [Google Scholar]
  • 21.King WD, Larkins S, Hucks-Ortiz C, Wang PC, Gorbach PM, Veniegas R, et al. Factors Associated with HIV Viral Load in a Respondent Driven Sample in Los Angeles. AIDS Behav. 2009;13:145–53. doi: 10.1007/s10461-007-9337-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Kral AH, Malekinejad M, Vaudrey J, Martinez AN, Lorvick J, McFarland W, et al. Comparing respondent-driven sampling and targeted sampling methods of recruiting injection drug users in San Francisco. J Urban Health. 2010;87:839–50. doi: 10.1007/s11524-010-9486-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Townsend L, Johnston LG, Flisher AJ, Mathews C, Zembe Y. Effectiveness of respondent-driven sampling to recruit high risk heterosexual men who have multiple female sexual partners: differences in HIV prevalence and sexual risk behaviours measured at two time points. AIDS Behav. 2010;14:1330–9. doi: 10.1007/s10461-010-9753-5. [DOI] [PubMed] [Google Scholar]
  • 24.Zhong F, Lin P, Xu H, Wang Y, Wang M, He Q, et al. Possible Increase in HIV and Syphilis Prevalence Among Men Who Have Sex with Men in Guangzhou, China: Results from a Respondent-Driven Sampling Survey. AIDS Behav. 2011;15:1058–66. doi: 10.1007/s10461-009-9619-x. [DOI] [PubMed] [Google Scholar]
  • 25.HIV/AIDS Epidemiology Unit. Public Health - Seattle & King County and the Infectious Disease and Reproductive Health Assessment Unit. Washington State Department of Health. HIV/AIDS Epidemiology Report, 1st half ‘11. 2011 Available at: http://www.kingcounty.gov/healthservices/health/communicable/hiv/epi/reports.aspx.
  • 26.Centers for Disease Control and Prevention. Risk, prevention and testing behaviors related to HIV and hepatitis infections - National HIV Behavioral Surveillance System: Injecting drug users, May 2005 - February 2006. HIV Special Surveillance Report 7. 2011 Available at: http://www.cdc.gov/hiv/topics/surveillance/resources/reports/#supplemental.
  • 27.Oster AM, Finlayson TJ, Sionean C, Miles IW, Hageman K, Smith A, et al. Monitoring HIV risk: Findings from the National HIV Behavioral Surveillance System, 2008–2010. Presented at: National HIV Prevention Conference; Atlanta GA. 2011. [Google Scholar]
  • 28.Ma X, Zhang Q, He X, Sun W, Yue H, Chen S, et al. Trends in prevalence of HIV, syphilis, hepatitis C, hepatitis B, and sexual risk behavior among men who have sex with men. Results of 3 consecutive respondent-driven sampling surveys in Beijing, 2004 through 2006. J Acquir Immune Defic Syndr. 2007;45:581–7. doi: 10.1097/QAI.0b013e31811eadbc. [DOI] [PubMed] [Google Scholar]
  • 29.Rudolph AE, Crawford ND, Latkin C, Heimer R, Benjamin EO, Jones KC, et al. Subpopulations of illicit drug users reached by targeted street outreach and respondent-driven sampling strategies: implications for research and public health practice. Ann Epidemiol. 2011;21:280–289. doi: 10.1016/j.annepidem.2010.11.007. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

01

Supplemental Table S1. RDS measures for sociodemographic characteristics; among Seattle participants in the 2009 NHBS-IDU2 survey

Supplemental Table S2. RDS measures for sexual, drug-associated and HIV- and HCV-related variables in the Seattle area NHBS-IDU2 population

RESOURCES