Abstract
Background
Among people who inject drugs (PWID), obtaining syringes via syringe services programs (SSPs) and pharmacies reduces injection sharing practices associated with hepatitis C virus (HCV). Whether indirect use of SSPs via secondary exchange confers a similar benefit remains unknown, particularly in rural settings. We compared HCV serostatus and injection sharing practices by primary syringe source among a sample of rural PWID.
Methods
Data are from a cross-sectional study of adults who use drugs recruited from eleven rural counties in New Hampshire, Vermont, and Massachusetts using respondent-driven sampling (2018–2019). Study staff performed HCV antibody testing. An audio computer-assisted self-interview assessed sociodemographic characteristics, past 30-day injection practices, and past 30-day primary syringe source. Primary syringe source was classified as direct SSP, pharmacy, indirect SSP (secondary exchange), or “other” (friend/acquaintance, street seller, partner/relative, found them). Mixed effects modified Poisson models assessed the association of primary syringe source with HCV seroprevalence and injection sharing practices.
Results
Among 397 PWID, the most common primary syringe source was “other” (33%), then pharmacies (27%), SSPs (22%), and secondary exchange (18%). In multivariable models, compared with those obtaining most syringes from “other” sources, those obtaining most syringes from pharmacies had a lower HCV seroprevalence [adjusted prevalence ratio (APR):0.85, 95% confidence interval (CI) 0.73–0.9985]; however, the upper bound of the 95% CI was close to 1.0. Compared with those obtaining most syringes from other sources, PWID obtaining most syringes directly from SSPs or pharmacies were less likely to report borrowing used syringes [APR(SSP):0.60, 95% CI 0.43–0.85 and APR(Pharmacies):0.70, 95% CI 0.52–0.93], borrowing used injection equipment [APR(SSP):0.59, 95% CI 0.50–0.69 and APR (Pharmacies):0.81, 95% CI 0.68–0.98], and backloading [APR(SSP):0.65, 95% CI 0.48–0.88 and APR(Pharmacies):0.78, 95% CI 0.67–0.91]. Potential inverse associations between obtaining most syringes via secondary exchange and injection sharing practices did not reach the threshold for statistical significance.
Conclusions
PWID in rural New England largely relied on informal syringe sources (i.e., secondary exchange or sources besides SSPs/pharmacies). Those obtaining most syringes from an SSP or pharmacy were less likely to share injection equipment/syringes and had a lower HCV seroprevalence, which suggests using these sources reduces the risk of new HCV infections or serves as proxy for past injection behavior.
Supplementary Information
The online version contains supplementary material available at 10.1186/s13722-022-00358-7.
Keywords: Rural, Secondary exchange, Syringe services programs, Pharmacy, Hepatitis C virus
Background
The opioid crisis in the United States has fueled a surge in injection drug use and new hepatitis C virus (HCV) infections. Between 2010 and 2019, the number of new HCV infections in the U.S. increased by 387% [1], driven primarily by a rise in injection drug use and related injection practices shown to be associated with acquiring HCV. These include sharing syringes or other injection equipment (e.g., cookers and cottons), and backloading (injecting drugs that someone else prepared, mixed, or divided with a used syringe) [2–4]. In rural communities, new HCV infections have occurred disproportionately among people who inject drugs (PWID) aged ≤ 30 years [5, 6].
In most states, syringe services programs (SSPs) and the nonprescription sale of syringes in pharmacies serve as important interventions to reduce transmission of bloodborne pathogens [7–9]. Studies show reductions in injection sharing practices and HIV transmission among PWID who obtain syringes from SSPs and purchase syringes in pharmacies [10–12], although the evidence for whether using these services reduces HCV transmission remains mixed [10]. Given HCV has greater transmissibility through percutaneous blood exposure compared to HIV, it is unclear whether SSPs and pharmacy syringe sales sufficiently reduce injection sharing practices to a level that lowers the risk of HCV transmission, with some studies suggesting this may depend in part on geographic context [13]. In New England, brick-and-mortar and mobile SSPs are available in some rural areas, but access is often limited by geographic proximity and limited hours of operation, with variation across states.
People who use SSPs commonly extend the indirect reach of these programs through secondary syringe exchange, a practice whereby an individual obtains syringes from an SSP and distributes them to others in their social network [14]. Secondary syringe exchange is common in the urban settings where the phenomenon has been studied [15–17]. However, it remains unclear whether indirect SSP use via secondary exchange offers similar benefits as direct SSP use. Previous studies have not assessed the impact of indirect SSP use on HCV serostatus nor injection sharing practices among rural PWID. Given limited access to formal syringe sources in rural communities [18], it is important to assess whether indirect SSP use among PWID who live in rural parts of the U.S. confers similar reductions in HCV-associated behaviors as it does for those who use SSPs directly.
Using data from the Drug Injection Surveillance and Care Enhancement for Rural Northern New England (DISCERNNE) study, we examined the association of primary syringe source (e.g., SSP, secondary exchange, pharmacy, other sources) with HCV serostatus. A secondary goal was to examine the relationship between primary syringe sources and three injection sharing practices: borrowing used syringes, borrowing used injection equipment, and backloading.
Methods
Data source
Data for this investigation were collected as part of the DISCERNNE study, a multi-site, mixed-methods cross-sectional study conducted in 11 rural counties along the Connecticut River Valley in New Hampshire (NH), Vermont (VT), and Massachusetts (MA). The overall goal of DISCERNNE was to characterize the risk environment and epidemiology of overdose and injection-mediated infectious diseases among rural PWID. Further study details and findings from the DISCERNNE study have been published elsewhere [19–21].
Study participants
Participants were eligible for DISCERNNE if they: (1) were 18 years or older, (2) spent most of the last 30 days living in the study area, (3) used opioids “to get high” (i.e., via any mode of administration) or injected any drug in the last 30 days, and (4) were able to provide written informed consent. We recruited participants at 11 study sites that were chosen after consulting local public health officials, service providers, and harm reduction experts. Study staff recruited participants between May 2018 and October 2019 using respondent-driven sampling (RDS), a chain referral sampling method used to recruit difficult-to-reach populations [22, 23]. Staff recruited RDS seeds (i.e., original participants who serve as initial recruiters) through street outreach and at harm reduction agencies. Once a seed completed the study survey, they were given three unique coupons to refer eligible peers to the study. Recruited peers who participated in the study were given their own set of coupons, and this sampling process continued through multiple waves until the desired sample size was reached. Participants received $10 for each recruited peer who met eligibility criteria and completed the study survey. Participants who successfully recruited 3 eligible peers were offered up to six additional peer-referral coupons. Fifty-one seeds generated a total of 589 survey participants. The present analysis was limited to the 456 participants (77% of total sample) who reported injecting any drug in the past 30 days; individuals were further excluded for having incomplete information on HCV serostatus (n = 31) and primary syringe source (n = 28), resulting in a final analytical sample of 397 PWID. The Baystate Health Institutional Review Board approved the study protocol.
Data collection
Participants completed a 90-min audio computer-assisted self-interview (ACASI) on touch-screen laptops. The use of ACASI has been shown to enhance perceived confidentiality and increase accurate reporting of sensitive behaviors, including substance use [24, 25]. The ACASI collected self-reported information on sociodemographic characteristics, criminal justice involvement, substance use (lifetime, past 30 days), overdose history, injection and sex behaviors (past 30 days), primary source of syringes (past 30 days), any use of SSPs and pharmacies (past 30 days), substance use treatment (lifetime, past 30 days), healthcare utilization, current mental health, and infectious disease history. Trained staff tested participants for HCV antibodies using the OraQuick HCV rapid antibody test [26]. Participants were compensated $40 for completing the ACASI and infectious disease testing.
Measures
Primary syringe source
We assessed participants’ primary syringe source with the question: “During the last 30 days, where have you gotten most of your syringes or needles?” Response options included (1) a “syringe or needle exchange program, in person” (i.e., directly from an SSP), (2) “from someone else who got them from a syringe or needle exchange program” (i.e., secondary exchange), (3) a “pharmacy”, or (4) some other syringe source (a “friend or acquaintance”; “drug dealer or street syringe seller”; “spouse, partner, or relative”; or they “found” their syringes). In our primary analysis, “other” sources served as the reference category. To directly compare those obtaining most syringes from pharmacies with those obtaining most syringes from SSPs on both primary and secondary outcomes, we conducted a supplementary analysis using SSP as the referent category.
HCV serostatus and injection sharing practices
The primary outcome of interest was HCV serostatus. Participants were considered HCV seropositive if they had a positive rapid HCV antibody test. HCV-RNA testing was not performed. Secondary outcomes included the following past 30-day injection sharing practices: borrowing used syringes (using a syringe known to have been used by someone else), borrowing other used injection equipment (using a cotton, cooker, or water for rinsing/mixing known to have been used by someone else), and backloading (injecting drugs that someone else prepared, mixed, or divided with a used syringe).
Potential confounding variables
We selected several potentially confounding variables using the disjunctive cause criterion, which proposes that sufficient control for confounding can be achieved by adjusting for variables that cause the exposure, outcome, or both, and excluding variables known to be instrumental variables [27, 28]. Informed by the existing literature [29–35], we controlled for the following variables in our models: age (years); gender (male, female); race (White, non-White); sexual orientation (heterosexual, bisexual/homosexual/other); incarceration within the past 6 months (yes/no); homelessness within the past 6 months (yes/no); years injecting (continuous); injection frequency in the past 30 days (at least once a day, less than daily); injecting multiple times per sitting within the past 30 days (yes/no); injecting heroin (yes/no), cocaine (yes/no), methamphetamine (yes/no), or simultaneous injection of opioid and stimulant (i.e., speedball or screwball) (yes/no) within the past 30 days, and receiving medications for opioid use disorder [MOUD] (ever, never).
Statistical analysis
We compared participant characteristics, HCV serostatus, and injection sharing practices for those obtaining most syringes directly from SSPs, indirectly through SSPs, from pharmacies, or from other sources using chi-square tests and ANOVA for discrete and continuous variables, respectively. Descriptive statistics were not weighted to account for RDS, and therefore should not be interpreted as population-based estimates. We used multivariable mixed effects modified Poisson regressions to model the relationship between primary syringe source and our primary and secondary outcomes. Mixed effects models accounted for the lack of independence among participants within study sites with a random intercept for study site. Modified Poisson models allow for the direct estimation of prevalence ratios for common binary outcomes [36, 37]. We included all potential confounders described previously in our final multivariable models. We performed a sensitivity analysis using an alternative model building approach; we used bivariate analyses to screen our initial list of potential confounders, including covariates in our final model if they had a bivariate association with the respective outcome at a level of P < 0.10. We analyzed the data using a complete case analysis approach, excluding participants from our regression models if they were missing data on any variables. We assessed multicollinearity using variance inflation factors (VIFs) and did not find it to be a problem as no VIF exceeded 2.0. All analyses were performed using Stata version 14.2 (Stata Corp LP, College Station, TX, USA).
Results
Participants in the analytic sample were predominantly male (58%), White (93%), injected heroin in the past 30 days (92%), and reported injecting drugs at least daily (59%) in the past 30 days (Table 1). Although not included in Table 1, a majority (63%) reported injecting “street fentanyl or carfentanil powder” in the past 30 days, of whom, 97% also reported injecting heroin. More than half (58%) reported homelessness in the past 6 months. The median age of participants was 33 years (IQR: 28–40) and the median number of years injecting drugs was 9 years (IQR: 5–15). Almost three-quarters of participants (73%) tested positive for HCV antibodies. Nearly one-half (49%) reported borrowing used syringes, while approximately six out of 10 (59%) reported borrowing other used injection equipment, and almost half (48%) reported backloading in the past 30 days.
Table 1.
Characteristic | Direct SSP (n = 89) | Pharmacy (n = 106) | Indirect SSP (n = 72) | Other Sources (n = 130) |
---|---|---|---|---|
Sociodemographics-% | ||||
Female | 36 | 33 | 44 | 51 |
Age (years)-median (IQR) | 36 (30–42) | 31 (28–39) | 34 (28–41) | 33 (27–40) |
Race: White | 92 | 93 | 93 | 92 |
Sexual orientation: bisexual/homosexual/othera | 17 | 16 | 17 | 19 |
High school education or higher | 81 | 69 | 74 | 72 |
Employment: Full/part-time | 34 | 45 | 29 | 30 |
Experienced homelessness (past 6 months) | 55 | 56 | 57 | 62 |
Criminal justice involvement-% | ||||
Incarcerated (past 6 months) | 23 | 31 | 28 | 39 |
Injection drug use-% | ||||
Years injecting-median (IQR) | 9 (4–16.5) | 9 (4–14.5) | 8 (5–16) | 10 (5–14) |
Inject at least daily (past 30 days) | 75 | 66 | 65 | 46 |
Inject multiple times per sitting (past 30 days) | 81 | 84 | 79 | 73 |
Inject heroin (past 30 days) | 94 | 94 | 90 | 89 |
Inject cocaine (past 30 days) | 52 | 55 | 58 | 47 |
Inject methamphetamine (past 30 days) | 19 | 25 | 39 | 26 |
Inject speedball or screwball (past 30 days) | 37 | 36 | 43 | 29 |
Addiction treatment-% | ||||
Ever received MOUD | 76 | 75 | 75 | 73 |
Infectious disease-% | ||||
HCV seropositive | 71 | 69 | 75 | 77 |
Injection sharing practices-% | ||||
Borrow used syringes (past 30 days) | 34 | 43 | 50 | 65 |
Borrow other used injection equipment (past 30 days) | 39 | 59 | 63 | 69 |
Backloading (past 30 days) | 33 | 43 | 50 | 61 |
SSP = syringe services program; MOUD = medications for opioid use disorder; HCV = hepatitis C virus Antibody positive
Chi-square tests were used for categorical variables, ANOVA was used for continuous variables
aMost PWID in the “bisexual/homosexual/other” category identified as bisexual (88.4%)
With respect to primary syringe source in the past 30 days, 22% reported obtaining most of their syringes directly from an SSP (direct SSP), 27% from a pharmacy, and 18% from someone else who got them from an SSP (indirect SSP). The remaining 33% of participants reported obtaining most of their syringes in the past 30 days from other sources. Among these PWID, primary syringe sources included friends and acquaintances (56%), a drug dealer or street syringe seller (25%), a spouse, partner, or family member (16%), and finding them (3%). A majority of PWID who reported obtaining most syringes directly from SSPs (76%) used no other syringe source; similarly, 86% of those who obtained most syringes from a pharmacy used no other source, and 61% of those who obtained most syringes indirectly from SSPs used no other source. Among those who obtained most syringes from “other” sources, 22% obtained syringes from SSPs (directly or indirectly) or a pharmacy at least once in the past 30 days.
Those obtaining most syringes from “other” sources were more likely to be female than those getting most syringes directly from SSPs, at pharmacies, or indirectly from SSPs (Table 1). Three quarters of those directly using SSPs reported injecting daily, compared with 66% of those who acquired most syringes from pharmacies, 65% of those acquiring syringes indirectly from SSPs, and 46% of those using other sources. Past-month injection of methamphetamine alone was less common than heroin, cocaine, or speedball/screwball injection, but was highest among those obtaining syringes indirectly from SSPs (39%), followed by those getting syringes from other sources (26%), pharmacies (25%), and directly from SSPs (19%). Those obtaining most syringes from other sources were most likely to report borrowing used syringes, borrowing used injection equipment, and backloading, followed by those indirectly acquiring syringes via SSPs, in pharmacies, and directly from SSPs.
In the final mixed effects modified Poisson adjusted model for HCV seroprevalence (Table 2), compared with those getting most syringes from other sources, those who obtained most syringes from pharmacies had a 15% lower HCV seroprevalence (APR: 0.85, 95% CI 0.73–1.00) and those who obtained most syringes directly from SSPs had an 11% lower HCV seroprevalence (APR: 0.89, 95% CI 0.75–1.04) (Table 2). However, the HCV seroprevalence was not statistically significantly different for those who obtained most syringes indirectly via SSPs vs. from other sources.
Table 2.
Primary Syringe Source (Past 30 days) | Crude PR (95% CI) | Adjusted PRa,b (95% CI) |
---|---|---|
Direct SSP | 0.92 (0.76–1.12) | 0.89 (0.75–1.04) |
Pharmacy | 0.90 (0.79–1.02) | 0.85 (0.73–1.00) |
Indirect SSP | 0.98 (0.83–1.15) | 0.96 (0.82–1.13) |
Other Source | reference | reference |
PR Prevalence ratio; CI Confidence interval
aAdjusted for age, gender, race, sexual orientation, incarceration, homelessness, years injecting, injection frequency, inject multiple times per sitting, inject heroin, inject cocaine, inject meth, inject speedball/screwball, ever received medication for opioid use disorder
bn = 375
In the final multivariable adjusted models for injection sharing practices (Table 3), compared with those who obtained most syringes from other sources, those who obtained most syringes directly from SSPs were significantly less likely to report borrowing used syringes (APR:0.60; 95% CI 0.43–0.85), borrowing used injection equipment (APR:0.59; 95% CI 0.50–0.69), and backloading (APR:0.65; 95% CI 0.48–0.88). Similarly, compared with those who obtained most syringes from “other” sources, those who obtained most syringes from pharmacies were significantly less likely to report borrowing used syringes (APR:0.70; 95% CI 0.52–0.93), borrowing used injection equipment (APR:0.81; 95% CI 0.68–0.98), and backloading (APR:0.78; 95% CI 0.67–0.91). Obtaining most syringes indirectly from SSPs was negatively associated with each injection sharing practice, but these associations were weak and imprecise. When using those who obtained most syringes directly from SSPs as the reference group, those who obtained most syringes from pharmacies were more likely to report borrowing used syringes, borrowing used injection equipment, and backloading. However, only the association with borrowing used injection equipment was statistically significant (APR:1.38; 95% CI 1.17–1.62) (Additional File 1: Table S1).
Table 3.
Primary syringe source (Past 30 days) | Borrowed used syringes (past 30 days) | Borrowed used injection equipment (past 30 days) | Backloading (past 30 days) | |||
---|---|---|---|---|---|---|
Crude PR (95% CI) | Adjusted PRa,b (95% CI) | Crude PR (95% CI) | Adjusted PRa,c (95% CI) | Crude PR (95% CI) | Adjusted PRa,d (95% CI) | |
Direct SSP | 0.62 (0.44–0.86) | 0.60 (0.43–0.85) | 0.63 (0.54–0.73) | 0.59 (0.50–0.69) | 0.62 (0.48–0.81) | 0.65 (0.48–0.88) |
Pharmacy | 0.70 (0.49–1.01) | 0.70 (0.52–0.93) | 0.86 (0.69–1.07) | 0.81 (0.68–0.98) | 0.74 (0.60–0.90) | 0.78 (0.67–0.91) |
Indirect SSP | 0.89 (0.60–1.31) | 0.89 (0.62–1.28) | 0.96 (0.70–1.32) | 0.91 (0.64–1.27) | 0.92 (0.69–1.23) | 0.92 (0.72–1.17) |
Other source | Reference | Reference | Reference | Reference | Reference | Reference |
PR prevalence ratio; CI confidence interval
aAdjusted for age, gender, race, sexual orientation, incarceration, homelessness, years injecting, injection frequency, inject multiple times per sitting, inject heroin, inject cocaine, inject meth, inject speedball/screwball, ever received medication for opioid use disorder
bn = 372
cn = 373
dn = 375
We performed a sensitivity analysis using an alternative model building approach (bivariate screening). The results from this approach were not appreciably different from our initial results, with no change in the overall conclusions (Additional File 1: Tables S2 and S3).
Discussion
In our sample of PWID from rural New England in the United States, we found 22% of participants obtained most of their syringes directly from an SSP, 27% from a pharmacy, 18% indirectly from an SSP via secondary syringe exchange, and the remaining 33% from other sources. Compared with the use of other sources, indirect SSP use was not meaningfully associated with HCV seroprevalence and was only weakly and imprecisely associated with a lower prevalence of injection sharing practices. In contrast, obtaining most syringes from pharmacies or directly from SSPs were each modestly associated with lower HCV seroprevalence and strongly associated with a lower risk of borrowing used syringes, borrowing used injection equipment, and backloading.
Secondary syringe exchange was relatively common in our sample of rural PWID. It is difficult to compare the prevalence of secondary exchange in our study with that of previous studies since those engaging in secondary exchange were defined differently across studies. However, the proportion of PWID in our study who exclusively obtained syringes via secondary exchange (11%) was much higher than that reported in previous studies among urban PWID (1.4–4.3%) [15, 38]. Urban PWIDs’ greater access to SSPs could explain this difference [18], as they may not need to rely as frequently on secondary exchange to acquire clean syringes. Research shows that urban participants who acquire syringes via secondary exchange cite inconvenient locations and hours as major barriers to direct SSP use [39]. Scarcity in terms of limited local access and limited hours of operation at formal SSPs may be more salient to the use of secondary syringe exchange in rural areas. At the time of this study, only five brick-and-mortar SSPs were operating in the 11-county study region: four across six VT counties, one in the sole MA county, and zero across four NH counties. Although the SSP in the rural MA county had operating hours comparable to SSPs in larger MA cities, the four SSPs in VT were only open once or twice per week for a total of three to eight hours. (In contrast, the SSP in VT’s largest city is open five days a week for a total of 35 h.) In terms of pharmacy syringe access, MA, NH, and VT all permit the nonprescription sale of syringes in pharmacies, but participation is optional. Although nonprescription syringe sales are available in nearly all MA pharmacies [40], recent qualitative research suggests PWID in rural NH experience very limited in-state pharmacy syringe access [41]. Given the majority (59%) of PWID in our study reported injecting drugs at least daily, having a clean syringe for each injection would require regular access to a large number of syringes. Our findings suggest that secondary syringe exchange is an important source of clean syringes among rural PWID in northern New England.
Although indirect use of SSPs was not associated with HCV seroprevalence, pharmacy use and direct SSP use were modestly correlated with lower HCV seroprevalence compared with using “other” syringe sources. Rural PWID who obtained most of their syringes from a pharmacy had a 15% lower prevalence of HCV antibodies compared with those who obtained most syringes from other sources; however, the upper bound of the 95% confidence interval was very close to 1.0, which suggests our findings may also be compatible with no significant difference. Previous reviews and meta-analyses have found inconsistent evidence that pharmacy syringe sales or SSPs reduce HCV incidence or prevalence [10, 42–44]. The literature is especially sparse for pharmacy syringe sales, with very few studies including HCV incidence or prevalence as an outcome [44]. Our study adds to the existing literature by examining the relationship between primary syringe source and HCV seroprevalence in a rural setting. While not definitive, our results suggest that obtaining syringes from a pharmacy or SSP may reduce the risk of HCV infection among rural PWIDs. However, since HCV seroprevalence alone (measured via antibodies) cannot differentiate between incident, prevalent, or resolved infection, we cannot ascertain the temporal relationship between exposure and disease. It is possible that participants were infected with HCV before they began obtaining syringes from their reported primary source.
Consistent with a large body of research in urban settings [10, 42, 43], we observed that acquiring most syringes from pharmacies or directly through SSPs was associated with a lower risk of borrowing used syringes and other injection equipment, and backloading among rural PWID. Obtaining most syringes directly from an SSP appears to have a greater impact on injection sharing practices than obtaining most syringes from a pharmacy. Compared to obtaining most syringes directly from an SSP, obtaining most syringes from a pharmacy was associated with a 16% higher risk of borrowing used syringes and a 38% higher risk of borrowing used injection equipment, although only the latter was statistically significant. This makes sense, given that SSPs and pharmacies both provide syringes, but only SSPs provide other injection equipment (e.g., cotton filters, cookers, rinse water) as well as harm reduction education, testing, and referrals. Additionally, although direct SSP use and pharmacy use were similarly associated with borrowing used syringes, syringes are typically available at no cost from SSPs, whereas they must be purchased from pharmacies. This may result in greater access to sterile syringes for those who obtained most syringes from SSPs. In our rural sample, the sociodemographic characteristics of those who obtained most of their syringes from pharmacies were not significantly different from those who obtained most of their syringes from SSPs. Of note, other studies in urban settings have reported differences in sociodemographic characteristics by primary syringe source [45, 46]. It is possible that in urban settings, the demographics are more heterogeneous, so differences are more likely to be observed. For example, the sample in our study is fairly homogeneous in terms of race and ethnicity.
Although the associations observed between acquiring most syringes through secondary exchange (vs. other sources) and each of the injection sharing practices were in the anticipated direction, these associations were weak and imprecise. These results differ from two previous studies conducted in three urban U.S. cities, which observed stronger associations between indirect SSP use and injection sharing practices [15, 38]. Several factors may explain the differences between our findings and those of previous studies. The first study, conducted in Chicago, used a more inclusive definition for indirect SSP use. Our study defined indirect SSP use as obtaining most syringes in the past 30 days from someone else who got them from an SSP. In contrast, the Chicago study defined their group of “mixed/secondary exchangers” as PWID who, in the past 6 months, obtained at least some needles indirectly from an SSP through other persons [15]. Only 5% of these mixed/secondary exchangers exclusively obtained syringes via secondary exchange (compared with 61% of those in our analysis), with the remaining 95% reporting getting syringes directly from an SSP at least once in the past 6 months. This level of mixed indirect and direct SSP use may have accounted for the strong negative association observed between mixed/secondary exchange and borrowing used syringes. In the second study, the authors explain their results may not be generalizable to other PWID populations given their study was conducted in an area with an unconventional SSP that delivered syringes directly to clients’ homes with no limit on the number of syringes exchanged [38]. Given the increased opportunity for direct SSP use, PWID relying on secondary exchange may have had better access to SSP clients, thus increasing their likelihood of fully meeting their syringe needs via secondary exchange.
Nevertheless, our findings should not be interpreted to mean that secondary syringe exchange should be discouraged in rural settings. First, strong evidence supports that secondary exchange increases the number of people served by SSPs by reaching PWID who are unable or unwilling to attend an SSP in person. In previous U.S. studies in urban settings, PWID who participated in secondary exchange reported fear of exposure, fear of police harassment, and inconvenient SSP locations and hours as major barriers to attending SSPs [14, 39]. Secondary exchange through one’s peer network effectively overcomes these barriers. Indeed, in our analysis, compared with those getting syringes directly from SSPs, those using SSPs indirectly were more likely to be female or to have been recently incarcerated, two populations shown to have fears of negative consequences from SSP participation [47–50]. Second, existing secondary exchange networks could serve as the basis for peer-based interventions among rural PWID. PWID who obtain syringes via secondary exchange do not receive the many ancillary services available at SSPs, which may explain why direct SSP use was strongly associated with reduced injection sharing practices while indirect SSP use was not. Therefore, training peer exchangers to deliver harm reduction messages and some of the ancillary services (e.g., facilitate referrals) might enhance the effectiveness of secondary exchange to reduce injection sharing practices and HCV prevalence. Peer-based interventions leveraging existing secondary exchange networks have been shown to be effective in Canada, the Russian Federation, and China [51–53].
This study has several limitations. First, the data are cross-sectional, which precludes statements about causality. Second, as previously mentioned, the study did not include HCV-RNA testing, so our seroprevalence data cannot differentiate between incident, prevalent, or resolved infection. The relatively high HCV seroprevalence (73%) in our sample suggests many of these cases may have developed long before we measured participants’ primary syringe source, and perhaps even before SSPs or nonprescription pharmacy syringe sales were available in the study area. Therefore, the modest and non-significant associations across primary syringe sources do not necessarily mean that those currently obtaining syringes from SSPs and pharmacies will not be less likely to develop a new HCV infection in the future. Given SSP and pharmacy use were negatively associated with injection sharing practices, we may have observed stronger protective associations between these syringe sources and HCV had we been able to focus on incident infections. Future research among rural PWID should include HCV-RNA testing to better assess the relationship between syringe source and HCV infection. Third, given the sample size, the analysis had limited power to detect differences in associations across the primary syringe source groups. Fourth, the self-reported data for primary syringe source creates the potential for social desirability bias. Previous research suggests, however, the use of ACASI may diminish socially desirable responses to sensitive questions [54].
Our measure of participants’ primary syringe source over the past 30 days is also subject to misclassification. For instance, although we classified friends, spouses, relatives and street sellers as “other” syringe sources, it is possible the PWID in our sample did not know the original source of the syringes obtained from others. If many of these syringes originally came from SSPs, then we have underestimated the number of individuals acquiring syringes indirectly via SSPs in our sample. However, from the perspective of risk perception, a participant truly not knowing the original source of their syringe remains distinct from a participant knowing a peer is giving them a sterile syringe that was obtained from an SSP. In the former scenario, the participant is assuming greater risk of infection than the participant who knowingly obtains most syringes via secondary exchange.
Finally, although we used RDS for recruitment, because several key assumptions were not met, we did not use RDS weights [22, 55]. Therefore, as explained in the methods, our sample should be treated as a convenience rather than a representative sample. Despite these limitations, this analysis adds to the relatively small body of research on secondary syringe exchange and is among the first conducted among rural PWID in the U.S., a high-risk and understudied population.
Conclusion
Secondary syringe exchange is a common practice among PWID in the rural northeastern U.S. However, indirect SSP use was not associated with HCV seroprevalence and only weakly associated with injection sharing practices. Further research is needed to determine whether existing syringe exchange networks can be leveraged to deliver peer-based harm reduction interventions to rural PWID. Finally, these findings reaffirm the important role SSPs and pharmacies play in reducing injection sharing practices, and suggest their benefits might extend to reducing the risk of future HCV infections.
Supplementary Information
Acknowledgements
We wish to thank Randall Hoskinson, Elyse Bianchet, Patrick Dowd, Linda Kinney, and Sonia Gill for their contributions to study coordination, recruitment, and data collection. We are also grateful to the people who generously gave their time to participate in this study.
Abbreviations
- HCV
Hepatitis C virus
- PWID
People who inject drugs
- SSP
Syringe services program
- DISCERNNE
Drug Injection Surveillance and Care Enhancement for Rural Northern New England
- NH
New Hampshire
- VT
Vermont
- MA
Massachusetts
- RDS
Respondent-driven sampling
- ACASI
Audio computer-assisted self-interview
- MOUD
Medications for opioid use disorder
Author contributions
ER led the study conception and design, performed the statistical analysis, interpreted data, and prepared the initial draft of the manuscript. AER contributed to the study conception and design, interpretation of the data, and drafting of the manuscript. BW contributed to the study design and supervised the statistical analysis. BMJ contributed to the study design and interpretation of the data. TJS and PDF designed and supervised the parent DISCERNNE study and contributed to the design of the present study and interpretation of the data. All authors provided critical revision of the article for additional intellectual content. All authors read and approved the final manuscript.
Funding
This study was supported by the National Institute on Drug Abuse, the Centers for Disease Control and Prevention, the Substance Abuse and Mental Health Services Administration (SAMHSA), and the Appalachian Health Agency (1UG3DA044830 – PI: PDF; 1F31DA051198 – PI: ER).
Availability of data and materials
All data generated and analyzed during the current study are available from the corresponding author on reasonable request.
Declarations
Ethics approval and consent to participate
The Baystate Health Institutional Review Board approved the study protocol. Informed consent was collected for all participants in this study.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Viral Hepatitis Surveillance Report | CDC. 2019. https://www.cdc.gov/hepatitis/statistics/2019surveillance/index.htm. Accessed 15 Nov 2021.
- 2.Campbell CA, Canary L, Smith N, Teshale E, Ryerson AB, Ward JW. State HCV incidence and policies related to HCV preventive and treatment services for persons who inject drugs—United States, 2015–2016. MMWR Morb Mortal Wkly Rep. 2017;66:465–9. doi: 10.15585/mmwr.mm6618a2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Zibbell JE, Asher AK, Patel RC, Kupronis B, Iqbal K, Ward JW, et al. Increases in acute hepatitis C virus infection related to a growing opioid epidemic and associated injection drug use, United States, 2004 to 2014. Am J Public Health. 2018;108:175–81. doi: 10.2105/AJPH.2017.304132. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Pouget ER, Hagan H, Des Jarlais DC. Meta-analysis of hepatitis C seroconversion in relation to shared syringes and drug preparation equipment. Addiction NIH Public Access. 2012;107:1057–1065. doi: 10.1111/j.1360-0443.2011.03765.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Klevens RM, Hu DJ, Jiles R, Holmberg SD. Evolving epidemiology of hepatitis C virus in the United States. Clin Infect Dis. 2012;55(Suppl 1):S3–9. doi: 10.1093/cid/cis393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Zibbell JE, Iqbal K, Patel RC, Suryaprasad A, Sanders KJ, Moore-Moravian L, et al. Increases in hepatitis C virus infection related to injection drug use among persons aged ≤30 years—Kentucky, Tennessee, Virginia, and West Virginia, 2006–2012. MMWR Morb Mortal Wkly Rep. 2015;64:453–8. [PMC free article] [PubMed] [Google Scholar]
- 7.Valleroy LA, Weinstein B, Jones TS, Groseclose SL, Rolfs RT, Kassler WJ. Impact of increased legal access to needles and syringes on community pharmacies’ needle and syringe sales–Connecticut, 1992–1993. J Acquir Immune Defic Syndr Hum Retrovirol. 1995;10:73–81. doi: 10.1097/00042560-199509000-00011. [DOI] [PubMed] [Google Scholar]
- 8.Deibert RJ, Goldbaum G, Parker TR, Hagan H, Marks R, Hanrahan M, et al. Increased access to unrestricted pharmacy sales of syringes in Seattle-King County, Washington: structural and individual-level changes, 1996 versus 2003. Am J Public Health. 2006;96:1347–53. doi: 10.2105/AJPH.2003.032698. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Fuller CM, Ahern J, Vadnai L, Coffin PO, Galea S, Factor SH, et al. Impact of increased syringe access: preliminary findings on injection drug user syringe source, disposal, and pharmacy sales in Harlem. New York. J Am Pharm Assoc. 2002;42:S77–82. doi: 10.1331/1086-5802.42.0.s77.fuller. [DOI] [PubMed] [Google Scholar]
- 10.Platt L, Minozzi S, Reed J, Vickerman P, Hagan H, French C, et al. Needle syringe programmes and opioid substitution therapy for preventing hepatitis C transmission in people who inject drugs. Cochrane database Syst Rev. 2017;9:CD012021. doi: 10.1002/14651858.CD012021.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Friedman SR, Perlis T, Des Jarlais DC. Laws prohibiting over-the-counter syringe sales to injection drug users: relations to population density, HIV prevalence, and HIV incidence. Am J Public Health. 2001;91:791–3. doi: 10.2105/AJPH.91.5.791. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Lewis CF, Rivera AV, Crawford ND, DeCuir J, Amesty S. Pharmacy-randomized intervention delivering HIV prevention services during the syringe sale to people who inject drugs in New York City. Drug Alcohol Depend. 2015;153:72–77. doi: 10.1016/j.drugalcdep.2015.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Vickerman P, Martin N, Turner K, Hickman M. Can needle and syringe programmes and opiate substitution therapy achieve substantial reductions in hepatitis C virus prevalence? Model projections for different epidemic settings. Addiction. 2012;107:1984–1995. doi: 10.1111/j.1360-0443.2012.03932.x. [DOI] [PubMed] [Google Scholar]
- 14.Sears C, Guydish JR, Weltzien EK, Lum PJ. Investigation of a secondary syringe exchange program for homeless young adult injection drug users in San Francisco, California, USA. J Acquir Immune Defic Syndr. 2001;27:193–201. doi: 10.1097/00126334-200106010-00015. [DOI] [PubMed] [Google Scholar]
- 15.Huo D, Bailey SL, Hershow RC, Ouellet L. Drug use and HIV risk practices of secondary and primary needle exchange users. AIDS Educ Prev. 2005;17:170–184. doi: 10.1521/aeap.17.3.170.62900. [DOI] [PubMed] [Google Scholar]
- 16.Tyndall MW, Bruneau J, Brogly S, Spittal P, O’Shaughnessy MV, Schechter MT. Satellite needle distribution among injection drug users: policy and practice in two canadian cities. J Acquir Immune Defic Syndr. 2002;31:98–105. doi: 10.1097/00126334-200209010-00013. [DOI] [PubMed] [Google Scholar]
- 17.Valente TW, Foreman RK, Junge B, Vlahov D. Satellite exchange in the Baltimore needle exchange program. Public Health Rep. 1998;113(Suppl 1):90–6. [PMC free article] [PubMed] [Google Scholar]
- 18.Des Jarlais DC, Nugent A, Solberg A, Feelemyer J, Mermin J, Holtzman D. Syringe service programs for persons who inject drugs in urban, suburban, and rural areas—United States, 2013. MMWR Morb Mortal Wkly Rep. 2015;64:1337–1341. doi: 10.15585/mmwr.mm6448a3. [DOI] [PubMed] [Google Scholar]
- 19.Nolte K, Drew AL, Friedmann PD, Romo E, Kinney LM, Stopka TJ. Opioid initiation and injection transition in rural northern New England: a mixed-methods approach. Drug Alcohol Depend. 2020;217:108256. doi: 10.1016/j.drugalcdep.2020.108256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Stopka TJ, Jacque E, Kelso P, Guhn-Knight H, Nolte K, Hoskinson R, et al. The opioid epidemic in rural northern New England: an approach to epidemiologic, policy, and legal surveillance. Prev Med. 2019 doi: 10.1016/j.ypmed.2019.05.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Nolte K, Romo E, Stopka TJ, Drew A, Dowd P, Del Toro-Mejias L, et al. “I’ve been to more of my friends’ funerals than I’ve been to my friends’ weddings”: Witnessing and responding to overdose in rural Northern New England. J Rural Heal. 2022 doi: 10.1111/jrh.12660. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Heckathorn DD. Respondent-driven sampling: a new approach to the study of hidden populations. Soc Probl Narnia. 1997;44:174–199. doi: 10.2307/3096941. [DOI] [Google Scholar]
- 23.Wang J, Falck RS, Li L, Rahman A, Carlson RG. Respondent-driven sampling in the recruitment of illicit stimulant drug users in a rural setting: findings and technical issues. Addict Behav. 2007;32:924–937. doi: 10.1016/j.addbeh.2006.06.031. [DOI] [PubMed] [Google Scholar]
- 24.Gribble JN, Miller HG, Cooley PC, Catania JA, Pollack L, Turner CF. The impact of T-ACASI interviewing on reported drug use among men who have sex with men. Subst Use Misuse. 2000;35:869–890. doi: 10.3109/10826080009148425. [DOI] [PubMed] [Google Scholar]
- 25.Simões AA, Bastos FI, Moreira RI, Lynch KG, Metzger DS. Acceptability of audio computer-assisted self-interview (ACASI) among substance abusers seeking treatment in Rio de Janeiro. Brazil Drug Alcohol Depend. 2006;82:S103–S107. doi: 10.1016/S0376-8716(06)80016-5. [DOI] [PubMed] [Google Scholar]
- 26.Pallarés C, Carvalho-Gomes Â, Hontangas V, Conde I, Di Maira T, Aguilera V, et al. Performance of the OraQuick hepatitis C virus antibody test in oral fluid and fingerstick blood before and after treatment-induced viral clearance. J Clin Virol. 2018;102:77–83. doi: 10.1016/j.jcv.2018.02.016. [DOI] [PubMed] [Google Scholar]
- 27.Vanderweele TJ, Shpitser I. A new criterion for confounder selection. Biometrics. 2011;67:1406–1413. doi: 10.1111/j.1541-0420.2011.01619.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.VanderWeele TJ. Principles of confounder selection. Eur J Epidemiol. 2019;34:211–9. doi: 10.1007/s10654-019-00494-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Magis-Rodríguez C, Brouwer KC, Morales S, Gayet C, Lozada R, Ortiz-Mondragón R, et al. HIV Prevalence and correlates of receptive needle sharing among injection drug users inthe mexican-US border city of tijuana. J Psychoactive Drugs. 2005;37:333–9. doi: 10.1080/02791072.2005.10400528. [DOI] [PubMed] [Google Scholar]
- 30.Stone J, Fraser H, Lim AG, Walker JG, Ward Z, MacGregor L, et al. Incarceration history and risk of HIV and hepatitis C virus acquisition among people who inject drugs: a systematic review and meta-analysis. Lancet Infect Dis. 2018;18:1397–1409. doi: 10.1016/S1473-3099(18)30469-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Craine N, Hickman M, Parry JV, Smith J, Walker AM, Russell D, et al. Incidence of hepatitis C in drug injectors: the role of homelessness, opiate substitution treatment, equipment sharing, and community size. Epidemiol Infect. 2009;137:1255–1265. doi: 10.1017/S095026880900212X. [DOI] [PubMed] [Google Scholar]
- 32.Linton SL, Celentano DD, Kirk GD, Mehta SH. The longitudinal association between homelessness, injection drug use, and injection-related risk behavior among persons with a history of injection drug use in Baltimore. MD Drug Alcohol Depend Elsevier. 2013;132:457–465. doi: 10.1016/j.drugalcdep.2013.03.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Hahn J. Hepatitis C virus infection and needle exchange use among young injection drug users in San Francisco. Hepatology. 2001;34:180–187. doi: 10.1053/jhep.2001.25759. [DOI] [PubMed] [Google Scholar]
- 34.Havens JR, Oser CB, Leukefeld CG. Injection risk behaviors among rural drug users: Implications for HIV prevention. AIDS Care Psychol Socio-Med Asp AIDS HIV. 2011;23:638–45. doi: 10.1080/09540121.2010.516346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Woody GE, Bruce D, Korthuis PT, Chhatre S, Poole S, Hillhouse M, et al. HIV risk reduction with buprenorphine-naloxone or methadone: Findings from a randomized trial. J Acquir Immune Defic Syndr. 2014;66:288–93. doi: 10.1097/QAI.0000000000000165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Barros AJD, Hirakata VN. Alternatives for logistic regression in cross-sectional studies: An empirical comparison of models that directly estimate the prevalence ratio. BMC Med Res Methodol. 2003;3:1–13. doi: 10.1186/1471-2288-3-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Zou G. A modified poisson regression approach to prospective studies with binary data. Am J Epidemiol Am J Epidemiol. 2004;159:702–706. doi: 10.1093/aje/kwh090. [DOI] [PubMed] [Google Scholar]
- 38.Behrends CN, Li C-S, Gibson DR. Decreased odds of injection risk behavior associated with direct versus indirect use of syringe exchange: evidence from two California cities. Subst Use Misuse NIH Public Access. 2017;52:1151–1159. doi: 10.1080/10826084.2017.1299182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Murphy S, Kelley MS, Lune H. The health benefits of secondary syringe exchange. J Drug Issues. 2004;34:245–68. doi: 10.1177/002204260403400201. [DOI] [Google Scholar]
- 40.Stopka TJ, Donahue A, Hutcheson M, Green TC. Nonprescription naloxone and syringe sales in the midst of opioid overdose and hepatitis C virus epidemics: Massachusetts, 2015. J Am Pharm Assoc. 2017;57:S34–44. doi: 10.1016/j.japh.2016.12.077. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Pollini RA, Paquette CE, Slocum S, LeMire D. ‘It’s just basically a box full of disease’—navigating sterile syringe scarcity in a rural New England state. Addiction. 2021;116:107–15. doi: 10.1111/add.15113. [DOI] [PubMed] [Google Scholar]
- 42.MacArthur GJ, van Velzen E, Palmateer N, Kimber J, Pharris A, Hope V, et al. Interventions to prevent HIV and hepatitis C in people who inject drugs: a review of reviews to assess evidence of effectiveness. Int. J. Drug Policy. 2014;25:34–52. doi: 10.1016/j.drugpo.2013.07.001. [DOI] [PubMed] [Google Scholar]
- 43.Palmateer N, Kimber J, Hickman M, Hutchinson S, Rhodes T, Goldberg D. Evidence for the effectiveness of sterile injecting equipment provision in preventing hepatitis C and human immunodeficiency virus transmission among injecting drug users: a review of reviews. Addiction. 2010;105:844–859. doi: 10.1111/j.1360-0443.2009.02888.x. [DOI] [PubMed] [Google Scholar]
- 44.Sawangjit R, Khan TM, Chaiyakunapruk N. Effectiveness of pharmacy-based needle/syringe exchange programme for people who inject drugs: a systematic review and meta-analysis. Addiction. 2017;112:236–247. doi: 10.1111/add.13593. [DOI] [PubMed] [Google Scholar]
- 45.Zlotorzynska M, Weidle PJ, Paz-Bailey G, Broz D. Factors associated with obtaining sterile syringes from pharmacies among persons who inject drugs in 20 US cities. Int J Drug Policy. 2018;62:51–58. doi: 10.1016/j.drugpo.2018.08.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Rudolph AE, Crawford ND, Ompad DC, Benjamin EO, Stern RJ, Fuller CM. Comparison of injection drug users accessing syringes from pharmacies, syringe exchange programs, and other syringe sources to inform targeted HIV prevention and intervention strategies. J Am Pharm Assoc. 2010;50:140–147. doi: 10.1331/JAPhA.2010.09193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Värmå Falk M, Strömdahl S, Ekström AM, Kåberg M, Karlsson N, Dahlborn H, et al. A qualitative study of facilitators and barriers to participate in a needle exchange program for women who inject drugs. Harm Reduct J. 2020;17:84. doi: 10.1186/s12954-020-00425-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.El-Bassel N, Strathdee SA. Women who use or inject drugs: an action agenda for women-specific, multilevel, and combination HIV prevention and research. J Acquir Immune Defic Syndr. 2015;69:S182–90. doi: 10.1097/QAI.0000000000000628. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Iversen J, Page K, Madden A, Maher L. HIV, HCV, and health-related harms among women who inject drugs: Implications for prevention and treatment. J Acquir Immune Defic Syndr. 2015;69:S176–81. doi: 10.1097/QAI.0000000000000659. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Wagner KD, Simon-Freeman R, Bluthenthal RN. The association between law enforcement encounters and syringe sharing among IDUs on skid row: a mixed methods analysis. AIDS Behav. 2013;17:2637–43. doi: 10.1007/s10461-013-0488-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Hayashi K, Wood E, Wiebe L, Qi J, Kerr T. An external evaluation of a peer-run outreach-based syringe exchange in Vancouver. Canada Int J Drug Policy Elsevier. 2010;21:418–421. doi: 10.1016/j.drugpo.2010.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Irwin K, Karchevsky E, Heimer R, Badrieva L. Secondary syringe exchange as a model for HIV prevention programs in the Russian federation. Subst Use Misuse. 2006;41:979–999. doi: 10.1080/10826080600667219. [DOI] [PubMed] [Google Scholar]
- 53.Liu B, Sullivan SG, Wu Z. An evaluation of needle exchange programmes in China. AIDS. 2007;21:S123–S128. doi: 10.1097/01.aids.0000304707.56670.cf. [DOI] [PubMed] [Google Scholar]
- 54.Islam MM, Topp L, Conigrave KM, van Beek I, Maher L, White A, et al. The reliability of sensitive information provided by injecting drug users in a clinical setting: Clinician-administered versus audio computer-assisted self-interviewing (ACASI) AIDS Care. 2012;24:1496–1503. doi: 10.1080/09540121.2012.663886. [DOI] [PubMed] [Google Scholar]
- 55.Heckathorn DD. Respondent-driven sampling II: deriving valid population estimates from chain-referral samples of hidden populations. Soc Probl. 2002;49:11–34. doi: 10.1525/sp.2002.49.1.11. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All data generated and analyzed during the current study are available from the corresponding author on reasonable request.