Abstract
The purpose of this study was to assesses the effectiveness of proactive and reactive methods in the recruitment of Black and Latino adolescents into a vaping-prevention randomized controlled trial (RCT). This study also assessed the characteristics of study participants by recruitment method. Proactive recruitment strategies included study presentations at community-based events (e.g., festivals, health fairs), school-based events (e.g., back-to-school events, after-school programs), and recreational centers (e.g., fitness centers, malls). Reactive recruitment strategies included study advertisements via social media (e.g., Facebook posts shared by local community-based organizations), word of mouth, and an academic-based research hub. Using proactive and reactive methods, in a 4-month period, 362 Black and Latino adolescents were successfully enrolled into the RCT. Compared to the proactive method, adolescents screened reactively were equally likely to be eligible but significantly more likely to enroll in the study. However, both proactive and reactive strategies made notable contributions to the overall recruitment effort. Moreover, proactive and reactive methods attracted adolescents with different characteristics (e.g., age, gender, sexual orientation, etc.). These findings suggest that both proactive and reactive recruitment strategies should be implemented for studies interested in recruiting a diverse sample of Black and Latino adolescents.
Keywords: adolescence, recruitment, tobacco control, vaping, Blacks, Latinos
1. Introduction
Adolescence (ages 10 to 19 years) [1] is a period of life characterized by tobacco- and nicotine-use initiation, experimentation, and progression to long-term addicted use [2,3,4,5]. According to the United States (U.S.) National Youth Tobacco Survey, in 2018, 7.2% of middle school students (approximately 840,000) and 27.1% of high school students (approximately 4 million) reported current use of any tobacco product and electronic nicotine delivery systems (ENDS) [6]. Electronic cigarettes (e-cigarettes) were the most used tobacco/nicotine products among middle school (4.9%) and high school (20.8%) students [6]. There is sufficient evidence that e-cigarette use (vaping) during adolescence is associated with future initiation of cigarette, marijuana, and alcohol use [7,8,9]. Moreover, early nicotine exposure puts adolescents at risk for a lifetime of vaping addiction as well as unknown health risks of long-term e-cigarette use. Chemical and heavy metal exposure from e-cigarettes and risk of toxicity and acute injuries are a public health concern [10,11,12,13,14,15].
Despite the potential adverse effects and high prevalence of e-cigarette use among adolescents, there is limited research on effective strategies in the scope of prevention. Moreover, the limited research on vaping prevention is hampered by methodological limitations, such as the underrepresentation of Black and/or Latino individuals, a lack of multi-modal recruitment strategies, and scarce reporting of recruitment data. Examples from the available literature include one study assessing different message themes to prevent vaping among adolescents and young adults [16]. Recruitment was solely conducted via Qualtrics Online Sample, a commercial survey sampling and administration company [17]. This effort resulted in the recruitment of 1564 adolescents (20.5% self-identified as Hispanic/Latino, and 13.4% self-identified as African American/Black) [16]. A second example is a study evaluating a school-based vaping educational program delivered by health professionals with vast experience in conducting tobacco education [18]. Participants were exclusively recruited from a mix of public and private schools in urban and rural settings in Alabama [18]. This effort resulted in the recruitment of 2889 middle and high school students (no reported data on race nor ethnicity) [18]. A third example is a study developing and pilot testing a risk communication campaign to prevent vaping among adolescents [19]. Participants were recruited through direct email invitations from the regional YMCA partner network and electronically distributed invitations via social media channels proctored by local teen-serving, community-based organizational networks [19]. The final sample consisted of 268 participants (9.3% self-identified as Hispanic, and 26.1% self-identified as Black/African American) [19]. While these three studies have been an extraordinary addition to the expanding literature on vaping prevention, increasing study participation of Black and Latino individuals, diversifying recruitment strategies, and detailing recruitment data are necessary to achieve research generalizability, facilitate evidence-based policy, improve health outcomes, and advance health equity.
Literature on the recruitment of Black and Latino individuals into tobacco-control (e.g., smoking cessation) studies have described the use of different recruitment methods [20,21,22,23,24,25,26]. These studies have recruited Black and Latino participants through proactive (also known as active or direct) recruitment, which includes direct interaction with potential participants [27], and reactive (also known as passive or indirect) recruitment, where individuals contact the study themselves [24]. Proactive strategies often include telephone calls, staff attendance at local health fairs, and local community presentations [27]. Reactive strategies often involve the distribution of printed material, such as flyers, newspaper ads, and advertisements in church bulletins, and use of media outlets, such as radio and television [24]. Proactive recruitment usually requires more resources but may yield higher rates of accrual, whereas reactive methods may be less effortful but result in lower rates of accrual [28]. It is also possible that the different recruitment approaches will yield participants with different characteristics. To the best of our knowledge, no study has assessed the effectiveness of proactive and reactive strategies in the recruitment of Black and Latino adolescents into vaping-prevention studies. The present study assesses the effectiveness of proactive and reactive methods and strategies in the recruitment of Black and Latino adolescents into a vaping-prevention randomized controlled trial. In this study, recruitment method refers broadly to either proactive or reactive recruitment. Recruitment strategies refer to the specific recruitment type implemented within each recruitment method. This study also assesses the characteristics of study participants by recruitment method.
2. Materials and Methods
2.1. Study Design
We conducted a randomized controlled trial (RCT) to assess the impact of theoretical-based graphic messages at preventing vaping among 362 Black and Latino adolescents. The graphic messages were developed using participatory research methods and incorporate four main theoretical constructs: health reward, financial reward, self-efficacy, and social norms [29]. Participants were compensated with a USD 25 gift card for their time and effort. This manuscript compares proactive and reactive recruitment methods for participants enrolled in the RCT. Study procedures were approved and monitored by the University of Rochester Medical Center Institutional Review Board (STUDY00006267). The trial was registered on ClincialTrials.gov (NCT04899999).
2.2. Recruitment
Recruitment was conducted by a team of diverse (e.g., race, ethnicity, and gender), bilingual (English and Spanish), trained recruiters. Recruitment started in August 2021 and ended in December 2021. Proactive recruitment strategies included study presentations supported by a display table at community-based events (e.g., festivals, health fairs), school-based events (e.g., back-to-school events, after-school programs), and recreational centers (e.g., fitness centers, malls). At the end of each study presentation, recruiters asked individuals if they were interested in participating in the RCT. The proactive recruitment strategies mostly took place in Hackensack, New Jersey, and Rochester, New York. U.S. Census Bureau data for the city of Hackensack, New Jersey, indicate lower proportions of White (49.7% vs. 72.1%) and more African American/Black (24.1% vs. 15.0%) as well as Hispanic/Latino (36.3% vs. 20.4%) residents than statewide, more residents speaking languages other than English at home (48.6% vs. 31.0%), and those living in poverty (12.3% vs. 10.0%) [30]. U.S. Census Bureau data for Rochester, New York, indicate lower proportions of White (45.4% vs. 69.6%) and more African American/Black (39.4% vs. 17.6%) residents than statewide. The proportion of Hispanic/Latino residents is similar in Rochester and New York (19.4% and 19.3%, respectively). Compared to New York State, more residents of Rochester live in poverty (30.4 vs. 12.7%) [31]. One school-based event occurred in Ponce, Puerto Rico, where almost all students were Hispanics/Latinos.
Reactive recruitment strategies included study advertisements via social media (e.g., Facebook posts shared by local community-based organizations), word of mouth, and an academic-based research hub (e.g., UR Health Research—An institutional resource to promote participation in clinical trials). UR Health Research connects individuals to clinical trials, promotes research findings, and educates the community about health research. No paid online advertisements via social media (e.g., Facebook ads) were used.
2.3. Parents’/Guardians’ Permission
Individuals who were interested in participating in the study received two informational letters, namely one addressed to the adolescent and the other to the parents/caregivers. The informational letters (available in Spanish and English) described the study, explained the benefits and risks, and included the study team contact information. Once the parents/caregivers received and reviewed the informational letter, they were instructed to contact the study team via electronic email or phone call. Research staff then scheduled a phone call with interested parents/caregivers to obtain permission for their adolescent to participate. During the phone call, the research team discussed all aspects of study participation and confidentiality and answered any questions. Parents/caregivers and adolescents were informed that they were free to decline study participation and end their involvement at any time without negative consequences. Once the parents/caregivers gave verbal permission for their adolescent to participate, study staff contacted the adolescent to conduct the eligibility assessment.
2.4. Eligibility
Individuals were eligible if they (1) self-identified as African American/Black and/or Hispanic/Latino, (2) knew how to read and speak English and/or Spanish, (3) were at least 12 but no greater than 17 years old, (4) had never used e-cigarettes, and (5) had access to a device that would allow them to connect to the online survey (e.g., desktop, laptop, tablet, and/or smartphone). Exclusion criteria included (1) not identifying as African American/Black and/or Hispanic/Latino and (2) currently using e-cigarettes. Eligibility assessment was conducted by study staff in the adolescent’s language of preference: either English or Spanish.
2.5. Participants’ Assent
Adolescents who were eligible to participate in the study received a unique link to REDCap, a secure web application for building and managing online surveys and databases [32]. Through this link, the adolescents accessed the informational letter described above (available in English and Spanish). Adolescents assented to participate in the study by clicking “Yes, I assent to participate in the study” via REDCap after reading the informational sheet. In this study, enrolled participants refer to adolescents who assented to participate in the study.
2.6. Assessments
All assessments were completed in the participants’ language of preference, either English or Spanish. Assessments were adapted from surveys used in previous studies and pre-tested for survey administration among the study team [33]. The baseline survey collected information on demographics (e.g., race, ethnicity, age, gender, sexual orientation, state of residence, and employment status). Participants’ state of residence was grouped into one of five regions (e.g., Northeast, Midwest, South, West, and Puerto Rico), in accordance with the U.S. Census Bureau [34]. Informed by prior foundational research on youth electronic cigarette use, susceptibility to future vaping was assessed with three items tapping curiosity, intent, and social influence [33]. Participants were asked: “Have you ever been curious about using e-cigarettes/vaping?”; “Do you think that you will use e-cigarettes/vape in the next 12 months?”; and “If one of your best friends were to offer you an e-cigarette/electronic vapor product, would you use it?” (1 = “Definitely not” to 4 = “Definitely yes”). These response categories were combined to create a dichotomous variable on susceptibility to future vaping (1 = “Definitely not”; 2 = “Probably not”, “Probably yes”, and “Definitely yes”). Moreover, we merged these items to create an overall susceptibility variable. Participants who responded with a response other than “Definitely not” to one or more items were deemed susceptible to future vaping.
2.7. Analyses
For each recruitment method, characteristics of enrolled participants were summarized with percentages for categorical variables and with means and standard deviations (SD) for continuous variables. Rates of eligibility and enrollment across the two recruitment methods were compared using chi-square tests. Differences in categorical variables were exploratorily compared using Pearson’s chi-square tests or Fisher exact test, while differences in continuous variables were compared using one-way ANOVA tests or Nonparametric Wilcoxon test depending on data distributions. Logistic regressions were used to estimate relative risks and 95% confidence intervals to measure the (1) association between recruitment method and the likelihood of obtaining eligible individuals among screened individuals and the (2) association between recruitment method and the likelihood of enrolling the screened participants. Intention-to-treat (ITT) was applied for missing data, and all analyses were performed in SPSS 14.0.
3. Results
Of the 408 individuals who completed screening, 401 (98.2%) met eligibility criteria, and 362 (88.7%) enrolled in the RCT. Most participants were enrolled via reactive recruitment strategies (n = 204, 56.4%) compared to the proactive recruitment strategies (n = 158, 43.6%). Table 1 lists the numbers of individuals who were screened and enrolled by recruitment method and includes measures (ratios) of eligibility efficiency and enrollment efficiency. Compared to the proactive method, individuals screened in the reactive method were equally likely to be eligible (98.1% vs. 98.4%; RR = 0.81, 95% CI = 0.18–3.58, p = 0.29) but statistically significantly more likely to enroll in the study (96.2% vs. 80.6%; RR = 5.13, 95% CI = 2.46–10.74, p < 0.001).
Table 1.
Recruitment Method | Number Screened | Number Eligible | Number Enrolled | Eligibility Efficiency Ratio a | Enrollment Efficiency Ratio b |
---|---|---|---|---|---|
Proactive | 196 | 193 | 158 | 98.4 | 80.6 |
Reactive | 212 | 208 | 204 | 98.1 | 96.2 |
Total | 408 | 401 | 362 | 98.2 | 88.7 |
a Ratio of number eligible to number screened. b Ratio of number enrolled to number screened.
Table 2 shows the efficiency of specific strategies used in both recruitment methods. In both proactive and reactive methods, all strategies yielded extremely high eligibility efficiency ratios (97.5–100%) except for academic-based hub (42.8%). Within the proactive method, the strategy that yielded the highest enrollment efficiency ratio was school-based events (86.9%). Within the reactive method, social media and word of mouth yielded extremely high enrollment efficiency ratios (100% and 97.0%, respectively).
Table 2.
Recruitment Method | Recruitment Strategy | Number Screened | Number Eligible | Number Enrolled | Eligibility Efficiency Ratio a | Enrollment Efficiency Ratio b |
---|---|---|---|---|---|---|
Proactive | Community-based events | 31 | 31 | 23 | 100 | 74.1 |
School-based events | 123 | 120 | 107 | 97.5 | 86.9 | |
Recreational centers | 42 | 42 | 28 | 100 | 66.6 | |
Reactive | Social media | 71 | 71 | 71 | 100 | 100 |
Word of mouth | 134 | 134 | 130 | 100 | 97.0 | |
Academic-based hub | 7 | 3 | 3 | 42.8 | 42.8 |
a Ratio of number eligible to number screened. b Ratio of number enrolled to number screened.
At baseline, participants’ mean age was 14.9 years old (SD 1.4); 50% of participants self-identified as African American/Black, and 50% self-identified as Hispanic/Latino (Table 3). Almost two-thirds of participants (64.9%) were male, 87.5% were heterosexual, and 66.3% lived in the Northeast region. Most participants (82%) selected English as their language of preference, and 18.7% were currently employed. More than half of participants (54.7%) were classified as susceptible to future vaping.
Table 3.
Characteristic | Total (N = 362) |
Proactive (n = 158) |
Reactive (n = 204) |
p-Value |
---|---|---|---|---|
Mean (SD) | Mean (SD) | Mean (SD) | ||
Age | 14.9 (1.4) | 14.6 (1.55) | 15.2 (1.37) | <0.001 |
N (%) | n (%) | n (%) | ||
Race: African American/Black | 161 (50%) | 42 (26.6%) | 139 (68.1%) | <0.001 |
Ethnicity: Hispanic/Latino | 161 (50%) | 116 (73.4%) | 65 (31.9%) | <0.001 |
Gender: Male | 235 (64.9%) | 77 (48.7%) | 158 (77.5%) | <0.001 |
Sexual orientation: Heterosexual | 317 (87.5%) | 125 (79.1%) | 192 (94.1%) | <0.001 |
Region: Northeast | 240 (66.3%) | 145 (91.8%) | 95 (46.6%) | <0.001 |
Language of preference: English | 297 (82%) | 101 (63.9%) | 196 (96.1%) | <0.001 |
Currently employed | 68 (18.7%) | 21 (13.3%) | 47 (23.0%) | 0.019 |
Susceptible to future vaping | 198 (54.7%) | 76 (48.1%) | 122 (59.8%) | 0.027 |
Table 3 compares the characteristics of enrolled participants between both recruitment methods. Black participants were significantly more likely to be recruited reactively compared to their non-Black counterparts (p < 0.001). Latino participants were significantly more likely to be recruited proactively compared to their non-Latino counterparts (p < 0.001). Participants recruited reactively were older (p < 0.001), more likely to be male (p < 0.001), more likely to be heterosexual, more likely to select English as their language of preference (p < 0.001), more likely to be currently employed (p = 0.019), and more likely to be susceptible to future vaping (p = 0.027) compared to participants recruited proactively.
4. Discussion
In a 4-month period, 362 Black and Latino adolescents were successfully enrolled into an RCT testing the impact of theoretical-based graphic messages at preventing future vaping. To the best of our knowledge, this is the first study to describe the effectiveness of diverse strategies for identifying and recruiting Black and Latino adolescents into a vaping-prevention RCT. This study compared proactive and reactive recruitment strategies on eligibility and enrollment rates. Results of this study show that compared to the proactive method, adolescents screened reactively were equally likely to be eligible but significantly more likely to enroll in the study. However, both proactive and reactive strategies made notable contributions to the overall recruitment effort.
The overall greater enrollment efficiency of reactive strategies compared to proactive strategies is consistent with other tobacco-control research among Black and Latino adults [23,24,35,36]. As noted by Harris et al., reactive recruitment may be more effective among underrepresented minorities due to its nature of reaching a wider audience and individuals’ readiness and motivation to participate in tobacco-control studies [24]. Of the different recruitment strategies, all strategies in both proactive and reactive methods yielded extremely high eligibility efficiency ratios (97.5–100%) except for academic-based hub (42.8%). In order to reach the recruitment goal, study staff attended an array of events and sites that were known to garner the attendance of Black and Latino adolescents. Proactive strategies (e.g., attending community-based events, school-based events, and recreational centers) resulted in recruitment of 43.6% of the sample. Within the proactive method, the strategy that yielded the highest enrollment efficiency ratio was school-based events (86.9%). As described by Tingen et al., schools—especially elementary and middle schools—provide a promising setting for reaching adolescents and parents/caregivers for tobacco-control studies [37]. In contrast, reactive strategies resulted in 56.4% of the sample. Within the reactive method, word of mouth and social media yielded extremely high enrollment efficiency ratios (97% and 100%, respectively). As described by Bonevski et al., Black and Latino individuals who do not receive care, information, or support from community-based organizations (CBOs) or academic medical centers may be less exposed to research opportunities, and thus, they might be less likely to participate in research [38]. Therefore, word of mouth may be uniquely fitted to enhance research engagement among Black and Latino individuals who have lower exposure to research. Furthermore, the extremely high efficiency of social media—specifically Facebook—is no surprise, as a systematic review of Facebook as a recruitment tool for adolescent health research showed that it is a successful method [39]. Moreover, social media is an integral part of adolescents’ lives, as 82% of them use social media to engage in fundamental tasks (e.g., learning), identity formation, and social connectivity (e.g., engaging with friends [40]). It is important to acknowledge that in this study, recruitment via social media only occurred through Facebook. Future studies should assess the impact of recruiting Black and Latino adolescents via Instagram, Snapchat, and TikTok—the currently most-used social media platforms among adolescents [41].
In this study, proactive and reactive methods attracted adolescents with different characteristics. Black adolescents were significantly more likely to be recruited reactively compared to proactively. This result is consistent with previous studies indicating that, among Black adults, reactive recruitment is the most successful recruitment method in tobacco-control (e.g., smoking cessation) studies [26,35,36]. In contrast, Latino adolescents were significantly more likely to be recruited proactively. Surprisingly, this result is inconsistent with previous studies showing that, among Latino adults, reactive strategies are the most successful recruitment efforts in tobacco-control (e.g., smoking cessation) studies [23,36]. However, García et al. reviewed the recruitment strategies of five studies with Latinos related to type 2 diabetes and tuberculosis and found that the recruitment efforts were far more successful when they relied on methods of direct contact with potential participants [42]. This was because Latino participants and recruiters shared cultural values of personalismo (preference for warm relationships that convey care and acceptance of participants and their circumstances), simpatía (preference for smooth relationships that are free of confrontation and criticism as well as finding someone likeable, sharing common interests), respeto (respect), confianza (trust), and familismo (emphasis on family, cooperation, loyalty, and interdependence) [42,43].
In this study, female participants were significantly more likely to be recruited via proactive strategies compared to reactive strategies. This result is consistent with other studies that have found that proactive approaches are successful to recruiting female adolescents from minority backgrounds [44,45]. Moreover, in this study, participants recruited reactively were more likely to be heterosexual compared to participants recruited proactively. The National Institutes of Health has recognized sexual and gender minority people as a “health disparity population for research [46]” because they experience numerous health and health care inequities, including worse mental health outcomes [47,48,49,50] and low utilization of preventive care services [51,52,53]. Future studies aiming to recruit adolescents from diverse sexual orientations (e.g., lesbian, gay, bisexual) can build upon proactive approaches to conduct tobacco-control research among non-heterosexual adolescents. Additionally, participants recruited reactively were significantly older, more likely to select English as their language of preference, and more likely to be currently employed compared to participants recruited proactively. The statistical difference observed in the region could be due to the proactive recruitment strategies occurring in the Northeast region (e.g., New Jersey and New York), with the exception of a school-based event in Puerto Rico that recruited 13 adolescents. Lastly, participants’ overall susceptibility to future vaping is consistent with the data reported among adolescents attending public schools in a low-income community in New Jersey [33].
The study team included Black and Latino researchers and staff. Thus, factors that contributed to recruitment success may include race, ethnicity, and language matching of research staff to both parents/caregivers and adolescents. In addition, recruitment efforts involved close partnership with key leaders of the Black and Latino communities, and study materials were culturally relevant and language appropriate. As recommended by Rhodes et al., emphasizing the study uniqueness was a vital recruitment tactic [54]. Recruiters in this study stressed to parents/caregivers and adolescents that the study was specifically designed and developed for Black and Latino adolescents and that no other vaping-prevention study like it existed for these populations. Additionally, key to recruitment was the provision of monetary compensations to study participants. As described by Ozer, monetary compensation increases youth’s feelings of equity, value, and investments in research projects [55].
4.1. Study Relevance and Implications for Future Research
This study adds valuable insights to the expanding literature on vaping prevention. Study results demonstrate that it is feasible to recruit Black and Latino adolescents—two traditionally hard-to-reach groups—into a vaping-prevention RCT. These findings provide evidence of Black and Latino adolescents being interested in participating in vaping-prevention research if recruited in a culturally and linguistically appropriate manner. Proactive and reactive methods attracted adolescents with different characteristics (e.g., age, gender, sexual orientation, etc.). An appreciation of these differences is important, as this information could be utilized to tailor recruitment strategies for Black and Latino adolescents. This study is timely given that Black and Latino adolescents are often underrepresented in tobacco-control studies, and this study suggests that 55% of them are susceptible to future vaping. Moreover, Black and Latino communities have a history of being targeted by the tobacco industry [56,57]. For example, vape shops are more densely distributed in neighborhoods with large Black and Latino populations [58,59]. Lastly, these recruitment approaches among Black and Latino adolescents have the potential to be replicated for research involving other public health concerns.
4.2. Strengths and Limitations
To the best of our knowledge, this is the first study to purposely focus on African American/Black and Hispanic/Latino adolescents for a vaping-prevention RCT. It is important to acknowledge that in the U.S., African American/Black is typically assessed as a race and Hispanic/Latino as an ethnicity and that these groups are not mutually exclusive. In this study, we did not encounter participants who self-identified as both African American/Black and Hispanic/Latino.
One of the strengths of this study and a possible facilitator of recruitment is that this research builds upon our established history of smoking-cessation treatment and research within the community [20,60,61,62,63,64]. Moreover, this work is grounded in principles of community-based participatory research (CPBR). CBPR is a partnership approach to research that involves community members, organizational representatives, and researchers across all phases of research [65]. This approach ensures that the research is relevant, meaningful, and appropriate to the population for which it is planned [65]. Consistent with CBPR, we recognize the community as a unit of identity and build on its unique strengths and resources. Specifically, the community (1) has identified vaping as a health concern, (2) is engaged in intervention design, (3) guides the research team to effective recruitment strategies, (4) collaborates in interpreting findings, and (5) cooperates in disseminating findings.
Another strength of the study is the use of proactive and reactive methods for recruitment. The design of the study allowed us to isolate and determine the unique contribution of each recruitment approach while tracking critical denominators to calculate both eligibility and enrollment efficiency. The inclusion of Spanish-speaking participants is another study strength: 18% of participants in this study selected Spanish as their language of preference. Despite these strengths, the current study has several methodological limitations. First, this study was not designed to test the efficiency of recruitment strategies. Given the broad reach of our channels, it is possible that participants were exposed to multiple strategies. It is also possible that individuals responding reactively may have been exposed to a prior or concomitant proactive strategy. Therefore, some cross-contamination effect cannot be ruled out. Lastly, we did not conduct a cost effectiveness analysis in this study because we did not track total costs and time spent. Moreover, the study relied on volunteers and the support of CBOs. We acknowledge that an essential component in determining the effectiveness of one recruitment method over another is to consider the costs and time spent. For example, the high eligibility and enrollment efficiency ratios of social media in this study are very promising given that no paid online advertisements (e.g., Facebook ads) were used. Moreover, the study flyer that was shared on social mediums was designed by the research staff and not a professional graphic designer. In contrast, all proactive recruitment strategies demanded staff resources, and results were mixed. For example, one recruiter (R.H.O.) attended one event at the Boys and Girls Club of Rochester—a local recreational center—for one hour. At this event, the recruiter identified 12 individuals who were interested in participating in the RCT. All 12 individuals were eligible to participate in the RCT and enrolled in the study; the eligibility and enrollment efficiency ratios of this particular event were both 100%. Another example was a back-to-school event organized by the Eugenio María de Hostos Charter School. Two recruiters (R.H.-T. and A.P.C.) attended the 4-hour event and identified 22 individuals who were interested and eligible to participate in the RCT (eligibility efficiency ratio of 100%). Of the 22 individuals, 13 were enrolled in the study (enrollment efficiency ratio was 59%). A third example was a community-based event at the International Plaza of the City of Rochester to celebrate Hispanic Heritage Month. Two recruiters (R.H.O. and A.C.-I.) attended the 3-hour event and did not identify a single individual who was interested in participating in the study.
5. Conclusions
Using proactive and reactive methods, a heterogeneous sample of Black and Latino adolescents was enrolled in a vaping-prevention RCT. Compared to the proactive method, adolescents screened reactively were equally likely to be eligible but significantly more likely to enroll in the study. However, both proactive and reactive strategies made notable contributions to the overall recruitment effort. Moreover, proactive and reactive methods attracted adolescents with different characteristics (e.g., age, gender, sexual orientation, etc.). These findings suggest that both proactive and reactive recruitment strategies should be implemented for studies interested in recruiting a diverse sample of Black and Latino adolescents.
Acknowledgments
The authors are grateful to the individuals who participated in this study. Moreover, the authors thank (listed in alphabetical order) Javannah Davis, Katty Ubillus, Mateakka Wilson, Pamela Bailie, Sarah Merritt, and Zainab Shah for their help recruiting participants. Furthermore, the authors thank the organizations that opened their doors to implement this study (listed in alphabetical order): Boys and Girls Club of Rochester, Cameron Community Ministries, David F. Gantt Recreation Center, Eugenio María de Hostos Charter School, Gidalias Bilingual Academy, Hackensack School District, Ibero-American Action League, International Plaza, Memorial Art Gallery of the University of Rochester, Reborn Family Center, Rochester Public Library, Rochester Public Market, The Mall at Greece Ridge, and Youth Voice-One Vision (Rochester Mayor’s Youth Advisory Council). Additionally, the authors acknowledge (listed in alphabetical order) Carrie Dykes and Cody Gardner for their assistance registering the study in clinicaltrials.gov and advertising the study in UR Health Research. Lastly, the authors express their sincere gratitude to (listed in alphabetical order) Christina Sisson, Claudia L. Burcke, Erin Schmidt, and Jacqueline Attia for the administrative support.
Author Contributions
Conceptualization, F.C.-B., D.B. and A.P.C.; methodology, F.C.-B., R.H.-T., R.H.O., E.A.-C. and A.P.C.; formal analysis, F.C.-B. and R.H.-T.; validation, X.C.; data curation, F.C.-B. and R.H.O.; writing—original draft preparation, F.C.-B., R.H.-T., R.H.O., A.C.-I. and O.A.L.; writing—review and editing, F.C.-B., C.A., D.B., E.A.-C., X.C., S.M., D.J.O. and A.P.C.; supervision X.C., S.M., D.J.O. and A.P.C.; project administration, R.H.O.; funding acquisition, F.C.-B. and A.P.C. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki and approved by the University of Rochester Medical Center Institutional Review Board. Protocol code: STUDY00006267. Date of approval: 18 June 2021.
Informed Consent Statement
Parents’/guardians’ permission and adolescents’ assent was obtained from all subjects involved in the study.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
Conflicts of Interest
The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.
Funding Statement
This research was funded by National Cancer Institute of the National Institutes of Health (NIH) and the Food and Drug Administration (FDA) Center for Tobacco Products under grant number U54CA228110. UR Health Research was supported by the University of Rochester CTSA award number UL1 TR002001 from the National Center for Advancing Translational Sciences of the NIH. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH or FDA.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Canadian Pediatric Society Age limits and adolescents. Paediatr. Child Health. 2003;8:577–578. doi: 10.1093/pch/8.9.577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Brook D.W., Brook J.S., Zhang C., Whiteman M., Cohen P., Finch S.J. Developmental trajectories of cigarette smoking from adolescence to the early thirties: Personality and behavioral risk factors. Nicotine Tob. Res. 2008;10:1283–1291. doi: 10.1080/14622200802238993. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Chassin L., Presson C.C., Pitts S.C., Sherman S.J. The natural history of cigarette smoking from adolescence to adulthood in a midwestern community sample: Multiple trajectories and their psychosocial correlates. Health Psychol. 2000;19:223–231. doi: 10.1037/0278-6133.19.3.223. [DOI] [PubMed] [Google Scholar]
- 4.Costello D.M., Dierker L.C., Jones B.L., Rose J.S. Trajectories of smoking from adolescence to early adulthood and their psychosocial risk factors. Health Psychol. 2008;27:811–818. doi: 10.1037/0278-6133.27.6.811. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Soneji S., Barrington-Trimis J.L., Wills T.A., Levanthal A.M., Unger J.B., Gibson L.A., Yang J., Primack B.A., Andrews J.A., Miech R.A., et al. Association between initial use of e-cigarettes and subsequent cigarette smoking among adolescents and young adults: A systematic review and meta-analysis. JAMA Pediatr. 2017;171:788–797. doi: 10.1001/jamapediatrics.2017.1488. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Gentzke A.S., Creamer M., Cullen K.A., Ambrose B.K., Willis G., Jamal A., King B.A. Vital signs: Tobacco product use among middle and high school students—United States, 2011–2018. MMWR Morb. Mortal. Wkly. Rep. 2019;68:157–164. doi: 10.15585/mmwr.mm6806e1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Primack B.A., Soneji S., Stoolmiller M., Fine M.J., Sargent J.D. Progression to traditional cigarette smoking after electronic cigarette use among US adolescents and young adults. JAMA Pediatr. 2015;169:1018–1023. doi: 10.1001/jamapediatrics.2015.1742. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Unger J.B., Soto D.W., Leventhal A. E-cigarette use and subsequent cigarette and marijuana use among Hispanic young adults. Drug Alcohol. Depend. 2016;163:261–264. doi: 10.1016/j.drugalcdep.2016.04.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Cohn A., Villanti A., Richardson A., Rath J.M., Williams V., Stanton C., Mermelstein R. The association between alcohol, marijuana use, and new and emerging tobacco products in a young adult population. Addict. Behav. 2015;48:79–88. doi: 10.1016/j.addbeh.2015.02.005. [DOI] [PubMed] [Google Scholar]
- 10.Goniewicz M.L., Gawron M., Smith D.M., Peng M., Jacob P., Benowitz N.L. Exposure to nicotine and selected toxicants in cigarette smokers who switched to electronic cigarettes: A longitudinal within-subjects observational study. Nicotine Tob. Res. 2017;19:160–167. doi: 10.1093/ntr/ntw160. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Goniewicz M.L., Smith D.M., Edwards K.C., Blount B.C., Caldwell K.L., Feng J., Wang L., Christensen C., Ambrose B., Borek N., et al. Comparison of nicotine and toxicant exposure in users of electronic cigarettes and combustible cigarettes. JAMA Netw. Open. 2018;1:e185937. doi: 10.1001/jamanetworkopen.2018.5937. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Shahab L., Goniewicz M.L., Blount B.C., Brown J., McNeill A., Alwis K.U., Feng J., Wang L., West R. Nicotine, carcinogen, and toxin exposure in long-term e-cigarette and nicotine replacement therapy users: A cross-sectional study. Ann. Intern. Med. 2017;166:390–400. doi: 10.7326/M16-1107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Rubinstein M.L., Delucchi K., Benowitz N.L., Ramo D.E. Adolescent exposure to toxic volatile organic chemicals from e-cigarettes. Pediatrics. 2018;141:e20173557. doi: 10.1542/peds.2017-3557. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Lerner C.A., Sundar I.K., Watson R.M., Elder A., Jones R., Done D., Kurtzman R., Ossip D.J., Robinson R., McIntosh S., et al. Environmental health hazards of e-cigarettes and their components: Oxidants and copper in e-cigarette aerosols. Environ. Pollut. 2015;198:100–107. doi: 10.1016/j.envpol.2014.12.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Lerner C.A., Sundar I.K., Yao H., Gerloff J., Ossip D.J., McIntosh S., Robinson R., Rahman I. Vapors produced by electronic cigarettes and e-juices induce toxicity, oxidative stress, and inflammatory response in lung epithelial cells and in mouse lung. PLoS ONE. 2015;10:e0116732. doi: 10.1371/journal.pone.0116732. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Rath J.M., Romberg A.R., Perks S.N., Edwards D., Vallone D.M., Hair E.C. Identifying message themes to prevent e-cigarette use among youth and young adults. Prev. Med. 2021;150:106683. doi: 10.1016/j.ypmed.2021.106683. [DOI] [PubMed] [Google Scholar]
- 17.Miller C.A., Guidry J.P.D., Dahman B., Thomson M.D. A tale of two diverse Qualtrics samples: Information for online survey researchers. Cancer Epidemiol. Biomark. Prev. 2020;29:731–735. doi: 10.1158/1055-9965.EPI-19-0846. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Gaiha S.M., Duemler A., Silverwood L., Razo A., Halpern-Felsher B., Walley S.C. School-based e-cigarette education in Alabama: Impact on knowledge of e-cigarettes, perceptions and intent to try. Addict. Behav. 2021;112:106519. doi: 10.1016/j.addbeh.2020.106519. [DOI] [PubMed] [Google Scholar]
- 19.England K.J., Edwards A.L., Paulson A.C., Libby E.P., Harrell P.T., Mondejar K.A. Rethink Vape: Development and evaluation of a risk communication campaign to prevent youth E-cigarette use. Addict. Behav. 2021;113:106664. doi: 10.1016/j.addbeh.2020.106664. [DOI] [PubMed] [Google Scholar]
- 20.Arana-Chicas E., Cartujano-Barrera F., Ogedegbe C., Ellerbeck E.F., Cox L.S., Graves K.D., Diaz F.J., Catley D., Cupertino A.P. Feasibility and Effectiveness of Recruiting Latinos in Decidetexto-A Smoking Cessation Clinical Trial from an Emergency Department Patient Registry. Int. J. Environ. Res. Public Health. 2021;18:10859. doi: 10.3390/ijerph182010859. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Collins B.N., Wileyto E.P., Hovell M.F., Nair U.S., Jaffe K., Tolley N.M., Audrain-McGovern J. Proactive recruitment predicts participant retention to end of treatment in a secondhand smoke reduction trial with low-income maternal smokers. Transl. Behav. Med. 2011;1:394–399. doi: 10.1007/s13142-011-0059-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Faseru B., Cox L.S., Bronars C.A., Opole I., Reed G.A., Mayo M.S., Ahluwalia J.S., Okuyemi K.S. Design, recruitment, and retention of African-American smokers in a pharmacokinetic study. BMC Med. Res. Methodol. 2010;10:6. doi: 10.1186/1471-2288-10-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Graham A.L., Lopez-Class M., Mueller N.T., Mota G., Mandelblatt J. Efficiency and cost-effectiveness of recruitment methods for male Latino smokers. Health Educ. Behav. 2011;38:293–300. doi: 10.1177/1090198110372879. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Harris K.J., Ahluwalia J.S., Catley D., Okuyemi K.S., Mayo M.S., Resnicow K. Successful recruitment of minorities into clinical trials: The Kick It at Swope project. Nicotine Tob. Res. 2003;5:575–584. doi: 10.1080/1462220031000118540. [DOI] [PubMed] [Google Scholar]
- 25.Okuyemi K.S., Cox L.S., Nollen N.L., Snow T.M., Kaur H., Choi W., Nazir N., Mayo M.S., Ahluwalia J.S. Baseline characteristics and recruitment strategies in a randomized clinical trial of African-American light smokers. Am. J. Health Promot. 2007;21:183–191. doi: 10.4278/0890-1171-21.3.183. [DOI] [PubMed] [Google Scholar]
- 26.Webb M.S., Seigers D., Wood E.A. Recruiting African American smokers into intervention research: Relationships between recruitment strategies and participant characteristics. Res. Nurs. Health. 2009;32:86–95. doi: 10.1002/nur.20299. [DOI] [PubMed] [Google Scholar]
- 27.McDonald P.W. Population-based recruitment for quit-smoking programs: An analytic review of communication variables. Prev. Med. 1999;28:545–557. doi: 10.1006/pmed.1998.0479. [DOI] [PubMed] [Google Scholar]
- 28.McIntosh S., Johnson T., Wall A.F., Prokhorov A.V., Calabro K.S., Ververs D., Assibey-Mensah V., Ossip D.J. Recruitment of community college students into a web-assisted tobacco intervention study. JMIR Res. Protoc. 2017;6:e79. doi: 10.2196/resprot.6485. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Cartujano-Barrera F., Azogini C., McIntosh S., Bansal-Travers M., Ossip D.J., Cupertino A.P. Developing graphic messages for vaping prevention among Black and Latino adolescents: Participatory research approach. J. Particip. Med. 2021;13:e29945. doi: 10.2196/29945. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.United States Census Bureau QuickFacts Hackensack City, New Jersey. [(accessed on 6 June 2022)]; Available online: https://www.census.gov/quickfacts/hackensackcitynewjersey.
- 31.United States Census Bureau QuickFacts Rochester City, New York. [(accessed on 6 June 2022)]; Available online: https://www.census.gov/quickfacts/rochestercitynewyork.
- 32.Harris P.A., Taylor R., Thielke R., Payne J., Gonzalez N., Conde J.G. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J. Biomed Inform. 2009;42:377–381. doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Tercyak K.P., Phan L., Gallegos-Carrillo K., Mays D., Audrain-McGovern J., Rehberg K., Li Y., Cartujano-Barrera F., Cupertino A.P. Prevalence and correlates of lifetime e-cigarette use among adolescents attending public schools in a low income community in the US. Addict. Behav. 2021;114:106738. doi: 10.1016/j.addbeh.2020.106738. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.United States Bureau of the Census Geographic areas reference manual. US Department of Commerce, Economics and Statistics Administration. Bur. Census. 1998:257–263. [Google Scholar]
- 35.Asfar T., Koru-Sengul T., Antoni M.A., Dorsey A., Ruano Herreria E.C., Lee D.J., Webb Hooper M. Recruiting racially and ethnically diverse smokers seeking treatment: Lessons learned from a smoking cessation randomized clinical trial. Addict. Behav. 2022;124:107112. doi: 10.1016/j.addbeh.2021.107112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Brodar K.E., Hall M.G., Butler E.N., Parada H., Stein-Seroussi A., Hanley S., Brewer N.T. Recruiting diverse smokers: Enrollment yields and cost. Int. J. Environ. Res. Public Health. 2016;13:1251. doi: 10.3390/ijerph13121251. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Tingen M.S., Andrews J.O., Heath J., Turnmire A.E., Waller J.L., Treiber F.A. Comparison of enrollment rates of African-American families into a school-based tobacco prevention trial using two recruitment strategies in urban and rural settings. Am. J. Health Promot. 2013;27:e91–e100. doi: 10.4278/ajhp.110204-QUAN-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Bonevski B., Randell M., Paul C., Chapman K., Twyman L., Bryant J., Brozek I., Hughes C. Reaching the hard-to-reach: A systematic review of strategies for improving health and medical research with socially disadvantaged groups. BMC Med. Res. Methodol. 2014;14:42. doi: 10.1186/1471-2288-14-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Whitaker C., Stevelink S., Fear N. The use of Facebook in recruiting participants for health research purposes: A systematic review. J. Med. Internet Res. 2017;19:e290. doi: 10.2196/jmir.7071. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Teens’ Social Media Habits and Experiences. [(accessed on 1 March 2022)]. Available online: https://www.pewresearch.org/internet/2018/11/28/teens-social-media-habits-and-experiences.
- 41.New Report Finds Snapchat, Tiktok, Outpace Instagram in Teen Popularity. [(accessed on 1 March 2022)]. Available online: https://www.socialmediatoday.com/news/new-report-finds-snapchat-tiktok-outpace-instagram-in-teen-popularity/586614.
- 42.García A.A., Zuñiga J.A., Lagon C. A Personal touch: The most important strategy for recruiting Latino research participants. J. Transcult. Nurs. 2017;28:342–347. doi: 10.1177/1043659616644958. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Padilla Y.C., Villalobos G. Cultural responses to health among Mexican American women and their families. Fam. Community Health. 2007;30:S24–S33. doi: 10.1097/00003727-200701001-00005. [DOI] [PubMed] [Google Scholar]
- 44.Elder J.P., Shuler L., Moe S.G., Grieser M., Pratt C., Cameron S., Hingle M., Pickrel J.L., Saksvig B.I., Schachter K., et al. Recruiting a diverse group of middle school girls into the trial of activity for adolescent girls. J. Sch. Health. 2008;78:523–531. doi: 10.1111/j.1746-1561.2008.00339.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Wiemann C.M., Chacko M.R., Tucker J.C., Velasquez M.M., Smith P.B., DiClemente R.J., von Sternberg K. Enhancing recruitment and retention of minority young women in community-based clinical research. J. Pediatr. Adolesc. Gynecol. 2005;18:403–407. doi: 10.1016/j.jpag.2005.09.006. [DOI] [PubMed] [Google Scholar]
- 46.Sexual and Gender Minorities Formally Designated as a Health Disparity Population for Research Purposes. [(accessed on 1 March 2022)]; Available online: https://www.nimhd.nih.gov/about/directors-corner/messages/message_10-06-16.html.
- 47.Crissman H.P., Stroumsa D., Kobernik E.K., Berger M.B. Gender and frequent mental distress: Comparing transgender and non-transgender individuals’ self-rated mental health. J. Womens Health. 2019;28:143–151. doi: 10.1089/jwh.2018.7411. [DOI] [PubMed] [Google Scholar]
- 48.Kidd S.A., Howison M., Pilling M., Ross L.E., McKenzie K. Severe mental illness in LGBT populations: A scoping review. Psychiatr. Serv. 2016;67:779–783. doi: 10.1176/appi.ps.201500209. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Steele L.S., Daley A., Curling D. LGBT identity, untreated depression, and unmet need for mental health services by sexual minority women and trans-identified people. J. Womens Health. 2017;26:116–127. doi: 10.1089/jwh.2015.5677. [DOI] [PubMed] [Google Scholar]
- 50.Yarns B.C., Abrams J.M., Meeks T.W., Sewell D.D. The mental health of older LGBT adults. Curr. Psychiatry Rep. 2016;18:60. doi: 10.1007/s11920-016-0697-y. [DOI] [PubMed] [Google Scholar]
- 51.Floyd S.R., Pierce D.M., Geraci S.A. Preventive and primary care for lesbian, gay and bisexual patients. Am. J. Med. Sci. 2016;352:637–643. doi: 10.1016/j.amjms.2016.05.008. [DOI] [PubMed] [Google Scholar]
- 52.Qureshi R.I., Zha P., Kim S. Health care needs and care utilization among lesbian, gay, bisexual, and transgender populations in New Jersey. J. Homosex. 2018;65:167–180. doi: 10.1080/00918369.2017.1311555. [DOI] [PubMed] [Google Scholar]
- 53.Shiu C., Kim H.-J., Fredriksen-Goldsen K. Health care engagement among LGBT older adults: The role of depression diagnosis and symptomatology. Gerontologist. 2017;57:S105–S114. doi: 10.1093/geront/gnw186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Rhodes S.D., Alonzo J., Mann-Jackson L., Tanner A.E., Vissman A.T., Martinez O., Rodriguez-Celedon R., Garcia J.M., Arellano J.E., Song E.Y., et al. Selling the product: Strategies to increase recruitment and retention of Spanish-speaking Latinos in biomedical research. J. Clin. Transl. Sci. 2018;2:147–155. doi: 10.1017/cts.2018.314. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Ozer E.J. Youth-Led Participatory Action Research: Developmental and Equity Perspectives. Adv. Child Dev. Behav. 2016;50:189–207. doi: 10.1016/bs.acdb.2015.11.006. [DOI] [PubMed] [Google Scholar]
- 56.Kirchner T.R., Villanti A.C., Cantrell J., Anesetti-Rothermel A., Ganz O., Conway K.P., Vallone D.M., Abrams D.B. Tobacco retail outlet advertising practices and proximity to schools, parks and public housing affect Synar underage sales violations in Washington, DC. Tobacco Control. 2015;24:e52–e58. doi: 10.1136/tobaccocontrol-2013-051239. [DOI] [PubMed] [Google Scholar]
- 57.Iglesias-Rios L., Parascandola M. A historical review of R.J. Reynolds’ strategies for marketing tobacco to Hispanics in the United States. Am. J. Public Health. 2013;103:e15–e27. doi: 10.2105/AJPH.2013.301256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Dai H., Hao J., Catley D. Vape shop density and socio-demographic disparities: A US Census tract analysis. Nicotine Tob. Res. 2017;19:1338–1344. doi: 10.1093/ntr/ntx063. [DOI] [PubMed] [Google Scholar]
- 59.Venugopal P.D., Morse A.L., Tworek C., Chang H.W. Socioeconomic Disparities in vape shop density and proximity to public schools in the conterminous United States, 2018. Health Promot. Pract. 2020;21:9S–17S. doi: 10.1177/1524839919887738. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Cartujano-Barrera F., Perales J., Arana E., Sanderson Cox L., Yeh H.W., Ellerbeck E.F., Richter K.P., Cupertino A.P. Increasing access to smoking cessation treatment among Latino smokers using case management. J. Smok. Cessat. 2019;14:168–175. doi: 10.1017/jsc.2019.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Cartujano-Barrera F., Arana-Chicas E., Ramírez-Mantilla M., Perales J., Sanderson Cox L., Ellerbeck E.F., Catley D., Cupertino A.P. “Every day I think about your messages”: Assessing text messaging interaction with Latino smokers. Patient Prefer. Adherence. 2019;13:1213–1219. doi: 10.2147/PPA.S209547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Cartujano-Barrera F., Sanderson Cox L., Arana-Chicas E., Ramírez M., Perales-Puchalt J., Valera P., Díaz F.J., Catley D., Ellerbeck E.F., Cupertino A.P. Feasibility and acceptability of a culturally- and linguistically-adapted smoking cessation text messaging intervention for Latino smokers. Front. Public Health. 2020;8:269. doi: 10.3389/fpubh.2020.00269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Cartujano-Barrera F., Arana-Chicas E., Catley D., Sanderson Cox L., Diaz F.J., Ellerbeck E.F., Graves K., Ogedegbe C., Cupertino A.P. Decídetexto: Mobile cessation support for Latino smokers. Study protocol for a randomized controlled trial. Contemp. Clin. Trials. 2020;99:106188. doi: 10.1016/j.cct.2020.106188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Cartujano-Barrera F., D’Abundo M.L., Arana-Chicas E., Chock S., Valera P., Kamen C.S., Cupertino A.P. Barriers and facilitators of smoking cessation among Latinos living with HIV: Perspectives from key leaders of community-based organizations and clinics. Int. J. Environ. Res. Public Health. 2021;18:3437. doi: 10.3390/ijerph18073437. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Israel B.A., Schulz A.J., Parker E.A., Becker A.B. Review of community-based research: Assessing partnership approaches to improve public health. Annu. Rev. Public Health. 1998;19:173–202. doi: 10.1146/annurev.publhealth.19.1.173. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.