Abstract
Introduction:
Racial/ethnic minority communities are underrepresented in research. Medical mistrust and mistreatment, discrimination, and a lack of diverse research workforce may influence recruitment and engagement. Engaging Latinx immigrants for research presents unique recruitment challenges, especially for biobehavioral research which is not well-explored. The purpose of this paper is to describe and examine the effect of targeted strategies for recruiting young adult, Latinx immigrants.
Methods:
Recruitment occurred in 2017 to 2019 in an ongoing, longitudinal, community-engaged research study examining risk and resilience factors for health outcomes in Latinx immigrants. Strategies included active recruitment (e.g., community-based events and public events) and passive recruitment (e.g., word-of-mouth and radio and flyer advertisements). Logistic regression analysis was conducted to examine the influence of type of recruitment on participant enrollment.
Results:
The study enrolled 391 participants of 701 interested individuals (55%). Greater odds of enrollment were among participants recruited through radio and flyer advertisements (AOR=2.90, 95%CI[1.59, 5.27], p=0.001), word-of-mouth (AOR=2.50, 95%CI[1.55, 4.03], p<0.000), or community-based organization (CBO) events (AOR=1.68, 95%CI[1.19, 2.38], p=0.003).
Conclusions:
Passive recruitment strategies through trusted sources increased enrollment of Latinx immigrants in biobehavioral research. Future recruitment efforts should leverage trusted sources to disseminate recruitment materials addressing barriers to recruiting Latinx participants for research.
Keywords: Recruitment, immigrant health, Latinx populations, community-based participatory research, community health, cultural diversity
Introduction
Latinx1 individuals comprise 18% of the United States (U.S.) population (Noe-Bustamante, Lopez, & Krogstad, 2020), but only represent 9.3% of participants enrolled in National Institute of Health (NIH)-funded research (Office of Research on Women’s Health, 2019). A myriad of factors that further marginalize Latinx immigrants may contribute to their underrepresentation in research and health care compared to U.S.-born Latinx individuals. Underrepresentation of Latinx individuals in research poses challenges to advance public health, namely to adequately understand disease prevalence and symptom expression of illnesses affecting the Latinx population, and limits knowledge of culturally-relevant strategies that can reduce existing health disparities and promote health equity (George, Duran, & Norris, 2014; Moreno-John et al., 2004; Salman, Nguyen, Lee, & Cooksey-James, 2016; Whitfield, 2005). Adequate representation of Latinx individuals in research holds promise of increasing generalizability of research findings, culturally tailoring evidence-based practices, and improving population health of Latinx individuals (Salman et al., 2016). Factors contributing to the underrepresentation of Latinx participants in research, however, are multifaceted and complex and attributed to historical and contemporary influences.
Historical Harms against Underrepresented Groups in Research
The relationship among researchers, research institutions, and racial/ethnic minoritized communities is punctuated by historical mistreatment and unethical research practices globally. In the name of science, researchers and healthcare professionals conducted experiments to understand untreated disease progression (e.g., Tuskegee syphilis experiment [Cobb, 1973]), to cultivate and proliferate cells used in biomedical research (e.g., “HeLa cells” from the late Henrietta Lacks; [Khan, 2011]), and to understand the effects of ionizing radiation and radioactive contamination on the human body (Washington, 2006), among others. Specific historical harms in research against the Latinx community occurred both in the U.S., (e.g., the experimentation of contraceptives in Latinx women in San Antonio [Kim, 2012] and Puerto Rico [Blakemore, 2019]) and in immigrant’s home countries, such as the Guatemala syphilis experiment (Reverby, 2012) and Cariporide trial in Argentina (De Young & Nelson, 2000). A long legacy of historical harms to racial/ethnic minoritized groups by researchers and healthcare systems contribute to their underrepresentation in research (Moreno-John et al., 2004; Salman et al., 2016; Shahabi et al., 2011). A hallmark of these abuses is illegal human experimentation without proper consent and fair treatment (De Young & Nelson, 2000; Kim, 2012; Reverby, 2012). The downstream effect of these abuses has created a culture of mistrust and fear of research among racial/ethnic minoritized groups, thereby creating barriers to research participation (Clark et al., 2019; Luebbert & Perez, 2016; Scharff et al., 2010; Smirnoff et al., 2018).
Recognition of these events as human rights abuses led to notable efforts to prevent unethical research practices. Institutional Review Boards (IRB) – the oversight committees over research at U.S. institutions - require training on the rights and welfare of human subjects in research (Steneck, 2007). Additionally, the NIH developed guidelines to promote the inclusion of underrepresented groups in NIH-funded clinical research (NIH, 2017). There were also attempts to provide reparations for these abuses, such as financial compensation to the family of Henrietta Lacks (Witze, 2020).
Prejudice, Discrimination, and Racism in Healthcare and Research
Minoritized groups experience significant discrimination and racism in everyday life (Pew Research Center, 2017; Robert Wood Johnson Foundation, 2017) and in healthcare systems (Benjamins & Middleton, 2019; Institute of Medicine, 2003), further increasing their mistrust in research and clinical care (Brandon, Isaac & LaVeist, 2005; García, Zuñiga, & Lagon, 2017; Moreno-John et al., 2004). The implications of unequal treatment for minoritized groups are lower healthcare utilization, poorer patient-provider relationships, and poorer health outcomes (Lee, Ayers, & Kronenfeld, 2009; Quach et al., 2012; Rivenbark & Ichou, 2020). Latinx individuals face additional challenges in research and healthcare settings including fear of deportation for disclosing an undocumented immigration status, lack of linguistically-appropriate materials, and interpretation during clinical encounters (López-Cevallos & Harvey, 2016; Steinberg, Valenzuela-Araujo, Zickafoose, Kieffer, & DeCamp, 2016). Cultural differences in health beliefs and attitudes among researchers and Latinx participants and language/literacy barriers may influence their willingness to participate in research (Huang, Ezenwa, Wilkie, & Judge, 2013; Salman, Nguyen, Lee, & Cooksey-James, 2016). A lack of understanding of cultural factors among providers and researchers could further contribute to negative experiences within the healthcare system and for engaging and recruiting Latinx individuals in research.
Lack of Diverse Research Workforce and Infrastructure to Engage Underrepresented Groups
The lack of representation of doctorally-prepared researchers from racial/ethnic minoritized groups in academic positions further contributes to the challenges in engaging underrepresented groups in research. Approximately 1.6% of U.S. adults hold a doctorate degree2, but of those with a doctorate degree, a mere 5.7% are Latinx (U.S. Census Bureau, 2017). Historically, research studies were conducted by White researchers where White participants largely comprise study samples (George et al., 2014). Individuals from underrepresented groups are more likely to participate in research when the research staff demonstrates cultural congruence, understands cultural nuances and linguistics, and relates to their lived experiences (Doran, Castelblanco, & Mijanovich, 2018; García et al., 2017; George et al., 2014). A lack of access to bilingual and bicultural researchers creates additional challenges to develop cultural- and linguistically-appropriate recruitment strategies to engage Latinx individuals in research (García et al., 2017).
An infrastructure that optimally facilitates research participation by Latinx individuals is also lacking. Research studies are often introduced to participants through their healthcare providers, creating missed opportunities to engage underrepresented groups in research for individuals without a source of care (Caraballo et al., 2020). Individuals from underrepresented groups also encounter limited access to healthcare due to availability of resources, lack of insurance, and face employment constraints from working multiple jobs (García et al., 2017; Luebbert & Perez, 2016; Moreno-John et al., 2004; Salman et al., 2016). The Latinx community also have higher uninsured rates than Black, White, and Asian individuals in the U.S. (19.0%, 11.5%, 7.5%, 6.8%, respectively; Artica, Orgera & Damico, 2020).
Sociopolitical Climate
The sociopolitical climate has become increasingly hostile for immigrants. Federal immigration policies enforced increased patrol at the U.S.-Mexico border, detained immigrants, forbade sanctuary cities from receiving federal assistance, and increased use of Immigration and Customs Enforcement (ICE) agents (Ink, 2020). Such immigration policies and enforcement practices has created a restrictive immigration climate in the U.S. Additionally, policies enacted to reduce the spread of communicable diseases to allow for immigration into the U.S. (DeSisto et al., 2015) may further contribute to these negative experiences. As a result, undocumented, Latinx immigrants may feel reluctant to participate in research because of instilled fears of deportation (Doran et al., 2018; García et al., 2017) and face additional barriers to research participation such as lacking a driver’s license or social security number (Salman et al., 2016) to receive study compensation.
Several states, however, refused to enforce immigration laws to protect immigrant communities (Ink, 2020) and have become sanctuary jurisdictions. Many U.S. cities implemented measures to provide immigrants access to health care, legal counsel, and municipal identification, regardless of their immigration status (Ink, 2020; National Immigration Law Center, 2015). Sanctuary policies, however, vary by state with some states supporting the restrictive immigration policies, and others prohibiting them (National Conference of State Legislatures, 2019). Restrictive immigration laws may create a harsh environment for Latinx immigrants and further exacerbate their experiences with discrimination (López-Cevallos, & Harvey, 2016) which has contributed to mistrust in research.
Strategies to Mitigate Barriers for Recruitment of Latinx Participants
Several recruitment and engagement strategies are used to mitigate research participation barriers among Latinx participants and hold promise for effective recruitment in research (García et al., 2017). Community-engaged strategies, snowballing sampling methods, direct contact with participants, and using bilingual and bicultural research staff fostered trust and increased engagement in research of Latinx participants (Nápoles-Springer et al., 2000; Mier et al., 2006; García et al., 2017). These strategies, however, have generally been implemented in behavioral studies and have not been well-explored in biobehavioral research where anthropometric measurements and biospecimens are collected. Gathering biospecimens from Latinx participants may create additional challenges for engagement and recruitment for biobehavioral research. To date, there is limited knowledge on recruitment and engagement of Latinx, young adult immigrants in biobehavioral research. To address this gap, we sought to examine the effect of targeted strategies for recruitment of young adult, Latinx immigrants into a biobehavioral research study.
Methods
Study Design
The Salud (Health), Estrés (Stress), y Resiliencia (Resiliency) (SER) Hispano Study is an ongoing longitudinal, observational, community-engaged research (CEnR) study that follows a cohort of young adult, Latinx immigrants in the U.S. Southeast across two years (N=391). The overarching aim of the study is to determine the cumulative impact of acculturation stress and resilience on health outcomes among Latinx immigrants over time, in an emerging Latinx immigrant community. This study utilized CEnR approaches for recruitment, engagement, and retention by partnering with the chief executive officer (CEO) of a community organization and recruitment coordinators who reside in the community where recruitment occurred. All procedures occurred outside the healthcare system. A combination of self-reported measures (e.g., standardized surveys), anthropometric measurements (e.g., height, weight, blood pressure), and biospecimens (e.g., blood and urine) were collected in participants’ homes or in the partnering community organization’s office.
Community Partners
The research team partnered with a local, trusted community-based organization (CBO) that provides programs in education, economic development, health and wellness, and community advocacy for Latinx communities. The CBO serves over 11,000 immigrants annually and has a long-established relationship with the academic institution. The CBO’s CEO served as a study co-investigator. A bilingual, bicultural community specialist was hired to foster trust with the Latinx community, coordinated outreach programs and events for engagement and recruitment, and developed strategies for study promotion in the Latinx community. The CBO and research team worked together through an iterative process to provide feedback to the study design, selection of key measures, and engagement and recruitment efforts.
Sample and Population
Recruitment occurred across three local counties in the U.S. Southeast, within an hour radius of the academic institution. We selected this radius to reduce the time between biospecimen collection and laboratory processing. The Latinx community represented 8.6%, 10.4%, and 13.7% of the counties’ population, respectively (U.S. Census Bureau, 2019). Eligible participants included young adults who: (a) self-identified as Latinx, (b) immigrated from a Spanish-speaking country (e.g., Latin America or Caribbean) within the past year, and (c) were between ages 18 and 44 years, (ages when immigrants are most likely to arrive in the U.S. [U.S. Department of Homeland Security, 2016] and when risk behaviors and mental health conditions peak [Mulye et al., 2009]). Exclusion criteria included individuals who planned to move from the region within two years because the study was limited to the three selected counties. This study received IRB approved from Duke University Health System.
Recruitment Strategies and Procedures
Using CEnR approaches, we developed a comprehensive, strategic recruitment plan that included: (a) developing a recruitment team, (b) identifying recruitment efforts within the CBO and events where Latinx individuals frequented, (c) gathering information of existing partnerships, and (d) developing cultural- and linguistic-appropriate recruitment materials. Recruitment sites were selected using existing partnerships with the study team members and the CBO, who established rapport with the Latinx community and other local community organizations.
We selected recruitment strategies addressing common barriers to research participation among Latinx immigrants (Table 1). Barriers were identified through a literature review, experiences from the research team on previous studies, and conversations with CBO staff. The research team and CBO brainstormed innovative solutions that capitalized on the CBO’s trust and reputation in the community and selected recruitment locations that were not local to the academic institution. The CBO coordinated community events for engagement and recruitment so that participants associated the study with an academic researcher staff and trusted community staff, most who were bilingual and bicultural. Weekly meetings were held to reevaluate and revise recruitment strategies. Revisions were made through an iterative process based on data gathered from recruited and enrolled participants.
Table 1.
Targeted Recruitment Efforts to Address Barriers to Research Participation Among Latinx Participants
| Barriers | Strategy |
|---|---|
| Historical and contemporary medical mistrust and mistreatment due to prejudice, discrimination, and racism in healthcare and research encounters |
|
| Difficulty navigating complex largely, monolingual health care settings |
|
| Fear of disclosing documentation status |
|
| Providing social security numbers for participant compensation |
|
| Underrepresentation of Latinx researchers in workforce |
|
| Immigrant-hostile climate |
|
Note. CBO = community-based organization; ICE = Immigration and Customs Enforcement
We retrospectively reviewed data gathered by the study team from participants recruited during 2018 and 2019. Data included participants’ contact and demographic information, recruitment location, and method of recruitment (e.g., community outreach, advertisement, social media, email list servs, and word-of-mouth). We assessed the method of recruitment used to recruit and enroll participants and grouped strategies into two types of recruitment: active recruitment and passive recruitment (Estabrooks et al., 2017), informed by effective recruitment methods salient to the Latinx community (García et al., 2017).
Active recruitment.
We defined active recruitment strategies as an activity where a research study team member approached, engaged, and initiated contact face-to-face with participants for recruitment. Active recruitment occurred through community outreach with local community organizations or at CBO-sponsored events and fairs well-known in the Latinx community. We stratified active recruitment into two groups: (1) community-based organization events, defined as recruitment through CBO-sponsored events (e.g., classes, scheduled activities, and local events), and (2) public events, defined as events not sponsored by the CBO, such as local festivals, health fairs, or outpatient clinics. Potential participants were screened for enrollment within a week of recruitment.
Passive recruitment.
We defined passive recruitment strategies as an activity where potential participants initiated contact with the study team for recruitment, without face-to-face interaction with study personnel. Recruitment occurred through word-of-mouth and materials including flyers and radio advertisements that were developed using cultural, linguistic, and age-specific content to appeal to a diverse, Latinx community. Radio and flyer advertisements included the study and partnering CBO logos, study description and contact information, and tailored infographics for various audiences (e.g., male, female, family). Advertisements were disseminated by the community specialist and recruitment staff, who were trusted and familiar persons in the Latinx community. Two types of bilingual flyers were created including an electronic version disseminated through email listservs and social media (e.g., CBO’s Facebook page), and a paper flyer disseminated and posted within the CBO and other community locations (e.g., business, grocery stores, restaurants, clinics). Copies of the flyers were also left at community establishments for participants to grab. Passive recruitment strategies were stratified into two groups: (a) advertisements, such as use of radio announcements and flyers, and (b) word-of-mouth, defined as referral from individuals interested in the study (e.g., family and friends). Interested participants contacted the research team via phone or email and were further screened for eligibility.
Recruitment and Engagement Procedures
After establishing initial contact, participants were screened for eligibility. A three-call threshold was placed to reach participants. The screening call consisted of explaining the study’s purpose, participant expectations, and assessing for eligibility. Participant expectations included completing five visits throughout a 2-year period, and willingness to have their body measurements and biospecimens obtained. Baseline visits were scheduled at participants’ homes or at the CBO to alleviate transportation barriers, promote privacy, and accommodate work schedules. Survey items and informed consents were offered in Spanish or English-language by a bilingual, bicultural research team member. Written consent was obtained at the initial visit where participants were enrolled into the study.
We implemented several strategies to engage and retain participants, such as sending welcome emails, reminders about study visits and events, quarterly updates of study findings, and invitations to attend an annual symposium to learn about preliminary study findings and local community resources. Messages and postcards were sent to participants to celebrate life events (e.g., new births and birthdays). During the COVID-19 pandemic, participants were also sent information regarding COVID-19 testing and vaccination sites and available resources to address their social and health needs.
Statistical Analysis
Descriptive statistics were analyzed to describe the characteristics of recruited participants and type of recruitment strategies. Non-directional statistical tests were conducted with significance set at 0.05 for all tests and were analyzed using SPSS, version 27 (IBM Corp, 2020). Chi-square tests were conducted to test the association between type of recruitment strategy and participant enrollment. Logistic regression analysis was conducted to examine which recruitment strategy best predicted participant enrollment. The multivariate logistic model included the four recruitment strategies and the primary outcome, participant enrollment. Adjusted odds ratios and their 95% confidence intervals were reported to address clinical relevance and effect size.
Results
Figure 1 depicts the flow diagram of participant enrollment. Table 2 presents the sample characteristics of recruitment strategies and participants enrolled in the study. Among 701 participants approached for recruitment, 391 participants enrolled (55.8%). Most enrolled participants were women (63%) and nearly half (48.9%) were reached within one phone call. Most participants were approached using active strategies, with 43.5% of participants approached through community-based organization events, followed by public events (32.1%). Among passive recruitment strategies, more participants were approached through word-of-mouth (15.4%) compared with radio and flyer advertisements (9.0%).
Figure 1.
CONSORT Diagram of Participant Enrollment
Table 2.
Sample Characteristics
| Characteristics | n (%) |
|---|---|
| Enrolled (N = 701) | |
| Yes | 391 (55.8%) |
| No | 310 (44.2%) |
| Gender (N = 701) | |
| Male | 262 (37.3%) |
| Female | 439 (62.5%) |
| Best Time to Contact (N = 701) | |
| No preference | 87 (12.4%) |
| Anytime | 207 (29.5%) |
| Morning | 81 (11.5%) |
| Afternoon | 150 (21.4%) |
| Evening | 157 (22.4%) |
| Weekend | 19 (2.7%) |
| Number of Calls (N = 700) | |
| 1 | 343 (48.9%) |
| 2 | 163 (23.2%) |
| 3 | 194 (27.6%) |
| Type of Recruitment Strategy (N = 701) | |
| Passive | |
| Advertisement | 63 (9.0%) |
| Word of Mouth | 108 (15.4%) |
| Active | |
| Community-Based Organization Events | 305 (43.5%) |
| Public Events | 225 (32.1%) |
Type of recruitment strategy was significantly associated with participant enrollment (x2 = 13.33, df = 1, p < 0.001) (Table 3). Among participants recruited through active recruitment strategies, roughly 52% enrolled into the study and nearly 48% did not enroll. Among participants enrolled using passive recruitment strategies, roughly 68% enrolled into the study and 32% did not enroll.
Table 3.
Chi-Square Analysis of Recruitment Strategy Type and Participant Enrollment, N = 701
| Active Recruitment n (%) |
Passive recruitment n (%) |
x 2 | df | p-value | |
|---|---|---|---|---|---|
| Enrollment Status | 13.33 | 1 | p < 0.001 | ||
| Enrolled | 275 (51.9%) | 116 (67.8%) | |||
| Did Not Enroll | 255 (48.1%) | 55 (32.2%) |
Note. df = degrees of freedom. Active recruitment included face-to-face recruitment where a research study team member initiated contact with potential participants at public events and community-based organization events. Passive recruitment included recruitment where potential participants initiated contact with the study team for recruitment and occurred through word-of-mouth and flyers and radio advertisements.
The odds of enrollment were 2.9 times greater when participants were recruited through radio and flyer advertisements compared with participants recruited through public events (AOR = 2.90, 95%CI [1.59, 5.27], p = 0.001) (Table 4). The odds of enrollment were 2.5 times greater and nearly 1.7 times greater when participants were recruited through word-of-mouth (AOR = 2.50, 95%CI [1.55, 4.03], p < 0.000) and community-based organization events (AOR = 1.68, 95%CI [1.19, 2.38], p = 0.003), respectively, compared with recruitment through public events.
Table 4.
Logistic Regression Analysis of Type of Recruitment Strategy and Participant Enrollment
| AOR | 95%CI | p-value | |
|---|---|---|---|
| Type of Recruitment Strategy | |||
| Public event | Ref. | Ref. | Ref. |
| Advertisement | 2.90 | (1.59, 5.27) | p = 0.001 |
| Word of mouth | 2.50 | (1.55, 4.03) | p < 0.000 |
| Community-Based Organization Events | 1.68 | (1.19, 2.38) | p = 0.003 |
Note: CI = confidence interval; AOR = adjusted odds ratio; Ref. = Referent group
Discussion
This study identified active and passive recruitment strategies to enroll young adult, Latinx immigrants into a longitudinal, biobehavioral study. Undocumented immigration status, language barriers, and cultural health beliefs and attitudes are noted barriers to recruiting Latinx immigrants in research (López-Cevallos & Harvey, 2016; Salman et al., 2016; Steinberg et al., 2016). We sought to mitigate these barriers by not requiring participants to disclose their immigration status or provide social security numbers for study compensation and used bicultural and bilingual research staff to develop and implement recruitment strategies. Overall, participants exposed to radio and flyer advertisements had greater odds of enrollment into our biobehavioral study. This study identified useful strategies targeting barriers specific to Latinx immigrants that may improve their representation in future research.
Although most participants were recruited using active recruitment strategies, these strategies generated less enrollment than passive strategies. This finding differs from other studies that found face-to-face recruitment through CBOs highly effective in recruiting participants from vulnerable populations (Greiner et al., 2014; Reidy, Orpinas, & Davis, 2012; Estabrooks et al., 2017; Wieland, Doubeni, & Sia, 2020). Difference in findings may be explained by strategies used for active recruitment in other studies, such telephone outreach, or promotional activities in community settings (Estabrooks et al., 2017; Sha, McAvinchey, Quiroz, & Moncada, 2017). Due to the IRB restrictions at our institution, we were unable to employ these recruitment strategies further highlighting the barriers that institutional research infrastructures can create for recruitment. Further, although the partnering CBO—who established trust in the Latinx community—facilitated study promotion at community events, there may have been an initial skepticism to engage in the study until individuals established their own trust with the research study team.
Differences in findings may also be explained by the smaller sample sizes in the passive recruitment strategies. Passive recruitment strategies were disseminated through email listservs, social media, and flyers posted and left at CBOs and other community establishments. Therefore, we were unable to document the number of individuals exposed to radio and flyer advertisements to estimate the yield in the total population. Future research should consider using population-based approaches to examine the most effective recruitment strategies to recruit Latinx participants. Future research studies should also consider using random sampling designs to identify which recruitment strategies are effective in engagement and retention of Latinx participants.
To our surprise, passive recruitment strategies using radio and flyer advertisements and word-of-mouth generated more enrollment of Latinx, young adult immigrants. Younger individuals may appeal to electronic formats for recruitment (e.g., flyers sent via social media or email listservs) compared to older individuals. Future research should consider exploring effective recruitment strategies for Latinx immigrants across age groups. A major strength of passive strategies is that interested participants can engage in recruitment without revealing their identity, which may be beneficial to undocumented individuals who fear disclosing their immigration status. Word-of-mouth may also facilitate participant enrollment. The Latinx culture places strong beliefs in familism, which place high values on family life (Landale, Oropesa, & Bradatan, 2006). A strength to using word-of-mouth is the ability for participants to receive referral for study participation from a trusted person. Radio and flyer advertisements from trusted sources and from individuals who participants could relate to (e.g., ethnic and language concordance), may have played a role and is described as important strategies in the literature (Avery, Hernandez, Hebl, 2004; Kayrouz, Dear, Karin, & Titov, 2016). Passive strategies, when leveraged with trusted sources, may be a promising approach to overcoming mistrust in research and healthcare experienced in Latinx communities.
This finding also sheds light on the characteristics of individuals enrolled through passive recruitment strategies. Participants self-selected and contacted the study team. Therefore, these individuals may be more engaged and willing for study participation than individuals approached through active recruitment strategies. Recruitment efforts should consider targeting popular social group settings and social media platforms among the Latinx community to increase recruitment into future research. Use of social media platforms may also assist with tracking the number of people viewing advertisements for recruitment in research studies to accurately assess participant engagement with these recruitment strategies.
Limitations.
This study has several limitations. The sample size for the passive recruitment strategies was small which may have potentially overinflated the strength of association between recruitment strategies used and participant enrollment. This study was limited in the ability to track the number of people who were exposed to advertisements. Thus, there may have been more participants who expressed study interest that could not be accounted. This study focused on one segment of the Latinx population. Thus, the generalizability of the study findings are not applicable to children, older adults, gender identities, and individuals living in other Latinx countries. Lastly, the study design was limited in the ability to examine the cost-effectiveness of multiple recruitment strategies compared to “head to head.” Therefore, cause and effect relationships between type of recruitment strategy and participant enrollment cannot be ascertained.
Conclusion
The Latinx population experiences significant health disparities yet are underrepresented in research aiming to improve health outcomes. This study provides a guide of culturally-relevant recruitment strategies that can increase Latinx representation in future research. Study findings can inform future recruitment efforts for Latinx immigrants that consider the resource investment for various active and passive recruitment strategies. These strategies can also be considered for healthcare and community-based interventions targeting the Latinx population. More research is needed, however, to examine the cost-effectiveness of different strategies to recruit and engage Latinx immigrants in research.
Acknowledgements:
Research reported in this publication was supported by the National Institute on Minority Health and Health Disparities of the National Institutes of Health under Award Number R01MD012249. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Footnotes
Declaration of Conflicting Interests: The authors declare that there is no conflict of interest.
Latinx refers to a gender-inclusive term that includes Hispanic, Latino, Latina.
This data includes all doctorate degrees such as Ph.D., M.D., Ed.D, J.D., etc. Therefore, the number of research-oriented doctorates are likely lower than these estimations.
References
- Artica S, Orgera K & Damico A (2020). Changes in health coverage by race and ethnicity since the ACA, 2010-2018. Kaiser Family Foundation. Retrieved on April 11, 2021 from https://www.kff.org/racial-equity-and-health-policy/issue-brief/changes-in-health-coverage-by-race-and-ethnicity-since-the-aca-2010-2018/ [Google Scholar]
- Avery DR, Hernandez M, & Hebl MR (2004). Who's watching the race? Racial salience in recruitment advertising. Journal of Applied Social Psychology, 34(1), 146–161. [Google Scholar]
- Benjamins MR, & Middleton M (2019). Perceived discrimination in medical settings and perceived quality of care: A population-based study in Chicago. PloS One, 14(4), e0215976. 10.1371/journal.pone.0215976 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blakemore E. (2019). The first birth control pill used Puerto Rican women as guinea pigs. History. Retrieved on October 12, 2021 from https://www.history.com/news/birth-control-pill-history-puerto-rico-enovid [Google Scholar]
- Brandon DT, Isaac LA, & LaVeist TA (2005). The legacy of Tuskegee and trust in medical care: Is Tuskegee responsible for race differences in mistrust of medical care? Journal of the National Medical Association, 97(7), 951. [PMC free article] [PubMed] [Google Scholar]
- Caraballo C, Massey D, Mahajan S, Lu Y, Annapureddy AR, Roy B, … Krumholz HM (2020). Racial and ethnic disparities in access to health care among adults in the United States: A 20-Year National Health Interview Survey analysis, 1999-2018. medRxiv. 10.1101/2020.10.30.20223420 [DOI] [Google Scholar]
- Clark LT, Watkins L, Piña IL, Elmer M, Akinboboye O, Gorham M, Jamerson B, McCullough C, Pierre C, Polis AB, Puckrein G, & Regnante JM (2019). Increasing diversity in clinical trials: Overcoming critical barriers. Current Problems in Cardiology, 44(5), 148–172. 10.1016/j.cpcardiol.2018.11.002 [DOI] [PubMed] [Google Scholar]
- Cobb WM (1973). The Tuskegee syphilis study. Journal of the National Medical Association, 65(4), 345–348. [PMC free article] [PubMed] [Google Scholar]
- DeSisto C, Broussard K, Escobedo M, Borntrager D, Alvarado-Ramy F, & Waterman S (2015). Border lookout: Enhancing tuberculosis control on the United States-Mexico border. The American Journal of Tropical Medicine and Hygiene, 93(4), 747–751. 10.4269/ajtmh.15-0300 [DOI] [PMC free article] [PubMed] [Google Scholar]
- De Young K & Nelson D (2000). Latin America is ripe for trials, and fraud. Retrieved from https://www.washingtonpost.com/archive/politics/2000/12/21/latin-america-is-ripe-for-trials-and-fraud/c9d9891b-18c7-495c-b907-d580eef137e0/ [Google Scholar]
- Doran KM, Castelblanco DG, & Mijanovich T (2018). Undocumented Latino immigrants and research: New challenges in changing times. Journal of Health Care for The Poor and Underserved, 29(2), 645–650. 10.1353/hpu.2018.0048 [DOI] [PubMed] [Google Scholar]
- Estabrooks P, You W, Hedrick V, Reinholt M, Dohm E, & Zoellner J (2017). A pragmatic examination of active and passive recruitment methods to improve the reach of community lifestyle programs: The Talking Health Trial. The International Journal of Behavioral Nutrition and Physical Activity, 14(1), 7. 10.1186/s12966-017-0462-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- García AA, Zuñiga JA, & Lagon C (2017). A personal touch: The most important strategy for recruiting Latino research participants. Journal of the Transcultural Nursing Society, 28(4), 342–347. 10.1177/1043659616644958 [DOI] [PMC free article] [PubMed] [Google Scholar]
- George S, Duran N, & Norris K (2014). A systematic review of barriers and facilitators to minority research participation among African Americans, Latinos, Asian Americans, and Pacific Islanders. American Journal of Public Health, 104(2), e16–e31. 10.2105/AJPH.2013.301706 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greiner KA, Friedman DB, Adams SA, Gwede CK, Cupertino P, Engelman KK, Meade CD, & Hébert JR (2014). Effective recruitment strategies and community-based participatory research: community networks program centers' recruitment in cancer prevention studies. Cancer Epidemiology, Biomarkers & Prevention, 23(3), 416–423. 10.1158/1055-9965.EPI-13-0760 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huang HY, Ezenwa MO, Wilkie DJ, & Judge MK (2013). ResearchTracking: Monitoring gender and ethnic minority recruitment and retention in cancer symptom studies. Cancer Nursing, 36(3), E1–E6. 10.1097/NCC.0b013e31826909a8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- IBM Corp. (2020). IBM SPSS Statistics for Windows, Version 27.0. Armonk, NY: IBM Corp. [Google Scholar]
- Ink S. (2020). President Trump's executive orders on immigration and refugees. Retrieved on April 11, 2021 from https://cmsny.org/trumps-executive-orders-immigration-refugees/ [Google Scholar]
- Institute of Medicine (US) Committee on understanding and eliminating racial and ethnic disparities in health care, Smedley BD, Stith AY, & Nelson AR (Eds.). (2003). Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care. National Academies Press; (US: ). [PubMed] [Google Scholar]
- Kayrouz R, Dear BF, Karin E, & Titov N (2016). Facebook as an effective recruitment strategy for mental health research of hard to reach populations. Internet Interventions, 4, 1–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Khan FA (2011). The immortal life of Henrietta Lacks. The Journal of IMA, 43(2), 93–94. 10.5915/43-2-8609 [DOI] [Google Scholar]
- Kim WO (2012). Institutional review board (IRB) and ethical issues in clinical research. Korean Journal of Anesthesiology, 62(1), 3–12. 10.4097/kjae.2012.62.1.3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Landale NS, Oropesa RS, Bradatan C (2006). Hispanic families in the United States: Family structure and process in an era of family change. In: National Research Council (US) Panel on Hispanics in the United States; Tienda M, Mitchell F, editors. Hispanics and the Future of America. Washington, D.C.: National Academies Press. Retrieved from: https://www.ncbi.nlm.nih.gov/books/NBK19902/ [PubMed] [Google Scholar]
- Lee C, Ayers SL, & Kronenfeld JJ (2009). The association between perceived provider discrimination, healthcare utilization and health status in racial and ethnic minorities. Ethnicity & Disease, 19(3), 330–337. [PMC free article] [PubMed] [Google Scholar]
- López-Cevallos DF, & Harvey SM (2016). Foreign-born Latinos living in rural areas are more likely to experience health care discrimination: Results from Proyecto de Salud para Latinos. Journal of Immigrant and Minority Health, 18(4), 928–934. 10.1007/s10903-015-0281-2 [DOI] [PubMed] [Google Scholar]
- Luebbert R, & Perez A (2016). Barriers to clinical research participation among African Americans. Journal of Transcultural Nursing, 27(5), 456–463. 10.1177/1043659615575578 [DOI] [PubMed] [Google Scholar]
- Mier N, Medina AA, Bocanegra-Alonso A, Castillo-Ruiz O, Acosta-Gonzalez RI, Ramirez JA (2006). Finding respondents from minority groups. Journal of Research Practice, 2(2), 1–11. [Google Scholar]
- Moreno-John G, Gachie A, Fleming CM, Nápoles-Springer A, Mutran E, Manson SM, & Pérez-Stable EJ (2004). Ethnic minority older adults participating in clinical research: Developing trust. Journal of Aging and Health, 16(5 Suppl), 93S–123S. 10.1177/0898264304268151 [DOI] [PubMed] [Google Scholar]
- Mulye TP, Park MJ, Nelson CD, Adams SH, Irwin CE Jr, & Brindis CD (2009). Trends in adolescent and young adult health in the United States. Journal of Adolescent Health, 45(1), 8–24. [DOI] [PubMed] [Google Scholar]
- Nápoles-Springer AM, Grumbach K, Alexander M, Moreno-John G, Forté D, Rangel-Lugo M, & Pérez-Stable EJ (2000). Clinical research with older African Americans and Latinos: Perspectives from the community. Research on Aging, 22(6), 668–691. 10.1177/0164027500226004 [DOI] [Google Scholar]
- National Conference of State Legislatures. (2019). Sanctuary policy FAQ. Retrieved on April 11, 2021 from https://www.ncsl.org/research/immigration/sanctuary-policy-faq635991795.aspx
- National Immigration Law Center. (2015). In cities and states, civil immigration debates in uncivil political climate. Retrieved on April 11, 2021 from https://www.nilc.org/2015/12/22/immigrant-inclusive-policies-move-ahead/
- National Institutes of Health (NIH). (2017). Inclusion of women and minorities as participants in research involving human subjects. Retrieved on April 11, 2021 from https://grants.nih.gov/policy/inclusion/women-and-minorities.htm
- Noe-Bustamante L, Lopez MH, & Krogstad JM (2020). U.S. Hispanic population surpassed 60 million in 2019, but growth has slowed. Retrieved on April 11, 2021 from https://www.pewresearch.org/fact-tank/2020/07/07/u-s-hispanic-population-surpassed-60-million-in-2019-but-growth-has-slowed/ [Google Scholar]
- Office of Research on Women’s Health. (2019). Report of the advisory committee on research on women’s health, Fiscal Years 2017–2018: Office of Research on Women’s Health and NIH Support for Research on Women’s Health. Bethesda, MD: U.S. Department of Health and Human Services, Public Health Service, National Institutes of Health. [Google Scholar]
- Pew Research Center. (2017). How the U.S. Hispanic population is changing. Retrieved on April 11, 2021 from https://www.pewresearch.org/fact-tank/2017/09/18/how-the-u-s-hispanic-population-is-changing/
- Quach T, Nuru-Jeter A, Morris P, Allen L, Shema SJ, Winters JK, Le GM, & Gomez SL (2012). Experiences and perceptions of medical discrimination among a multiethnic sample of breast cancer patients in the Greater San Francisco Bay Area, California. American Journal of Public Health, 102(5), 1027–1034. 10.2105/AJPH.2011.300554 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reidy MC, Orpinas P, & Davis M (2012). Successful recruitment and retention of Latino study participants. Health Promotion Practice, 13(6), 779–787. 10.1177/1524839911405842 [DOI] [PubMed] [Google Scholar]
- Reverby SM (2012). Ethical failures and history lessons: The U.S. public health service research studies in Tuskegee and Guatemala. Public Health Rev, 34(13), 1–18. 10.1007/BF0339166526236074 [DOI] [Google Scholar]
- Rivenbark JG, & Ichou M (2020). Discrimination in healthcare as a barrier to care: Experiences of socially disadvantaged populations in France from a nationally representative survey. BMC Public Health, 20(1), 31. 10.1186/s12889-019-8124-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Robert Wood Johnson Foundation. (2017). Discrimination pervades daily life, affects health across groups in the U.S., NPR/Harvard/RWJF poll shows. Retrieved on April 11, 2021 from https://www.rwjf.org/en/library/articles-and-news/2017/10/discrimination-pervades-daily-life--affects-health-across-groups.html
- Salman A, Nguyen C, Lee YH, & Cooksey-James T (2016). A review of barriers to minorities' participation in cancer clinical trials: Implications for future cancer research. Journal of Immigrant and Minority Health, 18(2), 447–453. 10.1007/s10903-015-0198-9 [DOI] [PubMed] [Google Scholar]
- Scharff DP, Mathews KJ, Jackson P, Hoffsuemmer J, Martin E, & Edwards D (2010). More than Tuskegee: Understanding mistrust about research participation. Journal of Health Care for the Poor and Underserved, 21(3), 879–897. 10.1353/hpu.0.0323 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sha M, McAvinchey G, Quiroz R & Moncada J (2017). Successful techniques to recruit Hispanic and Latino research participants. Survey Practice, 10(3), 1–9. 10.29115/SP-2017-0014 [DOI] [Google Scholar]
- Shahabi A, Bernstein L, Azen SP, McClain AD, Belcher B, Hsu YW, Nguyen-Rodriguez ST, & Spruijt-Metz D (2011). Recruitment and retention of African American and Latino preadolescent females into a longitudinal biobehavioral study. Ethnicity & Disease, 21(1), 91–98. [PMC free article] [PubMed] [Google Scholar]
- Smirnoff M, Wilets I, Ragin DF, Adams R, Holohan J, Rhodes R, Winkel G, Ricci EM, Clesca C, & Richardson LD (2018). A paradigm for understanding trust and mistrust in medical research: The Community VOICES study. AJOB Empirical Bioethics, 9(1), 39–47. 10.1080/23294515.2018.1432718 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Steinberg EM, Valenzuela-Araujo D, Zickafoose JS, Kieffer E, & DeCamp LR (2016). The "battle" of managing language barriers in health care. Clinical Pediatrics, 55(14), 1318–1327. 10.1177/0009922816629760 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Steneck NH (2007). ORI introduction to the responsible conduct of research. Retrieved on April 11, 2021 from https://ori.hhs.gov/ori-introduction-responsible-conduct-research [Google Scholar]
- U.S. Census Bureau. (2017). Current population survey, 2017 annual social and economic supplement. Retrieved on June 17, 2021 from https://www.census.gov/data/tables/2017/demo/education-attainment/cps-detailed-tables.html
- U.S. Census Bureau. (2019). QuickFacts. Retrieved on June 17, 2021 from https://www.census.gov/quickfacts/fact/table/US/PST045219
- U.S. Department of Homeland Security (2016). Table 8. Persons obtaining lawful permanent resident status by sex, age, marital status, and occupation: Fiscal year 2015. Retrieved on July 13, 2021 from https://www.dhs.gov/immigration-statistics/yearbook/2015/table8
- Washington, H. A. (2006). Medical apartheid: The dark history of medical experimentation on Black Americans from colonial times to the present. New York, NY: Doubleday. [Google Scholar]
- Whitfield KE (2005). Studying biobehavioral aspects of health disparities among older adult minorities. Journal of Urban Health, 82(2 Suppl 3), iii103–iii110. 10.1093/jurban/jti068 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wieland ML, Doubeni CA, & Sia IG (2020). Community engagement with vulnerable populations. Mayo Clinic Proceedings, 95(9), S60–S62. 10.1016/j.mayocp.2020.05.041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Witze A. (2020). Wealthy funder pays reparations for use of stolen cells: Howard Hughes Medical Institute’s six-figure donation aims to compensate for research on HeLa cell line. Nature. 587, 20–21. 10.1038/d41586-020-03042-5 [DOI] [PubMed] [Google Scholar]

