Skip to main content
Journal of General Internal Medicine logoLink to Journal of General Internal Medicine
. 2007 Mar 21;22(6):852–863. doi: 10.1007/s11606-007-0126-3

Recruiting Vulnerable Populations into Research: A Systematic Review of Recruitment Interventions

Stacy J UyBico 1, Shani Pavel 1, Cary P Gross 1,2,3,
PMCID: PMC2219860  PMID: 17375358

Abstract

Background

Members of vulnerable populations are underrepresented in research studies.

Objective

To evaluate and synthesize the evidence regarding interventions to enhance enrollment of vulnerable populations into health research studies.

Data sources

Studies were identified by searching MEDLINE, the Web of Science database, personal sources, hand searching of related journals, and article references. Studies that contained data on recruitment interventions for vulnerable populations (minority, underserved, poor, rural, urban, or inner city) and for which the parent study (study for which recruitment was taking place) was an intervention study were included. A total of 2,648 study titles were screened and 48 articles met inclusion criteria, representing 56 parent studies. Two investigators extracted data from each study.

Results

African Americans were the most frequently targeted population (82% of the studies), while 46% targeted Hispanics/Latinos. Many studies assessed 2 or more interventions, including social marketing (82% of studies), community outreach (80%), health system recruitment (52%), and referrals (28%). The methodologic rigor varied substantially. Only 40 studies (71%) incorporated a control group and 21% used statistical analysis to compare interventions. Social marketing, health system, and referral recruitment were each found to be the most successful intervention about 35–45% of the studies in which they were attempted, while community outreach was the most successful intervention in only 2 of 16 studies (13%) in which it was employed. People contacted as a result of social marketing were no less likely to enroll than people contacted through other mechanisms.

Conclusions

Further work with greater methodologic rigor is needed to identify evidence-based strategies for increasing minority enrollment in research studies; community outreach, as an isolated strategy, may be less successful than other strategies.

KEY WORDS: vulnerable populations, interventions, health research studies, disparities, race, recruitment, minorities, clinical trials

BACKGROUND

Although The NIH Revitalization Act of 1993 authorized that minorities be appropriately represented in clinical trials, they continue to have lower enrollment rates in health research when compared to nonminority groups.1,2 Several barriers specific to minority recruitment have been identified.3 Barriers at the institutional level include provider time constraints and competing service demands, while researcher barriers include multicultural differences, lack of knowledge, and bias against research leading to inactive recruitment.35 Barriers at the individual level include distrust of research, lack of confidentiality, fear of safety, schedule conflicts, poor access to medical care, lack of knowledge, language, and cultural differences.3,514 Despite such barriers, reports have appeared that minorities may be as willing to enroll in health research as whites if they are offered the opportunity to participate.1517

As barriers to recruiting minorities have become more clearly understood, there has been increased interest in designing recruitment interventions to overcome them.13,18 Suggested approaches include recruiting through partnerships with churches, community leaders and organizations, recruiting at community-based clinic sites, and providing logistical assistance or financial enticement.13,18 Social marketing, the use of marketing to design and implement programs to promote socially beneficial behavior change, has also been advocated as a recruitment strategy.19 However, marketing campaigns can be expensive, and it is not clear if prospective participants who learn of a study through marketing are as likely to enroll as patients recruited through other mechanisms.20 That is, if social marketing campaigns result in a large pool of candidates, of which many are not eligible, then this approach may not be efficient.

A recent review of minority cancer trial enrollment strategies found that “...more than a decade following the institution of (the) NIH requirement, enrollment of minority populations into cancer clinical trials remains woefully inadequate”.18 Although there has been a call for empiric research to identify which recruitment interventions are effective, we are unaware of any synthesis of the evidence.13,18 There is also a question of the methodologic rigor of trial enrollment studies, as prior work has suggested that studies of recruitment interventions vary in their definition of successful recruitment, and others have called for more complete reporting of racial, ethnic and cultural composition of subjects in trials as well as thorough descriptions of recruitment successes and failures.13,21 We therefore conducted a systematic review to identify which minority recruitment strategies have been attempted and which ones are effective and efficient. We also assessed the methodologic rigor of these studies with regard to quantitative and qualitative data reporting and ability to draw inferences.

METHODS

Data Sources

The MEDLINE database was searched from 1966 up to April 2005 (see Appendix for search terms). Further articles were found using hand searching of 3 journals including Journal of the National Medical Association, Controlled Clinical Trials, and Ethnicity and Disease from January 2002 to April 2005. Additional studies were identified by personal sources and reference sections of relevant studies. This strategy was supplemented by using the Web of Science database to generate a list of articles that cited studies of interest.

Study Selection

Studies that reported on recruitment intervention(s) with respect to recruiting special populations (defined as minority, underserved, lower socioeconomic status (SES), rural, urban, or inner city) into research studies were eligible. The parent study (the study for which recruitment was taking place) was also required to be an intervention. Studies were excluded if their target population did not specifically focus on minorities or socioeconomically underserved, or if the special population of interest was defined by gender or age. Studies that exclusively identified barriers to recruitment were also excluded, as our intent was to identify studies that evaluated recruitment interventions. Three investigators (S.U., S.P, and C.P.G.) reviewed 2,648 total citations and 96 full articles. A total of 48 manuscripts were eligible for inclusion, representing recruitment interventions for 56 parent studies (Fig. 1).2269

Figure 1.

Figure 1

Flow diagram of search methodology for studies to include. Studies were excluded if their target population did not specifically focus on minorities or socioeconomically underserved, if the sole aim was to identify barriers to enrollment, or if the parent study was not an intervention study.

Data Extraction

Two investigators (S.U, S.P) extracted the number of people screened, eligible, and enrolled from each study. Study quality was also evaluated using explicit criteria including description of recruitment interventions, assessing efficacy of intervention, controlling for bias, data reporting, and external validity.70 We also assessed internal validity, by determining whether there were sufficient data to support authors’ conclusions about the efficacy of their intervention. Insufficient evidence was defined as the lack of reported statistical significance in enrollment between intervention groups. After dual review of each manuscript, disagreements were resolved by consensus.

Synthesis of Evidence

Interventions were categorized into 4 main categories: social marketing, community outreach, referrals, and health system recruitment. Social marketing includes mass mailing, mass telephone calls, and media (TV, radio, newspaper, magazines, newsletters, brochures, flyers, PSA, specialty publications to a target group). Community outreach includes church recruitment, contact with community leaders and organizations, community presentations and meetings usually carried out by the research team in the community, health screenings, house to house/door to door/face to face contact in the community, community events participation with a booth, etc. Referrals include those from friends, family, other participants in the same study, participants from another study, etc. Health system recruitment strategies include direct recruitment by the healthcare provider or allowing research staff to approach potential subjects in clinical settings, or the use of medical records/registries to identify patients. The remaining interventions were classified as “other”.

Heterogeneity of study designs precluded quantitative metaanalysis. We calculated the proportion of study participants derived from each recruitment intervention as follows: number enrolled by a recruitment intervention/total number enrolled in study × 100. When possible, the proportion enrolled from different interventions was compared using chi-square tests. To present such results in aggregate, an additive method was used to determine the number of times a recruitment intervention was most successful in obtaining enrolled subjects, in contrast with the total number of studies in which it was attempted. An intervention was counted 0.5 instead of 1 if it was only included in a study as part of a combination of interventions (such as Community outreach and Health system).

When sufficient data were available, we assessed efficiency by calculating the recruitment fraction, which was defined as the number enrolled/number screened per recruitment intervention available.71 When possible, the recruitment fraction for social marketing vs “all other interventions” combined (community outreach + referrals + health system) were compared, given our a priori hypothesis that social marketing would have a lower recruitment fraction than other approaches.

RESULTS

In the final study sample, many of the 56 studies targeted more than 1 minority group. African Americans were the most frequently targeted population (82% ), while slightly less than half targeted Hispanics/Latinos (46%; Table 1). Older or elderly populations were identified by authors in 23% of the studies, and low SES or underserved populations in 18% of studies. Approximately 78% of the parent studies were prevention studies and the remaining 22% were treatment studies. The behavior/lifestyle subcategory was the most common type of preventive study, while pharmacotherapy was the most common treatment intervention studied.

Table 1.

Description of Studies

Description No. of Studies (%)
Population targeted for recruitment
 African Americans 46 (82)
 Latino/Hispanics 26 (46)
 “Other” racial/ethnic group 32 (57)
 Older/elderly 13 (23)
 Low SES/underserved 10 (18)
 Rural 2 (4)
Parent research study type*
 Prevention
  Pharmacologic 7 (12)
  Behavior/lifestyle 24 (41)
  Screening test 4 (7)
  Other 10 (17)
  Total prevention studies 45 (78)
 Treatment
  Pharmacologic 6 (10)
  Behavior/lifestyle 3 (5)
  Other 4 (7)
  Total treatment studies 13 (22)
Types of recruitment interventions
 Social marketing 46 (82)
  Mass mailing 23 (41)
  Mass telephone calls 9 (16)
  Media 38 (68)
   Newspaper advertisements and/or magazines 28 (50)
   Flyer 25 (45)
   Radio Advertisements 25 (45)
   TV Advertisements 21 (38)
   Other: (bulletin, posters, videotape, internet ad, not otherwise specified) 13 (23)
   Newsletter 11 (20)
   Brochure 10 (18)
   Public service announcement (not specified) 4 (7)
   Specialty publications to target group 3 (5)
 
 Community outreach 45 (80)
  Church 21 (38)
  Contact with community leaders and organizations 20 (36)
  Presentations and/or meetings (usually by investigators to and with community) 19 (34)
  Community events/table/booth 13 (23)
  Health screenings 11 (20)
  House to house/door to door canvassing or face-to-face in community setting 9 (16)
  Other: saw class, hospital employees 3 (5)
 
 Health system 29 (52)
  Health care provider approached or asked to refer 20 (36)
  Health care center recruitment (staff recruiting in clinic) 15 (27)
  Registry/patient chart review 11(20)
 
 Referrals 16 (28)
  Referred by friends/family 10 (18)
  Referred by other participants in the study 7(12)
  Other: staff, employers, coworkers 7 (12)
  Referred by another study 3 (5)
 
 Other 19 (34)
  Direct compensation 10 (18)
  Financial gain (money, coupons) 9 (16)
  Other gifts (mugs, T-shirts, pins, etc.) 3 (5)
  Ethnically matched staff/recruiter or language Interpreter 9 (16)
  Convenience (parking, transportation, child care, rapid and convenient clinic visits, etc.) 8 (14)
  Study buddy 1 (2)
  Questionnaire sent home to child’s parents 1 (2)

Some studies included more than one target group or intervention, therefore the total number is >58 for some categories.

*2 of the 56 studies satisfied more than one category therefore the total is 58.

Many studies assessed 2 or more interventions. Social marketing was used in 82% of studies, community outreach in 80%, followed by health system recruitment (52%), and referrals (28%; Table 1). Social marketing strategies included: media (68%), mass mailing (41%), and telephone calls (16%). The most common community outreach interventions included partnerships with churches (38%), contact with community leaders and organizations (36%), and presentations/meetings in the community (34%). The most frequent type of health system intervention was approaching health care providers directly (36%), followed by direct patient recruitment at a health center (27%), and chart review or registry (20%; Table 1).

Study Quality

The quality of study reporting was variable (Table 2). All (100%) of the studies reported their objective, the target population demographics, the recruitment interventions, and the locations for which recruitment would take place. However, less than 15% of studies reported the time spent or cost per recruitment intervention studied (Table 2). Only 48, 29, and 55% of studies reported the number approached/screened, eligible, and enrolled per recruitment intervention, respectively. It was difficult to assess external validity of many studies, as only 18% of studies reported that they recruited a sample that was representative of the entire population from which they were recruited, while 71% did not report a comparison between their sample and the target population.

Table 2.

Study Quality

Characteristic Number of Studies (%)
I. Description of recruitment study and interventions
 Main hypothesis and objectives of recruitment described 56 (100)
 Demographics of target population described 56 (100)
 Recruitment intervention(s) described in sufficient detail to allow replication 56 (100)
 Recruitment settings (e.g., church, senior center) described 56 (100)
 Time spent to complete recruitment intervention(s) noted
  Yes 8 (14)
  No 37 (66)
  Time mentioned, but actual data not given 11 (20)
 Cost to complete recruitment Intervention(s) noted
  Yes 7 (13)
  No 44 (79)
  Cost mentioned, but actual data not given 5 (9)
II. Assessing efficacy of intervention
 Presence of a control group 40 (71)
III. Controlling for bias
 Method for determining which recruitment intervention a population would receive*
 Randomization 2 (5)
 Nonrandom assignment
  Concurrent (interventions simultaneously on different groups) 22 (55)
  Sequential (added more interventions with time) 3 (33)
  Other 3 (8)
 For populations that received differing recruitment interventions, were they balanced with regard to sociodemographic/clinical characteristics?*
  Yes 5 (13)
  No 8 (20)
  Unclear 27 (68)
 Reported the use of formal statistical analysis (p values, confidence intervals, etc.) to assess the success of recruitment interventions 12 (21)
IV. Data reporting
 Reported the number approached or screened per recruitment intervention 27 (48)
 Reported the number eligible for study participation per recruitment intervention 16 (29)
 Reported the number enrolled in the study per recruitment intervention 31 (55)
V. External validity/generalizability
 For populations receiving recruitment intervention(s), were they representative of the entire population from which they were recruited?
  Yes 10 (18)
  No 6 (11)
  Unclear 40 (71)
VI. Internal validity
 Are author’s conclusions supported by the study data?
  Yes 11 (20)
  No 24 (43)
  Maybe 21 (38)

*denominator is 40

The approach to evaluating the efficacy of the recruitment intervention also varied substantially. Only 71% of studies had a control group; of these 40 studies, 2 used randomization as the method to determine which group would receive which recruitment intervention (5%). An additional 55% employed nonrandom assignment of interventions concurrently to 2 or more different groups of prospective participants using geographic location or other factors to target interventions, and 33% of studies applied recruitment intervention(s) sequentially.

Because few interventions were applied using randomization, it is important to compare the characteristics of groups receiving the interventions. However, authors in only 13% of studies stated that groups receiving differing recruitment interventions were similar with regard to sociodemographic and clinical characteristics. In 20% of the studies, authors stated that the groups were not similar and in 68% of the studies, group similarity was unclear. Furthermore, only 21% of studies used formal statistical analysis to compare recruitment interventions. Similarly, we found that only 20% of studies had sufficient data to support author’s conclusions about the efficacy of their interventions.

Effectiveness of Recruitment Interventions

The proportion of participants enrolled through separate recruitment interventions was reported in 20 studies (Table 3). Social marketing, alone or in combination with community outreach, yielded the highest number of participants in 9 studies. In these studies, which involved heterogeneous target groups, social marketing frequently yielded more than two-thirds of the study sample. Health system interventions were most effective in 5 studies, many of which involved patients with specific chronic conditions. In aggregate, social marketing was the most successful intervention 44% of the studies it was attempted (8 of 18), health system in 40% of the studies (5 of 12.5), referrals in 35% (3 of 8.5), and community outreach in only 13% of the studies in which it was attempted (2 of 16; Fig. 2).

Table 3.

Proportion of study sample obtained with different recruitment interventions

graphic file with name 11606_2007_126_Tab1a_HTML.jpg

graphic file with name 11606_2007_126_Tab1b_HTML.jpg

graphic file with name 11606_2007_126_Tab1c_HTML.jpg

graphic file with name 11606_2007_126_Tab1d_HTML.jpg

^(Baigis):SM and CO columnCombination of Newspaper, Flyer, specialty publications, church, presentations, community events, AND HS = health care provider data involved here. HS column: Recruitment at a health center only.

^(Hooks): OTHER category not listed: Questionnaire sent home (did not fit other categories): Contribution to study sample: 21.6%.

@=The majority ethnic/racial group in the study. “Diverse” indicates that whites were the majority in the study but minorities were included with separate data or recruitment goals given by authors for this population

^^^=Hispanic market segment 1 was not counted as it was not clear what the recruitment intervention breakdown was of this population recruited.

$=does not add up to 100% (authors omitted data or there was an other or unknown recruitment category) or data was only from subset of total enrolled

*=Total population was of that ethnic or racial group (e.g., if listed as “African Americans”, whole enrolled sample was African American).

Figure 2.

Figure 2

Success indicates that the recruitment intervention was associated with the largest proportion of patients enrolled in the parent study when compared to all other recruitment interventions in that study.

Efficiency of Recruitment Interventions

We found 11 studies that compared the recruitment fraction between social marketing and other interventions. There was no consistent evidence suggesting that social marketing was more or less efficient than other approaches. Three manuscripts reported no statistically significant difference between approaches (Table 4). Of the 8 remaining studies, 5 reported that patients identified through social marketing interventions were significantly less likely to enroll than patients identified through other mechanisms, while 3 found that social marketing yielded patients who were more likely to enroll (Table 4).

Table 4.

The Proportion of Potential Participants Who Were Screened and Eventually Enrolled: Recruitment Fraction of Social Marketing vs Other interventions

Study Name Study Description and Study Population for Others Section Majority Population Recruited* Social Marketing: % Enrolled (Number Screened) All Other: % Enrolled (Number Screened) p-Value
Social marketing less successful
 Arean PA Social service model of care RCT Diverse, elderly 25.5% (326) 44.7% (85) p=0.001
 Whelton, PK Drug therapy on hypertension and kidney disease RCT African Americans 8.9% (225) 28.3% (233) p<0.001
 Coleman, EA Elderly wellness intervention study-prevention RCT African Americans, elderly 38.7% (204) 73.2% (56) p<0.001
 Hooks, PC Community and family diet and exercise intervention African Americans 13.0% (100) 30.4% (312) p=0.001
 Lee, RE Home-based walking intervention RCT Hispanics 26.5% (307) 55.6% (81) p<0.001
Social marketing more successful
 Lewis, CE Dietary prevention RCT Diverse 11.7% (16,583) 9.7% (2,417) p=0.004
 Hill, MN‡, § Community health worker to reduce high blood pressure RCT African Americans 32.5% (40) 14.2% (1,342) p=0.001
 Brewster, WR Cancer prevention study RCT Hispanics, low income 51.4% (1,041) 26.3% (1,542) p<0.001
No significant difference
 Arean, PA Psychosocial interventions for depression RCT Diverse, low income, elderly 26.7% (75) 33.3% (153) p=0.312
 Unson, CG// Osteoporosis drug trial RCT Diverse, elderly 22.4% (364) 21.9% (288) p=0.878
 Fitzgibbon, ML§ Dietary Intervention African Americans 7.4% (1590) 8.4% (3590) p = 0.22

Recruitment fraction calculated as: number enrolled/number screened per recruitment intervention

*The majority ethnic/racial group in the study. “Diverse” indicates that whites were the majority in the study but minorities were included with separate data or recruitment goals given by authors for this population

Chi-squarep-value for difference in percentage enrolled between social marketing and other interventions

Total population was of that ethnic or racial group (e.g., if listed as “African Americans”, whole enrolled sample was African American).

§Number approached was denominator used (not number screened)

//Hispanic market segment 1 not counted as it was not clear what the recruitment intervention breakdown was of this population recruited.

CONCLUSIONS

This systematic review of the literature confirms that while numerous recruitment interventions for this population have been assessed, methodologic rigor is variable and the body of evidence has significant gaps. The heterogeneous nature of the trials’ interventions, target populations, and study designs rendered data synthesis challenging. Data on relative effectiveness of different recruitment approaches would be optimized if future studies could be designed to enhance internal and external validity as well as the transparency of reporting.

Some of the more commonly attempted recruitment interventions for minority populations included church recruitment and interaction with community organizations and leaders. Health system recruitment, including registry/chart review and physician referrals, was also assessed in about half of the studies. Given the recent emphasis on community-based research, it was surprising that health system recruitment was such a commonly used recruitment approach.6,7,9,10 This may have arisen from the perceived importance of physician referrals as gatekeepers to minority research recruitment, which has been previously documented.4,11,15

There was no clear dominant strategy. In fact, social marketing, health system, and referral interventions led to the highest proportion of participants 44, 40, and 35% of the times in which they were tried, respectively. The main outlier was community outreach which was the most successful in a mere 13% of the studies in which it was assessed. Although heterogeneity of studies and populations renders definitive comparisons difficult, the poor showing of community outreach merits further exploration as this is a commonly proposed intervention.3,7,9,10,22,72 It is important to note that community outreach likely has the advantage of being the recruitment strategy that may alleviate distrust.3,6 Our finding that outreach rarely was the most effective independent strategy may stem from the individual studies/populations in our review. Alternatively, perhaps the benefits of a collaboration with the community cannot be quantified as an independent strategy, but rather are most effective when incorporated into a comprehensive approach that includes other recruitment interventions.

We were surprised to note that some commonly proposed recruitment incentives such as financial reimbursement (cash or coupons) or convenience strategies (transportation/flexible scheduling) were infrequently assessed. Although we identified 9 studies that used financial incentives to assist in recruitment, none of them compared the effectiveness of this incentive with other recruitment interventions. For instance, Vollmer, et al. indicated that only 6 and 20% of African Americans and other minorities, respectively, cited financial incentives as their primary reason for participation, although recruitment fraction or enrollment proportions could not be calculated.62 This is an important gap in the literature. Financial incentives are commonly recommended, but they are not without controversy. Some authors have raised concerns that payments to underserved populations represents coercion, while others have suggested that payments may bias study results obtained or population recruited.7379 Accordingly, payments could potentially have a negative impact on trust, especially in vulnerable populations that might already be distrustful of research.7,77

Our review also demonstrated that both the reporting and the methodological rigor of recruitment intervention studies has room for improvement. Inclusion of quantitative screening and recruitment data in manuscripts would allow for a more transparent assessment of which recruitment intervention lead to the most subjects screened (greatest reach), most eligible participants (relevant reach), and enrolled. A limitation for assessing media and community outreach recruitment includes the difficulty in ascertaining the number of people who were exposed. While it would not be feasible to determine the number of people who had seen or heard a specific advertisement, future studies should try to report the size of a target audience and frequency of exposures at the population level as well as determining the efficacy of interventions across racial and ethnic groups. Although this was beyond the scope of our study, the comparison of recruitment interventions across different target populations (such as different racial or ethnic groups) should be performed when data are available because the effectiveness of interventions may be moderated by cultural and contextual effects.

Additionally, it is important to report the amount of time and cost per recruitment intervention (which was done in fewer than 15% of studies in our sample) as this could affect decision making for researchers and funders. Finally, authors need to report if the different populations they are recruiting via different recruitment interventions are balanced with regard to sociodemographic or clinical characteristics and if they are representative of the larger population from which they were recruited.

In addition to the quality of reporting study data, we found room for improvement in the internal validity of many study designs. A control recruitment group was lacking in about one-third of our studies, and those that did employ a control group rarely used randomization as a means to diminish bias. Furthermore, with only 21% of the studies using formal statistical analysis, it was unsurprising that only a minority of studies had the data to support the authors’ conclusions. When the validity of authors’ conclusions and study outcomes are questionable, interpreting the data presented by such studies is difficult.

An important caveat when considering the frequency of “statistically significant” findings across studies is the variation in sample size. However, we found no systematic relation between sample size, study design, and outcome in our dataset (data not shown). Finally, the 4 categories of recruitment approaches included in this study were intentionally rather broad so as to be inclusive and concordant with the depths of reporting provided by the manuscripts. We recommend that future studies report data per specific recruitment intervention to allow for more detailed analyses of the success of various approaches.

Approaches that are effective in 1 setting or 1 population may not be generalizable. We were therefore concerned that there was a paucity of studies that focused on Asian Americans, Native Americans, and other minority populations, as researchers have little evidence to guide their efforts for these populations. Another population that merits further research is the minority elders. When trying to enroll these individuals, researchers face the challenges associated with the inclusion of minority participants as well as those encountered when recruiting older adults into disease-oriented clinical trials such as a higher prevalence of comorbid illness and functional impairments.80,81 Additionally, many of our parent studies were prevention rather than treatment trials. Hence, our findings may not be applicable to other populations, types of studies, or disease entities, as each of these factors may have different barriers to recruitment.25 Finally, our sample was restricted to manuscripts that reported recruitment data; these manuscripts represent a minority of the clinical trials conducted and published. Many other studies may have used or evaluated different recruitment approaches but did not report results.

It is important to identify not only successful recruitment interventions but also efficient ones. We did not find any evidence that social marketing was any less efficient—in terms of the proportion of screened patients who eventually enroll—than any other intervention. Although social marketing appears to yield roughly the same proportion of study subjects as health system and referral approaches without lower recruitment fractions, further studies are needed to determine whether its efficiency as a recruitment intervention is comparable to other strategies. Researchers need to weigh their resources of time, financial budget, effort, and expertise to choose which of the recruitment interventions are truly ideal for the population they are attempting to recruit.

At a time when minority recruitment for research continues to be an important issue that many still find challenging, it is vital to develop and evaluate innovative approaches to increase minority participation. For instance, the National Cancer Institute’s Minority-Based Community Clinical Oncology Program (MBCCOP) has enrolled thousands of minority patients into cancer clinical trials.82 This suggests that minorities can be recruited when appropriate outreach and infrastructure mechanisms are supported. While we found that there is an increasing body of evidence regarding approaches to enhance equitable recruitment, more work is needed. Improved methodologic rigor and data reporting are paramount to continue assessing successes or failures of recruitment interventions in such special populations. Perhaps, with rigorous evaluation of recruitment methods and adequate funding for strategies that are found to be effective, the goals of the NIH with respect to equitable and representative access to research studies can finally be realized.

Financial Support and Disclosure

Dr. Gross’s efforts were supported by Claude D. Pepper Older` Americans Independence Center at Yale (P30AG21342).

Potential Financial Conflicts of Interest None disclosed.

Appendix

Medline search terms

1 Clinical trials or randomized controlled trials or multicenter studies
2 African Americans or Hispanic Americans or African American Continental Ancestry Group or minority groups or social class or socioeconomic factors or poverty or medically underserved area or urban population
3 Patient selection or research subjects, and [(enrol$ or recruit$ or particip$ or enlist$ or attrit$ or retent$).mp.
4 interven$ or initiativ$ or method$ or strateg$ or increase$ or enhanc$).mp.

References

  • 1.NIH Revitalization Act. B: Sec. 131–133; 1993.
  • 2.Murthy VH, Krumholz HM, Gross CP. Participation in cancer clinical trials: race-, sex-, and age-based disparities. JAMA. 2004;291(22):2720–6 (Jun 9). [DOI] [PubMed]
  • 3.Levkoff S, Sanchez H. Lessons learned about minority recruitment and retention from the Centers on Minority Aging and Health Promotion. Gerontologist. 2003;43(1):18–26. [DOI] [PubMed]
  • 4.Pinto HA, McCaskill-Stevens W, Wolfe P, Marcus AC. Physician perspectives on increasing minorities in cancer clinical trials: an Eastern Cooperative Oncology Group (ECOG) Initiative. Ann Epidemiol. 2000;10(8 Suppl):S78–84. [DOI] [PubMed]
  • 5.Shavers-Hornaday VL, Lynch CF, Burmeister LF, Torner JC. Why are African Americans under-represented in medical research studies? Impediments to participation. Ethn Health. 1997;2(1–2):31–45. [DOI] [PubMed]
  • 6.Corbie-Smith G, Thomas S, Williams M, Moody-Ayers S. Attitudes and beliefs of African Americans toward participation in medical research. J Gen Intern Med. 1999;14:537–46. [DOI] [PMC free article] [PubMed]
  • 7.Corbie-Smith G, Thomas SB, St George DM. Distrust, race, and research. Arch Intern Med. 2002;162(21):2458–63. [DOI] [PubMed]
  • 8.Gamble VN. Under the shadow of Tuskegee: African Americans and health care. Am J Public Health. 1997;87(11):1773–8. [DOI] [PMC free article] [PubMed]
  • 9.Harris Y, Gorelick PB, Samuels P, Bempong I. Why African Americans may not be participating in clinical trials. J Natl Med Assoc. 1996;88(10):630–4 (Oct). [PMC free article] [PubMed]
  • 10.Mouton CP, Harris S, Rovi S, Solorzano P, Johnson MS. Barriers to black women’s participation in cancer clinical trials. J Natl Med Assoc. 1997;89(11):721–7. [PMC free article] [PubMed]
  • 11.Robinson SB, Ashley M, Haynes MA. Attitude of African-Americans regarding prostate cancer clinical trials. J Community Health. 1996;21(2):77–87 (Apr). [DOI] [PubMed]
  • 12.Stone VE, Mauch MY, Steger K, Janas SF, Craven DE. Race, gender, drug use, and participation in AIDS clinical trials. Lessons from a municipal hospital cohort. J Gen Intern Med. 1997;12(3):150–7. [DOI] [PMC free article] [PubMed]
  • 13.Swanson GM, Ward AJ. Recruiting minorities into clinical trials: toward a participant-friendly system. J Natl Cancer Inst. 1995;87(23):1747–59. [DOI] [PubMed]
  • 14.Unson CG, Dunbar N, Curry L, Kenyon L, Prestwood K. The effects of knowledge, attitudes, and significant others on decisions to enroll in a clinical trial on osteoporosis: implications for recruitment of older African-American women. J Natl Med Assoc. 2001;93(10):392–401 (Oct); discussion 02–4. [PMC free article] [PubMed]
  • 15.Brown DR, Topcu M. Willingness to participate in clinical treatment research among older African Americans and Whites. Gerontologist. 2003;43(1):62–72. [DOI] [PubMed]
  • 16.Thompson EE, Neighbors HW, Munday C, Jackson JS. Recruitment and retention of African American patients for clinical research: an exploration of response rates in an urban psychiatric hospital. J Consult Clin Psychol. 1996;64(5):861–7. [DOI] [PubMed]
  • 17.Wendler D, Kington R, Madans J, et al. Are racial and ethnic minorities less willing to participate in health research? PLoS Medicine/Public Library of Science. 2006;3(2):0001–10. [DOI] [PMC free article] [PubMed]
  • 18.Ford JG, Howerton MW, Bolen S, et al. Knowledge and access to information on recruitment of underrepresented populations to cancer clinical trials. Evid Rep/Technol Assess. 2005;122:1–11. [DOI] [PMC free article] [PubMed]
  • 19.Bushley AW, Cassel K, Hernandez BY, Robinett H, Goodman MT. A tailored multi-media campaign to promote the human papillomavirus cohort study to young women. Prev Med. 2005;41(1):98–101. [DOI] [PubMed]
  • 20.Grier S, Bryant CA. Social marketing in public health. Annu Rev Public Health. 2005;26:319–39. [DOI] [PubMed]
  • 21.Bolen S, Tilburt J, Baffi C, et al. Defining “success” in recruitment of underrepresented populations to cancer clinical trials: moving toward a more consistent approach. Cancer. 2006;106(6):1197–204. [DOI] [PubMed]
  • 22.Arean PA, Alvidrez J, Nery R, Estes C, Linkins K. Recruitment and retention of older minorities in mental health services research. Gerontologist. 2003;43(1):36–44. [DOI] [PubMed]
  • 23.Baigis J, Francis ME, Hoffman M. Cost-effectiveness analysis of recruitment strategies in a community-based intervention study of HIV-infected persons. AIDS Care. 2003;15(5):717–28. [DOI] [PubMed]
  • 24.Bailey JM, Bieniasz ME, Kmak D, Brenner DE, Ruffin MT. Recruitment and retention of economically underserved women to a cervical cancer prevention trial. Appl Nurs Res. 2004;17(1):55–60. [DOI] [PubMed]
  • 25.Blumenthal DS, Sung J, Coates R, Williams J, Liff J. Recruitment and retention of subjects for a longitudinal cancer prevention study in an inner-city black community. Health Serv Res. 1995;30(1 Pt 2):197–205. [PMC free article] [PubMed]
  • 26.Brewster WR, Anton-Culver H, Ziogas A, et al. Recruitment strategies for cervical cancer prevention study. Gynecol Oncol. 2002;85(2):250–4. [DOI] [PubMed]
  • 27.Brill PA, Kohl HW, Rogers T, Collingwood TR, Sterling CL, Blair SN. The relationship between sociodemographic characteristics and recruitment, retention, and health improvements in a worksite health promotion program. Am J Health Promot. 1991;5(3):215–21. [DOI] [PubMed]
  • 28.Burroughs AR, Visscher WA, Haney TL, et al. Community recruitment process by race, gender, and SES gradient: lessons learned from the Community Health and Stress Evaluation (CHASE) Study experience. J Community Health. 2003;28(6):421–37. [DOI] [PubMed]
  • 29.Coleman EA, Tyll L, LaCroix AZ, et al. Recruiting African-American older adults for a community-based health promotion intervention: which strategies are effective? Am J Prev Med. 1997;13(6 Suppl):51–6. [PubMed]
  • 30.Dennis BP, Neese JB. Recruitment and retention of African American elders into community-based research: lessons learned. Arch Psychiatr Nurs. 2000;14(1):3–11. [DOI] [PubMed]
  • 31.Derose KP, Hawes-Dawson J, Fox SA, Maldonado N, Tatum A, Kington R. Dealing with diversity: recruiting churches and women for a randomized trial of mammography promotion. Health Educ Behav. 2000;27(5):632–48. [DOI] [PubMed]
  • 32.Escobar-Chaves SL, Tortolero SR, Masse LC, Watson KB, Fulton JE. Recruiting and retaining minority women: findings from the Women on the Move study. Ethn Dis. 2002;12(2):242–51. [PubMed]
  • 33.Fitzgibbon ML, Prewitt TE, Blackman LR, et al. Quantitative assessment of recruitment efforts for prevention trials in two diverse black populations. Prev Med. 1998;27(6):838–45. [DOI] [PubMed]
  • 34.Ford ME, Havstad SL, Davis SD. A randomized trial of recruitment methods for older African American men in the Prostate, Lung, Colorectal and Ovarian (PLCO) Cancer Screening Trial. Clin Trials. 2004;1(4):343–51. [DOI] [PubMed]
  • 35.Fouad MN, Corbie-Smith G, Curb D, et al. Special populations recruitment for the Women’s Health Initiative: successes and limitations. Control Clin Trials. 2004;25(4):335–52. [DOI] [PubMed]
  • 36.Gallagher-Thompson D, Arguello D, Johnson C, Rodriguez V, Meyer M. A comparison of outreach strategies for hispanic caregivers of Alzheimer’s victims. Clin Gerontol. 1994;15:57–63. [DOI]
  • 37.Gorelick PB, Richardson D, Hudson E, et al. Establishing a community network for recruitment of African Americans into a clinical trial. The African-American antiplatelet stroke Prevention Study (AAASPS) experience. J Natl Med Assoc. 1996;88(11):701–4. [PMC free article] [PubMed]
  • 38.Harris KJ, Ahluwalia JS, Catley D, Okuyemi KS, Mayo MS, Resnicow K. Successful recruitment of minorities into clinical trials: the kick it at Swope project. Nicotine Tob Res. 2003;5(4):575–84. [DOI] [PubMed]
  • 39.Hill MN, Bone LR, Hilton SC, Roary MC, Kelen GD, Levine DM. A clinical trial to improve high blood pressure care in young urban black men: recruitment, follow-up, and outcomes. Am J Hypertens. 1999;12(6):548–54. [DOI] [PubMed]
  • 40.Hooks PC, Tsong Y, Baranowski T, Henske JC, Nader PR, Levin JS. Recruitment strategies for multiethnic family and community health research. Fam Community Health. 1988:48–59. [DOI] [PubMed]
  • 41.Ives DG, Kuller LH, Schulz R, Traven ND, Lave JR. Comparison of recruitment strategies and associated disease prevalence for health promotion in rural elderly. Prev Med. 1992;21(5):582–91. [DOI] [PubMed]
  • 42.Kennedy BM, Conlin PR, Ernst D, Reams P, Charleston JB, Appel LJ. Successfully recruiting a multicultural population: the DASH-Sodium experience. Ethn Dis. 2005;15(1):123–9. [PubMed]
  • 43.Kiernan M, Phillips K, Fair JM, King AC. Using direct mail to recruit Hispanic adults into a dietary intervention: an experimental study. Ann Behav Med. 2000;22(1):89–93. [DOI] [PubMed]
  • 44.Larkey LK, Staten LK, Ritenbaugh C, et al. Recruitment of Hispanic women to the Women’s Health Initiative. the case of Embajadoras in Arizona. Control Clin Trials. 2002;23(3):289–98. [DOI] [PubMed]
  • 45.Lee RE, McGinnis KA, Sallis JF, Castro CM, Chen AH, Hickmann SA. Active vs. passive methods of recruiting ethnic minority women to a health promotion program. Ann Behav Med. 1997;19(4):378–84. [DOI] [PubMed]
  • 46.Lewis CE, George V, Fouad M, Porter V, Bowen D, Urban N. Recruitment strategies in the women’s health trial: feasibility study in minority populations. WHT:FSMP Investigators Group. Women’s Health Trial: Feasibility Study in Minority Populations. Control Clin Trials. 1998;19(5):461–76. [DOI] [PubMed]
  • 47.Linnan LA, Emmons KM, Klar N, Fava JL, LaForge RG, Abrams DB. Challenges to improving the impact of worksite cancer prevention programs: comparing reach, enrollment, and attrition using active versus passive recruitment strategies. Ann Behav Med. 2002;24(2):157–66. [DOI] [PubMed]
  • 48.Moinpour CM, Atkinson JO, Thomas SM, et al. Minority recruitment in the prostate cancer prevention trial. Ann Epidemiol. 2000;10(8 Suppl):S85–91. [DOI] [PubMed]
  • 49.Nacif de Brey V, Gonzalez VM. Recruiting for arthritis studies in hard-to-reach populations: a comparison of methods used in an urban Spanish-speaking community. Arthritis Care Res. 1997;10(1):64–71 [DOI] [PubMed]
  • 50.Nichols L, Martindale-Adams J, Burns R, et al. Social marketing as a framework for recruitment: illustrations from the REACH study. J Aging Health. 2004;16(5 Suppl):157S–76S. [DOI] [PMC free article] [PubMed]
  • 51.Oakley A, Wiggins M, Turner H, Rajan L, Barker M. Including culturally diverse samples in health research: a case study of an urban trial of social support. Ethn Health. 2003;8(1):29–39. [DOI] [PubMed]
  • 52.Paskett ED, DeGraffinreid C, Tatum CM, Margitic SE. The recruitment of African-Americans to cancer prevention and control studies. Prev Med. 1996;25(5):547–53. [DOI] [PubMed]
  • 53.Pletsch PK, Howe C, Tenney M. Recruitment of minority subjects for intervention research. Image J Nurs Scholarsh. 1995;27(3):211–5. [DOI] [PubMed]
  • 54.Powell IJ, Gelfand DE, Parzuchowski J, Heilburn L, Franklin A. A successful recruitment process of African American men for early detection of prostate cancer. Cancer. 1995;75:1880–84. [DOI]
  • 55.Rowland RM, Fisher KJ, Green M, Dunn AM, Pickering MA, Li F. Recruiting inactive older adults to a neighborhood walking trial: The SHAPE project. J Aging Stud. 2004;18:353–68. [DOI]
  • 56.Royal C, Baffoe-Bonnie A, Kittles R, et al. Recruitment experience in the first phase of the African American Hereditary Prostate Cancer (AAHPC) study. Ann Epidemiol. 2000;10(8 Suppl). [DOI] [PubMed]
  • 57.Schoenfeld ER, Greene JM, Wu SY, O’Leary E, Forte F, Leske MC. Recruiting participants for community-based research: the Diabetic Retinopathy Awareness Program. Ann Epidemiol. 2000;10(7):432–40. [DOI] [PubMed]
  • 58.Smith SR, Jaffe DM, Petty M, Worthy V, Banks P, Strunk RC. Recruitment into a long-term pediatric asthma study during emergency department visits. J Asthma. 2004;41(4):477–84. [DOI] [PubMed]
  • 59.Sorkness CA, Ford JG, Lemanske RF, Jr., Asthma Clinical Trials N. Recruitment strategies in the Asthma Clinical Research Network. Control Clin Trials. 2001;22(6 Suppl):222S–35S. [DOI] [PubMed]
  • 60.Stoy DB, Curtis RC, Dameworth KS, et al. The successful recruitment of elderly black subjects in a clinical trial: the CRISP experience. Cholesterol Reduction in Seniors Program. J Natl Med Assoc. 1995;87(4):280–7. [PMC free article] [PubMed]
  • 61.Unson CG, Ohannessian C, Kenyon L, Fenster J, Reisine S, Prestwood K. Strategies for enrolling diverse older women in an osteoporosis trial. J Aging Health. 2004;16(5):669–87. [DOI] [PubMed]
  • 62.Vollmer WM, Svetkey LP, Appel LJ, et al. Recruitment and retention of minority participants in the DASH controlled feeding trial. DASH Collaborative Research Group. Dietary Approaches to Stop Hypertension. Ethn Dis. 1998;8(2):198–208. [PubMed]
  • 63.Warren-Findlow J, Prohaska TR, Freedman D. Challenges and opportunities in recruiting and retaining underrepresented populations into health promotion research. Gerontologist. 2003;1:37–46. [DOI] [PMC free article] [PubMed]
  • 64.Whelton PK, Lee JY, Kusek JW, et al. Recruitment experience in the African American Study of Kidney Disease and Hypertension (AASK) Pilot Study. Control Clin Trials. 1996;17(4 Suppl):17S–33S. [DOI] [PubMed]
  • 65.Whitehorse LE, Manzano R, Baezconde-Garbanati LA, Hahn G. Culturally tailoring a physical activity program for hispanic women: recruitment successes of la vida buena’s salsa aerobics. J Health Educ. 1999;30:S18–S24.
  • 66.Wisdom K, Neighbors K, Williams VH, Havstad SL, Tilley BC. Recruitment of African Americans with type 2 diabetes to a randomized controlled trial using three sources. Ethn Health. 2002;7(4):267–78. [DOI] [PubMed]
  • 67.Yancey A, McCarthy WJ, Leslie J. Recruiting African-American women to community-based health promotion research. Am J Health Promot. 1998;12(5):335–8. [DOI] [PubMed]
  • 68.Yancey AK, Miles OL, McCarthy WJ, et al. Differential response to targeted recruitment strategies to fitness promotion research by African-American women of varying body mass index. Ethn Disease. 2001;11(1):115–23. [PubMed]
  • 69.Zhu K, Hunter S, Bernard LJ, Payne-Wilks K, Roland CL, Levine RS. Recruiting elderly African-American women in cancer prevention and control studies: a multifaceted approach and its effectiveness. J Natl Med Assoc. 2000;92(4):169–75 (Apr). [PMC free article] [PubMed]
  • 70.Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998;52(6):377–84. [DOI] [PMC free article] [PubMed]
  • 71.Gross C, Mallory R, Heiat A, Krumholz H. Reporting the recruitment process in clinical trials: who are these patients and how did they get there? Ann Intern Med. 2002;137:10–6. [DOI] [PubMed]
  • 72.Reed PS, Foley KL, Hatch J, Mutran EJ. Recruitment of older African Americans for survey research: a process evaluation of the community and church-based strategy in The Durham Elders Project. Gerontologist. 2003;43(1):52–61. [DOI] [PubMed]
  • 73.Bentley JP, Thacker PG. The influence of risk and monetary payment on the research participation decision making process. J Med Ethics. 2004;30(3):293–8. [DOI] [PMC free article] [PubMed]
  • 74.Dickert N, Grady C. What’s the price of a research subject? Approaches to payment for research participation. N Engl J Med. 1999;341(3):198–203. [DOI] [PubMed]
  • 75.Doody MM, Sigurdson AS, Kampa D, et al. Randomized trial of financial incentives and delivery methods for improving response to a mailed questionnaire. Am J Epidemiol. 2003;157(7):643–51. [DOI] [PubMed]
  • 76.Emanuel EJ. Ending concerns about undue inducement. J Law Med Ethics. 2004;32(1):100–5. [DOI] [PubMed]
  • 77.Grady C. Payment of clinical research subjects. J Clin Invest. 2005;115(7):1681–7. [DOI] [PMC free article] [PubMed]
  • 78.Halpern SD, Karlawish JH, Casarett D, Berlin JA, Asch DA. Empirical assessment of whether moderate payments are undue or unjust inducements for participation in clinical trials. Arch Intern Med. 2004;164(7):801–3. [DOI] [PubMed]
  • 79.Weise KL, Smith ML, Maschke KJ, Copeland HL. National practices regarding payment to research subjects for participating in pediatric research. Pediatrics. 2002;110(3):577–82. [DOI] [PubMed]
  • 80.Arean PA, Gallagher-Thompson D. Issues and recommendations for the recruitment and retention of older ethnic minority adults into clinical research. J Consult Clin Psychol. 1996;64(5):875–80. [DOI] [PubMed]
  • 81.Townsley CA, Selby R, Siu LL. Systematic review of barriers to the recruitment of older patients with cancer onto clinical trials. J Clin Oncol. 2005;23(13):3112–24. [DOI] [PubMed]
  • 82.McCaskill-Stevens W, McKinney MM, Whitman CG, Minasian LM. Increasing minority participation in cancer clinical trials: the minority-based community clinical oncology program experience. J Clin Oncol. 2005;23(22):5247–54. [DOI] [PubMed]

Articles from Journal of General Internal Medicine are provided here courtesy of Society of General Internal Medicine

RESOURCES