Skip to main content
The Gerontologist logoLink to The Gerontologist
. 2011 Jun;51(Suppl 1):S142–S146. doi: 10.1093/geront/gnr019

Advancing the Science of Recruitment and Retention of Ethnically Diverse Populations

Anna M Nápoles 1,2,*, Letha A Chadiha 3,4
PMCID: PMC3092974  PMID: 21565815

Abstract

We highlight several critical challenges that must be addressed to accelerate the advancement of the science on recruitment and retention of ethnically diverse older adults into health research. These include the relative lack of attention by researchers to methodological issues related to recruitment and retention of ethnically diverse populations and the inadequacy of funding to advance systematically this field. We describe strategies used by the Resource Centers on Minority Aging Research and other National Institute of Aging–funded programs to advance the science of recruitment of ethnically diverse older adults. Finally, we propose a set of broad recommendations designed to generate a body of evidence on successful methods of recruitment and retention of ethnically diverse populations in health research. To eliminate health disparities and better understand aging processes in ethnically diverse populations, much more research is needed on effective strategies for increasing minority enrollment in health research. Comparative effectiveness research on more intensive recruitment and retention methods, which are often needed for including diverse populations, will require dedicated funding and concerted efforts by investigators.

Keywords: Health research, Enrollment, Racial and ethnic minorities, Race, Ethnicity


The National Institutes of Health (NIH) Revitalization Act of 1993 and the Agency for Healthcare Research and Quality Healthcare Research and Quality Act of 1999 identified recruitment and retention of diverse populations as a priority for clinical researchers. (Agency for Healthcare Research and Quality, 2003; NIH, 2001) The need to include ethnically diverse groups in health research will grow even more acute as the United States becomes increasingly multicultural.

Systematic reviews have examined factors affecting the equitable representation of minority groups in research (Ford et al., 2008; Lai et al., 2006; UyBico, Pavel, & Gross, 2007; Yancey, Ortega, & Kumanyika, 2006). These reviews share one overarching recommendation, that is, the need for more systematic research to test the efficacy of specific methods, with greater methodological rigor, in specific subpopulations. The recruitment literature on older ethnically diverse adults is particularly limited.

The Resource Centers for Minority Aging Research (RCMARs) were established originally by the National Institute on Aging (NIA), with co-funding from the National Institute of Nursing Research, and the Office of Research in Minority Health. The RCMAR program is currently funded by the NIA and the National Center for Minority Health and Health Disparities, to address health disparities among older ethnic minority adults. The RCMARs foster academic-community partnerships and conduct research on recruitment and retention of older ethnic minority adults for health research to develop evidence-based approaches. Some of the challenges and successes in advancing the science of recruitment have been described in this supplement to The Gerontologist entitled, “The Science of Recruitment and Retention among Ethnically Diverse Older Adults.”

In this commentary, we aim to highlight several critical challenges that must be met to accelerate the advancement of the state of the science on recruitment of ethnically diverse older adults for health research. These include the relative lack of attention by researchers to methodological issues related to recruitment and retention of ethnically diverse populations and the inadequacy of funding to advance systematically this field. Then, we will illustrate some of the strategies used by the RCMARs and other NIA-funded programs to advance the science of recruitment of ethnically diverse older adults. Finally, we will propose a set of broad recommendations designed to generate a body of evidence on successful methods of recruitment and retention of ethnically diverse populations in health research.

Lack of Attention by Health Researchers to Issues of Recruitment and Retention of Ethnically Diverse Populations

The paucity of evidence on effective recruitment and retention methods for use with ethnically diverse populations is largely a reflection of their de facto exclusion in research and the omission by health researchers of published ethnic group–specific data on recruitment and retention results. Several systematic reviews have documented the general lack of attention by clinical researchers to enrolling and reporting on ethnically diverse groups in studies. For example, one review that examined more than 700 articles published between 1970–2003 on obesity-related lifestyle interventions, identified only 23 that included a large enough sample of an underserved ethnic group to enable ethnic group–specific analyses and only 5 of these presented ethnic group–specific outcomes data (Yancey et al., 2004). Another review of 261 Phase III cancer prevention and treatment trials from 1990 to 2000 found that, although 92% of these trials reported the age and gender composition of their samples, race/ethnicity was reported in only 35% of treatment and 54% of prevention trials. None of the trials used race or ethnicity in their selection criteria, whereas gender was specified in 44% and age in 29% of the trials’ selection criteria (Swanson & Bailar, 2002). Finally, a review of arthritis-related behavioral intervention studies from 1997 to 2008 found that only 11 of the 25 studies provided data on the racial/ethnic diversity of their samples and only 2 of these stratified their results by White and minority participants (McIlvane, Baker, Mingo, & Haley, 2008). Inattention to recruitment of ethnic minority groups and failure to report on the racial and ethnic group composition of samples (and stratified outcomes data) limits our ability to address health disparities.

Inadequate Funding of Recruitment- and Retention-Specific Studies

Despite the importance of establishing evidence-based recruitment strategies, federal funding opportunities to support rigorous research on the science of recruitment and retention in diverse populations are lacking. To illustrate the lack of federal funding opportunities for studies of recruitment or retention methods in health research, we conducted searches using two major Web sites listing federal funding opportunities and solicitations: the Federal Business Opportunities (FedBizOpps.gov) and NIH Office of Extramural Research (http://grants.nih.gov/grants/guide/) Web sites. We used search terms of “recruitment OR retention AND research,” searching for active and inactive funding opportunities between 1992 and September 2010.

The FedBizOpps.gov search yielded 857 opportunities. Reviewing the title and synopsis of each one identified no opportunities that specifically requested research studies to test the effectiveness of recruitment or retention methods. Two that were closest to this intent were a contract award opportunity to generate a representative sample for the Healthy Aging in Neighborhoods of Diversity across the Life Span Study (solicitation number: 260-03-15) and a solicitation for an AIR National Guard Recruiting and Retention CD-ROM Planning Tool to assist recruiters in tracking progress toward recruitment goals (solicitation number: W9133N-04-CD-ROM). The search of the NIH Office of Extramural Research Web site yielded nine funding opportunities. None focused on studying the effectiveness of recruitment or retention methods.

Accumulating an Evidence Base on Recruitment and Retention of Ethnically Diverse Older Adults

The RCMARs and other NIA-funded programs have implemented strategies to build an evidence base on effective recruitment strategies in diverse populations in the face of limited funding. One of these strategies involves conducting nested studies of recruitment methods within funded health research studies. For example, at the University of California San Francisco RCMAR, called the Center for Aging in Diverse Communities, researchers have conducted randomized trials of several types of supplemental recruitment materials that have been nested within patient-reported quality of care studies, such as the addition of pamphlets that describe the nature of research or invitation letters that are culturally tailored (Napoles-Springer, Fongwa, Stewart, Gildengorin, & Perez-Stable, 2004). Conducting comparative effectiveness studies of recruitment and retention methods will require targeted funding, but in the absence of such funding, conducting nested recruitment studies is a useful interim strategy. However, nested studies without supplemental funding are only economically feasible for low-intensity recruitment methods.

Another strategy that is used within funded studies is to conduct supplemental analyses related to recruitment and retention outcomes. For example, such analyses have included reporting of enrollment rates stratified by race/ethnicity and stage of recruitment or retention (e.g., contact attempt, contact, invitation, enrollment, maintenance; Napoles-Springer, Santoyo, & Stewart, 2005; Ofstedal & Weir, 2011) or examining participant and site characteristics associated with retention (Manson et al., 2011). Formative research can also be used to collect data prior to (or even after) studies to examine barriers and facilitators of participation of underrepresented groups (Napoles-Springer et al., 2000; Williams, Meisel, Williams, & Morris, 2011).

The RCMAR at the University of Michigan/Wayne State University, called the Michigan Center for Urban African American Aging Research, has developed a registry of research study volunteers composed mostly of older African Americans (Chadiha et al., 2011). If multiple research centers could share the costs to support the development and maintenance of such registries, this strategy might prove to be especially cost-effective across centers. Moreover, registries may serve as a resource for creating samples of older adults from underrepresented groups, particularly racial/ethnic minority persons, and for collecting data on their health status and outcomes of care. A more resource intensive approach adopted by the NIA-funded Alzheimer's Disease Research Center at Washington University involved setting up an African American Outreach Satellite, which conducts strategic outreach and recruitment programs and training for community health care providers (Williams et al., 2011).

Recommendations to Advance the Science of Recruitment and Retention

Taken together, these creative strategies are beginning to inform future efforts to recruit and retain vulnerable populations in research. Nonetheless, much work remains to be done if we are to eliminate health disparities in older adults. The lack of funding for recruitment studies helps explain the preponderance of observational studies focused on this topic. Experimental studies in the recruitment literature that rigorously test recruitment or retention methods are the exception, despite the valuable evidence they contribute (Kiernan, Phillips, Fair, & King, 2000; Ramirez et al., 2008, 2008; Wenzel et al., 2008). Although formative and observational recruitment and retention studies are informative and essential, the insights they provide and methodological questions they raise can be addressed more definitively in some cases, using experimental methods. Tracking the cost-effectiveness of recruitment and retention methods is also vital.

Reflecting on the content of this supplement and our experiences through the RCMAR program, we present in Table 1 a set of recommendations that would significantly advance the science of recruitment and retention in diverse populations. The recommendations are listed in order of least to most resource intensive.

Table 1.

A Summary of Recommendations for Advancing the Science of Recruitment and Retention of Ethnically Diverse Populations in Health Research Organized From Least to Most Resource Intensive

1. Investigators track and report enrollment rates stratified by race/ethnicity, related challenges, and solutions.
2. Investigators conduct nested studies of the effectiveness of recruitment or retention within other health research studies.
3. Funding opportunity announcements for primary data collection studies include a request for investigators to incorporate a nested study that compares the effectiveness of multiple methods of recruitment and/or retention, especially studies that include underrepresented groups.
4. Funding agencies appropriate targeted funding to investigate specific methodologically challenging recruitment issues, e.g., identifying alternative incentives for recruiting groups that have been discriminated against or that are impoverished in longitudinal cohort studies that may have limited funding to pay monetary incentives to participants.

A requirement of funded studies that enroll a substantial proportion of an ethnic minority or other vulnerable group should be that investigators report stratified enrollment rates, as well as unique recruitment challenges and solutions within population subgroups. When applying for funding or even after studies are funded, investigators can design nested randomized trials or other types of recruitment studies within the larger substantive study that is the focus of the proposed project. Similarly, funding agencies can incorporate a relevant recruitment or retention topic within the scope of research topics specified in funding opportunity announcements. Finally, just as special funding initiatives have addressed the need for measurement studies to develop innovations in measures of complex behavioral constructs (PAR-08-212 Methodology and Measurement in the Behavioral and Social Sciences; http://grants.nih.gov/grants/guide/pa-files/PAR-08-212.html), funding agencies can create targeted recruitment initiatives. These initiatives are especially indicated in the case of large population-based cohort studies involving underrepresented groups, where biological specimens or burdensome procedures are required that can impose particular hardships on participants. A cost-effective way to test recruitment strategies is for funding agencies to offer supplemental funding to nest these studies within larger studies.

Conclusions

To eliminate health disparities and better understand aging processes in ethnic subpopulations, much more research is needed on effective strategies for increasing minority enrollment in health research. Unless there are concerted efforts (set asides) to provide funding to test the effectiveness of specific strategies in underrepresented groups and researchers devote attention to these issues, scientific progress toward identifying the most promising strategies will advance slowly and in a piecemeal fashion. Comparative effectiveness research on more intensive recruitment and retention methods, which are often needed for including ethnically diverse populations, will require dedicated funding and concerted efforts by investigators.

Funding

This work was supported by the Resource Centers for Minority Aging Research program of the National Institute on Aging (NIA), the National Institute of Nursing Research, and the National Center on Minority Health and Health Disparities (grant numbers P30 AG15272 and P30 AG015281). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIA, the National Institute of Nursing Research, and the National Center on Minority Health and Health Disparities or the National Institutes of Health.

Acknowledgments

We thank Robert J. Taylor for helpful comments on a draft of this article.

References

  1. Agency for Healthcare Research and Quality. 2003. AHRQ policy on the inclusion of priority populations in research. Retrieved February 10, 2011, from http://grants.nih.gov/grants/guide/notice-files/not-hs-03-010.html. [Google Scholar]
  2. Chadiha L, Washington OGM, Lichtenberg PA, Green CR, Daniels KL, Jackson JS. A logic model for building a registry of research volunteers among older urban African Americans. The Gerontologist. 2011;51:S106–S115. doi: 10.1093/geront/gnr034. this supplement. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Ford JG, Howerton MW, Lai GY, Gary TL, Bolen S, Gibbons MC, et al. Barriers to recruiting underrepresented populations to cancer clinical trials: A systematic review. Cancer. 2008;112:228–242. doi: 10.1002/cncr.23157. [DOI] [PubMed] [Google Scholar]
  4. Kiernan M, Phillips K, Fair JM, King AC. Using direct mail to recruit Hispanic adults into a dietary intervention: An experimental study. Annals of Behavioral Medicine. 2000;22:89–93. doi: 10.1007/BF02895172. [DOI] [PubMed] [Google Scholar]
  5. Lai GY, Gary TL, Tilburt J, Bolen S, Baffi C, Wilson RF, et al. Effectiveness of strategies to recruit underrepresented populations into cancer clinical trials. Clinical Trials. 2006;3:133–141. doi: 10.1191/1740774506cn143oa. [DOI] [PubMed] [Google Scholar]
  6. Manson S, Jiang L, Zhang L, Beals J, Acton KJ, Roubideaux Y, et al. The special diabetes program for Indians healthy heart demonstration project: Retaining American Indians and Alaska natives in cardiovascular risk reduction. The Gerontologist. 2011;51:S21–S32. doi: 10.1093/geront/gnq083. this supplement. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. McIlvane JM, Baker TA, Mingo CA, Haley WE. Are behavioral interventions for arthritis effective with minorities? Addressing racial and ethnic diversity in disability and rehabilitation. Arthritis Rheum. 2008;59:1512–1518. doi: 10.1002/art.24117. doi:10.1002/art.24117. [DOI] [PubMed] [Google Scholar]
  8. Napoles-Springer AM, Fongwa MN, Stewart AL, Gildengorin G, Perez-Stable EJ. The effectiveness of an advance notice letter on the recruitment of African Americans and Whites for a mailed patient satisfaction survey. Journal of Aging Health. 2004;16:124S–136S. doi: 10.1177/0898264304269724. [DOI] [PubMed] [Google Scholar]
  9. Napoles-Springer AM, Grumbach K, Alexander M, Moreno-John G, Forte D, Rangel-Lugo M, et al. Clinical research with older African Americans and Latinos: Perspectives from the community. Research on Aging. 2000;22:668–691. [Google Scholar]
  10. Napoles-Springer AM, Santoyo J, Stewart AL. Recruiting ethnically diverse general internal medicine patients for a telephone survey on physician-patient communication. Journal of General Internal Medicine. 2005;20:438–443. doi: 10.1111/j.1525-1497.2005.0078.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. National Institutes of Health. 2001. NIH policy and guidelines on the inclusion of women and minorities as subjects in clinical research—amended. Retrieved February 10, 2011, from http://grants.nih.gov/grants/funding/women_min/guidel.ines_amended_10_2001_htm. [Google Scholar]
  12. Ofstedal MB, Weir DR. Recruitment and retention of minority participants in the health and retirement study. The Gerontologist. 2011;51:S8–S20. doi: 10.1093/geront/gnq100. this supplement. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Ramirez AG, Miller AR, Gallion K, San Miguel de Majors S, Chalela P, Garcia Aramburo S. Testing three different cancer genetics registry recruitment methods with Hispanic cancer patients and their family members previously registered in local cancer registries in Texas. Community Genetics. 2008;11:215–223. doi: 10.1159/000116882. [DOI] [PubMed] [Google Scholar]
  14. Swanson GM, Bailar JC., III Selection and description of cancer clinical trials participants—Science or happenstance? Cancer. 2002;95:950–959. doi: 10.1002/cncr.10785. doi:10.1002/cncr.10785. [DOI] [PubMed] [Google Scholar]
  15. UyBico SJ, Pavel S, Gross CP. Recruiting vulnerable populations into research: A systematic review of recruitment interventions. Journal of General Internal Medicine. 2007;22:852–863. doi: 10.1007/s11606-007-0126-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Wenzel L, Bowen D, Habbal R, Leighton N, Vu T, Anton-Culver H. Testing targeted approaches to enhance Cancer Genetics Network minority recruitment within Asian populations. Community Genetics. 2008;11:234–240. doi: 10.1159/000116884. doi:000116884 [pii]10.1159/000116884. [DOI] [PubMed] [Google Scholar]
  17. Williams MM, Meisel MM, Williams J, Morris JC. An interdisciplinary outreach model of African American recruitment for Alzheimer's disease research. The Gerontologist. 2011;51:S134–S141. doi: 10.1093/geront/gnq098. this supplement. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Yancey AK, Kumanyika SK, Ponce NA, McCarthy WJ, Fielding JE, Leslie JP, et al. Population-based interventions engaging communities of color in healthy eating and active living: A review. Preventing Chronic Disease. 2004;1:A09. doi: A09 [pii] [PMC free article] [PubMed] [Google Scholar]
  19. Yancey AK, Ortega AN, Kumanyika SK. Effective recruitment and retention of minority research participants. Annual Review Public Health. 2006;27:1–28. doi: 10.1146/annurev.publhealth.27.021405.102113. [DOI] [PubMed] [Google Scholar]

Articles from The Gerontologist are provided here courtesy of Oxford University Press

RESOURCES