Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2025 Nov 1.
Published in final edited form as: JACC Heart Fail. 2024 Sep 11;12(11):1942–1945. doi: 10.1016/j.jchf.2024.08.006

Measures to Improve Trial Enrollment

It’s Game Time!

Nosheen Reza a, Mona Fiuzat b, Marvin A Konstam c
PMCID: PMC11540738  NIHMSID: NIHMS2029273  PMID: 39269394

Clinical trials generate the bedrock of evidence from which our patient care directives are derived. Although there has been significant evolution in the design and execution of cardiovascular clinical trials over the past several decades, shifting demographic trends, operational inefficiencies, and rising costs still pose threats to the current trial ecosystem. From 2008 to 2018, the estimated cost for developing a new cardiovascular drug, from the nonclinical through postmarketing phases, was $153.5 million.1 In 9 large randomized cardiovascular drug trials that enrolled at North American research sites, the median time from study protocol delivery to the first participant enrollment was 9 months.2 In addition, the increasing globalization of cardiovascular drug trials, often with higher enrollment rates outside the U.S., has resulted in a more severe underrepresentation of real-world U.S. populations.3 Analogous data regarding cardiovascular device trial processes are sparse, but we suspect similar limitations because recent evidence has shown that the demographics of enrolled populations in device trials may influence which patients receive the intervention in the real world.4 It is clear that strategies to accelerate trial enrollment, improve efficiency, and ensure generalizability and representativeness of target populations to increase the rate of new data generation and reduce trial duration and costs are needed. Herein, we discuss innovative strategies to achieve these goals in the context of current clinical trial infrastructures.

GAMIFICATION TO INCENTIVIZE STUDY PERFORMANCE

Recently there has been investigation of improving start up time and enrollment rate with the use of gamification, a technique based on behavioral science principles. At each site within a clinical trial, a dashboard displays to the investigative team its site’s performance in key metrics of trial performance, relative to targets and to those of other sites. It is expected that the ensuing competitive spirit might enhance performance at each site. In this issue of JACC: Heart Failure, Bhatt et al5 report on the impact of a novel gamification intervention within a large, global, randomized clinical trial on increasing trial enrollment. In this intervention deployed at 92 U.S. sites, when >70% of target U.S. patients were already enrolled, the investigators delivered a gamified electronic dashboard to sites in the FINEARTS-HF (Finerenone Trial to Investigate Efficacy and Safety Superior to Placebo in Patients With Heart Failure; NCT04435626)6 trial every 2–4 weeks. Effectiveness was assessed by: 1) comparing trial enrollments before and after the intervention rollout; and 2) comparing U.S. sties with non-U.S. sites, serving as nonrandomized control sites where no intervention was deployed. Although the intervention was not associated with a significant change in screening or enrollment rates compared with predeployment in either the U.S. or the non-U.S. sites, the authors provide several possible explanations which further inspire the exploration of this type of intervention to improve clinical trial performance. They also clarify that they considered this investigation to be a pilot study. Behavioral economics principles deployed within trial designs, like those employed by Bhatt et al,5 merit further exploration. Gamification has been shown to accelerate performance and increase enjoyment of the trial workforce during the trial startup phase,7 and its potential impact on other trial execution metrics and enrollment should be evaluated in dedicated and randomized studies. As the authors summarize, several issues, including timing of gamified intervention within the trial, heterogeneity of global trial sites, and lack of ability to objectively measure engagement with the intervention, all present opportunities for future investigation.

The concept of a trial enrollment dashboard, as piloted in this study, introduces the potential for a more expansive enrollment tracking platform that can be used by site principal investigators and tracked by trial leadership in real time. One such platform, the Accrual Quality Improvement Program, has been deployed in cancer prevention studies through the National Cancer Institute.8 That program provides a web-based centralized infrastructure for collecting, analyzing, displaying, and saving participant-, site-, and study-level data at each stage of the recruitment and enrollment process. Achieved metrics, such as enrollment rates, can be compared with projected rates and displayed along with recommendations for modifications to recruitment strategies.

STREAMLINING DATA COLLECTION AND CASE REPORT FORMS

The HFC (Heart Failure Collaboratory), a multidisciplinary group of investigators, statisticians, regulators, industry representatives, and patients, has been working diligently to address each of the roadblocks to delivering effective drugs and devices to patients more efficiently and rapidly. One major focus has been the basics of clinical trial design, working, eg, to standardize a “lean” case report form (CRF), free of procedures and measurements that are not part of the pathway to regulatory approval.9 The HFC has also devised specialized modules that can be added to the lean CRF as adjunctive information to be collected when appropriate for a particular disease state, population, or intervention. It is hoped that adoption of these standardized tools will reduce resistance to enrollment and expedite trial conduct.

IMPROVING TRIAL REPRESENTATION AND DIVERSITY

Historically, trial screening and enrollment strategies have been standardized and uniform for all participants; emerging strategies, however, have shown the potential to increase enrollment of specific populations with tailored outreach approaches. As an example, the pragmatic PRO-HF (Patient-Reported Outcome Measurement in Heart Failure Clinic; NCT04164004) trial used a virtual enrollment strategy via e-mails, text messages, and telephone calls. Asian, Black, Native American, and Pacific Islander patients enrolled in greater proportions by telephone than by e-mail, and those who enrolled by e-mail were likely to be older.10 Leveraging multimodal communication strategies tailored to sociocultural preferences should be further evaluated as a strategy to improve enrollment of underrepresented individuals. Beyond traditional outreach methods, more contemporary patient-facing platforms such as social media may harbor untapped potential. About one-fourth of adults in U.S. households have reported that they use social media at least weekly to find health-related information, and this proportion is higher among Hispanic, Black, and low-income adults.11 This iteration of direct-to-consumer advertising has shown promise in expediting enrollment and at reduced costs.12

The association between diverse trial leadership and research teams and increased enrollment from historically underrepresented populations has been demonstrated in heart failure13 and other cardiovascular specialties. Multidisciplinary consortia such as the HFC,14 Women As One, and the American College of Cardiology are leading the way in creating academic-industry partnerships and skill-development programs to cultivate early career trialists from diverse backgrounds. Leadership positions that can have an impact on trial enrollment may extend beyond executive or steering committees. At a recent HFC training program for data monitoring committee members,15 participants discussed the role of data safety monitoring boards in recommending temporary pauses on subject accrual if certain populations are disproportionately represented. Furthermore, the HFC has emphasized the role of everyone involved, from sponsors to journal editors, to increase diverse study leadership leading to downstream diverse study cohorts.14

RETOOLING SITE AND INVESTIGATOR SELECTION

Identifying clinical trial sites and investigators has largely relied on previous trial enrollment performance, site experience in a particular therapeutic area, and other such historic metrics. Recent data from the U.S. Platinum Diversity (NCT02240810) and Promus Element Plus (NCT01589978) studies demonstrated that enrollment of underrepresented populations varies by research site, geographic region, and surrounding population.16 Now, with the increasing integration of artificial intelligence in health care, we can imagine a future state in which multiple sources of information such as electronic health records, cardiovascular imaging, sponsor and trial databases, and local epidemiology and demographic patterns are inputs to machine learning models used for predictive17 and prognostic enrichment.18 As a result, trial sites with access to patients most similar to these targets would be prioritized for site activation. This practice may also serve to expand the number of investigators in heart failure clinical trials, Where there is currently recognized to be an inadequate workforce, whose participation is frequently financially and professionally discouraged.19

COLLABORATING WITH SPONSORS AND REGULATORY AGENCIES

Strategies to increase the enrollment of diverse populations in heart failure clinical trials have been extensively reviewed elsewhere.3,20 Despite a relatively increased emphasis on this issue in recent years, there has not yet been substantial progress in the representation of women and underrepresented minorities. In June 2024, the U.S. Food and Drug Administration issued a draft guidance, “Diversity Action Plans to Improve Enrollment of Participants From Underrepresented Populations in Clinical Studies,” intended to guide trial sponsors through the process of submitting Diversity Action Plans to the FDA.21 The Food and Drug Omnibus Reform Act has mandated this new requirement in an effort to encourage sponsors and investigators to design trial enrollment rationale and goals to be representative of the affected population. As of this time, a Diversity Action Plan must include the sponsor’s goals for enrollment disaggregated by race, ethnicity, sex, and age group of clinically relevant study populations, rationale for these goals, and explanation of how the sponsor plans to meet these goals. Regulatory agencies can require robust goals and plans in the approval of study protocols and could even incorporate goal achievement into the approval process.

Bhatt et al5 should be congratulated for their ingenuity and initiative in deploying a novel method to improve patient enrollment through embedding their behavioral intervention within a large global clinical trial. Although there was no indication of effectiveness within their pilot study, they highlighted several improvements that can be made within future investigation: refining the intervention, randomizing individual matched sites across the geography, and launching the intervention earlier, ideally to include study start-up. Their work highlights the ongoing challenges in executing clinical trials that are representative, agile, and cost-effective, and inspires frameworks to rigorously test innovative strategies to improve trial performance across relevant domains and domains of trial conduct.

FUNDING SUPPORT AND AUTHOR DISCLOSURES

Dr Reza is supported by the National Heart, Lung, and Blood Institute of the National Institutes of Health under award number K23HL166961; has received speaking honoraria from Zoll; has received research grants to her institution from Bristol Myers Squibb; and has received consulting fees from Roche Diagnostics, American Regent, and Bristol Myers Squibb. Dr Konstam is a consultant and is on the data monitoring committees for Boehringer Ingelheim, Cardurian, Luitpold, and Alnylam; and is a consultant for and has received research support from LivaNova and SCPharma, and Fire1. Dr Fiuzat has reported that she has no relationships relevant to the contents of this paper to disclose.

Footnotes

The authors attest they are in compliance with human studies committees and animal welfare regulations of the authors’ institutions and Food and Drug Administration guidelines, including patient consent where appropriate. For more information, visit the Author Center.

REFERENCES

  • 1.Sertkaya A, Beleche T, Jessup A, Sommers BD. Costs of drug development and research and development intensity in the US, 2000–2018. JAMA Netw Open. 2024;7:e2415445. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Goyal A, Schibler T, Alhanti B, et al. Assessment of North American clinical research site performance during the start-up of large cardiovascular clinical trials. JAMA Netw Open. 2021;4:e2117963. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Ortega RF, Yancy CW, Mehran R, Batchelor W. Overcoming lack of diversity in cardiovascular clinical trials: a new challenge and strategies for success. Circulation. 2019;140:1690–1692. [DOI] [PubMed] [Google Scholar]
  • 4.Adamson PB, Echols M, DeFilippis EM, et al. Clinical trial inclusion and impact on early adoption of medical innovation in diverse populations. JACC Heart Fail. 2024;12:1212–1222. [DOI] [PubMed] [Google Scholar]
  • 5.Bhatt AS, Chatur S, Claggett BL, et al. Gamified behavioral science intervention to enhance trial enrollment: an embedded study within the FINEARTS-HF trial. JACC Heart Fail. 2024;12:XXX-XXX. [DOI] [PubMed] [Google Scholar]
  • 6.Study to evaluate the efficacy (effect on disease) and safety of finerenone on morbidity (events indicating disease worsening) & mortality (death rate) in participants with heart failure and left ventricular ejection fraction (proportion of blood expelled per heart stroke) greater or equal to 40. Accessed July 22, 2024. https://clinicaltrials.gov/study/NCT04435626
  • 7.Lane K, Majkowski R, Gruber J, et al. Using gamification to enhance clinical trial start-up activities. J Clin Transl Sci. 2022;6:e75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Richmond E, Samimi G, House M, Ford LG, Szabo E. Accrual Quality Improvement Program for clinical trials. Clin Trials. 2024:17407745241243027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Psotka MA, Fiuzat M, Carson PE, et al. Design of a “lean” case report form for heart failure therapeutic development. JACC Heart Fail. 2019;7:913–921. [DOI] [PubMed] [Google Scholar]
  • 10.Gupta A, Skye M, Calma J, et al. Patient representativeness with virtual enrollment in the PRO-HF trial. J Am Heart Assoc. 2024;13:e030903. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Poll. most Americans encounter health misinformation, and most aren’t sure whether it’s true or false. KFF. Accessed July 26, 2024. https://www.kff.org/coronavirus-covid-19/press-release/poll-most-americans-encounter-health-misinformation-and-most-arent-sure-whether-its-true-or-false/
  • 12.Darmawan I, Bakker C, Brockman TA, Patten CA, Eder M. The role of social media in enhancing clinical trial recruitment: scoping review. J Med Internet Res. 2020;22:e22810. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Reza N, Tahhan AS, Mahmud N, et al. Representation of women authors in international heart failure guidelines and contemporary clinical trials. Circ Heart Fail. 2020;13:e006605. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Lindenfeld J, Fiuzat M, O’Connor C. Promoting diversity in clinical trial leadership: a call to action. JACC Heart Fail. 2021;9:401–402. [DOI] [PubMed] [Google Scholar]
  • 15.Fleming TR, Wittes J, Fiuzat M, et al. Training the next generation of data monitoring committee members: an initiative of the Heart Failure Collaboratory. JACC Heart Fail. 2024. S2213–1779(24) 00180-X. [DOI] [PubMed] [Google Scholar]
  • 16.Batchelor WB, Damluji AA, Yong C, et al. Does study subject diversity influence cardiology research site performance? Insights from 2 U.S. national coronary stent registries. Am Heart J. 2021;236:37–48. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Oikonomou EK, Thangaraj PM, Bhatt DL, et al. An explainable machine learning–based phenomapping strategy for adaptive predictive enrichment in randomized clinical trials. NPJ Digit Med. 2023;6:217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Harrer S, Shah P, Antony B, Hu J. Artificial intelligence for clinical trial design. Trends Pharmacol Sci. 2019;40:577–591. [DOI] [PubMed] [Google Scholar]
  • 19.O’Connor CM, Psotka MA, Fiuzat M, et al. Improving heart failure therapeutics development in the United States: the Heart Failure Collaboratory. J Am Coll Cardiol. 2018;71:443–453. [DOI] [PubMed] [Google Scholar]
  • 20.DeFilippis EM, Echols M, Adamson PB, et al. Improving enrollment of underrepresented racial and ethnic populations in heart failure trials: a call to action from the Heart Failure Collaboratory. JAMA Cardiol. 2022;7:540–548. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.U.S. Food and Drug Administration. FDA guidance provides new details on diversity action plans required for certain clinical studies. Accessed July 25, 2024. https://www.fda.gov/news-events/press-announcements/fda-guidance-provides-new-details-diversity-action-plans-required-certain-clinical-studies

RESOURCES