Skip to main content
Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease logoLink to Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease
editorial
. 2021 Nov 15;10(22):e023673. doi: 10.1161/JAHA.121.023673

Recruitment Practices in Multicenter Randomized Clinical Trials: Time for a Relook

Prakriti Gaba 1, Deepak L Bhatt 1,
PMCID: PMC8751918  PMID: 34779247

Multicenter randomized clinical trials are considered to provide the highest quality evidence for clinical decision making. In cardiology, this is particularly true as the field boasts a massive repository of clinical trials on subjects spanning from acute coronary syndromes to atrial fibrillation to structural heart disease. 1 However, clinical trials are not without their own drawbacks. 2 Curbed efficiency, the time‐consuming nature, and potential biases from heterogeneity in recruitment have raised concerns about their true “gold standard” nature. 3 , 4 , 5

In this issue of the Journal of the American Heart Association (JAHA), Ndrepepa et al evaluate one potential aspect of trial biases and adeptly compare clinical outcomes between patients recruited at high recruitment centers (HRCs) and low recruitment centers (LRCs) from the ISAR‐REACT 5 (Ticagrelor or Prasugrel in Patients With Acute Coronary Syndromes) trial. 6 , 7 Among the 4018 patients with acute coronary syndrome recruited in ISAR‐REACT 5 trial, 3011 (75%) were recruited at HRCs and 1007 (25%) were recruited at LRCs. There was a lower cumulative incidence of the primary end point (death, myocardial infarction, or stroke) in patients recruited at LRCs as opposed to HRCs (7.3% versus 8.4%; hazard ratio [HR], 0.86). Although this value did not reach statistical significance (P=0.27), the numerical trend was driven by significantly lower all‐cause mortality among patients recruited at LRCs compared with HRCs (2.9% versus 4.5%; HR, 0.64; P=0.031).

More notably, when evaluated for effect modification, there was a significant interaction between the treatment effect of ticagrelor versus prasugrel and patient recruitment category for all‐cause death. Although all‐cause death was higher among patients treated with ticagrelor than those treated with prasugrel and recruited at LRCs (4.2% versus 1.6%; HR, 2.67; P=0.018), there was no significant difference among HRC recruited patients treated with either antiplatelet agent (4.6% versus 4.4%; HR, 1.05; P=0.76), resulting in an interaction P value of 0.032. On careful analysis of baseline risk profiles of patients recruited at HRCs and LRCs in ISAR‐REACT 5 trial, patients recruited at LRCs were younger, had fewer comorbidities, including hypercholesterolemia, and were less sick, with fewer cases of cardiogenic shock or history of prior revascularization. The authors concluded that the recruitment of patients with lower baseline risk at LRCs was most likely responsible for the differences in all‐cause death and numerical trends in the lower incidence of the primary composite end point. Of note, follow‐up was incomplete in 3.1% of patients recruited at LRCs and 2.0% of patients recruited at HRCs (P=0.038).

The findings of this study have several important implications. First, baseline risk profiles of patients recruited at LRCs ought to be more carefully analyzed before inclusion of patients in randomized clinical trials. This is not the first analysis of a clinical trial that has found differential outcomes between patients enrolled in low versus high recruitment sites; in fact, it is one of several. As the authors point out, the GLOBAL LEADERS (A Clinical Study Comparing Two Forms of Anti‐Platelet Therapy After Stent Implantation) trial has previously reported the impact of recruitment volume on all‐cause mortality and found similarly low baseline risk among patients recruited at LRCs. In contrast, a post hoc analysis of the EVEREST (Efficacy of Vasopressin Antagonism in Heart Failure: Outcome Study with Tolvaptan) trial showed low enrolling sites had worse outcomes and higher rates of death compared with high enrolling sites. 9 , 10 Although the differences did not reach significance, together with the results of this present study, these studies reveal the spectrum of clinical outcomes observed across sites with low recruitment volumes. 9 , 10 Moreover, they beg the question of whether a novel standardized approach is required for patient recruitment across low (and high) recruitment centers. Although the randomization process should have prevented any site‐by‐site heterogeneity, statistically, there was significant effect modification for all‐cause death between the two treatment arms based on high versus low recruitment volume, suggesting the potential for a real difference. Perhaps training and support aimed at recruiting patients with similar risk profiles in line with the intent of the trial protocol should be provided to all site investigators from the get‐go. This may prevent the inadvertent enrollment of patients who are lower risk than intended, which can compromise the statistical power of a trial. It can, however, be difficult to tease out any impact that LRC status may have on other aspects of trial conduct, such as completeness of follow‐up or adherence to guideline‐directed therapies that could affect event rates in all arms of a trial.

Second, central remote patient recruitment and consent may assist in recruiting a larger number of patients with appropriate risk profiles for clinical trials. Over the past 2 decades, both social media and digital health platforms have been leveraged to reach a larger network of diverse participants who meet inclusion criteria of trials. 3 , 11 , 12 , 13 However, despite introduction of these novel technologies and methods, they have not been routinely implemented. The COVID‐19 pandemic has helped provide some of the much needed activation energy for this process as in‐person recruiting and consent were limited by stay‐at‐home and quarantine requirements, but more work is needed for sustainable change. 2 , 3 , 13 , 14

Finally, and perhaps most importantly, this study serves as a reminder that clinical trial results should be analyzed carefully before implementation into clinical practice. Decisions to start treatment should be personalized to each patient and his/her needs. Physicians must ensure that their patients fit the risk profile of trial participants driving the outcomes of a trial. These efforts will prevent overtreatment and preclude unwanted sequelae of new therapies, whether they be drugs or devices.

A few limitations to be noted include the single trial data set, arbitrary cutoffs used for HRCs versus LRCs, and lack of analyses that correct for all baseline differential risk profiles, potentially influencing clinical outcomes.

In conclusion, this insightful study by Ndrepepa et al underscores the need for a relook, reevaluation, and central standardization of recruitment processes for multicenter clinical trials, especially LRCs. Efforts are needed at both the central and local level for sustainable change. We are now equipped with sophisticated technologies that allow easy and immediate remote communication. It is our imperative to leverage these resources, in addition to existing resources, to build a better, more unified, and higher quality future for our patients. Ongoing studies of other multicenter clinical trials will help to continue to inform this process.

Disclosures

Dr Bhatt discloses the following relationships: Advisory Board: Cardax, CellProthera, Cereno Scientific, Elsevier Practice Update Cardiology, Janssen, Level Ex, Medscape Cardiology, MyoKardia, NirvaMed, Novo Nordisk, PhaseBio, PLx Pharma, and Regado Biosciences; Board of Directors: Boston VA Research Institute, Society of Cardiovascular Patient Care, and TobeSoft; Chair: Inaugural Chair, American Heart Association Quality Oversight Committee; Data Monitoring Committees: Baim Institute for Clinical Research (formerly Harvard Clinical Research Institute, for the PORTICO trial, funded by St. Jude Medical, now Abbott), Cleveland Clinic (including for the ExCEED trial, funded by Edwards), Contego Medical (Chair, PERFORMANCE 2), Duke Clinical Research Institute, Mayo Clinic, Mount Sinai School of Medicine (for the ENVISAGE trial, funded by Daiichi Sankyo), Novartis, and Population Health Research Institute; Honoraria: American College of Cardiology (Senior Associate Editor, Clinical Trials and News, ACC.org; Chair, ACC Accreditation Oversight Committee), Baim Institute for Clinical Research (formerly Harvard Clinical Research Institute; RE‐DUAL PCI clinical trial steering committee funded by Boehringer Ingelheim; AEGIS‐II executive committee funded by CSL Behring), Belvoir Publications (Editor in Chief, Harvard Heart Letter), Canadian Medical and Surgical Knowledge Translation Research Group (clinical trial steering committees), Duke Clinical Research Institute (clinical trial steering committees, including for the PRONOUNCE trial, funded by Ferring Pharmaceuticals), HMP Global (Editor in Chief, Journal of Invasive Cardiology), Journal of the American College of Cardiology (Guest Editor; Associate Editor), K2P (Cochair, interdisciplinary curriculum), Level Ex, Medtelligence/ReachMD (Continuing Medical Education [CME] steering committees), MJH Life Sciences, Population Health Research Institute (for the COMPASS operations committee, publications committee, steering committee, and USA national coleader, funded by Bayer), Slack Publications (Chief Medical Editor, Cardiology Today's Intervention), Society of Cardiovascular Patient Care (Secretary/Treasurer), and WebMD (CME steering committees); Other: Clinical Cardiology (Deputy Editor), NCDR‐ACTION Registry Steering Committee (Chair), and VA CART Research and Publications Committee (Chair); Research Funding: Abbott, Afimmune, Amarin, Amgen, AstraZeneca, Bayer, Boehringer Ingelheim, Bristol‐Myers Squibb, Cardax, CellProthera, Cereno Scientific, Chiesi, CSL Behring, Eisai, Ethicon, Ferring Pharmaceuticals, Forest Laboratories, Fractyl, Garmin, HLS Therapeutics, Idorsia, Ironwood, Ischemix, Janssen, Lexicon, Lilly, Medtronic, MyoKardia, NirvaMed, Novartis, Novo Nordisk, Owkin, Pfizer, PhaseBio, PLx Pharma, Regeneron, Roche, Sanofi, Synaptic, The Medicines Company, and 89Bio; Royalties: Elsevier (Editor, Cardiovascular Intervention: A Companion to Braunwald's Heart Disease); Site Coinvestigator: Abbott, Biotronik, Boston Scientific, CSI, St. Jude Medical (now Abbott), Philips, and Svelte; Trustee: American College of Cardiology; Unfunded Research: FlowCo, Merck, and Takeda. Dr Gaba has no disclosures to report.

The opinions expressed in this article are not necessarily those of the editors or of the American Heart Association.

For Disclosures, see page 2.

See Article by Ndrepepa et al.

REFERENCES

  • 1. Kearney A, Linden K, Savage P, Menown IBA. Advances in clinical cardiology 2020: a summary of key clinical trials. Adv Ther. 2021;38:2170–2200. doi: 10.1007/s12325-021-01711-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Vaduganathan M, Butler J, Krumholz HM, Itchhaporia D, Stecker EC, Bhatt DL. Regulation of cardiovascular therapies during the COVID‐19 public health emergency. J Am Coll Cardiol. 2020;76:2517–2521. doi: 10.1016/j.jacc.2020.09.594 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Gaba P, Bhatt DL. The COVID‐19 pandemic: a catalyst to improve clinical trials. Nat Rev Cardiol. 2020;17:673–675. doi: 10.1038/s41569-020-00439-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Goyal A, Schibler T, Alhanti B, Hannan KL, Granger CB, Blazing MA, Lopes RD, Alexander JH, Peterson ED, Rao SV, et al. Assessment of North American clinical research site performance during the start‐up of large cardiovascular clinical trials. JAMA Netw Open. 2021;4:e2117963. doi: 10.1001/jamanetworkopen.2021.17963 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Bhatt DL. Reconfiguring the cardiovascular clinical trial enterprise in the United States. JAMA Netw Open. 2021;4:e2118176. doi: 10.1001/jamanetworkopen.2021.18176 [DOI] [PubMed] [Google Scholar]
  • 6. Ndrepepa G, Neumann F, Menichelli M, Bernlochner I, Richardt G, Wöhrle J, Witzenbichler B, Mayer K, Cassese S, Gewalt S, et al. Assessment of impact of patient recruitment volume on risk profile, outcomes and treatment effect in a randomized trial of ticagrelor vs. prasugrel in acute coronary syndromes. J Am Heart Assoc. 2021;10:e021418. doi: 10.1161/JAHA.121.021418 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Schüpke S, Neumann F‐J, Menichelli M, Mayer K, Bernlochner I, Wöhrle J, Richardt G, Liebetrau C, Witzenbichler B, Antoniucci D, et al. Ticagrelor or prasugrel in patients with acute coronary syndromes. N Engl J Med. 2019;381:1524–1534. doi: 10.1056/NEJMoa1908973 [DOI] [PubMed] [Google Scholar]
  • 8. Takahashi K, Kogame N, Tomaniak M, Chichareon P, Chang C‐C, Modolo R, Benit E, Liebetrau C, Janssens L, Ferrario M, et al. Impact of recruitment and retention on all‐cause mortality in a large all‐comers randomised controlled trial: insights from the GLOBAL LEADERS trial. Clin Res Cardiol. 2020;109:918–929. doi: 10.1007/s00392-019-01585-w [DOI] [PubMed] [Google Scholar]
  • 9. Bhatt DL, Cavender MA. Are all clinical trial sites created equal? J Am Coll Cardiol. 2013;61:580–581. doi: 10.1016/j.jacc.2012.10.024 [DOI] [PubMed] [Google Scholar]
  • 10. Butler J, Subacius H, Vaduganathan M, Fonarow GC, Ambrosy AP, Konstam MA, Maggioni A, Mentz RJ, Swedberg K, Zannad F, et al. Relationship between clinical trial site enrollment with participant characteristics, protocol completion, and outcomes. J Am Coll Cardiol. 2013;61:571–579. doi: 10.1016/j.jacc.2012.10.025 [DOI] [PubMed] [Google Scholar]
  • 11. Steinhubl SR, Wolff‐Hughes DL, Nilsen W, Iturriaga E, Califf RM. Digital clinical trials: creating a vision for the future. NPJ Digit Med. 2019;2:1–3. doi: 10.1038/s41746-019-0203-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Anderson A, Borfitz D, Getz K. Global public attitudes about clinical research and patient experiences with clinical trials. JAMA Netw Open. 2018;1:e182969. doi: 10.1001/jamanetworkopen.2018.2969 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Forrest CB, Xu H, Thomas LE, Webb LE, Cohen LW, Carey TS, Chuang CH, Daraiseh NM, Kaushal R, McClay JC, et al. Impact of the early phase of the COVID‐19 pandemic on US healthcare workers: results from the HERO registry. J Gen Intern Med. 2021;36:1319–1326. doi: 10.1007/s11606-020-06529-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Wang X, Bhatt DL. COVID‐19: an unintended force for medical revolution? J Invasive Cardiol. 2020;32:E81–E82. [DOI] [PubMed] [Google Scholar]

Articles from Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease are provided here courtesy of Wiley

RESOURCES