Abstract
Traditional clinical trial eligibility criteria restrict study populations, perpetuating enrollment disparities. We aimed to assess implementation of modernized eligibility criteria guidelines among pancreatic cancer (PC) clinical trials. Interventional PC trials in the United States since January 1, 2014, were identified via clinicaltrials.gov with December 31, 2017, as the transition for pre- and postguidance eras. Trials were assessed for guideline compliance and compared using Fisher exact test. In total, 198 trials were identified: 86 (43.4%) were pre- and 112 (56.6%) postguidance era. Improvements were seen in allowing patients with history of HIV (8.6% vs 43.8%; P < .0001), prior cancer (57.0% vs 72.3%; P = .034), or concurrent and/or stable cancer (2.1% vs 31.1%; P < .0001) to participate. Most (>95%) trials were compliant with laboratory reference ranges, QT interval corrected for heart rate (QTc) cutoffs, and rationalizing excluding prior therapies both pre- and postguidance eras. However, overall compliance with modernized criteria remains poor. We advocate for stakeholders to update protocols and scrutinize traditionally restrictive eligibility criteria.
Clinical trial eligibility criteria define the study population and reduce patient risk. However, traditional criteria restrict populations to the healthiest patients, perpetuating disparities in enrollment and disproportionately excluding Black patients (1). In 2017, the American Society of Clinical Oncology, Friends of Cancer Research, and the US Food and Drug Administration issued guidance on modernized study criteria to influence generalizability of results. Guidelines liberalized criteria for performance status, HIV, organ dysfunction, prior and current malignancies, comorbidities, prior therapies, washout periods, concomitant medication, and brain metastases (2-8). The extent to which these criteria have been implemented remains unknown, and importantly, their impact on clinical trial participation must be investigated (9).
We investigated the use of modernized eligibility criteria in clinical trials pre- and postpublication of updated guidance. We selected pancreatic cancer (PC), where outcomes are poor, trials are ample, and enrollment fulfills unmet clinical needs, and we previously showed that modifying criteria achieved more equitable enrollment (1). Interventional PC clinical trials in the United States starting January 1, 2014, or later in clinicaltrials.gov were identified. Trials were excluded if they were international, as the guidelines are US-based, addressed other malignancies, or were noninterventional. Trials were assessed for compliance with December 31, 2017, as the transition for pre- and postguidance eras to include 4 years of data in both. Only clinicaltrials.gov was referenced for 13 specific criteria, as this is a common source of information for referring physicians and patients. Fisher exact test was used to compare trials by disease stage, year, study phase, and sponsor to determine their influence in following modernized guidelines. Analyses were 2-sided using α = 0.05 and conducted using R statistical software (version 3.6.3; R Foundation for Statistical Computing, Vienna).
In total, 198 trials were identified: 86 (43.4%) were pre- and 112 (56.6%) postguidance era (Figure 1). In the postguidance era, improvements were seen in allowing HIV+ patients (43.8% vs 8.6%; P < .0001) and patients with prior cancer (72.3% vs 57.0%; P = .034) or concurrent, yet stable, cancer (31.1% vs 2.1%; P < .0001) to participate in trials (Table 1). Improved compliance was a function of time, unrelated to disease stage, study phase, or sponsor (Supplementary Table 1, available online). Nearly all (>95%) trials were compliant with using reference ranges for laboratory tests, QTc cutoffs, and rationale for excluding prior therapies in both eras. Modernized criteria recommendations for cardiac function measurements, cardiac abnormalities, time-based washout periods, full recovery from prior nonclinically relevant adverse events, and stable brain metastases were not statistically significantly altered.
Table 1.
Eligibility criteria | Pre (n = 86, 43.4%) n/N (%) |
Post (n = 112, 56.6%) n/N (%) |
P |
---|---|---|---|
Performance status of 2 allowed | 27/74 (36.5) | 38/105 (36.2) | 1.000 |
HIV+ allowed | 5/58 (8.6) | 49/112 (43.8) | <.0001 |
Renal function compliant (use of creatinine clearance (CrCl) only) | 6/62 (9.7) | 7/73 (9.6) | 1.000 |
Reference ranges used for labs assessing organ function | 57/59 (96.6) | 72/75 (96.0) | 1.000 |
Classification system used for assessing heart failure | 26/49 (53.1) | 35/61 (57.4) | .702 |
Cardiac abnormalities specified | 59/86 (68.6) | 67/112 (59.8) | .234 |
QTc compliant | 70/74 (94.6) | 106/109 (97.2) | .443 |
Prior malignancy >24 mo ago allowed | 49/86 (57.0) | 81/112 (72.3) | .034 |
Concurrent malignancy allowed if stable and off treatment | 1/47 (2.1) | 23/74 (31.1) | <.0001 |
Prior therapy allowed + exclusions must be specified | 56/56 (100) | 71/75 (94.7) | .135 |
Time-based washout period used | 33/55 (60.0) | 41/77 (53.2) | .480 |
Mentions recovery from prior adverse events | 25/55 (45.5) | 29/77 (37.7) | .377 |
Brain metastases allowed if stable >4 wk | 21/41 (51.2) | 25/37 (67.6) | .171 |
Denominators vary based on availability of data; missing or unknown values were not included in determining the proportion of trials that were compliant. Allowance of brain metastases, if stable for >4 weeks, was assessed only for trials that included patients with metastatic disease.
With minimal improvement, the current implementation of modernized eligibility criteria allows for increased participation of only a select few patients while continuing to fall short of increasing inclusivity. For example, HIV status contributes to disparities in eligibility of Black patients (1). Although including HIV patients may improve eligibility for Black patients, its low prevalence compared with other comorbidities is striking. In the United States, approximately 1.2 million people have HIV and 407 100 are aged 55 years or older, of which 164 010 are Black individuals (10). Taken in context with PC incidence (11), including HIV+ patients potentially affects 54 patients, 26 of whom are Black individuals. Thus, PC clinical trial inclusivity is impacted minimally through liberalizing HIV criteria.
There is opportunity for improvement with other comorbidities. Chronic kidney disease afflicts 37 million people, and Black individuals are 3 times more likely to be impacted (12). It may be as simple as removing creatinine, a controversial kidney function measure, and instead using glomerular filtration rate (13). However, only 10% of trials followed renal function recommendations, which is unacceptably low given the long-standing guidance that glomerular filtration rate estimates should be used because of creatinine’s disparate impact on minority populations.
Improved compliance with modernized criteria was associated with time but not disease stage, study phase, or sponsor. Patients with advanced disease seeking palliation were subjected to the same criteria as patients with curable disease. Phase III studies are not associated with more modernized criteria relative to early phase studies where safety determinations could arguably be more critical. Finally, the lack of association with trial sponsor is reflective of an issue across clinical research. Lack of compliance with modernization is pervasive, indicating the need for revolutionizing how patients are assessed for participation.
This begs the question of why we continue to fall short. It’s possible that protocols and historical criteria carried forward, lacking knowledge or consideration of modernized criteria. However, there may be other reasons for slow uptake including concerns that agencies may not find changes acceptable or precedent hasn’t been established. Such decisional paralysis supports the need for stakeholder accountability and criteria change in trials where appropriate.
This study was limited by referencing criteria from clinicaltrials.gov and not directly from study protocols, potentially limiting the accuracy of listed criteria. Discrepancies can exist between criteria in a study’s protocol and listing, which may lead to misrepresentation of criteria compliance (14). Furthermore, trials were considered HIV compliant if explicitly stated or lacked exclusion of serious infections requiring systemic therapy, possibly overestimating true compliance. Additionally, uptake of guidelines is likely influenced by the time required to develop clinical trials; it is possible that trials started in the post-era were developed prior to guideline publication. Reassessment may be beneficial in the future as more modern-era trials report their results. Compliance with all guidelines may not be appropriate for every trial, particularly those with surgery or combination therapies that may have increased risk of adverse events yet target compliance rates haven’t been established. Last, it’s important to assess the impact of these changes in the accrued patient populations; however, only 33.7% (29 of 86) pre- and 3.6% (4 of 112) post-era trials reported results on clinicaltrials.gov at this time.
Although specific to PC, these data provide an understanding of modernized eligibility criteria use, demonstrating that great strides are still needed to improve diversity in PC clinical trials. Further investigation into their impact for other diseases is unknown and should be determined. With recent statements in support of increasing diversity in cancer clinical trials (15), we call for all involved to update protocols and scrutinize the need for restrictive criteria. We challenge all to critically assess eligibility criteria to promote diverse and equitable participation in cancer research and care.
Supplementary Material
Acknowledgements
ANR and KMH are supported by the Collaborative Alliance for Pancreatic Education and Research Scholars program.
Funding sources had no role in the design, study commencement, analysis, results interpretation and writing of this manuscript, or decision to submit the manuscript for publication.
This work was presented in poster format at the American Society of Clinical Oncology, Annual Meeting 2022, Chicago, IL, USA. Abstract title: Use of Modernized Eligibility Criteria in Pancreatic Cancer Clinical Trials.
Contributor Information
Andrea N Riner, Department of Surgery, University of Florida College of Medicine, Gainesville, FL, USA.
Devon C Freudenberger, Department of Surgery, Virginia Commonwealth University School of Medicine, Richmond, VA, USA.
Kelly M Herremans, Department of Surgery, University of Florida College of Medicine, Gainesville, FL, USA.
Vignesh Vudatha, Department of Surgery, Virginia Commonwealth University School of Medicine, Richmond, VA, USA.
Daniel W Neal, Department of Surgery, University of Florida College of Medicine, Gainesville, FL, USA.
Thomas J George, Department of Medicine, Division of Hematology and Oncology, University of Florida College of Medicine, Gainesville, FL, USA.
Jose G Trevino, Department of Surgery, Virginia Commonwealth University School of Medicine, Richmond, VA, USA; Massey Cancer Center, Virginia Commonwealth University School of Medicine, Richmond, VA, USA.
Data availability
The data underlying this article are available in the Zenodo data repository at https://dx.doi.org/10.5281/zenodo.7600042. The datasets were derived from sources in the public domain: ClinicalTrials.gov (https://clinicaltrials.gov).
Author contributions
Andrea N Riner, MD, MPH (Conceptualization; Data curation; Investigation; Methodology; Project administration; Resources; Validation; Visualization; Writing—original draft; Writing—review & editing); Devon C Freudenberger, MD (Data curation; Investigation; Methodology; Resources; Validation; Visualization; Writing—original draft; Writing—review & editing); Kelly M Herremans, MD (Investigation; Writing—review & editing); Vignesh Vudatha, MD (Investigation; Writing—review & editing); Daniel W Neal, MS (Formal analysis; Investigation; Methodology; Resources; Software; Validation; Visualization; Writing—review & editing); Thomas J George, MD (Investigation; Methodology; Writing—review & editing); Jose G. Trevino, MD (Funding acquisition; Investigation; Methodology; Supervision; Writing—review & editing).
Funding
This work was not sponsored. Authors are supported by the National Human Genome Research Institute (T32 HG008958 to ANR, KMH) and National Cancer Institute (R01 CA242003 to JGT, U54 CA233444 to JGT, U54 CA233444-03S1 to ANR and JGT, and T32 CA093423-13 to DCF) of the National Institutes of Health, the University of Florida Health Cancer Center (TG) and the Joseph and Ann Matella Fund for Pancreatic Cancer Research (JGT).
Conflicts of interest
The authors declare no disclosures.
References
- 1. Riner AN, Girma S, Vudatha V, et al. Eligibility criteria perpetuate disparities in enrollment and participation of Black patients in pancreatic cancer clinical trials. J Clin Oncol. 2022;40(20):2193-2202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Magnuson A, Bruinooge SS, Singh H, et al. Modernizing clinical trial eligibility criteria: recommendations of the ASCO-Friends of Cancer Research performance status work group. Clin Cancer Res. 2021;27(9):2424-2429. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Uldrick TS, Ison G, Rudek MA, et al. Modernizing clinical trial eligibility criteria: recommendations of the American Society of Clinical Oncology-Friends of Cancer Research HIV working group. J Clin Oncol. 2017;35(33):3774-3780. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Spira AI, Stewart MD, Jones S, et al. Modernizing clinical trial eligibility criteria: recommendations of the ASCO-Friends of Cancer Research laboratory reference ranges and testing intervals work group. Clin Cancer Res. 2021;27(9):2416-2423. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Lichtman SM, Harvey RD, Damiette Smit MA, et al. Modernizing clinical trial eligibility criteria: recommendations of the American Society of Clinical Oncology-Friends of Cancer Research organ dysfunction, prior or concurrent malignancy, and comorbidities working group. J Clin Oncol. 2017;35(33):3753-3759. [DOI] [PubMed] [Google Scholar]
- 6. Osarogiagbon RU, Vega DM, Fashoyin-Aje L, et al. Modernizing clinical trial eligibility criteria: recommendations of the ASCO-Friends of Cancer Research prior therapies work group. Clin Cancer Res. 2021;27(9):2408-2415. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Harvey RD, Mileham KF, Bhatnagar V, et al. Modernizing clinical trial eligibility criteria: recommendations of the ASCO-Friends of Cancer Research washout period and concomitant medication work group. Clin Cancer Res. 2021;27(9):2400-2407. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Lin NU, Prowell T, Tan AR, et al. Modernizing clinical trial eligibility criteria: recommendations of the American Society of Clinical Oncology-Friends of Cancer Research brain metastases working group. J Clin Oncol. 2017;35(33):3760-3773. [DOI] [PubMed] [Google Scholar]
- 9. Snyder RA. Clinical trial eligibility criteria: a structural barrier to diversity in clinical trial enrollment. J Clin Oncol. 2022;40(20):2183-2185. [DOI] [PubMed] [Google Scholar]
- 10. Centers for Disease, Control, and Prevention. Estimated HIV Incidence and Prevalence in the United States, 2015-2019. HIV Surveillance Supplemental Report. 2021. https://www.cdc.gov/hiv/pdf/library/reports/surveillance/cdc-hiv-surveillance-supplemental-report-vol-26-1.pdf. Accessed April 28, 2022.
- 11. National Cancer Institute. SEERExplorer: An Interactive Website for SEER Cancer Statistics. https://seer.cancer.gov/explorer/. Accessed April 28, 2022.
- 12. Centers for Disease Control and Prevention. Chronic Kidney Disease in the United States, 2021. Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention; 2021. [Google Scholar]
- 13. Delgado C, Baweja M, Crews DC, et al. A unifying approach for GFR estimation: recommendations of the NKF-ASN task force on reassessing the inclusion of race in diagnosing kidney disease. Am J Kidney Dis. 2022;79(2):268-288.e1. [DOI] [PubMed] [Google Scholar]
- 14. Zhang S, Liang F, Li W, Tannock I.. Comparison of eligibility criteria between protocols, registries, and publications of cancer clinical trials. J Natl Cancer Inst. 2016;108(11):djw129. [DOI] [PubMed] [Google Scholar]
- 15. Oyer RA, Hurley P, Boehmer L, et al. Increasing racial and ethnic diversity in cancer clinical trials: an American Society of Clinical Oncology and Association of Community Cancer Centers joint research statement. J Clin Oncol. 2022;40(19):2163-2171. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data underlying this article are available in the Zenodo data repository at https://dx.doi.org/10.5281/zenodo.7600042. The datasets were derived from sources in the public domain: ClinicalTrials.gov (https://clinicaltrials.gov).