Abstract
The last decade in oncology has been marked by the identification of numerous new potential cancer targets, and even more agents designed to inhibit them. The matrix of new targets, new agents, and the companion diagnostics required to identify the right patient for the right drug has created a major challenge for the clinical trial process. This has been compounded by the addition of new immunomodulators targeting the host immune system rather than the tumor. Recognizing the need for new approaches, industry, investigators and regulators have responded to this challenge. New clinical trial designs are being evaluated to incorporate the genomic sequence data being obtained almost routinely after cancer diagnosis. New dose-finding approaches are being proposed to identify the maximum effective dose rather than the maximum tolerated dose. The FDA is involved in the drug approval process from points early in development, and has accepted registration quality data from expansion cohorts in support of drug approval. Despite progress on several fronts, many challenges remain, including the lack of predictability of preclinical data for clinical results and Phase II data for Phase III results, an infrastructure that can be an obstacle to clinical trial development and implementation, and the increasing use of contracted Clinical Research Organizations that limit a fit for purpose approach to clinical trial execution. Perhaps most challenging and important of all are the difficulties with clinical trial accrual that can prevent study completion. Both the innovations and the challenges highlight the important role of process in progress in clinical oncology.
Introduction
When Gleevec first achieved FDA accelerated approval for targeting the aberrant tyrosine kinase Bcr-Abl in chronic myelogenous leukemia in 2001, it represented the first in a new class of anticancer agents. Subsequently, cancer genome sequencing identified numerous such targets mutated or rearranged in cancer. Although representing only a fraction of the hundreds of protein kinases found in the human genome, the estimated 90 tyrosine kinases (including 58 transmembrane receptor and 32 cytoplasmic nonreceptor types (1, 2), have been particularly fruitful cancer targets, and more than a decade has been spent developing agents that inhibit them (Table 1 for examples). Over the last decade it has become apparent that our clinical trial structure, as it currently exists, cannot support the level and pace of development required, and that a paradigm shift in translational and clinical science will be needed to rapidly assess the efficacy of new agents. Considering that tumor sensitivity to many of these agents is dependent upon the existence of gene amplification, rearrangement, or mutation--requiring the development of companion diagnostics through a separate regulatory pathway-- it becomes readily apparent that the matrix of many targets, many drugs, and sensitizing genomic alterations in subsets of tumors creates a complex task for drug development. The complexity is increased again by the new class of immunomodulatory agents, which target non-malignant immune cells and thus have the potential to be active across a broad range of malignancies regardless of histology.
Table 1.
Examples of tyrosine kinase inhibitors (TKI) in clinical development
| TKI | Main target(s) | Development stage |
|---|---|---|
| Afatinib | EGFR/HER2 | FDA approved |
| Alectinib | ALK | Phase III |
| Apatinib | VEGFR-2 | Phase II |
| Axitinib | BEGFR | FDA approved |
| Bafetinib | Bcr-Abl | Phase II |
| Bosutinib | Bcr-Abl | FDA approved |
| Brivanib | FGFR, VEGFR | Phase II |
| Canertinib | Pan-ErbB | No longer in development |
| Cediranib | VEGFR-1, -2, -3 | Phase III |
| Ceritinib | ALK | FDA approved |
| Crizotinib | ALK | FDA approved |
| Dasatinib | SRC, Bcr-Abl | FDA approved |
| Dovitinib | FGFR, VEGFR | Phase III |
| Erlotinib | EGFR | FDA approved |
| Fedratinib | JAK2 | Discontinued |
| Gefitinib | EGFR | FDA approved |
| Ibrutinib | BTK | FDA approved |
| Imatinib | Bcr-Abl | FDA approved |
| Lapatinib | EGFR, HER2 | FDA approved |
| Lestaurtinib | FLT3 | No longer in development |
| Levantinib | FGFR, VEGFR | FDA approved |
| Lucitanib | FGFR 1/2, VEGFR 1–3, PGFRα/β | Phase II |
| Motesanib | VEGFR, PDGFR, SCFR | Phase II/III |
| Neratinib | EGFR, HER2, HER4 | Phase III |
| Nilotinib | Bcr-Abl | FDA approved |
| Nintedanib | PDGFR α/β, FGFR 1/3, and VEGFR 1–3 | Phase II |
| Pazopanib | VEGFR | FDA approved |
| Ponatinib | Bcr-Abl | FDA approved |
| Quizartinib | FLT3 | Phase II/IIb |
| Regorafenib | VEGFR | FDA approved |
| Ruxolitinib | JAK2 | FDA approved |
| Semaxanib | VEGFR | No longer in development |
| Sorafenib | VEGFR, BRAF | FDA approved |
| Sunitinib | VEGFR | FDA approved |
| Tivozanib | VEGFR 1–3 | Phase III |
| Toceranib | KIT, VEGFR 2, PDGFR | FDA approved in canines |
| Vandetanib | RET, VEGFR β | FDA approved |
Among the many novel aspects of immune checkpoint inhibitor therapy were the trial designs that supported the FDA approval of the first two immune checkpoint agents – pembrolizumab and nivolumab. Both drugs received accelerated approval in melanoma – pembrolizumab, based on results obtained in a subset of 173 patients with advanced melanoma treated on an open label Phase Ib clinical trial that has by now enrolled over 1200 patients (3); nivolumab based on a subset of 120 patients enrolled on a randomized Phase III trial that screened 631 patients at 90 sites in 14 countries (4). The FDA approval of an agent in the “Phase I” setting was in itself remarkable the fact notwithstanding that the actual cohort of melanoma patients treated that led to drug approval was not representative of a typical Phase I trial. The responses were at times dramatic and those patients whose tumors did respond often had long-term benefit – supporting the FDA decision. In this case, the customary clinical trial progression from safety in Phase I to efficacy in Phase II to comparative efficacy in Phase III was replaced by the use of expansion cohorts, generating a “continuum” or “phaseless” trial utilizing amendments and discussions with the FDA. This served the useful purpose of bringing the agent to patients faster, and demonstrated the FDA’s willingness to be flexible and innovative. One provocative aspect of the use of this “continuum” expansion cohort model is that it bypassed the conventional drug development model and the complex regulatory infrastructure that has become daunting for investigators and regulators alike.
One caveat – the term “regulatory” may refer to the work of the FDA or EMA in deciding whether a drug is sufficiently safe and effective to allow its approval. But “regulatory structure or infrastructure” refers rather to the apparatus that has been created over the years to ensure that clinical trials not only comply with clinical and scientific requirements, but also with FDA guidelines, human subjects protection, financial conflicts of interest, and intellectual property constraints. This regulatory infrastructure has often burdened clinical trial completion and drug development. As the basic understanding of cancer increases, and we envision better anti-cancer agents, we need to imagine a future (5) in which our clinical trial system can adapt to the ever-expanding number of clinical targets and agents, and more rapidly and efficiently assess the efficacy of a new agent, including companion diagnostics as appropriate, without the need for the complex regulatory infrastructure that typically requires lengthy evaluations and multiple sequential clinical trials.
New Trial Designs to Incorporate New Science
With the expansion of genetic profiling of cancers into both research and private sectors, the clinical trial structure has had to adapt to the resulting genomic information. As discussed by Siu et al., new trial designs are being crafted that incorporate a tumor’s genomic profile (6). However, even the new trial designs cannot incorporate the sheer number of mutations being described. That remains the challenge for the future.
Cancer biologists are characterizing cancer’s heterogeneity, identifying potential targets, and developing therapies for those targets. The challenge is that the majority of tumors have multiple targets, and drug combinations will be required. Delivering these novel therapies to patients requires clinical trials that to date have understood cancers to be heterogeneous but out of necessity were treated as homogeneous. Now, as we focus on ever-smaller subsets of a particular cancer, the relevant patient population will not be able to support a large traditional trial. The good news is that identifying a subset of patients whose tumors are or may be exquisitely sensitive to a therapy means sample size can be smaller and still have good power.
To maximize resource utilization and expedite delivery of agents to patients, we will need a new paradigm that will require a new business model for pharmaceutical companies and a new regulatory model. Oncology Times quoted Janet Woodcock, during her tenure as director of the Center for Drug Evaluation and Research (CDER) at the FDA, in this regard (7): “We need a new definition of a clinical trial. Because it will be impossible to do a separate, single trial to answer each question raised by each biomarker and candidate therapy, we need to turn the [current] paradigm on its head.” Woodcock also noted that clinical trials are too expensive, are too noninformative, and take too long, and that new trial designs should aim to intervene early with combination therapies. As an example of an adaptive trial design, Woodcock cited the breast cancer I-SPY2 trial, which has a broad intake and many treatment strata based on biomarkers (7).
Multiple new clinical trial designs have been proposed to adapt to the identification of genomic alterations in cancer. Some of these designs, detailed in Table 2, attempt to deal with the genomic alterations identified in an individual patient’s tumor. As described by Siu et al. (6), trials that enroll patients based on a genomic alteration rather than a disease type – so-called basket trials – are well underway. It is not clear, however, what the registration path will be for agents showing activity in that setting. In contrast to the newer LUNG-MAP trial testing multiple agents in squamous cell lung cancer, which had a registrational intent at its inception, the I-SPY 2 trial discussed below planned to “graduate” biomarker/agent combinations to subsequent registration studies (5, 6, 8–10).
Table 2.
Categorizing modern oncology clinical trial designs
| Name | Description |
|---|---|
| Platform trial | Evaluates many therapies in a particular disease or group of diseases. Therapies usually have different sponsors and may be combinations or sequences. |
| Standing trial | Platform trial in which therapies enter and leave over time. |
| Master protocol | A trial with multiple treatment options requiring separate protocols but under the same aegis. Informed consent is usually required for both the master protocol and the respective individual protocol. |
| Indication finder | Evaluates a particular therapy across multiple cancers that are defined by organ type, or across subtypes within a specific organ type. The goal is to determine which diseases or which biomarker subtypes are appropriate for further development. |
| Basket (or bucket) trial | Evaluates the effect of a particular targeted therapy on a particular genetic or molecular aberration across cancer organ types. Variant of indication finder but the therapy is not evaluated for its off-target effects. |
| Umbrella Trial | This term may be useless because it is used for very different designs by different researchers and reporters. I use it for platform trials (many therapies) that are indication finders for each therapy. |
| Adaptive trial | Trials in which unblinded data are monitored and used to determine the future course of the trial based on prospectively defined decision rules. |
| Seamless phasesa | A particular kind of adaptive trial that moves from one phase of drug development to another without pausing accrual. Decisions at the phase switch usually involve greater focus. Examples include dropping arms, dropping doses or schedules, dropping patient subsets, changing randomization proportions, estimating the sample size for the next phase, and there are many possibilities. (I do not include changing primary endpoint for reasons indicated in the text.) |
FDA’s February draft “Guidance for Industry, Adaptive Design Clinical Trials for Drugs and Biologics” (46) is focused on phase 3 trials. It avoids the term “seamless phase 2/3” because the term provides “no additional meaning beyond the term adaptive.” Reprinted from ref. 5: Molecular Oncology, Vol 9, Berry DA, The Brave New World of clinical cancer research: adaptive biomarker-driven trials integrating clinical practice with clinical research, 951–9, Copyright 2015, with permission from Federation of European Biochemical Societies.
I-SPY 2 has been called an umbrella trial, and perhaps more aptly, a standing platform trial (5). It is an adaptively designed phase 2 process for screening experimental drugs. It began in 2010 and is ongoing. The adaptive approach is especially useful for addressing many questions. I-SPY 2 compares the efficacy of a novel therapy added to a standard therapy to standard therapy alone within many subsets of disease and asks which of many possible combinations are better for which patients. An innovative feature of the trial is that success is measured in terms of predicting regulatory success in a future confirmatory phase 3 trial. These predictions use the Bayesian approach and are based on information currently available in the trial.
The patient population in the I-SPY trials is high-risk primary breast cancer and the therapeutic approach is neoadjuvant. Experimental therapies are added to the taxane portion of standard neoadjuvant therapy and are evaluated for 10 prospective biomarker-defined subsets of patients. The only exception has been neratinib which, for HER2-positive disease, replaced the standard arm’s trastuzumab rather than adding to it. Using a common control has an obvious benefit in terms of overall trial sample size, and facilitates indirect comparisons of the treatment effect of the experimental arms with each other in the same population and the same protocol. The trial’s primary end point is pathologic complete response (pCR). Information about pCR is gathered via longitudinal modeling of tumor burden using MRI 3 and 12 weeks after initiating therapy. During the course of the trial pCR became accepted as a route to accelerated approval by the FDA (11). The trial has evaluated, or is currently evaluating, 10 experimental therapies. Three of these have “graduated.” The first was veliparib, a PARP inhibitor, which was given in addition to carboplatin plus standard therapy and was considered only for HER2-negative tumors. It graduated with a signature in triple-negative breast cancer, and showed no benefit in hormone-receptor (HR) positive disease (12). The other two graduates were across the entire patient population, at least in the initial period of their randomization. Neratinib, a HER1/2/4 inhibitor, graduated with a HER2+/HR- signature (13); and MK2206, an allosteric Akt1/2/3 inhibitor, graduated with three signatures: HER2+/HR-, HER2+, and HR- (14).
Historically, two clinical trial strategies have been used to assess agents targeting a particular biomarker. One is to enroll only patients whose tumors express the biomarker. The other is to treat a broader spectrum of tumors but with a primary focus on the biomarker-defined subset following the trial. The former approach minimizes the number of patients enrolled, but it fails to confirm the predictability of the biomarker and may miss important off-target effects. I-SPY 2’s adaptive randomization is a compromise between the two extremes. It learns about effects in a broader population, but with only modest increase in sample size. As an example, neratinib showed little promise of benefit in patients with HER2- tumors and with a relatively low MammaPrint score. The randomization probability for these patients became 0 toward the latter part of neratinib’s tenure in the trial. Even though this patient subset represents about 45% of the overall patient population, only 17 (15%) of the 115 patients assigned to neratinib were in this subset.
The multi-arm, common control aspect of I-SPY 2 has an advantage that was demonstrated in September 2013 when the FDA gave accelerated approval (15) to pertuzumab for the neoadjuvant treatment of HER2+ breast cancer “in combination with trastuzumab and other chemotherapy” (16, 17). It thus became necessary to drop the control arm for patients who had HER2+ tumors, which in a two-armed randomized trial would require stopping the trial. However, I-SPY 2 simply continued accrual with a minor modification made in the statistical analysis that already had a built-in indirect comparison feature.
Finally, in addition to matching a specific genomic alteration to a drug, there is the problem of developing the companion diagnostic that will define the patient population likely to benefit. Scher et al. proposed an adaptive design in the context of a randomized Phase III study with registrational intent that would test a biomarker, e.g., one that required designation of an expression level cutoff, and include assignment of patients to either training or validation cohorts within the context of the same study, allowing assessment of treatment impact on both the whole population and on the biomarker positive population (18).
We do not know what the new paradigm in cancer clinical trials will be, or even what it should be. What is most important is that we propose new clinical trial designs, and actually put the more promising of the proposals into practice. We must identify new and more efficient ways to learn and subsequently identify new and more efficient ways to develop the next generation of drugs for our patients.
New Dose Finding Strategies
The search for innovative dose-finding paradigms in oncology is not new. In the era of chemotherapy development, the 3+3 approach became the standard for MTD selection (19). Dose-finding was driven by the mechanism of the drugs being developed, where toxicity was intrinsically linked to a drug’s clinical activity. Various attempts to develop adaptive dose finding methods were introduced, most notably the Continuous Reassessment Method (CRM) (20), generally implemented in the Bayesian framework. CRM optimized the number of patients treated at doses near MTD and improved overall MTD determination. Subsequent modifications [restricted CRM (21); cohorted CRM (22); two-stage CRM (23)] were implemented to both reduce safety risk (lowering the number of patients treated at doses above the MTD) and reduce the duration of studies. Escalation With Overdose Control – EWOC (24) reduced safety risk further by using the uncertainty of the dose-DLT relationship to better quantify risk for future dose levels.
In 2004, the FDA released the report “Innovation/Stagnation: Challenges and Opportunities on the Critical Path to New Medicinal Products” with a call for innovation in dose selection (25). The book, Translational Medicine: Strategies and Statistical Methods, reports that “a senior FDA official notified the audience that the success rate at registration had dropped to 50% in 2003 and ‘most of the failures at registration (were) due to the sponsor selecting the wrong dose or regimen for the test drug’” (26). It is clear regulators want to see novel designs implemented and that modern dose-finding requires them. Yet Rogatko reported in 2007 that just 20/1215 (1.6%) of phase I studies implemented Bayesian adaptive designs (27)and in 2009, Le Tourneau reported that only 6 of an additional 181 studies (3.3%) implemented these novel approaches (28). So what holds back their adoption?
In general, novel approaches require sound statistical capabilities and not all institutions or companies have access to the relevant statisticians skilled in these approaches. A greater focus must be paid to translating these complex approaches into easy to understand communications in the clinical literature allowing them to be more accessible to the non-statistical audience. There are also concerns that these novel designs require more patients and thus “the same job can be done with a simple algorithm”. However, this is clearly not the case. Numerous publications show that a design focused only on DLT will be more successful to determine MTD when using a Bayesian design than an algorithm (20, 29). Further, unlike traditional chemotherapy development where toxicity was considered the surrogate for activity, modern targeted agents may have activity without the onset of significant toxicity (particularly in the case of single-agent immunotherapies). Therefore, the paradigm of MTD as the sole endpoint is being challenged.
Phase I trials now require many questions to be answered at the same time. While optimizing dose, we may change the schedule and/or formulation, assess whether the drug should be given in a fasted or fed state, or ascertain the potential impact of combination partners through drug-drug interactions (Fig. 1). Pharmacodynamics markers can indicate when a biologically active dose is achieved without the need to continue to MTD. In some cases the underlying science tells us that non-monotone activity is possible where higher doses of the drug lead to loss of activity (examples being some immunotherapies). Therefore, on-study PK and PD data may alter the decisions we make about the recommended dose.
Figure 1.

Information used to select dose throughout escalation
The blue circles denote required information that is necessary to know how to (or when not to) escalate beyond certain dose levels. The orange circles denote nonrequired information that allows dosing decisions to be driven by other endpoints collected within the study (e.g., using PK data to assess whether a change of schedule is needed). AE, adverse event; DLT, dose-limiting toxicity; PD, pharmacodynamic; PK, pharmacokinetic; QTc, QT corrected interval; RDI, relative dose intensity; SAE, serious adverse event.
An adaptive dose-finding approach must use the safety risk-assessment to exclude escalation beyond certain dose levels since safety and tolerability are required for dose selection. It must also be flexible enough to allow dosing decisions to be driven by other endpoints collected within the study when needed (Fig. 1). It should prospectively allow changes such as altering the schedule or adjusting formulations. In addition to the DLT assessment, long-term tolerability of the drug should be factored into dose and/or schedule decisions. For example, onset of thrombocytopenia in later cycles of treatment may be mitigated by using an intermittent schedule from the onset of treatment, or by utilizing a lower dose given more frequently if the event is considered related to the maximum concentration of the drug. The choice of the adaptation needs to be made by review of all the data.
Fundamentally, a more flexible approach to dose finding is needed, and a well-designed model to assess the risk of DLT is essential. This model should incorporate the available information on the safety of our compound (from preclinical or historical studies), be able to reflect a wide-range of possible dose-DLT relationships, and should be flexible enough to react to data observed in the trial. Neuenschwander et al. introduced the Bayesian logistic regression model (BLRM), which addresses each of these concerns; technical details of incorporating prior information are highlighted in a 2011 ASA Webinar (29, 30). The key difference in the implementation of the original CRM and that recommended by the BLRM authors and reinforced in clinical examples of its use (31) and subsequent presentations (32) is that the BLRM uses EWOC to identify doses that are not acceptable for use due to safety risk and then requires the investigators to use all of the available information to select the most appropriate dose for patients from those that are considered safe for use. If safety is the only available information then the BLRM can be used to drive the selection, whereas a new dose may be chosen based on the available PK or PD data, or even early activity information. This may reflect the comparative success of implementing BLRM within phase I studies; in a 2015 AACR/FDA workshop on dose finding of small molecule oncology drugs Bailey noted that over 150 studies had been performed using BLRM with around 30 being combination studies(30, 32). For a recent overview of how these novel approaches have been developed for combination dose finding and a summary of designs and experience, see Neuenschwander et al. (33).
As we move into this new era of dose finding, continuous access to data is key to making more effective decisions. Electronic databases now allow the rapid turn-around of data and analyses to support escalation decisions. Commitment to developing biomarkers and assessing this data prospectively throughout the study, reviewing the pharmacokinetics and looking at these data in context with the preclinical knowledge and the science of the cancer is critical to making better decisions. This is a call to design studies to answer all of the questions at hand while maximizing a patient’s potential to achieve benefit. It is not only about collecting more data to build this foundation, but about collecting the right data and using it at the right time. The adaptive BLRM approach is one way to address these challenges and these novel approaches should be considered along with other appropriate methods for analyzing the other information (i.e., PK, PD, activity). In the case of increasingly smaller populations in rare subdivisions of cancers, these novel approaches may be the only way to determine the right treatment for patients at the same time as facilitating early approvals.
Flexible Regulatory Review
Recent oncology drug approvals have demonstrated the FDA Office of Hematology and Oncology Products’ (OHOP) adoption of new approaches to speed drug development, including the flexibility to review at early stages of development, as discussed in Theoret et al. (34). The traditional roadmap for regulatory oversight of the process of drug development (Fig. 2A) evolved in conjunction with, and soon after, the enacting in 1962 of the Kefauver-Harris amendment to the Food, Drugs, and Cosmetics Act in the wake of the thalidomide tragedy. Prior to that time, the balance of safety and effectiveness was not explicit in the standards by which drugs were measured for approval. The linear drug development process, with three distinct phases, grew out of the need to develop drugs that, for the first time, met measureable criteria for safety and effectiveness while also protecting the rights and health of research volunteers. During the early years of cancer chemotherapy, this linear, well-demarcated process was sufficient to keep pace with the discovery of new drugs and new scientific methods. Since the start of the current millennium, however, there has been a rapid growth in agents under development. This occurred in conjunction with the acceleration of scientific understanding of cancer along multiple axes, from a molecular-- including genetic, epigenetic, and proteomic--to a systems biology understanding of cancer and its evolution. Given this expansion of drug development technology, and the possibility of targeting specific patient populations based on biomarkers that are more likely to receive a benefit from specific treatments, the complexity of drug development has increased, and in conjunction, has promoted the development of a modern drug regulatory framework that is more efficient and flexible. Of critical importance as the regulatory process increases in complexity is the continued need to prioritize patients' safety, which will always function as a regulatory brake. While maintaining this priority, the once-rigid three-phase clinical trials process has become much more fluid (Fig. 2B). The goal is to be able to clearly evaluate endpoints that meet the regulatory requirements of demonstrating safety and efficacy, without being constrained by traditional trial phases, most importantly for those drugs that show significant improvement over available therapies. Recent prominent examples include the approval of pembrolizumab for the treatment of metastatic melanoma following the demonstration of efficacy in a single-arm phase 1b trial (3), and the approval of vismodegib for the treatment of basal cell carcinoma following a phase 2 trial (35). In the first case, an expansion cohort was sufficient to demonstrate a robust objective response rate; in the latter, significant clinical benefit was seen following the reduction in disease burden in the target disease population. Other aspects of modern oncology that make the shortened regulatory timeline possible are biomarker-driven patient selection, where an efficacy signal could be seen in a shorter timeline with fewer patients. Despite examples of effective treatments making it to patients faster because of a shortened regulatory timeline, other scientific hurdles persist, which are important reminders of the potential pitfalls of accelerated regulatory action. The recent example of iniparib, which demonstrated a strong OS advantage in phase 2 but that was unfortunately not borne out in phase 3, is one such example (36, 37).
Figure 2.
Regulatory timelines then (A) and now (B).
Approaches to Avoiding Failure in Phase III Trials
Seruga et al. in this CCR Focus examine the outcome of Phase III randomized controlled trials (RCTs) of targeted therapies published between 2010- 1014 (38). Efficacy trials enrolling over 150 participants were included. In all, 112 RCTs were identified meeting criteria defined for inclusion. Of these, 60 trials were negative and 52 were deemed positive. In seeking factors that could lead to negative findings in Phase III, the investigators focused on two observations. One is that many Phase III trials proceed despite an adequate threshold of activity not being reached in Phase II. The second is that few studies include sufficient pharmacodynamic analysis to conclude that target has actually been inhibited. With the limited resources including the patient populations required for clinical trial, the harm done in conducting a negative Phase III trial can be considerable. It is not unusual for a negative Phase III trial to signal the demise of a company that has put most of its resources there. If we want to speed drug development, approaches that reduce the rate of Phase III failure need to be identified.
Unified Data Collection Strategies
Standards for data collection should be unified, and codified, so that data collection is just right, rather than too much or too little. This would address the problem generated by Clinical Research Organizations (CRO) seeking “registration level data” during monitoring of a trial designed to screen for efficacy. This issue remains a large impediment to multi-institutional trials and requires continued dialog between regulators, sponsors, and CROs for resoluation. A related problem is that variability in data collection procedures amongst institutions creates difficulties in merging clinical databases. This slows down drug development by delaying clinical trial initiation and creating redundant processes for data gathering. Electronic case report forms often do not have the flexibility to change as the protocol changes. The critical role of the case report form in data quality is emerging as a key component in data quality for clinical trials, whether conducted for safety or for registration (39). The reorganizations that are ongoing involving the NCI Cooperative Groups and the Early Therapeutics Clinical Trials Network (ETCTN) sponsored by the Cancer Therapy Evaluation Program (CTEP) may provide an opportunity for streamlining and simplifying data collection for multi-institutional trials.
Clinical Trials and Regulatory Infrastructure Should Be Fit for Purpose
We should not evolve a system in which "every trial is a registration trial." While it is exciting to think of drug approval at the Phase 1b stage, and we laud the flexibility of the FDA and investigators in the rapid development of the checkpoint inhibitors, the 1200 patient pembrolizumab trial is in some sense a sign of strain in our clinical trial system. The fact that this path to approval was chosen demonstrates that investigators considered this the most direct approach – despite the multiple amendments and conversations that allowed conversion of a Phase I safety trial into registration quality endpoint data (34). Writing in this issue of CCR Focus, David Stewart and colleagues examine the many regulatory infrastructure hurdles that vex investigators, and offers ideas for resolving these hurdles (40).
The clinical trial system should be based on the “fit for purpose” concept. The design should attempt to fulfill the objectives of the clinical trial and those objectives should guide the level of regulatory infrastructure required. This concept and others are listed in Text Box 1. The challenge for the future is to envision a "better clinical trial system" with novel tools that maximize the knowledge gained, enhancing next generation agents to translate data from these trials back into the laboratory. This question is most critical for drugs/combinations that are incremental in nature rather than paradigm-shifting such as the tyrosine kinase inhibitors and the immune check point inhibitors (e.g., Keytruda and Opdivo).
Text Box 1. Some approaches to create a more fit for purpose clinical trial system.
| Our clinical trial system would be improved by: |
| 1. Scientific review that did not require extensive preclinical data but be "fit for purpose"– e.g., a small two-stage Phase II should not require extensive animal efficacy testing. Recognition that preclinical efficacy models are often not sufficiently predictive and that a small study with a high bar may be a more effective way to test a hypothesis. And, a faster approach to translating preclinical data to Phase 1. |
| 2. Hypothesis-generating studies, e.g., natural history studies collecting genomic information did not require a pre-existing question. |
| 3. Agreed upon clinical trial templates–previously agreed upon language for early phase studies, to streamline the review process. |
| 4. Multi-institutional trials require scientific and IRB review only at site of origination. |
| 5. A "fit for purpose" trial design scheme–e.g. Nonregistration vs Registration–so that the level of data collection and monitoring matched the trial purpose. |
| 6. Acceptance of a high efficacy bar for Nonregistration/Exploratory trials to decrease size and speed completion. |
| 7. Established efficacy bars and benchmarks so that single-arm studies could be used for screening for activity or for registration. For example, selecting complete response as a metric may provide a more accurate index of efficacy than response alone. |
| 8. A less adversarial audit process culture. |
| 9. Platform trials were the norm rather than the exception. |
| 10. A continued emphasis on companion diagnostic development but recognition that the level of development should be “fit for purpose”–e.g. full technical validation might occur in the post-marketing period. Also, minimal validation for other cancer types after first diagnostic approval. |
| 11. Unified data collection strategies to streamline multi-institutional trials. 12. Incentives for clinical trial referral were in place at the community level–and a marked simplification of enrollment processes. |
Clinical Trial Accrual
One last critical topic for speeding drug development is that of clinical trial accrual. The fraction of patients taking part in clinical trials remains a small subset of those under active treatment – and stable to decreasing over the past few years at a dismal rate of <3% (41). Despite the cost of clinical trials and their financial needs, the most valuable and challenged resource to clinical trial recruitment and drug approval is the patient. With increasing drugs receiving FDA approval, there are more standard of care options available. Given the infrastructural needs required to recruit patients to clinical trials and the increasing resource limitations in the healthcare system, the challenge of enhancing recruitment of patients to clinical trials has never been greater (42–44).
In many instances, there is a significant “disconnect.” More and better tools are becoming available to patients and physicians in oncology: genomic profiling, as one example. Yet, translating the worth of such tools into practice will require well-controlled clinical trials that not only demonstrate “proof of concept” of the direct interpretation of the tool, but also examining many different facets of such tools. The limited trials made available to patients treated in the community, put to question the expense of using such information tools in general practice.
Finally, the Affordable Care Act (ACA) has specific language regarding participation of clinical trials for patients with cancer. In fact, PHS Act section 2709(a) of the ACA states (45) that if a group health plan or health insurance issuer in the group and individual health insurance market provides coverage to a qualified individual (as defined under PHS Act section 2709(b)), then such plan or issuer: (a) may not deny the qualified individual participation in an approved clinical trial with respect to the treatment of cancer or another life-threatening disease or condition; (b) may not deny (or limit or impose additional conditions on) the coverage of routine patient costs for items and services furnished in connection with participation in the trial; and (c) may not discriminate against the individual on the basis of the individual’s participation in the trial.
However, with more effective standard of care agents available, and the increased burden of the healthcare system on providers with limitations on infrastructural resources to accommodate clinical research, and the majority of patients treated outside of centers focusing on clinical research, it is more difficult to increase the actual percentage of patients recruited to therapeutic cancer trials. The challenge for increased recruitment rests upon the entire cancer community: it is imperative to include clinical trials in the list of options. The pembrolizumab and nivolumab story are exciting and somewhat unique in the clinical trial paradigm. If we are to continue the pendulum of drug development clinical successes, and to optimize the incremental steps that have been fundamental to progress, it is the responsibility of the entire provider community to develop not only unique trial designs and regulatory paths, but also a new paradigm that facilitates enhanced accrual. This much is critical to assure and maintain a positive and rapid trajectory of development of the next generation of agents in oncology.
Conclusions
This edition of CCR Focus has sought to define and discuss some of the prevailing issues in drug development – issues central to the question of how we as a community can develop drugs more rapidly, more efficiently, more cost effectively. These include both exciting new clinical trial design ideas – from Dose Finding to Adaptive Trial Designs, and more difficult issues such as why some trials fail late in development and how our regulatory structure contributes to slowing things down. One clear point to be made is that neither design nor regulation can prevent effective new drugs from being developed. Drugs that are paradigm shifting such as imatinib, vemurafenib, nivolumab, and pembrolizumab will be developed no matter what. Nor can optimal design and improved local regulatory infrastructure give us new drugs or validated targets. Cancer is much too complex. However, design and structure can make the process more or less efficient. Further, drugs that provide incremental improvement can be lost in poor design or poor accrual. How can we maximize the efficiency of the development process for both transformative drugs as well as those that are incremental in nature? These issues are work for the next decade.
Footnotes
Disclosure of Potential Conflicts of Interest
D.A. Berry is an employee of and a consultant/advisory board member for Berry Consultants. P.M. LoRusso reports receiving commercial research support from Astex Pharmaceuticals, Genentech, and Novartis; speakers bureau honoraria from Genentech; and is a consultant/advisory board member for Pfizer. No potential conflicts of interest were disclosed by the other authors.
References
- 1.Blume-Jensen P, Hunter T. Oncogenic kinase signalling. Nature. 2001;411:355–65. doi: 10.1038/35077225. [DOI] [PubMed] [Google Scholar]
- 2.Manning G, Whyte DB, Martinez R, Hunter T, Sudarsanam S. The protein kinase complement of the human genome. Science. 2002;298:1912–34. doi: 10.1126/science.1075762. [DOI] [PubMed] [Google Scholar]
- 3.Poole RM. Pembrolizumab: first global approval. Drugs. 2014;74:1973–81. doi: 10.1007/s40265-014-0314-5. [DOI] [PubMed] [Google Scholar]
- 4.Weber JS, D'Angelo SP, Minor D, Hodi FS, Gutzmer R, Neyns B, et al. Nivolumab versus chemotherapy in patients with advanced melanoma who progressed after anti-CTLA-4 treatment (CheckMate 037): a randomised, controlled, open-label, phase 3 trial. Lancet Oncol. 2015;16:375–84. doi: 10.1016/S1470-2045(15)70076-8. [DOI] [PubMed] [Google Scholar]
- 5.Berry DA. The Brave New World of clinical cancer research: adaptive biomarker-driven trials integrating clinical practice with clinical research. Mol Oncol. 2015;9:951–9. doi: 10.1016/j.molonc.2015.02.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Siu LL, Conley BA, Boerner S, LoRusso PM. Next-generation sequencing to guide clinical trials. Clin Cancer Res. 2015;21:xxxx–xxxx. doi: 10.1158/1078-0432.CCR-14-3215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Eastman P. Janet Woodcock: FDA will soon issue guidance on co-development of drugs and diagnostics. Oncology Times. 2013;35:11–2. [Google Scholar]
- 8.Barker AD, Sigman CC, Kelloff GJ, Hylton NM, Berry DA, Esserman LJ. I-SPY 2: an adaptive breast cancer trial design in the setting of neoadjuvant chemotherapy. Clin Pharmacol Ther. 2009;86:97–100. doi: 10.1038/clpt.2009.68. [DOI] [PubMed] [Google Scholar]
- 9.Berry DA. Adaptive clinical trials in oncology. Nat Rev Clin Oncol. 2012;9:199–207. doi: 10.1038/nrclinonc.2011.165. [DOI] [PubMed] [Google Scholar]
- 10.Berry DA, Herbst RS, Rubin EH. Reports from the 2010 Clinical and Translational Cancer Research Think Tank meeting: design strategies for personalized therapy trials. Clin Cancer Res. 2012;18:638–44. doi: 10.1158/1078-0432.CCR-11-2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Silver Spring (MD): U.S. Food and Drug Administration; 2014. Guidance for industry: pathological complete response in neoadjuvant treatment of high-risk early-stage breast cancer: use as an end point to support accelerated approval [PDF on the Internet] [cited 2015 Jul 25]. Available from: http://www.fda.gov/downloads/drugs/guidancecomplianceregulatoryinformation/guidances/ucm305501.pdf. [Google Scholar]
- 12.Rugo HS, Olopade O, DeMichele A, van 't Veer L, Buxton M, Hylton N, et al. Veliparib/carboplatin plus standard neoadjuvant therapy for high-risk breast cancer: first efficacy results from the I-SPY 2 TRIAL. Cancer Res. 2013;73(24 Suppl):Abstract nr S5–02. [Google Scholar]
- 13.Park JW, Liu MC, Yee D, DeMichele A, van 't Veer L, Hylton N, et al. Neratinib plus standard neoadjuvant therapy for high-risk breast cancer: efficacy results from the I-SPY 2 TRIAL [abstract]. Cancer Res; Proceedings of the 105th Annual Meeting of the American Association for Cancer Research; 2014 Apr 5–9; San Diego, CA. Philadelphia (PA): AACR; 2014. p. Abstract nr CT227. [Google Scholar]
- 14.Tripathy D, Chien AJ, Hylton N, Buxton MB, Ewing CA, Wallace AM, et al. Adaptively randomized trial of neoadjuvant chemotherapy with or without the Akt inhibitor MK-2206: graduation results from the I-SPY 2 Trial. J Clin Oncol. 2015;33(suppl):abstr 524. [Google Scholar]
- 15.FDA approves Perjeta for neoadjuvant breast cancer treatment. FDA News Release. 2013 Sep 30; [cited 2015 Jul 25]. Available from: http://www.fda.gov/NewsEvents/Newsroom/PressAnnouncements/ucm370393.htm.
- 16.Amiri-Kordestani L, Wedam S, Zhang L, Tang S, Tilley A, Ibrahim A, et al. First FDA approval of neoadjuvant therapy for breast cancer: pertuzumab for the treatment of patients with HER2-positive breast cancer. Clin Cancer Res. 2014;20:5359–64. doi: 10.1158/1078-0432.CCR-14-1268. [DOI] [PubMed] [Google Scholar]
- 17.Gianni L, Pienkowski T, Im YH, Roman L, Tseng LM, Liu MC, et al. Efficacy and safety of neoadjuvant pertuzumab and trastuzumab in women with locally advanced, inflammatory, or early HER2-positive breast cancer (NeoSphere): a randomised multicentre, open-label, phase 2 trial. Lancet Oncol. 2012;13:25–32. doi: 10.1016/S1470-2045(11)70336-9. [DOI] [PubMed] [Google Scholar]
- 18.Scher HI, Nasso SF, Rubin EH, Simon R. Adaptive clinical trial designs for simultaneous testing of matched diagnostics and therapeutics. Clin Cancer Res. 2011;17:6634–40. doi: 10.1158/1078-0432.CCR-11-1105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Storer BE. A sequential phase II/III trial for binary outcomes. Stat Med. 1990;9:229–35. doi: 10.1002/sim.4780090305. [DOI] [PubMed] [Google Scholar]
- 20.O'Quigley J, Pepe M, Fisher L. Continual reassessment method: a practical design for phase 1 clinical trials in cancer. Biometrics. 1990;46:33–48. [PubMed] [Google Scholar]
- 21.Faries D. Practical modifications of the continual reassessment method for phase I cancer clinical trials. J Biopharm Stat. 1994;4:147–64. doi: 10.1080/10543409408835079. [DOI] [PubMed] [Google Scholar]
- 22.Korn EL, Midthune D, Chen TT, Rubinstein LV, Christian MC, Simon RM. A comparison of two phase I trial designs. Stat Med. 1994;13:1799–806. doi: 10.1002/sim.4780131802. [DOI] [PubMed] [Google Scholar]
- 23.Moller S. An extension of the continual reassessment methods using a preliminary up-and-down design in a dose finding study in cancer patients, in order to investigate a greater range of doses. Stat Med. 1995;14:911–22. doi: 10.1002/sim.4780140909. discussion 23. [DOI] [PubMed] [Google Scholar]
- 24.Babb J, Rogatko A, Zacks S. Cancer phase I clinical trials: efficient dose escalation with overdose control. Stat Med. 1998;17:1103–20. doi: 10.1002/(sici)1097-0258(19980530)17:10<1103::aid-sim793>3.0.co;2-9. [DOI] [PubMed] [Google Scholar]
- 25.FDA's Critical Path Initiative [about 2 screens] [cited 2015 Jul 25]. Available from: http://www.fda.gov/scienceresearch/specialtopics/criticalpathinitiative/ucm076689.htm#.
- 26.Cosmatos D, Chang-Chow S, editors. Translational medicine: strategies and statistical methods. Boca Raton (FL): Chapman and Hall; 2009. [Google Scholar]
- 27.Rogatko A, Schoeneck D, Jonas W, Tighiouart M, Khuri FR, Porter A. Translation of innovative designs into phase I trials. J Clin Oncol. 2007;25:4982–6. doi: 10.1200/JCO.2007.12.1012. [DOI] [PubMed] [Google Scholar]
- 28.Le Tourneau C, Lee JJ, Siu LL. Dose escalation methods in phase I cancer clinical trials. J Natl Cancer Inst. 2009;101:708–20. doi: 10.1093/jnci/djp079. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Neuenschwander B, Branson M, Gsponer T. Critical aspects of the Bayesian approach to phase I cancer trials. Stat Med. 2008;27:2420–39. doi: 10.1002/sim.3230. [DOI] [PubMed] [Google Scholar]
- 30.Bailey S, Neuenschwander B. Bayesian model-based approaches for single and combination dose finding [PDF on the Internet] Alexandria (VA): American Statistical Association; 2011. [cited 2015 Jul 25]. Available from: http://www.amstat.org/sections/sbiop/webinars/2011/Presentation4-27-2011.pdf. [Google Scholar]
- 31.Sessa C, Shapiro GI, Bhalla KN, Britten C, Jacks KS, Mita M, et al. First-in-human phase I dose-escalation study of the HSP90 inhibitor AUY922 in patients with advanced solid tumors. Clin Cancer Res. 2013;19:3671–80. doi: 10.1158/1078-0432.CCR-12-3404. [DOI] [PubMed] [Google Scholar]
- 32.Dose-Finding of Small Molecule Oncology Drugs [about 13 screens] [cited 2015 Jul 25]. Available from: http://www.aacr.org/AdvocacyPolicy/GovernmentAffairs/Pages/dose-finding-of-small-molecule-oncology-drugs.aspx.
- 33.Neuenschwander B, Matano A, Tang Z, Roychoudhury S, Wandel S, Bailey S. A Bayesian industry approach to phase I combination trials in oncology. In: Zhao W, Yang H, editors. Statistical methods in drug combination studies. Boca Raton (FL): CRC Press; 2015. [Google Scholar]
- 34.Theoret MR, Pai-Scherf LH, Chuk MK, Prowell TM, Balasubramaniam S, Kim T, et al. Expansion cohorts in first-in-human solid tumor oncology trials. Clin Cancer Res. 2015;21:xxxx–xxxx. doi: 10.1158/1078-0432.CCR-14-3244. [DOI] [PubMed] [Google Scholar]
- 35.Axelson M, Liu K, Jiang X, He K, Wang J, Zhao H, et al. U.S Food and Drug Administration approval: vismodegib for recurrent, locally advanced, or metastatic basal cell carcinoma. Clin Cancer Res. 2013;19:2289–93. doi: 10.1158/1078-0432.CCR-12-1956. [DOI] [PubMed] [Google Scholar]
- 36.O'Shaughnessy J, Osborne C, Pippen JE, Yoffe M, Patt D, Rocha C, et al. Iniparib plus chemotherapy in metastatic triple-negative breast cancer. N Engl J Med. 2011;364:205–14. doi: 10.1056/NEJMoa1011418. [DOI] [PubMed] [Google Scholar]
- 37.O'Shaughnessy J, Schwartzberg L, Danso MA, Miller KD, Rugo HS, Neubauer M, et al. Phase III study of iniparib plus gemcitabine and carboplatin versus gemcitabine and carboplatin in patients with metastatic triple-negative breast cancer. J Clin Oncol. 2014;32:3840–7. doi: 10.1200/JCO.2014.55.2984. [DOI] [PubMed] [Google Scholar]
- 38.Seruga B, Ocana A, Amir E, Tannock IF. Failures in phase III: causes and consequences. Clin Cancer Res. 2015;21:xxxx–xxxx. doi: 10.1158/1078-0432.CCR-15-0124. [DOI] [PubMed] [Google Scholar]
- 39.Bellary S, Krishnankutty B, Latha MS. Basics of case report form designing in clinical research. Perspect Clin Res. 2014;5:159–66. doi: 10.4103/2229-3485.140555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Stewart DJ, Batist G, Kantarjian HM, Bradford J-P, Schiller JH, Kurzrock R. The urgent need for clinical research reform to permit faster, less expensive access to new therapies for lethal diseases. Clin Cancer Res. 2015;21:xxxx–xxxx. doi: 10.1158/1078-0432.CCR-14-3246. [DOI] [PubMed] [Google Scholar]
- 41.Eisenstein M. Clinical trials: More trials, fewer tribulations. Nature. 2014;509:S55–7. doi: 10.1038/509S55a. [DOI] [PubMed] [Google Scholar]
- 42.Gerber DE, Lakoduk AM, Priddy LL, Yan J, Xie XJ. Temporal trends and predictors for cancer clinical trial availability for medically underserved populations. Oncologist. 2015;20:674–82. doi: 10.1634/theoncologist.2015-0083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Schroen AT, Petroni GR, Wang H, Gray R, Wang XF, Cronin W, et al. Preliminary evaluation of factors associated with premature trial closure and feasibility of accrual benchmarks in phase III oncology trials. Clin Trials. 2010;7:312–21. doi: 10.1177/1740774510374973. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Carlisle B, Kimmelman J, Ramsay T, MacKinnon N. Unsuccessful trial accrual and human subjects protections: an empirical analysis of recently closed trials. Clin Trials. 2015;12:77–83. doi: 10.1177/1740774514558307. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Patient Protection and Affordable Care Act of 2010, Pub. L. No. 2709, 117 Stat. 2272 (Dec 24, 2009). Available from: http://www.hhs.gov/healthcare/rights/law/patient-protection.pdf.
- 46.Guidance for industry: adaptive design clinical trials for drugs and biologics[PDF on the Internet] Silver Spring (MD): U.S. Food and Drug Administration; 2010. [cited 2015 Jul 25]. Available from: http://www.fda.gov/downloads/Drugs/.../Guidances/ucm201790.pdf. [Google Scholar]


