Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2021 Jun 3.
Published in final edited form as: Clin Trials. 2021 Jan 10;18(3):314–323. doi: 10.1177/1740774520983484

Adapting isotonic dose-finding to a dynamic set of drug combinations with application to a phase I leukemia trial

Nolan A Wages 1, Daniel R Reed 2, Michael K Keng 2, Mark R Conaway 1, Gina R Petroni 1
PMCID: PMC8172388  NIHMSID: NIHMS1652642  PMID: 33426919

Abstract

Background/aims:

This paper describes the proposed design of a Phase I study evaluating the safety of ceramide nanoliposome and vinblastine among an initial set of nineteen possible dose combinations in patients with relapsed/refractory acute myeloid leukemia and patients with untreated acute myeloid leukemia who are not candidates for intensive induction chemotherapy.

Methods:

Extensive collaboration between statisticians and clinical investigators revealed the need to incorporate several adaptive features into the design, including the flexibility of adding or eliminating certain dose combinations based on safety criteria applied to multiple dose pairs. During the design stage, additional dose levels of vinblastine were added, increasing the dimension of the drug combination space and thus the complexity of the problem. Increased complexity made application of existing drug combination dose-finding methods unsuitable in their current form.

Results:

Our solution to these challenges was to adapt a method based on isotonic regression to meet the research objectives of the study. Application of this adapted method is described herein, and a simulation study of the design’s operating characteristics is conducted.

Conclusions:

The aim of this manuscript is to bring to light examples of novel design applications as a means of augmenting the implementation of innovative designs in the future and to demonstrate the flexibility of adaptive designs in satisfying changing design conditions.

Keywords: Dose finding, Phase I, drug combination

Introduction

The paper describes the proposed design of a Phase I trial evaluating the safety of ceramide nanoliposome and vinblastine in leukemia patients. The primary objective of the study was to determine the maximum tolerated dose combination of ceramide nanoliposome and vinblastine among the possible combinations provided in Figure 1. The maximum tolerated dose combination was defined as the combination with a dose-limiting toxicity rate closest to the pre-specified target rate of 20%, which was chosen based on the expectedness of adverse events according to the toxicity profiles observed in previous studies that involved vinblastine or ceramide nanoliposome in solid tumors. The study included several unique design considerations that made direct application of an existing Phase I drug combination method problematic. The initial set of regimens of interest to investigators included the nineteen combinations in the shaded region of Figure 1, with combination 5 being the starting combination. Investigators wanted the design to allow for exploration of another four possible dose combinations (combination 1 through combination 4) if the lowest combinations in the initial set (combinations 5 and 6) were determined to be too toxic. Therefore, not all dose pairs were admissible at the startup, and some dose pairs, such as (54 mg/m2 vinblastine, 0.375 mg/m2 ceramide nanoliposome) and (54 mg/m2 vinblastine, 0.75 mg/m2 ceramide nanoliposome), were never intended to be explored. If at any time in the accrual process combinations 5 (the starting combination) and 6 were deemed too toxic, then future accrual to combination 5 or above was no longer allowed. This required that the design be able to handle the adaptive opening and closing of certain dose pairs, based on safety stopping criteria applied to multiple dose pairs.

Figure 1.

Figure 1.

Combination and zone designation for a phase I trial of ceramide nanoliposome and vinblastine in leukemia patients.

The clinical considerations of which dose pairs to explore and when created a high-dimensional, dynamic drug combination space that necessitated adaptations to existing methods for combination dose-finding. While it is the case that some existing dose-finding methods for drug combinations can eliminate dose combination candidates, no current method will move to specific areas of the drug combination matrix based on default elimination rules. All current methods would need to be adapted in some form, and it is unknown what impact these types of modifications have on the operating characteristics of any particular design. There are many methods available12 that could be considered for modification, yet we chose to focus our attention on methods that have been implemented in published drug combination studies. One possibility is the partial order continual reassessment method,3 which has been adapted for implementation into several real studies.46 The method of Ivanova and Wang7 was executed in a Phase I study of neratinib in combination with temsirolimus in patients with human epidermal growth factor receptor 2-dependent and other solid tumors.8 The method of Conaway, Dunbar, and Peddada9 was implemented in a Phase I trial investigating induction therapy with bortezomib and vorinostat in patients with surgically resectable non-small cell lung cancer.10 The partial order continual reassessment method requires pre-specification of a constant, termed the “skeleton” of the model, that is a representation of the probability of dose-limiting toxicity at each combination. The skeleton values must be adequately spaced to ensure good operating characteristics.11 This proved to be very difficult in the current study due to the large number of combinations being studied, as we will demonstrate in our simulation studies. The latter two methods7,9 rely on isotonic regression12 for estimation of dose-limiting toxicity probabilities. The Conaway-Dunbar-Peddada method has been extensively evaluated and has demonstrated favorable operating characteristics in recent simulation studies among a variety of more complex dose-finding problems.1317 Based on these results, as well as its ability to balance simplicity with good statistical properties, we decided to adapt the Conaway-Dunbar-Peddada method to meet the challenges of the Phase I leukemia trial. Changes in access to one of the study agents ultimately lead to further design modifications with a more limited scope, but we describe the tailoring of the original design to the dynamic set of combinations herein.

Methods

Estimation in the Conaway-Dunbar-Peddada method accounts for the uncertainty in toxicity ordering among the combinations under investigation when identifying the maximum tolerated dose combination. Toxicities were to be assessed according to the National Cancer Institute Common Toxicity Criteria for Adverse Events, version 5. The primary outcome measure that was to guide accrual decisions was the frequency of treatment related dose-limiting toxicities. For the purposes of dose escalation, dose-limiting toxicities were to be determined by protocol-specific severe adverse events occurring during the first cycle of treatment, and intra-patient dose escalation was not to be allowed.

Participant allocation

Participant allocation was to occur in two stages. The escalation plan for the Stage 1 was based upon following an initial pre-specified escalation path, noted by the dashed arrow in Figure 1. Participants were to be accrued to the study in cohorts of size 2 to the initial pre-specified escalation path beginning with Combination 5. The statistical team for this study originally proposed escalation in cohorts of size 1 in Stage 1 in order to quickly and efficiently move through the many combinations being studied. The clinical team (and review entities) felt more comfortable slowing initial escalation to cohorts of size 2 in order to be a bit more conservative. If no participant in the cohort experienced a dose-limiting toxicity, escalation was to proceed along the pre-specified path. Escalation to the next combination in the path was to occur only when both participants had been followed for the minimum follow-up period, and no dose-limiting toxicity had been observed. This allocation strategy was to be followed for accrual along the pre-specified path until the first dose-limiting toxicity was observed, or a stopping rule was triggered. Once a dose-limiting toxicity had been observed in any participant or the highest combination had been reached, Stage 2 based on the estimation procedure of Conaway-Dunbar-Peddada7 was to begin. The Stage 1 cohort size and the initial escalation path had little impact on the overall operating characteristics of the design (Supplemental Figures 1 and 2).

Stage 2 was to allocate eligible participants in cohorts of size 1 based upon estimates of the dose-limiting toxicity probabilities at each of the combinations. Estimates are based on a modification of the Conaway-Dunbar-Peddada method using a selected set of possible orderings for the dose-limiting toxicity probabilities (Table 1). Six orderings provides an appropriate balance between choosing enough orderings so that we include adequate information to account for the uncertainty surrounding partially ordered dose–toxicity curves, without increasing the dimension of the problem so much so that we diminish performance.14 At any point in the trial, the dose-limiting toxicity data for dose combination di is of the form Ωi = {(yi,ni):i = 1,…,I} with yi equal to the number of observed dose-limiting toxicities and ni equal to the number of participants who have been evaluated for toxicity at combination di. To model the probability of dose-limiting toxicity πi at each combination, we assumed a beta-binomial model

yiπi~ Binomial (πi);πi~Beta(αi,βi),

where Beta(αi,βi) is a beta distribution with parameters αi and βi. Based on the accumulated toxicity data Ωi=(yi,ni) at di, the posterior distribution of πi follows a beta distribution

πiΩi~Beta(αi+yi,βi+niyi).

Based on this distribution, the updated dose-limiting toxicity probabilities, are given by the following posterior mean.

π^i=yi+αini+αi+βi

For each of the six assumed orders in Table 1, isotonic regression estimates of the dose-limiting toxicity probabilities were to be computed using the pool-adjacent-violators algorithm.18 Under ordering m, the dose-limiting toxicity probability for combination i is estimated using isotonic regression as

π˜mi=minisImax1rii=rsπ^i

This algorithm replaces adjacent estimates that violate the monotonicity assumption with their weighted average, where the weights are the current sample size at each dose level. To satisfy the known ordering relationships among combinations, the set of m = 6 isotonic regression estimates were to be averaged to produce a single set of estimates for the dose-limiting toxicity probabilities across the combinations so that

π¯i=m=1Mπ˜mim

This simplifies the estimation procedure described in Conaway et al9 in that it does not rely on the more complex estimation procedure of Hwang and Peddada.19

Table 1.

Selected set of possible orderings for the dose-limiting toxicity probabilities among the combinations.

Set Possible orderings
1 1-2-3-4-6-5-7-8-9-13-12-11-10-14-15-16-17-20-19-18-21-22-23
2 1-2-3-4-5-6-9-8-7-10-11-12-13-17-16-15-14-18-19-20-22-21-23
3 1-2-3-4-5-6-7-8-9-10-11-12-13-14-15-16-17-18-19-20-21-22-23
4 1-2-3-4-6-5-9-8-7-13-12-11-10-17-16-15-14-20-19-18-22-21-23
5 1-2-3-4-6-9-13-5-8-12-17-7-11-16-20-10-15-19-22-14-18-21-23
6 1-2-3-4-5-7-10-14-6-8-11-15-18-9-12-16-19-21-13-17-20-22-23

Updating the recommended combination

Let Ai denote a set of admissible combinations to consider for assignment after a dose-limiting toxicity has been observed in the most recent patient treated at di. Let Bi denote set of admissible combinations to consider for assignment after a non-dose-limiting toxicity has been observed in the most recent patient treated at di. When the most recent participant experiences a dose-limiting toxicity (or non-dose-limiting toxicity) on di, we want the design to either stay at di, move to a combination adjacent to di that is a known de-escalation (or escalation), or move to a combination whose toxicity relationship is unknown relative to di because of the partial order. These restrictions ensure that the design is coherent20 in that it does not move to a combination that we know to be an escalation (de-escalation) decision in the presence (absence) of a dose-limiting toxicity in the most recent participant. For instance, for d8, we know that d5 and d6 are de-escalations, and the toxicity relationship between d8, d7 and d9 is unknown. Therefore, the set A8 = {d5, d6, d7, d8, d9}. With these restrictions, the algorithm does not allow for escalation of both agents simultaneously, or a change of more than one dose level of a single agent.

  1. If the most recent participant experiences a dose-limiting toxicity, for all diAi, compute the loss Li(π¯i,π*)=|π¯iπ*| associated with each combination based on the target dose-limiting toxicity rate π*. If the most recent participant experiences a non-dose-limiting toxicity, compute Li(π¯i,π*) for all diBi.

  2. Let lmin=minLi(π¯i,π*), and let Ti be the set of combinations with losses equal to the minimum observed loss so that Ti={di:Li(π¯i,π*)=lmin}.

  3. If Ti contains a single combination with minimum observed loss, then the suggested combination is the element contained in Ti. If Ti contains more than one combination, then we choose from among them according to the following rules:
    1. If π¯t>π*tTi, the suggested combination is randomly chosen from among the combinations in Ti with the lowest estimated dose-limiting toxicity probability.
    2. If π¯tπ* for at least one tTi, the suggested combination is randomly chosen from among the combinations in Ti with the highest estimated dose-limiting toxicity probability.

If at any time in the accrual process, Combination 5 (the starting combination) and Combination 6 were deemed too toxic and the model recommends accrual to Combination 1 then future accrual to Combination 5 or above was no longer to be allowed.

Based on the posterior distributions π55 and the pre-specified target dose-limiting toxicity rate π*, we can calculate the posterior probability that combination d5 is too toxic

Pr(π5>π*Ω5)=1B(π*;α5+y5,β5+n5y5)

where B(π*;α5+y5,β5+n5y5) is the cumulative density function of the beta distribution with parameters α5 + y5 and β5 + n5y5. Similarly, we can calculate Pr (π6 > π*|Ω6) We compare these probabilities to an upper probability cutoff pT. If Pr (π5 > π*|Ω5) > PT and pr (π6 > π*|Ω6) > pT, we say that combinations d5 and d6 are not safe combinations. Combinations 5 and 6 were considered the gate keepers for moving to Combination 1 and are deemed too toxic when the posterior probability is at least pT = 70% that the risk of dose-limiting toxicity at Combinations 5 and 6 exceed the target rate. The impact of various values of pT are explored in Supplemental Figure 3, with 70% yielding the most desirable operating characteristics on average across all scenarios considered. Under these circumstances, future accrual was to be limited to those combinations in the first column (Combinations 1 to 4) in Figure 1. Allocation of future participants was to be based on the Conaway-Dunbar-Peddada method using isotonic regression estimates, but in this case, there is only a single ordering: {i.e., 1-2-3-4}. Otherwise, accrual to the study continues until either (1) N participants have been evaluated for toxicity or (2) one of the following accrual stopping rules is triggered.

Accrual stopping rules

If, for the lowest combination the posterior probability was at least 70% that the dose-limiting toxicity rate at Combination 1 exceeded the target rate, then Combination 1 was to be deemed too toxic, the trial was to stop for safety, and no combination was to be recommended as the maximum tolerated dose combination. Otherwise, accrual to the study was to continue until the model recommended accrual to a combination that had already accrued 12 eligible participants or the maximum accrual target of 60 eligible participants had been reached. The target of 12 participants was based upon having preliminary information to estimate complete remission rate.

Sample size and estimated accrual

Maximum target sample size was based upon acquiring enough information to assess the goal of establishing the maximum tolerated dose combination and preliminary assessment of response to treatment at the maximum tolerated dose combination. Simulation results provided below indicated that a maximum target accrual of 60 eligible participants performed well and based upon the simulation results the study goals may be achieved with less than 45 participants. Accrual was expected to be about 1 patient per month, and the dose-limiting toxicity evaluation window was 1 cycle of treatment (i.e. 1 month). Therefore, we did not anticipate logistical difficulties associated with partially observed dose-limiting toxicity outcomes of previously treated patients at the time of a new dose assignment, and thus we did not account for this possibility in our simulation study. Yuan, Nguyen, and Thall21 quantify the severity of this potential problem by defining the logistical difficulty index

ζ=Q×α

Where Q is the length of the observation window and α is the accrual rate. In our study, Q = 1 month and α = 1 patient per month for an overall logistical difficulty index of ζ = 1. Yuan et al21 state that when ζ ≤ 1, there is no logistical difficulty applying a standard adaptive decision rule.

Results

Application to the phase I leukemia trial

The primary objective of the trial was to identify the maximum tolerated dose combination, defined by the dose combination with a dose-limiting toxicity rate closest to the target rate of 0.20. Prior information for the dose-limiting toxicity probabilities πi at each combination is expressed through a distribution of the form πi~Beta(αi,βi). Based on the expected value of πi and a 95% upper limit ui on the dose-limiting toxicity probability, the equations

E(πi)=αiαi+βi and Pr(πiui)=0.95,

are solved to obtain prior specifications for αi and βi. In the absence of prior information, a practical prior specification can be acquired by setting the prior mean equal to the target dose-limiting toxicity rate π* and setting the 95% upper limit ui equal to 2×π* at each dose level. This prior specification is recommended by Wages and Conaway22 to avoid the problem of rigidity23 in which allocation can become confined to a sub-optimal combination regardless of the ensuing observed data. Based on a target dose-limiting toxicity rate of 0.20, we used a Beta (2.6, 10.4) prior for π at each combination. The maximum target accrual was N = 60 participants who will be evaluated for toxicity. The trial will begin on combination 5, and the upper probability cutoff used to define the safety stopping rule were pT = 0.70.

We illustrate the behavior of the described design under a set of hypothesized dose-limiting toxicity probabilities. The assumed probabilities for combinations 1–23 are (0.08, 0.09, 0.11, 0.13, 0.10, 0.10, 0.12, 0.13, 0.13, 0.15, 0.16, 0.16, 0.15, 0.18, 0.19, 0.20, 0.20, 0.23, 0.25, 0.25, 0.30, 0.31, 0.38), indicating combinations 16 and 17 to be the true maximum tolerated dose combinations since they have the dose-limiting toxicity probabilities closest to the target rate of 0.20. The data from the entire simulation trial are provided in Table 2. The first two eligible participants are assigned to combination 5 and escalation proceeds in cohorts of size two according to the dashed arrow in Figure 1 without a dose-limiting toxicity event until participant 8 experiences a dose-limiting toxicity on combination 15. At this point in the trial, Stage 1 ends and Stage 2, based on the estimation procedure described above, begins. After the dose-limiting toxicity in the most recent participant on d15, the set A15 of admissible combinations consists of combinations d10, d11, d14, d15, and d16. Based on the currently observed dose-limiting toxicity data at the admissible combinations, we update π^10=0.20, π^11=0.173, π^14=0.20, π^15=0.24, π^16=0.20. Based on the chosen possible orderings, the averaged isotonic estimates π¯ for the dose-limiting toxicity probabilities for each of the admissible combinations are π˜10=0.187, π˜11=0.173, π˜14=0.216, π˜15=0.24, π˜16=0.22. Following Step 3 in the above algorithm for updating the recommended combination, we compute the loss for each combination in A15. In this case, the set T15 will only consist of combination 10 since it is the single combination with estimated probability (π˜10=0.187) closest to the target. Therefore, Step 3 of the assignment algorithm indicates that combination 10 is the suggested combination. Working now in cohorts of size 1, the next participant is administered combination 10 on which he/she does not experience dose-limiting toxicity. Ultimately, the design settles on combination 16 with a true dose-limiting probability of 0.20 as the maximum tolerated dose combination after the accrual of N = 48 participants to the study. At study conclusion, the total observed dose-limiting toxicity data at combination 16 are 2/12, with an estimated dose-limiting toxicity probability of π¯16=0.182.

Table 2.

A simulated sequential trial using the described two-stage Phase I design.

Pt Combo DLT Stage Pt Combo DLT Stage
1 5 0 1 25 17 1 2
2 5 0 1 26 16 0 2
3 7 0 1 27 15 0 2
4 7 0 1 28 18 0 2
5 11 0 1 29 18 0 2
6 11 0 1 30 19 1 2
7 15 0 1 31 18 1 2
8 15 1 2 32 15 0 2
9 10 0 2 33 16 0 2
10 14 0 2 34 16 0 2
11 14 0 2 35 16 0 2
12 15 1 2 36 17 0 2
13 15 0 2 37 17 0 2
14 15 1 2 38 17 0 2
15 18 0 2 39 17 0 2
16 21 0 2 40 17 0 2
17 23 1 2 41 17 0 2
18 22 0 2 42 16 0 2
19 22 0 2 43 17 0 2
20 21 1 2 44 16 1 2
21 22 1 2 45 16 0 2
22 20 1 2 46 16 0 2
23 17 0 2 47 16 0 2
24 16 0 2 48 16 0 2

Estimated maximum tolerated dose combination=16

DLT = dose-limiting toxicity.

Operating characteristics

Simulations were run to display the performance of the design’s operating characteristics under a wide range of possible dose-toxicity scenarios. The scenarios are provided in Figure 2, with shaded combinations indicating true probabilities within 5% of the target rate. For each scenario, 5000 simulated trials were run. Figure 3 reports the percentage of trials in which a shaded combination was recommended as the maximum tolerated dose combination, the average number of participants treated at shaded combinations, the average sample size, and the accuracy index24 of maximum tolerated dose combination selection. The maximum value of the accuracy index is 1, with larger values (close to 1) indicating that the method possesses high accuracy. Supplemental Tables 14 provide the entire distribution of maximum tolerated dose selection and participant allocation for the proposed design and a modified partial order continual reassessment method.

Figure 2:

Figure 2:

True dose-limiting probability scenarios for the motivating Phase I leukemia trial. Shaded combinations indicate true dose-limiting toxicity probabilities within 5% of the target dose-limiting toxicity rate of 20%.

Figure 3:

Figure 3:

Operating characteristics for the proposed design and a modified partial order continual reassessment method (POCRM). The target dose-limiting toxicity rate is 20%. Results are based on 5000 simulated trials, with each trial starting at combination 5 and accruing a maximum sample size of N=60 participants. The stage 1 cohort size is 2 participants.

The modified partial order continual reassessment method used the same Stage 1 escalation scheme as the proposed design until observance of the first dose-limiting toxicity. Stage 2 used an empiric working model xiexp(a), where xi is the skeleton of the model obtained using the function getprior(0.05, 0.20, 9, 23) in the R package dfcrm, and the set of possible orderings in Table 1. Safety guidelines used to guide the trial to combinations 1 through 4 and to stop the trial early were based on Agresti-Coull binomial confidence interval estimation. If the lower bound of an 80% confidence interval for the observed dose-limiting toxicity rate at combinations 5 and 6 exceeds the target rate of 20%, then the trial restricts assignments for future participants to combinations 1 through 4. If the lower bound of an 80% confidence interval for the observed dose-limiting toxicity rate at combination 1 exceeds 20%, then the trial terminates early for safety.

The results displayed in Figure 3 were based upon a maximum target accrual of 60 eligible participants. In Scenario 1, the true dose-limiting toxicity probabilities indicate that all available combinations are safe (i.e., ≤ 20%). The design selects, as the maximum tolerated dose combination, a combination with a true dose-limiting toxicity probability between 0.15 and 0.20 in 75.9% of simulated trials (accuracy index 66%), while treating 16.2 of 39.8 participants (40.7%) on average at these combinations. The modified partial order continual reassessment method selected a combination with a true dose-limiting toxicity probability between 0.15 and 0.20 in 43.8% of simulated trials (accuracy index 39.8%), while treating 9.3 of 33.8 participants (27.5%) on average at these combinations. The diminished performance of the partial order continual reassessment method in this case relative to the proposed design can likely be attributed to the lack of spacing between adjacent skeleton values due to the number of combinations being studied. In Scenario 2, the true dose-limiting toxicity probabilities indicate that all available combinations are safe (i.e., ≤ 20%), except for combination 23 with a true dose-limiting toxicity rate of 0.32. The proposed design selected, as the maximum tolerated dose combination, a combination with a true dose-limiting toxicity probability between 0.15 and 0.23 in 58.7% of simulated trials (accuracy index 57%), while treating 14.6 of 41.7 participants (35.0%) on average at these combinations. The modified partial order continual reassessment method selected a combination with a true dose-limiting toxicity probability between 0.15 and 0.23 in 37.1% of simulated trials (accuracy index 37.4%), while treating 8.7 of 36 participants (24.2%) on average at these combinations. In Scenario 3, the true dose-limiting toxicity probabilities indicate that most available combinations are safe (i.e., ≤ 20%), with the exception of combinations 19 through 23. The proposed design selected, as the maximum tolerated dose combination, a combination with a true dose-limiting toxicity probability between 0.15 and 0.25 in 47.2% of simulated trials (accuracy index 46.7%), while treating 15.5 of 43.0 participants (36.0%) on average at these combinations. The modified partial order continual reassessment method selected a combination with a true dose-limiting toxicity probability between 0.15 and 0.25 in 40.3% of simulated trials (accuracy index 35.5%), while treating 10.9 of 34.3 participants (31.8%) on average at these combinations.

Scenarios 4–6 represent more toxic scenarios in which there exist multiple combinations with dose-limiting toxicity probabilities exceeding 20%. In Scenario 4, there are 11 of 23 combinations that have true dose-limiting toxicity probabilities between 0.15 and 0.25. The proposed design selects one of these combinations as the maximum tolerated dose combination in 71.3% of simulated trials (accuracy index 28.2%) while allocating 28.4 of 43.7 participants (65.0%) on average to these combinations. The partial order continual reassessment method selects one of these combinations as the maximum tolerated dose combination in 71.2% of simulated trials (accuracy index 30.7%) while allocating 19 of 31 participants (61.3%) on average to these combinations. In Scenario 5, there are 6 of 23 combinations that have true dose-limiting toxicity probabilities between 0.15 and 0.25. The proposed design selects one of these combinations as the maximum tolerated dose combination in 50.2% of simulated trials (accuracy index 34.2%) while allocating 18.5 of 48.02 participants (38.5%) on average to these combinations. The partial order continual reassessment method selects one of these combinations as the maximum tolerated dose combination in 45.1% of simulated trials (accuracy index 32.7%) while allocating 10.4 of 33 participants (32.7%) on average to these combinations. In Scenario 6, there are 6 of 23 combinations that have true dose-limiting toxicity probabilities between 0.15 and 0.25. The proposed design selects one of these combinations as the maximum tolerated dose combination in 75.7% of simulated trials (accuracy index 64.7%) while allocating 25.6 of 37.5 participants (68.3%) on average to these combinations. The partial order continual reassessment method selects one of these combinations as the maximum tolerated dose combination in 70.3% of simulated trials (accuracy index 62.1%) while allocating 19.4 of 27.6 participants (70.3%) on average to these combinations. The final two scenarios represent situations in which (1) the maximum tolerated dose combination is only located in combinations 1–4, and combinations 5 and 6 are too toxic (Scenario 7); and (2) all of the combinations are overly toxic (Scenario 8). In Scenario 7, the proposed design selects the single maximum tolerated dose combination in 40.6% of simulated trials (accuracy index 76.8%) while allocating 6.1 of 28.6 participants (21.3%) on average to this combination. The partial order continual reassessment method selects the single maximum tolerated dose combination in 37.6% of simulated trials (accuracy index 76.7%) while allocating 5.8 of 26.6 participants (21.8%) on average to this combination. In Scenario 8, both methods stop early for safety in a large percentage of simulated trials (proposed 83.9%, partial order continual reassessment method 86.9%). The simulation results indicate that the proposed design and stopping rules have good statistical properties under a wide range of possible dose toxicity relationships and that on average the trial will achieve the study goal with accrual of fewer than 60 participants. It also performs well when compared to an alternative modified method.

Conclusions

The advance of novel methods for the design of clinical trials in early oncology development has grown in recent years, yet the use of innovative designs remains uncommon in real studies. In this article, we have outlined an adaptive design for a proposed Phase I study evaluating the safety of the combination of ceramide nanoliposome and vinblastine among an initial set of nineteen possible dose combinations in patients with relapsed/refractory acute myeloid leukemia and patients with untreated acute myeloid leukemia who are not candidates for intensive induction chemotherapy. The isotonic regression method presented offers an alternative to rigid rule-based methods that lack the capacity to manage the complexity presented by studies involving a large and dynamic set of drug combinations. The execution of more contemporary approaches that are tailored to the research questions that are currently being asked in early development trials are being supported by the FDA and review entities.2528 Simulation studies were performed to justify and evaluate the statistical properties of the design. The results in Figure 3 establish the method’s ability to efficiently recommend desirable combinations, defined by acceptable toxicity, in a high percentage of simulated trials with practicable sample sizes.

Software in the form of R29 code for both simulation of design operating characteristics and direct protocol implementation of the method is available upon request from the first author. The numerical results presented in the simulation studies such as the distribution of sample size and frequency of early trial termination is the type of simulation information that improve understanding, acceptance, and approval of adaptive designs such as the one described in this manuscript.30,31 Design specifics often are not provided on sites such as clinicaltrials.gov, and current clinical trials lack the transparency needed to support the timely implementation of novel designs. The objective of this current work is to highlight design strategies that tackle modern study objectives as a means of enhancing the use of novel approaches in future trials and to illustrate the flexibility of adaptive designs in handling dynamic design considerations. Presentation of novel design use in current clinical trials are needed to mitigate the obstacles that prevent more frequent execution of contemporary design strategies in early development. Thus, this paper can support the acceptance of novel design implementation in early-phase trials. In addition, given the extensive amount of time between study conception and protocol submission, it is important to offer design solutions that have wide applicability. Moreover, journals do not require complete protocols as supplemental material for completed dose-finding trials, and final clinical trial papers do not have the space to adequately present design details. The proposed study design complements a growing number of studies that have endorsed adaptive design strategies to answer complex research questions posed in current early-phase cancer trials. This endorsement for adaptive designs will strengthen early-phase trial design in drug combination studies.32 Early-phase designs with good statistical properties can have a significant influence on the drug development process.33

Supplementary Material

1

Funding:

R03CA238966 to N.A.W.

References

  • 1.Braun TM and Wang S. A hierarchical Bayesian design for phase I trials of novel combinations of cancer therapeutic agents. Biometrics 2010; 66: 805–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Yin G and Yuan Y. Bayesian dose finding in oncology for drug combinations by copula regression. J R Stat Soc Ser C Appl Stat 2009; 58: 211–24. [Google Scholar]
  • 3.Wages NA, Conaway MR and O’Quigley J. Continual reassessment method for partial ordering. Biometrics 2011; 67: 1555–63. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Melssen MM, Petroni GR, Chianese-Bullock KA, et al. A multipeptide vaccine plus toll-like receptor agonists or polyICLC in combination with incomplete freund’s adjuvant in melanoma patients. J Immunother Cancer 2019; 7: 163. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Wages NA, Slingluff CL Jr and Petroni GR. A phase I/II adaptive design to determine the optimal treatment regimen from a set of combination immunotherapies. Contemp Clin Trials 2015; 41: 172–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Wages NA, Millard TA, Dillon PM, et al. Efficient dose-finding for drug combination studies involving a shift in study populations. Contemp Clin Trials Commun 2020; [epub ahead of print] January 7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Ivanova A and Wang K. A non-parametric approach to the design and analysis of two-dimensional dose-finding trials. Stat Med 2004; 23: 1861–70. [DOI] [PubMed] [Google Scholar]
  • 8.Gandhi L, Bahleda R, Tolaney SM, et al. Phase I study of neratinib in combination with temsirolimus in patients with human epidermal growth factor receptor 2-dependent and other solid tumors. J Clin Oncol 2014; 32: 68–75. [DOI] [PubMed] [Google Scholar]
  • 9.Conaway MR, Dunbar S and Peddada SD. Designs for single- or multiple-agent phase I trials. Biometrics 2004; 60: 661–669. [DOI] [PubMed] [Google Scholar]
  • 10.Jones DR, Moskaluk CA, Gillenwater HH, et al. Phase I trial of induction histone deacetylase and proteasome inhibition followed by surgery in non-small-cell lung cancer. J Thorac Oncol 2012; 7: 1683–1690. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lee SM and Cheung YK. Model calibration in the continual reassessment method. Clin Trials 2009; 6:227–38 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Barlow RE, Bartholomew DJ, Bremner JM, et al. Statistical inference under order restrictions: The theory and application of isotonic regression. New York: Wiley; 1972 [Google Scholar]
  • 13.Hirakawa A, Wages NA, Sato H, et al. A comparative study of adaptive dose-finding design for phase I oncology trials of combination therapies. Stat Med 2015; 34: 3194–3213. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Wages NA, Ivanova A and Marchenko O. Practical designs for phase I combination studies I oncology. J Biopharm Stat 2016; 26: 150–66. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Conaway MR and Wages NA. Designs for phase I trials in ordered groups. Stat Med 2017; 36: 254–65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Conaway MR. A design for phase I trials in completely or partially ordered groups. Stat Med 2017; 36: 2323–2332. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Conaway MR. Isotonic designs for phase I trials in partially ordered groups. Clin Trials 2017; 14: 491–498. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Robertson T, Wright FT and Dykstra R. Order restricted statistical inference. New York: John Wiley & Sons, 1988. [Google Scholar]
  • 19.Hwang J and Peddada S. Confidence interval estimation subject to order restrictions. Ann Stat 1994; 22: 67–93. [Google Scholar]
  • 20.Cheung YK. Coherence principles in dose finding studies. Biometrika. 2005; 92: 863–73. [Google Scholar]
  • 21.Yuan Y, Nguyen HQ and Thall PF. Bayesian designs for phase I-II clinical trials. Chapman and Hall/CRC Press, New York, 2016. [Google Scholar]
  • 22.Wages NA and Conaway MR. Revisiting isotonic phase I design in the era of model-assisted dose-finding. Clin Trials 2018; 15: 524–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Cheung YK. On the use of nonparametric curves in phase I trials with low toxicity tolerance. Biometrics 2002; 58: 237–240. [DOI] [PubMed] [Google Scholar]
  • 24.Cheung YK. Dose finding by the continual reassessment method. Chapman and Hall/CRC Press,New York, 2011. [Google Scholar]
  • 25.Riviere MK, Le Tourneau C, Paoletti X, et al. Designs of drug-combination phase I trials in oncology: a systematic review of the literature. Ann Oncol 2015; 26: 1036–1037. [DOI] [PubMed] [Google Scholar]
  • 26.Paoletti X, Ezzalfani M and Le Tourneau C. Statistical controversies in clinical research: requiem for the 3 + 3 design for phase I trials. Ann Oncol 2015; 26: 1808–1812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Iasonos A and O’Quigley J. Adaptive dose-finding studies: a review of model-guided phase I clinical trials. J Clin Oncol 2014; 32: 2505–2511. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Nie L, Rubin EH, Mehrotra N, et al. Rendering the 3+3 design to rest: more efficient approaches to oncology dose-finding trials in the era of targeted therapy. Clin Cancer Res 2016; 22: 2623–2629. [DOI] [PubMed] [Google Scholar]
  • 29.R Development Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing, 2008. [Google Scholar]
  • 30.Iasonos A, Gönen M and Bosl GJ. Scientific review of phase I protocols with novel dose-escalation designs: how much information is needed? J Clin Oncol 2015; 33: 2221–2225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Petroni GR, Wages NA, Paux G, et al. Implementation of adaptive methods in early-phase clinical trials. Stat Med 2017; 36: 215–224. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Wages NA, Conaway MR, Slingluff CL Jr, et al. Recent developments in the implementation of novel designs for early-phase combination studies. Ann Oncol 2015; 26: 1036–37. [DOI] [PubMed] [Google Scholar]
  • 33.Conaway MR and Petroni GR. The impact of early phase trial design in the drug development process. Clin Cancer Res 2019; 25: 819–827. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

1

RESOURCES