End points and statistical considerations in immuno-oncology trials: impact on multiple myeloma

Abstract

Unlike conventional cancer treatment, immuno-oncology therapies are commonly associated with delayed clinical benefit and durable responses, as seen with immuno-oncology therapies for multiple myeloma (MM). Therefore, a longer-term approach to immuno-oncology data assessment is required. Appropriate study designs, end points and statistical methods are essential for evaluating immuno-oncology therapies to assess treatment outcomes, and may better accommodate immuno-oncology clinical trial data. In addition to conventional end points including median progression-free survival (PFS) and overall survival (OS), end points such as hazard ratios for PFS and OS over time, PFS and OS landmark analyses beyond the median, and immune-response end points might provide better indications of the efficacy of immuno-oncology therapies. Long-term data with these agents will allow better prediction of outcomes in MM.

Unlike conventional therapies that directly kill tumor cells, immunotherapies harness the patient's own immune system to stimulate a response against the cancer [1]. Immunotherapy includes various treatments with different mechanisms of action, which may involve priming or boosting the immune system, T-cell modulation, natural killer cell activation, reducing immunosuppression and enhancing adaptive immunity. Examples of immunotherapies are hematopoietic stem cell transplantation, cell-based approaches (e.g., T-cell infusion, chimeric antigen receptor T-cell therapy), cancer vaccines (e.g., dendritic cell vaccination, DNA vaccination, peptide vaccination, viral vaccine vectors), immunomodulatory drugs and immuno-oncology agents (including immunostimulatory antibodies), which target immune checkpoints and costimulatory pathways. Immuno-oncology agents exhibit kinetics that are characteristically different from conventional cancer therapies, which involve building a cellular immune response followed by tumor regression.

Traditional immunotherapies, such as, IFN and IL-2, have not demonstrated consistent clinical benefit in advanced-stage cancer, possibly due to an incomplete understanding of tumor immunology. Further, the use of conventional trial designs and end points does not capture the novel patterns of response seen with immuno-oncology therapies [2]. Therefore, opportunities to identify effective therapies are potentially being overlooked or not fully appreciated.

The patterns of response to treatment with immuno-oncology agents differ from those seen with conventional therapies [3]. Long-term survival and delayed clinical benefit are common outcomes. Stable disease or responses can occur after conventional progressive disease owing to clinically insignificant new lesions in the presence of other responsive lesions and to a reduction in total tumor burden. As such, discontinuation of immuno-oncology therapies at the first sign of progressive disease might not always be appropriate [4]. In addition, durable stable disease might represent meaningful antitumor activity in patients who do not meet the criteria for an objective response [3]. Because the clinical benefit of immuno-oncology agents might extend beyond that of traditional cytotoxic agents, alternative statistical methods should be considered to allow treatment efficacy of immuno-oncology therapies to be assessed appropriately [3,5].

The introduction of immuno-oncology therapies is likely to have a significant impact on the treatment of multiple myeloma (MM), with improved clinical outcomes and changing treatment paradigms. MM is a malignant disease of monoclonal plasma cells that is associated with a 5-year survival rate below 50% [6]. Owing to the aging population, the incidence of MM is projected to increase by 57% from 2010 to 2030 in the USA [7]. The introduction of autologous stem cell transplantation and new targeted therapies, including proteasome inhibitors (e.g., bortezomib, carfilzomib and ixazomib) and immunomodulatory drugs (e.g., thalidomide, lenalidomide and pomalidomide), has increased response rates and survival in patients with MM [8–10]. Despite these advances, MM is still considered by many to be an incurable disease, primarily because of high intratumoral heterogeneity that increases as the disease progresses [11,12]. However, investigators have recently challenged this belief; indeed, tandem hematopoietic stem cell transplantation and long-term follow-up results from the Total Therapy trial program at the Myeloma Institute of the University of Arkansas for Medical Sciences have shown evidence of a cure [13,14]. Until a definitive cure is developed, there is a need for new agents to improve treatment outcomes for patients with MM. Immunotherapies currently in clinical development for the treatment of MM are presented in Table 1.

Table 1. . Immunotherapies in clinical development for the treatment of multiple myeloma.

Therapy type	Agent/regimen	Study	Latest development stage	Number of enrolled patients	Patient population	Status
Vaccine	GM-CSF allogeneic vaccine	Allogeneic GM-CSF vaccine and lenalidomide in treatment myeloma patients with near complete remission (NCT01349569)	Phase II	18	Patients with MM near complete remission	Completed
	KRN7000 (Alpha GalCer)-pulsed dendritic cells	Combination of lenalidomide and autologous mature dendritic cells pulsed with KRN7000 in myeloma (NCT00698776)	Phase I/II	6	Patients with asymptomatic MM	Completed
	PVX-410 multipeptide vaccine	Phase 1/2a study of cancer vaccine to treat smoldering multiple myeloma (NCT01718899)	Phase I/IIa	22	Patients with smoldering MM	Completed
	MAGE-A3 recombinant protein	MAGE-A3 protein + AS15 as consolidation for multiple myeloma patients undergoing autologous stem cell transplantation (NCT01380145)	Phase I	13	Patients with MM undergoing autologous SCT	Completed
Checkpoint inhibitor	Pidilizumab (CT-011; anti-PD-1 antibody) + dendritic cell fusion vaccine	Blockade of PD-1 in conjunction with the dendritic cell/myeloma vaccines following stem cell transplantation (NCT01067287)	Phase II	35 (estimated)	Patients with MM after autologous SCT	Ongoing
	Pidilizumab (CT-011; anti-PD1 antibody)	Lenalidomide and pidilizumab in treating patients with relapsed or refractory multiple myeloma (NCT02077959)	Phase I/II	20	Patients with RRMM	Ongoing
	Pembrolizumab (anti-PD1 antibody)	A study of pembrolizumab (MK-3475) in combination with standard of care treatments in participants with multiple myeloma (MK-3475-023/KEYNOTE-023) (NCT02036502); a trial of pembrolizumab (MK-3475) in participants with blood cancers (MK-3475-013) (KEYNOTE-013) (NCT01953692)	Phase I	115 (estimated); 222 (estimated)	Patients with MM; patients with blood cancers including MM	Ongoing; ongoing
	Nivolumab (anti-PD1 antibody) alone or in combination with ipilimumab (anti-CTLA-4 antibody) or lirilumab (anti-KIR antibody)	Safety study of nivolumab by Itself or in combination in patients with lymphoma or multiple myeloma (NCT01592370)	Phase I	375 (estimated)	Patients with lymphoma or myeloma	Ongoing
Cytokine-targeted agent	Siltuximab (anti-IL-6 antibody)	A study of siltuximab (anti-IL-6 monoclonal antibody) in patients with high-risk smoldering multiple myeloma (NCT01484275)	Phase II	87	Patients with high-risk smoldering MM	Ongoing
	ALT-803 (IL-15 superagonist complex)	IL-15 super agonist ALT-803 to treat relapse of hematologic malignancy after allogeneic SCT (NCT01885897); QUILT-3.005: a study of ALT-803 in patients with relapsed on refractory multiple myeloma (NCT02099539)	Phase I/II	61 (estimated); 57 (estimated)	Patients with relapse of hematologic malignancies, including MM, after allogeneic SCT; patients with RRMM	Ongoing; ongoing
Adoptive T-cell transfer	CART-19 T cells targeting CD19	CART-19 for multiple myeloma (NCT02135406)	Phase I	13	Patients with RRMM after autologous SCT	Ongoing
	T cells engineered to target the NY-ESO-1 antigen	Redirected auto T cells for advanced myeloma (NCT01352286); CT antigen TCR-engineered T cells for myeloma (NCT01892293)	Phase I/II	26 (estimated); 10 (estimated)	Patients with RRMM	Ongoing; ongoing
	WT1-specific donor-derived T cells	Dose escalation trial of WT1-specific donor-derived T cells following T-cell depleted allogeneic hematopoietic stem cell transplantation for patients with relapsed/refractory multiple myeloma (NCT01758328)	Phase I	21 (estimated)	Patients with RRMM following T-cell depleted allogeneic SCT	Ongoing
Natural killer cell-targeted therapy	Elotuzumab (anti-SLAMF7 antibody)	Phase III study of lenalidomide and dexamethasone with or without elotuzumab to treat newly diagnosed, previously untreated multiple myeloma (ELOQUENT - 1) (NCT01335399); Phase III study of lenalidomide and dexamethasone with or without elotuzumab to treat relapsed or refractory multiple myeloma (ELOQUENT-2) (NCT01239797)	Phase III	750 (estimated); 761	Patients with newly diagnosed MM; patients with RRMM	Ongoing; ongoing
	Elotuzumab (anti-SLAMF7 antibody) in combination with lirilumab (anti-KIR antibody) or urelumab (anti-CD137 antibody)	A Phase I open label study of the safety and tolerability of elotuzumab (BMS-901608) administered in combination with either lirilumab (BMS-986015) or urelumab (BMS-663513) in subjects with multiple myeloma (NCT02252263)	Phase I	136 (estimated)	Patients with RRMM or postautologous SCT with VGPR or CR and MRD	Ongoing
Tumor-directed monoclonal antibodies	Daratumumab (anti-CD38 antibody)	Addition of daratumumab to combination of bortezomib and dexamethasone in participants with relapsed or refractory multiple myeloma (NCT02136134); a study comparing daratumumab, lenalidomide, and dexamethasone with lenalidomide and dexamethasone in relapsed or refractory multiple myeloma (NCT02076009)	Phase III	498; 569	Patients with RRMM	Ongoing; ongoing
	Lorvotuzumab mertansine (anti-CD56 antibody–drug conjugate)	IMGN901 in combination with lenalidomide and dexamethasone (NCT00991562)	Phase I	50 (estimated)	Patients with CD56+ RRMM	Completed
	Indatuximab ravtansine (anti-CD138 antibody–drug conjugate)	BT062 in combination with lenalidomide or pomalidomide and dexamethasone in patients with multiple myeloma (NCT01638936)	Phase I/IIa	64	Patients with RRMM	Ongoing

CAR: Chimeric antigen receptor; CR: Complete response; CTLA-4: Cytotoxic T lymphocyte–associated protein 4; GM-CSF: Granulocyte–macrophage colony-stimulating factor; IL: Interleukin; KIR: Killer-cell immunoglobulin-like receptor; MM: Multiple myeloma; MRD: Minimal residual disease; PD1: Programmed cell death 1; RRMM: Relapsed/refractory multiple myeloma; SCT: Stem cell transplant; SLAMF7: Signaling lymphocytic activation molecule family member 7; VGPR: Very good partial response.

All study details were taken from [15]

Immuno-oncology therapies: response assessments & safety considerations

• Delayed clinical benefit

Several immuno-oncology therapies have shown a delayed clinical effect [16–18] likely due to their mechanism of action [3]. Because time is required to build an effective immune response, responses to immuno-oncology therapy are expected to take longer than responses to cytotoxic therapy, and may develop after a period of apparent progressive disease (either progression of known lesions or the appearance of new lesions), or may continue after therapy is discontinued. Separation of estimated survival curves might therefore occur several months after the start of treatment with immuno-oncology agents. In addition, patients might experience transient worsening of disease before achieving tumor regression or stable disease [3], including prolonged periods of stable disease that are clinically significant [3,19]. Therefore, caution should be taken when terminating therapy early, as responses can take substantially longer than is typical to become apparent, and immune cell infiltration might be mistaken for tumor progression. Importantly, a delay in the separation of survival curves violates the fundamental study design assumption of proportional hazards, which might reduce the statistical power of a study to differentiate between two treatment arms [2,5,20].

• Long-term survival

In some patients, long-term survival might be achievable with immuno-oncology therapies, which is reflected by a plateau in survival curves. Long-term survival has been observed with the use of immuno-oncology therapies in certain cancer types, including melanoma [16,21] and chronic myeloid leukemia [22,23]. Also, durable responses and progression-free survival (PFS) benefit were observed in an open-label Phase III trial of nivolumab versus docetaxel in patients with previously treated metastatic squamous cell non-small-cell lung cancer [24]. In addition, a survival benefit with ipilimumab, an antibody that targets CTLA-4, has been demonstrated in two randomized controlled Phase III trials in melanoma [16,21]. Separation of PFS and overall survival (OS) curves has been observed just prior to 4 months after treatment initiation with ipilimumab plus glycoprotein 100 (gp100) peptide vaccine or ipilimumab monotherapy compared with gp100 monotherapy [16]. In another study, long-term follow-up in patients treated with ipilimumab and dacarbazine demonstrated a 5-year survival rate of 18% [25].

In contrast to the patterns observed in solid tumor studies, in some MM trials, early separation of curves has been observed with immuno-oncology agents in combination with standard MM therapy. In a Phase III study of elotuzumab plus lenalidomide and dexamethasone in patients with relapsed or refractory MM (RRMM; ELOQUENT-2), the relatively early separation of curves, indicating initial disease control, may be due to the enhancement of the efficacy of elotuzumab by the lenalidomide/dexamethasone backbone. Elotuzumab, with its immune-stimulatory component, allows for long-term disease control. Similarly, in the CASTOR and POLLUX studies of daratumumab, an early separation of curves was observed and treatment was in combination with a similar treatment backbone. Thus, the combination of immuno-oncology agents with standard MM therapy (lenalidomide/dexamethasone) may be a valuable treatment option for patients with MM experiencing early relapse or indolent relapse who would benefit from both early and late disease control. In a study of elotuzumab given as monotherapy in patients with RRMM, elotuzumab did not show significant antimyeloma activity as a single agent after a follow-up period of 8 weeks. This lack of response may be due to elotuzumab's mechanism of action and the short follow-up period. Longer follow-up in this study may have shown benefit in these patients. On the other hand, other MM immunotherapy trials have shown the emergence of a long-term survival plateau or delayed separation of PFS and OS curves.

Allogeneic transplantation, which represents ongoing immunotherapy in MM wherein donor T cells target host tumor cells, is a good example of the emergence of a long-term survival plateau. Allogeneic transplantation, while potentially curative in a subgroup of patients with MM, is controversial due to a high rate of transplantation-related mortality [26]. As part of a prospective randomized study conducted by SWOG (formerly the Southwest Oncology Group) in patients with MM (Trial S9321), patients with suitable donors were assigned to an allogeneic transplantation arm (n = 36), resulting in high rates of early mortality but a long-term survival plateau in a few patients (n = 14) [27]. In the EBMT-NMAM2000 study conducted by the European Group for Blood and Marrow Transplantation, tandem autologous/reduced intensity conditioning allogeneic transplantation was associated with longer OS but higher mortality than was autologous transplantation at a median follow-up of 96 months [28]. However, follow-up of longer than 5 years is needed to confirm differences in outcomes between the two approaches. In the Total Therapy 2 study at the University of Arkansas for Medical Sciences, the addition of thalidomide to high-dose melphalan-based chemotherapy and autologous hematopoietic stem cell transplantation increased the frequency of complete responses and extended event-free survival, but not OS [29]. However, a delayed benefit in OS of thalidomide treatment was observed after 5 years [30]. In a Phase III study of elotuzumab plus lenalidomide and dexamethasone in patients with RRMM (ELOQUENT-2) [31], interim results revealed an early and increasing separation between the PFS curves over time that was maintained at 2 years; follow-up for long-term survival is ongoing. While these studies differ in design and populations studied, and evaluate therapies with differing mechanisms of action, overall they suggest that long-term follow-up, including end points that capture benefit across the entire study population and at milestone time points (e.g., hazard ratios [HRs] over time and 5-year PFS or OS), should be considered when designing immuno-oncology clinical trials involving patients with MM.

• Immune-related response criteria

The standard WHO criteria and Response Evaluation Criteria In Solid Tumors (RECIST) [32,33] were designed to assess the effects of cytotoxic and cytostatic anticancer agents, but do not account for the delayed clinical benefit and long-term survival seen with immuno-oncology therapies. The immune-related response criteria (irRC), a novel set of antitumor assessment criteria for evaluating immune response in patients treated with immuno-oncology therapies, were developed based on RECIST and WHO criteria to account for the unique characteristics of immuno-oncology agents [34]. The irRC differs from the standard RECIST and WHO response criteria by measuring total tumor burden (the sum of index lesion and new measurable lesions) and comparing it with baseline measurements (preconfirmed immune-related disease progression) at various time points. Use of the irRC might avoid premature discontinuation of therapy in patients who will eventually respond to treatment or have prolonged stable disease. A challenge of using the irRC is uniformly implementing these criteria among treating physicians across various sites and ensuring data interpretability by standardizing assessment methods across immuno-oncology clinical trials. Further clarification of the irRC should be made in an effort to standardize these criteria and minimize discordance between sites and central independent assessments, with the aim of providing more objective and reproducible response assessments in patients treated with immuno-oncology therapies. Nevertheless, since its publication in 2009, the irRC has been shown to be a powerful tool, allowing more comprehensive investigation of immunotherapies in clinical trials [34].

Further study of the utility of the irRC in immuno-oncology trials for different cancer types is warranted. To date, no such studies have been performed in hematologic malignancies, although modification of the irRC to accommodate this is the next step in the evolution of these criteria [34]. The implementation of the irRC is more complicated in the setting of MM compared with solid tumors. Furthermore, RECIST guidelines are not applicable, and the International Myeloma Working Group (IMWG) response criteria are being used instead [35,36]. These IMWG consensus criteria have recently been updated [37]. Notably, according to the IMWG criteria, repeat response assessment for confirmation of progression is critical in the setting of MM, which avoids the problem of assessment errors due to abnormal M-protein spikes that are sometimes observed in patients with MM. The recent update of the IMWG criteria has also proposed new response criteria, including minimal residual disease (MRD) assessment as an end point in MM trials. In addition, using next-generation flow cytometry methods allows for both assessment of MRD and detection of abnormal immune profiles. Ongoing assessment of immune reconstitution for long-term survivors in MM, which may be important for patients receiving immuno-oncology therapy, is addressed as part of these new response criteria, although this is a relatively new area that requires further data. Normalization of the light chain ratios for immunoglobulins appears to be an indicator of normalization of the immune system [38]. Although PFS and OS should remain the primary end points for Phase III immuno-oncology therapy studies, it might be useful to explore secondary immune end points, such as the elimination of antigens or T-cell response. These end points could provide early indications of efficacy, with the caveat that delayed response to treatment is a feature of immuno-oncology therapy.

• Minimal residual disease

MRD is a measurement of the depth of a response to treatment in hematologic cancers, using sensitive technology that can detect the presence of cancer when standard tests cannot. MRD is a particularly attractive new concept in hematologic cancer studies, as it may provide a powerful indication of treatment efficacy and remission early on, before standard outcomes like OS can be measured.

Incorporating a novel surrogate end point, such as MRD, into trial designs presents significant challenges, such as the standardization of these measurements and the selection and availability of the sensitive technology platforms needed to detect MRD. The 2016 update to the IMWG criteria defines new response categories of MRD as disease assessment criteria in patients with MM. Based on these new consensus criteria, it is likely that MRD will become more widely used as a surrogate end point in future MM studies. However, obtaining approval from regulatory bodies even for end points such as MRD that are well accepted in the community is an additional challenge. We propose that surrogate end points be incorporated into study designs as interim analyses which would allow for an earlier read on the data; however longer-term end points like OS and PFS should remain primary end points.

• Immune-related adverse events

In contrast to conventional cancer treatment, such as chemotherapy, most adverse events (AEs) seen with immuno-oncology therapies are inflammatory in nature, caused by the modulation of immune activity. This spectrum of adverse effects commonly affects the skin, liver, bowel and endocrine system [16]. As conventional safety analyses might not accurately capture the safety profile of immuno-oncology agents, alternative analyses are necessary to characterize AEs of immune system origin. In studies evaluating the efficacy of the CTLA-4 inhibitor ipilimumab, a method was developed to identify immune-related AEs [16]. In studies evaluating the efficacy of immuno-oncology agents, careful monitoring of safety, immune-related AEs and immune-mediated adverse reactions is required during both the trial and long-term follow-up.

Study design issues & solutions

• Statistical concepts

To achieve statistical power in immuno-oncology clinical trials, alternative statistical methods should be considered when calculating the required number of events for the final analysis under a delayed-separation assumption [5]. Although statistical survival analysis models are typically nonparametric (e.g., Kaplan–Meier curves and log-rank tests), parametric survival models, such as the exponential or Weibull models, can reveal additional insights.

A minimum notation will help to illustrate the statistical issues raised by the introduction of these new agents. Let the familiar survival curve be denoted by S(t). An important concept in survival analysis is the hazard function, which, simplistically, is the probability of death shortly after time t, given survival to time t. From the calculus, this is given by the derivative of -S(t) divided by S(t). The simplest possible model for the survival curve, containing one parameter, is the exponential model S(t) = exp(-λt), for which the hazard function is the constant, λ. Figure 1A shows two exponential survival curves, with hazards of 0.25 and 1.25 (lower hazard means better survival). Also shown in Figure 1A are the HR (which in this case is a constant, 0.2) and the median survival for the two curves (points at which the curves cross 50%). For this example, the medians are 2.75 and 0.55 years, respectively. This illustrates a further property of the exponential model: that the HR (here 0.2) is the inverse of the ratio of the medians (2.75/0.55 = 5).

Figure 1. . Survival curve S(t).

HR: Hazard ratio.

• The Weibull model

The exponential model is extremely useful for calculating sample size and power at the design stage of the clinical trial process, but it is overly simplistic and often does not fit the observed data. A slightly more complicated two-parameter model called the Weibull model is given by S(t) = exp(-λt^ρ), where the parameter ρ is often called the ‘shape’ parameter. For a Weibull survival curve, the hazard is, in general, not a constant but a function of time, given by pλt^{ρ -1}. For ρ^-1, this reduces to the exponential model.

Pairs of Weibull survival curves are shown in Figure 1B & C. In Figure 1B, the parameter ρ is the same for the two curves. This means that the HR is again a constant (here 0.2), and not a function of time. However, the ratio of median survival times is no longer the inverse of the HR (2.0/0.65 ≠ 5). In Figure 1C, the shape parameters also differ between the two curves, and the HR is a function of time. The two survival curves in Figure 1C are quite similar for a period of time before separating, meaning that the Weibull model might be a good fit to the data from clinical trials in immuno-oncology.

The Weibull model also allows for the inclusion of covariates of survival times, and can describe data from long-tailed distributions, which are common in immuno-oncology trials. As the Weibull model is both a proportional hazards model and an accelerated failure time model, treatment effects can be defined either in terms of HR or relative increase or decrease in survival time [39]. The model offers a compromise between exponential and nonparametric approaches, and can be a useful alternative in the analysis of survival data [40]. This model, along with a mixture model incorporating a cure fraction, has been suggested for use in clinical studies involving patients with long-term survival [41–43]. The SWOG Phase III study investigating the addition of gemtuzumab ozogamicin to induction or maintenance therapy in acute myeloid leukemia, in which the survival curve reached a plateau, is an example of a study in which the Weibull model may have been of use [44]. One drawback of the existing simple parametric models is their lack of flexibility owing to strong assumptions about the shape of the baseline hazard function. Piecewise exponential distributions have also been recognized as a simple and flexible tool in survival analyses, and can perhaps be valuable in immuno-oncology trials [45].

• Early interim analyses

Standard group sequential designs and interim analyses have been used in Phase III studies to allow early study termination for success or futility. Standard designs and response criteria should be reassessed when considering immuno-oncology studies [4]. Early interim analysis should be approached carefully because a drug with delayed separation of the survival curves might confer a misleadingly negative early result. In a Phase III trial of tremelimumab in metastatic melanoma, an early interim analysis showed no survival benefit and the study was terminated; however, extended follow-up showed delayed separation of the survival curves [46].

Data analysis issues & solutions

Traditionally, the most commonly used statistical methods for time-to-event analyses are the log-rank test and Cox regression analysis [47], which have maximal statistical power under the proportional hazards (constant HR) assumption. However, these methods do not emphasize the treatment effect on long-term survivors. Also, as previously noted, the delayed separation of curves often seen in immuno-oncology studies violates the fundamental study design assumption of proportional hazards, which can lead to a loss of statistical power.

• Nonproportional hazards & weighted log-rank test

For agents, such as immuno-oncology therapies, that show a delayed clinical effect, the possibility of nonproportional hazards should be considered when estimating the size of the study to reduce the likelihood of false-negative conclusions [4]. A sufficient number of patients need to be randomized to ensure that the total number of events is reachable, while the study duration should be long enough to ensure an adequate follow-up duration for all patients to capture any long-term survival benefit. The delayed clinical effect and the long tail of survival curves highlight the importance of using landmark survival analyses, as well as the HR and median OS, to benchmark long-term survival outcomes. Indeed, in a Phase III study of treatment-naive patients with advanced melanoma, a milestone survival analysis with a minimum follow-up of 5 years demonstrated improved outcomes with ipilimumab plus dacarbazine. The median OS was 11.2 months (95% CI: 9.5–13.8 months) in the ipilimumab plus dacarbazine group versus 9.1 months (95% CI: 7.8–10.5 months) in the dacarbazine-only group, with an HR of 0.69 (95% CI: 0.57–0.84) [48]. Milestone survival rates at given time points, such as, 1- or 2-year OS rates and HRs, are warranted in immuno-oncology therapy trials, provided the minimum follow-up is long enough to allow robust estimation of these rates. Alternative summary measures of treatment differences should also be considered [49–52]. Of these, particularly promising is the estimated probability that a patient on a particular treatment dies earlier than if that same patient received another treatment.

The weighted log-rank test is more powerful when nonproportional hazards, such as delayed clinical effect and long-term survival, are present, and can be considered an appropriate alternative to traditional statistical methods [20], along with the Weibull model. To avoid a substantial loss of statistical power, Fine proposed using a weighted log-rank test with the Fleming–Harrington [53] class of weights as the primary analysis in confirmatory studies of immunotherapies focusing on a survival end point [20]. However, there is no consensus on an a priori set of weights that should be used for a given trial, as the point at which the survival curves might diverge cannot be predicted at the start. A weighted log-rank test, which downweighs the early time period during which survival curves might be similar, requires more events to detect a treatment effect than does the standard log-rank test. In the absence of knowledge of that time period, and thus of the appropriate weights to use, the sample size calculated using a proportional hazards assumption should be increased. In our experience, this inflation factor should be in the order of 10%; however, further investigation is needed.

Perspectives on the changing treatment paradigm in MM predictive markers of anticancer immunity

Immune-response end points might provide early indications of the efficacy of immuno-oncology therapies. In addition, predictive biomarkers of immune response, such as, elimination of antigens and T-cell or antibody response, might better identify subsets of patients who would benefit from treatment. The use of such immune-response end points could improve the design and implementation of immuno-oncology trials by determining whether an immuno-oncology therapy has achieved its biologic effect, thus predicting clinical outcomes. However, T-cell immune-response assays are highly variable and should be standardized to minimize data variability [5]. In melanoma immuno-oncology studies, markers of immune response correlating with outcomes have been reported [54,55]; however, further development of reliable and reproducible assays for novel markers that correlate with improved survival in immuno-oncology trials for different types of cancers, including MM, is needed.

• Surrogate end points

As patients with hematologic cancers often present with slow-growing indolent disease, alternate or surrogate end points are particularly important when considering trial designs, with the goal of expediting drug development and delivering new treatments to these patients faster. In MM, implementation of appropriate surrogate end points in future studies will be important to better establish early signals for efficacy. Surrogate end points evaluating immune responses, biomarkers and MRD in earlier phase studies may be beneficial.

Delivering new treatment options to patients as quickly as possible by expediting the regulatory process of developing drugs is not uncommon for serious and life-threatening diseases, such as cancer. Breakthrough or fast-track designations have become more common for new cancer therapies including immuno-oncology agents such as daratumumab, which was approved by health agencies based on Phase II data. As such, appropriate surrogate end points in Phase II studies of immuno-oncology agents should be established to increase the confidence of earlier phase data and retain the scientific rigor that is required for regulatory approval.

• Maintenance therapy

A longer PFS has been observed in patients with MM undergoing continuous therapy with several drugs, including lenalidomide [56–59]. However, next-generation treatment for MM should include alternative maintenance strategies, as some of these drugs have been associated with a higher frequency of second primary malignancies [60]. The specificity, therapeutic efficacy and low toxicity profile of monoclonal antibodies make them attractive candidates for maintenance therapy. In the solid tumor setting, in contrast to traditional chemotherapies used for the treatment of melanoma, nivolumab and pembrolizumab are currently given until disease progression or unacceptable toxicity [61,62]. In MM, the treatment of residual disease with continuous immuno-oncology therapy after induction therapy might yield better outcomes than induction alone. Although there is some evidence of a beneficial immunomodulatory effect of lenalidomide in the maintenance setting [63], further studies evaluating the efficacy of long-term therapy in patients with MM are needed. However, long-term improved OS does not necessarily mean that a patient is cured. Indeed, a meta-analysis of maintenance therapy in MM showed that a subset of ‘cured’ patients with long-term survival have some residual disease versus those who are MRD negative [64]. Therefore, long-term survival can be improved with maintenance therapy, as some patients require ongoing immune modulation of residual disease despite improved OS.

A challenge in immuno-oncology is how to optimize the sequence of treatment with immuno-oncology therapies, as increasing evidence suggests that clinical benefit might be optimized by administering immuno-oncology therapies as early as possible in the treatment paradigm. In a retrospective analysis evaluating the efficacy of ipilimumab therapy before and after BRAF inhibitor treatment in patients with metastatic melanoma [65], patients treated with ipilimumab prior to BRAF inhibitors experienced better outcomes than did patients treated with the opposite schedule. In the MM setting, a Phase III study of elotuzumab plus lenalidomide and dexamethasone as first-line therapy in previously untreated patients (ELOQUENT-1; NCT01335399) is under way. Further randomized controlled trials are needed to define the optimal sequencing of immuno-oncology therapies.

Conclusion

When considering immuno-oncology agents in MM, appropriate study designs, end points, statistical analyses and interpretation are needed, which can differ from those for cytotoxic chemotherapy and pathway-specific agents. Importantly, clinical benefit with immuno-oncology therapies is often delayed, so consideration of long-term (i.e., beyond the median) benefit is needed. In order to confirm early outcomes with surrogate end points, adequate long-term follow-up continues to be of utmost importance in immuno-oncology clinical trials, in order to capture the overall benefits of these new therapies. Clinical trials should take a longer-term view to understand the clinical benefit across the study population and ensure that potentially beneficial treatments are not disregarded too early.

Future perspective

Immuno-oncology therapies that harness the patient's immune system to target cancer cells are likely to have a significant impact on the treatment of MM, with improved clinical outcomes and changing treatment paradigms. Appropriate study designs, end points and statistical methods are essential for evaluating immuno-oncology therapies to achieve more favorable treatment outcomes. Currently, much focus is placed on median time-to-event end points, such as OS and PFS. As clinical benefit with immuno-oncology therapies is often delayed, a long-term approach to the assessment of immuno-oncology data should be taken, including assessment of HRs over time (which assess benefit across the entire course of a study and include all patients) and milestone PFS/OS analyses, as clinical trial results can be misleading if analyzed too early. In addition to the conventional efficacy end points, we propose selecting appropriate immune end points to determine early signs of an immune response, and adapting currently accepted end points to ensure the long-term evaluation of clinical benefit with immuno-oncology agents. Long-term data with promising immuno-oncology agents may help us better predict future outcomes with immuno-oncology therapies in MM.

EXECUTIVE SUMMARY.

• Long-term survival and delayed clinical benefit are common patterns of response to treatment with immuno-oncology agents.

• Alternate statistical methods and end points should be considered to allow treatment efficacy of immuno-oncology agents to be assessed appropriately.

Immuno-oncology therapies: response assessments & safety considerations

• Long-term follow-up and end points, such as, hazard ratios and 5-year progression-free survival and overall survival should be considered when designing immuno-oncology trials in the multiple myeloma (MM) setting.

• Immune-related response criteria were developed based on Response Evaluation Criteria In Solid Tumors and WHO criteria for evaluating immune response in patients with solid tumors treated with immuno-oncology therapies:

  • These criteria are not yet being used in hematologic malignancies and may require adaptation in the MM setting.

• Careful monitoring of safety and immune-related adverse events is required during immuno-oncology trials and long-term follow-up.

Study design issues & solutions

• Although statistical survival analysis models are typically nonparametric (e.g., Kaplan–Meier curves and log-rank tests), parametric survival models, such as the exponential or Weibull models, can reveal additional insights as they allow for the inclusion of covariates of survival times. In addition, compared with the exponential model with the underlying proportional assumption, the Weibull model can describe data from long-tailed distributions, which are common in immuno-oncology trials.

• Standard study designs and interim analyses allowing for early study termination for success or futility should be reassessed when considering immuno-oncology agents, so potentially beneficial treatments are not disregarded too early.

Data analysis issues & solutions

• The delayed clinical benefit and long-term survival often seen in immuno-oncology studies violate the fundamental assumption of proportional hazards, which can lead to a loss of statistical power.

• The weighted log-rank test is more powerful when nonproportional hazards are present and can be considered an appropriate alternative to traditional statistical methods.

• Milestone survival rates, such as 1- and 2-year overall survival rates and hazard ratios, are warranted in immuno-oncology trials.

Perspectives on the changing treatment paradigm in MM predictive markers of anticancer immunity

• Further randomized controlled trials are needed to evaluate the efficacy of long-term maintenance therapy and to define the optimal sequencing of immuno-oncology therapies in the MM setting.