Abstract
Introduction
Advances in the treatment of metastatic melanoma have been achieved in recent years: immunotherapies and targeted therapies have demonstrated survival benefits over older agents such as granulocyte-macrophage colony-stimulating factor (GM-CSF), dacarbazine, and glycoprotein peptide vaccine (gp100) in pivotal phase 3 trials. It is important to compare therapies to guide the treatment decision-making process, and establishing the relationship between older agents can strengthen the networks of evidence for newer therapies. We report the outcome of an indirect comparison of GM-CSF, dacarbazine, and gp100 in metastatic melanoma through meta-analysis of absolute treatment effect.
Methods
A systematic literature review identified trials for inclusion in the meta-analysis. A valid network meta-analysis was not feasible: treatment-specific meta-analysis was conducted. A published algorithm was used to adjust overall survival estimates from trials of GM-CSF, dacarbazine, and gp100 for heterogeneity in baseline prognostic factors. Survival estimates were compared in three patient groups: stage IIIB–IV M1c, stage IIIB–IV M1a, and stage IV M1b/c.
Results
One trial of GM-CSF, four of dacarbazine, and one of gp100 were included in the analysis. After adjusting for differences in baseline prognostic factors, median overall survival (OS) in all patient groups was longer for those receiving GM-CSF than for those receiving dacarbazine or gp100. The observed survival over time for GM-CSF was similar to the adjusted survival for dacarbazine and greater than for gp100 in all patient groups.
Conclusion
The relative treatment effect of GM-CSF, dacarbazine, and gp100 has been reliably estimated by adjusting for differences in baseline prognostic factors. Results suggest that OS with GM-CSF is at least as good as with dacarbazine and greater than with gp100. Given the role of these agents as controls in phase 3 trials of new immunotherapies and targeted agents, these results can be used to contextualize the efficacy of newer therapies.
Funding
Amgen Inc.
Keywords: Dacarbazine, Efficacy, Glycoprotein 100, Granulocyte-macrophage colony-stimulating factor, Indirect treatment comparison, Meta-analysis, Metastatic melanoma, Oncology, Survival
Introduction
Metastatic melanoma is a serious disease with a poor survival outcome; the 5-year survival rate for patients with distant metastases at diagnosis is 15–20% [1, 2]. Until recently, therapies for unresectable metastatic melanoma had no confirmed survival benefit and the aim of treatment was palliation [3]. However, the number of treatment options has increased rapidly since 2011. Immunotherapies and targeted agents have demonstrated survival benefits in randomized controlled phase 3 trials and are now recommended for first- and second-line treatment of metastatic melanoma [4, 5]. The choice of treatment may be guided by the patient’s BRAF mutation status: the BRAF kinase inhibitors vemurafenib and dabrafenib are used to treat mutated-BRAF disease, which accounts for approximately 40–50% of melanoma cases, whereas immunotherapies such as ipilimumab, pembrolizumab, and nivolumab, and the oncolytic virus therapy talimogene laherparepvec, can be used regardless of BRAF mutation status [4–6].
Many of these new treatment options were evaluated in phase 3 trials against older agents. Each new treatment was compared with the agent or regimen considered appropriate for that trial setting at the time when the trials were designed, which led to the use of a wide range of control agents in pivotal trials. For example, ipilimumab was compared with glycoprotein peptide vaccine (gp100) in previously treated patients [7] and with dacarbazine in the first-line setting [8]. Dacarbazine was also the control agent in trials of vemurafenib and dabrafenib monotherapy [9, 10], whereas granulocyte-macrophage colony-stimulating factor (GM-CSF) was the control agent in the pivotal trial of talimogene laherparepvec [11].
As the treatment landscape continues to develop, it is important to compare currently used therapies to guide the treatment decision-making process. However, there are challenges in estimating the relative treatment effects for these newer therapies, at least in part because they were compared to older agents in phase 3 trials and the relative efficacy of these older agents has never been established. Systematic evaluations of new treatment options (health technology assessments [12]) have not discounted the possibility of equipoise between gp100 and placebo; however, there is no precedent for making the same assumption for dacarbazine. By better understanding the relative efficacy of older agents, it may be possible to strengthen the networks of evidence and indirect treatment comparisons of the newer therapies.
Here we report the outcome of an indirect treatment comparison of survival with GM-CSF, dacarbazine, and gp100 in phase 3 randomized controlled trials in metastatic melanoma. The indirect treatment comparison took the form of a treatment-specific meta-analysis of absolute treatment effect, with adjustment for heterogeneity in prognostic factors for survival. Given that survival rates vary according to stage of disease [13], we also have compared relative survival with these agents in three populations: stage IIIB–IV M1c melanoma, that is all patients in the trials; stage IIIB–IV M1a melanoma (early metastatic melanoma), that is patients without bone, brain, lung, or other visceral metastases; and stage IV M1b/c melanoma (late metastatic melanoma), that is patients with visceral metastases.
Methods
Systematic Literature Review
A systematic literature review was carried out to identify relevant trials relating to treatments for melanoma; the methodology has been described in full elsewhere [14]. The systematic review followed Cochrane and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. Briefly, clinical trials published between January 1990 and September 2015 that evaluated the efficacy and safety of treatments for metastatic melanoma were identified from searches of the following databases: MEDLINE, including MEDLINE In-Process Citations and Daily Update (PubMed; OvidSP); Embase (OvidSP); and the Cochrane Library, including the Cochrane Database of Systematic Reviews (CDSR), Database of Abstracts of Reviews of Effects (DARE), Cochrane Central Register of Controlled Trials (CENTRAL), Health Technology Assessment (HTA) Database, and the NHS Economic Evaluation Database (NHSEED). To identify relevant studies presented at conferences, the following meeting proceedings were also searched: American Society of Clinical Oncology (ASCO), European Association of Dermato Oncology (EADO), European Cancer Congress (ECC), European Society for Medical Oncology (ESMO), and International Society for Pharmacoeconomics and Outcomes Research (ISPOR; European and international conferences).
The trials identified in the review were assessed against pre-specified inclusion and exclusion criteria; trials that met these criteria and that investigated the agents of interest were then assessed for bias and study quality using the Grades of Recommendation, Assessment, Development and Evaluation (GRADE) criteria [15].
Establishing the Feasibility of a Valid Network Meta-Analysis
The feasibility of conducting a valid network meta-analysis of GM-CSF, dacarbazine, and gp100 was assessed using a process developed and published by Cope and colleagues [16]. The network of evidence for previously untreated or treated melanoma is shown in Fig. 1, including both current treatments and the control agents included in the trials. The network had few trials and generally one trial per connection; aside from dacarbazine, each of the treatments of interest occurred in only a single trial. There were no head-to-head data for the treatments of interest and patient characteristics (e.g., stage of disease, previous treatment) differed between trial populations meaning that a valid network of evidence could not be established [17].
Fig. 1.
Network of evidence for previously untreated or treated melanoma. a Trial ongoing but data are reported; b Non-standard dose, administration, or setting; c Previously treated patients; d NCT identifier not available, data published (Ravaud et al. 2001). GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein peptide vaccine, T-VEC talimogene laherparepvec
Indirect Treatment Comparisons
The use of treatment-specific meta-analysis of absolute treatment effect as an alternative approach to indirect treatment comparison has been previously reported when a valid network of evidence could not be established [14]. We used the same approach here, which involved analysis of survival data for GM-CSF, dacarbazine, and gp100 from metastatic melanoma trials in which these agents were studied as monotherapy.
Survival outcomes were adjusted for heterogeneity in prognostic factors to permit a valid comparison between agents. Adjustments were based on a predictive model for survival developed by Korn and colleagues [18]; a modified version of the model has been accepted by the UK National Institute for Health and Care Excellence (NICE) [19]. The modified Korn model produces a hazard ratio (HR) based on five prognostic factors for survival: sex, Eastern Cooperative Oncology Group performance status, presence of visceral metastases, presence of brain metastases, and lactate dehydrogenase (LDH) level. Survival was adjusted using the HR as the modifier, thereby reflecting the impact of the difference in patient characteristics between trial arms for each agent.
GM-CSF was considered the reference agent for the indirect treatment comparison since this permitted additional analyses of survival rates according to stage of disease (early and late metastatic melanoma). To test the robustness of the indirect treatment comparison, survival outcomes were also analyzed using dacarbazine as the reference, as this control agent had the largest evidence base.
Survival outcomes were analyzed separately for each comparator. Where survival outcomes for a particular comparator were available from more than one trial, estimates of overall survival (OS) from each trial were adjusted separately using the modified Korn model and then pooled using the Mantel–Haenszel method [20, 21]. A detailed description of the application of the modified Korn model and Mantel–Haenszel method is published elsewhere [14].
Survival outcomes with GM-CSF were available according to stage of disease—that is, for patients without bone, brain, lung, or other visceral metastases (stage IIIB–IV M1a) and patients with visceral metastases (stage IV M1b/c). These data were not available for dacarbazine and gp100, so adjustment factors for dacarbazine and gp100 did not include this specificity.
For the analyses using dacarbazine as the reference agent, adjusted survival outcomes with GM-CSF and gp100 were determined relative to dacarbazine for all patients (stage IIIB–IV M1c disease). As survival outcomes with dacarbazine were not available according to stage of disease, it was not possible to conduct the indirect comparison of treatments on the subgroups of patients with early or late metastatic melanoma using dacarbazine as the reference agent.
Extracting Survival Data for Analysis
DigitizeIt version 2.0.3 software was used to extract and digitize Kaplan–Meier curves [22]. This provided survival estimates at consecutive half-month intervals for the relevant arm of each trial. Median survival estimates from the digitized datasets were compared with the published median survival estimates to establish the quality of the outputs.
Compliance with Ethics Guidelines
This article is based on previously conducted studies and does not involve any new studies of human or animal subjects performed by any of the authors.
Results
Systematic Review
Figure 2 shows the PRISMA flow diagram illustrating the identification of studies in the systematic review. Trials that had evaluated GM-CSF, dacarbazine, or gp100 as control agents were identified for inclusion in the meta-analysis on the basis of the following criteria: they had to be randomized phase 3 trials published from 2010 onwards, OS curves had to be reported, as did patient baseline characteristics relevant to the modified Korn model.
Fig. 2.
PRISMA flow diagram for the systematic review. GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, PRISMA Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Trials Included in the Indirect Treatment Comparison
In total, six trials were identified for inclusion in the indirect treatment comparison: one trial with GM-CSF, four trials with dacarbazine, and one trial with gp100. All of the trials were designed to meet regulatory requirements and were therefore considered of sufficient quality to include in the analyses; it was not considered necessary to use formal assessments of potential bias (e.g., using GRADE criteria) to further refine the list of trials included in the analyses.
The baseline characteristics of patients enrolled in these trials are listed in Table 1. Sex, a prognostic factor for survival, was generally balanced across trials but there were important differences in some other prognostic factors: patients enrolled in the GM-CSF trial seemed to have a better prognosis than those in the dacarbazine trials and the gp100 trial; for example, a higher percentage of patients in the GM-CSF trial had stage IIIB–IV M1a disease and a higher percentage had normal LDH levels.
Table 1.
Patient baseline characteristics for randomized controlled phase 3 trials of GM-CSF, dacarbazine, and gp100
| Patient characteristic | OPTiM IIIB-IV M1c (ITT) (n = 141) [11] |
OPTiM IIIB-IV M1a (n = 86) [11] |
OPTiM IV M1b/c (n = 55) [11] |
CA184-024 (n = 252) [8] |
|---|---|---|---|---|
| Comparator (dose) |
GM-CSF (125 µg/m2 for 14 days in 28 day cycle) |
GM-CSF (125 µg/m2 for 14 days in 28 day cycle) |
GM-CSF (125 µg/m2 for 14 days in 28 day cycle) |
Dacarbazine (850 mg/m2 on day 1, every 3 weeks) |
| Patient population | Previously treated and untreated | Previously treated and untreated | Previously treated and untreated | Previously untreated |
| Disease stage | Unresectable stage IIIB/C or IV | Unresectable stage IIIB/C or IV M1a | Stage IV M1b/c | Unresectable stage III or IV |
| Sex, % | ||||
| Male | 55 | 55 | 55 | 59.1 |
| Female | 45 | 45 | 45 | 40.9 |
| ECOG PS, % | ||||
| 0 | 69 | 63 | 78 | 71.0 |
| ≥1 | 23 | 28 | 15 | 29.0 |
| Unknown | 9 | 9 | 7 | 0 |
| No visceral disease, %a | 61 | 100 | 0 | 20.3 |
| No brain metastases, % | 100 | 100 | 100 | 100 |
| LDH, % | ||||
| ≤ULN | 88 | 87 | 89 | 55.6 |
| >ULN | 4 | 2 | 0 | 43.7 |
| Unknown | 9 | 11 | 11 | 0.8 |
| Patient characteristic | BRIM-3 (n = 338) [10] |
BREAK-3 (n = 63) [9] |
Daponte (n = 70) [25] |
MDX010-20 (n = 136) [7] |
|---|---|---|---|---|
| Comparator (dose) |
Dacarbazine (1000 mg/m2 on day 1, every 3 weeks) |
Dacarbazine (1000 mg/m2 on day 1, every 3 weeks) |
Dacarbazine (900 mg/m2 on day 1, every 3 weeks) |
gp100 (2 × 1 mg per dose, every 3 weeks) |
| Patient population | Previously untreated | Previously untreated | Previously untreated | Previously treated |
| Disease stage | Unresectable stage IIIC or IV, positive for BRAF V600 mutation | Unresectable stage III or IV, positive for BRAF V600E mutation | Advanced (stage IV) | Unresectable stage III or IV |
| Sex, % | ||||
| Male | 54 | 59 | 60 | 53.7 |
| Female | 46 | 41 | 40 | 46.3 |
| ECOG PS, % | ||||
| 0 | 68 | 70 | 79 | 51.5 |
| ≥1 | 32 | 25 | 21 | 47.8 |
| Unknown | 0 | 5 | 0 | 0.7 |
| No visceral disease, %a | 16 | 18 | 9 | 11.0 |
| No brain metastases, % | 100 | 100 | 94 | 84.6 |
| LDH, % | ||||
| ≤ULN | 42 | 68 | 33 | 59.6 |
| >ULN | 58 | 30 | 67 | 38.2 |
| Unknown | 0 | 2 | 0 | 2.2 |
ECOG PS Eastern Cooperative Oncology Group performance status, GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, ITT intent to treat, LDH lactate dehydrogenase, ULN upper limit of normal
aNo visceral disease includes stages IIIB to IV M1a
The heterogeneity in patient baseline characteristics across the trials confirmed the need for adjustment before comparing the survival outcomes for the three agents, although heterogeneity in outcomes could not be assessed quantitatively because of the small number of trials and the variation in sample sizes.
The modified Korn model was applied to adjust for differences in the five baseline prognostic factors, and an HR modifier was calculated for each trial. Adjustment factors were then determined from the ratio of the HR modifiers for GM-CSF (or dacarbazine) and the comparator agents.
Relative Survival in all Patients (Stage IIIB–IV M1c)
GM-CSF as the Reference Agent
Table 2 lists the adjustment factors applied to determine the relative survival effect of dacarbazine and gp100 compared with GM-CSF in all patients (stage IIIB–IV M1c disease). All the adjustment factors are less than 1, reflecting the poorer survival prognosis for patients in the dacarbazine trials and gp100 trial compared with those in the GM-CSF trial.
Table 2.
Overall survival curve adjustment: HR and adjustment factor for all patients (stage IIIB–IV M1c)
| Trial (drug, patient population) | HR for comparators | HR for GM-CSF | Adjustment factor |
|---|---|---|---|
| CA184-024 (dacarbazine, previously untreated) [8] | 0.32 | 0.22 | 0.69 |
| BRIM-3 (dacarbazine, previously untreated) [10] | 0.32 | 0.22 | 0.69 |
| BREAK-3 (dacarbazine, previously untreated) [9] | 0.29 | 0.22 | 0.76 |
| Daponte (dacarbazine, previously untreated) [25] | 0.39 | 0.22 | 0.57 |
| MDX010-20 (gp100, previously treated) [7] | 0.34 | 0.22 | 0.65 |
GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, HR hazard ratio
The observed median OS estimate for GM-CSF and the unadjusted and adjusted median OS estimates for dacarbazine and gp100 in all patients are presented in Table 3. For both dacarbazine and gp100, adjustment for patient baseline characteristics substantially increased adjusted median OS compared with the unadjusted estimates. Again, this reflects the poorer original survival prognosis driven by the patient characteristics in the dacarbazine trials and the gp100 trial. Median OS with GM-CSF was estimated to be longer than with dacarbazine or gp100, even after adjusting for heterogeneity in patient baseline characteristics.
Table 3.
Median overall survival in months: all patients (stage IIIB–IV M1c)
| Drug | Unadjusted | Modified Korn adjustment |
|---|---|---|
| GM-CSFa | 18.9 | NA |
| Dacarbazineb | 9.3 | 16.0 |
| gp100 | 6.4 | 10.1 |
GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, NA not applicable
aObserved median overall survival
bBased on pooled analysis of four dacarbazine curves
The observed OS curve for GM-CSF and unadjusted OS curves for dacarbazine and gp100 are shown in Fig. 3. Adjustment for differences in baseline prognostic factors improved OS for both dacarbazine (Fig. 4) and gp100 (Fig. 5) at each time point along the curve. The observed OS for GM-CSF was greater than the unadjusted OS for dacarbazine and gp100 at each time point. The observed OS for GM-CSF was also greater than the adjusted OS for dacarbazine at every time point (Fig. 4); however, the observed OS for GM-CSF tracked close to or just below the upper bound of the 95% confidence interval (CI) of the adjusted OS curve for dacarbazine, which suggested that the survival estimates for the two agents might be similar. When comparing the observed OS for GM-CSF with the adjusted OS for gp100 (Fig. 5), the observed OS for GM-CSF tracked above the upper bound 95% CI of the adjusted OS curve for gp100 at every time point, even though differences in the trial populations that might affect survival outcomes had been accounted for, suggesting greater efficacy for GM-CSF throughout the survival curve.
Fig. 3.
Unadjusted Kaplan–Meier OS curves for dacarbazine and gp100 vs observed OS curve for GM-CSF, all patients (stage IIIB–IV M1c). GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, OS overall survival
Fig. 4.
Unadjusted and adjusted Kaplan–Meier OS curves for dacarbazine vs observed OS curve for GM-CSF, all patients (stage IIIB–IV M1c). CI confidence interval, GM-CSF granulocyte-macrophage colony-stimulating factor, OS overall survival
Fig. 5.
Unadjusted and adjusted Kaplan–Meier OS curves for gp100 vs observed OS curve for GM-CSF, all patients (stage IIIB–IV M1c). CI confidence interval, GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, OS overall survival
Dacarbazine as the Reference Agent
Table 4 lists the adjustment factors applied to determine the relative survival effect of GM-CSF and gp100 compared with dacarbazine in all patients (stage IIIB–IV M1c disease). Similarly to the original analysis, median OS with GM-CSF was longer than with dacarbazine and gp100, even after adjusting for heterogeneity in patient baseline characteristics (Table 5).
Table 4.
Overall survival curve adjustment to dacarbazine reference: HR and adjustment factor for all patients (stage IIIB–IV M1c)
| Trial (drug, patient population) | HR for comparators | HR for dacarbazine | Adjustment factor |
|---|---|---|---|
| OPTiM (GM-CSF, previously treated and untreated) [11] | 0.22 | 0.32 | 1.46 |
| MDX010-20 (gp100, previously treated) [7] | 0.34 | 0.32 | 0.95 |
GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, HR hazard ratio
Table 5.
Median overall survival in months: all patients (stage IIIB–IV M1c)
| Drug | Unadjusted | Modified Korn adjustment |
|---|---|---|
| Dacarbazinea | 9.3 | NA |
| GM-CSF | 18.9 | 14.2 |
| gp100 | 6.4 | 7.3 |
GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, NA not applicable
aObserved median overall survival (based on pooled analysis of four dacarbazine curves)
Although adjustment for differences in baseline prognostic factors reduced OS for GM-CSF at each time point compared with the observed data, the adjusted GM-CSF curve still dominated the observed OS curve for dacarbazine (Fig. 6). Moreover, the lower 95% CI for GM-CSF tracked above or on the observed OS curve for dacarbazine, suggesting that the survival estimates may be similar and supporting the outcome of the original analysis. The adjusted OS for gp100 tracked below the observed OS for dacarbazine but with some overlap with the upper 95% CI (Fig. 7), again suggesting that the survival estimates for the two treatments are similar.
Fig. 6.
Unadjusted and adjusted Kaplan–Meier OS curves for GM-CSF vs observed OS curve for dacarbazine, all patients (stage IIIB–IV M1c). CI confidence interval, GM-CSF granulocyte-macrophage colony-stimulating factor, OS overall survival
Fig. 7.
Unadjusted and adjusted Kaplan–Meier OS curves for gp100 vs observed OS curve for dacarbazine, all patients (stage IIIB–IV M1c). CI confidence interval, gp100 glycoprotein 100, OS overall survival
Relative Survival in Patients with Early Metastatic Melanoma (Stage IIIB–IV M1a)
Stage IIIB–IV M1a disease, in which bone, brain, lung, and other visceral metastases are absent, can be considered an early stage of metastatic melanoma. Table 6 lists the adjustment factors applied to determine the relative survival effect of dacarbazine and gp100 compared with GM-CSF in these patients. As stated previously, the adjustment factors for GM-CSF were specific to the stage of disease (i.e., to stage IIIB–IV M1a), but those for dacarbazine and gp100 were not.
Table 6.
Overall survival curve adjustment: HR and adjustment factor for patients with early metastatic melanoma (stage IIIB–IV M1a)
| Trial (drug, patient population) | HR for comparators | HR for GM-CSF | Adjustment factor |
|---|---|---|---|
| CA184-024 (dacarbazine, previously untreated) [8] | 0.32 | 0.20 | 0.64 |
| BRIM-3 (dacarbazine, previously untreated) [10] | 0.32 | 0.20 | 0.64 |
| BREAK-3 (dacarbazine, previously untreated) [9] | 0.29 | 0.20 | 0.70 |
| Daponte (dacarbazine, previously untreated) [25] | 0.39 | 0.20 | 0.52 |
| MDX010-20 (gp100, previously treated) [7] | 0.34 | 0.20 | 0.60 |
GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, HR hazard ratio
The absence of brain or visceral metastases is recognized as a positive prognostic factor for OS and so, as would be expected, adjustment factors for this group were lower than those for the corresponding total patient populations across all trials, resulting in a greater impact on survival outcomes.
The observed median OS estimate for GM-CSF and the unadjusted and adjusted median OS estimates for dacarbazine and gp100 are shown in Table 7. For both dacarbazine and gp100, the adjusted median OS for this population was longer than for the overall patient population, as would be expected given the better survival prognosis. Median OS with GM-CSF was longer than with dacarbazine or gp100 even after adjusting for heterogeneity in patient baseline characteristics.
Table 7.
Median overall survival in months: patients with early metastatic melanoma (stage IIIB–IV M1a)
| Drug | Unadjusted | Modified Korn adjustment |
|---|---|---|
| GM-CSFa | 21.5 | NA |
| Dacarbazineb | NR | 17.3 |
| gp100 | NR | 10.6 |
GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, NA not applicable, NR not reported, however, the adjusted data exist because, for gp100 and dacarbazine, the entire stage IIIB–IV data were used
aObserved median overall survival
bBased on pooled analysis of four dacarbazine curves
As in the overall patient population, the observed OS for GM-CSF was greater than the adjusted OS for both dacarbazine and gp100 at every time point (Fig. 8). Again, the observed OS for GM-CSF tracked close to or on the upper bound 95% CI of the adjusted OS curve for dacarbazine and above the upper bound 95% CI of the adjusted OS curve for gp100.
Fig. 8.
Adjusted Kaplan–Meier OS curves for dacarbazine and gp100 vs observed OS curve for GM-CSF, patients with early metastatic melanoma (stage IIIB–IV M1a). CI confidence interval, GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, OS overall survival
Relative Survival in Patients with Late Metastatic Melanoma (Stage IV M1b/c)
Stage IV M1b/c disease, where visceral metastases are present, can be considered a late stage of metastatic melanoma. Table 8 lists the adjustment factors applied to determine the relative survival effect of dacarbazine and gp100 compared with GM-CSF in this population. The adjustment factors for this group were greater than those for the corresponding total patient populations across all trials, reflecting the poorer survival prognosis as determined by the GM-CSF data specific to this patient population.
Table 8.
Overall survival curve adjustment: HR and adjustment factor for patients with late metastatic melanoma (stage IV M1b/c)
| Trial (drug, patient population) | HR for comparators | HR for GM-CSF | Adjustment factor |
|---|---|---|---|
| CA184-024 (dacarbazine, previously untreated) [8] | 0.32 | 0.25 | 0.79 |
| BRIM-3 (dacarbazine, previously untreated) [10] | 0.32 | 0.25 | 0.79 |
| BREAK-3 (dacarbazine, previously untreated) [9] | 0.29 | 0.25 | 0.86 |
| Daponte (dacarbazine, previously untreated) [25] | 0.39 | 0.25 | 0.65 |
| MDX010-20 (gp100, previously treated) [7] | 0.34 | 0.25 | 0.74 |
GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, HR hazard ratio
For dacarbazine and gp100, the unadjusted and adjusted median OS estimates for these patients are shown in Table 9, alongside the observed median OS estimate for GM-CSF. The adjusted median OS for each agent was shorter for these patients than for the overall patient population, again reflecting the poorer survival prognosis. Median OS with GM-CSF was longer than with dacarbazine or gp100, even after adjusting for heterogeneity in patient baseline characteristics.
Table 9.
Median overall survival in months: patients with late metastatic melanoma (stage IV M1b/c)
| Drug | Unadjusted | Modified Korn adjustment |
|---|---|---|
| GM-CSFa | 15.9 | NA |
| Dacarbazineb | NR | 14.1 |
| gp100 | NR | 9.2 |
GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, NA not applicable, NR not reported; however, the adjusted data exist because, for gp100 and dacarbazine, the entire stage IIIB–IV data were used
aObserved median overall survival, b Based on pooled analysis of four dacarbazine curves
The observed OS for GM-CSF was similar to the adjusted OS for dacarbazine, tracking on or close to the OS curve for dacarbazine at every time point (Fig. 9). The observed OS for GM-CSF was greater than the adjusted OS for gp100 at every time point, and tracked above the upper bound 95% CI of the gp100 OS curve.
Fig. 9.
Adjusted Kaplan–Meier OS curves for dacarbazine and gp100 vs observed OS curve for GM-CSF, patients with late metastatic melanoma (stage IV M1b/c). CI confidence interval, GM-CSF granulocyte-macrophage colony-stimulating factor, gp100 glycoprotein 100, OS overall survival
Discussion
The treatment landscape for metastatic melanoma has evolved rapidly in recent years. Evidence of significant survival benefits from randomized controlled phase 3 trials means that immunotherapies and targeted agents are now treatment options for a patient population that historically has been considered difficult to treat [4, 5, 23]. There are challenges in estimating the relative treatment effects of new therapies, however, because they were compared to different older agents in pivotal phase 3 trials and the relative efficacy of these older agents has never been established. By better understanding the relative efficacy of older agents, it may be possible to strengthen the networks of evidence and indirect treatment comparisons of the newer therapies.
In this indirect treatment comparison, the choice of agents for the analysis was driven by the choice of control agents in the pivotal trials of newer immunotherapies and targeted agents. GM-CSF was the control in the pivotal trial of talimogene laherparepvec [11], gp100 in the registration trial of ipilimumab [7], and dacarbazine in the trials of vemurafenib and dabrafenib monotherapies in the first-line setting [9, 10] and also in another trial of ipilimumab [8]. Dacarbazine is the most commonly used older systemic chemotherapy to treat metastatic melanoma. Guidelines from the European Society of Medical Oncology consider dacarbazine or temozolomide an option for the treatment of stage IV metastatic disease in situations where a clinical trial, immunotherapy, or targeted therapy is not available [4].
The current analysis showed that median OS was longer in patients who received GM-CSF than in those who received dacarbazine, even after adjusting for differences in baseline prognostic factors for survival. This was also consistently observed in early-stage disease (without bone, brain, lung, or other visceral metastases) and in late-stage disease (with visceral metastases). The survival estimates over time for GM-CSF were similar to the adjusted survival estimates for dacarbazine; this was also the case when dacarbazine was considered the reference agent. Median OS was longer in patients who received GM-CSF than in those who received gp100 after adjusting for differences in baseline prognostic factors for survival. Again, this was consistently observed in early and late metastatic melanoma. Survival rates for GM-CSF were higher than those for gp100 at each time point evaluated, tracking above the upper bound 95% CI of the adjusted gp100 OS curve. This suggests that GM-CSF has greater efficacy than gp100, throughout the distribution of survival.
This analysis has some limitations that are common already to previous analyses of treatment for melanoma. There were only a small number of qualifying trials and the adjustments made to the survival curves were based on a number of observed prognostic factors. It is possible that other unobserved factors also influenced the trial results; however, the factors included were previously identified on the basis of data from a large number of metastatic melanoma trials [18, 19] and have been used multiple times in adjustments for differences between studies in melanoma [14, 24]. Any additional bias left unadjusted should be minimal.
The network of evidence was such that it could not establish similarity or consistency in studies or treatment effects. This was not surprising, as trials of these agents in melanoma are sporadic, spanning back to the year 2000, and include various treatment settings. In the absence of such a network, adjustment for baseline prognostic factors was undertaken using the modified Korn model; however, there still could be uncertainty. For example, the single study that addressed the efficacy of GM-CSF was the OPTiM trial, which had some identifiably different patient characteristics, as well as better-specified data on disease stage (more patients without visceral disease were included in the trial). Some of the differences in survival, therefore, could be ascribed to patient characteristics. However, this was mitigated to a degree by the inclusion of visceral disease in the modified Korn model, and further mitigated by separate analyses of disease with and without bone, brain, lung, or other visceral diseases. The consistent findings from all patients (stage IIIB–IV M1c), patients with early metastatic melanoma (stage IIIB–IV M1a), and patients with late metastatic melanoma (stage IV M1b/c) increase the confidence in the results.
To our knowledge, this is the first study to compare the relative treatment effects of the control agents used in phase 3 trials of newer immunotherapies and targeted agents for metastatic melanoma. By adjusting for observed differences in patient characteristics across the trials, we have reliably estimated the relative survival associated with each agent. Findings from this study may help strengthen the networks of evidence in metastatic melanoma, and help future studies establish the relative value of treatments for metastatic melanoma.
Conclusions
In this indirect treatment comparison, using data from randomized controlled phase 3 trials in metastatic melanoma, the relative treatment effect of GM-CSF, dacarbazine, and gp100 has been reliably estimated by adjusting for differences in prognostic factors for survival between patient populations. After adjustment, GM-CSF had survival estimates that were at least as good as those for dacarbazine over time, a finding supported by sensitivity analysis with dacarbazine as the reference agent. Compared with gp100, GM-CSF had higher rates of survival at each time point and longer median OS, suggesting greater efficacy throughout the distribution of survival. Importantly, comparing relative treatment effects according to stage of disease consistently yielded the same pattern. Given the role of these agents as controls in pivotal phase 3 trials of new immunotherapies and targeted agents, the results of this analysis can be used to contextualize the efficacy of these new therapies.
Acknowledgements
This study was sponsored by Amgen Inc. and co-conducted with PRMA Consulting Ltd, an independent consulting firm. Talimogene laherparepvec is manufactured by BioVex Inc. a subsidiary of Amgen Inc. Granulocyte-macrophage colony-stimulating factor (GM-CSF) was the control agent in the pivotal trial of talimogene laherparepvec.
The article processing charges and open-access fee for this publication were funded by Amgen Inc. The authors wish to thank Alison Blackburn (PRMA Consulting Ltd), who provided medical writing services on behalf of Amgen Inc. and PRMA Consulting Ltd. All named authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship for this manuscript, take responsibility for the integrity of the work as a whole, and have approved the version to be published. All authors had full access to all of the data in this study and take complete responsibility for the integrity of the data and accuracy of the data analysis.
Compliance with Ethics Guidelines
This article is based on previously conducted studies and does not involve any new studies of human or animal subjects performed by any of the authors.
Disclosures
Casey Quinn is an employee of PRMA Consulting Ltd. Amber Kudlac is an employee of PRMA Consulting Ltd. Qiufei Ma is an employee of Amgen Inc and holds stocks of Amgen Inc. Beth Barber is an employee of Amgen Inc and holds stocks of Amgen Inc. Zhongyun Zhao is an employee of Amgen Inc and holds stocks of Amgen Inc. Stephen Palmer received consulting fees for his contributions to the study.
Data Availability
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
Open Access
This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Footnotes
Enhanced content
To view enhanced content for this article go to http://www.medengine.com/Redeem/1947F06053C3D321.
References
- 1.American Cancer Society. Melanoma skin cancer. http://www.cancer.org/acs/groups/cid/documents/webcontent/003120-pdf.pdf. Accessed 28 April 2016.
- 2.National Cancer Institute. SEER cancer statistics factsheets: melanoma of the skin. http://seer.cancer.gov/statfacts/html/melan.html. Accessed 28 April 2016.
- 3.Dummer R, Hauschild A, Guggenheim M, Jost L, Pentheroudakis G, ESMO Guidelines Working Group Melanoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2010;21(Suppl 5):v194–v197. doi: 10.1093/annonc/mdq188. [DOI] [PubMed] [Google Scholar]
- 4.Dummer R, Hauschild A, Lindenblatt N, Pentheroudakis G, Keilholz U, ESMO Guidelines Committee Cutaneous melanoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2015;26(Suppl 5):v126–v132. doi: 10.1093/annonc/mdv297. [DOI] [PubMed] [Google Scholar]
- 5.National Comprehensive Cancer Network (NCCN). NCCN Clinical Practice Guidelines in Oncology (NCCN Guidelines®): Melanoma. Version 2.2016 ed2016. [DOI] [PubMed]
- 6.Colombino M, Capone M, Lissia A, et al. BRAF/NRAS mutation frequencies among primary tumors and metastases in patients with melanoma. J Clin Oncol. 2012;30(20):2522–2529. doi: 10.1200/JCO.2011.41.2452. [DOI] [PubMed] [Google Scholar]
- 7.Hodi FS, O’Day SJ, McDermott DF, et al. Improved survival with ipilimumab in patients with metastatic melanoma. N Engl J Med. 2010;363(8):711–723. doi: 10.1056/NEJMoa1003466. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Robert C, Thomas L, Bondarenko I, et al. Ipilimumab plus dacarbazine for previously untreated metastatic melanoma. N Engl J Med. 2011;364(26):2517–2526. doi: 10.1056/NEJMoa1104621. [DOI] [PubMed] [Google Scholar]
- 9.Hauschild A, Grob JJ, Demidov LV, et al. Dabrafenib in BRAF-mutated metastatic melanoma: a multicentre, open-label, phase 3 randomised controlled trial. Lancet. 2012;380(9839):358–365. doi: 10.1016/S0140-6736(12)60868-X. [DOI] [PubMed] [Google Scholar]
- 10.McArthur GA, Chapman PB, Robert C, et al. Safety and efficacy of vemurafenib in BRAF(V600E) and BRAF(V600K) mutation-positive melanoma (BRIM-3): extended follow-up of a phase 3, randomised, open-label study. Lancet Oncol. 2014;15(3):323–332. doi: 10.1016/S1470-2045(14)70012-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Andtbacka RH, Kaufman HL, Collichio F, et al. Talimogene laherparepvec improves durable response rate in patients with advanced melanoma. J Clin Oncol. 2015;33(25):2780–2788. doi: 10.1200/JCO.2014.58.3377. [DOI] [PubMed] [Google Scholar]
- 12.NICE. NICE technology appraisal guidance 268: Ipilimumab for previously treated advanced (unresectable or metastatic) melanoma 2012. 2012. http://www.nice.org.uk/guidance/ta268/resources/guidance-ipilimumab-for-previously-treated-advanced-unresectable-or-metastatic-melanoma-pdf.
- 13.Balch CM, Gershenwald JE, Soong SJ, et al. Final version of 2009 AJCC melanoma staging and classification. J Clin Oncol. 2009;27(36):6199–6206. doi: 10.1200/JCO.2009.23.4799. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Quinn C, Ma Q, Kudlac A, Palmer S, Barber B, Zhao Z. Indirect treatment comparison of talimogene laherparepvec compared with ipilimumab and vemurafenib for the treatment of patients with metastatic melanoma. Adv Ther. 2016;33:643–657. doi: 10.1007/s12325-016-0313-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–926. doi: 10.1136/bmj.39489.470347.AD. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Cope S, Zhang J, Saletan S, Smiechowski B, Jansen JP, Schmid P. A process for assessing the feasibility of a network meta-analysis: a case study of everolimus in combination with hormonal therapy versus chemotherapy for advanced breast cancer. BMC Med. 2014;12:93. doi: 10.1186/1741-7015-12-93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Alemayehu D, Alvir JM, Jones B, Willke RJ. Statistical issues with the analysis of nonrandomized studies in comparative effectiveness research. J Manag Care Pharm. 2011;17(9 Suppl A):S22–S26. doi: 10.18553/jmcp.2011.17.s9-a.S22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Korn EL, Liu PY, Lee SJ, et al. Meta-analysis of phase II cooperative group trials in metastatic stage IV melanoma to determine progression-free and overall survival benchmarks for future phase II trials. J Clin Oncol. 2008;26(4):527–534. doi: 10.1200/JCO.2007.12.7837. [DOI] [PubMed] [Google Scholar]
- 19.NICE. NICE technology appraisal guidance 319: Ipilimumab for previously untreated advanced (unresectable or metastatic) melanoma. https://www.nice.org.uk/guidance/ta319. Accessed 6 May 2016.
- 20.Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst. 1959;22(4):719–748. [PubMed] [Google Scholar]
- 21.Deeks JJ, Higgins JPT, Altman DG. Analysing data and undertaking meta-analyses. In: Higgins JP, Green S, editors. Cochrane handbook for systematic reviews of interventions: Cochrane book series. Chichester: Wiley; 2008. [Google Scholar]
- 22.Guyot P, Ades AE, Ouwens MJ, Welton NJ. Enhanced secondary analysis of survival data: reconstructing the data from published Kaplan-Meier survival curves. BMC Med Res Methodol. 2012;12:9. doi: 10.1186/1471-2288-12-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Jones C, Zhao Z, Barber B, Bagijn M, Corrie P, Saltman D. Treatment patterns in advanced melanoma: findings from a survey of European oncologists. Eur J Cancer Care. 2015;24:862–866. doi: 10.1111/ecc.12326. [DOI] [PubMed] [Google Scholar]
- 24.Kotapati S, Dequen P, Ouwens MJ et al. Overall survival (OS) in the management of pretreated patients with unresectable stage III/IV melanoma: a systematic literature review and meta-analysis. J Clin Oncol. 2011;29:Abstract 8580. [DOI] [PMC free article] [PubMed]
- 25.Daponte A, Signoriello S, Maiorino L, et al. Phase III randomized study of fotemustine and dacarbazine versus dacarbazine with or without interferon-alpha in advanced malignant melanoma. J Transl Med. 2013;11:38. doi: 10.1186/1479-5876-11-38. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Chapman PB, Hauschild A, Robert C, et al. Improved survival with vemurafenib in melanoma with BRAF V600E mutation. N Engl J Med. 2011;364(26):2507–16. doi: 10.1056/NEJMoa1103782. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Lawson DH, Tarhini AA et al. Phase III cooperative study of yeast-derived granulocyte macrophage colonystimulating factor (GM-CSF) versus placebo as adjuvant treatment of patients with completely resected stage III-IV melanoma. J Clin Oncol 2010;28(suppl):Abstract 8504).
- 28.Ravaud A, Delaunay M, Chevreau C, et al. Granulocyte-macrophage colony-stimulating factor alone or with dacarbazine in metastatic melanoma: a randomized phase II trial. British J Cancer. 2001;85(10):1467–71. doi: 10.1054/bjoc.2001.2120. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Patel PM, Suciu S, Mortier L, et al. Extended schedule, escalated dose temozolomide versus dacarbazine in stage IV melanoma: Final results of a randomised phase III study (EORTC 18032) European J Cancer. 2011;47:1476–83. doi: 10.1016/j.ejca.2011.04.030. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.