This systematic review and meta-analysis evaluates the immune checkpoint inhibitor regimens used along with the incidence of adverse events reported in randomized clinical trials for treatment of advanced melanoma.
Key Points
Question
Does the risk of immune-related adverse events differ across immune checkpoint inhibitors used by patients with advanced melanoma?
Findings
In this systematic review and network meta-analysis of randomized clinical trials of advanced melanoma treatment, the risk of immune-related adverse events varied by the immune checkpoint inhibitors used and by the different doses of these same immune checkpoint inhibitors. Pembrolizumab, 2 mg/kg, every 3 weeks and 10 mg/kg every 3 weeks as well as nivolumab, 3 mg/kg, every 2 weeks were the 3 immune checkpoint inhibitor regimens associated with the lowest risk of any or severe immune-related adverse events.
Meaning
Results of this study suggest that network analysis comparing different treatment regimens for advanced melanoma may be valuable for clinical decision-making in the absence of evidence from randomized clinical trials with head-to-head comparisons.
Abstract
Importance
Since 2011, immune checkpoint inhibitors (ICIs) have been effective treatment options for advanced melanoma. Little is known about how risks of immune-related adverse events (irAEs) vary by ICIs.
Objective
To compare the risk of irAEs across different treatment regimens for advanced melanoma using network meta-analysis.
Data Sources
PubMed/MEDLINE, Embase, Web of Science, and Scopus were searched for all randomized clinical trial (RCT) articles published from January 1, 2010, through June 30, 2019.
Study Selection
Studies included phases 2 and 3 RCTs in the treatment of advanced melanoma that compared ICIs (ipilimumab, nivolumab, and pembrolizumab) with chemotherapy drugs (eg, dacarbazine, carboplatin, and paclitaxel) or different ICI regimens.
Data Extraction and Synthesis
Different treatment regimens were compared using bayesian network meta-analysis with Markov chain Monte Carlo simulation with noninformative prior distribution and random-effects generalized linear models.
Main Outcomes and Measures
Primary outcomes were the cumulative incidence of any irAEs (regardless of severity) and severe irAEs (grades 3-5). Based on the pooled odds ratios (ORs) and 95% credible intervals (95% CrI), the probability of being associated with the lowest irAE risks was estimated for each treatment regimen.
Results
Nine RCTs with 8 different treatment regimens for advanced melanoma and involving a total of 5051 patients were included. Overall, the 3 ICI treatment regimens associated with the lowest risk of any or severe irAEs were pembrolizumab, 2 mg/kg, every 3 weeks; nivolumab, 3 mg/kg, every 2 weeks; and pembrolizumab, 10 mg/kg, every 3 weeks. Compared with ipilimumab, 10 mg/kg, every 3 weeks, only nivolumab, 3 mg/kg, every 2 weeks, was associated with a decreased risk for any irAEs (OR, 0.34; 95% CrI, 0.13-0.94). A decreased risk for severe irAEs was observed for ipilimumab, 3 mg/kg, every 3 weeks (OR, 0.35; 95% CrI, 0.14-0.74); pembrolizumab, 10 mg/kg, every 2 weeks (OR, 0.22; 95% CrI, 0.05-0.95) and 10 mg/kg every 3 weeks (OR, 0.20; 95% CrI, 0.06-0.68); and nivolumab, 3 mg/kg, every 2 weeks (OR, 0.20; 95% CrI, 0.07-0.48) compared with ipilimumab, 10 mg/kg, every 3 weeks. An increased risk for severe irAEs was associated with nivolumab, 1 mg/kg, every 3 weeks combined with ipilimumab, 3 mg/kg, every 3 weeks compared with other ICI regimens (ORs ranging from 4.09 [95% CrI, 1.73-10.99] to 7.40 [95% CrI, 1.12-49.29]) except ipilimumab, 10 mg/kg, every 3 weeks.
Conclusions and Relevance
These findings suggest that for patients with advanced melanoma at high risk of irAEs, pembrolizumab, 2 mg/kg, every 3 weeks, nivolumab, 3 mg/kg, every 2 weeks, and pembrolizumab, 10 mg/kg, every 3 weeks may be the preferred treatment regimens (with respect to irAE risks) among the ICI regimens reported, whereas ipilimumab, 10 mg/kg, every 3 weeks alone and nivolumab, 1 mg/kg, every 3 weeks combined with ipilimumab, 3 mg/kg, every 3 weeks should be used with caution. A network analysis may be valuable for clinical decision-making when evidence from head-to-head comparisons is lacking.
Introduction
Melanoma, one of the serious forms of skin cancer, is the fifth most common cancer in the United States.1 In 2018, more than 91 000 individuals were newly diagnosed with melanoma.2 Most early-stage melanomas (stages I and II) are curable, with a 5-year survival rate of 98.4%.1 However, advanced melanoma (stages III and IV) with dacarbazine chemotherapy had a low 3-year survival rate of 12.2%.3 In recent years, immunotherapy with novel immune checkpoint inhibitors (ICIs) has revolutionized treatment approaches for advanced melanoma. Ipilimumab, the first ICI for treatment of advanced melanoma, was introduced to the US market in 2011. Since then, 2 additional ICIs (pembrolizumab and nivolumab) have been approved by the US Food and Drug Administration as a first-line treatment for advanced melanoma.
Randomized clinical trials (RCTs) have demonstrated superior survival rates associated with the ICIs compared with the historically used chemotherapy drugs among patients with advanced melanoma (eg, 3-year survival rate: 20.8% vs 12.2%).3,4,5,6 Despite the improved survival benefit associated with ICIs, concerns of immune-related adverse events (irAEs) associated with ICI regimens are growing because of their pharmacological mechanisms.7 By blocking the pathways that regulate the immune system, ICIs can increase the immune system’s activity, causing organ inflammation and thus increasing the risk of irAEs.8 ICI-associated irAEs can potentially involve multiple organs or systems, including the skin (eg, rash, pruritus), gastrointestinal tract (eg, diarrhea, colitis), endocrine (eg, hypothyroidism, hypophysitis), liver (eg, hepatitis), and lung (eg, pneumonitis).3,4,5,6,9,10,11,12,13,14 In the published RCTs, the occurrence of any irAEs varied from 54% to 96% among patients with advanced melanoma receiving ICIs.4,5,6,9,10,11,12,13,14 Without proper management, irAEs can be severe and life-threatening and may result in treatment discontinuation or failure.
Previous studies, including 1 network meta-analysis and 6 traditional meta-analyses, have examined the risks of irAEs associated with ICI therapy, but these studies mainly focused on patients with all types of cancer.15,16,17,18,19,20,21 In addition, these studies did not explicitly examine the risk of irAEs across different ICI regimens, which may vary by type of cancer. Little is known about how the risk of irAEs differs across ICI regimens among patients with advanced melanoma. Given the lack of head-to-head RCTs that directly compare different ICI regimens for advanced melanoma, we conducted a network meta-analysis. We combined direct and indirect evidence for pairwise comparisons of ICI regimens to assess the risks of irAEs in patients with advanced melanoma.
Methods
Data Sources and Searches
We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline (eFigure 1 in the Supplement).22 Given that the first RCT using ICI for advanced melanoma was published in 2010, we systematically searched PubMed/MEDLINE, Embase, Web of Science, and Scopus for all RCT articles published from January 1, 2010, through June 30, 2019. The search strategy used a combination of terms, including controlled vocabulary (eg, MeSH [Medical Subject Headings] and Emtree) and text words developed in consultation with a pharmacy liaison research librarian (eTable 1 in the Supplement).
Study Selection and Data Extraction
We identified RCTs (phases 2 and 3) that compared an ICI (ipilimumab, pembrolizumab, or nivolumab) or a combination therapy of 2 ICIs with (1) a chemotherapy drug (dacarbazine, carboplatin, or paclitaxel), (2) a different ICI, or (3) different doses of 1 of the ICIs for patients with advanced melanoma. All of the ICI treatment regimens reported in the RCTs were included to capture the potential treatment regimens used in clinical practice. Advanced melanoma was defined as stage III or IV melanoma or as surgically unresectable, with the cancer cells spread from the epidermis to the dermis of the skin or to distant organ sites.23
We excluded non–English-language articles, case reports, reviews, meta-analyses, editorials, commentary letters, conference proceedings, and extension analyses of previously published RCTs (eFigure 1 in the Supplement). After a comprehensive literature search and removal of duplicates, we (C.Y.C., C.Y.W.) independently reviewed the titles and abstracts of the articles and further screened their full text against our inclusion and exclusion eligibility criteria. We extracted the study information and details using a standardized spreadsheet (Microsoft Excel; Microsoft Corp). We resolved disagreements during the study selection and data extraction processes by consensus and consultation with a third reviewer (W.H.L.C.).
We extracted the following information for each eligible article: (1) study details (ie, year of publication, author names, country, and follow-up duration), (2) baseline characteristics of participants (eg, sex, age), and (3) interventions and outcomes (ie, population size of each group, treatment dose, and type and number of irAEs).
Quality and Risk-of-Bias Assessment
Two of us (C.Y.C., C.Y.W.) independently evaluated the included studies for potential biases (eg, selection and performance bias) using the Cochrane Collaboration’s risk-of-bias assessment tool.24 Bias assessment was generated by Review Manager 5.3 (Cochrane Collaboration). We assessed publication bias using asymmetric distributions from the funnel plots when 4 or more studies for each comparison were available. Asymmetry of funnel plots visually indicates potential publication bias.25
Outcome Measures
The primary outcomes included the cumulative incidence of any irAEs (severity grades 1-5) and severe irAEs (severity grades 3-5).7 Grades 1 and 2 referred to mild-to-moderate AEs, grade 3 indicated severe but not immediately life-threatening AEs, grade 4 indicated life-threatening AEs, and grade 5 indicated death-related events.26 We defined irAEs according to how each RCT reported its treatment-related AEs or irAEs. Treatment-related AEs and irAEs were highly associated with the trial’s intervention treatment.
The secondary outcomes included organ-specific irAEs and outcomes by AE severity. Dermatologic irAEs included pruritus, rash, and vitiligo. Gastrointestinal irAEs included diarrhea and colitis. Endocrine irAEs included hypothyroidism and hypophysis functioning. Hepatic irAEs included increased alanine aminotransferase level, increased aspartate aminotransferase level, and hepatitis. Pulmonary irAEs included pneumonitis.
Data Synthesis and Statistical Analysis
We generated network plots depicting head-to-head comparisons between different treatment regimens using Stata, version 13.0 (StataCorp LLC). In a bayesian network meta-analysis, we simultaneously compared all treatment regimens for advanced melanoma using a Markov chain Monte Carlo simulation technique in WinBUGS, version 1.4 statistical software (MRC Biostatistics Unit). We applied noninformative previous distribution and random-effects generalized linear models with a logit link function, running 10 000 iterations in each of the 4 chains. We used pooled odds ratios (ORs) with 95% credible intervals (CrIs, the bayesian equivalent of CIs) to estimate the risk of irAEs across different treatment regimens. We generated forest plots using R, version 3.5.1 (R Project for Statistical Computing).
For the primary outcomes, we ranked the probability of a treatment regimen to be the best (ie, to be associated with the lowest risk of irAEs) by estimating the median (95% CrI) of the posterior distribution for the rank of each treatment regimen. The treatment ranked first was the best treatment regimen (ie, associated with the lowest risk of irAE). In each Markov chain Monte Carlo cycle, every treatment regimen was ranked according to the estimated OR. The probability of a certain treatment ranking as the best among all treatment regimens was estimated from the proportion of the cycles in which a given regimen was rated as first of the total Markov cycles.27
For the secondary outcomes, we conducted pairwise comparisons of ICI regimens to compare the associated risks or likelihood of irAEs. A statistically significant (P ≤ .05; 2-sided) OR of less than 1 suggested a lower associated risk for the reference treatment regimen compared with the comparison regimen, whereas a significant OR of greater than 1 suggested a greater associated risk for the reference regimen compared with the comparison regimen.
To ensure the robustness of the findings, we conducted a sensitivity analysis using the node-splitting method to evaluate the consistency between direct and indirect evidence to test for any violation of assumptions in the network analysis.28,29 Direct evidence was the effect estimated directly from 1 head-to-head RCT. Indirect evidence was the effect derived from the comparison of 2 separate head-to-head RCTs. We obtained posterior means (SDs) of the log ORs from direct and indirect evidence for the treatment comparison, and then we compared the inconsistency between direct and indirect effects (direct effect minus indirect effect) for each treatment comparison in R, version 3.5.1 (package: R2WinBUGS), and WinBUGS 1.4.28 If the P value measuring the agreement between direct and indirect evidence for each treatment comparison was significant (P < .05; 2-sided), then inconsistency was present between direct and indirect evidence, which indicated a violation of the network analysis assumption.
Results
Study and Patient Characteristics
The initial literature search yielded 4458 records, of which 2497 (56.0%) remained after removal of the duplicates. Screening of the titles and abstracts resulted in the exclusion of articles that were not RCTs (n = 1240); did not compare an ICI with a chemotherapy drug, another ICI, or a different dose of the same ICI regimen (n = 114); did not include patients with advanced melanoma (n = 1007); did not include an outcome of interest (n = 109); or were extension analyses of the included RCTs (n = 18). The network meta-analyses included 9 RCTs with 8 different treatment regimens for advanced melanoma4,5,6,9,10,11,12,13,14 (Figure; eFigure 1 in the Supplement).
As shown in eTable 2 and eTable 3 in the Supplement, 8 RCTs were multinational studies,4,5,6,9,10,12,13,14 and 1 did not report the country of the study.11 Among 21 treatment regimens, 18 (85.7%) were ICIs (ie, ipilimumab, nivolumab, and pembrolizumab) with a median follow-up duration ranging from 5 to 38 months, and 3 (14.3%) were chemotherapy drugs (ie, carboplatin, dacarbazine, and/or paclitaxel) with a median follow-up duration of 5 to 28 months. Of the total 5051 participants, 2046 (40.5%) were women. The median patient age ranged from 55 to 67 years for those treated with ICI regimens (n = 4513) and from 62 to 66 years for those treated with chemotherapy drugs (n = 538).
Risk-of-Bias Assessment and Publication Bias
The overall risk of bias was low for the 9 included RCTs4,5,6,9,10,11,12,13,14 (eFigure 2 in the Supplement). Four RCTs (44.4%) had high or unclear risk of performance and detection bias because of the lack of blinding of participants, personnel, and/or outcome assessment.4,6,11,13 Publication bias could not be assessed for any of the outcomes of interest because fewer than 4 studies were available for each treatment comparison.
Primary Outcomes: Ranking the Probability of Treatment Regimen to Be the Best
Overall, nivolumab, 3 mg/kg, by intravenous (IV) infusion every 2 weeks, pembrolizumab, 2 mg/kg, by IV infusion every 3 weeks, and pembrolizumab, 10 mg/kg, by IV infusion every 3 weeks were the 3 ICI treatment regimens most likely to rank as the best owing to being associated with the lowest risk of any or severe irAEs (Table 1; eTable 4 in the Supplement). Compared with 10 mg/kg of ipilimumab by IV infusion every 3 weeks, only 3 mg/kg of nivolumab every 2 weeks (OR, 0.34; 95% CrI, 0.13-0.94) was associated with a decreased risk of any irAEs (Table 2). In terms of the risk of severe irAEs (Table 3), compared with 10 mg/kg of ipilimumab every 3 weeks, a decreased risk was associated with ipilimumab, 3 mg/kg, by IV infusion every 3 weeks (OR, 0.35; 95% CrI, 0.14-0.74) followed by pembrolizumab, 10 mg/kg, by IV infusion every 2 weeks (OR, 0.22; 95% CrI, 0.05-0.95), nivolumab, 3 mg/kg, every 2 weeks (OR, 0.20; 95% CrI, 0.07-0.48), and pembrolizumab, 10 mg/kg, every 3 weeks (OR, 0.20; 95% CrI, 0.06-0.68).
Table 1. Ranking of the Probability of Being the Best Treatment Regimena.
Treatment regimen | Median rank (95% CrI)b |
---|---|
Pembrolizumab, 2 mg/kg, every 3 wk | 1 (1-7) |
Nivolumab, 3 mg/kg, every 2 wk | 2 (1-6) |
Pembrolizumab, 10 mg/kg, every 3 wk | 3 (1-7) |
Ipilimumab, 3 mg/kg, every 3 wk | 4 (1-6) |
Chemotherapyc | 5 (2-7) |
Pembrolizumab, 10 mg/kg, every 2 wk | 6 (1-8) |
Nivolumab, 1 mg/kg, every 3 wk and ipilimumab, 3 mg/kg, every 3 wk | 7 (2-8) |
Ipilimumab, 10 mg/kg, every 3 wk | 7 (4-8) |
Abbreviation: CrI, credible interval.
We ranked this probability by estimating the median (95% CrIs) of the posterior distribution for the rank of each treatment regimen. Some median ranks across different treatment regimens were the same because rank was an integer. The best treatment regimen was the one with the lowest risk of any immune-related adverse event.
Median rank refers to the median and the 95% CrI refers to the 95% CrI of the posterior distribution for the rank of each treatment regimen.
Immune-related adverse events were the outcomes associated with immune checkpoint inhibitors, not chemotherapy drugs (ie, carboplatin, dacarbazine, and paclitaxel). For patients receiving chemotherapy, the adverse events identified were associated with chemotherapy.
Table 2. Risk of Any Immune-Related Adverse Events Associated With Each Treatment Regimena.
Treatment regimen | Odds ratio (95% CrI) | |||||||
---|---|---|---|---|---|---|---|---|
Chemotherapyb | Ipilimumab | Pembrolizumab, 10 mg/kg, every 2wk | Nivolumab, 1 mg/kg, every 3 wk + ipilimumab 3 mg/kg every 3 wk | Nivolumab, 3 mg/kg, every 2 wk | Pembrolizumab | |||
3 mg/kg every 3wk | 10 mg/kg every 3wk | 10 mg/kg every 3 wk | 2 mg/kg every 3wk | |||||
Chemotherapyb | NA | 1.13 (0.37-3.26) | 0.50 (0.15-1.72) | 0.79 (0.14-4.19) | 0.79 (0.14-4.19) | 1.44 (0.63-3.4) | 1.21 (0.41-3.49) | 1.74 (0.48-6.67) |
Ipilimumab | ||||||||
3 mg/kg every 3 wk | 0.88 (0.30-2.70) | NA | 0.44 (0.2-1.04) | 0.71 (0.19-2.59) | 0.71 (0.19-2.59) | 1.29 (0.54-3.27) | 1.08 (0.38-3.14) | 1.55 (0.31-8.7) |
10 mg/kg every 3wk | 2.00 (0.58-6.45) | 2.27 (0.94-4.96) | NA | 1.60 (0.33-7.09) | 1.60 (0.33-7.09) | 2.91 (1.09-7.55)c | 2.44 (0.68-8.36) | 3.51 (0.62-20.48) |
Pembrolizumab, 10 mg/kg, every 2 wk | 1.25 (0.23-6.81) | 1.42 (0.37-5.31) | 0.62 (0.14-3.07) | NA | 0.60 (0.13-3.67) | 1.83 (0.39-9.23) | 1.52 (0.29-7.99) | 2.19 (0.28-18.94) |
Nivolumab | ||||||||
1 mg/kg every 3 wk and ipilimumab, 3 mg/kg, every 3 wk | 2.05 (0.38-8.26) | 2.31 (0.70-6.04) | 1.02 (0.25-3.61) | 1.66 (0.26-7.75) | NA | 3.05 (0.7-10.59) | 2.55 (0.51-9.88) | 3.67 (0.46-23.96) |
3 mg/kg every 2 wk | 0.69 (0.29-1.60) | 0.78 (0.30-1.90) | 0.34 (0.13-0.94)c | 0.55 (0.11-2.67) | 0.33 (0.09-1.57) | NA | 0.84 (0.27-2.55) | 1.20 (0.27-5.83) |
Pembrolizumab | ||||||||
10 mg/kg every 3 wk | 0.82 (0.28-2.44) | 0.93 (0.32-2.67) | 0.41 (0.12-1.50) | 0.66 (0.12-3.56) | 0.40 (0.10-2.08) | 1.19 (0.38-3.81) | NA | 1.44 (0.29-7.89) |
2 mg/kg every 3 wk | 0.58 (0.14-2.16) | 0.65 (0.11-3.43) | 0.29 (0.05-1.70) | 0.46 (0.05-3.84) | 0.28 (0.04-2.30) | 0.84 (0.17-3.88) | 0.70 (0.13-3.79) | NA |
Abbreviations: CrI, credible interval; NA, not applicable.
The pooled odds ratios (95% CrIs) were the result of comparing the left-column treatment regimens with the top-row treatment regimens (the reference group).
Immune-related adverse events were the outcomes associated with immune checkpoint inhibitors, not chemotherapy drugs (ie, carboplatin, dacarbazine, and paclitaxel). For chemotherapy users, the adverse events identified were associated with chemotherapy. The pooled odds ratios were estimated from all direct and indirect comparisons.
Statistically significant.
Table 3. Risk of Severe Immune-Related Adverse Events Associated With Each Treatment Regimena.
Treatment regimen | Odds ratio (95% CrI) | |||||||
---|---|---|---|---|---|---|---|---|
Chemotherapyb | Ipilimumab | Pembrolizumab, 10 mg/kg, every 2 wk | Nivolumab, 1 mg/kg, every 3wk + ipilimumab, 3 mg/kg, every 3 wk | Nivolumab, 3 mg/kg, every 2 wk | Pembrolizumab | |||
3 mg/kg every 3 wk | 10 mg/kg every 3 wk | 10 mg/kg every 3 wk | 2 mg/kg every 3 wk | |||||
Chemotherapyb | NA | 1.34 (0.48-4.04) | 0.47 (0.14-1.50) | 2.12 (0.43-11.28) | 0.33 (0.08-1.30) | 2.35 (1.04-5.56)c | 2.31 (0.82-6.84) | 2.42 (0.65-8.57) |
Ipilimumab | ||||||||
3 mg/kg every 3 wk | 0.75 (0.25-2.08) | NA | 0.35 (0.14-0.74)c | 1.57 (0.45-5.71) | 0.24 (0.09-0.58)c | 1.75 (0.73-4.13) | 1.72 (0.59-4.87) | 1.82 (0.33-9.13) |
10 mg/kg every 3 wk | 2.13 (0.67-7.13) | 2.86 (1.35-6.95)c | NA | 4.48 (1.06-22.02)c | 0.70 (0.21-2.41) | 4.96 (2.09-13.53)c | 4.90 (1.48-18.14)c | 5.21 (0.93-28.90) |
Pembrolizumab, 10 mg/kg, every 2 wk | 0.47 (0.09-2.31) | 0.64 (0.18-2.24) | 0.22 (0.05-0.95)c | NA | 0.16 (0.03-0.70)c | 1.12 (0.24-5.06) | 1.10 (0.21-5.48) | 1.15 (0.14-8.61) |
Nivolumab | ||||||||
1 mg/kg every 3 wk and ipilimumab, 3 mg/kg, every 3 wk | 3.03 (0.77-12.79) | 4.09 (1.73-10.99)c | 1.43 (0.42-4.87) | 6.37 (1.43-34.00)c | NA | 7.12 (2.19-26.51)c | 6.97 (1.82-30.15)c | 7.40 (1.12-49.29)c |
3 mg/kg every 2 wk | 0.43 (0.18-0.96)c | 0.57 (0.24-1.37) | 0.20 (0.07-0.48)c | 0.90 (0.20-4.24) | 0.14 (0.04-0.46)c | NA | 0.98 (0.32-3.01) | 1.04 (0.21-4.54) |
Pembrolizumab | ||||||||
10 mg/kg every 3 wk | 0.43 (0.15-1.22) | 0.58 (0.21-1.69) | 0.20 (0.06-0.68)c | 0.91 (0.18-4.81) | 0.14 (0.03-0.55)c | 1.02 (0.33-3.16) | NA | 1.05 (0.2-5.12) |
2 mg/kg every 3 wk | 0.41 (0.12-1.53) | 0.55 (0.11-3.07) | 0.19 (0.03-1.08) | 0.87 (0.12-7.19) | 0.14 (0.02-0.89)c | 0.97 (0.22-4.66) | 0.95 (0.20-5.04) | NA |
Abbreviations: CrI, credible interval; NA, not applicable.
The pooled odds ratios (95% CrIs) were the result of comparing the left-column treatment regimens with the top-row treatment regimens (the reference group).
Immune-related adverse events were the outcomes associated with immune checkpoint inhibitors, not chemotherapy drugs (ie, carboplatin, dacarbazine, and paclitaxel). For chemotherapy users, the adverse events identified were associated with chemotherapy. The pooled odds ratios were estimated from all direct and indirect comparisons.
Statistically significant.
As shown in Table 3, compared with 1 mg/kg of nivolumab by IV infusion every 3 weeks combined with 3 mg/kg of ipilimumab every 3 weeks, a decreased risk of severe irAEs was associated with ipilimumab, 3 mg/kg, every 3 weeks (OR, 0.24; 95% CrI, 0.09-0.58), pembrolizumab, 10 mg/kg, every 2 weeks (OR, 0.16; 95% CrI, 0.03-0.70), nivolumab, 3 mg/kg, every 2 weeks (OR, 0.14; 95% CrI, 0.04-0.46), pembrolizumab, 10 mg/kg, every 3 weeks (OR, 0.14; 95% CrI, 0.03-0.55), and pembrolizumab, 2 mg/kg, every 3 weeks (OR, 0.14; 95% CrI, 0.02-0.89). Of the ICI regimens, only nivolumab, 3 mg/kg, every 2 weeks (OR, 0.43; 95% CrI, 0.18-0.96) was associated with a lower risk of severe irAEs compared with chemotherapy drugs.
Secondary Outcomes: Ranking the Probability of Treatment Regimen to Be the Best
The ranking probability of an ICI treatment regimen having the lowest risk varied by organ system and by AE severity. The statistically significant secondary outcomes are described herein.
For dermatologic irAEs, among the ICI regimens, nivolumab, 3 mg/kg, every 2 weeks had the lowest risk of any pruritus (median rank, 2; 95% CrI, 2-6) and any rash (median rank, 4; 95% CrI, 2-8) (Table 4) and was associated with the second lowest risk of severe pruritus and severe rash among the ICI regimens (median rank, 3; 95% CrI, 1-6) (eTable 5 and eTable 6 in the Supplement). In addition, an associated lower risk of severe rash (OR, 0.06; 95% CrI, 0.004-0.49) was observed for nivolumab, 3 mg/kg, every 2 weeks compared with the ICI combination of nivolumab, 1 mg/kg, every 3 weeks and ipilimumab, 3 mg/kg, every 3 weeks (eTable 6 in the Supplement). Except for pembrolizumab, 10 mg/kg, every 2 weeks, the ICI regimens were associated with a higher risk of any pruritus compared with chemotherapy drugs (range of all ICI ORs = 3.15-6.88) (eTable 6 in the Supplement).
Table 4. Ranking of the Probability of Being the Best Treatment Regimen, by System or Organ Immune-Related Adverse Eventsa.
System or Organ Immune-Related Adverse Event | Treatment regimen, median rank (95% CrI)b | |||||||
---|---|---|---|---|---|---|---|---|
Chemotherapyc | Ipilimumab | Pembrolizumab, 10 mg/kg, every 2 wk | Nivolumab, 1 mg/kg, every 3 wk and ipilimumab, 3 mg/kg, every 3 wk | Nivolumab, 3 mg/kg, every 2 wk | Pembrolizumab | |||
3 mg/kg every 3 wk | 10 mg/kg every 3 wk | 10 mg/kg every 3 wk | 2 mg/kg every 3 wk | |||||
Dermatologic irAEs | ||||||||
Pruritus | 1 (1-2) | 5 (3-8) | 6 (2-8) | 5 (1-8) | 6 (2-8) | 2 (2-6) | 6 (2-8) | 6 (2-8) |
Rash | 1 (1-3) | 6 (3-7) | 4 (2-8) | 6 (1-8) | 8 (2-8) | 4 (2-8) | 4 (2-8) | 4 (1-8) |
Vitiligo | 1 (1-4) | 3 (1-6) | 3 (1-8) | 7 (2-8) | 4 (1-8) | 5 (2-8) | 7 (3-8) | 6 (1-8) |
Gastrointestinal irAEs | ||||||||
Diarrhea | 2 (1-5) | 6 (4-7) | 7 (5-8) | 5 (1-7) | 8 (6-8) | 2 (1-5) | 4 (1-6) | 3 (1-7) |
Colitis | 1 (1-6) | 6 (4-7) | 5 (3-7) | 3 (1-6) | 7 (4-7) | 2 (1-6) | 4 (1-7) | NAd |
Endocrine irAEs | ||||||||
Hypothyroidism | 1 (1-3) | 2 (1-5) | 3 (2-7) | 7 (3-8) | 5 (2-8) | 4 (2-8) | 7 (3-8) | 7 (2-8) |
Hypophysis | NAd | 4 (3-6) | 4 (2-6) | 2 (1-5) | 6 (3-6) | 2 (1-4) | 3 (1-6) | NAd |
Liver irAEs | ||||||||
Increased ALT level | 1 (1-4) | 2 (1-3) | 4 (3-5) | NAd | 5 (2-5) | 3 (1-4) | NAd | NAd |
Increased AST level | 1 (1-4) | 2 (1-3) | 4 (3-5) | NAd | 4 (2-5) | 3 (1-4) | NAd | NAd |
Hepatitis | NAd | 2 (1-4) | 4 (1-4) | 2 (1-4) | NAd | NAd | 3 (1-4) | NAd |
Pulmonary irAEs | ||||||||
Pneumonitis | 1 (1-6) | 3 (1-5) | 7 (2-7) | 3 (1-7) | 5 (2-7) | 3 (1-6) | 6 (2-7) | NAd |
Abbreviations: ALT, alanine aminotransferase; AST, aspartate aminotransferase; CrI, credible interval; irAE, immune-related adverse event; NA, not applicable.
We ranked this probability by estimating the median (95% CrIs) of the posterior distribution for the rank of each treatment regimen. Some median ranks across different treatment regimens were the same because rank was an integer. The best treatment regimen was the one with the lowest risk of any irAE.
Median rank refers to the median and the 95% CrI refers to the 95% CrI of the posterior distribution for the rank of each treatment regimen.
Immune-related AEs were the outcomes associated with immune checkpoint inhibitors, not chemotherapy drugs (ie, carboplatin, dacarbazine, and paclitaxel). For chemotherapy users, the adverse events identified were associated with chemotherapy.
No specific individual irAE was reported in that treatment regimen in the included studies, so the indirect evidence could not be generated. For example, pneumonitis was not reported in any included studies comparing pembrolizumab, 2 mg/kg, every 3 weeks with other treatments, so the indirect evidence of pneumonitis from pembrolizumab, 2 mg/kg, every 3 weeks could not be generated by linking that regimen with other treatments.
For gastrointestinal irAEs, the ICI regimen with the lowest risk of any diarrhea, any colitis (Table 4), and severe colitis (eTable 5 in the Supplement) was nivolumab, 3 mg/kg, every 2 weeks. In addition, nivolumab, 3 mg/kg, every 2 weeks was associated with the lowest risk of any diarrhea compared with ipilimumab, 3 mg/kg, every 3 weeks (OR, 0.48; 95% CrI, 0.30-0.78), ipilimumab, 10 mg/kg, every 3 weeks (OR, 0.39; 95% CrI, 0.23-0.61), and nivolumab, 1 mg/kg, every 3 weeks combined with ipilimumab, 3 mg/kg, every 3 weeks (OR, 0.30; 95% CrI, 0.15-0.58) (eTable 7 in the Supplement). Compared with chemotherapy drugs, nivolumab, 1 mg/kg, every 3 weeks combined with ipilimumab, 3 mg/kg, every 3 weeks (OR, 3.27; 95% CrI, 1.46-7.22) and the monotherapy drugs ipilimumab, 10 mg/kg, every 3 weeks (OR, 2.49; 95% CrI, 1.29-4.94) and ipilimumab, 3 mg/kg, every 3 weeks (OR, 2.02; 95% CrI, 1.05-3.71) (eTable 7 in the Supplement) were associated with a higher risk of any diarrhea.
For endocrine irAEs, ipilimumab, 3 mg/kg, every 3 weeks was associated with the lowest risk for any hypothyroidism (median rank, 2; 95% CrI, 1-5), and nivolumab, 3 mg/kg, every 2 weeks was associated with the lowest risk for any hypophysis (median rank, 2; 95% CrI, 1-4) (Table 4; eTable 8 in the Supplement). Moreover, of the ICI regimens, nivolumab, 3 mg/kg, every 2 weeks was associated with the lowest risk of severe hypothyroidism (median rank, 3; 95% CrI, 1-7) and severe hypophysis (median rank, 2; 95% CrI, 1-5) (eTable 5 in the Supplement).
For hepatic irAEs, ipilimumab, 3 mg/kg, every 3 weeks was associated with the lowest risk among the ICI regimens (Table 4; eTable 5 in the Supplement). Compared with ipilimumab, 3 mg/kg, every 3 weeks, ipilimumab, 10 mg/kg, every 3 weeks was associated with a higher risk of any increase in alanine aminotransferase level (OR, 4.79; 95% CrI, 1.02-28.17) and any increase in aspartate aminotransferase level (OR, 5.28; 95% CrI, 1.21-33.28). Compared with ipilimumab, 3 mg/kg, every 3 weeks, 1 mg/kg of nivolumab every 3 weeks combined with 3 mg/kg of ipilimumab every 3 weeks was associated with a higher risk of any increase (OR, 5.62; 95% CrI, 1.19-21.46) or severe increase (OR, 7.15; 95% CrI, 1.57-47.37) in alanine aminotransferase level and with any increase (OR, 5.12; 95% CrI, 1.21-19.11) or severe increase (OR, 10.42; 95% CrI, 1.72-92.95) in aspartate aminotransferase level (eTable 9 in the Supplement).
For pulmonary irAEs, 10 mg/kg of pembrolizumab every 2 weeks was associated with the lowest risk among the ICI regimens for any risk (median rank, 3; 95% CrI, 1-7) or severe risk (median rank, 2; 95% CrI, 1-7) of pneumonitis (Table 4; eTable 5 and eTable 10 in the Supplement).
Sensitivity Analysis: Consistency Between Direct and Indirect Evidence
No significant inconsistency was observed between direct and indirect studies (eTable 11 and eTable 12 in the Supplement). However, the consistency analysis was not applicable when no direct head-to-head study evidence was available for a specific treatment regimen.
Discussion
The network analysis yielded 3 important findings regarding ICI use and risk of irAEs among patients with advanced melanoma. First, the 3 ICI regimens associated with the lowest risk of (and thus with the best safety profiles for) any or severe irAEs were nivolumab, 3 mg/kg, every 2 weeks, pembrolizumab, 2 mg/kg, every 3 weeks, and pembrolizumab, 10 mg/kg, every 3 weeks. In contrast, ipilimumab, 10 mg/kg, every 3 weeks alone and nivolumab, 1 mg/kg, every 3 weeks combined with ipilimumab, 3 mg/kg, every 3 weeks were associated with higher risks compared with the other ICI regimens. Second, within the various organ systems and AE severities, different ICI regimens were ranked as being associated with the lowest risk of irAEs. Nivolumab, 3 mg/kg, every 2 weeks was associated with a lower risk of dermatologic, gastrointestinal, and endocrine irAEs (regardless of AE severity) compared with other ICI regimens. Ipilimumab, 3 mg/kg, every 3 weeks was associated with a lower risk of any or severe liver irAEs, and pembrolizumab, 10 mg/kg, every 2 weeks was associated with a lower risk of any or severe pulmonary irAEs. Third, ICI regimens were associated with a higher risk of any pruritus and diarrhea compared with traditional chemotherapy regimens.
These findings were generally consistent with the results from 3 previous studies in terms of nivolumab and pembrolizumab being the ICIs with the best safety profile for irAEs.15,16,21 In addition, chemotherapy had the third best safety profile for any AEs, although it was ranked as having the best or second-best safety profiles for AEs within the various organ systems and AE severities. The distribution of any AEs and organ-specific AEs across different treatment regimens may explain this discrepancy. More patients receiving chemotherapy than those receiving ICI therapy experienced a treatment-related AE within an organ system, but they typically only had 1 AE. In contrast, patients receiving ICI therapy who had an irAE often had more than 1 AE. Therefore, the number of patients receiving chemotherapy who experienced any AEs was larger than the number of those receiving ICI therapy who experienced any irAEs.
The present study thoroughly compared different ICI dose regimens and examined their irAE risk. Still, the results of this study differed from previous findings in several aspects. For instance, previous studies provided limited evidence on the variation of risks of different doses of pembrolizumab.15,16,21 In the present study, pembrolizumab, 2 mg/kg, every 3 weeks and 10 mg/kg every 3 weeks had better safety profiles for irAEs compared with pembrolizumab, 10 mg/kg, every 2 weeks. Moreover, a previous network analysis ranked chemotherapy drugs as being associated with a lower risk of irAEs compared with ipilimumab.15 We found ipilimumab, 3 mg/kg, every 3 weeks to be associated with a lower risk of any or severe irAEs than chemotherapy drugs, but we found ipilimumab, 10 mg/kg, every 3 weeks to be associated with a higher risk compared with chemotherapy drugs. The ipilimumab regimen of 10 mg/kg every 3 weeks was used less often for advanced melanoma in the current clinical practice.30
Past studies focused on examining individual irAEs by severity among patients with all types of cancer.15,16,21 Unlike studies15 that included ICIs that were not approved for melanoma, the present study ranked the treatment options approved by the Food and Drug Administration for melanoma only. This distinction is important because the rankings of the treatment options for advanced melanoma were different from those of other cancers in previous studies. For example, Xu et al15 showed that atezolizumab was the best ICI with the lowest risk of irAEs among patients with all types of cancer. However, atezolizumab was not approved by the Food and Drug Administration as a treatment option for advanced melanoma.
The presentations of irAEs are immune-mediated damages of normal tissue in various organ systems. Possible explanations for the differences in the risk of irAEs may be the different mechanisms of action of each medication and the combined use of ICIs.31 Ipilimumab is a cytotoxic T-lymphocyte–associated protein 4 inhibitor that enhances T-cell priming. Pembrolizumab and nivolumab are PD-1 (programmed cell death 1) inhibitors that reinvigorate preexisting T-cell responses.32 It is possible that irAEs might be more predominant through priming than through reinvigorating T-cell response. Moreover, it is common to observe more AEs when drugs with different mechanisms are combined. Illustrating this point in this study, nivolumab, 1 mg/kg, every 3 weeks combined with ipilimumab, 3 mg/kg, every 3 weeks had the highest risk of severe irAEs compared with the independent use of ipilimumab, pembrolizumab, or nivolumab.
Although ICIs have become the first-line treatment options for advanced melanoma in accordance with the current National Comprehensive Cancer Network guidelines,33 clinicians must tailor treatment regimens to maximize the treatment advantages while reducing any AEs associated with treatment discontinuation or failure. In a network meta-analysis that included 12 RCTs focusing on all types of cancers, the combination of 2 ICI regimens or the use of nivolumab or pembrolizumab alone compared with ipilimumab was associated with a statistically significant survival advantage.34 These advantages must be considered along with the risks. For instance, the present study found that the combination of 2 ICI regimens was associated with a higher risk of irAEs compared with other ICI regimens alone. These findings provide additional evidence and insights for better clinical practice guidance on ICI use in terms of irAEs, especially in patients at high risk.35,36 Specifically, for individuals with preexisting autoimmune diseases, initiating ICI regimens with a lower risk of any or severe irAEs is recommended to avoid irAEs. Also critical is regularly monitoring patients with advanced melanoma (eg, testing aspartate aminotransferase or alanine aminotransferase level every week) and then adjusting doses if needed.7
To our knowledge, this study was the first network meta-analysis that thoroughly examined the risk of irAEs by different ICI regimens for advanced melanoma. It also examined individual irAEs by organ and AE severity.
Limitations
This study has several limitations. First, the RCTs used different terms to describe irAEs. We reviewed the grading system and terminology used in reporting irAEs and found them to be consistent and compatible. In addition, awareness and reporting of irAEs may have increased over time as the number of patients receiving ICI therapy increased. Second, the wide CrIs of the risk measures in this study could be attributed to the small number of studies, small sample sizes in some studies, and different methods and reporting standards for ICI-related AEs. We were not able to examine consistency between direct and indirect evidence using the node-splitting method when no direct head-to-head studies were available. Similarly, we were not able to examine publication bias because fewer than 4 studies for each treatment comparison were available. However, we included the findings from all of the registered RCTs evaluating ICI use in patients with advanced melanoma during the study period.
Third, 5 of the 9 RCTs did not report follow-up duration for each treatment regimen,3,4,5,6,12 so the results were reported as cumulative incidence. However, we did not observe a higher risk of any irAEs in the studies with longer follow-up durations. The findings were unlikely to be confounded by the follow-up duration. Fourth, this network analysis compared irAEs across ICI regimens. We did not compare individual ICIs with individual chemotherapy drugs because of the limited sample sizes. Fifth, our ability to report the ranking of a treatment regimen’s probability to have the lowest risk of each irAE was limited by the specific irAEs reported in the RCTs. Thus, we could not evaluate and rank some treatment options, and the CrIs for some treatment options were wide because of the small number of studies available for ranking.
Conclusions
Nivolumab, 3 mg/kg, every 2 weeks as well as pembrolizumab, 2 mg/kg, every 3 weeks and 10 mg/kg every 3 weeks may be the preferred ICI regimens for advanced melanoma given that they are associated with a low risk of irAEs. This finding may be especially important for individuals with autoimmune diseases or those who use immunosuppressants. Ipilimumab, 10 mg/kg, every 3 weeks alone and nivolumab, 1 mg/kg, every 3 weeks combined with ipilimumab, 3 mg/kg, every 3 weeks should be used with caution and close monitoring. A network analysis of different treatment regimens may be valuable for clinical decision-making in the absence of evidence from RCTs.
References
- 1.National Cancer Institute SEER Program. Cancer stat facts: melanoma of the skin. Accessed May 1, 2019. https://seer.cancer.gov/statfacts/html/melan.html
- 2.Hall CS, Ross M, Bowman Bauldry JB, et al. . Circulating tumor cells in stage IV melanoma patients. J Am Coll Surg. 2018;227(1):-. doi: 10.1016/j.jamcollsurg.2018.04.026 [DOI] [PubMed] [Google Scholar]
- 3.Robert C, Thomas L, Bondarenko I, et al. . Ipilimumab plus dacarbazine for previously untreated metastatic melanoma. N Engl J Med. 2011;364(26):2517-2526. doi: 10.1056/NEJMoa1104621 [DOI] [PubMed] [Google Scholar]
- 4.Hamid O, Puzanov I, Dummer R, et al. . Final analysis of a randomised trial comparing pembrolizumab versus investigator-choice chemotherapy for ipilimumab-refractory advanced melanoma. Eur J Cancer. 2017;86:37-45. doi: 10.1016/j.ejca.2017.07.022 [DOI] [PubMed] [Google Scholar]
- 5.Robert C, Long GV, Brady B, et al. . Nivolumab in previously untreated melanoma without BRAF mutation. N Engl J Med. 2015;372(4):320-330. doi: 10.1056/NEJMoa1412082 [DOI] [PubMed] [Google Scholar]
- 6.Weber JS, D’Angelo SP, Minor D, et al. . Nivolumab versus chemotherapy in patients with advanced melanoma who progressed after anti-CTLA-4 treatment (CheckMate 037): a randomised, controlled, open-label, phase 3 trial. Lancet Oncol. 2015;16(4):375-384. doi: 10.1016/S1470-2045(15)70076-8 [DOI] [PubMed] [Google Scholar]
- 7.Brahmer JR, Lacchetti C, Schneider BJ, et al. ; National Comprehensive Cancer Network . Management of immune-related adverse events in patients treated with immune checkpoint inhibitor therapy: American Society of Clinical Oncology Clinical Practice Guideline. J Clin Oncol. 2018;36(17):1714-1768. doi: 10.1200/JCO.2017.77.6385 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Postow MA, Sidlow R, Hellmann MD. Immune-related adverse events associated with immune checkpoint blockade. N Engl J Med. 2018;378(2):158-168. doi: 10.1056/NEJMra1703481 [DOI] [PubMed] [Google Scholar]
- 9.Ascierto PA, Del Vecchio M, Robert C, et al. . Ipilimumab 10 mg/kg versus ipilimumab 3 mg/kg in patients with unresectable or metastatic melanoma: a randomised, double-blind, multicentre, phase 3 trial. Lancet Oncol. 2017;18(5):611-622. doi: 10.1016/S1470-2045(17)30231-0 [DOI] [PubMed] [Google Scholar]
- 10.Hodi FS, Chesney J, Pavlick AC, et al. . Combined nivolumab and ipilimumab versus ipilimumab alone in patients with advanced melanoma: 2-year overall survival outcomes in a multicentre, randomised, controlled, phase 2 trial. Lancet Oncol. 2016;17(11):1558-1568. doi: 10.1016/S1470-2045(16)30366-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Robert C, Schachter J, Long GV, et al. ; KEYNOTE-006 Investigators . Pembrolizumab versus ipilimumab in advanced melanoma. N Engl J Med. 2015;372(26):2521-2532. doi: 10.1056/NEJMoa1503093 [DOI] [PubMed] [Google Scholar]
- 12.Weber J, Mandala M, Del Vecchio M, et al. ; CheckMate 238 Collaborators . Adjuvant nivolumab versus ipilimumab in resected stage III or IV melanoma. N Engl J Med. 2017;377(19):1824-1835. doi: 10.1056/NEJMoa1709030 [DOI] [PubMed] [Google Scholar]
- 13.Wolchok JD, Chiarion-Sileni V, Gonzalez R, et al. . Overall survival with combined nivolumab and ipilimumab in advanced melanoma. N Engl J Med. 2017;377(14):1345-1356. doi: 10.1056/NEJMoa1709684 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Wolchok JD, Neyns B, Linette G, et al. . Ipilimumab monotherapy in patients with pretreated advanced melanoma: a randomised, double-blind, multicentre, phase 2, dose-ranging study. Lancet Oncol. 2010;11(2):155-164. doi: 10.1016/S1470-2045(09)70334-1 [DOI] [PubMed] [Google Scholar]
- 15.Xu C, Chen YP, Du XJ, et al. . Comparative safety of immune checkpoint inhibitors in cancer: systematic review and network meta-analysis. BMJ. 2018;363:k4226. doi: 10.1136/bmj.k4226 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Wang Y, Zhou S, Yang F, et al. . Treatment-related adverse events of PD-1 and PD-L1 inhibitors in clinical trials: a systematic review and meta-analysis. JAMA Oncol. 2019;5(7):1008-1019. doi: 10.1001/jamaoncol.2019.0393 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Abdel-Rahman O, ElHalawani H, Fouad M. Risk of endocrine complications in cancer patients treated with immune check point inhibitors: a meta-analysis. Future Oncol. 2016;12(3):413-425. doi: 10.2217/fon.15.222 [DOI] [PubMed] [Google Scholar]
- 18.Abdel-Rahman O, ElHalawani H, Fouad M. Risk of cutaneous toxicities in patients with solid tumors treated with immune checkpoint inhibitors: a meta-analysis. Future Oncol. 2015;11(17):2471-2484. doi: 10.2217/fon.15.118 [DOI] [PubMed] [Google Scholar]
- 19.Abdel-Rahman O, ElHalawani H, Fouad M. Risk of elevated transaminases in cancer patients treated with immune checkpoint inhibitors: a meta-analysis. Expert Opin Drug Saf. 2015;14(10):1507-1518. doi: 10.1517/14740338.2015.1085969 [DOI] [PubMed] [Google Scholar]
- 20.Abdel-Rahman O, ElHalawani H, Fouad M. Risk of gastrointestinal complications in cancer patients treated with immune checkpoint inhibitors: a meta-analysis. Immunotherapy. 2015;7(11):1213-1227. doi: 10.2217/imt.15.87 [DOI] [PubMed] [Google Scholar]
- 21.Abdel-Rahman O, Fouad M. Risk of pneumonitis in cancer patients treated with immune checkpoint inhibitors: a meta-analysis. Ther Adv Respir Dis. 2016;10(3):183-193. doi: 10.1177/1753465816636557 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Hutton B, Salanti G, Caldwell DM, et al. . The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162(11):777-784. doi: 10.7326/M14-2385 [DOI] [PubMed] [Google Scholar]
- 23.National Cancer Institute. Melanoma treatment (PDQ®)—patient version. Updated May 21, 2019. Accessed July 12, 2019. https://www.cancer.gov/types/skin/patient/melanoma-treatment-pdq
- 24.Higgins JP, Altman DG, Gøtzsche PC, et al. ; Cochrane Bias Methods Group; Cochrane Statistical Methods Group . The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. doi: 10.1136/bmj.d5928 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Sterne JA, Sutton AJ, Ioannidis JP, et al. . Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002. doi: 10.1136/bmj.d4002 [DOI] [PubMed] [Google Scholar]
- 26.National Cancer Institute Common Terminology Criteria for Adverse Events (CTCAE) v5.0. Updated May 27, 2017. Accessed July 12, 2019. https://ctep.cancer.gov/protocolDevelopment/electronic_applications/ctc.htm#ctc_50
- 27.Salanti G, Ades AE, Ioannidis JP. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2011;64(2):163-171. doi: 10.1016/j.jclinepi.2010.03.016 [DOI] [PubMed] [Google Scholar]
- 28.Dias S, Welton NJ, Caldwell DM, Ades AE. Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010;29(7-8):932-944. doi: 10.1002/sim.3767 [DOI] [PubMed] [Google Scholar]
- 29.Jackson D, Barrett JK, Rice S, White IR, Higgins JP. A design-by-treatment interaction model for network meta-analysis with random inconsistency effects. Stat Med. 2014;33(21):3639-3654. doi: 10.1002/sim.6188 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Tarhini AA, Lee SJ, Hodi FS, et al. . A phase III randomized study of adjuvant ipilimumab (3 or 10 mg/kg) versus high-dose interferon alfa-2b for resected high-risk melanoma (US Intergroup E1609): preliminary safety and efficacy of the ipilimumab arms. J Clin Oncol. 2017;35(15_suppl):9500-9500. doi: 10.1200/JCO.2017.35.15_suppl.9500 [DOI] [Google Scholar]
- 31.Khan Z, Hammer C, Guardino E, Chandler GS, Albert ML. Mechanisms of immune-related adverse events associated with immune checkpoint blockade: using germline genetics to develop a personalized approach. Genome Med. 2019;11(1):39. doi: 10.1186/s13073-019-0652-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Chen DS, Mellman I. Elements of cancer immunity and the cancer-immune set point. Nature. 2017;541(7637):321-330. doi: 10.1038/nature21349 [DOI] [PubMed] [Google Scholar]
- 33.National Comprehensive Cancer Network Cutaneous melanoma (version 2.2019). Updated March 12, 2019. Accessed March 20, 2019. https://www.nccn.org/professionals/physician_gls/pdf/cutaneous_melanoma.pdf
- 34.Pasquali S, Chiarion-Sileni V, Rossi CR, Mocellin S. Immune checkpoint inhibitors and targeted therapies for metastatic melanoma: a network meta-analysis. Cancer Treat Rev. 2017;54:34-42. doi: 10.1016/j.ctrv.2017.01.006 [DOI] [PubMed] [Google Scholar]
- 35.Johnson DB, Sullivan RJ, Ott PA, et al. . Ipilimumab therapy in patients with advanced melanoma and preexisting autoimmune disorders. JAMA Oncol. 2016;2(2):234-240. doi: 10.1001/jamaoncol.2015.4368 [DOI] [PubMed] [Google Scholar]
- 36.Menzies AM, Johnson DB, Ramanujam S, et al. . Anti-PD-1 therapy in patients with advanced melanoma and preexisting autoimmune disorders or major toxicity with ipilimumab. Ann Oncol. 2017;28(2):368-376. doi: 10.1093/annonc/mdw443 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.