Abstract
Recent studies suggest that combining nivolumab with ipilimumab is a more effective treatment for melanoma patients, compared to using ipilimumab or nivolumab alone. However, treatment with these immunotherapeutic agents is frequently associated with increased risk of toxicity, and (auto-) immune-related adverse events. The precise pathophysiologic mechanisms of these events are not yet clear, and evidence from clinical trials and translational studies remains limited. Our retrospective analysis of ~7700 metastatic melanoma patients treated with ipilimumab and/or nivolumab from the FDA Adverse Event Reporting System (FAERS) demonstrates that the identified immune-related reactions are specific to ipilimumab and/or nivolumab, and that when the two agents are administered together, their safety profile combines reactions from each drug alone. While more prospective studies are needed to characterize the safety of ipilimumab and nivolumab, the present work constitutes perhaps the first effort to examine the safety of these drugs and their combination based on computational evidence from real world post marketing data.
Keywords: side effects, ipilimumab, nivolumab, melanoma, real world data, data mining, pharmacoepidemiology, proportional reporting ratio
1. Introduction
The introduction of immune-checkpoint inhibitors in recent years constitutes a major breakthrough in the treatment of advanced melanoma. With this approach, specific immune checkpoints are blocked, such as the cytotoxic T lymphocyte antigen-4 (CTLA-4) and the programmed cell death protein-1 (PD-1), enhancing thus antitumor immunity. Three checkpoint inhibitors have been associated with objective responses in metastasized melanoma and have been approved by the US Food and Drug Administration (FDA): ipilimumab, nivolumab and pembrolizumab [1,2,3,4,5,6]. Ipilimumab targets CTLA-4, while nivolumab and pembrolizumab target PD-1 (Supplementary Material S1, Figure S1).
Although these single-agent treatment strategies have a proven efficacy in advanced melanoma, not all patients benefit from them. Moreover, tumor control on a long-term basis remains a big challenge of immunotherapy. In this context, combinational treatment represents a reasonable approach for enhancing antitumor activity. In particular, the combination of concurrent PD-1 and CTLA-4 blockade holds considerable promise, since PD-1 contributes to T-cell exhaustion primarily in peripheral tissues and within the tumor microenvironment, and CTLA-4 inhibits at earlier point in T-cell activation [7,8]. In other words, PD-1 and CTLA-4 blockade act in distinct positions within the T-cell response pathway and complement, rather than overlap one another. Nivolumab with ipilimumab has been the first combination treatment to demonstrate a long-term benefit in advanced untreated melanoma: in a phase III trial (CheckMate 067) involving 945 patients with previously untreated, unresectable stage III or IV melanoma, the median progression free survival for the combination treatment nivolumab plus ipilimumab was 11.5 months, as compared to 2.9 months with ipilimumab and 6.9 months with nivolumab [9]. Recently, an updated analysis of the trial was published according to which the overall survival (OS) rate at three years was 58% in the nivolumab plus ipilimumab group, 52% in the nivolumab group, and 34% in the ipilimumab group [10]. These results indicate that nivolumab combined with ipilimumab is superior to ipilimumab and likely also nivolumab alone.
Yet, the increased immune activity triggered by immunotherapeutic agents is associated with inflammatory side-effects, commonly addressed as immune-related adverse events (irAEs). The precise pathophysiologic mechanism of these, sometimes severe, adverse events (AEs) is not yet clear and no prospective studies on their successful management have been published. Although potentially all organs may be affected, irAEs usually occur in the gastrointestinal tract, endocrine glands, skin and liver, while the pulmonary, musculoskeletal, and central nervous systems are less often involved [11]. Reasonably, more concerns regarding toxic effects rise when two immunotherapeutic agents are combined. Specifically, 55% of the CheckMate 067 trial’s patients demonstrated grade 3 or 4 AEs when nivolumab and ipilimumab were used together, in comparison to 16.3% and 27.3% of the nivolumab and ipilimumab monotherapy groups, respectively [9]. The safety profile was similar also in the updated survival analysis of the trial with grade 3 or 4 treatment-related AEs occurring in 59% of the patients in the nivolumab plus ipilimumab group, in 21% of those in the nivolumab group, and in 28% of those in the ipilimumab group [10].
2. Materials and Methods
To examine the side-effect profiles of ipilimumab, nivolumab, and their combination in metastatic melanoma patients, we analyzed serious AEs from the FDA’s Adverse Event Reporting System (FAERS).
2.1. The Adverse Event Data Set
We performed our analysis over the publicly available FAERS data set (incl. 2017Q2) that contained 9.5 million reports for 7.9 million cases. FAERS information used in this analysis included patients’ treatments (medications), indications (disease or condition), as well as reported adverse reactions and observed outcomes (e.g., “death” or “hospitalization”).
2.2. FAERS Data Integration
FAERS data regarding treatments, indications, and adverse reactions were consolidated in the following way:
FAERS medication synonyms (coded in free-text names) were mapped to drugs and compounds from DrugBank [12] and PubChem [13].
Drugs were further categorized according to the Anatomical Therapeutic Chemical (ATC) classification system.
Indications and reactions (coded by FAERS in terms from the MedDRA dictionary) were contextualized further by using the full hierarchical structure of the ontology.
2.3. Statistical Characterization of the Adverse Event Data
For the statistical characterization of the observed associations between the reported in FAERS drugs, reactions, and outcomes, we employed the proportional reporting ratio (PRR), an established metric of disproportionality in pharmacovigilance. PRR gives an indication for the relative congruence of pairwise entity relations as based on their co-occurrence in subsets of AE data [14]. For a drug (D) and an event (E) the PRR metric is defined to be the value of a(c+d)/c(a+b), based on the following contingency matrix (1).
AE cases | Event (E) | Not E | Totals |
Drug (D) | a | B | a + b |
Not D | c | D | c + d |
Totals | a + c | b + d | N = a + b + c + d |
An event E may represent the occurrence of AE reaction(s) or of patient outcome(s). While PRR has become a standard metric for the evaluation of safety signals, we also considered relevant statistical significance be reflected by Fisher’s exact test p-values (two-tailed).
2.4. Experiments: Definition of Cohorts
To examine drug-reaction occurrences, we defined patient cohorts as collections of AE cases that contained each drug in the context of metastatic melanoma. The identified cohorts were then examined with respect to reported drugs, indications, reactions, and outcomes. Results per cohort are described in terms of observed case counts (i.e., number of AEs a certain occurrence was observed in), percentage of cohort cases, and the PRR disproportionality score. Metastatic melanoma cases were defined to be those cases for which there was an indication reported that linked under the MedDRA hierarchy to the term ‘Skin melanomas (excluding ocular)’, such as ‘MALIGNANT MELANOMA’, ‘METASTATIC MALIGNANT MELANOMA’, or ‘MALIGNANT MELANOMA STAGE IV’. Specifically, eight metastatic melanoma cohorts were defined (Figure 1):
#1) Ipilimumab: cases that had ipilimumab reported as medication. This set of 6413 AEs was used to profile co-morbidities and co-medications of ipilimumab, as reported in FAERS.
#2) Nivolumab: cases that had nivolumab reported as medication. This set of 2943 AEs was used to profile co-morbidities and co-medications of Nivolumab, as reported in FAERS.
#3) Ipilimumab and Nivolumab (together): cases that had both ipilimumab and nivolumab reported as medications. This set of 1574 AEs was used to cross-validate the combination’s side-effect profile when used together with other drugs.
#4) Ipilimumab without Nivolumab: cases that had ipilimumab reported as medication but not nivolumab. This set of 4839 AEs was used to cross-validate the ipilimumab side-effect profile when used together with other drugs, but not with Nivolumab.
#5) Nivolumab without Ipilimumab: cases that had nivolumab reported as medication but not ipilimumab. This set of 1369 AEs was used to cross-validate the nivolumab side-effect profile when used together with other drugs, but not with ipilimumab.
#6) Ipilimumab (only): cases that had only ipilimumab reported as medication, and no other drugs. This set of 2704 AEs was used to identify the ipilimumab side-effects.
#7) Nivolumab (only): cases that had only nivolumab reported as medication, and no other drugs. This set of 890 AEs was used to identify the nivolumab side-effects.
#8) Ipilimumab and Nivolumab (only): cases that had both ipilimumab and nivolumab reported as medications, and no other drugs. This set of 682 AEs was used to identify the combination’s side-effect profile.
To systemize the statistical characterization, each cohort’s AEs (noted as ‘D’ in contingency matrix 1) were compared against the remaining FAERS (noted as ‘Not D’) during the calculation of PRR signals and for Fisher’s exact test.
2.5. Analysis of Outcomes
To compare the occurrence of outcomes ‘death’ and ‘hospitalization’ in the presence and absence of selected reactions in each cohort, we employed an enrichment approach [15,16] without multiple test correction and with PRR as ‘enhancement factor’, based on the following contingency matrix (2).
Cohort’s AEs | Outcome (O) | Not O | Totals |
Reaction (R) | A | b | a + b |
Not R | C | d | c + d |
Totals | a + c | b + d | N = a + b + c + d |
2.6. Patient Case Examples
For data-supportive and illustrative reasons, the database of the Clinical Cooperation Unit Nuclear Medicine of the German Cancer Research Center (DKFZ) was searched for examples of melanoma patients undergoing immunotherapy with radiologic signs indicative of irAEs. No further analysis regarding these data was performed in the present study.
3. Results
Before starting the analysis we wanted to verify that the identified patient cohorts reflected properly the use of ipilimumab, nivolumab, and their combination in the clinical practice of metastatic melanoma. Indeed, cohort AE timelines revealed reduction of ipilimumab monotherapy use over time, as opposed to the gradual increase of nivolumab use and of the ipilimumab plus nivolumab combination (Figure 2). We also examined co-morbidities (indications of co-medications) mentioned in cohorts #1–#5. The highest occurrence of the top most-mentioned (non-metastatic melanoma) indication was observed in cohort #3 (namely, ‘pain’ in 3.2% of ipilimumab plus nivolumab cases). The defined cohorts were specific to melanoma patients undergoing ipilimumab and/or nivolumab treatment, since mentioned co-administered medications (such as analgesics, antipyretics, corticosteroids, non-steroid anti-inflammatory dugs, antidiarrheals, anti-infective agents) did not exhibit antineoplastic activity, but were rather applied to alleviate symptoms or coexisting conditions.
3.1. Side Effect Profiling
Then occurrence of reactions in each cohort was examined (Supplementary Material S2). Table 1 summarizes the twenty most frequently reported reactions in the patient cohorts that received only ipilimumab, nivolumab, and their combination, and no other drugs (cohorts #6–#8). Reactions involved both general symptoms (such as ‘fever’, ‘fatigue’), and more specific organ- or system-related (dermatologic, pulmonary, hepatic, renal, gastrointestinal) conditions, sometimes with frequency >3%.
Table 1.
Cohort | Ipilimumab and Nivolumab (#8) | Ipilimumab (#6) | Nivolumab (#7) | ||||||
---|---|---|---|---|---|---|---|---|---|
Order | Name | AEs | % | Name | AEs | % | Name | AEs | % |
1 | Diarrhoea | 67 | 9.9 | Diarrhoea | 388 | 14.3 | Hypothyroidism | 42 | 4.7 |
2 | Colitis | 65 | 9.5 | Colitis | 299 | 11.1 | Diarrhoea | 38 | 4.3 |
3 | Pyrexia | 48 | 7.0 | Rash | 176 | 6.5 | Pruritus | 29 | 3.3 |
4 | Rash | 38 | 5.6 | Fatigue | 139 | 5.1 | Alanine aminotransferase increased | 21 | 2.4 |
5 | Hypophysitis | 24 | 3.5 | Hypophysitis | 125 | 4.6 | Decreased appetite | 21 | 2.4 |
6 | Pneumonitis | 21 | 3.1 | Pyrexia | 107 | 3.9 | Aspartate aminotransferase increased | 20 | 2.2 |
7 | Hyperthyroidism | 20 | 2.9 | Vomiting | 99 | 3.7 | Colitis | 18 | 2.0 |
8 | Hypothyroidism | 20 | 2.9 | Pruritus | 79 | 2.9 | Gamma-glutamyltransferase increased | 17 | 1.9 |
9 | Pruritus | 19 | 2.8 | Dehydration | 78 | 2.9 | Pneumonitis | 16 | 1.8 |
10 | Hepatitis | 18 | 2.6 | Decreased appetite | 74 | 2.7 | Hepatic function abnormal | 15 | 1.7 |
11 | Pneumonia | 18 | 2.6 | Abdominal pain | 67 | 2.5 | Interstitial lung disease | 15 | 1.7 |
12 | General physical health deterioration | 17 | 2.5 | Enterocolitis | 56 | 2.1 | Leukoderma | 15 | 1.7 |
13 | Abdominal pain | 16 | 2.3 | Weight decreased | 53 | 2.0 | Blood alkaline phosphatase increased | 14 | 1.6 |
14 | Alanine aminotransferase increased | 14 | 2.1 | Anaemia | 46 | 1.7 | Acute kidney injury | 11 | 1.2 |
15 | Dehydration | 14 | 2.1 | Adrenal insufficiency | 42 | 1.6 | Lung disorder | 11 | 1.2 |
16 | Aspartate aminotransferase increased | 11 | 1.6 | Sepsis | 38 | 1.4 | Sepsis | 11 | 1.2 |
17 | Liver disorder (not further clarified) | 11 | 1.6 | Hepatitis | 36 | 1.3 | Infusion related reaction | 10 | 1.1 |
18 | Myocarditis | 11 | 1.6 | Hyponatraemia | 35 | 1.3 | Renal impairment | 10 | 1.1 |
19 | Sepsis | 11 | 1.6 | Intestinal perforation | 35 | 1.3 | Uveitis | 10 | 1.1 |
20 | Type 1 diabetes mellitus | 11 | 1.6 | Hypothyroidism | 34 | 1.3 | Adrenal insufficiency|liver disorder|diabetic ketoacidosis | 9 | 1.0 |
Total | 591 reactions | 682 | - | 1130 reactions | 2704 | - | 675 reactions | 890 | - |
To compensate for the reporting in FAERS of different terms that may refer to similar conditions (e.g., ‘renal failure’, ‘renal failure acute’, ‘renal impairment’), we examined reaction occurrence also at High-Level Terms (HLT) of the MedDRA hierarchy. This allowed us to filter some reactions based on their signals: e.g., ‘Asthenic conditions’, the more general category of ‘Fatigue’, was found not to be statistically significant, while some other general reaction categories were found to have high PRR signals despite their small occurrence. Supplementary Material S1’s Table S1 summarizes the examined HLT categories, mentioning also most representative reactions from each class.
Using this approach we derived side-effect profiles for ipilimumab, nivolumab, and their combination:
#6: Ipilimumab (only): diarrhoea (14.35%); colitis (11.06%); rash (6.51%); hypophysitis (4.62%); pyrexia (3.96%); pruritus (2.92%); dehydration (2.89%); decreased appetite (2.74%); anaemia (1.70%); adrenal insufficiency (1.55%); sepsis (1.41%); hepatitis (1.33%); intestinal perforation (1.29%); hyponatraemia (1.29%); hypothyroidism (1.26%); pneumonitis (1.22%); renal failure acute (1.11%).
#7: Nivolumab (only): hypothyroidism (4.72%); diarrhoea (4.27%); pruritus (3.26%); decreased appetite (2.36%); colitis (2.02%); pneumonitis (1.79%); hepatic function abnormal (1.69%); leukoderma (1.69%); pituitary analyses anterior (1.35%); muscle infections and inflammations (1.35%); sepsis (1.24%); acute kidney injury (1.24%); infusion related reaction (1.12%); uveitis (1.12%); adrenal insufficiency (1.01%); liver disorder (1.01%).
#8: Ipilimumab and Nivolumab (only): diarrhoea (9.82%); colitis (9.53%); pyrexia (7.04%); rash (5.57%); hypophysitis (3.52%); pneumonitis (3.08%); hyperthyroidism (2.93%); hypothyroidism (2.93%); pruritus (2.79%); hepatitis (2.64%); pneumonia (2.64%); dehydration (2.05%) type 1 diabetes mellitus (1.61%); liver disorder (1.61%); myocarditis (1.61%); sepsis (1.61%); adrenal insufficiency (1.47%); acute kidney injury (1.47%); pituitary analyses anterior (1.32%); arthritis (1.32%); hepatic function abnormal (1.17%).
The results suggest that the identified irAEs are specific for these drugs (Figure 3). This is supported, first, by the fact that the patients of these cohorts were not co-administered any additional medications. Then, the overall occurrence of some reactions in FAERS was at times small, but very specific to the examined cohorts (e.g., ‘Hypophysitis’ or ‘Leukoderma’). Furthermore, the reaction profiles of ipilimumab, nivolumab, and their combination when co-medicated with other drugs (cohorts #3–#5; Supplementary Material S1, Table S2) were similar to those of the more specific groups (cohorts #6–#8).
Altogether, ipilimumab had more reported side-effects than nivolumab (1130 and 675 reactions in cohorts #6 and #7, respectively), whereas their combination involved effects from both profiles (591 reactions in cohort #8)—sometimes with increased PRR signal, compared to single drug administration of either nivolumab or ipilimumab (e.g., ‘hepatitis’ or ‘pneumonitis’).
3.2. Outcome Analysis
Next, it was investigated whether specific side-effect manifestation might potentially be associated with the outcome of patients. Results were somewhat inconclusive when reactions were examined individually in each cohort (Supplementary Material S2). However, when examined together (all the reactions of each respective side-effect profile), we found that death occurrence was reduced and, in comparison, hospitalizations were increased in all cohorts (Supplementary Material S1, Figure S2).
4. Discussion
In an attempt to investigate the side-effect profiles of ipilimumab, nivolumab, and their combination therapy, we examined respective reaction occurrence in AEs from public FAERS. FAERS contains valuable information for a large amount of patients (7.9 million cases) coming from healthcare professionals, consumers, and manufacturers. Our results are based on real world events and provide additional insight to previous safety profiling efforts of those drugs—and their combination—that were based on clinical trials and translational studies.
In the context of our work, public FAERS was used for hypothesis generation only. Although FAERS data and generated signals are used regularly to evaluate safety concerns by the FDA, identified relationships should be investigated further. We make available our results and provide observed data for future reference, but these should not be interpreted as calculated incidences of events based on AE data, since this is not the intended use of FAERS. Reasons for that include, firstly, the practical inability for follow-up or on-site verification of the truth of reported AE information. Moreover, the existence of a plausible causal connection between drug exposure and an AE cannot be always proven, since reports do not always contain enough detail to properly evaluate an event. Furthermore, the FDA does not receive reports for every AE. Finally, absolute and relative frequencies or risk of AEs cannot be determined from FAERS alone unless drug exposure or appropriate control group data are available. Therefore, we only report on AE occurrence and study identified signals that indicate relationships without inferring causality only by looking at these data.
Despite the above-mentioned shortcomings, one key advantage of FAERS is the ability to examine cases from significantly more patients than in other studies. Importantly, in our work we also corrected for limitations possibly introduced from confounded cases and possible miscoding.
The main contribution of the presented results is that they not only recapitulate but also add real world evidence to the existing safety profiles of these agents. Compared to label notes, clinical trial results and other studies [9,17,18], FAERS content captured occurrence of irAEs better than that of general symptoms (such as diarrhea or fatigue), indicating a possible reporting bias for the latter—perhaps not reported as often in these FAERS cohorts. Put together, we found that ipilimumab has a higher number of reported AEs than nivolumab and the combination regimen. This could be attributed to the earlier FDA approval of ipilimumab and, therefore, its longer usage, which may also explain the reporting of a broader reaction variety in FAERS. Also, the therapeutic usage of the newer agent nivolumab, or of the emerging ipilimumab plus nivolumab combination, is much more recent, therefore collecting additional post-market pharmacovigilance data may be required to follow-up our analysis.
One other limitation of the present study is that while FAERS contains serious AEs, the severity of each reported reaction is not specifically graded. Moreover, during the analysis of outcomes we could not compensate for the lack of information regarding treatment durations or the exact disease stage of patients. Given the limitations of the dataset we could not establish specific relations between the manifestation of individual reactions and an overall improved condition, other than the general observation that reduced death occurrence was simultaneously accompanied by an increase of hospitalizations in all cohorts when the reactions of each safety profile were examined together. While an association between the occurrence of irAEs and the efficacy of the immune checkpoint blockade has been suggested before [19,20,21], a recent retrospective study on ipilimumab showed that neither OS nor time to treatment failure were affected by the occurrence of irAEs or the need for systemic corticosteroid use [22].
Interestingly, our results suggest that the co-administration of ipilimumab and nivolumab leads to a toxicological profile that combines side-effects of both agents. When compared with results from the phase 3 CheckMate 067 study [9] and its 3-year OS analysis [10], our findings confirm the high occurrence of gastrointestinal (diarrhea, colitis), skin-related (pruritus, rash) and pyrexia events. Endocrine AEs, which are particularly significant because they may require long-term hormone therapy, were also reported, with hypophysitis (most likely attributed to the impact of ipilimumab [23]) and thyroid dysfunction (frequent among patients receiving anti-PD-1 therapy [11]) being the most common.
The specificity of certain irAEs to those immunotherapeutic agents revealed by our study, translates also into potentially significant clinical implications for the management of patients treated with ipilimumab and/or nivolumab. While the biological mechanisms underlying irAEs are still to be elucidated, their potential pathophysiologic basis involves two main courses of evidence. First, checkpoint inhibitors play key role in autoimmune conditions and secondly, tumor neoantigens and antigens from healthy tissue could cross-react (Supplementary Material S1, Figure S1) [24,25]. Importantly, irAEs are very often associated with radiologic manifestations, despite sometimes being clinically silent (Supplementary Material S1, Figure S3).
Recently, a study based on pooled trial data from the European Medicines Agency of 1551 patents with advanced melanoma demonstrated that irAEs occur more frequently for the ipilimumab plus nivolumab combination, with a shorter time-to-onset, and tend to be more severe [26]. The study provides also clinical recommendations that may render such events reversible and highlights the significance of early diagnosis and of the good communication and close cooperation of an interdisciplinary network required for more successful irAE evaluation.
5. Conclusions
Recent evidence suggests combining ipilimumab and nivolumab for improved clinical efficacy in metastatic melanoma patients. The enhanced immune activity triggered by these agents is frequently associated with increased toxicity risk, with irAEs being the main manifestation. Our present study describes safety profiles of ipilimumab and/or nivolumab from the retrospective analysis of AEs, based on computational evidence from real world post marketing data.
Our results suggest that the co-administration of ipilimumab and nivolumab leads to a toxicological profile that combines side-effects of both agents. These findings confirm high occurrence of gastrointestinal (diarrhea, colitis), skin-related (pruritus, rash) and pyrexia events. Endocrine AEs were also reported, with hypophysitis and thyroid dysfunction being the most common. Last, in this dataset ipilimumab had a higher number of reported AEs than nivolumab and the combination regimen.
The present study also highlights that computational analysis of real world data can translate into clinical insight for more informed patient management. We therefore invite for more computational approaches that strive to efficiently support the gain of clinical insight directly from the analysis of real world data and hope that our findings will provide additional context and scope to the efforts to interpret the impact and results of many currently active or recruiting clinical trials that study the ipilimumab plus nivolumab combination.
Supplementary Materials
The following are available online at http://www.mdpi.com/2075-4418/8/4/76/s1, Supplement Material S1: Support figures and tables. Supplement Material S2: Reaction statistics and outcome analysis.
Author Contributions
T.G.S. designed research and analyzed data; T.G.S. and C.S. conceived original idea, performed research, and wrote manuscript; L.L. helped with Supplementary Figure S1; J.C.H. and A.D.-S. helped with writing review and editing.
Funding
This research received no funding.
Conflicts of Interest
T.G.S. is employee of Molecular Health GmbH and holder of patents related to the analysis of adverse event data.
References
- 1.Hodi F.S., O’day S.J., McDermott D.F., Weber R.W., Sosman J.A., Haanen J.B., Gonzalez R., Robert C., Schadendorf D., Hassel J.C., et al. Improved survival with ipilimumab in patients with metastatic melanoma. N. Engl. J. Med. 2010;363:711–723. doi: 10.1056/NEJMoa1003466. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Robert C., Thomas L., Bondarenko I., O’day S., Weber J., Garbe C., Lebbe C., Baurain J.-F., Testori A., Grob J.-J., et al. Ipilimumab plus dacarbazine for previously untreated metastatic melanoma. N. Engl. J. Med. 2011;364:2517–2526. doi: 10.1056/NEJMoa1104621. [DOI] [PubMed] [Google Scholar]
- 3.Schadendorf D., Hodi F.S., Robert C., Weber J.S., Margolin K., Hamid O., Patt D., Chen T.T., Berman D.M., Wolchok J.D. Pooled Analysis of Long-Term Survival Data from Phase II and Phase III Trials of Ipilimumab in Unresectable or Metastatic Melanoma. J. Clin. Oncol. 2015;33:1889–1894. doi: 10.1200/JCO.2014.56.2736. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Robert C., Long G.V., Brady B., Dutriaux C., Maio M., Mortier L., Hassel J.C., Rutkowski P., McNeil C., Kalinka-Warzocha E., et al. Nivolumab in previously untreated melanoma without BRAF mutation. N. Engl. J. Med. 2015;372:320–330. doi: 10.1056/NEJMoa1412082. [DOI] [PubMed] [Google Scholar]
- 5.Larkin J., Minor D., D’Angelo S., Neyns B., Smylie M., Miller W., Gutzmer R., Linette G., Chmielowski B., Lao C.D., et al. Overall Survival in Patients with Advanced Melanoma Who Received Nivolumab Versus Investigator’s Choice Chemotherapy in CheckMate 037: A Randomized, Controlled, Open-Label Phase III Trial. J. Clin. Oncol. 2018;36:383–390. doi: 10.1200/JCO.2016.71.8023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Schachter J., Ribas A., Long G.V., Arance A., Grob J.J., Mortier L., Daud A., Carlino M.S., McNeil C., Lotem M., et al. Pembrolizumab versus ipilimumab for advanced melanoma: Final overall survival results of a multicentre, randomised, open-label phase 3 study (KEYNOTE-006) Lancet. 2017;390:1853–1862. doi: 10.1016/S0140-6736(17)31601-X. [DOI] [PubMed] [Google Scholar]
- 7.Wolchok J.D., Kluger H., Callahan M.K., Postow M.A., Rizvi N.A., Lesokhin A.M., Segal N.H., Ariyan C.E., Gordon R.-N., Reed K., et al. Nivolumab plus ipilimumab in advanced melanoma. N. Engl. J. Med. 2013;369:122–133. doi: 10.1056/NEJMoa1302369. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Warner A.B., Postow M.A. Combination Controversies: Checkpoint Inhibition Alone or in Combination for the Treatment of Melanoma? Oncology. 2018;32:228–234. [PubMed] [Google Scholar]
- 9.Larkin J., Chiarion-Sileni V., Gonzalez R., Grob J.J., Cowey C.L., Lao C.D., Schadendorf D., Dummer R., Smylie M., Rutkowski P., et al. Combined Nivolumab and Ipilimumab or Monotherapy in Untreated Melanoma. N. Engl. J. Med. 2015;373:23–34. doi: 10.1056/NEJMoa1504030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Wolchok J.D., Chiarion-Sileni V., Gonzalez R., Rutkowski P., Grob J.J., Cowey C.L., Lao C.D., Wagstaff J., Schadendorf D., Ferrucci P.F., et al. Overall Survival with Combined Nivolumab and Ipilimumab in Advanced Melanoma. N. Engl. J. Med. 2017;377:1345–1356. doi: 10.1056/NEJMoa1709684. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Postow M.A., Sidlow R., Hellmann M.D. Immune-Related Adverse Events Associated with Immune Checkpoint Blockade. N. Engl. J. Med. 2018;378:158–168. doi: 10.1056/NEJMra1703481. [DOI] [PubMed] [Google Scholar]
- 12.Wishart D.S., Feunang Y.D., Guo A.C., Lo E.J., Marcu A., Grant J.R., Sajed T., Johnson D., Li C., Sayeeda Z., et al. DrugBank 5.0: A major update to the DrugBank database for 2018. Nucleic Acids Res. 2018;46:D1074–D1082. doi: 10.1093/nar/gkx1037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Kim S., Thiessen P.A., Bolton E.E., Chen J., Fu G., Gindulyte A., Han L., He J., He S., Shoemaker B.A., et al. PubChem Substance and Compound databases. Nucleic Acids Res. 2016;44:D1202–D1213. doi: 10.1093/nar/gkv951. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Van Puijenbroek E.P., Bate A., Leufkens H.G., Lindquist M., Orre R., Egberts A.C. A comparison of measures of disproportionality for signal detection in spontaneous reporting systems for adverse drug reactions. Pharmacoepidemiol. Drug Saf. 2002;11:3–10. doi: 10.1002/pds.668. [DOI] [PubMed] [Google Scholar]
- 15.Soldatos T.G., O’Donoghue S.I., Satagopam V.P., Jensen L.J., Brown N.P., Barbosa-Silva A., Schneider R. Martini: Using literature keywords to compare gene sets. Nucleic Acids Res. 2010;38:26–38. doi: 10.1093/nar/gkp876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Soldatos T.G., Perdigão N., Brown N.P., Sabir K.S., O’Donoghue S.I. How to learn about gene function: Text-mining or ontologies? Methods. 2015;74:3–15. doi: 10.1016/j.ymeth.2014.07.004. [DOI] [PubMed] [Google Scholar]
- 17.Postow M.A., Bate A., Leufkens H.G., Lindquist M., Orre R., Egberts A.C. Nivolumab and ipilimumab versus ipilimumab in untreated melanoma. N. Engl. J. Med. 2015;372:2006–2017. doi: 10.1056/NEJMoa1414428. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Antonia S.J., López-Martin J.A., Bendell J., Ott P.A., Taylor M., Eder J.P., Jäger D., Pietanza C., Le D.T., Braud F., et al. Nivolumab alone and nivolumab plus ipilimumab in recurrent small-cell lung cancer (CheckMate 032): A multicentre, open-label, phase 1/2 trial. Lancet Oncol. 2016;17:883–895. doi: 10.1016/S1470-2045(16)30098-5. [DOI] [PubMed] [Google Scholar]
- 19.Attia P., Phan G.Q., Maker A.V., Robinson M.R., Quezado M.M., Yang J.C., Sherry R.M., Topalian S.L., Kammula U.S., Royal R.E., et al. Autoimmunity correlates with tumor regression in patients with metastatic melanoma treated with anti-cytotoxic T-lymphocyte antigen-4. J. Clin. Oncol. 2005;23:6043–6053. doi: 10.1200/JCO.2005.06.205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Downey S.G., Klapper J.A., Smith F.O., Yang J.C., Sherry R.M., Royal R.E., Kammula U.S., Hughes M.S., Allen T.E., Levy C.L., et al. Prognostic factors related to clinical response in patients with metastatic melanoma treated by CTL-associated antigen-4 blockade. Clin. Cancer Res. 2007;13:6681–6688. doi: 10.1158/1078-0432.CCR-07-0187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Assi H., Wilson K.S. Immune toxicities and long remission duration after ipilimumab therapy for metastatic melanoma: Two illustrative cases. Curr. Oncol. 2013;20:e165–e169. doi: 10.3747/co.20.1265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Horvat T.Z., Adel N.G., Dang T.O., Momtaz P., Postow M.A., Callahan M.K., Carvajal R.D., Dickson M.A., D’Angelo S.P., Woo K.M., et al. Immune-Related Adverse Events, Need for Systemic Immunosuppression, and Effects on Survival and Time to Treatment Failure in Patients with Melanoma Treated with Ipilimumab at Memorial Sloan Kettering Cancer Center. J. Clin. Oncol. 2015;33:3193–3198. doi: 10.1200/JCO.2015.60.8448. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Caturegli P., Di Dalmazi G., Lombardi M., Grosso F., Larman H.B., Larman T., Taverna G., Cosottini M., Lupi I. Hypophysitis Secondary to Cytotoxic T-Lymphocyte-Associated Protein 4 Blockade: Insights into Pathogenesis from an Autopsy Series. Am. J. Pathol. 2016;186:3225–3235. doi: 10.1016/j.ajpath.2016.08.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Johnson D.B., Balko J.M., Compton M.L., Chalkias S., Gorham J., Xu Y., Hicks M., Puzanov I., Alexander M.R., Bloomer T.L., et al. Fulminant Myocarditis with Combination Immune Checkpoint Blockade. N. Engl. J. Med. 2016;375:1749–1755. doi: 10.1056/NEJMoa1609214. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Byrne E.H., Fisher D.E. Immune and molecular correlates in melanoma treated with immune checkpoint blockade. Cancer. 2017;123:2143–2153. doi: 10.1002/cncr.30444. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Hassel J.C., Heinzerling L., Aberle J., Bähr O., Eigentler T.K., Grimm M.O., Grünwald V., Leipe J., Reinmuth N., Tietze J.K., et al. Combined immune checkpoint blockade (anti-PD-1/anti-CTLA-4): Evaluation and management of adverse drug reactions. Cancer Treat. Rev. 2017;57:36–49. doi: 10.1016/j.ctrv.2017.05.003. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.