Skip to main content
JAMA Network logoLink to JAMA Network
. 2019 Jan 3;5(4):529–536. doi: 10.1001/jamaoncol.2018.5904

Association of Patient Sex With Efficacy of Immune Checkpoint Inhibitors and Overall Survival in Advanced Cancers

A Systematic Review and Meta-analysis

Christopher J D Wallis 1,, Mohit Butaney 2, Raj Satkunasivam 3, Stephen J Freedland 4,5, Sandip P Patel 6, Omid Hamid 7, Sumanta K Pal 8, Zachary Klaassen 9,10
PMCID: PMC6459215  PMID: 30605213

Key Points

Question

Do women derive less advantage from immune checkpoint inhibitors, compared with standard systemic therapy, in the treatment of advanced solid-organ malignant neoplasm?

Findings

In this systematic review and meta-analysis of 23 randomized clinical trials of immunotherapy for advances solid-organ cancers including 9322 men and 4399 women, overall survival from immunotherapy was found in both men and women, with no statistically significant differences between the sexes.

Meaning

The response to immune checkpoint inhibitors does not appear to differ on the basis of patient sex.

Abstract

Importance

Sex-associated differences in immune response are known, but a meta-analysis suggested men, compared with women, derive greater value from immunotherapy for advanced solid-organ malignant neoplasms. However, methodologic concerns and subsequent trials have placed these results in doubt.

Objective

To perform an updated, comprehensive meta-analysis that assesses the efficacy of immunotherapy in advanced cancers according to patient sex.

Design, Setting, and Participants

A systematic review of studies (n = 23) indexed in MEDLINE (PubMed), Embase, and Scopus from inception of these databases to October 2, 2018, was conducted. Randomized clinical trials that compared immunotherapy with standard of care in the treatment of advanced solid-organ malignant neoplasms were included if overall survival was reported as an outcome and if data stratified by patient sex were available. Observational studies, editorials, commentaries, review articles, non–peer-reviewed publications, studies that compared various immunotherapy regimens, studies that reported other measures of oncologic response, and studies that reported subgroup analyses for 1 sex only were excluded.

Main Outcomes and Measures

Overall survival, with a test for heterogeneity between women and men, to assess the null hypothesis that no difference in the survival advantage of immunotherapy exists by patient sex.

Results

This meta-analysis included 23 randomized clinical trials that reported on 9322 men (67.9%) and 4399 women (32.1%); the age of most patients was in the 70s. An overall survival benefit of immunotherapy was found for both men (hazard ratio [HR], 0.75; 95% CI, 0.69-0.81; P < .001) and women (HR, 0.77; 95% CI, 0.67-0.88; P = .002). Random-effects meta-analysis of study-level differences in response to immunotherapy demonstrated no statistically significant difference between the sexes (I2 = 38%; P = .60). Subgroup analyses according to disease site, line of therapy, class of immunotherapy, study methodology, and representation of women recapitulated these findings.

Conclusions and Relevance

Stratified analyses demonstrated no statistically significant association of patient sex with the efficacy of immunotherapy in the treatment of advanced cancers using overall survival as the outcome.


This systematic review and meta-analysis examine randomized clinical trials to assess whether immunotherapy treatments for advanced cancer are less effective in female patients.

Introduction

Women and men differ in their immunologic response to both foreign and self-antigens, with women typically having stronger innate and adaptive immune responses.1 Compared with men, women not only experience a higher prevalence of systemic autoimmune disease1,2 but also have a greater response to vaccination and a lower severity and prevalence of many infectious conditions.1,3,4 In oncology, differences in immune response have been postulated to underlie observed differences in prevalence and mortality from many cancers.5,6

Immune checkpoint inhibitors targeting cytotoxic T-lymphocyte antigen-4 (CTLA-4) and programmed cell death 1 (PD-1) have demonstrated higher efficacy than standard of care (SOC) chemotherapeutic approaches in several malignant neoplasms. Sex hormone modulation of the PD-1/programmed cell death 1 ligand 1 (PD-L1) pathway has been demonstrated in animal models.7,8 Thus, it has been postulated that the advantages of immunotherapy may vary according to patient sex.9 Recently, Conforti et al10 found in a meta-analysis of randomized clinical trials that men derived greater value from immune checkpoint inhibitors compared with women (hazard ratio [HR], 0.72 [95% CI, 0.65-0.79] vs 0.86 [95% CI, 0.79-0.93]; P = .002). However, another recent analysis has presented conflicting data: No difference in advantages between nivolumab and everolimus was seen among men and women with metastatic renal cell carcinoma.11

The Conforti et al10 meta-analysis demonstrated a difference between patient sex, which presents a number of limitations that preclude strong conclusions from being drawn from the data set. First, the meta-analysis included a limited subset of approved immunotherapeutic agents. Second, several comprehensive and updated studies that met the inclusion criteria, including those with a more robust representation of female patients, have been published since the Conforti et al10 literature review.

To address these concerns, we performed a systematic review and meta-analysis that examine the association of patient sex with the advantages of immunotherapy in patients with advanced cancer. We used a more contemporary and comprehensive literature search strategy.

Methods

This systematic review and meta-analysis followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines.12 The study protocol was registered with PROSPERO.

Types of Studies

We included randomized clinical trials. Observational studies (whether cohort or case-control in design), editorials, commentaries, and review articles were excluded. Publications that were not subject to peer review (ie, reports of data from the National Vital Statistics System and dissertations or theses) were also excluded. To prevent the duplication of patients used in our analyses, we selected 1 study (when more than 1 was published about the same patient cohort), on the basis of contemporary timing, cohort size, and granularity of data reported.

We included studies that compared immunotherapy for metastatic cancers with other systemic treatment regimens, including chemotherapy-based regimens and those that used other targeted therapies. Analyses that examined immunotherapy-chemotherapy combinations compared with chemotherapy alone were also included. However, studies that compared various immunotherapy regimens were excluded.

Outcome and Exposure of Interest

The outcome of interest was overall survival (OS) and whether OS was reported as the primary or secondary outcome of the original study. Studies that reported other measures of oncologic response, including progression-free survival and objective response rate (without OS data) were excluded as these may not be comparable across histologic subtypes.

We sought to examine whether patient sex modified the association between immunotherapy (compared to chemotherapy) and OS. Studies that did not report analyses stratified by sex in the original trials were excluded. Furthermore, to exclude ecologic bias, we excluded studies that reported subgroup analyses for 1 sex only.

Search Strategy and Review Method

To perform this present analysis, we updated a previous relevant systematic review by Conforti et al10 that used MEDLINE (PubMed), Embase, and Scopus from inception of these databases to November 30, 2017, to identify phase 2 or 3 randomized clinical trials for the agents ipilimumab, tremelimumab, nivolumab, and pembrolizumab. In this update, we expanded the literature search for previously included agents from November 30, 2017, to October 2, 2018. We expanded the search criteria to include atezolizumab, durvalumab, and avelumab and searched the relevant databases from inception to October 2, 2018. References from review articles, editorials, and included studies were reviewed and cross-referenced to ensure completeness. No limitations were placed regarding publication language or publication year. After the literature search, we excluded all duplicates. References from review articles, commentaries, editorials, included studies, and conference publications of relevant medical societies were reviewed and cross-referenced to ensure completeness.

We (M.B. and Z.K.) performed study selection independently, and we resolved disagreements by consensus with the primary author (C.J.D.W.). Titles and abstracts were used to screen for initial study inclusion. Full-text reviews were performed if the abstracts were insufficient for determining if the studies met the inclusion or exclusion criteria. We (C.J.D.W., M.B., and Z.K.) developed a data extraction form by consensus. One of us (M.B.) performed all of the data extraction, and two of us (C.J.D.W. and Z.K.) conducted independent verification.

Study characteristics, including first author, year of publication, study design, phase, type of therapy (anti–PD-L1 or anti–CTLA-4), line of therapy, underlying malignant neoplasm, and baseline demographic characteristics were extracted. In addition, outcome information, including the HR (with 95% CI) for death, stratified by patient sex, was abstracted. A risk-of-bias assessment was conducted using the Cochrane Collaboration tool for assessing risk of bias.13

Assessment of Heterogeneity and Statistical Analysis

We identified heterogeneity using the Q test. Heterogeneity was estimated using the DerSimonian-Laird method and was quantified using I2 values.14

Meta-analysis was performed using Review Manager, version 5.3 (Nordic Cochrane Centre). We used the inverse variance technique for meta-analysis of HRs. Because of the clinical heterogeneity inherent in the data, we used random-effects models for all meta-analyses. To assess the differences between the sexes in each study while accounting for study-level associations, we made calculations using log HR and then assessed whether the variations differed from the null using the χ2 test.14 All reported P values are 2-sided, and P = .05 was used to indicate statistical significance.

Subgroup Analyses

We performed a number of prespecified subgroup analyses to assess the potential association of oncologic and methodologic factors in effect modification of patient sex with immunotherapy efficacy. We considered subgroups, including disease site (melanoma, non–small cell lung cancer [NSCLC], and other tumor sites), line of therapy (first line and subsequent), class of immunotherapy (anti–CTLA-4, anti–PD-1, and anti–PD-L1), and study methodology (various immunotherapies vs chemotherapy alone, immunotherapy-chemotherapy combination vs chemotherapy alone).

To assess the degree to which the relative underrepresentation of women in these trials may contribute to the previously observed differences in outcome between women and men, we performed a stratified analysis according to the proportion of women in each study. We categorized the included studies according to whether women represented less than 20%, 20% to 30%, 30% to 40%, or 40% or more of the study cohort.

Results

Literature Search Results

The literature search identified 57 unique references. After a full-text review of 17 studies, we identified 7 relevant clinical trials for inclusion, in addition to 16 trials included from the Conforti et al10 meta-analysis. Thus, a total of 23 trials15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37 were included in the present meta-analysis (Figure 1). All trials included a subgroup analysis, stratified by sex, that compared the intervention group with the control group, with an HR for OS.

Figure 1. PRISMA Diagram.

Figure 1.

IO indicates immunotherapy; OS, overall survival; PFS, progression-free survival; RFS, relapse-free survival.

Characteristics of Identified Trials

Table 1 lists the main characteristics of the 23 trials. In total, 13 721 patients were included, of which 9322 (67.9%) were men and 4399 (32.1%) were women; the age of most patients was in the 70s. All studies enrolled patients within the past decade, and most trials were published in the past 3 years. Only 2 studies18,29 (9%) evaluated OS as a secondary end point (the primary end point was progression-free survival), both of which allowed crossover to immunotherapy at the time of disease progression. There were 11 trials (48%) for patients with NSCLC,16,17,18,20,21,22,29,31,34,35,36 4 (17%) for melanoma,24,30,32,33 2 (9%) for clear cell renal cell carcinoma,26,27 2 (9%) for SCLC,28,37 and 1 (4%) each for urothelial carcinoma,15 head and neck squamous carcinoma,19 mesothelioma,25 and gastric or gastroesophageal carcinoma.23 Most trials evaluated immunotherapy after previous systemic therapy failure; however, 11 trials (48%) assessed the efficacy for OS in the first-line setting.18,20,21,27,28,29,30,32,33,35,37 Most trials used a PD-L1 or PD-1 inhibitor as the immunotherapy agent, whereas 6 trials (26%) used a CTLA-4 inhibitor.21,25,27,28,30,32 Most study designs included immunotherapy vs SOC, but 6 trials20,21,28,32,35,37 (26%) were designed as immunotherapy and SOC vs SOC alone.

Table 1. Characteristics and Outcomes of the 23 Trials Included in the Meta-analysis.

Source Disease Site Trial Name Lines of Therapy Intervention (No.) Control Treatment (No.) Age, Median (Range or IQR), y Follow-up, Median (Range or IQR), mo Sex, No. Overall Survival HR (95% CI)
Men Women Overall Men Women
Antonia et al,34 2018 NSCLC PACIFIC >1 Durvalumab (476) Placebo (237) 64 (23-90) 25.2 (0.2-43.1) 500 213 0.68 (0.47-0.998) 0.78 (0.59-1.03) 0.46 (0.30-0.73)
Barlesi et al,36 2018 NSCLC JAVELIN Lung 200 >1 Avelumab (396) Docetaxel (396) Int: 64 (58-69); Cont: 63 (57-69) 18.3 (IQR, 13.2-22.7) 367 162 0.90 (0.72-1.12) 0.83 (0.64-1.08)a 1.08 (0.74-1.59)a
Bellmunt et al,15 2017 Urothelial carcinoma KEYNOTE 045 >1 Pembrolizumab (270) ICC (272) 66 (26-88) 14.1 (9.9-22.1) 402 140 0.73 (0.59-0.91) 0.73 (0.56-0.94) 0.78 (0.49-1.24)
Borghaei et al,16 2015 NSCLC CheckMate 057 >1 Nivolumab (292) Docetaxel (290) 62 (21-85) 13.2 (NR) 319 263 0.73 (0.59-0.89) 0.73 (0.56-0.96) 0.78 (0.58-1.04)
Brahmer et al,17 2015 NSCLC CheckMate 017 >1 Nivolumab (135) Docetaxel (137) 63 (39-85) 11.0 (NR) 208 64 0.59 (0.44-0.79) 0.57 (0.41-0.78) 0.67 (0.36-1.25)
Carbone et al,18 2017 NSCLC CheckMate 026 1 Nivolumab (271) ICC (270) 64 (29-89) 13.5 (NR) 332 209 1.02 (0.80-1.30) 0.97 (0.74-1.26) 1.15 (0.79-1.66)
Ferris et al,19 2016 Head & neck squamous carcinoma CheckMate 141 >1 Nivolumab (240) ICC (121) 60 (28-83) 5.1 (0-16.8) 300 61 0.70 (97.73% CI, 0.51-0.96) 0.65 (0.48-0.88) 0.93 (0.47-1.85)
Gandhi et al,20 2018 NSCLC KEYNOTE 189 1 Pembrolizumab + platinum (410) Placebo + platinum (206) Int: 65 (34-84); Cont: 64 (34-84) 10.5 (0.2-20.4) 363 253 0.49 (0.38-0.64) 0.70 (0.50-0.99) 0.29 (0.19-0.44)
Govindan et al,21 2017 NSCLC NR 1 Ipilimumab + paclitaxel + carboplatin (388) Placebo + paclitaxel + carboplatin (361) 64 (28-85) Int: 12.5 (NR); Cont: 11.8 (NR) 635 114 0.91 (0.77-1.07) 0.85 (0.71-1.02) 1.33 (0.84-2.11)
Herbst et al,22 2016 NSCLC KEYNOTE 010 >1 Pembrolizumab 2 mg/kg (345); pembrolizumab 10 mg/kg (346) Docetaxel (343) 63 (IQR, 54-70) 13.1 (IQR, 8.6-17.7) 634 399 Pooled: 0.67 (0.56-0.80) 0.65 (0.52-0.81) 0.69 (0.51-0.94)
Horn et al,37 2018 SCLC IMpower133 1 Atezolizumab + carboplatin + etoposide (201) Placebo + carboplatin + etoposide (202) Int: 64 (28-90); Cont: 64 (26-87) 13.9 (NR) 261 142 0.70 (0.54-0.91) 0.74 (0.54-1.02) 0.65 (0.42-1.00)
Kang et al,23 2017 Gastric or gastroesophageal junction carcinoma ATTRACTION-2 >1 Nivolumab (330) Placebo (163) 62 (IQR, 53-69) Int: 8.87 (IQR, 6.57-12.37); Cont: 8.59 (IQR, 5.65-11.37) 348 145 0.63 (0.51-0.78) 0.59 (0.46-0.75) 0.83 (0.56-1.23)
Larkin et al,24 2018 Melanoma NR >1 Nivolumab (272) ICC (133) 61 (23-88)
24 (NR)
261 144 0.95 (0.73-1.24) 0.85 (0.62-1.17) 1.07 (0.69-1.65)
Maio et al,25 2017 Mesothelioma DETERMINE >1 Tremelimumab (382) Placebo (189) 67 (IQR, 60-73) NR 434 137 0.92 (0.76-1.12) 0.91 (0.73-1.13) 1.12 (0.72-1.75)
Motzer et al,26 2015 ccRCC CheckMate 025 >1 Nivolumab (410) Everolimus (411) 62 (18-88) 14 (NR) 619 202 0.73 (98.5% CI, 0.57-0.93) 0.73 (0.58-0.92) 0.84 (0.57-1.24)
Motzer et al,27 2018 ccRCC CheckMate 214 1 Nivolumab + ipilimumab (425) Sunitinib (422) Int: 62 (26-85); Cont: 51 (21-85) 25.2 (NR) 615 232 0.63 (99.8% CI, 0.44-0.89) 0.71 (0.55-0.92) 0.52 (0.34-0.78)
Paz-Ares et al,35 2018 NSCLC KEYNOTE 407 1 Pembrolizumab + ICC (278) Placebo + ICC (281) Int: 65 (29-87); Cont: 65 (36-88) 7.8 (0.1-19.1) 455 104 0.64 (0.49-0.85) 0.69 (0.51-0.94) 0.42 (0.22-0.81)
Reck et al,28 2016 SCLC NR 1 Ipilimumab + etoposide + platinum (478) Placebo + etoposide + platinum (476) 63 (36-85) Int: 10.5 (NR); Cont: 10.2 (NR) 643 311 0.94 (0.81-1.09) 1.07 (0.89-1.28) 1.06 (0.81-1.37)
Reck et al,29 2016 NSCLC KEYNOTE 024 1 Pembrolizumab (154) ICC (151) 65 (33-90) 11.2 (6.3-19.7) 187 118 0.60 (0.41-0.89) 0.54 (0.36-0.80) 0.96 (0.56-1.64)
Ribas et al,30 2013 Melanoma NR 1 Tremelimumab (328) ICC (327) 57 (22-90) NR 372 283 0.88 (NR); P = .13 0.93 (0.74-1.17) 0.81 (0.62-1.06)
Rittmeyer et al,31 2017 NSCLC OAK >1 Atezolizumab (425) Docetaxel (425) 64 (33-85) 21 (NR) 520 330 0.73 (0.62-0.87) 0.79 (0.64-0.97) 0.64 (0.49-0.85)
Robert et al,32 2011 Melanoma NR 1 Ipilimumab + dacarbazine (250) Placebo + dacarbazine (252) 56.9 (NR) 54 (NR) 301 201 0.72 (0.59-0.87) 0.70 (0.55-0.90) 0.86 (0.63-1.17)
Robert et al,33 2015 Melanoma CheckMate 066 1 Nivolumab (210) Dacarbazine (208) 65 (18-87) Int: 8.9 (NR); Cont: 6.8 (NR) 246 172 0.42 (0.25-0.73) 0.34 (0.22-0.54) 0.56 (0.33-0.95)

Abbreviations: ccRCC, clear cell renal cell carcinoma; Cont, control group; HR, hazard ratio; ICC, investigator’s choice of chemotherapy; Int, intervention group; IQR, interquartile range; NR, not reported; NSCLC, non–small cell lung cancer; PD-L1, programmed cell death 1 ligand 1; SCLC, small cell lung cancer.

a

Sex subgroup analysis performed in population with positive PD-L1.

Several trials had unique designs that may warrant further explanation. The KEYNOTE 010 trial22 was unique in that it tested 2 doses of pembrolizumab (2 mg/kg and 10 mg/kg) vs docetaxel among patients with NSCLC, with an overall pooled HR for OS of 0.67 (95% CI, 0.56-0.80). In the CheckMate 214 study, Motzer et al27 randomized 1096 patients with advanced clear cell renal cell carcinoma to receive both an anti–PD-1 (nivolumab) and an anti–CTLA-4 (ipilimumab) agent vs sunitinib; however, Motzer et al27 performed OS analysis on only a sex subgroup among 847 patients with intermediate- or poor-risk disease, demonstrating a survival advantage for both sexes (men HR, 0.71 [95% CI, 0.55-0.92]; women HR, 0.52 [95% CI, 0.34-0.78]).

The median age of patients included was typically in the 70s; however, in 2 trials, the median age was in the 60s.30,32 Most studies tended to have short follow-up, although 3 trials (13%) had a median follow-up of 24 months or more.24,27,34 Overall, all but 7 studies18,21,24,25,28,30,36 (30%) showed an OS advantage for patients who received immunotherapy compared with the control group. In subgroup analyses, 14 studies15,16,17,19,20,22,23,26,27,29,31,32,33,35 (61%) demonstrated a survival advantage from immunotherapy among men and 7 studies20,22,27,31,33,34,35 (30%) showed this advantage among women.

Risk of Bias

Risk of bias of the included trials is shown in the eTable in the Supplement. All trials included random-sequence generation and were at low risk for selection bias. There was intermittent reporting of allocation concealment; several studies were at risk for selection bias because of this criterion. Generally, all studies were at low risk for attrition and reporting bias. Several studies were unblinded and were thus at risk for performance and detection bias; however, for the outcome of OS, such a lack of blinding is likely inconsequential as blinding is unlikely to affect the outcome.

Primary Analysis

Meta-analysis of the available literature demonstrated a statistically significant advantage in OS for patients who received immunotherapy compared with other systemic therapies (HR, 0.75, 95% CI, 0.70-0.81; P < .001; I2 = 61%). Compared with SOC systemic therapy, an OS advantage of immunotherapy was observed for both men (HR, 0.75; 95% CI, 0.69-0.81; P < .001) and women (HR, 0.77; 95% CI, 0.67-0.88; P = .002); however, we found no statistically significant difference in OS advantage between the sexes (P = .60; I2 = 38%) (Table 2, Figure 2). Statistically significant heterogeneity was demonstrated among both men (tau2 = 0.02; χ2 = 51.67; P = .003; I2 = 57%) and women (tau2 = 0.07; χ2 = 62.29; P < .001; I2 = 65%).

Table 2. Differences in Efficacy of Immunotherapy in Men and Women by Subgroups .

Variable Study, No. (%) Participants, No. Pooled HR (95% CI) for IO vs SOC Test for Difference
Men Women Men Women I2, % P Value
Overall 23 9322 4399 0.75 (0.69-0.81) 0.77 (0.67-0.88) 38 .60
Disease site
Melanoma 4 (17) 1180 800 0.68 (0.48-0.97) 0.83 (0.68-1.00) 16 .36
NSCLC 11 (48) 4520 2125 0.79 (0.71-0.88) 0.72 (0.56-0.93) 61 .79
Other tumors 8 (35) 3622 1474 0.76 (0.66-0.89) 0.83 (0.69-1.00) 0 .47
Line of therapy
First line 11 (48) 4410 2139 0.75 (0.64-0.87) 0.73 (0.57-0.94) 58 .92
Subsequent 12 (52) 4912 2260 0.73 (0.66-0.80) 0.79 (0.68-0.91) 2 .38
Class of immunotherapya
Anti–CTLA-4 6 (26) 3000 1278 0.86 (0.76-0.98) 0.91 (0.73-1.13) 26 .62
Anti–PD-1 18 (78) 7198 3495 0.70 (0.65-0.77) 0.70 (0.60-0.83) 44 .94
Study methodology
Non-IO + IO vs non-IO 6 (26) 2658 1125 0.80 (0.68-0.94) 0.69 (0.45-1.07) 69 .55
IO vs non-IO 17 (74) 6664 3274 0.73 (0.66-0.80) 0.79 (0.69-0.89) 14 .33
Proportion of women, %
<20 3 (13) 1390 279 0.75 (0.63-0.90) 0.82 (0.41-1.64) 58 .65
20-30 7 (30) 3126 1133 0.72 (0.64-0.81) 0.72 (0.57-0.91) 33 .93
31-39 8 (35) 3205 1815 0.81 (0.70-0.94) 0.88 (0.73-1.06) 0 .52
≥40 5 (22) 1601 1172 0.67 (0.52-0.87) 0.63 (0.44-0.90) 71 .76

Abbreviations: CTLA-4, cytotoxic T-lymphocyte antigen-4; HR, hazard ratio; IO, immunotherapy; NSCLC, non–small cell lung cancer; PD-1, programmed cell death 1; SOC, standard of care chemotherapy.

a

Motzer et al27 included both classes of immunotherapy in subgroups as agents from both categories used in the exposure arm.

Figure 2. Forest Plot of Association Between Overall Survival and Immunotherapy (IO) and Standard of Care (SOC) Stratified by Patient Sex.

Figure 2.

HR indicates hazard ratio.

aNew studies included in this meta-analysis.

Subgroup Analysis

We performed a number of subgroup analyses according to disease site, line of therapy, class of immunotherapy, and study methodology. No statistically significant differences in the efficacy of immunotherapy were found between men and women in any of these analyses (Table 2). Finally, we examined for the effect of the prevalence of women in the study cohort. Again, no statistically significant differences were demonstrated among these subgroups (Table 2).

Discussion

Contrary to the published meta-analysis by Conforti et al,10 which suggested a greater immunotherapy advantage compared with SOC systemic therapy for men than women, the present analysis found no difference in OS from immune checkpoint inhibitors when comparing the efficacy of these treatments between the sexes. Furthermore, when assessing several subgroup analyses, including disease site, line of therapy, class of immunotherapy, and study methodology, we could not demonstrate any significant sex-associated differences in efficacy.

These conflicting results may be explained in a number of ways. First, we excluded 3 trials, which were included in Conforti et al,10 that compared various immunotherapy regimes.38,39,40 By including only those trials that compared an immunotherapy group with a nonimmunotherapy control, we were able to specifically assess the association of sex with response to immunotherapy. Second, we expanded the search criteria to include immunotherapy agents that were not considered in Conforti et al.10 The resulting search included a trial of atezolizumab in patients with NSCLC.31 This trial demonstrated a greater net value of immunotherapy for women (HR, 0.64; 95% CI, 0.49-0.85) than for men (HR, 0.79; 95% CI, 0.64-0.97). Because this trial was large (n = 850 patients), it contributed considerably to the pooled HR effect.

Third, we updated the search previously performed and identified 7 recent large trials that have been published since the end date for inclusion in the Conforti et al10 meta-analysis. Gandhi et al20 in KEYNOTE 189 tested pembrolizumab plus platinum chemotherapy (n = 410) vs placebo plus platinum chemotherapy (n = 206) in the first-line setting among patients with NSCLC. KEYNOTE 189 included 363 men and 253 women and noted a strong OS advantage from immunotherapy among women (HR, 0.29; 95% CI, 0.19-0.44) compared with men (HR, 0.70; 95% CI, 0.50-0.99). Motzer et al27 in CheckMate 214 tested nivolumab plus ipilimumab (n = 425) and the tyrosine-kinase inhibitor sunitinib (n = 422) in the first-line setting among intermediate- and poor-risk patients with clear cell renal cell carcinoma. CheckMate 214 had 615 men and 232 women and also found a strong OS advantage from immunotherapy among women (HR, 0.52; 95% CI, 0.34-0.78) compared with men (HR, 0.71; 95% CI, 0.55-0.92). KEYNOTE 407 tested first-line pembrolizumab vs saline placebo (plus carboplatin and either paclitaxel or nanoparticle albumin-bound paclitaxel) among patients with NSCLC.35 Although women made up only 18.6% of participants in KEYNOTE 407, they had a remarkable immunotherapy treatment advantage (HR, 0.42; 95% CI, 0.22-0.81) compared with men (HR, 0.69; 95% CI, 0.51-0.94). Taken together, the present meta-analysis provides a more specific assessment of the research question while including a greater number of immunotherapy agents and an updated search.

Small samples sizes may result in an elevated false discovery rate41 or even false-positive results.42 Meta-analyses of such trials may propagate such findings by enhancing the statistical power of these small subgroup analyses. To explore the final hypothesis that the representation of women in a study may mediate observed differences in immunotherapy efficacy between men and women, we performed a stratified analysis. We found no statistically significant difference in outcomes between men and women regardless of the proportion of women in the study cohort. The effect estimates favored men in studies with study cohorts composed of less than 20% women, but the results were very comparable in the other subgroups. Trials with an underrepresentation of women may present spurious results for sex-specific subgroup analyses, as evidenced by the wide CIs when less than 20% of the cohort represented is women. Six20,27,31,34,36,37 of the 7 trials included in this meta-analysis but not included in the Conforti et al10 study had more than 27% women representation, with 2 trials20,31 having more than 38% women inclusion.

Strengths and Limitations

The strengths of this meta-analysis include the strict methodologic inclusion criteria that required the comparison between an immunotherapy group and a nonimmunotherapy control group; the broad inclusion of all approved immunotherapy agents; and the rigorous, up-to-date search strategy. As a result, this analysis provides a comprehensive assessment of the association of patient sex with response to immunotherapy compared with nonimmunotherapy, including data on more than 13 000 patients. Furthermore, we undertook several subgroup analyses in an attempt to ascertain any differences in immunotherapy efficacy between the sexes.

This analysis has several limitations. First, it relies on published clinical trial subgroup HRs and not on individual patient-level data. Second, residual confounding is possible in that differences other than sex contribute to immunotherapy response and OS. Third, differences in outcomes between men and women may be ascribed to other factors (including differences in lifestyle, comorbidities, incidence of autoimmune diseases, and other factors) that are unaccounted for in clinical trials. Fourth, as in all clinical trials, the included studies are at risk for having nongeneralizable results (the so-called efficacy-effectiveness gap) because of referral bias and strict inclusion criteria, among other factors, that result in the underrepresentation of uninsured, low-income, and minority populations. Meta-analysis of these trials, such as the one we performed, is subject to the same limitations. Finally, the trials that we excluded because of a lack of published sex-subgroup analyses may demonstrate sex differences if analyzed in this fashion.

Conclusions

In this contemporary meta-analysis of all available immunotherapy clinical trials across all disease sites, we found no difference in immunotherapy efficacy or OS between women and men. Contrary to findings of a previous analysis, we found no evidence that sex should be considered when deciding whether to offer immunotherapy to patients with advanced cancers.

Supplement.

eTable. Risk of Bias

References

  • 1.Klein SL, Flanagan KL. Sex differences in immune responses. Nat Rev Immunol. 2016;16(10):626-638. doi: 10.1038/nri.2016.90 [DOI] [PubMed] [Google Scholar]
  • 2.Whitacre CC, Reingold SC, O’Looney PA. A gender gap in autoimmunity. Science. 1999;283(5406):1277-1278. doi: 10.1126/science.283.5406.1277 [DOI] [PubMed] [Google Scholar]
  • 3.vom Steeg LG, Klein SL. SeXX matters in infectious disease pathogenesis. PLoS Pathog. 2016;12(2):e1005374. doi: 10.1371/journal.ppat.1005374 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Klein SL, Jedlicka A, Pekosz A. The Xs and Y of immune responses to viral vaccines. Lancet Infect Dis. 2010;10(5):338-349. doi: 10.1016/S1473-3099(10)70049-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Cook MB, Dawsey SM, Freedman ND, et al. . Sex disparities in cancer incidence by period and age. Cancer Epidemiol Biomarkers Prev. 2009;18(4):1174-1182. doi: 10.1158/1055-9965.EPI-08-1118 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Cook MB, McGlynn KA, Devesa SS, Freedman ND, Anderson WF. Sex disparities in cancer mortality and survival. Cancer Epidemiol Biomarkers Prev. 2011;20(8):1629-1637. doi: 10.1158/1055-9965.EPI-11-0246 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Polanczyk MJ, Hopke C, Vandenbark AA, Offner H. Treg suppressive activity involves estrogen-dependent expression of programmed death-1 (PD-1). Int Immunol. 2007;19(3):337-343. doi: 10.1093/intimm/dxl151 [DOI] [PubMed] [Google Scholar]
  • 8.Polanczyk MJ, Hopke C, Vandenbark AA, Offner H. Estrogen-mediated immunomodulation involves reduced activation of effector T cells, potentiation of Treg cells, and enhanced expression of the PD-1 costimulatory pathway. J Neurosci Res. 2006;84(2):370-378. doi: 10.1002/jnr.20881 [DOI] [PubMed] [Google Scholar]
  • 9.Botticelli A, Onesti CE, Zizzari I, et al. . The sexist behaviour of immune checkpoint inhibitors in cancer therapy? Oncotarget. 2017;8(59):99336-99346. doi: 10.18632/oncotarget.22242 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Conforti F, Pala L, Bagnardi V, et al. . Cancer immunotherapy efficacy and patients’ sex: a systematic review and meta-analysis. Lancet Oncol. 2018;19(6):737-746. doi: 10.1016/S1470-2045(18)30261-4 [DOI] [PubMed] [Google Scholar]
  • 11.Graham J, Abdel-Rahman O, Choueiri TK, Heng DYC; International mRCC Database Consortium . Re: Fabio Conforti, Laura Pala, Vincenzo Bagnardi, et al. Cancer immunotherapy efficacy and patients’ sex: a systematic review and meta-analysis. Lancet Oncol 2018;19:737-46. Eur Urol. 2018;S0302-2838(18)30482-2.https://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=30031571&dopt=Abstract doi: 10.1016/j.eururo.2018.07.004 [DOI] [PubMed] [Google Scholar]
  • 12.Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group . Preferred Reporting Items for Systematic Reviews and Meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006-1012. doi: 10.1016/j.jclinepi.2009.06.005 [DOI] [PubMed] [Google Scholar]
  • 13.Higgins JP, Altman DG, Gøtzsche PC, et al. ; Cochrane Bias Methods Group; Cochrane Statistical Methods Group . The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. doi: 10.1136/bmj.d5928 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557-560. doi: 10.1136/bmj.327.7414.557 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Bellmunt J, de Wit R, Vaughn DJ, et al. ; KEYNOTE-045 Investigators . Pembrolizumab as second-line therapy for advanced urothelial carcinoma. N Engl J Med. 2017;376(11):1015-1026. doi: 10.1056/NEJMoa1613683 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Borghaei H, Paz-Ares L, Horn L, et al. . Nivolumab versus docetaxel in advanced nonsquamous non–small-cell lung cancer. N Engl J Med. 2015;373(17):1627-1639. doi: 10.1056/NEJMoa1507643 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Brahmer J, Reckamp KL, Baas P, et al. . Nivolumab versus docetaxel in advanced squamous-cell non–small-cell lung cancer. N Engl J Med. 2015;373(2):123-135. doi: 10.1056/NEJMoa1504627 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Carbone DP, Reck M, Paz-Ares L, et al. ; CheckMate 026 Investigators . First-line nivolumab in stage IV or recurrent non–small-cell lung cancer. N Engl J Med. 2017;376(25):2415-2426. doi: 10.1056/NEJMoa1613493 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Ferris RL, Blumenschein G Jr, Fayette J, et al. . Nivolumab for recurrent squamous-cell carcinoma of the head and neck. N Engl J Med. 2016;375(19):1856-1867. doi: 10.1056/NEJMoa1602252 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Gandhi L, Rodríguez-Abreu D, Gadgeel S, et al. ; KEYNOTE-189 Investigators . Pembrolizumab plus chemotherapy in metastatic non–small-cell lung cancer. N Engl J Med. 2018;378(22):2078-2092. doi: 10.1056/NEJMoa1801005 [DOI] [PubMed] [Google Scholar]
  • 21.Govindan R, Szczesna A, Ahn MJ, et al. . Phase III trial of ipilimumab combined with paclitaxel and carboplatin in advanced squamous non–small-cell lung cancer. J Clin Oncol. 2017;35(30):3449-3457. doi: 10.1200/JCO.2016.71.7629 [DOI] [PubMed] [Google Scholar]
  • 22.Herbst RS, Baas P, Kim DW, et al. . Pembrolizumab versus docetaxel for previously treated, PD-L1-positive, advanced non-small-cell lung cancer (KEYNOTE-010): a randomised controlled trial. Lancet. 2016;387(10027):1540-1550. doi: 10.1016/S0140-6736(15)01281-7 [DOI] [PubMed] [Google Scholar]
  • 23.Kang YK, Boku N, Satoh T, et al. . Nivolumab in patients with advanced gastric or gastro-oesophageal junction cancer refractory to, or intolerant of, at least two previous chemotherapy regimens (ONO-4538-12, ATTRACTION-2): a randomised, double-blind, placebo-controlled, phase 3 trial. Lancet. 2017;390(10111):2461-2471. doi: 10.1016/S0140-6736(17)31827-5 [DOI] [PubMed] [Google Scholar]
  • 24.Larkin J, Minor D, D’Angelo S, et al. . Overall survival in patients with advanced melanoma who received nivolumab versus investigator’s choice chemotherapy in CheckMate 037: a randomized, controlled, open-label phase III trial. J Clin Oncol. 2018;36(4):383-390. doi: 10.1200/JCO.2016.71.8023 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Maio M, Scherpereel A, Calabrò L, et al. . Tremelimumab as second-line or third-line treatment in relapsed malignant mesothelioma (DETERMINE): a multicentre, international, randomised, double-blind, placebo-controlled phase 2b trial. Lancet Oncol. 2017;18(9):1261-1273. doi: 10.1016/S1470-2045(17)30446-1 [DOI] [PubMed] [Google Scholar]
  • 26.Motzer RJ, Escudier B, McDermott DF, et al. ; CheckMate 025 Investigators . Nivolumab versus everolimus in advanced renal-cell carcinoma. N Engl J Med. 2015;373(19):1803-1813. doi: 10.1056/NEJMoa1510665 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Motzer RJ, Tannir NM, McDermott DF, et al. ; CheckMate 214 Investigators . Nivolumab plus ipilimumab versus sunitinib in advanced renal-cell carcinoma. N Engl J Med. 2018;378(14):1277-1290. doi: 10.1056/NEJMoa1712126 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Reck M, Luft A, Szczesna A, et al. . Phase III randomized trial of ipilimumab plus etoposide and platinum versus placebo plus etoposide and platinum in extensive-stage small-cell lung cancer. J Clin Oncol. 2016;34(31):3740-3748. doi: 10.1200/JCO.2016.67.6601 [DOI] [PubMed] [Google Scholar]
  • 29.Reck M, Rodríguez-Abreu D, Robinson AG, et al. ; KEYNOTE-024 Investigators . Pembrolizumab versus chemotherapy for PD-L1-positive non–small-cell lung cancer. N Engl J Med. 2016;375(19):1823-1833. doi: 10.1056/NEJMoa1606774 [DOI] [PubMed] [Google Scholar]
  • 30.Ribas A, Kefford R, Marshall MA, et al. . Phase III randomized clinical trial comparing tremelimumab with standard-of-care chemotherapy in patients with advanced melanoma. J Clin Oncol. 2013;31(5):616-622. doi: 10.1200/JCO.2012.44.6112 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Rittmeyer A, Barlesi F, Waterkamp D, et al. ; OAK Study Group . Atezolizumab versus docetaxel in patients with previously treated non-small-cell lung cancer (OAK): a phase 3, open-label, multicentre randomised controlled trial. Lancet. 2017;389(10066):255-265. doi: 10.1016/S0140-6736(16)32517-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Robert C, Thomas L, Bondarenko I, et al. . Ipilimumab plus dacarbazine for previously untreated metastatic melanoma. N Engl J Med. 2011;364(26):2517-2526. doi: 10.1056/NEJMoa1104621 [DOI] [PubMed] [Google Scholar]
  • 33.Robert C, Long GV, Brady B, et al. . Nivolumab in previously untreated melanoma without BRAF mutation. N Engl J Med. 2015;372(4):320-330. doi: 10.1056/NEJMoa1412082 [DOI] [PubMed] [Google Scholar]
  • 34.Antonia SJ, Villegas A, Daniel D, et al. ; PACIFIC Investigators . Overall survival with durvalumab after chemoradiotherapy in Stage III NSCLC [published online September 25, 2018]. N Engl J Med. 2018. doi: 10.1056/NEJMoa1809697 [DOI] [PubMed] [Google Scholar]
  • 35.Paz-Ares L, Luft A, Vicente D, et al. ; KEYNOTE-407 Investigators . Pembrolizumab plus chemotherapy for squamous non–small-cell lung cancer. N Engl J Med. 2018;379(21)2040-2051.https://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=30280635&dopt=Abstract doi: 10.1056/NEJMoa1810865 [DOI] [PubMed] [Google Scholar]
  • 36.Barlesi F, Vansteenkiste J, Spigel D, et al. . Avelumab versus docetaxel in patients with platinum-treated advanced non-small-cell lung cancer (JAVELIN Lung 200): an open-label, randomised, phase 3 study [published online September 21, 2018]. Lancet Oncol. 2018;S1470-2045(18)30673-9. doi: 10.1016/S1470-2045(18)30673-9 [DOI] [PubMed] [Google Scholar]
  • 37.Horn L, Mansfield AS, Szczęsna A, et al. ; IMpower133 Study Group . First-line atezolizumab plus chemotherapy in extensive-stage small-cell lung cancer [published online September 25, 2018]. N Engl J Med. 2018. doi: 10.1056/NEJMoa1809064 [DOI] [PubMed] [Google Scholar]
  • 38.Robert C, Schachter J, Long GV, et al. ; KEYNOTE-006 Investigators . Pembrolizumab versus ipilimumab in advanced melanoma. N Engl J Med. 2015;372(26):2521-2532. doi: 10.1056/NEJMoa1503093 [DOI] [PubMed] [Google Scholar]
  • 39.Hodi FS, Chesney J, Pavlick AC, et al. . Combined nivolumab and ipilimumab versus ipilimumab alone in patients with advanced melanoma: 2-year overall survival outcomes in a multicentre, randomised, controlled, phase 2 trial. Lancet Oncol. 2016;17(11):1558-1568. doi: 10.1016/S1470-2045(16)30366-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Hodi FS, O’Day SJ, McDermott DF, et al. . Improved survival with ipilimumab in patients with metastatic melanoma. N Engl J Med. 2010;363(8):711-723. doi: 10.1056/NEJMoa1003466 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Button KS, Ioannidis JP, Mokrysz C, et al. . Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013;14(5):365-376. doi: 10.1038/nrn3475 [DOI] [PubMed] [Google Scholar]
  • 42.Hackshaw A. Small studies: strengths and limitations. Eur Respir J. 2008;32(5):1141-1143. doi: 10.1183/09031936.00136408 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement.

eTable. Risk of Bias


Articles from JAMA Oncology are provided here courtesy of American Medical Association

RESOURCES