Pre-clinical mouse models suggest that the gut microbiome modulates tumor response to checkpoint blockade immunotherapy; however, this has not been well-characterized in human cancer patients. Here we examined the oral and gut microbiome of melanoma patients undergoing anti-PD-1 immunotherapy (n=112). Significant differences were observed in the diversity and composition of the patient gut microbiome of responders (R) versus non-responders (NR). Analysis of patient fecal microbiome samples (n=43, 30R, 13NR) showed significantly higher alpha diversity (p<0.01) and relative abundance of Ruminococcaceae bacteria (p<0.01) in responding patients. Metagenomic studies revealed functional differences in gut bacteria in R including enrichment of anabolic pathways. Immune profiling suggested enhanced systemic and anti-tumor immunity in responding patients with a favorable gut microbiome, as well as in germ-free mice receiving fecal transplants from responding patients. Together, these data have important implications for the treatment of melanoma patients with immune checkpoint inhibitors.
Tremendous advances have been made in the treatment of melanoma and other cancers using immune checkpoint inhibitors targeting the cytotoxic T-lymphocyte-associated antigen (CTLA-4) and the programmed death 1 (PD-1) protein, however responses to these therapies are often heterogeneous and not durable (1–3). It has recently emerged that factors beyond tumor genomics influence cancer development and therapeutic responses (4–7), including host factors such as the gastrointestinal (gut) microbiome (8–10). A number of studies have shown that the gut microbiome may influence anti-tumor immune responses via innate and adaptive immunity (11, 12), and that therapeutic responses may be improved via its modulation (13, 14), however this has not been extensively studied in cancer patients.
To better understand the role of the microbiome in response to immune checkpoint blockade, we prospectively collected microbiome samples from patients with metastatic melanoma starting treatment with anti-PD-1 therapy (n=112 patients) (fig. S1 and table S1). Oral (buccal) and gut (fecal) microbiome samples were collected at treatment initiation, and tumor biopsies and blood samples were collected at matched pre-treatment time points when possible to assess for genomic alterations, as well as the density and phenotype of tumor-infiltrating and circulating immune cell subsets (Fig. 1A and fig. S2). Taxonomic profiling via 16S rRNA gene sequencing was performed on all available oral and gut samples, with metagenomic whole genome shotgun (WGS) sequencing on a subset (n=25). Eligible patients (n=89) were classified as responders (R; n=54) versus non-responders (NR; n=35) based on radiographic assessment using the Response Evaluation Criteria in Solid Tumors (RECIST 1.1) criteria (15) at 6 months after treatment initiation. Patients were classified as R if they achieved an objective response (complete or partial response or stable disease lasting at least 6 months), versus NR if they progressed on therapy or had stable disease lasting less than 6 months. This classification accounts for the subset of patients who may derive long-term disease benefit despite not achieving a bona fide RECIST response, and has been employed in numerous published studies of patients on checkpoint blockade (16–19). Of note, patients in R versus NR groups were similar with respect to age, gender, primary type, prior therapy, concurrent systemic therapy and serum lactate dehydrogenase (LDH) (table S2). Prior genomic analyses have demonstrated that patients with tumors having a higher mutational load are more likely to respond to anti-CTLA-4 (16, 20, 21) or anti-PD-1 therapy (21–24), however a high mutational load alone appears neither sufficient nor essential for response. In this cohort, the total number and specific melanoma driver mutations were within comparable parameters between R and NR following anti-PD-1 therapy (fig. S3), though the number of tumors available for sequencing (n=10, R=7, NR=3) was limited and may have reduced our ability to detect a significant association between mutational burden and response.
We first assessed the landscape of the oral and gut microbiome in all available samples in patients (n=112) with metastatic melanoma via 16S sequencing, noting that both communities were relatively diverse, with a high abundance of Lactobacillales in the oral microbiome and Bacteroidales in the fecal microbiome (Fig. 1B). Bipartite network analysis (25) demonstrated a clear separation of community structure between the oral and fecal microbiomes in terms of both matched and aggregate samples (fig. S4), suggesting that these communities are distinct. Loss of microbial diversity (dysbiosis) is associated with chronic health conditions (26–28) and cancer (8–10), and is also associated with poor outcomes to certain forms of cancer therapy including allogeneic stem cell transplant (29). Based on these data, we examined the diversity of the oral and gut microbiomes in eligible patients on anti-PD1 therapy, and found that alpha diversity of the gut microbiome was significantly higher in R (n=30) compared to NR (n=13) using several indices (p<0.01, Fig. 1C and fig. S5). No significant differences were observed in the oral microbiome (R=54, NR=32, p=0.11, fig. S6). We then tested the relationship of diversity and progression-free survival (PFS) in our cohort by stratifying patients based on tertiles of Inverse Simpson scores, demonstrating that patients with a high diversity in the fecal microbiome had significantly prolonged PFS compared to those with intermediate or low diversity (p=0.02 and 0.04, respectively; Fig. 1, D and E, and fig. S7). No differences in PFS were noted when comparing diversity of the oral microbiome (fig. S8). Importantly, upon visualizing beta diversity weighted UniFrac distances (30) by principal coordinate analysis, we found a notable clustering effect by response status in the gut microbiome of these patients, which was not observed in the oral microbiome (Fig. 1F and fig. S8E).
Since compositional differences in the microbiome may also influence cancer development and response to therapy (12, 14, 15, 23), we sought to determine if differences existed in the oral or gut microbiomes of R and NR to anti-PD-1 therapy. To test this, we first compared an enrichment of operational taxonomic units (OTUs) in R versus NR, demonstrating that distinct sets of rare low abundance OTUs were associated with response to anti-PD-1 therapy, with enrichment of Clostridiales in R and Bacteroidales in NR in the gut microbiome (p<0.01, Fig. 2, A and B, and fig. S9, A and C). No significant differences in enrichment were noted in the oral microbiome of R versus NR (fig. S9, B and D, and fig. S10). To further explore these findings, we performed high dimensional class comparisons via linear discriminant analysis of effect size (LEfSe) (31), which again demonstrated differentially abundant bacteria in the fecal microbiome of R versus NR to anti-PD-1 therapy, with Clostridiales/Ruminococcaceae enriched in R and Bacteroidales enriched in NR (Fig. 2, C and D). No major differences were observed in the oral microbiome between R and NR, with the exception of higher Bacteroidales in NR to anti-PD-1 therapy (fig. S11). Pairwise comparisons were then performed for bacterial taxa at all levels by response. In addition to confirming the previous taxonomic differences, these analyses identified the Faecalibacterium genus as significantly enriched in R (Fig. 2E and table S3). Metagenomic WGS further confirmed enrichment of Faecalibacterium species in addition to others in R, while Bacteroides thetaiotaomicron, Escherichia coli, and Anaerotruncus colihominis were enriched in NR (Fig. 2F and table S4). Importantly, the gut microbiome was shown to be relatively stable over time in a limited number of longitudinal samples tested (fig. S12).
We next asked whether bacterial composition and abundances within the gut and/or oral microbiomes of patients were associated with a specific treatment outcome to anti-PD-1 therapy. We grouped all identified OTUs into clusters of related OTUs (crOTUs) via construction of a phylogenetic tree from sequence alignment data (32). This technique involves comparison of abundances of different potential groupings of bacteria based on 16S sequence similarity and helps address the sparse distribution of OTU abundances observed in the absence of this approach (fig. S13). Unsupervised hierarchical clustering of crOTU abundances within the gut and oral microbiomes was then performed without input of response data. We found that patients segregated into 2 distinct community types. Type 1 comprised entirely of R and was enriched for Clostridiales, whereas Type 2 comprised a mixture of R and NR (p=0.02) and was enriched for Bacteroidales (Fig. 3A). To better understand compositional differences between these crOTU community types, we again performed pairwise comparisons of the gut microbiota, and identified a pattern very similar to that seen when clustering by response, with Clostridiales/Ruminococcaceae enriched in Type 1, and Bacteroidales enriched in Type 2 (fig. S14A and table S5). Further, these communities clustered distinctly using principal coordinate analysis of weighted Unifrac distances (fig. S14B). Analysis of crOTUs in the oral microbiome revealed no apparent relationship to treatment response (fig. S15, A and B).
To explore how specific bacterial taxa impact patient treatment response, we compared PFS following anti-PD-1 therapy as it related to the “top hits” consistently observed across our analyses. From the Ruminococcaceae family of the Clostridiales order, we focused on the Faecalibacterium genus in R, and Bacteroidales order in NR, and stratified patients into high versus low categories based on the median relative abundance of these taxa in the gut microbiome. Patients with high Faecalibacterium abundance had a significantly prolonged PFS versus those with a low abundance (p=0.03). Conversely, patients with a high abundance of Bacteroidales had a shortened PFS compared to those with a low abundance (p=0.05, Fig. 3D). This is in line with recently published data in a small cohort of patients on CTLA-4 blockade, where patients with a higher abundance of Faecalibacterium had a prolonged PFS compared to those with a higher abundance of Bacteroidales in the gut microbiome (33). In addition, univariate Cox proportional hazards analyses demonstrated that the strongest microbial predictors of response to anti-PD-1 therapy were alpha diversity [Intermediate hazard ratio (HR)=3.60, 95% C.I.=1.02-12.74; Low HR=3.57, 95% confidence interval (C.I.)=1.02-12.52], and abundance of Faecalibacterium (HR=2.92, 95% C.I.=1.08-7.89) and Bacteroidales (HR= 0.39, 95% CI=0.15-1.03) in the fecal microbiome. There was no association found between PFS and stage in our cohort. Our final multivariate model was selected by forward stepwise selection and included Faecalibacterium abundance (HR=2.95, 95% C.I.=1.31-7.29, p=0.03) and prior immunotherapy (HR=2.87, 95% C.I.=1.10-7.89, p=0.03) (table S6). Abundance of Faecalibacterium and Bacteroidales also outperformed relevant clinical variables in receiver operating characteristic curve (ROC) analysis (fig. S16).
Next, we sought to gain insight into the mechanism through which the gut microbiome may influence response to anti-PD-1 therapy, and first conducted functional genomic profiling of gut microbiome samples via metagenomic WGS sequencing (n=25) in R (n=14) vs NR (n=11). Organism-specific gene hits were assigned to the Kyoto Encyclopedia of Genes and Genomes (KEGG) orthology (KO), and based on these annotations, metagenomes for each sample were reconstructed into metabolic pathways using the MetaCyc hierarchy of pathway classifications (34, 35). Unsupervised hierarchical clustering of predicted pathway enrichment identified two groups of patient samples, with response rates of 69.2% and 41.7% (Fig. 3E). A similar pattern was also noted for KO-abundances with 70.6% and 37.5% response rates (fig. S17). Comparisons of pathway enrichment across these groups showed changes in metabolic functions, with anabolic functions predominating in R including amino acid biosynthesis (Fig. 3E), which may promote host immunity (36), whereas catabolic functions predominated in NR (Fig. 3E, fig. S16, and table S7).
There is clear evidence in pre-clinical models that differential composition of the gut microbiome may influence therapeutic responses to anti-PD-1 therapy at the level of the tumor microenvironment (12), thus we next examined the relationship between the gut microbiota and systemic and anti-tumor immune responses in our cohort of patients on anti-PD-1 therapy. We compared the tumor-associated immune infiltrates via multi-parameter immunohistochemistry (IHC) and observed a higher density of CD8+ T cells in baseline samples of R versus NR (p=0.04), consistent with prior reports (Fig. 4A and fig. S18) (18, 37). Pairwise comparisons using Spearman rank correlations were then performed between specific bacterial taxa enriched in the gut microbiome of R and NR and immune markers in the tumor microenvironment, demonstrating a statistically significant positive correlation between the CD8+ T cell infiltrate in the tumor and abundance of the Faecalibacterium genus, the Ruminococcaceae family and the Clostridiales order in the gut and a non-significant but negative correlation with Bacteroidales (Fig. 4, B and C, and figs. S19 and S20). No associations were seen between CD8+ T cell density and diversity or crOTU community type membership (fig. S21). Analysis of systemic immune responses via flow cytometry and cytokine assays revealed that patients with a high abundance of Clostridiales, Ruminococcaceae or Faecalibacterium in the gut had higher levels of effector CD4+ and CD8+ T cells in the systemic circulation with a preserved cytokine response to anti-PD-1 therapy, whereas patients with a higher abundance of Bacteroidales in the gut microbiome had higher levels of regulatory T cells (Treg) and myeloid derived suppressor cells (MDSC) in the systemic circulation, with a blunted cytokine response (Fig. 4D and figs. S22 and S23). To better understand the influence of compositional differences in the gut microbiome on antigen processing and presentation within the tumor microenvironment, we next performed multiplex IHC targeting the myeloid compartment (38). In these studies, patients with a high abundance of Faecalibacterium in the gut microbiome had a higher density of immune cells and markers of antigen processing and presentation compared to those with a high abundance of Bacteroidales (Fig. 4, E and F, and figs. S24 and S25), suggesting a possible mechanism through which the gut microbiome may modulate anti-tumor immune responses (12), though this must be validated in a larger cohort.
To investigate a causal link between a “favorable” gut microbiome and response to immune checkpoint blockade, we performed Fecal Microbiome Transplantation (FMT) experiments in germ-free recipient mice (Fig. 4G). In these studies, mice that were transplanted with stool from R to anti-PD-1 therapy (R-FMT) had significantly reduced tumor growth (p=0.04, Fig. 4H and fig. S26A) by day 14 compared to those transplanted with stool from NR (NR-FMT). Importantly, mice transplanted with R-FMT also exhibited improved responses to anti-PD-L1 therapy (Fig. 4I) in contrast to mice that were transplanted with stool from NR (NR-FMT). Next we performed 16S sequencing on fecal samples collected from mice treated with FMT, demonstrating that R-FMT mice also had significantly higher abundance of Faecalibacterium in their gut microbiome (p<0.01) (fig. S27). We also wanted to better understand the mechanism through which the gut microbiome may influence systemic and anti-tumor immune responses, and performed correlative studies on tumors, peripheral blood and spleens from these mice. These studies demonstrated that tumors of mice receiving R-FMT had a higher density of CD8+ T cells than mice receiving NR-FMT, consistent with human data (Fig. 4J and fig. S26B, top series). Analysis of CD45+ myeloid and lymphoid tumor infiltrating cells by flow cytometry confirmed this result (fig. S26C). Moreover, FMT from R locally increased the number of CD45+ immune and CD8+ T cells in the gut compared to NR-FMT (Fig. 4K and fig. S26B, bottom series). Mass cytometry analysis using t-SNE dimension reduction was performed on tumors from mice, and demonstrated up-regulation of PD-L1 in the tumor microenvironment of mice receiving R-FMT versus NR-FMT (fig. S26D), suggesting the development of a “hot” tumor microenvironment. Further phenotypic studies of tumor immune infiltrates revealed a significant enrichment of innate effector cells (expressing CD45+CD11b+Ly6G+) in mice receiving R-FMT (fig. S26E). A lower frequency of suppressive myeloid cells (expressing CD11b+CD11c+) was observed in mice receiving R-FMT compared to mice receiving NR-FMT (fig. S26F). Finally, an increase in the frequency of RORγT+ Th17 cells in the tumor was also detected in NR-FMT mice (fig. S26G), in line with what we observed in tumors from patients who failed to respond to anti-PD-1 therapy. Mice receiving NR-FMT also had higher levels of regulatory CD4+ FoxP3+ T cells (fig. S26H) and CD4+ IL-17+ (fig. S26I) cells in the spleen, suggesting impaired host immune responses.
Our results indicate that the gut microbiome may modulate responses to anti PD-1 immunotherapy in melanoma patients. We propose that patients with a “favorable” gut microbiome (e.g., high diversity and abundance of Ruminococcaceae/Faecalibacterium) have enhanced systemic and anti-tumor immune responses mediated by increased antigen presentation, and improved effector T cell function in the periphery and the tumor microenvironment. In contrast, patients with an “unfavorable” gut microbiome (e.g., low diversity and high relative abundance of Bacteroidales) have impaired systemic and anti-tumor immune responses mediated by limited intratumoral lymphoid and myeloid infiltration and weakened antigen presentation capacity. These findings highlight the therapeutic potential of modulating the gut microbiome in patients receiving checkpoint blockade immunotherapy, and warrant prompt evaluation in cancer patients through clinical trials.
Supplementary Material
Acknowledgments
The data reported in this paper are tabulated in the main text and Supplementary Materials. The authors wish to acknowledge all patients and families affected by melanoma. J.A.W. is supported by the Binational Science Foundation, the Melanoma Research Alliance, Stand Up To Cancer, an Institutional Research Grant, a Multidisciplinary Research Program Grant, and MD Anderson’s Melanoma Moon Shot Program. This project was supported by the generous philanthropic contributions to The University of Texas MD Anderson Melanoma Moon Shots program. J.A.W, P.S and J.P.A are members of the Parker Institute for Cancer Immunotherapy at M. D. Anderson Cancer Center. A.R. is supported by the Kimberley Clarke Foundation Award for Scientific Achievement provided by the Odyssey Fellowship program at The University of Texas MD Anderson Cancer Center. K.L.H. is supported by the NCI/NIH under Award Numbers CA016672 (PI: Ronald DePinho, M.D.) and R25CA057730 (PI: Shine Chang, Ph.D.). J.E.L. is supported by philanthropic contributions to the University of Texas MD Anderson Cancer Center Moon Shots Program, The University of Texas MD Anderson Cancer Center Various Donors Melanoma and Skin Cancers Priority Program Fund, the Miriam and Jim Mulva Research Fund, the McCarthy Skin Cancer Research Fund and the Marit Peterson Fund for Melanoma Research. The authors acknowledge the Miriam and Sheldon G. Adelson Medical Research Foundation for their support of MD Anderson’s Biospecimen Collection team. L.M.C acknowledges a Stand Up To Cancer – Lustgarten Foundation Pancreatic Cancer Convergence Dream Team Translational Research Grant, support from the NIH/NCI, and the Brenden-Colson Center for Pancreatic Health. T.T. acknowledges the Oregon Clinical and Translational Research Institute (OCTRI) from the National Center for Advancing Translational Sciences (NCATS) at the NIH (NIH, #UL1TR000128). J.A.W. acknowledges Christine Diaz for administrative support. Fecal, oral and murine 16S, and fecal WGS data are available from the European Nucelotide Archive under accession numbers PRJEB22894, PRJEB22874, PRJEB22895 and PRJEB22893 respectively. Human WES data are available from the European Genome-phenome Archive under accession number EGAS00001002698. J.A.W and V.G. are inventors on a patent application (PCT/US17/53717) submitted by The University of Texas MD Anderson Cancer Center that covers methods to enhance checkpoint blockade therapy by the microbiome. T.T. and L.M.C are inventors on a patent (WO 2017/087847) held by Oregon Health and Science University that covers the multiplex technology. M.A.D. is an advisory board member for Bristol-Myers Squibb, Novartis, GlaxoSmithKline, Roche/Genentech, Sanofi-Aventis, and Vaccinex and has received funding from GlaxoSmithKline, Roche/Genentech, Merck, AstraZeneca, and Sanofi-Aventis. A.J.L. is a consultant for MedImmune, Bristol-Myers Squibb, Novartis, and Merck, and has received research support from AstraZeneca/MedImmune. Z.A.C. is an employee of MedImmune and owns stock or options in AstraZeneca. J.E.G. is on the advisory board of Merck, and receives royalties from Mercator Therapeutics. S.P.P. has honoraria from Speaker’s bureau of Dava Oncology, Merck, and Bristol-Myers Squibb, and is an advisory board member for Amgen and Roche/Genentech. P.H. serves on the advisory board of Lion Biotechnologies and Immatics US. R.N.A. has received research support from Merck, Novartis and Bristol-Myers Squibb. P.S. is a consultant for Bristol-Myers Squibb, Jounce Therapeutics, Helsinn, and GlaxoSmithKline as well as a stockholder from Jounce Therapeutics. J.P.A. is a consultant and stockholder for Jounce Therapeutics, receives royalties from Bristol-Myers Squibb, and has intellectual property with Bristol-Myers Squibb and Merck. J.A.W. has received honoraria from Speakers’ bureau of Dava Oncology, Bristol-Myers Squibb, Illumina, and is an advisory board member for GlaxoSmithKline, Novartis, and Roche/Genentech.
Footnotes
The other authors declare no competing interests.
References and Notes
- 1.Schadendorf D, Hodi FS, Robert C, Weber JS, Margolin K, Hamid O, Patt D, Chen T-T, Berman DM, Wolchok JD. Pooled analysis of long-term survival data from phase II and phase III trials of ipilimumab in unresectable or metastatic melanoma. J. Clin. Oncol. 2015;33:1889–1894. doi: 10.1200/JCO.2014.56.2736. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Robert C, et al. KEYNOTE-006 investigators. Pembrolizumab versus ipilimumab in advanced melanoma. N. Engl. J. Med. 2015;372:2521–2532. doi: 10.1056/NEJMoa1503093. [DOI] [PubMed] [Google Scholar]
- 3.Robert C, Long GV, Brady B, Dutriaux C, Maio M, Mortier L, Hassel JC, Rutkowski P, McNeil C, Kalinka-Warzocha E, Savage KJ, Hernberg MM, Lebbé C, Charles J, Mihalcioiu C, Chiarion-Sileni V, Mauch C, Cognetti F, Arance A, Schmidt H, Schadendorf D, Gogas H, Lundgren-Eriksson L, Horak C, Sharkey B, Waxman IM, Atkinson V, Ascierto PA. Nivolumab in previously untreated melanoma without BRAF mutation. N. Engl. J. Med. 2015;372:320–330. doi: 10.1056/NEJMoa1412082. [DOI] [PubMed] [Google Scholar]
- 4.Vesely MD, Schreiber RD. Cancer immunoediting: Antigens, mechanisms, and implications to cancer immunotherapy. Ann. N. Y. Acad. Sci. 2013;1284:1–5. doi: 10.1111/nyas.12105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Topalian SL, Drake CG, Pardoll DM. Immune checkpoint blockade: A common denominator approach to cancer therapy. Cancer Cell. 2015;27:450–461. doi: 10.1016/j.ccell.2015.03.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Tran E, Robbins PF, Rosenberg SA. ‘Final common pathway’ of human cancer immunotherapy: Targeting random somatic mutations. Nat. Immunol. 2017;18:255–262. doi: 10.1038/ni.3682. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Bachireddy P, Burkhardt UE, Rajasagi M, Wu CJ. Haematological malignancies: At the forefront of immunotherapeutic innovation. Nat. Rev. Cancer. 2015;15:201–215. doi: 10.1038/nrc3907. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Garrett WS. Cancer and the microbiota. Science. 2015;348:80–86. doi: 10.1126/science.aaa4972. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Segre JA. Microbial growth dynamics and human disease. Science. 2015;349:1058–1059. doi: 10.1126/science.aad0781. [DOI] [PubMed] [Google Scholar]
- 10.Drewes JL, Housseau F, Sears CL. Sporadic colorectal cancer: Microbial contributors to disease prevention, development and therapy. Br. J. Cancer. 2016;115:273–280. doi: 10.1038/bjc.2016.189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Paulos CM, Wrzesinski C, Kaiser A, Hinrichs CS, Chieppa M, Cassard L, Palmer DC, Boni A, Muranski P, Yu Z, Gattinoni L, Antony PA, Rosenberg SA, Restifo NP. Microbial translocation augments the function of adoptively transferred self/tumor-specific CD8+ T cells via TLR4 signaling. J. Clin. Invest. 2007;117:2197–2204. doi: 10.1172/JCI32205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Sivan A, Corrales L, Hubert N, Williams JB, Aquino-Michaels K, Earley ZM, Benyamin FW, Lei YM, Jabri B, Alegre M-L, Chang EB, Gajewski TF. Commensal Bifidobacterium promotes antitumor immunity and facilitates anti–PD-L1 efficacy. Science. 2015;350:1084–1089. doi: 10.1126/science.aac4255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Iida N, Dzutsev A, Stewart CA, Smith L, Bouladoux N, Weingarten RA, Molina DA, Salcedo R, Back T, Cramer S, Dai R-M, Kiu H, Cardone M, Naik S, Patri AK, Wang E, Marincola FM, Frank KM, Belkaid Y, Trinchieri G, Goldszmid RS. Commensal bacteria control cancer response to therapy by modulating the tumor microenvironment. Science. 2013;342:967–970. doi: 10.1126/science.1240527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Viaud S, Saccheri F, Mignot G, Yamazaki T, Daillère R, Hannani D, Enot DP, Pfirschke C, Engblom C, Pittet MJ, Schlitzer A, Ginhoux F, Apetoh L, Chachaty E, Woerther P-L, Eberl G, Bérard M, Ecobichon C, Clermont D, Bizet C, Gaboriau-Routhiau V, Cerf-Bensussan N, Opolon P, Yessaad N, Vivier E, Ryffel B, Elson CO, Doré J, Kroemer G, Lepage P, Boneca IG, Ghiringhelli F, Zitvogel L. The intestinal microbiota modulates the anticancer immune effects of cyclophosphamide. Science. 2013;342:971–976. doi: 10.1126/science.1240537. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Schwartz LH, Litière S, de Vries E, Ford R, Gwyther S, Mandrekar S, Shankar L, Bogaerts J, Chen A, Dancey J, Hayes W, Hodi FS, Hoekstra OS, Huang EP, Lin N, Liu Y, Therasse P, Wolchok JD, Seymour L. RECIST 1.1–Update and clarification: From the RECIST committee. Eur. J. Cancer. 2016;62:132–137. doi: 10.1016/j.ejca.2016.03.081. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Snyder A, Makarov V, Merghoub T, Yuan J, Zaretsky JM, Desrichard A, Walsh LA, Postow MA, Wong P, Ho TS, Hollmann TJ, Bruggeman C, Kannan K, Li Y, Elipenahli C, Liu C, Harbison CT, Wang L, Ribas A, Wolchok JD, Chan TA. Genetic basis for clinical response to CTLA-4 blockade in melanoma. N. Engl. J. Med. 2014;371:2189–2199. doi: 10.1056/NEJMoa1406498. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Sharma P, Retz M, Siefker-Radtke A, Baron A, Necchi A, Bedke J, Plimack ER, Vaena D, Grimm M-O, Bracarda S, Arranz JÁ, Pal S, Ohyama C, Saci A, Qu X, Lambert A, Krishnan S, Azrilevich A, Galsky MD. Nivolumab in metastatic urothelial carcinoma after platinum therapy (CheckMate 275): A multicentre, single-arm, phase 2 trial. Lancet Oncol. 2017;18:312–322. doi: 10.1016/S1470-2045(17)30065-7. [DOI] [PubMed] [Google Scholar]
- 18.Chen PL, Roh W, Reuben A, Cooper ZA, Spencer CN, Prieto PA, Miller JP, Bassett RL, Gopalakrishnan V, Wani K, De Macedo MP, Austin-Breneman JL, Jiang H, Chang Q, Reddy SM, Chen W-S, Tetzlaff MT, Broaddus RJ, Davies MA, Gershenwald JE, Haydu L, Lazar AJ, Patel SP, Hwu P, Hwu W-J, Diab A, Glitza IC, Woodman SE, Vence LM, Wistuba II, Amaria RN, Kwong LN, Prieto V, Davis RE, Ma W, Overwijk WW, Sharpe AH, Hu J, Futreal PA, Blando J, Sharma P, Allison JP, Chin L, Wargo JA. Analysis of immune signatures in longitudinal tumor samples yields insight into biomarkers of response and mechanisms of resistance to immune checkpoint blockade. Cancer Discov. 2016;6:827–837. doi: 10.1158/2159-8290.CD-15-1545. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Roh W, Chen P-L, Reuben A, Spencer CN, Prieto PA, Miller JP, Gopalakrishnan V, Wang F, Cooper ZA, Reddy SM, Gumbs C, Little L, Chang Q, Chen W-S, Wani K, De Macedo MP, Chen E, Austin-Breneman JL, Jiang H, Roszik J, Tetzlaff MT, Davies MA, Gershenwald JE, Tawbi H, Lazar AJ, Hwu P, Hwu W-J, Diab A, Glitza IC, Patel SP, Woodman SE, Amaria RN, Prieto VG, Hu J, Sharma P, Allison JP, Chin L, Zhang J, Wargo JA, Futreal PA. Integrated molecular analysis of tumor biopsies on sequential CTLA-4 and PD-1 blockade reveals markers of response and resistance. Sci. Transl. Med. 2017;9 doi: 10.1126/scitranslmed.aah3560. eaah3560. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Van Allen EM, Miao D, Schilling B, Shukla SA, Blank C, Zimmer L, Sucker A, Hillen U, Foppen MHG, Goldinger SM, Utikal J, Hassel JC, Weide B, Kaehler KC, Loquai C, Mohr P, Gutzmer R, Dummer R, Gabriel S, Wu CJ, Schadendorf D, Garraway LA. Genomic correlates of response to CTLA-4 blockade in metastatic melanoma. Science. 2015;350:207–211. doi: 10.1126/science.aad0095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.McGranahan N, Furness AJS, Rosenthal R, Ramskov S, Lyngaa R, Saini SK, Jamal-Hanjani M, Wilson GA, Birkbak NJ, Hiley CT, Watkins TBK, Shafi S, Murugaesu N, Mitter R, Akarca AU, Linares J, Marafioti T, Henry JY, Van Allen EM, Miao D, Schilling B, Schadendorf D, Garraway LA, Makarov V, Rizvi NA, Snyder A, Hellmann MD, Merghoub T, Wolchok JD, Shukla SA, Wu CJ, Peggs KS, Chan TA, Hadrup SR, Quezada SA, Swanton C. Clonal neoantigens elicit T cell immunoreactivity and sensitivity to immune checkpoint blockade. Science. 2016;351:1463–1469. doi: 10.1126/science.aaf1490. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Hugo W, Zaretsky JM, Sun L, Song C, Moreno BH, Hu-Lieskovan S, Berent-Maoz B, Pang J, Chmielowski B, Cherry G, Seja E, Lomeli S, Kong X, Kelley MC, Sosman JA, Johnson DB, Ribas A, Lo RS. Genomic and transcriptomic features of response to anti-PD-1 therapy in metastatic melanoma. Cell. 2016;165:35–44. doi: 10.1016/j.cell.2016.02.065. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Johnson DB, Frampton GM, Rioth MJ, Yusko E, Xu Y, Guo X, Ennis RC, Fabrizio D, Chalmers ZR, Greenbowe J, Ali SM, Balasubramanian S, Sun JX, He Y, Frederick DT, Puzanov I, Balko JM, Cates JM, Ross JS, Sanders C, Robins H, Shyr Y, Miller VA, Stephens PJ, Sullivan RJ, Sosman JA, Lovly CM. Targeted next generation sequencing identifies markers of response to PD-1 blockade. Cancer Immunol. Res. 2016;4:959–967. doi: 10.1158/2326-6066.CIR-16-0143. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Rizvi NA, Hellmann MD, Snyder A, Kvistborg P, Makarov V, Havel JJ, Lee W, Yuan J, Wong P, Ho TS, Miller ML, Rekhtman N, Moreira AL, Ibrahim F, Bruggeman C, Gasmi B, Zappasodi R, Maeda Y, Sander C, Garon EB, Merghoub T, Wolchok JD, Schumacher TN, Chan TA. Mutational landscape determines sensitivity to PD-1 blockade in non-small cell lung cancer. Science. 2015;348:124–128. doi: 10.1126/science.aaa1348. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Muegge BD, Kuczynski J, Knights D, Clemente JC, González A, Fontana L, Henrissat B, Knight R, Gordon JI. Diet drives convergence in gut microbiome functions across mammalian phylogeny and within humans. Science. 2011;332:970–974. doi: 10.1126/science.1198719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Human Microbiome Project Consortium. Structure, function and diversity of the healthy human microbiome. Nature. 2012;486:207–214. doi: 10.1038/nature11234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Turnbaugh PJ, Bäckhed F, Fulton L, Gordon JI. Diet-induced obesity is linked to marked but reversible alterations in the mouse distal gut microbiome. Cell Host Microbe. 2008;3:213–223. doi: 10.1016/j.chom.2008.02.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Qin J, et al. MetaHIT Consortium. A human gut microbial gene catalogue established by metagenomic sequencing. Nature. 2010;464:59–65. doi: 10.1038/nature08821. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Taur Y, Jenq RR, Perales M-A, Littmann ER, Morjaria S, Ling L, No D, Gobourne A, Viale A, Dahi PB, Ponce DM, Barker JN, Giralt S, van den Brink M, Pamer EG. The effects of intestinal tract bacterial diversity on mortality following allogeneic hematopoietic stem cell transplantation. Blood. 2014;124:1174–1182. doi: 10.1182/blood-2014-02-554725. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Lozupone C, Lladser ME, Knights D, Stombaugh J, Knight R. UniFrac: An effective distance metric for microbial community comparison. ISME J. 2011;5:169–172. doi: 10.1038/ismej.2010.133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Segata N, Izard J, Waldron L, Gevers D, Miropolsky L, Garrett WS, Huttenhower C. Metagenomic biomarker discovery and explanation. Genome Biol. 2011;12:R60. doi: 10.1186/gb-2011-12-6-r60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Peled JU, Devlin SM, Staffas A, Lumish M, Khanin R, Littmann ER, Ling L, Kosuri S, Maloy M, Slingerland JB, Ahr KF, Porosnicu Rodriguez KA, Shono Y, Slingerland AE, Docampo MD, Sung AD, Weber D, Alousi AM, Gyurkocza B, Ponce DM, Barker JN, Perales M-A, Giralt SA, Taur Y, Pamer EG, Jenq RR, van den Brink MRM. Intestinal microbiota and relapse after hematopoietic-cell transplantation. J. Clin. Oncol. 2017;35:1650–1659. doi: 10.1200/JCO.2016.70.3348. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Chaput N, Lepage P, Coutzac C, Soularue E, Le Roux K, Monot C, Boselli L, Routier E, Cassard L, Collins M, Vaysse T, Marthey L, Eggermont A, Asvatourian V, Lanoy E, Mateus C, Robert C, Carbonnel F. Baseline gut microbiota predicts clinical response and colitis in metastatic melanoma patients treated with ipilimumab. Ann. Oncol. 2017;28:1368–1379. doi: 10.1093/annonc/mdx108. [DOI] [PubMed] [Google Scholar]
- 34.Caspi R, Foerster H, Fulcher CA, Kaipa P, Krummenacker M, Latendresse M, Paley S, Rhee SY, Shearer AG, Tissier C, Walk TC, Zhang P, Karp PD. The MetaCyc Database of metabolic pathways and enzymes and the BioCyc collection of Pathway/Genome Databases. Nucleic Acids Res. 2008;36:D623–D631. doi: 10.1093/nar/gkm900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Kanehisa M, Goto S. KEGG: Kyoto encyclopedia of genes and genomes. Nucleic Acids Res. 2000;28:27–30. doi: 10.1093/nar/28.1.27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Blacher E, Levy M, Tatirovsky E, Elinav E. Microbiome-modulated metabolites at the interface of host immunity. J. Immunol. 2017;198:572–580. doi: 10.4049/jimmunol.1601247. [DOI] [PubMed] [Google Scholar]
- 37.Tumeh PC, Harview CL, Yearley JH, Shintaku IP, Taylor EJM, Robert L, Chmielowski B, Spasic M, Henry G, Ciobanu V, West AN, Carmona M, Kivork C, Seja E, Cherry G, Gutierrez AJ, Grogan TR, Mateus C, Tomasic G, Glaspy JA, Emerson RO, Robins H, Pierce RH, Elashoff DA, Robert C, Ribas A. PD-1 blockade induces responses by inhibiting adaptive immune resistance. Nature. 2014;515:568–571. doi: 10.1038/nature13954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Tsujikawa T, Kumar S, Borkar RN, Azimi V, Thibault G, Chang YH, Balter A, Kawashima R, Choe G, Sauer D, El Rassi E, Clayburgh DR, Kulesz-Martin MF, Lutz ER, Zheng L, Jaffee EM, Leyshock P, Margolin AA, Mori M, Gray JW, Flint PW, Coussens LM. Quantitative multiplex immunohistochemistry reveals myeloid-inflamed tumor-immune complexity associated with poor prognosis. Cell Reports. 2017;19:203–217. doi: 10.1016/j.celrep.2017.03.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Human Microbiome Project Consortium. A framework for human microbiome research. Nature. 2012;486:215–221. doi: 10.1038/nature11209. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Caporaso JG, Lauber CL, Walters WA, Berg-Lyons D, Huntley J, Fierer N, Owens SM, Betley J, Fraser L, Bauer M, Gormley N, Gilbert JA, Smith G, Knight R. Ultra-high-throughput microbial community analysis on the Illumina HiSeq and MiSeq platforms. ISME J. 2012;6:1621–1624. doi: 10.1038/ismej.2012.8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Rognes T, Flouri T, Nichols B, Quince C, Mahé F. VSEARCH: A versatile open source tool for metagenomics. PeerJ. 2016;4:e2584. doi: 10.7717/peerj.2584. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Edgar RC. Search and clustering orders of magnitude faster than BLAST. Bioinformatics. 2010;26:2460–2461. doi: 10.1093/bioinformatics/btq461. [DOI] [PubMed] [Google Scholar]
- 43.Edgar RC. UPARSE: Highly accurate OTU sequences from microbial amplicon reads. Nat. Methods. 2013;10:996–998. doi: 10.1038/nmeth.2604. [DOI] [PubMed] [Google Scholar]
- 44.DeSantis TZ, Hugenholtz P, Larsen N, Rojas M, Brodie EL, Keller K, Huber T, Dalevi D, Hu P, Andersen GL. Greengenes, a chimera-checked 16S rRNA gene database and workbench compatible with ARB. Appl. Environ. Microbiol. 2006;72:5069–5072. doi: 10.1128/AEM.03006-05. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Cole JR, Wang Q, Fish JA, Chai B, McGarrell DM, Sun Y, Brown CT, Porras-Alfaro A, Kuske CR, Tiedje JM. Ribosomal Database Project: Data and tools for high throughput rRNA analysis. Nucleic Acids Res. 2014;42:D633–D642. doi: 10.1093/nar/gkt1244. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Quast C, Pruesse E, Yilmaz P, Gerken J, Schweer T, Yarza P, Peplies J, Glöckner FO. The SILVA ribosomal RNA gene database project: Improved data processing and web-based tools. Nucleic Acids Res. 2013;41:D590–D596. doi: 10.1093/nar/gks1219. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Caporaso JG, Bittinger K, Bushman FD, DeSantis TZ, Andersen GL, Knight R. PyNAST: A flexible tool for aligning sequences to a template alignment. Bioinformatics. 2010;26:266–267. doi: 10.1093/bioinformatics/btp636. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Schloss PD, Westcott SL, Ryabin T, Hall JR, Hartmann M, Hollister EB, Lesniewski RA, Oakley BB, Parks DH, Robinson CJ, Sahl JW, Stres B, Thallinger GG, Van Horn DJ, Weber CF. Introducing mothur: Open-source, platform-independent, community-supported software for describing and comparing microbial communities. Appl. Environ. Microbiol. 2009;75:7537–7541. doi: 10.1128/AEM.01541-09. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Price MN, Dehal PS, Arkin AP. FastTree 2—approximately maximum-likelihood trees for large alignments. PLOS ONE. 2010;5:e9490. doi: 10.1371/journal.pone.0009490. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Caporaso JG, Kuczynski J, Stombaugh J, Bittinger K, Bushman FD, Costello EK, Fierer N, Peña AG, Goodrich JK, Gordon JI, Huttley GA, Kelley ST, Knights D, Koenig JE, Ley RE, Lozupone CA, McDonald D, Muegge BD, Pirrung M, Reeder J, Sevinsky JR, Turnbaugh PJ, Walters WA, Widmann J, Yatsunenko T, Zaneveld J, Knight R. QIIME allows analysis of high-throughput community sequencing data. Nat. Methods. 2010;7:335–336. doi: 10.1038/nmeth.f.303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Yutin N, Galperin MY. A genomic update on clostridial phylogeny: Gram-negative spore formers and other misplaced clostridia. Environ. Microbiol. 2013;15:2631–2641. doi: 10.1111/1462-2920.12173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Lozupone C, Knight R. UniFrac: A new phylogenetic method for comparing microbial communities. Appl. Environ. Microbiol. 2005;71:8228–8235. doi: 10.1128/AEM.71.12.8228-8235.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Morgan XC, Huttenhower C. Chapter 12: Human microbiome analysis. PLOS Comput. Biol. 2012;8:e1002808. doi: 10.1371/journal.pcbi.1002808. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Chao A. Nonparametric estimation of the number of classes in a population. Scand. J. Stat. 1984;11:265–270. [Google Scholar]
- 55.Simpson EH. Measurement of diversity. Nature. 1949;163:688–688. doi: 10.1038/163688a0. [DOI] [Google Scholar]
- 56.Shannon CE. A mathematical theory of communication. Mob. Comput. Commun. Rev. 2001;5:3–55. doi: 10.1145/584091.584093. [DOI] [Google Scholar]
- 57.Shannon CE, Weaver W. A mathematical theory of communication. Bell Syst. Tech. J. 1948;27:623–656. doi: 10.1002/j.1538-7305.1948.tb00917.x. [DOI] [Google Scholar]
- 58.Shannon PT, Grimes M, Kutlu B, Bot JJ, Galas DJ. RCytoscape: Tools for exploratory network analysis. BMC Bioinformatics. 2013;14:217. doi: 10.1186/1471-2105-14-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Li J, et al. MetaHIT Consortium. An integrated catalog of reference genes in the human gut microbiome. Nat. Biotechnol. 2014;32:834–841. doi: 10.1038/nbt.2942. [DOI] [PubMed] [Google Scholar]
- 60.Langmead B, Salzberg SL. Fast gapped-read alignment with Bowtie 2. Nat. Methods. 2012;9:357–359. doi: 10.1038/nmeth.1923. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Cotillard A, et al. ANR MicroObes Consortium. Dietary intervention impact on gut microbial gene richness. Nature. 2013;500:585–588. doi: 10.1038/nature12480. [DOI] [PubMed] [Google Scholar]
- 62.Pons N, Batto J-M, Kennedy S, Almeida M, Boumezbeur F. paper presented at the Annual Conference of the JOBIM (Journées Ouvertes en Biologie, Informatique et Mathématique); Montpellier, France. 7 to 9 September 2010. [Google Scholar]
- 63.Nielsen HB, et al. MetaHIT Consortium. Identification and assembly of genomes and genetic elements in complex metagenomic samples without using reference genomes. Nat. Biotechnol. 2014;32:822–828. doi: 10.1038/nbt.2939. [DOI] [PubMed] [Google Scholar]
- 64.Li H, Durbin R. Fast and accurate short read alignment with Burrows-Wheeler transform. Bioinformatics. 2009;25:1754–1760. doi: 10.1093/bioinformatics/btp324. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.McKenna A, Hanna M, Banks E, Sivachenko A, Cibulskis K, Kernytsky A, Garimella K, Altshuler D, Gabriel S, Daly M, DePristo MA. The Genome Analysis Toolkit: A MapReduce framework for analyzing next-generation DNA sequencing data. Genome Res. 2010;20:1297–1303. doi: 10.1101/gr.107524.110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Cibulskis K, Lawrence MS, Carter SL, Sivachenko A, Jaffe D, Sougnez C, Gabriel S, Meyerson M, Lander ES, Getz G. Sensitive detection of somatic point mutations in impure and heterogeneous cancer samples. Nat. Biotechnol. 2013;31:213–219. doi: 10.1038/nbt.2514. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Ye K, Schulz MH, Long Q, Apweiler R, Ning Z. Pindel: A pattern growth approach to detect break points of large deletions and medium sized insertions from paired-end short reads. Bioinformatics. 2009;25:2865–2871. doi: 10.1093/bioinformatics/btp394. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Sachidanandam R, et al. International SNP Map Working Group. A map of human genome sequence variation containing 1.42 million single nucleotide polymorphisms. Nature. 2001;409:928–933. doi: 10.1038/35057149. [DOI] [PubMed] [Google Scholar]
- 69.1000 Genomes Project Consortium. An integrated map of genetic variation from 1,092 human genomes. Nature. 2012;491:56–65. doi: 10.1038/nature11632. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Lek M, et al. Exome Aggregation Consortium. Analysis of protein-coding genetic variation in 60,706 humans. Nature. 2016;536:285–291. doi: 10.1038/nature19057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Fu W, O’Connor TD, Jun G, Kang HM, Abecasis G, Leal SM, Gabriel S, Rieder MJ, Altshuler D, Shendure J, Nickerson DA, Bamshad MJ, Akey JM NHLBI Exome Sequencing Project. Analysis of 6,515 exomes reveals the recent origin of most human protein-coding variants. Nature. 2013;493:216–220. doi: 10.1038/nature11690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Zhang T, Dutton-Regester K, Brown KM, Hayward NK. The genomic landscape of cutaneous melanoma. Pigment Cell Melanoma Res. 2016;29:266–283. doi: 10.1111/pcmr.12459. [DOI] [PubMed] [Google Scholar]
- 73.Cooper ZA, Reuben A, Spencer CN, Prieto PA, Austin-Breneman JL, Jiang H, Haymaker C, Gopalakrishnan V, Tetzlaff MT, Frederick DT, Sullivan RJ, Amaria RN, Patel SP, Hwu P, Woodman SE, Glitza IC, Diab A, Vence LM, Rodriguez-Canales J, Parra ER, Wistuba II, Coussens LM, Sharpe AH, Flaherty KT, Gershenwald JE, Chin L, Davies MA, Clise-Dwyer K, Allison JP, Sharma P, Wargo JA. Distinct clinical patterns and immune infiltrates are observed at time of progression on targeted therapy versus immune checkpoint blockade for melanoma. Oncoimmunology. 2016;5:e1136044. doi: 10.1080/2162402X.2015.1136044. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Blanche P, Dartigues JF, Jacqmin-Gadda H. Estimating and comparing time-dependent areas under receiver operating characteristic curves for censored event times with competing risks. Stat. Med. 2013;32:5381–5397. doi: 10.1002/sim.5958. [DOI] [PubMed] [Google Scholar]
- 75.Fritz CO, Morris PE, Richler JJ. Effect size estimates: Current use, calculations, and interpretation. J. Exp. Psychol. Gen. 2012;141:2–18. doi: 10.1037/a0024338. [DOI] [PubMed] [Google Scholar]
- 76.R Development Core Team. R Foundation for Statistical Computing. Vienna, Austria: 2017. [Google Scholar]
- 77.National Research Council. Guide for the Care and Use of Laboratory Animals. 8. National Academies Press; 2011. pp. 1–220. [PubMed] [Google Scholar]
- 78.Cooper ZA, Juneja VR, Sage PT, Frederick DT, Piris A, Mitra D, Lo JA, Hodi FS, Freeman GJ, Bosenberg MW, McMahon M, Flaherty KT, Fisher DE, Sharpe AH, Wargo JA. Response to BRAF inhibition in melanoma is enhanced when combined with immune checkpoint blockade. Cancer Immunol. Res. 2014;2:643–654. doi: 10.1158/2326-6066.CIR-13-0215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Amir ED, Davis KL, Tadmor MD, Simonds EF, Levine JH, Bendall SC, Shenfeld DK, Krishnaswamy S, Nolan GP, Pe’er D. viSNE enables visualization of high dimensional single-cell data and reveals phenotypic heterogeneity of leukemia. Nat. Biotechnol. 2013;31:545–552. doi: 10.1038/nbt.2594. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.