Abstract
The use of genome-wide data in cancer research, for the identification of groups of patients with similar molecular characteristics, has become a standard approach for applications in therapy-response, prognosis-prediction, and drug-development. To progress in these applications, the trend is to move from single genome-wide measurements in a single cancer-type towards measuring several different molecular characteristics across multiple cancer-types. Although current approaches shed light on molecular characteristics of various cancer-types, detailed relationships between patients within cancer clusters are unclear. We propose a novel multi-omic integration approach that exploits the joint behavior of the different molecular characteristics, supports visual exploration of the data by a two-dimensional landscape, and inspection of the contribution of the different genome-wide data-types. We integrated 4,434 samples across 19 cancer-types, derived from TCGA, containing gene expression, DNA-methylation, copy-number variation and microRNA expression data. Cluster analysis revealed 18 clusters, where three clusters showed a complex collection of cancer-types, squamous-cell-carcinoma, colorectal cancers, and a novel grouping of kidney-cancers. Sixty-four samples were identified outside their tissue-of-origin cluster. Known and novel patient subgroups were detected for Acute Myeloid Leukemia’s, and breast cancers. Quantification of the contributions of the different molecular types showed that substructures are driven by specific (combinations of) molecular characteristics.
With rapidly increasing availability of novel therapeutic options, like targeted therapies for tumor-driving signal transduction pathways and revolutionary immunotherapies, there is an urgent clinical need to match these therapies to specific groups of patients, in order to maximize patient benefit. Conventionally, cancer subtyping, prognosis assessment, and therapy choice for cancer patients are based on standard histopathology, such as pathological stainings for KI67, ER, PR and Her2 in the case of breast cancer1, or identifying EGFR, BRAF, and KRAS mutations in colorectal or lung cancer2. High throughput technologies, such as microarrays and next-generation sequencing, have opened new possibilities for biomarker discovery and cancer subtyping, by moving from single gene analysis to an analysis encompassing the whole genome and/or transcriptome3,4. For instance, transcriptional breast cancer signatures have been associated with clinical outcome5. Remarkably, patient groups identified using either genomic mutations or expression signatures often show poor concordance. This is for example apparent in Acute Myeloid Leukemias where the largest group of patients have normal karyotypes with point mutations (e.g, FLT3ITD, NPM1, IDH1/IDH2 or KRAS/NRAS) and do not cluster on mutation status using gene expression profiles6. A lack of cluster robustness across different molecular data-types complicates treatment choice. Hence, there is a need for integrative analyses of genome-wide datasets across different molecular data-types to reach a unified and more robust cancer subtyping.
Besides analyzing each molecular data-type separately, integration of transcriptomic architectures with other types of molecular data (e.g., single-nucleotide polymorphisms7, DNA-methylation8,9, or copy-number variation10) is heavily researched and has shown to improve patient characterization and subtyping. The simple hypothesis is that each molecular characteristic provides a different perspective of the same disease, and integration of complementary data should give more comprehensive insights in the disease state. Therefore, many studies step away from single data-type analysis and develop methods to integrate various data-types to improve disease characterisation11,12,13,14.
State-of-the-art approaches to improve cancer characterization and patient subtyping incorporate multiple molecular genome-wide data-types, but also multiple cancerous tissues (pan-cancer). It is believed that such a pan-cancer approach can reveal common mechanisms of cancerous cells that could substantially improve the success of targeted therapies. A special case is the group of metastatic cancers identified as samples with unknown primary origin, which have been shown to account for 3% to 5% of all cancers15,16. The Cancer Genome Atlas project17 (TCGA) provides multiple types of molecular data for 34 different cancerous tissues. Exploiting multi-omic pan-cancer data does, however, require novel data integration methods18,19.
Data integration can be performed in three ways: early (concatenation-based), intermediate (transformation-based) and late (model-based) stage integration18. Recently, for patient subtyping on multi-omic pan-cancer data, the late stage integration approach (data integration after analyses of each molecular data-type separately) was used20. Although many novel insights were gained, and it outperformed other methods21,22, the approach still describes the patient relationships for each of the measured molecular characteristics separately, while a majority vote decides on the final clustering. Alternatively, an early or intermediate stage integration approach would be more powerful, because it can capture interactions between different molecular data-types. As an example, in AML it has been shown that modeling the joint effect of different molecular characteristics has advantages in subtype discovery and prediction8,9. Hence, it seems more reasonable to integrate data earlier. Such an approach is methodologically more complex, since the molecular data-types have different data distributions, and types with an excessive number of features can dominate the results.
Patient relationships are commonly described using tree-based clustering approaches, with the result that relationships between similar patients are difficult to interpret. As an example, it has been shown that hundreds of squamous-like-tissue samples cluster strongly together20, but it is unclear whether there is any substructure among these patient samples. Insights in the similarities between similar samples are important to further refine subgroups of patients with similar genome-wide characteristics. Alternatively, patient samples can be visualized in a low-dimensional map (e.g. in two dimensions) by employing, for instance, a principal component analysis (PCA) and exploring the similarities between the samples in the 2D-map14,23. However, PCA puts emphasis on finding dissimilar samples, rather than similar samples24. Therefore, another approach should be followed when studying the relationships between samples within and across cancer subtypes.
We propose a novel omic integration method, called MEREDITH, which is a hybrid of an early stage (concatenation-based) and intermediate stage (transformation-based) integration approach. Our approach allows for visualization and analysis of samples in a 2D-map that emphasizes similarities between similar samples, and quantifies the contribution of each molecular data-type across the genome-wide dataset. We collectively analyzed 4,434 specimens from 19 cancers by integrating same-sample measurements across different molecular characteristics, and demonstrate that MEREDITH detects known global pan-cancer clusters as well as within-tissue-of-origin clusters. We report putative novel cancer subtypes, and identify patients with unknown primary tumor of origin, for which we show that only a subset has significantly poor prognosis. Finally, we systematically quantified the contribution of each molecular data-type in the multi-omic approach, demonstrating the importance of each data-type for pan-cancer and within-tissue-of-origin cancer subtyping. Software is freely available on request and the cancer map can be explored interactively at http://pancancer-map.ewi.tudelft.nl.
Results
MEREDITH: multi-omic data integration approach
We devised a novel multi-omic data integration approach (MEREDITH) to identify similarities among 4,434 patients taken from The Cancer Genome Atlas (TCGA)17 across 19 cancer-types based on genome-wide measurements of four different molecular characteristics: gene expression (GE; 18,882 features), DNA-methylation (ME; 11,429 features), copy-number variation (CN; 23,638 features) and microRNA expression (MIR; 467 features). MEREDITH is able to find similarities between samples across all molecular data-types simultaneously in seven principal steps (Fig. 1). First, features of each molecular data-type are mapped to the corresponding genes and a principal component analysis (PCA) is applied per dataset of a particular molecular type for an initial dimensionality reduction. We retained the 50 PCs with the highest eigenvalues for each data-type, which is a parameter setting that users can change (explained variance for GE, ME, CN and MIR is 74%, 66%, 73%, and 89% respectively). Note that similar results are obtained when retaining the PCs that explain 95% of the variance, see supplement for more details (Fig. S1). The contributions per molecular data-type are scaled using the total variance of each of their respective set of 50 PCs to ensure that the final integrated result is not dominated by a single data-type (See supplementary method for more details). Next, the reduced features for each of the four types of molecular data are concatenated, resulting in a 200 dimensional (200D) space in which the samples are represented. Then, samples are mapped to a two-dimensional multi-omic map (MO-map, Fig. 2a) using t-distributed stochastic neighborhood embedding (t-SNE)25. Here we used the fast Barnes-Hut t-SNE26, which non-linearly retains local similarities between samples instead of focusing on the similarities between dissimilar samples. The resulting multi-omic map allows for subsequent analyses, such as cluster analysis, contribution analysis of the different molecular data-types, or patient survival analysis. It should be noted that the MO-map is determined by a stochastic mapping, resulting in different mappings for different initializations. We used the solution with the lowest Kullback–Leibler divergence after running Barnes-Hut t-SNE 1000 times. In addition, the axes in the MO-map are meaningless since samples are positioned in such a way that “only” their similarities are being preserved.
MO-map reflects original sample distributions faithfully
We first quantified the conservation of local similarities among samples in the MO-map using a measure of local similarity reflecting the percentage of overlapping neighboring samples (Methods section and Supplementary Fig. S2). The (2D) MO-map showed high local similarity (64%) with the 200D space, spanned by the PCs of the different types of molecular data (Supplementary Fig. S3b), indicating that the output of the t-SNE algorithm accurately represents smaller distances of the samples in their high-dimensional space. We also compared the MO-map to that of a higher order t-SNE map (6D), and detected strong preservation of neighboring relationships (81%, Supplementary Fig. S3c). In contrast, inspection of the first two principal components (with the highest eigenvalue) yielded a low local similarity compared to the MO-map (39%, Supplementary Fig. S3d) and poor separation of the 19 cancer-tissues (Supplementary Fig. S3a). Note that the principal components represent a linear combination of all features based on the four omic data sets (loadings are demonstrated in supplementary Fig. S2a). This indicates that the local structure of the data cannot be preserved by mapping the 200D data to a 2D space using a linear method like PCA (44% similarity, Supplementary Fig. S3e) that equally weighs similar and dissimilar samples.
Unsupervised pan-cancer clustering detects known and novel data structures
Unsupervised clustering of the MO-map revealed 18 clusters (Fig. 2a, based on DBSCAN with the Davies-Bouldin index score for selecting the number of clusters, more details in Methods section). The 18 clusters are subsequently associated with the cancer-type labels by assessing the overrepresentation of each cancer-type within each cluster (Fig. 2b, P < 0.001) Out of the 18 clusters, 15 showed a near one-to-one relationship with the cancer-tissue-of-origin (Fig. 2b). Moreover, we confirmed the near one-to-one relationship by testing whether the t-SNE distances between samples from the same tissue-of-origin are significantly smaller than randomly chosen samples (P < 1 × 10−4, Supplementary Fig. S4, Methods section). Patient clustering on the 2D MO-map created by MEREDITH showed high accordance with conventional clustering based on the 200D PCA space (cophenetic correlation27 of 0.46, Fig. 2c), and is in line with previously published analyses of TCGA data16,20. The three detected clusters without a clear one-to-one relationship with tissue-of-origin contain a complex mixture of cancer samples from various cancer-types (Fig. 2, panel a,b), i.e., the squamous-like cancer samples (Cluster 2: BLCA, CESC, HNSC and LUSC), colorectal and pancreatic cancers (Cluster 4: COAD, READ and PAAD), and a putative novel subtype of kidney-related cancer samples (Cluster 9: KICH, KIRC and KIRP). Interestingly, although the detection of the cluster with the squamous-like-type cancer-tissue samples is consistent with previous results20, the MO-map clearly demonstrates that these cancer-tissues are not completely inseparable (Fig. 2a). Examination of Cluster 4, in which all samples are derived from the gastro-intestinal tract, revealed that especially COAD and READ cancer samples are placed together (Fig. 2a). The co-clustering of these two groups is in line with literature, where they are described as colorectal cancers28, for which mutations in the Wnt signaling pathway drive tumorigenesis29,30,31,32.
Although there is strong overlap between clusters obtained from the MO-map and those obtained by hierarchical clustering in the 200D space, there are differences in the structure of the dendrogram (Fig. 2c). In particular, specific samples destroy the balance of the dendrogram in the 200D space (in fact only 10 clusters are detected, based on optimizing the Davies-Bouldin index score, whereas there are 19 cancer-tissues based on the MO-map). Hence, by retaining the local similarity between samples (which is done by the t-SNE step in MEREDITH), we balance the general distribution of samples, improving their subsequent analysis. As a result, the MO-map supports visual exploration of both the distribution of clusters and of the individual samples.
To investigate the value of MEREDITH further, we evaluated the results of different clustering algorithms (DBSCAN33, Hierarchical Clustering, k-means, and Mixture of Gaussians34), and PCA between the samples in the low-dimensional MO-map and in their original high-dimensional representation (200D). MEREDITH showed highest tissue enrichment for 9 out of 19 cancer tissues (Fig. S5, Table S1), and lowest Davies-Bouldin scores (Fig. S5). This demonstrates that a reduction of data complexity, by a transformation step of samples into a low-dimensional space, is beneficial for follow-up analysis.
MO-map gives insight in joint behaviour of the different molecular data-types
To determine the contribution of the four molecular data-types in the MO-map, we systematically quantified the overlap of the k(=20)-nearest neighbours per sample in the MO-maps for each of the fourteen possible combinations with the neighbours in the MO-map based on all four molecular data-types (Methods section). By hierarchically clustering the overlap-percentage per sample for every combination, samples with a similar overlap-percentage across the different contributions of molecular data-types are grouped together, and thereby define a common genomic profile (depicted in Fig. 3a).
The Blue Cluster (denoted as any-profile) contains 222 samples and shows on average the same 20-nearest neighbors across all MO-maps; i.e. these samples group consistently together, no matter which combination of molecular data-types is taken. Cancer tissues that were significantly overrepresented in this group are DLBC, PAAD, ACC, LAML, and LGG (P < 0.001). For the Purple Cluster (n = 626) samples do not show consistent genomic patterns but rather a mixture of various combinations of molecular data-types for BLCA, LAML, and PRAD (P < 0.001). The Red (n = 807) and Green (n = 942) clusters include a ME or CN genomic profile, respectively. Hence, the clustering of these samples in the MO-map is mainly driven by either of these two molecular data-types. Samples with a ME genomic profile are significantly overrepresented with the cancer-types COAD, BRCA, KIRC, and LIHC (P < 0.001), whereas samples with the CN genomic profile are associated with COAD, KICH, KIRC, KIRP, LGG, and OV (P < 0.001). Interestingly, a deeper examination of the colorectal samples (COAD and READ), which initially showed no clear structure in the sample distribution (Fig. 2a), reveals now the underlying genomic profiles (Fig. 3a, within dashed box). This suggests that the sample distribution is based on differences in DNA-methylation and Copy number changes.
The Yellow Cluster contains 1,837 samples (41%) for which the local neighborhoods are unique to the MO-map based on all four molecular data-types (denoted as all-profile). These samples are located mainly in the “center” of the MO-map (Fig. 3b) and are significantly overrepresented among the cancer-types BRCA, HNSC, PRAD and BLCA (P < 0.001).
To evaluate the consistency of the genomic profiles of the samples, we reran MEREDITH with 100 random initializations to derive 100 MO-maps. The average overlap of the 100 MO-maps with the final MO-map is 78% based on the 20-nearest neighborhood (Supplementary Fig. S6). 502 samples (11.3%) had no consistent 20-nearest neighborhood, and these samples were mainly located in the Yellow Cluster (448/502, Fig. 3a,b indicated with the grey lines, and dots respectively). The remaining 1,389 (31.3%) samples in the Yellow Cluster are thus the result of a complex mix of molecular features (as their neighborhood is preserved and are thus not the result of mapping variation).
Interestingly, when comparing the overall survival (OS) of samples with a specific genomic profile to that of all other samples, we detected that samples from the Green Cluster (combinations with CN) have significant better OS in the log-rank test (P = 3.37 × 10−4, Fig. 3c). These results remained significant in the in the Cox proportional hazard ratio model where we corrected for the confounders age, sex and the six cancer-types that are significantly associated with CN (Pcox = 0.0428, HR = 0.831, 95% CI 0.69–0.99). Moreover, examination of exclusively the colorectal samples (Fig. 3b, dashed rectangle), showed that samples from the Yellow Cluster (based on all data-types) are associated with significantly inferior OS (P = 3.13 × 10−3, Fig. 3d). Together these results show that different combinations of molecular data-types contribute differently to the (sub)grouping in the MO-map, emphasizing the importance to analyze the distribution of samples after integrating the data over the different omic-datasets using MEREDITH.
MEREDITH reveals known and novel structures for Acute Myeloid Leukemia
Acute Myeloid Leukemia (AML) is a heterogenic hematological malignancy that can be dissected in subtypes that have prognostic value and determine therapy choice. In general, patients with AML are separated into three groups, i.e., patients with abnormal karyotype (e.g., translocations, t(8;21), t(15;17) or inversions inv(16)), normal karyotype (usually with point mutations in the genes FLT3ITD, NPM1, IDH1), and complex karyotype (with multiple (cyto)genetic abnormalities, e.g., 3q, 7q, and trisomy 8). These three groups are known to have good, intermediate and poor survival, respectively6,35,36.
Unsupervised clustering of the 167 AML patients, using MEREDITH, resulted in 11 clusters. Nine of these clusters were significantly associated with (cyto)genetic labels (P < 0.05, Fig. 4a, Supplementary Table S2). Only two clusters are not significantly enriched for any of the (cyto)genetic labels but rather are associated with FAB-classification37 M5 (Cluster 5), and M6 (Cluster 9).
The association of the clusters with (cyto)genetic labels demonstrates that the complex behavior of the known AML subtypes is accurately be captured in the MO-map (Fig. 4a). Overall, the grouping of samples is in line with previous results6,9,35, e.g., clustering of samples with: i) t(8;21), Cluster 4; ii) t(15;17), Cluster 11; iii) inv(16), Cluster 13; and iv) complex karyotype in Cluster 7. In addition, we could discern samples with different combinations of FLT3/NPM1 and IDH1 mutations, known to be associated with clinical outcome38,39. In addition, samples in Cluster 1, with IDH1 mutations and the genotype of mutated NPM1 without FLT3ITD, were recently discovered by solely looking at the genotypes39. Interestingly, our MO-map shows that IDH1 mutants can be further dissected in two different clusters based on the four molecular data-types (Cluster 1 and 8), which appear to have different OS (Fig. 4b). Although we cannot show its significance using the log-rank test (P = 0.09), further investigation with larger sets of samples may provide better characterization of this specific subgroup of AML.
Integrating multiple molecular data-types identifies the subtypes of AML cancers
To assess whether the 11 detected AML clusters (Fig. 4a) can also be discovered when analyzing the GE, ME, CN, and MIR genome-wide datasets separately, we used MEREDITH to analyze each of the four omic-datasets separately. For each molecular data-type we follow the same clustering procedure and cut the tree in 11 clusters (same number as when using MEREDITH on the four data-types combined), Each cluster for each data-type is then tested for significant overlap with any of the MEREDITH clusters (P < 0.001, Supplementary Table S2). There was no individual molecular data-type that could recover all 11 clusters identified by MEREDITH, indicating that the four molecular data-types contain complementary information. Note that the solutions provided by the four individual data-types are not necessarily incorrect but are rather different, or an incomplete perspective of the same disease. There was only one cluster, i.e., samples with a complex karyotype (Cluster 7) that grouped consistently together over all four molecular data-types. This is of interest as these samples are known to have a multitude of mutations, which appear to present themselves across all four molecular characteristics (Supplementary Table S2). In contrast, samples that grouped in the novel Cluster 9 are only seen by the CN data, highlighting that some differences have a highly specific origin. We also analyzed whether MEREDITH outperforms various PCA reductions (2D/3D/4D, and 200D) in terms of cluster enrichment for the AML subtypes. We detected that 6 out of 12 AML groups showed highest cluster enrichment using MEREDITH being comparable to the derived from the 200D PCA space (Table S3).
MEREDITH correctly identifies known subtype structure for breast cancers
Patients with breast cancer can be categorized into three general groups: 1) triple negative breast cancer dominated by basal type breast cancer (i.e., estrogen receptor negative (ER−), progesterone receptor negative (PR−), and human epidermal growth factor receptor-2 negative (HER-2); 2) the HER-2 subtype (ER−/PR−/HER2+); and 3) ER/PR positive breast cancer (ER+/PR+), which can be further subtyped based on mRNA profiling into luminal A (ER+/PR+/HER2−) and luminal B (ER+/PR+/HER2+)5. Despite the variation in prognosis between the different subtypes within each group, therapy choices are tuned to the three basic groups. It was already shown before that data integration revealed novel insights40,41,42, however unknown are the results in subtyping when integrating mRNA, DNA-methylation, microRNA and Copy number changes.
Subtype analysis of the 563 breast cancer samples using MEREDITH resulted in five distinct clusters (Fig. 5a) that were significantly associated with the known breast cancer subtypes: i) cluster 1 for the Luminal A subtype (P = 5.1 × 10−6); cluster 2 also for Luminal A (P = 6.2 × 10−4); iii) cluster 3 for the Basal subtype (P = 3.9 × 10−14); iv) cluster 4 for the Basal and HER2-type (P = 1.5 × 10−3 and P = 0.035 respectively); and v) cluster 5 for the Luminal B subtype (P = 1.6 × 10−6). Detailed clinical characteristics can be found in Supplementary Table S4. This clearly demonstrates that breast cancer subtypes can also be captured in the two-dimensional MO-map (Fig. 5a). In terms of overall survival, we detected that samples in Cluster 5 (enriched for Luminal B) have a significant inferior survival compared to samples outside the cluster (P = 0.026), with 5-year survival rates of 78% (Fig. 5b). Intriguingly, while both Clusters 1 and 2 include samples that are significantly associated with Luminal A, samples in Cluster 1 showed significantly good survival rates (P = 6 × 10−5), which was not seen of patients in Cluster 2.
Integrating multiple molecular data-types identifies subtypes of breast cancers
Similar to our analysis of the AML clusters, we analyzed whether the five breast cancer clusters identified using MEREDITH can be similarly discovered when analyzing the GE, ME, CN, and MIR datasets separately. We detected that the known breast cancer subtypes can be readily detected by analyzing solely gene expression profiles, i.e. 78% overlap between the 20-nearest neighbours of the samples in the gene expression map and the MO-map (based on the four molecular data-types). A cluster analysis revealed that all four data-types could recover the 5 clusters identified by MEREDITH (Fig. 5a, supplementary Table S4 and Fig. S7). However, there is an advantage of incorporating the four different data-types which can especially be seen in Cluster 1 and 2 (Fig. 5c). Both clusters are significantly enriched for Luminal A but their molecular makeup now clearly shows that only a specific set of samples group together when the four omic data sets is used. We also analyzed whether MEREDITH outperforms various PCA reductions (2D/3D/4D, and 200D) in terms of subtype enrichment. We detected that MEREDITH showed highest cluster enrichment for ER/PR/HER2/Luminal A, and Basal subtypes (Table S5).
To determine whether the subtypes of breast cancer (Fig. 5a) are affected by any of the five genomic profiles (Fig. 3a), we systematically assessed their enrichment for each of the breast cancer clusters (Fig. 5c). Samples of the Luminal B subtype were significantly enriched for the Yellow Cluster (i.e., combinations of all data-types, P = 2.97 × 10−4), whereas samples with the Basal subtype were significantly enriched for the Red Cluster (combinations with ME, P = 3.52 × 10−11). The associations with the genomic profiles explain the separation of Luminal A samples in the two distinct clusters (Cluster 1 and 2): samples in Cluster 1 are significantly enriched for the Yellow Cluster (all, P = 2.67 × 10−4), whereas samples in Cluster 2 are enriched for the Purple Cluster (various: P = 1.4 × 10−9) and Green Cluster (CN: P = 1.77 × 10−3). Taken together, we demonstrate that specific molecular data-types can drive sample grouping and possible reveal novel subtypes of breast cancer. As an example, subsets of samples in Cluster 2, 3 and 5 (Fig. 5c) are mainly driven by copy-number variations, which is known to be important in subtyping10, whereas subsets of samples cluster 3 and 4 are mainly driven by epigenetic changes.
Samples located outside the primary tissue-of-origin (COPs) can be divided into two distinct groups
Besides samples that fall into the matched tissue-cluster, we also detected samples that do not have a matched genome-wide profile with the cancer-tissue-of-origin cluster (Fig. 2, red and orange circled samples). Such cancer samples have previously been reported as cancer with unknown primary (CUP)15,16 but were left unnoticed in other pan-cancer studies20,43,44. Our MO-map demonstrates that not all of these cancer-tissue samples are necessarily of unknown primary, but many represent “Cancers Outside their Primary (COP)” because these samples can be located just outside the boundary of the cancer-tissue-of-origin cluster (Fig. 2).
There are 64 COP samples (1.44%, Fig. 2a) across 12 cancer-types (Fig. 2b). Three cancer-types (LUSC, KIRC and LUAD) showed a significant overrepresentation of COPs (P = 9.7091e-08, P = 1.6054e-04, and P = 0.0044, Fig. 2b). In contrast, seven cancer-types included no COPs (CESC, COAD, DLBC, LAML, PAAD, PRAD, and READ).
Because previous studies detected larger numbers of CUPs (3% to 5% of all cancers15), we analyzed the percentages of detected COPs across all other combinations of molecular data-types. The COP percentages ranged from 0.25% (CN) to 5.9% (ME) from which 14 samples were consistently detected as being a COP across all combinations. This suggests that not all COP samples may be the result of biological effects but may also be the result of type-specific technical effects.
COP samples were thought to be molecularly similar to the cell type of origin15. However, we could dissect the 64 COP samples into two major subgroups. Namely, samples that do cluster with another tissue-of-origin (COP-I), and samples located outside the annotated tissue-of-origin but without genomic similarities to any of the known cancer-type tissue labels (COP-II). The type-II COPs (n = 14) cluster at the edge of the squamous-like-type of cancers (Fig. 2a, Cluster 2), and were detected by running MEREDITH on the 64 COPs in isolation of the other samples (Supplementary Fig. S8a). In addition, the type-II COPs showed higher correlations among each other when analyzing the molecular data-types separately (Supplementary Fig. S8b). Strikingly, these COPs showed strongly reduced survival compared to the type-I COPs (log-rank P = 2.15 × 10−11, Fig. 6a), which remained significant after correction for potential confounders as listed in Fig. 6b (Pcox = 6.08 × 10−10, HR = 12.1, 95% CI 5.49–26.66). In contrast, the OS of the type-I COPs (n = 50) showed no significant differences compared to all other samples with matched tissue-of-origin (P = 0.16, and Pcox = 0.45, Fig. 6b).
We next analysed whether the 14 type-II COP samples have a specific pathway abnormality or co-expression network by comparing the gene expression profiles to all other samples. We first zero-mean normalized gene expression values per cancer to avoid detecting cancer-specific related gene expression profiles. When comparing the type-II COPs to all other samples, we detected 3,474 significantly differential expressed genes using Limma45 and multiple testing correction using Holm46 (P < 0.05). Pathway analysis on these genes showed association with well-known cancer biomarkers (Fig. 6c), such as a suppressor of retinoblastoma RB-P107 (P = 9.88 × 10−9), but also P53 (P = 5.98 × 10−7), LEF1 (P = 5.41 × 10−6), MEK (P = 2.63 × 10−6), E2F1 (P = 3.54 × 10−5), KRAS (P = 5.8 × 10−4) (detailed information can be found in Supplementary Table S6 and Methods section). We created a co-expression network by computing the pairwise Pearson correlations for the differentially expressed genes (only retaining genes with at least two correlating partners for which the correlation is higher than 0.6). This resulted in four distinct gene clusters (Fig. 6d), all significantly associated with known mechanisms to be disturbed in cancer cells, including: cell cycle pathway, RB-P107, immune system, and mRNA splicing pathways as shown in Clusters 1 to 4, respectively.
Discussion
We introduce a multi-omic integration approach, MEREDITH, which we applied to integrate four different types of molecular data: mRNA expression, DNA-methylation, microRNA, and copy-number changes. We analyzed 4,434 patients across 19 primary cancer-types and showed a strong similarity between samples with the same tissue-of-origin. Instead of analyzing the molecular data-types separately, as is the case with current state-of-the-art methods such as COCA20, MEREDITH creates a 2D MO-map of the samples based on all data-types, taking joint behavior into account. The 2D MO-map represents accurately the sample distributions in the high-dimensional measurement space, can easily be visually explored, and identifies robustly substructures in the data. For example, it has been demonstrated that hundreds of squamous-like-tissue samples cluster together20, but with MEREDITH we clearly demonstrate the substructure among these samples. Furthermore, we demonstrate novel grouping of samples in AML, breast cancer and COPs that has not been shown before.
It should be noted that, besides the similarly clustered samples, differences between clustering algorithms in the original space versus the low-dimensional space are also seen (Fig. S5). As an example, samples of the squamous-like-tissue are clustered using MEREDITH, and using hierarchical clustering in the original space (200D). However, when we cluster the low-dimensional space using K-means or hierarchical clustering, it can separate HNSC, CESC, LUSC, and BLCA (Fig. S5). Thus our presented low-dimensional space may also be used for the prediction of these separate cancer-tissues. In general, differences between results when using various clustering algorithms are insurmountable. A final biological interpretation remains an experts task for which our provided MO-map allows a more detailed examination of local substructures across and within the cancer-tissues.
MEREDITH resembles the MFA approach by Tayrac et al.14. Like them we follow a hybrid data integration where different data-types are merged after an initial principal component analysis for each data-type separately (to weigh their contributions equally). However, after this initial step we use stochastic neighborhood embedding instead of PCA analysis. We argued that for a low-dimensional embedding of the data (like the 2D-map that we propose) it is important to emphasize similarities between samples (as done by t-SNE) instead of emphasizing dissimilarities between samples (as done by PCA and advocated by Tayrac et al.). This principal change much better captures the different cancer (sub)types (Fig. 2a), and is representative for the sample distribution in high-dimensional space (supplement Fig. S3b,c), as opposed to using PCA in the second step (supplement Fig. S3a,d,e). Note that the PCA in the initial step captures most of the variability in each of the data-types so that the argument of keeping similar samples together is not relevant for this integration step. Tayrac et al. inspected the contributions of the different data-types by looking at the loading factors of the final PCA step. Although insightful, we show how a sample is influenced by molecular data-types by systematically evaluating all possible combinations of genomic data. As such, samples could be categorized into genomic profiles, and substructures can now be explained by their molecular makeup.
From a pan-cancer perspective we show that integrating molecular data-types can better separate cancer-tissue samples in well-defined clusters compared to analyzing only a single molecular data-type. To quantify the separability of all cancer-tissue samples by using a supervised-learning approach, we used each label (cancer-type) of a sample and assessed whether it could be predicted from the label of its closest neighbor. The MO-approach outperformed all single data set analyses (AUC = 0.94, Supplementary Fig. S9). However, slightly worse performance is obtained for GE, ME or MIR separately (AUC ≈ 0.93 for each of these data types), and relatively bad performance when using the CN data (AUC = 0.72). This indicates that for GE, ME and MIR only a small number of patients is misclassified when performing single data-type analysis. This is not the case for copy number changes that appear to be less informative. We speculate that the MO-approach is less sensitive to noise since it integrates over the different data types, and therefore retains patients in the tissue-of-origin cluster, whereas single data-type analysis mistakenly pushes away samples from the tissue-of-origin cluster. Thus combining data types, may not necessarily reveal novel clusters but it may prevent misclassifications. More details about single data type analysis versus MO-analysis can be found in supplementary materials (Single data type analysis versus MO-map). Although samples with similar cancers tend to group together in both the integrated map as well as the individual maps (Supplementary Figs S10–S13), there is an intriguing difference. Samples tend to cluster more densely in the integrated map, whereas samples in individual maps seem to “drift away” from the tissue-of-origin cluster. Nevertheless, it can be beneficial to analyze different combinations of molecular data-types to improve our understanding of the complex relationships between different cancer-tissue samples and their molecular make-up. For example, we detected that colon and rectal tissue samples are tangled together in a cluster. However, an analysis of the contributions of each of the molecular data-types provided insights in the separation between the two cancer-types. To support visual exploration of the contributions of the different data-types, we have made the maps of different combinations of molecular data-types available in an interactive browser at the following website: http://pancancer-map.ewi.tudelft.nl. This is especially useful when visually exploring subtypes of samples together with various sample annotations (gender, age, survival time etc), which we statically demonstrate for breast cancers in Fig. S7.
Initially we found that maps based on DNA-methylation profiles resulted in strong gender-based grouping within tissue-of-origin (Supplementary Fig. S14). The clear distinction between genders was also seen when analyzing copy-number profiles, however, in that case genders were grouped together across-tissue-of-origin (Supplementary Fig. S15). Although gender specific grouping is a known effect, e.g., males do have a tendency toward higher methylation levels47, we saw striking differences between DNA-methylation and copy-number changes and the effect on cancer subtyping. These differences were not prominently seen in the PCA-based maps (Supplementary Fig. S16 panel a,b), again showing the benefit of the multi-omic data integration as proposed by MEREDITH. Note that, to avoid gender-specific clustering, removal of features on the X and Y chromosomes is required (details regarding normalization can be found in methods section).
MEREDITH also detected cancers outside their primary of origin (COPs) that were left unnoticed by different studies20. The detection of the COPs depends on the type of molecular data being used, but 56 out of the 64 COP samples were detected repeatedly using seven different combinations of molecular data-types. Another finding is that we detected a subgroup of COPs (type-II COPs) that showed significantly reduced OS. This group showed a common cell cycle pathway abnormality which is likely the result of abnormal regulation of genes in the oncogenic pathways, such as RB, E2F1, P53 (Fig. 6d, clusters 2 and 3). This opens the question whether metastatic cancer cells converge to a stage of similarly disturbed biological mechanisms, for example an EMT transition with associated stem cell cancer characteristics and high metastatic potential and therapy resistance characteristics.
MEREDITH successfully identified known cancer-types and subtypes enabling novel insights in patient characterization and subtyping. Further improvements of subtyping may even be possible as our approach is not limited to these four molecular data-types, but it is applicable to any type and combination of genome-wide data.
Methods
TCGA data processing
In this study we used 4,434 patients across 19 distinct malignancies from the TCGA consortium17 (Fig. 2b). Four high-throughput datasets were used in this study: mRNA expression data (GE), DNA-methylation data (ME), Copy Number variation data (CN), and microRNA expression data (MIR). We left out the mutational data because it is not trivial to map those to gene-based values. For each dataset, Level 3 data was retrieved from TCGA using the TCGA-Assembler48. For GE we retrieved the RNAseqV2, RSEM values which were accordingly log2-transformed (to avoid having infinite values, we initially added+1 to all values), followed by a zero-mean normalization per gene. For ME we retrieved the beta values (methylated/(methylated+unmethylated) ratio) for both Illumina 27 k (505 samples) and 450 k (4,169 samples) beadchip. The beta values are subsequently standardized per sample by averaging gene-wise within 1,500 base pairs of the transcriptional-start-site, followed by quantile normalization. This makes sure that the beta values for both beadchips can be used together. We next applied a zero-mean normalization, and PCA normalization to remove technical variation. For microRNA we retrieved the RPM values which were accordingly log2-transformed (with pseudocount of 1), followed by a zero-mean normalization. For CN, copy-number values are transformed by log2(copy-number/2), and centered on 0. For each dataset we removed all genes located on the X and Y chromosome to avoid gender related biases (Supplementary Figs S14 and S15). Features containing missing values among all samples are removed whereas others are imputed using K = 3 nearest neighbor approach. No biases were observed regarding gender (Supplementary Figs S11a and S12a) ethnicity, race, or BCR center types (Supplementary Fig. S17 panel a–c). To avoid bias due to the DNA-methylation array, we used samples measured on the 450K array in the breast cancer analysis.
Cluster analysis
Density-Based Algorithm for Discovering Clusters (DBSCAN33) is employed to define clusters in each of the cluster analysis. DBSCAN is suitable for clustering t-SNE and PCA maps as it is based on the sample density. Clustering cut-off (eps parameter) is chosen by maximizing the silhouette score49, and samples were not forced into clusters, instead, at most 10% of the tissues samples can be labelled as ‘non-clustering’.
Annotation enrichment
Patient characteristics for cancer-tissues were compared using the Mann-Whitney-U test (continuous-variables) and the one sided Fisher exact test (categorical variables). All the association tests are performed using the hypergeometric test, i.e., to assess significance of overrepresentation of the cancer-types and cluster labels.
Quantification of Local similarity across two maps
To compare the embedding of samples in two different maps, we propose a scale dependent similarity measure. For a pair of maps X and Y, we compare the sets of the, respectively, kx and ky nearest neighbours of each sample. We first define the variable rxij as the rank of the distance of sample j among all samples with respect to sample i, in map X. The nearest neighbor of sample i will have rank 1, the second nearest neighbor rank 2, etc. Analogously, ryij is the rank of sample j with respect to sample i in map Y. Now we define a score on the interval [0, 1], as (eq. 1)
where the variable n is the total number of samples, and the indicator function is given by (eq. 2)
The score sx,y(kx, ky) will have value 1 if, for each sample, all kx nearest neighbours in map X are also the ky nearest neighbours in map Y, or vice versa. For the analysis in Fig. 3 we have used kx = ky = 20. Other settings of kx and ky can be found in the supplement (Fig. S18). Note that a local neighborhood of 20 samples (that we used in our experimental settings) is based on the cancer-tissue with the smallest number of samples (i.e., PAAD). For the analysis in Supplementary Fig. S3, panel b–e we used kxy = 250 which is the average of the cancer-tissue group size.
Survival analysis
Outcome measures are assessed using Kaplan-Meier estimates50 in a univariate analysis using the log-rank test51. Multivariate analyses is performed according the Cox proportional hazard ratio model, where we corrected for the covariates age, sex, and cancer-tissue types when required. The definition of complete remission (CR) and survival endpoints such as overall survival (OS) are provided by TCGA.
Pathway analysis
Canonical pathways (1,320), Biocarta genesets (217), and oncogenic signatures (189) are utilized from the molecular signature database (MsigDB v4.0) for which we calculated a P-value for the fraction of genes that is significantly detected (either by gene expression, DNA-methylation or copy-number changes), and annotated in the pathway using the hypergeometric test. Multiple test correction is applied according Benjamini and Yukuteli (BY)52 and pathways are selected when PBY < 0.05.
Additional Information
How to cite this article: Taskesen, E. et al. Pan-cancer subtyping in a 2D-map shows substructures that are driven by specific combinations of molecular characteristics. Sci. Rep. 6, 24949
Supplementary Material
Acknowledgments
Publication costs for this article were sourced from the BioRange program of the Netherlands Bioinformatics Centre (NBIC), which is supported by the Netherlands Genomics Initiative (NGI,Project: BIOPATH BR 2.5). JHK was funded by the Dutch public-private research community (COMMIT, project: P23).
Footnotes
Author Contributions E.T. and M.J.T.R. designed the study and drafted the manuscript. E.T., S.H. and A.M. analyzed the data. E.T., S.H., A.M., J.H.K., J.D.R., A.V.D.S., E.V.D.A., W.V. and M.J.T.R. participated in the discussions, interpretation and editing of the manuscript. E.T., S.H., A.M., J.H.K., J.D.R., A.V.D.S., E.V.D.A., W.V. and M.J.T.R. provided relevant input at different stages of the project. All authors approved the final manuscript.
References
- Joensuu K. et al. ER, PR, HER2, Ki-67 and CK5 in Early and Late Relapsing Breast Cancer-Reduced CK5 Expression in Metastases. Breast Cancer (Auckl) 7, 23–34, 10.4137/BCBCR.S10701 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Borras E. et al. Clinical pharmacogenomic testing of KRAS, BRAF and EGFR mutations by high resolution melting analysis and ultra-deep pyrosequencing. BMC Cancer 11, 406, 10.1186/1471-2407-11-406 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kandoth C. et al. Mutational landscape and significance across 12 major cancer types. Nature 502, 333–339, 10.1038/nature12634 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ciriello G. et al. Emerging landscape of oncogenic signatures across human cancers. Nat Genet 45, 1127–1133, 10.1038/ng.2762 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perou C. M. et al. Molecular portraits of human breast tumours. Nature 406, 747–752, 10.1038/35021093 (2000). [DOI] [PubMed] [Google Scholar]
- Valk P. J. et al. Prognostically useful gene-expression profiles in acute myeloid leukemia. N Engl J Med 350, 1617–1628, 10.1056/NEJMoa040465 (2004). [DOI] [PubMed] [Google Scholar]
- Xiong Q., Ancona N., Hauser E. R., Mukherjee S. & Furey T. S. Integrating genetic and gene expression evidence into genome-wide association analysis of gene sets. Genome Res 22, 386–397, 10.1101/gr.124370.111 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taskesen E., Babaei S., Reinders M. M. & de Ridder J. Integration of gene expression and DNA-methylation profiles improves molecular subtype classification in acute myeloid leukemia. BMC Bioinformatics 16 Suppl 4, S5, 10.1186/1471-2105-16-S4-S5 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taskesen E. et al. Two splice-factor mutant leukemia subgroups uncovered at the boundaries of MDS and AML using combined gene expression and DNA-methylation profiling. Blood 123, 3327–3335, 10.1182/blood-2013-07-512855 (2014). [DOI] [PubMed] [Google Scholar]
- Curtis C. et al. The genomic and transcriptomic architecture of 2,000 breast tumours reveals novel subgroups. Nature 486, 346–352, 10.1038/nature10983 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Serra A. et al. MVDA: a multi-view genomic data integration methodology. BMC Bioinformatics 16, 261, 10.1186/s12859-015-0680-3 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Speicher N. K. & Pfeifer N. Integrating different data types by regularized unsupervised multiple kernel learning with application to cancer subtype discovery. Bioinformatics 31, i268–275, 10.1093/bioinformatics/btv244 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tieri P., de la Fuente A., Termanini A. & Franceschi C. Integrating Omics data for signaling pathways, interactome reconstruction, and functional analysis. Methods Mol Biol 719, 415–433, 10.1007/978-1-61779-027-0_19 (2011). [DOI] [PubMed] [Google Scholar]
- de Tayrac M., Le S., Aubry M., Mosser J. & Husson F. Simultaneous analysis of distinct Omics data sets with integration of biological knowledge: Multiple Factor Analysis approach. BMC Genomics 10, 32, 10.1186/1471-2164-10-32 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pavlidis N. & Pentheroudakis G. Cancer of unknown primary site: 20 questions to be answered. Annals of oncology: official journal of the European Society for Medical Oncology/ESMO 21 Suppl 7, vii303–307, 10.1093/annonc/mdq278 (2010). [DOI] [PubMed] [Google Scholar]
- Wei I. H., Shi Y., Jiang H., Kumar-Sinha C. & Chinnaiyan A. M. RNA-Seq accurately identifies cancer biomarker signatures to distinguish tissue of origin. Neoplasia 16, 918–927, 10.1016/j.neo.2014.09.007 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cancer Genome Atlas Research, N. et al. The Cancer Genome Atlas Pan-Cancer analysis project. Nat Genet 45, 1113–1120, 10.1038/ng.2764 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ritchie M. D., Holzinger E. R., Li R., Pendergrass S. A. & Kim D. Methods of integrating data to uncover genotype-phenotype interactions. Nature reviews. Genetics 16, 85–97, 10.1038/nrg3868 (2015). [DOI] [PubMed] [Google Scholar]
- Gomez-Cabrero D. et al. Data integration in the era of omics: current and future challenges. BMC systems biology 8 Suppl 2, I1, 10.1186/1752-0509-8-S2-I1 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hoadley K. A. et al. Multiplatform analysis of 12 cancer types reveals molecular classification within and across tissues of origin. Cell 158, 929–944, 10.1016/j.cell.2014.06.049 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vaske C. J. et al. Inference of patient-specific pathway activities from multi-dimensional cancer genomics data using PARADIGM. Bioinformatics 26, i237–245, 10.1093/bioinformatics/btq182 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cancer Genome Atlas Research, N. et al. Integrated genomic characterization of endometrial carcinoma. Nature 497, 67–73, 10.1038/nature12113 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meng C., Kuster B., Culhane A. C. & Gholami A. M. A multivariate approach to the integration of multi-omics datasets. BMC Bioinformatics 15, 162, 10.1186/1471-2105-15-162 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ringner M. What is principal component analysis? Nature biotechnology 26, 303–304, 10.1038/nbt0308-303 (2008). [DOI] [PubMed] [Google Scholar]
- Maaten L. J. P. v. d. & Hinton G. E. Visualizing High-Dimensional Data Using t-SNE. Journal of Machine Learning Research 9, 2579–2605 (2008). [Google Scholar]
- Maaten L. v. d. Barnes-Hut-SNE. arXiv.org arXiv:1301.3342 (2013 ).
- Sokal R. R. a. F. J. R. The comparison of dendrograms by objective methods. Taxon 11, 33–40, 10.2307/1217208 (1962). [DOI] [Google Scholar]
- Masuda M., Sawa M. & Yamada T. Therapeutic targets in the Wnt signaling pathway: Feasibility of targeting TNIK in colorectal cancer. Pharmacology & therapeutics, 10.1016/j.pharmthera.2015.10.009 (2015). [DOI] [PubMed] [Google Scholar]
- Guder C. et al. The Wnt code: cnidarians signal the way. Oncogene 25, 7450–7460, 10.1038/sj.onc.1210052 (2006). [DOI] [PubMed] [Google Scholar]
- Lustig B. & Behrens J. The Wnt signaling pathway and its role in tumor development. Journal of cancer research and clinical oncology 129, 199–221, 10.1007/s00432-003-0431-0 (2003). [DOI] [PubMed] [Google Scholar]
- Nusse R. Wnt signaling in disease and in development. Cell research 15, 28–32, 10.1038/sj.cr.7290260 (2005). [DOI] [PubMed] [Google Scholar]
- Guinney J. et al. The consensus molecular subtypes of colorectal cancer. Nature medicine 21, 1350–1356, 10.1038/nm.3967 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ester M., Kriegel H.-p., S J. & Xu X. A density-based algorithm for discovering clusters in large spatial databases with noise. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96) 96, 226–231, 10.1.1.71.1980 (1996). [Google Scholar]
- Peel G. M. a. D. Finite Mixture Models. John Wiley & Sons, Inc. (2005). [Google Scholar]
- Figueroa M. E. et al. DNA methylation signatures identify biologically distinct subtypes in acute myeloid leukemia. Cancer Cell 17, 13–27, 10.1016/j.ccr.2009.11.020 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taskesen E. et al. Two splice factor mutant leukemia subgroups uncovered at the boundaries of MDS and AML using combined gene expression and DNA-methylation profiling. Blood. 10.1182/blood-2013-07-512855 (2014). [DOI] [PubMed] [Google Scholar]
- Bennett J. M. et al. Proposals for the classification of the acute leukaemias. French-American-British (FAB) co-operative group. Br J Haematol 33, 451–458 (1976). [DOI] [PubMed] [Google Scholar]
- How J. et al. The prognostic impact of FLT3-ITD and NPM1 mutations in patients with relapsed acute myeloid leukemia and intermediate-risk cytogenetics. Blood cancer journal 3, e116, 10.1038/bcj.2013.14 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paschka P. et al. IDH1 and IDH2 mutations are frequent genetic alterations in acute myeloid leukemia and confer adverse prognosis in cytogenetically normal acute myeloid leukemia with NPM1 mutation without FLT3 internal tandem duplication. J Clin Oncol 28, 3636–3643, 10.1200/JCO.2010.28.3762 (2010). [DOI] [PubMed] [Google Scholar]
- Dai X., Chen A. & Bai Z. Integrative investigation on breast cancer in ER, PR and HER2-defined subgroups using mRNA and miRNA expression profiling. Scientific reports 4, 6566, 10.1038/srep06566 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen Y. et al. Identifying potential cancer driver genes by genomic data integration. Scientific reports 3, 3538, 10.1038/srep03538 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sanchez-Garcia F. et al. Integration of genomic data enables selective discovery of breast cancer drivers. Cell 159, 1461–1475, 10.1016/j.cell.2014.10.048 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tamborero D. et al. Comprehensive identification of mutational cancer driver genes across 12 tumor types. Scientific reports 3, 2650, 10.1038/srep02650 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martinez E. et al. Comparison of gene expression patterns across 12 tumor types identifies a cancer supercluster characterized by TP53 mutations and cell cycle defects. Oncogene 34, 2732–2740, 10.1038/onc.2014.216 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ritchie M. E. et al. limma powers differential expression analyses for RNA-sequencing and microarray studies. Nucleic Acids Res 43, e47, 10.1093/nar/gkv007 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holm S. A Simple Sequentially Rejective Multiple Test Procedure Scandinavian Journal of Statistics 6, 65–70 (1979). [Google Scholar]
- El-Maarri O. et al. Gender specific differences in levels of DNA methylation at selected loci from human total blood: a tendency toward higher methylation levels in males. Hum Genet 122, 505–514, 10.1007/s00439-007-0430-3 (2007). [DOI] [PubMed] [Google Scholar]
- Zhu Y., Qiu P. & Ji Y. TCGA-assembler: open-source software for retrieving and processing TCGA data. Nature methods 11, 599–600, 10.1038/nmeth.2956 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rousseeuw P. J. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics 20, 53–65, 10.1016/0377-0427(87)90125-7 (1987). [DOI] [Google Scholar]
- Bland J. M. & Altman D. G. Survival probabilities (the Kaplan-Meier method). Bmj 317, 1572 (1998). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mantel N. Evaluation of survival data and two new rank order statistics arising in its consideration. Cancer chemotherapy reports. Part 1 50, 163–170 (1966). [PubMed] [Google Scholar]
- Yekutieli Y. B. a. D. The control of the false discovery rate in multiple testing under dependency. The Annals of Statistics 29, 1165–1188, 10.1214/aos/1013699998 (2001). [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.