vissE: a versatile tool to identify and visualise higher-order molecular phenotypes from functional enrichment analysis

Abstract

Functional analysis of high throughput experiments using pathway analysis is now ubiquitous. Though powerful, these methods often produce thousands of redundant results owing to knowledgebase redundancies upstream. This scale of results hinders extensive exploration by biologists and can lead to investigator biases due to previous knowledge and expectations. To address this issue, we present vissE, a flexible network-based analysis and visualisation tool that organises information into semantic categories and provides various visualisation modules to characterise them with respect to the underlying data, thus providing a comprehensive view of the biological system. We demonstrate vissE’s versatility by applying it to three different technologies: bulk, single-cell and spatial transcriptomics. Applying vissE to a factor analysis of a breast cancer spatial transcriptomic data, we identified stromal phenotypes that support tumour dissemination. Its adaptability allows vissE to enhance all existing gene-set enrichment and pathway analysis workflows, empowering biologists during molecular discovery.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12859-024-05676-y.

Introduction

Biological systems are often studied using experiments that generate vast amounts of molecular measurements. Rigorous statistical analyses are routinely performed to identify the key molecules participating in the system. This is followed by interpretation from biologists who then attempt to explain the observed molecular shifts in their experiments, find evidence for molecular mechanisms and identify novel biology. Interpreting lists of molecules can be difficult and laborious for biologists in cases where thousands of molecules change in the experiment [1]. This problem has motivated the development of statistical analyses that identify molecular processes enriched in the list of molecules, thus providing biologists with higher-order interpretable summaries of their experiments [2]. When the molecules of interest are genes, these analyses have taken up the form of gene-set enrichment analysis [2, 3] where sets of genes representing a common biological process are statistically assessed for enrichment in the experiment. Such gene-sets are derived from multiple sources which typically include the Gene Ontology (GO) project [4], the Reactome pathway database [5], the Kyoto Encyclopedia of Genes and Genomes (KEGG) pathway database [6] and the molecular signatures database (MSigDB) [7, 8]. These gene-sets are either curated from existing scientific literature or derived from molecular experiments.

Though gene-set enrichment analyses are powerful tools to study biological processes underpinning biological systems, they often identify thousands of processes thus introducing a challenge in the interpretation of results. This is in part driven by redundancy introduced by the hierarchical structuring of processes in gene-set databases such as the GO, Reactome and KEGG [9–11]. Additionally, the increasing number of experimentally derived gene-sets in databases such as the MSigDB will naturally lead to gene-set redundancy when related processes are being studied. Information redundancy in such databases is not necessarily detrimental, especially when evidenced by independent studies, however, it does pose a significant challenge when interpreting the results of gene-set enrichment analyses. Related pathways/processes are likely to be significant because of shared significant genes from the upstream analysis. In such a setting, biologists interpreting the top N processes will end up investigating the same signal in the data and will miss any orthogonal signals that although not as obvious, may lead to new insight into the nature of the data. Alternatively, domain experts attempting to interpret the full result set could be biased by their previous knowledge of the systems and would opt to select and focus on familiar processes for further investigations.

Three broad categories of solutions have been developed to address this problem: collapsing redundant information (for example, the creation of GO “slim” ontologies), incorporating redundancy information in the gene-set enrichment analysis method, or visualising redundancy in the gene-set enrichment analysis results. The first category focuses on modifying the underlying database such that redundant information is collapsed to produce a reduced collection of discrete categories, an approach that has been applied to GO and the Hallmark gene-sets from MSigDB [7, 12, 13]. The second category of methods has been primarily developed for GO where the graph structure is incorporated into the statistical testing framework [14–16]. While powerful, their application is limited to the analysis of knowledgebases that have a hierarchical structure such as GO and Reactome, and they can only be applied to a single database at a time restricting the sources of gene-sets.

On the other hand, the category of visualisation methods aims to reveal the redundancy structure in gene-set databases. As such, these methods can be coupled with a broader range of existing enrichment analysis methods [2, 3], including some of the recent single-sample gene-set enrichment analysis methods [17]. These methods generally begin by computing pairwise gene-set similarities based on content similarity of shared genes [1, 10, 18–22] or semantic similarity computed from the underlying graph structure [23]. Gene-set clusters are subsequently identified by clustering on the similarity matrix directly [11, 18, 22] or by constructing a graph and applying graph clustering algorithms [1, 10, 19–21]. The resulting similarity graphs are visualised with gene-set statistics such as p-values or enrichment scores overlayed onto vertices. A subset of methods attempt to collapse gene-set annotations in each cluster into a per-cluster annotation by either annotating each cluster using a single representative significant member [11, 18, 21, 22] or by performing text-mining on all member gene-sets to identify an overarching biological theme [1, 10, 20]. Figure 1 summarises current methods (including refs [24–29]) developed to consolidate and visualise gene-set enrichment analysis results, detailing the approaches used to compute similarity, perform clustering, and annotate clusters.

Fig. 1.

Existing methods to summarise and visualise gene-set enrichment analysis results

Visualisation approaches are appealing since they can be applied to any gene-set enrichment analysis workflow. Good visualisations should reveal structure in the data that is not otherwise obvious. Approaches developed in the past have been powerful but restrict problem formulation to that of summarising the results of gene-set enrichment analysis and do not relate summarised processes back to the experimental data. Thus, they lack the ability to provide useful insight about biological function in the context of the experiment. Furthermore, they lack suitable tools to visualise, explore and interpret the results of a gene-set enrichment analysis in the context of the underlying data and its downstream analysis. Tools within the popular clusterProfiler software [30, 31], Metascape [22], and simplifyEnrichment [28] allow exploration of gene membership within gene-sets or gene-set membership within gene-set groups but fail to identify gene-set clusters and/or characterise them in the context of the experiment. Apart from EnrichmentMap [10] and GOsummaries [26], none of the other tools support exploration of experimental measurements in the context of the identified gene-set clusters. Although EnrichmentMap [10] allows exploration of gene-level statistics (e.g., logFC) or their expression values through heatmaps, it does not support additional study specific visualisations due to limitations of the access platform. As the focus for most of these existing tools has been to summarise gene-set redundancies, they lack visualisations that enable exploration of identified gene-set groups with respect to the gene-level measurements.

vissE addresses this limitation in linking gene-set groups back to experimental measurements by reformulating the problem as one of identifying and then characterising higher-order biological processes with the aim of allowing greater application and utility in all areas of biological and clinical sciences. Higher-order biological processes are identified by clustering on the gene-set network and are explored using various analytical modules including cluster annotation. Higher-order process characterisation involves extracting the semantic meaning of the process, as well as understanding mechanisms by relating processes back to the genomic measurements. Due to the open problem formulation, we can extend development of tools and are able to perform novel functional analysis workflows, such as unsupervised exploration of molecular phenotypes in single-cell and spatial transcriptomics data. The methods and data described here have been implemented in the vissE, msigdb and emtdata R/Bioconductor packages. Our pipeline has been implemented by the https://vissE.Cloud [32] web application that allows interactive exploration of results and extends analysis to 10x Xenium and NanoString CosMx spatial transcriptomics data.

Methods

Gene-set enrichment analysis (GSEA) workflows

Datasets

Bulk, single-cell, and spatial transcriptomics breast cancer datasets were analysed to demonstrate the usability of vissE. Characteristics of these datasets, as well as their processed versions are outlined in the Table 1.

Table 1.

Datasets analysed using vissE

			ORIGINAL		FILTERED
DATASET	Technology	Samples	Genes	Cells/spots	Genes	Cells/spots
Cursons et al. [33]	Bulk RNA-seq	6	27,515	–	23,279	–
Pal et al. [34]	10x Chromium	6	33,249	64,468	2000	51,660
10x [35]	10x Visium	1	23,799	4,325	2000	3364

Processing bulk RNA-seq data

Sequencing reads from [33] were downloaded from the sequencing reads archive (SRA) using sratools. The Subread [36] aligner was used to align reads to the GRCh38 human reference genome and featureCounts [37] was used to quantify reads per gene. Genes with low expression were filtered out and normalisation factors were calculated using the TMM method [38]. This data is made available through the emtdata R/Bioconductor package. Differential expression analysis was performed using the quasi-likelihood pipeline [39] from the edgeR R/Bioconductor package [40]. Gene-sets from the hallmark collection (h), Reactome, KEGG, WikiPathways, and the gene ontology were downloaded from the molecular signatures database (MSigDB v7.2) using the msigdb R/Bioconductor package. These were then used to perform gene-set enrichment analysis using the limma::fry method.

Processing scRNA-seq data

Pre-processed data from [34] was downloaded from the gene expression omnibus (GSE161529) with quality control performed as described in the original publication. Three estrogen receptor positive (ER+) breast cancer samples (GSM4909299, GSM4909302, GSM4909317), three BRCA1 triple negative breast cancers (GSM4909285, GSM4909286, GSM4909288) and one triple negative breast cancer sample (GSM4909284) were selected for further analysis. Data from each sample were normalised using the scran R package [41] and then integrated by identifying integration anchors using the Seurat R package [42]. PCA was performed on the top 2000 highly variable genes defined based on the mean–variance relationship of genes. Cell type annotation was performed with the SingleR [43] package using a breast cancer dataset as a reference [44]. Data were visualised using uniform manifold approximations (UMAPs) computed from the first 50 principal components (PCs) using implementations in the scater R package.

Processing spatial transcriptomics data

Visium spatial targeted data of human invasive lobular carcinoma breast tissue (ER positive, PR positive, HER2 negative) used in this study was obtained from the 10x Genomics demonstration datasets [35]. Data were pre-processed using Space Ranger software v1.2.0. Spots with library sizes smaller than 3000 and less than 500 expressed genes were filtered out while the rest were normalised using the scran R package [41]. PCA was performed on the top 2000 highly variable genes defined based on the mean–variance relationship of genes. Cell type deconvolution was performed with the RCTD method [45] using a single-cell dataset (GSM4909302) from the previous section as a reference.

Spots mapping stroma surrounded by different types of malignant cells were defined by mapping the pathologist’s annotations onto the spatial transcriptomics data. Pixels within a 150-pixel circular radius were used to define spots. Spots with more than 75% stromal annotated pixels were defined as stromal spots. The surroundings of stromal spots were defined based on a square grid. Windows starting at x-coordinates 3000 and 9000 pixels and of width 6000 pixels, and y-coordinates 16,000 onwards, were defined as stroma surrounded by malignant mesenchymal cells and stroma surrounded by malignant epithelial cells respectively. Only the stromal spots within these windows were used for the differential expression analysis. Pseudo-replicates were defined by splitting windows within each group into three equally sized bins along the x-axis. Pseudo-bulk samples were subsequently created and subjected to a differential expression analysis [39] followed by a limma::fry() analysis, and finally a vissE analysis.

Gene-set enrichment analysis of factors

Factors identified in a factor analysis often have loadings, amplitudes or weights representing feature importance. Principal components analysis (PCA) of RNA sequencing data produces gene loadings that reflect the relevance of each gene to the principal component (PC) of interest. Gene loadings can be used to compute gene-set scores that reflect the importance of each gene in the PC. We used the singscore method [17] implemented in the singscore R/Bioconductor package to compute gene-set scores for each gene-set in a PC for the single-cell and spatial transcriptomics datasets. In each PC, genes were ranked using their gene loadings. Scores were computed for all gene-sets in the hallmark collection (h), Reactome, KEGG, WikiPathways, gene ontology and the single-cell gene-sets collection (c8) of the molecular signatures database (MSigDB v7.2). This produced gene-set scores for these gene-sets in each PC identified using PCA.

vissE

Compute overlap network

Gene-sets used in gene-set enrichment analysis often vary in the resolution of molecular phenotypes they represent. Different resolutions can therefore map onto the same biological process, and it is often of interest to identify the higher-order biological process that encapsulates related gene-sets. This idea is used in vissE to identify higher-order molecular phenotypes from a cluster of gene-sets of interest (Fig. 2). Given a list of gene-sets, a similarity matrix is produced by computing the pairwise gene-set similarity using either the Adjusted Rand Index (ARI), the Jaccard index, or the overlap coefficient. Given n genes are measured in the experiment, gene-sets can be represented as a n-dimensional binary vector where genes that belong to the gene-set are encoded by 1 and 0 otherwise. To compute similarity between two gene-sets, X and Y, a contingency table is first built and the ARI, Jaccard index (JI), and the overlap coefficient (OC) are subsequently computed.

	$Y_0$	$Y_1$	sums
$X_0$	$n_{00}$	$n_{01}$	$a_0$
$X_1$	$n_{10}$	$n_{11}$	$a_1$
sums	$b_0$	$b_1$	$n$

$$ARI=\frac{{\sum }_{\mathit{ij}}\left(\begin{array}{c}{n}_{\mathit{ij}}\\ 2\end{array}\right)-\left[{\sum }_i\left(\begin{array}{c}{a}_i\\ 2\end{array}\right){\sum }_j\left(\begin{array}{c}{b}_j\\ 2\end{array}\right)\right]/\left(\begin{array}{c}n\\ 2\end{array}\right)}{\frac{1}{2}\left[{\sum }_i\left(\begin{array}{c}{a}_i\\ 2\end{array}\right)+{\sum }_j\left(\begin{array}{c}{b}_j\\ 2\end{array}\right)\right]-\left[{\sum }_i\left(\begin{array}{c}{a}_i\\ 2\end{array}\right){\sum }_j\left(\begin{array}{c}{b}_j\\ 2\end{array}\right)\right]/\left(\begin{array}{c}n\\ 2\end{array}\right)}$$

$$JI=\frac{n_{11}}{n_{01}+n_{10}+n_{11}}$$

$$OC=\frac{n_{11}}{min\left(a_1,b_1\right)}$$

Fig. 2.

A schematic representation of various vissE workflows. A vissE workflow builds interpretable visualisations from gene-set enrichment analyses that allow users to easily investigate phenotypes at the resolution of biological themes and individual genes, while minimising investigator biases. (1) vissE is flexible for use with any gene-set enrichment analysis, including those from scRNA-sequencing, spatial transcriptomics and traditional bulk RNA-sequencing technologies. (2) A list of significant gene-sets from these analyses are used to generate a gene-set network that is used to minimise gene-set redundancy by identifying higher-order biological themes. (3) vissE offers a variety of analytical modules to then explore functional themes and to build a biological narrative that describes the underlying biological system being explored

When working with multiple databases, the Adjusted Rand Index or the Jaccard index are preferred since the overlap coefficient specifically highlights parent–child relationships and therefore works best when using a single hierarchically structured database. A gene-set overlap graph is built by thresholding the similarity matrix and represented using the igraph R package [46]. Gene-sets without any connections are dropped from the graph. Though these gene-sets are omitted from a vissE analysis, they could still be relevant in the context of the system being studied and should be examined outside of a vissE analysis. All graphs in the package are visualised using the ggraph R package.

Identify biological themes

Under the assumption that gene-sets with many shared genes will likely represent related biological processes, vissE aims to identify clusters of gene-sets by applying graph clustering algorithms that harness topological information in the network. The preferred choice here is random walks based walktrap algorithm implemented in the igraph R package [46]. This algorithm has been shown to work well for both dense and sparse graphs in identifying small and large community structures [47]. Clusters are then ordered to maximise the statistic of interest, as well as their size, using the product of ranks approach described in [48]. Briefly, this approach computes a statistic using the products of the cluster ranks computed based on cluster sizes and on the median gene-set statistic respectively and uses this statistic to rank clusters (the lower the better).

Biological theme exploration

Cluster annotation using word clouds

The next step in a vissE analysis is to characterise each gene-set cluster and interpret the higher-order biological processes they represent using the range of analytical modules available in vissE. The vissE software provides a text-based interpretation of each gene-set cluster. This is done by performing text-mining analysis on the names or short descriptions of each gene-set in the cluster. Text from all gene-sets in a cluster form a single document while text from each gene-set in the entire molecular signatures database form the corpus. Text data are first split using the “_”, “/”, “@”, “(”, “)” and “|” characters to generate words. Punctuation marks, extra white spaces, words that are numbers, stop words used in the English language and user provided words to exclude are removed. Words such as KEGG, hallmark and other such prefixes and suffixes commonly used to name or describe gene-sets are removed by default. The full list of excluded words can be accessed using the vissE:: getMsigExclusionList() function. All characters are transformed to lowercase characters. String lemmatisation is performed to produce lemmatised words. A term frequency is computed for each word across the document (gene-sets from a single cluster). All text-mining analysis is performed using the tm R package [49].

$$IDF\left(t,GS\right)=log\frac{N}{\left|\left\{gs\in GS:t\in gs\right\}\right|}$$

Concurrently, document frequencies (the number of gene-sets that word belongs to) are computed for each term for all gene-sets (gs) from the gene-set database (GS). These are used to compute inverse document frequencies (IDF) per term (t). Term frequencies within each gene-set cluster are then weighted against IDFs thus producing a term frequency inverse document frequency (TF-IDF) for each term. This helps to remove any database specific bias by down-weighting over-represented words in the database. To ensure the visualisation is not too dense, up to 25 words with the highest TF-IDF are used to represent each gene-set cluster and are visualised using word clouds as shown in Fig. 2. These visual representations of biological themes summarise hundreds of enriched terms and are more conducive for interpretation by the user. Biologists can draw insights from these visualisations to interpret the biological processes represented by clusters of gene sets and quickly interpret gene-set enrichment analyses in the context of their data.

Gene-level statistic exploration

In addition to the word cloud, vissE enables characterisation of gene-set clusters using individual genes based on specific gene-level statistics of interest. In the context of a differential expression analysis, this could be the log fold change of each gene. A gene statistic scatter plot comprising the statistic of interest of each gene and the number of gene-sets in the cluster that a gene belongs to can be generated (Fig. 2). These gene statistics could be used to infer gene relevance within a process in the context of the specific experiment. High frequency genes could be interpreted as representative of clusters, and by extension, the associated higher-order biological process. Genes with both high statistics and frequencies within a cluster would be of interest in explaining the cluster with regards to the experiment.

Protein–protein interaction (PPI) network

An analytical module within vissE also allows visualisation of protein–protein interactions from the international molecular exchange (IMEx) database [50] between genes in a gene-set cluster, providing an independent line of evidence for underlying higher-order biological processes. The IMEX database was used to produce a protein–protein interaction (PPI) network for human and mouse [50]. The full PPI was downloaded in the PSI-MI TAB format (as of 6th July 2021) and records where both the source and target nodes are of the same species were retained. The human and mouse PPIs were then filtered out and separated. Uniprot IDs were mapped to Entrez IDs to allow gene-level queries from vissE. Human to mouse ortholog data from the HGNC Comparison of Orthology Predictions (HCOP) database [51] were used to infer PPIs for each organism using the other. This was done to provide better coverage for organisms like mouse that have not been studied as extensively. Inferred interactions were annotated in the resulting data and can therefore be filtered out when necessary. Duplicated edges, defined as interactions involving the same two Entrez IDs, were combined with the maximum confidence score taken as the confidence score. The resulting PPIs are available from the msigdb R/Bioconductor package. PPIs are induced for each gene-set cluster using member genes. Node degree is computed for each node to enable further node filtering. Edges can be filtered based on their confidence score available from the database. The network visualisation incorporates node degree, node statistics (e.g., logFC), and edge weights.

Running EnrichmentMap

The EnrichmentMap plugin (v3.3.2) in Cytoscape (v3.9.0) was used to identify and characterise higher-order phenotypes in the bulk RNA-seq data. Log fold-changes (logFCs) were computed for each gene using the same differential expression pipeline as that used for the vissE analysis. Genes ranked based on logFCs were used to perform gene-set enrichment analysis using the GSEA method [8] as per the EnrichmentMap workflow [1]. The gene-set database used was the same as that used for the vissE analysis. Default settings were used to generate the gene-set overlap graph, identify clusters and annotate clusters.

Results

Higher-order molecular phenotypes involved in an epithelial to mesenchymal transition in breast cancer

Here we demonstrate the application of vissE to a standard differential expression analysis. In epithelial tumours, malignant cells can undergo an epithelial to mesenchymal transition (EMT) and acquire mesenchymal properties such as migration and motility. The process of EMT is thought to enable cancers to metastasise [52]. While often characterised as a single process, the transition from an epithelial to mesenchymal phenotype involves various complex changes to cells and their microenvironment [53]. To explore these processes, we used data from the human mammary epithelial (HMLE) cell line system in Cursons et al. [33] where a mesenchymal subline of the HMLE cell line (mesHMLE) was induced by TGFβ stimulation and maintained with epidermal growth factor (EGF). Differential expression analysis was performed followed by gene-set enrichment analysis that identified 1240 significant gene-sets at the FDR level 0.1. These gene-set were then processed using vissE to identify higher-order biological processes. A threshold of 0.25 was applied on the adjusted Rand index (ARI) to produce the gene-set overlap network. Lower thresholds result in reduced connectivity, producing smaller clusters with increased specificity of biological themes and vice-versa. Empirically, we observed that ideal thresholds sit within the range of 0.2 and 0.4 (Additional file 1: Fig. S1). Disconnected gene-sets were dropped (70 gene-sets) producing a network with 1170 nodes and 4113 edges. Community detection using the walktrap algorithm identified 195 non-overlapping gene-set clusters that were then characterised using tools within vissE. Figure 3 shows four higher-order processes that are expected to change during EMT, demonstrating how vissE captures key biological properties of a dataset.

Fig. 3.

Using vissE to identify and characterise biological themes observed in an epithelial to mesenchymal transition (EMT) in the human mammary epithelial (HMLE) cell line. a A gene-set overlap graph of gene-sets enriched during an EMT with nodes representing individual gene-sets and edges representing overlaps based on the adjusted rand index (ARI). Nodes are coloured based on the direction and significance of enrichment: green nodes represent gene-sets enriched in mesenchymal cells and blue in epithelial cells. Four gene-set clusters representing biological themes are identified, containing 14, 104, 31 and 34 gene-sets respectively. b Cluster annotations generated by text-mining analysis of gene-set names. c Log fold-change (logFC) of genes belonging to gene-sets in the cluster plot against the number of gene-sets in the cluster the gene belongs to. d Protein–protein interaction (PPI) networks between genes that belong to gene-sets in the cluster. Each node represents a gene and edges represent known PPIs. Nodes are coloured based on the logFC

We identified higher-order phenotypic changes associated with cell–cell interaction reflect the loss of junctions and cell–cell adhesion in epithelial cells that is necessary for their transition into a mesenchymal phenotype [53]. Specifically, Fig. 3 shows that cluster 3, identified by vissE, represents tight junctions that were downregulated in mesenchymal cells relative to the epithelial HMLE cells. This and other themes are recognised and interpretable when word clouds are generated either using set names or short descriptions (Additional file 1: Fig. S2). Key genes identified include claudin genes (CLDNs) such as CLDN7 and E-cadherin (CDH1) (Fig. 3c, cluster 3), that are known epithelial markers and are predictive of an epithelial state [54]. Other than downstream phenotypic changes, vissE also captured changes in signalling such as differences in EGFR/HER2 signalling between HMLE and mesHMLE cell lines (Fig. 3, cluster 9). Specifically following through the analysis of cluster 9 in Fig. 3, EGFR/HER2 signalling (text as ‘erbb2 signal’) was relatively lower in mesHMLE compared to HMLE (Fig. 3a) and protein interactions amongst key ERBB signalling proteins including ERBB2/3/4, EGFR and downstream signalling proteins like SHC1 and SOS2 were observed. The HMLE cell line has been demonstrated to depend on autocrine EGFR signalling for growth and proliferation [55, 56], hence, it is expected that EGFR/HER2 signalling activity in HMLE is higher than in mesHMLE. Additionally, TGFβ transactivates EGFR in breast cancer [57] therefore removal of TGFβ stimulation in the mesHMLE subline attenuated EGFR/HER2 signalling as evidenced by the relative downregulation of EGF signalling ligands such as AREG in Fig. 3c. However, since EGFR/HER2 signalling was not completely lost in the mesHMLE subline, its mesenchymal phenotype was stably maintained (AveLogCPM of AREG in mesHMLE was 4.321). The signalling events identified in cluster 9 clearly reflect the biology expected in this experiment and validates the vissE workflow. All other themes identified by vissE are included in Additional file 2.

Other than the known or expected processes, vissE was able to identify other processes of interests. Cluster 12 identified an up-regulated higher-order process involving proteoglycans such as VCAN and SDC1, and sulfate proteoglycans (SPGs). These genes are known to regulate cell adhesion and motility [58] and were mostly up regulated in mesenchymal HMLE cells as seen in Fig. 3c. Similarly, cluster 31 represents numerous collagen genes that were up regulated in mesHMLE cells. Both these clusters represent different components of the extra cellular matrix (ECM). TGFβ signalling in mesenchymal cells has been known to directly affect accumulation of fibrillar collagens in the ECM [59] and the results from cluster 31 suggest this is also the case in the TGFβ stimulated HMLE system. Up-regulation of genes in clusters 12 and 31 suggest a more rigid ECM that promotes EMT via nuclear localisation of TWIST1 [60]. Our differential expression analysis supported this hypothesised mechanism as evidenced by the up regulation of TWIST1 in mesHMLE (logFC = 2.403, FDR = 0.002). Further validations of the mechanism that promote TGFβ-induced EMT is the up-regulation of proteoglycans in response to the growth factor, such as versican (VCAN) [61] and aggrecan (ACAN) [62], which provides a favourable ECM for migrating mesenchymal cells and enables detachment of cells from the basement membrane [63]. Collectively, the vissE analysis was able to identify and visualise these higher-order processes, capturing the cell-extracellular matrix remodelling that is required for EMT in a clear and unbiased manner.

We contrast vissE with two alternative analysis strategies common in the literature. In the first, we focus on the top N gene-sets from an enrichment analysis and in the second we compare to results from the EnrichmentMap tool. We assessed redundancy in the selected top N gene-sets by computing the degree of overlap of DE genes in the top 50 significant gene-sets. Many of the top 50 gene-sets shared a large number of DE genes, suggesting that their significance was attained due to the same set of underlying DE genes. Additionally, these gene-sets formed clusters based on their DE gene overlap demonstrating that the same sets of processes were captured repeatedly in the top 50 gene-sets (Additional file 1: Fig. S3). EnrichmentMap revealed many of the same processes we identified using vissE, however, the method clustered considerably fewer gene-sets for the biological themes it identified, for example, it identified only 6 gene-sets in the sulfate proteoglycan cluster as opposed to the 31 vissE identified (Additional file 1: Fig. S4–5). This was the case for most other biological themes, demonstrating that vissE provided better coverage of the enrichment results than EnrichmentMap. In some cases, the default cluster annotation from EnrichmentMap produced uninformative cluster labels such as labelling a cluster representing positive regulation of alpha and beta T-cell activity as “positive beta alpha”. However, since all summarisation methods, including vissE and EnrichmentMap, are by nature visualisation approaches, extensive quantitative benchmarks are impossible therefore we only present a qualitative comparison here.

De-novo identification of higher-order molecular phenotypes in single-cell RNA-seq experiments

Single-cell RNA-sequencing experiments are now commonly used to probe phenotypes associated with cell identity; molecular measurements at the cellular level can allow finer dissection of molecular phenotypes in a biological system. Powerful exploratory analysis without any presumptions on the biology can be performed with such high-resolution data. Unlike the bulk RNA-seq setting where we begin with a specific research question or hypothesis, such as a comparison between known groups, here we introduce a more flexible framework to explore molecular phenotypes. Very few approaches exist for this type of analysis of single-cell transcriptomic data. Firstly, factor analysis of the high-dimensional data is performed to identify factors that represent the underlying biological processes. In most cases, methods such as principal components analysis (PCA) are used to identify orthogonal factors that, in essence, reflect orthogonal groups of biological processes. Here, we used principal components analysis to identify factors from a single-cell RNA-seq breast cancer dataset containing 51,660 cells from seven patients across two breast cancer subtypes (Fig. 4a) [34]. The identified factors were interpreted by performing gene-set enrichment analysis on each factor using singscore [17] as described in the methods. Higher-order phenotypes were then identified in each factor by performing a vissE analysis on gene-sets with absolute scores greater than 0.2. Like the ARI threshold, a stricter score threshold will likely result in a sparser network as fewer gene-sets are used to build the network. An ARI threshold of 0.25 was applied in vissE to generate the gene-set overlap network.

Fig. 4.

Using vissE to identify and characterise a proliferative phenotype in single-cell transcriptomic data of seven breast cancer patients from. a–c A uniform manifold approximation projection (UMAP) of cells from 7 patients annotated by a inferred cell types. b The projection of the fourth principal component (PC4). c Expression of the MKI67 gene that encodes the Ki67 marker of proliferation. d A gene-set overlap graph of gene-sets enriched in PC4 with nodes representing individual gene-sets and edges representing overlaps based on the adjusted rand index (ARI). Nodes are coloured based on the direction and significance of enrichment: green nodes represent gene-sets enriched in PC4 high cells. Six gene-set clusters representing biological themes are identified, containing 36, 76, 32, 7, 22 and 34 gene-sets respectively. e Cluster annotations generated by text-mining analysis of gene-set names. f Gene loadings (also known as weights) for genes belonging to gene-sets in the cluster plot against the number of gene-sets in the cluster the gene belongs to. g Protein–protein interaction (PPI) networks between genes that belong to gene-sets in the cluster. Each node represents a gene and edges represent known PPIs. Nodes are coloured based on gene loadings (also known as weight)

Figure 4 shows the results when vissE and singscore are applied to the fourth principal component (PC4) that explained 1.91% of variance of the data. Figure 4a–c show the UMAP projections of cells (explaining 30.5% variance in the data) with the cell type, the PCA projection on factor 4 (i.e., PC4), and the expression of the MKI67 gene annotated respectively. These plots show that the molecular phenotype identified by the fourth principal component does not represent a cell type nor cells from a single patient (Additional file 1: Fig. S6) but a phenotype that is common to cells from various cell types, including malignant cells and immune cells. Functional analysis of Factor 4 (PC4) using singscore identified 704 gene-sets with absolute scores greater than 0.2. Analysing these gene-set using vissE with an ARI threshold of 0.3 identified 82 gene-set clusters (175 disconnected gene-sets). Six representative clusters identified using word clouds and shown in Fig. 4d–g clearly reveal a proliferative phenotype that is present in a subset of cancer and immune cells (as shown in panel a-c, other clusters found in Additional file 3).

Specifically, cluster 2, the largest cluster in Fig. 4d represents the broader set of gene-sets associated with the cell cycle as evident from the word cloud in Fig. 4e and the genes highlighted in Fig. 4f. These clusters capture gene-sets related to cell proliferation, including cell cycle stages (cluster 2) or organelle activity such as chromosome segregation (cluster 1), centrosomic changes (cluster 4) and microtubule formation (cluster 8). Most genes in these representative clusters have positive PC loadings (as shown by the gene-level statistics/weights in Fig. 4g) suggesting they are positively associated with factor 4 and by extent, the process of proliferation. Clusters 7 and 10 represent processes that are required for a smooth transition through the cell cycle. DNA damage repair is required to ensure error free replication [64] and the secretome pathway of retrograde transport via the Golgi is required for recycling membrane bound proteins during cell division [65]. These clusters are themselves heavily interlinked indicating a strong dependence between the processes they represent.

The gene-level statistics in Fig. 4g can link interpretations back to specific genes, enabling the identification of key regulators or markers of the processes identified. For instance, genes identified in clusters 1, 2, 4 and 8 such as AURKA and CDK1 are known kinases regulating cell cycle progression [66]. Furthermore, vissE also provides the protein–protein interaction network (Fig. 4g) that serve as a line of evidence independent from the enrichment analysis and/or gene set membership that can be further explored using specialised network analysis tools to identify key proteins in the relevant processes. Collectively, these findings suggest that factor 4 is identifying a subpopulation of proliferating cells as validated by the expression of the MKI67 gene (Fig. 4c). They also showcase how vissE captures shared phenotypic characteristics that span several cell types across various patients. Though we focus on studying the biology captured by PC4 here, all other PCs can be studied using this pipeline to obtain a holistic understanding of biological function in the system.

Higher-order spatially resolved molecular phenotypes of tumour promoting cancer associated fibroblasts

The advent of spatially resolved transcriptomics data has enhanced the context-specific exploration of biology. The factor analysis pipeline described in the previous section can be used to perform an unbiased exploration of molecular phenotypes in any transcriptomic data, including spatial transcriptomics data. We applied the factor analysis pipeline to a human invasive lobular carcinoma breast tissue (estrogen receptor positive, progesterone receptor positive, and HER2 negative) dataset [35] that contains transcriptomics measurements profiled across 4325 spots. The data were pre-processed, and factors were identified by applying PCA to the 3364 spots that passed quality control (see Methods). Factors identified were subjected to a gene-set enrichment analysis using singscore [17] and resulting gene-sets with absolute scores greater than 0.2 were interpreted using vissE by applying an ARI threshold of 0.2.

The original Haematoxylin and Eosin (H&E) stained tissue slide (Fig. 5a) was profiled using spatial transcriptomics and annotated by a pathologist for regions of stroma, malignant epithelial cells, and malignant mesenchymal cells (Fig. 5b). Spots were projected onto PC1 (explained 7.90% of variance) and subsequently mapped onto the original spatial landscape to explore and characterise the resultant spatial patterns (Fig. 5c). A key finding was that the gene expression pattern of stroma adjacent to epithelial cells differed from the stroma adjacent to mesenchymal-like cells (Fig. 5b). Regions with positive PC1 projections captured stroma infiltrated by mesenchymal-like malignant cells (Fig. 5b–c). The singscore analysis of this PC identified 880 gene sets that were then clustered into 107 biological themes using vissE (130 disconnected gene-sets omitted). Our vissE analysis showed that these regions were enriched in collagen-related (cluster 1), sulfate proteoglycan metabolism (cluster 4) and other cell-ECM binding (cluster 13) gene-sets, characterising the tumour-stromal interactions between cell populations at the boundaries of the tumour (Fig. 5d–g, other clusters found in Additional file 4). Positive gene weights (Fig. 5f) for stroma-specific genes, including collagens (e.g., COL4A1), VCAN, FN1 and many ECM proteins (Fig. 5f–g), further indicated ECM remodelling and suggested the contribution of fibroblasts to this transcriptomic signal. Gene-sets relating to growth factor expression (cluster 11) and chemotaxis (clusters 11, 12 and 25) were also enriched. In addition, cluster 25 relates to the regulation of VEGF-induced migration, including the expression of key VEGF-related genes (NRP1, NRP2, FLT1, KDR, PGF), which can promote tumour dissemination by supporting the invasion of malignant cells into the stroma. These results, coupled with the up-regulation of chemokines (CXCL12) and growth factors (PDGF and TGFβ, see Fig. 5g) reflect the tumour-stromal interactions in this tumour microenvironment that support the invasion of mesenchymal-like malignant cells in adjacent stroma.

Fig. 5.

Using vissE to identify and characterise a cancer associated fibroblast (CAF) phenotype in spatial transcriptomics data of a breast cancer patient. a A Haematoxylin and Eosin (H&E) image of the breast cancer tissue profiled using the 10X visium technology. b Spots profiled coloured by the projection of the first principal component (PC1). c Pathologist’s annotations of stromal (olive-green), malignant (purple) and mesenchymal-like (gold) regions of the tissue overlayed on the H&E image. d A gene-set overlap graph of gene-sets enriched in PC1 with nodes representing individual gene-sets and edges representing overlaps based on the adjusted rand index (ARI). Nodes are coloured based on the direction and significance of enrichment: green nodes represent gene-sets enriched in PC1-high spots. Six gene-set clusters representing biological themes are identified, containing 69, 21, 8, 6, 11 and 5 gene-sets respectively. e Cluster annotations generated by text-mining analysis of gene-set names. f Gene loadings (also known as weights) for genes belonging to gene-sets in the cluster plot against the number of gene-sets in the cluster the gene belongs to. g Protein–protein interaction (PPI) networks between genes that belong to gene-sets in the cluster. Each node represents a gene and edges represent known PPIs. Nodes are coloured based on gene loadings (also known as weight). h Cell type deconvolution (left) and expression of CAF-related marker genes (center) for the top 20% of spots with the highest PC1 projection vs. all other spots (region marked in the right panel)

These higher-order biological themes point to a cancer-associated fibroblast (CAF) phenotype. Biomarkers of CAFs like PDGFRA, PDGFRB, TGFB1 (cluster 12 and 25), FAP (cluster 13), MMP9 (cluster 11), LOXL1 and αSMA (also known as ACTA2) are more highly expressed in PC1-high regions (top 20% spots) as seen in Fig. 5h. Cell type deconvolution results agreed with this hypothesis. PC1-high regions demonstrated strong evidence for fibroblasts and weak support for malignant cells (Fig. 5h). The few malignant cells present in these regions (Fig. 5h) could contribute to CAF formation via TGFβ signalling as evidenced by the upregulation of TGFβ1 and its receptors (cluster 11) [67]. ECM stiffening induces mechanical stress that further activates CAFs [68]. Upregulation of the CAF-induced pre-metastatic niche (PMN) marker POSTN (cluster 11) [69], chemotaxis and vasculature (clusters 12 and 25) as well as higher deconvolution weights of endothelial cells and macrophages in the PC1-high regions are evidence for a tumour promoting role of CAFs at the leading edge of tumours [70].

To validate these findings, we performed a supervised differential expression analysis of the stroma surrounded by different types of malignant cells defined using our pathologist’s annotations. We found that gene expression signatures and higher-order themes identified in our unsupervised PCA analysis (Fig. 5) were consistent with those identified in our supervised analysis of the stroma (Additional file 1: Fig. S7), demonstrating that these stromal regions are secreting extracellular matrix constituents and remodelling the ECM to support the invasion of mesenchymal cancer cells.

Discussion

Functional interpretation of high-dimensional molecular data has been a challenge since the advent of high through-put technologies. The rate of data generation greatly outcompetes the rate of their analysis and interpretation, leaving many data under-explored. While statistical and computational tools have assisted in identifying molecules/features of interest in data, these results are difficult to interpret functionally. Gene-set enrichment analysis is a solution to functional exploration of molecular data; however, it results in the identification of numerous biological processes and often limits a holistic interpretation of the data. In such scenarios, it is common to use the top significant processes to understand the biological system being studied. In this study, we showed that while such an approach will control the FDR at a desired level, the top gene-sets would provide redundant biological insight because of a shared set of significant genes/molecules (Additional file 1: Fig. S3). This effect would be amplified when hierarchically structured knowledgebases are used. The vissE method tackles gene-set redundancy by condensing information from all significant gene-sets into higher-order biological processes, thus hierarchically structuring the results in an easily browsable manner: starting with identification of higher-order processes of interest, then dissecting the gene-sets within that process, and finally drilling down to the genes common across those gene-sets. Associations between different higher-order processes can also be explored providing a more comprehensive landscape of the system being studied.

The redundancy of biological knowledge both within and between knowledgebases is exploited by vissE to enable robust identification of higher-order processes. Within-knowledgebase redundancy helps derive higher-order processes while between-knowledgebase redundancy provides additional independent evidence of processes. As such, vissE can accumulate and structure functional evidence derived from gene-set enrichment analysis methods. Accumulation of gene-sets across knowledgebases can also assist in reducing the impact of poor-quality gene-sets as their effect would be averaged out. A caveat to collecting information from across sources is that database size may skew results, especially when said databases are not capturing related information. For instance, including the immunologic signatures collection (c7) from the MSigDB in a vissE analysis of non-lymphoid cancer cell lines will bias some of the results towards immunologic phenotypes because of the large size of this collection (5219 gene sets in v7.2), despite these cell lines not having an immune phenotype.

This is a specific instance of a more general limitation that applies to gene-set enrichment analysis: biological processes and phenomena that are widely studied will be overrepresented in knowledgebases and will therefore skew results of enrichment analysis. Due to these limitations, it is important to choose related knowledgebases when performing a vissE analysis. Our recommendation for studying cancer systems and other non-lymphoid systems is to use the hallmark collection (h), the canonical pathways sub-collection (CP) of the curated gene-sets collection (c2), the cell type signatures collection (c8) and the ontology collection (c5) excluding the human phenotype ontology (HPO) of MSigDB. Other subcollections should be included in a study-specific manner. Similarly, vissE and other summarisation tools inherit limitations of gene-set enrichment analysis. Importantly, since this is a knowledge-driven tool, the discoveries made using vissE will be limited to known pathways and biological processes. However, vissE does allow exploration of the relatedness of processes in the biological system being studied, supporting the discovery of context-specific phenotypes. Though unknown processes cannot be identified, their presence can be suggested by vissE due to a guilt-by-association: the unknown process is likely to interact with other known processes and the vissE graph can show how these known processes are associated, leading to plausible hypothesis and potential explanations regarding the unknown process.

An important analytical and visualisation module in the vissE arsenal is the text-mining analysis of gene-set clusters that facilitates cluster interpretation. The results of this analytical module, like any other analysis tool, depend on the quality of the underlying data. Concisely named gene-sets accompanied with succinct short descriptions would result in informative and interpretable word clouds. Curated knowledgebases such as pathway databases and GO generally use a controlled vocabulary to represent biological processes and are therefore rich information sources for text mining. The results in this study primarily used these sources and the resultant word clouds were biologically meaningful and easy to interpret. Consistent word clouds from text mining of names and short descriptions (Additional file 1: Fig. S21) attested to this claim and motivate our selection of specific sub-collections from the MSigDB. Collections such as the chemical and genetic perturbations (CGN) in the MSigDB contain many informative gene-sets however these have been named by individual contributors without a consistent naming convention and are limited in their utility in a text mining analysis. Concise, functional naming of gene-sets in repositories provides valuable information for downstream analysis of results and should be encouraged by knowledgebases.

Combining factor analysis with gene-set enrichment analysis and vissE, we were able to demonstrate a novel pipeline for unsupervised identification and characterisation of molecular phenotypes in various data modalities. Factor analysis has been previously used to explore expression patterns in an unbiased way however, the extension of this pipeline with singscore and vissE allowed us to gain a multifaceted view of the phenotype underlying the factors identified. Through this pipeline, we were able to identify and characterise proliferating cells in single cell transcriptomic data and the more nuanced phenotype of tumour promoting cancer associated fibroblasts (CAFs) in spatially resolved transcriptomics data. Despite capturing linear relationships in the data, the factor analysis algorithm we used proved to be powerful when combined with a functional interpretation pipeline. Since factors identified using PCA are orthogonal, we expect that biological processes captured using it are also orthogonal. The same process appearing across different factors would likely represent different context-specific states that produce context-specific outcomes. We expect PCA to perform better than other sophisticated approaches because it can capture modules of co-occurring context-specific processes within orthogonal factors that can then be decoupled using vissE. Other approaches such as independent components analysis (ICA) may reveal independent processes that biologists would then have to investigate for associations. The choice of PCA was easily justified with the results of the spatial transcriptomics analysis: using our pipeline, we were able to recover and characterise spatial structures associated with complex molecular phenotypes despite not having used the spatial context in the analysis. These results showed that spatially resolved transcriptomic data has the potential to recapitulate fine-grained spatial structures using purely transcriptomic measurements. The problem then becomes associating these gene expression signatures with known biology, which is in essence the problem that vissE has been designed to address.

Conclusion

Biological systems are composed of complex interacting biological processes that function together to result in a phenotype. To fully understand these systems, we need computational and statistical tools that allow us to gain a complete understanding of the underlying system. The tool presented here, vissE, takes us a step forward in gaining a more holistic view of biological systems when coupled with state-of-the-art statistical methodology, and importantly, helps to reduce investigator bias in interpretation. A vissE analysis can assist biologists in identifying biological themes in their experiments to drive novel hypotheses. Since it provides a comprehensive view of the system, vissE will allow biologists to capture the discoveries that would otherwise be missed when exploring the top few results. Its generalised applicability will greatly enhance functional analysis in every biologist’s workflow.

Author contributions

DDB and MJD conceived and led the study. DDB, NL, SL, MK and AM performed the computational and statistical analysis. DDB, MK and CWT developed the R/Bioconductor packages used in this study. DDB, CWT, HJW and MJD assisted in the interpretation of results. NP annotated the pathology slides from the spatial analysis. MJD supervised the study. All authors helped in preparing the manuscript.

Funding

DDB and MJD are supported by the Grant-in-Aid Scheme administered by Cancer Council Victoria and by a research grant from the Australian Lions Childhood Cancer Foundation. MJD is funded by the Betty Smyth Centenary Fellowship in Bioinformatics and the Cure Brain Cancer Foundation and National Breast Cancer Foundation joint Grant CBCNBCF-19-009. AM is supported by research grant from the Colonial Foundation as part of Colonial Foundation Healthy Ageing Centre. WEHI acknowledges the support of the Operational Infrastructure Program of the Victorian Government.

Availability of data and materials

The vissE method along with gene-sets from the MSigDB can be accessed using the R/Bioconductor packages vissE and msigdb, respectively. Data from the EMT study can be accessed using the emtdata R/Bioconductor package. Input data to run vissE on the three workflows in this study as well as the full-resolution annotated breast cancer sample are available on figshare (DOI: 10.26188/19193660).

Declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.