Skip to main content
PLOS One logoLink to PLOS One
. 2026 Mar 20;21(3):e0325399. doi: 10.1371/journal.pone.0325399

Visual analytics framework for survival analysis and biomarker discovery from gene expression data

Jaka Kokošar 1, Cagatay Turkay 2, Luka Ausec 3, Miha Štajdohar 3, Blaž Zupan 1,4,*
Editor: Diego A Forero5
PMCID: PMC13004513  PMID: 41860988

Abstract

We introduce a visual analytics methodology for survival analysis, and propose a framework that defines a reusable set of visualization and modeling components to support exploratory and hypothesis-driven biomarker discovery. Survival analysis—essential in biomedicine—evaluates patients‘ survival rates and the onset of medically relevant events, given their clinical and genetic profiles and genetic predispositions. Existing approaches often require programming expertise or rely on inflexible analysis pipelines, limiting their usability among biomedical researchers. The lack of advanced, user-friendly tools hinders problem solving, limits accessibility for biomedical researchers, and restricts interactive data exploration. Our methodology emphasizes functionality-driven design and modularity, akin to combining LEGO bricks to build tailored visual workflows. We (1) define a minimal set of reusable visualization and modeling components that support common survival analysis tasks, (2) implement interactive visualizations for discovering survival cohorts and their characteristic features, and (3) demonstrate integration within an existing visual analytics platform. We implemented the methodology as an open-source add-on to Orange Data Mining and validated it through use cases ranging from Kaplan–Meier estimation to biomarker discovery. While the framework is generally applicable, we illustrate its value through case studies in cancer research, where survival analysis is of critical importance. The resulting framework illustrates how methodological design can drive intuitive, transparent, and effective survival analysis.

1 Introduction

Survival analysis is a set of statistical methods used to determine the life expectancy of an investigated population. Survival analysis became particularly valuable in medical research, where researchers use survival data to observe the life expectancy of the investigated population. Notably, in a clinical setting, we refer to survival time as a time to some clinical outcomes, like relapse or progression of a disease [1,2]. In biomedicine, these covariates are understood as potential biomarkers and targets for treatment development (see Fig 1). To improve survival outcomes, it is essential to understand how patients with different health conditions and genomic predispositions respond to various treatments [3]. Furthermore, the identification of novel markers is crucial for the development of personalized medicine, a rising trend in evidence-based medicine [4].

Fig 1. An example of a Kaplan-Meier survival plot for two gene expression-dependent conditions associated with patient survival.

Fig 1

(a) The difference between survival curves of gene CD14 is not evident. (b) The survival curve is substantially higher for a group of patients with highly expressed gene MAP7. We could say that MAP7 is hence a better biomarker for survival. In biomarker discovery, one of the tasks is to rank features, e.g., gene mutation status, gene expression values, and protein levels, according to the degree of separation between survival signatures given gene expression.

Survival analysis tools should therefore support the inference of survival, the study of changes in survival over time, and the identification of cohorts of subjects with substantial differences in survival. Cohorts are characterised by features, and tools should support users in finding and exploring the most informative ones. Most of these functionalities are currently available through libraries in scripting environments such as R and Python (e.g., survival [5], scikit-survival [6], and lifelines [7]), where they integrate well with other data visualisation and modelling techniques. However, due to the lack of computer programming experience, these are difficult to access for biomedical domain experts. Moreover, scripting does not lend itself to exploratory data analysis and does not facilitate communication with the domain experts involved.

These limitations of scripting environments for survival analysis call for a complementary visual analytics approach, which combines interactive visualizations, integrated analysis methods, and visual programming. Visual analytics [8] enhances data exploration by allowing users to interactively manipulate and interpret data through graphical interfaces, while interactive visualizations [9] provide dynamic, real-time feedback to reveal patterns and trends. Visual programming (e.g., [10]) enables intuitive, workflow-based analysis, reducing the need for coding and making complex methods more accessible—an essential advantage for medical data analysis, where interpretability, usability, and collaboration between clinical researchers and data scientists are critical.

Here, we report on our visual analytics approach to survival analysis. We aim to design an intuitive but powerful tool with a smooth learning curve and interactive interface that motivates exploratory data analysis, explanation, and discovery, supporting a broad scope of potential applications with as few components as possible. The main contributions of our work thus include:

  1. Task-oriented decomposition of survival analysis. We define and implement a reusable set of analytical components that together cover key survival analysis goals. This decomposition supports flexible construction of diverse analytical pipelines and facilitates exploratory biomarker discovery.

  2. Demonstration of concept validity through replication and application. We show that with the designed components, users can replicate recently published biomedical survival analyses and address complex, large-scale datasets—demonstrating both the generality and practical utility of the framework.

  3. Integration with a broader data mining and machine learning ecosystem. Implemented as an add-on to Orange Data Mining (see https://orangedatamining.com) [11,12], the framework integrates seamlessly with a wide range of existing visual programming tools, enabling the complementary use of advanced data visualization, machine learning models, and interaction analysis beyond survival-specific methods.

Our visual analytics framework and all workflows presented in this paper are freely available as open-source resources to promote transparency, reproducibility, and further community-driven development.

The manuscript begins with an overview of related methods, including survival analysis, visual analytics, and workflow-based approaches to data analysis. We then describe our visual analytics approach, which integrates interpreted workflows [13], interactive visualisations and the use of computational models. To demonstrate the usefulness of the designed analytical components and tool, we present a set of typical survival analysis and biomarker discovery tasks and show how we can solve them using our proposed visual analytics toolbox.

2 Related work

In application, the data analysis framework we present here relates to concepts from survival analysis and discovery of biomarkers. In the development of exploratory data analysis approach, our work is related to visual analytics and development of pipelines that use workflows and visual programming, and combine machine learning and interactive data visualization. In particular, for the latter, our work borrows from concepts developed within Orange Data Mining framework.

2.1 Survival analysis for biomarker discovery

Biomarkers play a pivotal role in linking a patient’s molecular characteristics to clinical outcomes, helping to predict the success of therapies and guide decision-making. In biomedicine, the covariates with a significant impact on patient survival are potential markers, characteristics of a biological system we can measure objectively and use as an indicator of the system‘s state [14]. In oncology, for instance, biomarkers can distinguish patients likely to benefit from specific therapies, while sparing others from ineffective treatments. Markers may be clinical, related to the patient‘s symptoms, or biological, related to measurements on the molecular level, like the concentration of a specific protein or expression of a particular gene [15,16]. Identifying such markers is crucial for the development of personalized medicine that uses data to deliver targeted, patient-specific treatments [17].

2.2 Key visual analytics concepts

Here we discuss a number of key visual analytics principles to facilitate data analysis tasks involving large numbers of data features and multiple data sources. We then highlight key relevant techniques and applications in related domains.

Interplay of computation and human input – Visual analytics is often referred to as a dialogue, an interplay, between the analysts and the data, through the facilitation of computational tools and interactive visualizations [8]. Interaction and integrated computational methods that are triggered by human inputs have been a key facilitator of dialogues that are mechanisms for analysis and reasoning [18]. For instance, such integrated approaches have been used to cluster large collections interactively [19], or for high-dimensional data analysis [20]. Through flexible programmable visual analytics workflows, our approach in this paper facilitates such interactions in a more structured manner and makes opportunities for the analysts to interact more explicit.

Input variation & result comparison – A key mechanism often used in visual analytics methods is to explore the variation in the results in response to variation of data and parameters that control an analytical operation or a model [21]. Visual analytics approaches have shown to effectively support comparative analysis for modelling in the context of classification [22], or in dimension reduction [23]. In this work, we build on this notion of input-output variation exploration within the context of survival analysis.

Visual analysis workflow & interactive propagation – A number of visualization approaches and systems have made the analysis workflow explicit and available for further interaction starting with the seminal VisTrails work by Bavoli et al. [24]. More recently, similar visual programming and visual workflow methods have been used in generating visualization design variations [25]. While these methods are primarily focused on visualization generation, they pave the way for more general, flexible and transferable data analysis workflows where interactive alterations at an intermediate stage of the analytical process can be propagated further through the analytical tools and visualizations that communicate the results.

2.3 Visual analytics for survival analysis

The challenges around survival analysis have been approached by visual analytics methods in a number of studies. In their Caleydo system, Lex et al. demonstrates how Kaplan-Meier (KM) plots could be associated as visual indicators to characterize sub-cohorts in a visual analysis of cancer subtype stratification process [26]. Corvo et al. makes survival analysis a core analysis focus and demonstrates how KM plots could be generated in response to interactive selections in their SurviVIS tool [27]. Marai et al. employ KM plots and Nomograms in their visual analytics system designed to explore and detect similar head and neck cancer patients [28]. However, these solutions primarily focus on a pre-defined tasks (or disease types) and do not support user-defined analytical pipelines. Our work takes these methods further by integrating a combination of analytical methods and interactive visualizations within a visual programming paradigm.

Several web-based tools with a focus on survival analysis have been proposed to assist biomedical researchers in genome-based biomarker discovery [29,30]. These tools provide a graphical user interface combining genomics data, clinical data and analysis tools designed specifically for mining survival-related gene markers across different data sources and tumor types. For instance, Maller et al. used Kaplan-Meier Plotter to evaluate the association between PLOD2 gene expression values and relapse-free survival [31] and Ingebriktsen et al. used it to evaluate a six-gene signature concerning recurrence-free survival in breast cancer patients [32]. While the proposed web-based solutions can make exploring data simpler, they do not fully implement the key concepts of visual analytics (discussed in Sect 2.2) and this dashboard-based approach often struggle to adapt to real-time insights or changing hypotheses. In addition, as discussed by Idogawa et al. [33], there are concerns about the data integrity of the proposed systems and more importantly, the underlying analysis is often closed-source. This ultimately leads to a lack of trust within the research community and hinders the reproducibility of research results.

2.4 Orange data mining framework

We have implemented the visual analytics approach to survival analysis we describe here as an add-on to the Orange data mining framework [10,12,34]. Orange is a general-purpose data analysis tool. Data analysis pipelines in Orange are assembled through visual programming and consist of widgets—components with a graphical user interface—that perform distinct data analysis or visualization tasks. We entirely borrow the visual analytics concept from Orange. The principal innovation of the work presented here is designing components for survival analysis so that they can collectively be applied to a wide range of tasks and seamlessly integrate with other existing Orange components. Notice that we could develop a similar survival analysis framework in different general purpose workflow-based data analysis systems, including popular RapidMiner (see https://rapidminer.com/) or KNIME (see http://knime.com). We choose Orange, though, since it uses interpreted workflows [13], that execute in real time as users interact with individual components. In an interpreted workflow, every change to widget settings, data selections, or parameters is immediately propagated through the pipeline without requiring explicit re-execution. This property enables tightly coupled human–machine interaction and supports the exploratory, iterative nature of visual analytics. Orange is also different from the two mentioned workflow systems in supporting interactive visualizations. Despite all these differences, our choice for Orange is biased: several authors of this report are its principal designers and contributors.

3 Key analytical approaches to survival analysis for biomarker discovery

The literature shows that current practice uses a limited range of computational and data visualization methods for the analysis of survival data. These methods can be used in combination to address many different task in biomarker discovery where the overreaching goal is to identify or validate data features that are best associated with patient survival. By far the most widely used and established methods of survival analysis are the Kaplan-Meier estimator and Cox regression model. Their adaptation and importance are evident in their status among the most cited articles [35] as well as more focused reviews and guidelines on their practical use in biomedical cancer research [1,36–40].

3.1 Characterization of key goals and tasks

Based on the above-mentioned reviews and guidelines, we have externalized the common goals (G) and tasks (T) typically employed in different analytical scenarios. While we do not delve into the details and definitions of survival analysis methods, we do, however, outline their use in the context of biomedical application and how they can be applied across diverse analytical scenarios in oncology.

G1 – Understand the distribution of survival times. Survival data is most often presented as a survival curve, which illustrates how survival prognosis changes over time. The most fundamental step in survival analysis is the construction of the survival curve.

T1 Estimate and plot the survival curve. The most common approach to survival curve estimation is the Kaplan-Meier method [41]. The calculated survival probabilities are then plotted against time to provide a visual summary of survival probabilities over time.

T2 Summarize key statistics. Kaplan-Meier curves can be thought of as a form of descriptive statistics for survival data [42]. To add context to the visual representation, Kaplan-Meier curves are often juxtaposed by additional statistics, such as total number of samples, number of samples with observed events, median survival time, and confidence intervals for survival probabilities, among others.

G2 – Analyze the differences in survival between different cohorts. Survival curves provide a basis for comparing the survival experience of different sample groups.

T3 Stratify the data by variables of interest. Kaplan-Meier analysis does not directly account for the impact of various variables on survival. However, it is often used to conduct a univariate analysis for comparing survival curves of groups defined by different categorical variables. For continuous variables researches have to first define boundaries defining different groups.

T4 Compare survival curves of different groups. To inspect differences in survival between groups, researchers typically plot multiple survival curves on the same graph [42]. A visual inspection can provide an initial indication of whether a particular group has, for example, a more favorable prognosis compared to others. Visual comparison is further supported by statistical tests, predominantly log-rank test, to quantify this difference [43].

G3 – Interpret the effect of data features on survival outcomes. Survival analysis can be extended to measure the impact of different data features on survival rates.

T5 Develop a prognostic model of patient survival. Researchers often model the impact of data features on survival in either univariate or multivariate settings using Cox regression analysis [44]:

  T5.1 Univariate cox regression analysis is often used a feature screening technique or to observe how each data features affects survival independently.

  T5.2 Multivariate cox regression analysis is used to observe how the significance of features shifts when they are adjusted for other data features.

T6 Model interpretation and explanation. By examining the hazard ratios and confidence intervals derived from the prognostic models, the researchers assess the strength and direction of associations between data features and survival outcomes, identifying which factors have significant prognostic value.

T7 Model application and visualization. Researchers often present prognostic models graphically as Nomograms to enable individualized survival predictions [45]. Nomograms translate prognostic models into an accessible visual format that aids in their interpretation and makes it easier for clinicians to apply them in practice.

G4 – Develop personalized risk-based patient stratification. Patient stratification exemplifies the practical application of prognostic models, allowing identification of high-risk groups that may, for example, benefit from targeted interventions.

T8 Assign risk scores to individual patients. A common approach is to utilize the coefficients derived from the developed prognostic model to calculate the risk score (sometimes referred to as the prognostic index) for each patient [46]. These risk scores are then used to stratify patients into different risk groups. This stratification process is crucial for identifying subgroups of high- and low-risk patients with distinct prognoses that can inform personalized treatments or biomarker development and validation.

G5 – Validation of developed prognostic or risk-based stratification models. In biomarker discovery, models with strong discriminatory power can help validate the clinical relevance of the identified biomarkers, showing that they provide meaningful insight into patient outcomes [47].

T9 Evaluating the discriminative power. It is common practice to visually inspect the separation between the curves for high- and low-risk groups, which indicates good discriminatory power. More analytical another common approach is to use the concordance index (C-index) [48], which quantifies how well the model distinguishes between individuals who experience the event of interest and those who do not.

3.2 Typical analytical pipelines

This goal-oriented abstraction can generally be used for analyzing any type of survival data. However, typical biomarker discovery pipelines tend to be more complex and multifaceted. Also, how survival analysis is used can vary; survival data can be the primary concern of the analysis or just as a validation step, where the results are evaluated in relation to clinical outcomes. In either case, this goal-oriented abstraction can be applied across various analytical scenarios; each goal can function as a standalone analysis or be combined in different ways to suit specific analysis needs.

For example, in their clinical trail, Lawrence et al. [49] set out to evaluate the relationship between expression of the DNA mismatch repair (MMR) gene MLH1 and survival outcomes in patients with resected pancreatic cancer who received adjuvant chemoradiation. They set out to analyze survival distributions of study population, evaluate the differences in survival of different cohorts, and assess the prognostic impact of potential gene marker (G1, G2, G3). Their data analysis pipeline includes stratifying patients based on median expression of MLH1 (T3), estimating survival curves for each cohort (T1,2), evaluating how significant is the differance in survival between cohorts (T4) and estimating the prognostic value of gene MLH1 in univariate and multivariate setting (T5,6). We can observe similar data analysis pipelines in several different studies for biomarker discovery in oncology [50–53].

Expanding on this concepts, in their analysis pipeline, Long et al. [54] developed and validated a multi gene-based prognostic index to stratify patients into low- and high-risk groups (G4, G4, G5). They first screened survival related genes (T5.1) and selected a four-gene prognosis model (T5.2) that assigns risk scores to individual patients. Their analysis includes a validation of newly developed prognosis model in relation to established clinical factors (T6) and construction of a predictive nomogram (T7). They also validate a risk-based patient stratification by splitting patients into low- and high-risk groups (T3), calculating survival curve for each group (T1) and test if there are significant differences (T4) in survival rates (G1, G2). Similary as before, we can observe this kind of analytical approaches across various different studies [55–57].

4 Integrating survival analysis, workflows and visual programming

Our approach to support survival analysis consists of decomposing the key analytical approaches (T) discussed in Sect 3 into independent and reusable components, each addressing a specific analytical or exploratory function. These components can then be assembled into diverse workflows through visual programming, allowing users to construct pipelines that meet the needs of their specific analytical scenarios (G). By grounding our design in this task-oriented approach, we have created a survival analysis framework that users can use to build custom data analysis pipelines ranging from simple exploratory analysis of survival curves to complex pipelines for multi-gene biomarker discovery, all within a visual programming environment. Below, we describe this general framework and list the components we have implemented for survival analysis.

4.1 Data analysis framework

The following elements from Orange were critical in supporting our design:

Widgets are Orange’s components in data analytics workflows that receive data on input, process or visualize the data, and transmit the results or user selections to the widget’s output. Widgets encapsulate data processing and visualization functions and allow us to combine tasks (T) and goals (G) into independent, reusable components:

Kaplan-Meier plotter (T1-4) is a component that we can use to analyse survival function (G2) and assess the differences of survival between different cohorts (G2).

Cox Regression (T5-6) component allows us to estimate the effect different data features have on survival of our patients (G3).

Rank Survival Features (T5.1) is a very specialized component that ranks data features based on univariate cox regression analysis.

Cohorts (T8) is what we can use for the development of prognosis model and assign risk score to each patient (G4).

Survival Nomogram (T7) enables graphical representation of developed prognostic model and supports its interpretation (G3).

We then combine these components into workflows using visual programming.

Workflows are ordered collections of widgets that combine different analytical tasks and goals into user defined analytical pipelines, like the ones discussed in Sect 3.2. For example, a workflow from Fig 2 starts with the widget for loading the data and then branches into pipelines for (1) exploring biomarker significance, (2) risk-based patient stratification, and (3) exploring similarity between data instances. This exemplifies how a visual programming paradigm supports iterative assembly of workflows, allowing users to test and refine their hypothesis in real time. Orange workflows are read from left to right, with inputs to widgets on the left and outputs on the right. Note that in this workflow Kaplan-Meier Plot widget is reused to display the difference in survival of either the feature-defined cohorts, cohorts defined by risk-based stratification model or between group of patients selected in the t-SNE visualization.

Fig 2. An example workflow to explore cohort formation based on clustering and biomarker discovery.

Fig 2

The workflow starts by loading the data (Datasets widget). The workflow progresses from (1) stratification of patients based on specified cutoffs value of continuous features (using Distributions, Kaplan-Meier Plot) to more complex (2) cohort formation based on several data features (the branch with Rank Survival Features, Cohorts). For comparison, (3) we plotted the map of patients (t-SNE), where patients are grouped by similarity of their feature-profiles. The survival curve for the cluster of patients selected in t-SNE is then compared to all other patients (Kaplan-Meier Plot (1)).

Interactive interface.

Orange widgets are interactive. The first and most obvious type of interaction is the selection of display options in the widget’s control area, as in the Kaplan-Meier plot widget from Fig 3a. More important for visual analytics, however, are interactive displays of data. For example, in the Distributions widget, the user can select any part of the distribution (Fig 3b) and instruct the widget to output only the subset of the selected data instances or pass selection indicator with the data on the output (Fig 3c).

Fig 3. We zoom in on the top branch in workflow from Fig 2.

Fig 3

We use the Distribution widget to plot the distribution of the tumor size feature. The distribution plot is interactive, for example, we select data instances where the tumor size is less than 35 mm (b). Patient subgroups defined in the Distribution widget (b) are linked to survival curves in the Kaplan–Meier Plot (c) through brush-and-link interaction, providing an interactive browser to characterize the survival of the selected group. Different analysis options are available to the user, for example plotting of the confidence interval (a).

Signal processing.

To support interactive visual analysis, widgets emit their output whenever their data selections or parameters change. They communicate user’s selections to downstream pipeline, where components instantaneously react to changes immediately. In Fig 2, for example in the middle branch, a combination of Rank Survival Features, Cohorts and Kaplan-Meier Plot provide a interactive way for users to select top-ranked data features that are then used for construction of risk-based model, split patients into low- and high-risk cohorts and plot the survival curve of each cohort (see Fig 4).

Fig 4. Focusing on the middle branch of workflow from Fig 2.

Fig 4

We use the Rank Survival Features to prioritize features most relevant (a). Data that is passed to Cohorts widget contains only two selected features to construct a risk-based model and stratify patients into low- and high-risk cohorts (b). This information is then passed to the Kaplan-Meier Plot that estimates, plots and assess how significantly different are the two survival curves (c).

5 Evaluation through case studies

To evaluate our approach, we designed a series of case studies based on recently published research in survival analysis and biomarker discovery. These case studies test the ability of our approach and developed software to address key challenges in the field, assessing whether the provided components are sufficient, whether they can be effectively combined to solve relevant analytical tasks, and whether the approach is practical for real-world applications. Through these examples, we demonstrate how interactive visual analytics facilitates exploratory data analysis, hypothesis generation, and discovery of survival-related biomarkers.

5.1 Data

In all case studies, we use data from the METABRIC database. The METABRIC (Molecular Taxonomy of Breast Cancer International Consortium) dataset comprises genomic and clinical data from nearly 2,000 breast cancer patients, including expression profiles with approximately 24,000 genes, clinical features, and survival outcomes [58]. The dataset is publicly available and widely used in studies of breast cancer prognosis and biomarker discovery. We use this dataset as a representative example of a large, complex dataset with multiple data types and survival outcomes, which is typical of many studies in oncology and survival-related biomarker discovery. An example of the METABRIC data as provided in Orange is shown in Fig 5.

Fig 5. A small sample of the METABRIC dataset available in Orange, where each row represents a primary breast cancer patient characterized by (1) clinical features (such as age at diagnosis and tumor stage), (2) gene expression values (e.g., KRAS, RERE, PHF7), (3) and clinical outcomes (overall patient survival).

Fig 5

5.2 Exploring prognostic role of gene KRAS

Hwang et al. [51] have recently investigated the prognostic role of the mRNA expression of a proto-oncogene KRAS in breast cancer with the application of survival analysis on two different datasets (TCGA [59] and METABRIC [58]). The authors set out to find if the expression of KRAS is prognostic in breast cancer. KRAS is a well-known driver of lung, prostate, and colon cancer. To investigate the prognostic impact of KRAS, Hwang et al. stratified patients into high- and low-expression groups based on median expression levels (T3). They plotted Kaplan-Meier survival curves (T1) for overall survival of both cohorts and assessed statistical significance using log-rank test (T4). They incorporated multivariate Cox proportional hazards models to assess the independent prognostic value of KRAS while adjusting for key clinical variables, such as age, tumor stage, and receptor statuses (T5-6). The analysis showed significantly worse outcomes for the high-expression group and confirmed high KRAS expression as an independent indicator of poorer prognosis across both datasets.

In the workflow in Fig 6 we show how can we readily reproduce steps of their analysis with our proposed survival analysis components. Workflow starts with the Genes widget, a part of Orange’s Bioinformatics add-on, we selected a KRAS gene. The Genes widget also shows information from the Entrez Database—thus simplifying gene exploration within Orange. We use Discretize widget to specify the median expression as the threshold between high- and low-expressors. In the upper branch of the workflow we use Kaplan-Meier Plot widget to visualize and compare survival curves. The lower branch of the workflow performs Cox regression analysis for KRAS expression levels adjusted for other known clinical factors. Users can compare the results of both analysis side by side. In this workflow we focused only on METABRIC dataset, however, the analysis can be easily repeated with different dataset by loading the data with File widget. The analysis above focused only on KRAS gene, but how would we identify related genes that may be just as important?

Fig 6. Evaluation of the prognostic potential of individual genes.

Fig 6

This simple workflow effectively reproduces the study of Hwang et al. [51]. The METABRIC data set is pushed through the Distributions widget to allow for an interactive selection of gene expression threshold, and survival probability is visualized in the Kaplan-Meier Plot widget. Different gene expression thresholds can be explored at a click of a button.

5.3 Exploring the related genes

The RAS pathway is a central regulator of cell growth and differentiation in normal tissues, and perturbations of the pathway frequently result in cancer or developmental syndromes (RASopathies) [60]. It is natural to ask the question of the relative importance of other genes in the RAS pathway. Finding such genes can be easily accomplished using a combination of existing and our new widgets (Fig 7).

Fig 7. (a) By using Gene sets, we have reduced the initial data to include only those genes that are participating in Ras signalling pathway from KEGG pathway databse. (b) We conduct standard survival analysis tasks on those genes through Rank Survival Features and Cohorts. Visualizing survival curves in Kaplan-Meier plot allows us to explore newly defined cohorts.

Fig 7

In Fig 7a, we use Genes and Gene Sets widgets to pull in the RAS pathway from the KEGG pathway database and keeping only set of genes from the RAS pathway. Like before, we use the Discretize widget to set a threshold between high- and low-expressor groups for all the genes in the gene set (T3). We use the Rank Survival Features widget for ranking genes in the entire gene set and prioritize ones that best separate cohorts according to survival (T5.1). We select five top-ranked genes and observe that the gene that is best at separating patients by survival is FLT3.

The workflow continues with Fig 7b, we pass the selected genes back into the Genes widget to get more context around these genes. For example, we can see that the protein product of FLT3 expression functions as a receptor tyrosine kinase normally expressed on hematopoietic stem cells. Its mutations are well studied in acute myeloid leukemia [61]. In addition, the upregulation of FLT3 expression has also been observed in lymph node metastases of patients with primary breast cancer [62]. We observe this also in our exploratory analysis (Kaplan-Meier plot in the top branch), where we observe that overexpression of FLT3 leads to a favorable prognosis (T1-4). However, individual genes seldom function in isolation. Understanding the broader molecular circuitry (beyond single-gene biomarkers) can help us better understand the complex nature of diseases such as cancer. The bottom branch of this workflow uses the Cohorts widget to develop a risk score model based on all of the selected genes (T8). We then use the Kaplan-Meier Plot widget to plot and compare survival curves of high- and low-risk groups (T1-4). The resulting workflow thus provides a browser of genes and sets of genes that we can evaluate individually or in combination.

5.4 Cohort formation based on similarity of data instances

Our exploratory analysis of METABRIC dataset above focused heavily on survival analysis components. We would like to demonstrate that the goals and tasks discussed in Sect 3 can also be used interchangeably with different analysis goals. For example, one might want to explore the similarity of data instances (patients) based on how similar their gene expression profiles are. But then, based on identified clusters, the goal might be to describe and compare different clusters in terms of their survival experiences (G1 and G2). The key question is: what characterizes those clusters?

In Fig 8 we demonstrate the utility of Hierarchical Clustering to group patients into three distinct clusters. User selected clusters are propagated to Kaplan-Meier Plot where we explore the difference of survival functions of patients in different cohorts (T1-4). Interestingly, we observe that for the cluster of patients in red survival rates drop rapidly compared to other clusters at the beginning. To investigate further, we extend the workflow and use Box Plot to reveal features that characterize patients of each cluster. The exploration of our dataset revealed that patients in the red cluster are defined by the overexpression of gene PSAT1. This finding is interesting, since the gene PSAT1 is indeed a subject of an active research in breast cancer with similar reports [63,64].

Fig 8. Identifying groups of patients on the METABRIC dataset.

Fig 8

The workflow computes distances between patient profiles (Distances widget) and clusters the patients accordingly in Hierarchical Clustering. The user can use the dendrogram in Hierarchical Clustering to choose the clusters by brushing or defining a cut-off distance. We display survival curves of identified clusters of patients in the Kaplan-Meier Plot. The workflow uses Box Plot to characterize given clusters by providing a sorted list of features, which can help in the formation of new hypotheses. In the particular case displayed in the figure, we observe that expression levels of gene PSAT1 are highest in cluster C2.

Again, notice that any change in interactive cluster selection in Hierarchical Clustering propagates through the workflow and updates the content of both Box Plot and Kaplan-Meier Plot and thus enable on-the-fly hypothesis formation.

6 Discussion

Our goal was to design a visual analytics system explicitly tailored to survival data analysis tasks. We aimed to provide comprehensive coverage of key visual analytics concepts (see Sect 2.2) and also to test the hypothesis that a small, well-defined set of reusable visual analytics components could enable domain experts to effectively address a broad range of survival analysis tasks.

Focus of our approach is the flexibility afforded by visual programming, enabling users to construct and adjust data analysis pipelines dynamically. This adaptability supports a nuanced data exploration through comparative analysis and variation of inputs. Changes in the outcomes of the computational analysis may be observed interactively by changing any method’s settings, selecting a different data or feature subset, or designing different analysis paths in the same workflow. Our system’s design inherently supports the seamless interplay between computational processes and human input and demonstrates how users can be actively engaged in various analytical tasks. In particular, this includes the selection of features and cohorts. Our framework supports various means of human intervention, ranging from computationally driven decisions, such as feature ranking, to domain knowledge-driven decisions, such as selecting genes of interest.

In the manuscript, our proof-of-concept demonstrations focused on showing that the proposed components and user interfaces can readily reproduce analytical steps commonly used in gene expression-based biomarker discovery. However, the proposed tool is primarily designed for new explorations, where fast prototyping and interactive visual analytics become most valuable. To illustrate this, we revisited the SCAN-B breast-cancer dataset from Brueffer et al. [65], which comprises over 3,000 primary tumors profiled by whole-transcriptome sequencing. Whereas the original study focused on training multigene RNA-seq classifiers for conventional clinical biomarkers (for example, predicting estrogen-receptor status from consensus pathology labels), we instead combined their expression and survival data to explore the prognostic potential of small (N<10 genes) interpretable gene sets.

As found in the original analysis of SCAN-B dataset, expression values of single genes that encode the target proteins (e.g., estrogen receptor gene ESR1, Fig 9a) cannot stratify patients by survival. We therefore constructed a compact panel of biologically motivated gene sets capturing major breast cancer programs (Estrogen, Proliferation, HER2, PI3K, Immune, EMT), see Fig 9b). Gene-set enrichment scores revealed that Estrogen- and Proliferation-related genes produced the strongest survival separation (Fig 9d, 9e), consistent with extensive literature linking these pathways to patient prognosis [66]. Moreover, projecting gene-set scores into a low-dimensional space (t-SNE) yielded three robust clusters enriched respectively for estrogen signalling (predominantly ER-positive tumors), proliferation/HER2 activity, and EMT/immune features. This construction of the t-SNE plot demonstrates that even a small number of gene sets can expose clinically meaningful structure in the SCAN-B cohort.

Fig 9. Workflow for gene set–based biomarker scoring and exploration.

Fig 9

(a) Expression of ESR1 alone does not sufficiently separate patient survival. (b) We load a set of expert-curated gene groups capturing major breast-cancer programs. (c) A t-SNE projection of data from gene sets reveals three clusters with different proportions of ER-positive patients. (d) Gene sets are ranked by prognostic value, showing Estrogen and Proliferation as most informative. (e) A Proliferation and Estrogen-based marker constructed from this sets yields clear separation of Kaplan–Meier survival curves.

This example highlights the strength of our proposed toolbox: users can combine the survival-specific components we developed with the broader machine-learning and bioinformatics methods, like in our case, those on dimensionality reduction, gene-set construction, and ssGSEA scoring (see [67]). Starting from simple domain knowledge-such as an table defining gene sets—a complete exploratory workflow like the one from Fig 9 can be assembled within minutes. The resulting environment encourages rapid hypothesis generation, comparison of analytical choices, and visual discovery of patterns. More broadly, this interoperability demonstrates that our survival analysis framework can be combined with essentially any machine-learning or data-science method, achieving the method integration that was one of the design goals of our approach. This flexibility also means that users can incorporate analytical techniques beyond simple correlation-based exploration. For example, ssGSEA we have included in our use case is a representative of such feature-group modeling approaches.

Support for visual analytics in our proposed framework is primarily a consequence of developing survival analysis components within Orange data mining framework. From Orange, we benefit from interpreted workflows, interactive visualizations, and the ability to encapsulate methods of choice within widgets that act on their own, but through a responsive exchange of data collectively, constrained within a workflow, form an exploratory data analysis environment. This reliance on in-memory processing is what enables such a high degree of interactivity, though it also implies that the framework is best suited for datasets that can fit into the machine’s working memory. This design ensures that the analytical environment, characterized by its exploratory nature and the synergy between different components, is entirely shaped by the user’s interactions and decisions. While the framework itself does not impose additional scalability constraints, its performance scales with the underlying Python ecosystem that includes NumPy, pandas, and scikit-learn, which allows the toolbox to handle datasets of the same size and complexity supported by these widely used libraries.

In summary, our work contributes to the field of survival analysis by providing a novel visual analytics framework that enhances user engagement through intuitive design and visual programming.

7 Conclusion

Survival analysis is concerned with data where the outcome variable of interest is time to an event. Its results can help us understand the effects of factors that determine a patient’s lifespan or design treatments for disease. With advances in technology to profile patients, phenotypes, drugs, and treatments and to collect the data related to survival, the democratization of survival data analysis and visual communication of results becomes essential.

In this paper, we have described a tool and an approach for visual analysis of survival data. Our main contributions are the definition and implementation of analytic components for survival analysis workflows and the demonstration that these are sufficient and convenient to solve standard survival analysis tasks. We have also shown that these workflows can bring humans into the loop and thoroughly implement key visual analytics concepts, involving users in both experimentation and interpretation of results.

Data Availability

The toolbox we developed is available as an open-source add-on “Survival” to Orange (http://orangedatamining.com). The code is available at https://github.com/biolab/orange3-survival-analysis. The workflows from the case studies, together with the data, are available at https://orangedatamining.com/examples under the section “Survival Analysis”.

Funding Statement

This work was supported in part by grants from Slovenian Research Agency (P2-0209, L2-3170, V2-2272).

References

  • 1.Fleming TR, Lin DY. Survival analysis in clinical trials: past developments and future directions. Biometrics. 2000;56(4):971–83. doi: 10.1111/j.0006-341x.2000.0971.x [DOI] [PubMed] [Google Scholar]
  • 2.Pazdur R. Endpoints for assessing drug activity in clinical trials. Oncologist. 2008;13 Suppl 2:19–21. doi: 10.1634/theoncologist.13-S2-19 [DOI] [PubMed] [Google Scholar]
  • 3.van’t Veer LJ, Bernards R. Enabling personalized cancer medicine through analysis of gene-expression patterns. Nature. 2008;452(7187):564–70. doi: 10.1038/nature06915 [DOI] [PubMed] [Google Scholar]
  • 4.Chin L, Andersen JN, Futreal PA. Cancer genomics: from discovery science to personalized medicine. Nat Med. 2011;17(3):297–303. doi: 10.1038/nm.2323 [DOI] [PubMed] [Google Scholar]
  • 5.Therneau TM, Grambsch PM. Modeling survival data: extending the Cox model. New York: Springer; 2000. [Google Scholar]
  • 6.Pölsterl S. scikit-survival: a library for time-to-event analysis built on top of scikit-learn. Journal of Machine Learning Research. 2020;21(212):1–6.34305477 [Google Scholar]
  • 7.Davidson-Pilon C. lifelines: survival analysis in Python. JOSS. 2019;4(40):1317. doi: 10.21105/joss.01317 [DOI] [Google Scholar]
  • 8.Andrienko N, Andrienko G, Fuchs G, Slingsby A, Turkay C, Wrobel S. Visual analytics for data scientists. Springer; 2020. [Google Scholar]
  • 9.Ward MO, Grinstein G, Keim D. Interactive data visualization: foundations, techniques, and applications. 2nd ed. CRC Press; 2015. [Google Scholar]
  • 10.Curk T, Demsar J, Xu Q, Leban G, Petrovic U, Bratko I, et al. Microarray data mining with visual programming. Bioinformatics. 2005;21(3):396–8. doi: 10.1093/bioinformatics/bth474 [DOI] [PubMed] [Google Scholar]
  • 11.Demšar J, Curk T, Erjavec A, Črt G, Hočevar T, Milutinovič M, et al. Orange: data mining toolbox in Python. Journal of Machine Learning Research. 2013;14:2349–53. [Google Scholar]
  • 12.Demšar J, Zupan B. Orange: Data mining fruitful and fun—a historical perspective. Informatica. 2013;37(1):55. [Google Scholar]
  • 13.Myers BA. Taxonomies of visual programming and program visualization. Journal of Visual Languages & Computing. 1990;1(1):97–123. doi: 10.1016/s1045-926x(05)80036-9 [DOI] [Google Scholar]
  • 14.Biomarkers Definitions Working Group. Biomarkers and surrogate endpoints: preferred definitions and conceptual framework. Clin Pharmacol Ther. 2001;69(3):89–95. doi: 10.1067/mcp.2001.113989 [DOI] [PubMed] [Google Scholar]
  • 15.Sotiriou C, Piccart MJ. Taking gene-expression profiling to the clinic: when will molecular signatures become relevant to patient care?. Nat Rev Cancer. 2007;7(7):545–53. doi: 10.1038/nrc2173 [DOI] [PubMed] [Google Scholar]
  • 16.Henry NL, Hayes DF. Cancer biomarkers. Mol Oncol. 2012;6(2):140–6. doi: 10.1016/j.molonc.2012.01.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Collins FS, Varmus H. A new initiative on precision medicine. N Engl J Med. 2015;372(9):793–5. doi: 10.1056/NEJMp1500523 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Endert A, Ribarsky W, Turkay C, Wong BLW, Nabney I, Blanco ID, et al. The state of the art in integrating machine learning into visual analytics. Computer Graphics Forum. 2017;36(8):458–86. doi: 10.1111/cgf.13092 [DOI] [Google Scholar]
  • 19.Andrienko G, Andrienko N, Rinzivillo S, Nanni M, Pedreschi D, Giannotti F. Interactive visual clustering of large collections of trajectories. In: 2009 IEEE Symposium on Visual Analytics Science and Technology. 2009. p. 3–10. 10.1109/vast.2009.5332584 [DOI] [Google Scholar]
  • 20.Krause J, Dasgupta A, Fekete J-D, Bertini E. SeekAView: an intelligent dimensionality reduction strategy for navigating high-dimensional data spaces. In: 2016 IEEE 6th Symposium on Large Data Analysis and Visualization (LDAV). 2016. p. 11–9. 10.1109/ldav.2016.7874305 [DOI] [Google Scholar]
  • 21.Sedlmair M, Heinzl C, Bruckner S, Piringer H, Möller T. Visual parameter space analysis: a conceptual framework. IEEE Trans Vis Comput Graph. 2014;20(12):2161–70. doi: 10.1109/TVCG.2014.2346321 [DOI] [PubMed] [Google Scholar]
  • 22.Choo J, Lee H, Kihm J, Park H. iVisClassifier: An interactive visual analytics system for classification based on supervised dimension reduction. In: 2010 IEEE Symposium on Visual Analytics Science and Technology. 2010. p. 27–34. 10.1109/vast.2010.5652443 [DOI] [Google Scholar]
  • 23.Chatzimparmpas A, Martins RM, Kerren A. t-viSNE: interactive assessment and interpretation of t-SNE projections. IEEE Trans Vis Comput Graph. 2020;26(8):2696–714. doi: 10.1109/TVCG.2020.2986996 [DOI] [PubMed] [Google Scholar]
  • 24.Bavoil L, Callahan SP, Crossno PJ, Freire J, Scheidegger CE, Silva CT. Vistrails: enabling interactive multiple-view visualizations. In: IEEE Visualization. 2005. p. 135–42. [Google Scholar]
  • 25.Yu B, Silva CT. VisFlow - web-based visualization framework for tabular data with a subset flow model. IEEE Trans Vis Comput Graph. 2017;23(1):251–60. doi: 10.1109/TVCG.2016.2598497 [DOI] [PubMed] [Google Scholar]
  • 26.Lex A, Streit M, Schulz H-J, Partl C, Schmalstieg D, Park PJ, et al. StratomeX: visual analysis of large-scale heterogeneous genomics data for cancer subtype characterization. Comput Graph Forum. 2012;31(33):1175–84. doi: 10.1111/j.1467-8659.2012.03110.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Corvò A, Caballero HG, Westenberg MA. SurviVIS: visual analytics for interactive survival analysis. In: 10th International EuroVis Workshop on Visual Analytics. 2019. 73–7.
  • 28.Marai GE, Ma C, Burks AT, Pellolio F, Canahuate G, Vock DM, et al. Precision risk analysis of cancer therapy with interactive nomograms and survival plots. IEEE Trans Vis Comput Graph. 2019;25(4):1732–45. doi: 10.1109/TVCG.2018.2817557 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Chen X, Sun X, Hoshida Y. Survival analysis tools in genomics research. Hum Genomics. 2014;8(1):21. doi: 10.1186/s40246-014-0021-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Zheng H, Zhang G, Zhang L, Wang Q, Li H, Han Y, et al. Comprehensive review of web servers and bioinformatics tools for cancer prognosis analysis. Front Oncol. 2020;10:68. doi: 10.3389/fonc.2020.00068 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Maller O, Drain AP, Barrett AS, Borgquist S, Ruffell B, Zakharevich I, et al. Tumour-associated macrophages drive stromal cell-dependent collagen crosslinking and stiffening to promote breast cancer aggression. Nat Mater. 2021;20(4):548–59. doi: 10.1038/s41563-020-00849-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Ingebriktsen LM, Finne K, Akslen LA, Wik E. A novel age-related gene expression signature associates with proliferation and disease progression in breast cancer. Br J Cancer. 2022;127(10):1865–75. doi: 10.1038/s41416-022-01953-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Idogawa M, Koizumi M, Hirano T, Tange S, Nakase H, Tokino T. Dead or alive? Pitfall of survival analysis with TCGA datasets. Cancer Biol Ther. 2021;22(10–12):527–8. doi: 10.1080/15384047.2021.1979845 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Godec P, Pančur M, Ilenič N, Čopar A, Stražar M, Erjavec A, et al. Democratized image analytics by visual programming through integration of deep models and small-scale machine learning. Nat Commun. 2019;10(1):4551. doi: 10.1038/s41467-019-12397-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Van Noorden R, Maher B, Nuzzo R. The top 100 papers. Nature. 2014;514(7524):550–3. doi: 10.1038/514550a [DOI] [PubMed] [Google Scholar]
  • 36.Mallett S, Royston P, Waters R, Dutton S, Altman DG. Reporting performance of prognostic models in cancer: a review. BMC Med. 2010;8:21. doi: 10.1186/1741-7015-8-21 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Collins GS, de Groot JA, Dutton S, Omar O, Shanyinde M, Tajar A, et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol. 2014;14:40. doi: 10.1186/1471-2288-14-40 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Phung MT, Tin Tin S, Elwood JM. Prognostic models for breast cancer: a systematic review. BMC Cancer. 2019;19(1):230. doi: 10.1186/s12885-019-5442-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Altman DG, McShane LM, Sauerbrei W, Taube SE. Reporting recommendations for tumor marker prognostic studies (REMARK): explanation and elaboration. BMC Med. 2012;10:51. doi: 10.1186/1741-7015-10-51 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Moons KGM, Altman DG, Reitsma JB, Ioannidis JPA, Macaskill P, Steyerberg EW, et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015;162(1):W1-73. doi: 10.7326/M14-0698 [DOI] [PubMed] [Google Scholar]
  • 41.Kaplan EL, Meier P. Nonparametric estimation from incomplete observations. Journal of the American Statistical Association. 1958;53(282):457–81. doi: 10.1080/01621459.1958.10501452 [DOI] [Google Scholar]
  • 42.Cupples LA, Gagnon DR, Ramaswamy R, D’Agostino RB. Age-adjusted survival curves with application in the Framingham Study. Stat Med. 1995;14(16):1731–44. doi: 10.1002/sim.4780141603 [DOI] [PubMed] [Google Scholar]
  • 43.Harrington DP, Fleming TR. A class of rank test procedures for censored survival data. Biometrika. 1982;69(3):553–66. doi: 10.1093/biomet/69.3.553 [DOI] [Google Scholar]
  • 44.Cox DR. Regression models and life-tables. Journal of the Royal Statistical Society Series B: Statistical Methodology. 1972;34(2):187–202. doi: 10.1111/j.2517-6161.1972.tb00899.x [DOI] [Google Scholar]
  • 45.Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. 2015;16(4):e173-80. doi: 10.1016/S1470-2045(14)71116-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Mehta HB, Mehta V, Girman CJ, Adhikari D, Johnson ML. Regression coefficient-based scoring system should be used to assign weights to the risk index. J Clin Epidemiol. 2016;79:22–8. doi: 10.1016/j.jclinepi.2016.03.031 [DOI] [PubMed] [Google Scholar]
  • 47.Harrell Jr FE, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87. doi: 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4 [DOI] [PubMed] [Google Scholar]
  • 48.Uno H, Cai T, Pencina MJ, D’Agostino RB, Wei LJ. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med. 2011;30(10):1105–17. doi: 10.1002/sim.4154 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Lawrence YR, Moughan J, Magliocco AM, Klimowicz AC, Regine WF, Mowat RB, et al. Expression of the DNA repair gene MLH1 correlates with survival in patients who have resected pancreatic cancer and have received adjuvant chemoradiation: NRG Oncology RTOG Study 9704. Cancer. 2018;124(3):491–8. doi: 10.1002/cncr.31058 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Nodin B, Fridberg M, Jonsson L, Bergman J, Uhlén M, Jirström K. High MCM3 expression is an independent biomarker of poor prognosis and correlates with reduced RBM3 expression in a prospective cohort of malignant melanoma. Diagn Pathol. 2012;7:82. doi: 10.1186/1746-1596-7-82 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Hwang K-T, Kim BH, Oh S, Park SY, Jung J, Kim J, et al. Prognostic role of KRAS mRNA expression in breast cancer. J Breast Cancer. 2019;22(4):548–61. doi: 10.4048/jbc.2019.22.e55 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Chen L, Shi Y, Yuan J, Han Y, Qin R, Wu Q, et al. HIF-1 alpha overexpression correlates with poor overall survival and disease-free survival in gastric cancer patients post-gastrectomy. PLoS One. 2014;9(3):e90678. doi: 10.1371/journal.pone.0090678 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Goncalves A, Finetti P, Birnbaum D, Bertucci F. The CINSARC signature predicts the clinical outcome in patients with Luminal B breast cancer. NPJ Breast Cancer. 2021;7(1):48. doi: 10.1038/s41523-021-00256-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Long J, Zhang L, Wan X, Lin J, Bai Y, Xu W, et al. A four-gene-based prognostic model predicts overall survival in patients with hepatocellular carcinoma. J Cell Mol Med. 2018;22(12):5928–38. doi: 10.1111/jcmm.13863 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Lee H, Kwon MJ, Koo B-M, Park HG, Han J, Shin YK. A novel immune prognostic index for stratification of high-risk patients with early breast cancer. Sci Rep. 2021;11(1):128. doi: 10.1038/s41598-020-80274-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Yuan J, Duan F, Zhai W, Song C, Wang L, Xia W, et al. An aging-related gene signature-based model for risk stratification and prognosis prediction in breast cancer. Int J Womens Health. 2021;13:1053–64. doi: 10.2147/IJWH.S334756 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Zhang M, Wang X, Chen X, Zhang Q, Hong J. Novel immune-related gene signature for risk stratification and prognosis of survival in lower-grade glioma. Front Genet. 2020;11:363. doi: 10.3389/fgene.2020.00363 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Curtis C, Shah SP, Chin S-F, Turashvili G, Rueda OM, Dunning MJ, et al. The genomic and transcriptomic architecture of 2,000 breast tumours reveals novel subgroups. Nature. 2012;486(7403):346–52. doi: 10.1038/nature10983 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Cancer Genome Atlas Research Network, Weinstein JN, Collisson EA, Mills GB, Shaw KRM, Ozenberger BA, et al. The Cancer Genome Atlas Pan-Cancer analysis project. Nat Genet. 2013;45(10):1113–20. doi: 10.1038/ng.2764 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Downward J. Targeting RAS signalling pathways in cancer therapy. Nat Rev Cancer. 2003;3(1):11–22. doi: 10.1038/nrc969 [DOI] [PubMed] [Google Scholar]
  • 61.Quentmeier H, Reinhardt J, Zaborski M, Drexler HG. FLT3 mutations in acute myeloid leukemia cell lines. Leukemia. 2003;17(1):120–4. doi: 10.1038/sj.leu.2402740 [DOI] [PubMed] [Google Scholar]
  • 62.Chen R, Wang X, Fu J, Liang M, Xia T. High FLT3 expression indicates favorable prognosis and correlates with clinicopathological parameters and immune infiltration in breast cancer. Front Genet. 2022;13:956869. doi: 10.3389/fgene.2022.956869 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Gao S, Ge A, Xu S, You Z, Ning S, Zhao Y. PSAT1 is regulated by ATF4 and enhances cell proliferation via the GSK3/-catenin/cyclin D1 signaling pathway in ER-negative breast cancer. Journal of Experimental & Clinical Cancer Research. 2017;36. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Feng M, Cui H, Tu W, Li L, Gao Y, Chen L. An integrated pan-cancer analysis of PSAT1: A potential biomarker for survival and immunotherapy. Frontiers in Genetics. 2022;13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Brueffer C, Vallon-Christersson J, Grabau D, Ehinger A, Häkkinen J, Hegardt C, et al. Clinical value of RNA sequencing-based classifiers for prediction of the five conventional breast cancer biomarkers: a report from the population-based multicenter Sweden cancerome analysis network-breast initiative. JCO Precis Oncol. 2018;2:PO.17.00135. doi: 10.1200/PO.17.00135 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Loibl S, André F, Bachelot T, Barrios CH, Bergh J, Burstein HJ, et al. Early breast cancer: ESMO Clinical Practice Guideline for diagnosis, treatment and follow-up. Ann Oncol. 2024;35(2):159–82. doi: 10.1016/j.annonc.2023.11.016 [DOI] [PubMed] [Google Scholar]
  • 67.Špendl M, Kokošar J, Praznik E, Ausec L, Štajdohar M, Zupan B. Large scale gene set ranking for survival-related gene sets. Artif Intell Med. 2025;167:103149. doi: 10.1016/j.artmed.2025.103149 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Diego Forero

17 Sep 2025

Dear Dr. Zupan,

Please submit your revised manuscript by Nov 01 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols .

We look forward to receiving your revised manuscript.

Kind regards,

Diego A. Forero, MD; PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating in your Funding Statement:

“This work was supported in part by grants from Slovenian Research Agency (P2-0209, L2-3170, V2-2272).”

Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now. Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement.

Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf.

3. Thank you for stating the following financial disclosure:

“This work was supported in part by grants from Slovenian Research Agency (P2-0209, L2-3170, V2-2272).”

Please state what role the funders took in the study. If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

If this statement is not correct you must amend it as needed.

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

4. Thank you for stating the following in the Acknowledgments Section of your manuscript:

“This work was supported in part by grants from Slovenian Research Agency (P2-0209, L2-3170, V2-2272).”

We note that you have provided funding information that is currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

“This work was supported in part by grants from Slovenian Research Agency (P2-0209, L2-3170, V2-2272).”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

5. Thank you for uploading your study's underlying data set. Unfortunately, the repository you have noted in your Data Availability statement does not qualify as an acceptable data repository according to PLOS's standards.

At this time, please upload the minimal data set necessary to replicate your study's findings to a stable, public repository (such as figshare or Dryad) and provide us with the relevant URLs, DOIs, or accession numbers that may be used to access these data. For a list of recommended repositories and additional information on PLOS standards for data deposition, please see https://journals.plos.org/plosone/s/recommended-repositories .

6. We note that Figures 2, 6, 7 and 8 in your submission contain copyrighted images. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

a. You may seek permission from the original copyright holder of Figures 2, 6, 7 and 8 to publish the content specifically under the CC BY 4.0 license.

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

b. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

7. If the reviewer comments include a recommendation to cite specific previously published works, please review and evaluate these publications to determine whether they are relevant and should be cited. There is no requirement to cite these works unless the editor has indicated otherwise.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously? -->?>

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available??>

The PLOS Data policy

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English??>

Reviewer #1: Yes

Reviewer #2: Yes

**********

Reviewer #1: This article presents a visual analysis methodology designed to simplify survival analysis in biomedicine. It proposes a framework of reusable visualization and modeling components, akin to "LEGO bricks," to aid in biomarker discovery. This approach addresses the limitations of existing methods that often require programming skills or are inflexible, thus hindering accessibility for biomedical researchers. Its goal is to provide a user-friendly, open-source tool (implemented as an Orange Data Mining add-on) that facilitates interactive data exploration and hypothesis-driven research. It is relevant for the journal. However, I have some suggestion for improvement shown below.

1. The article provides a valuable tool for survival data analysis, but could be enhanced by explicitly addressing scalability for large and complex datasets.

2. Future improvements could focus on advanced interactive visualization techniques to uncover intricate relationships within high-dimensional data, potentially incorporating machine learning-driven insights for predictive modeling and automated pattern detection.

3. Expanding the tool's interoperability with other popular biomedical data platforms would broaden its adoption.

4. A detailed discussion of how the tool supports causal inference in survival analysis, beyond mere correlation, would significantly enhance its analytical capabilities.

5. Please improve the quality of the figures.

Reviewer #2: The paper describes a visual analytics tool for survival analysis. It presents substantial work and is potentially interesting for a broad readership. The paper is well-written and easy to follow. My major concern is the novelty of the work. As contribution, the authors mention support for cohort definition and cohort discovery. Highly relevant papers in this area (also with medical applications), however, are not even cited:

Supporting iterative cohort construction with visual temporal queries

J Krause, A Perer, H Stavropoulos

IEEE transactions on visualization and computer graphics 22 (1), 91-100

Interactive visual patient cohort analysis

Z Zhang, D Gotz, A Perer

Proc. of IEEE VisWeek Workshop on Visual Analytics in Health Care

Somarakis, A., Ijsselsteijn, M. E., Luk, S. J., Kenkhuis, B., de Miranda, N. F., Lelieveldt, B. P., & Höllt, T. (2020). Visual cohort comparison for spatial single-cell omics-data. IEEE Transactions on Visualization and Computer Graphics, 27(2), 733-743.

Preim, B., Klemm, P., Hauser, H., Hegenscheid, K., Oeltze, S., Toennies, K., & Völzke, H. (2016). Visual analytics of image-centric cohort studies in epidemiology. In Visualization in Medicine and Life Sciences III: Towards Making an Impact (pp. 221-248). Cham: Springer International Publishing.

Thus, the contributions should be either better justified or revised.

Author summary:

"many clinicians and life science researchers" - I would remove "clinicians". Without very few exceptions,

clinicians, i.e., the persons treating patients under severe time pressure, is not the target group for this research.

I also wonder whether the title of the paper is ideal. Of course, the method is not restricted to cancer, not even to medicine, but cancer patients is by far the most important application, also discussed in the paper. Reading the abstract, I thought, what this might be good for and clearly for cancer patients. But cancer is neither part of the abstract, nor the title. The authors should at least consider to change this.

I would be more convinced of the paper if the tool indeed helped to gain new insights. I like the idea of insight-based evaluations (Chris North) for visual analytics applications. I would not say that such an evaluation is mandatory for publishing this work, but to better understand examples of true insights would be helpful. I understand that the author did a lot to apply their tool to real world data, also to confirm existing hypotheses - that is also useful, but I miss the aha-moment: Here is something that is very hardly possible with any other tool; the uniqueness. Applying visual analytics to e.g., gene-related data - that is really not new.

The terms "clinical event of interest" and "clinical outcomes" have strongly overlapping, if not identical meanings. I recommend to either clarify what discriminates both terms or use just one of them.

The term "interpreted workflow" is interesting. I suggest to emphasize it and elaborate it.

Figure 3: I would use the term brush-and-link at least in "()" in the caption.

References: A couple of conference references may be shortened, e.g., 18, 21, 23. They contain the year twice and IEEE twice.

**********

what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy

Reviewer #1: Yes: Sudhir K. Routray

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step.

PLoS One. 2026 Mar 20;21(3):e0325399. doi: 10.1371/journal.pone.0325399.r002

Author response to Decision Letter 1


25 Nov 2025

We would like to thank the editor and the reviewers for the feedback on our previous submission, which helped us to improve the manuscript. We provide point-by-point responses to the reviewers' suggestions for changes in an accompanying document.

Attachment

Submitted filename: response-to-reviews.pdf

pone.0325399.s001.pdf (73.5KB, pdf)

Decision Letter 1

Diego Forero

6 Jan 2026

Visual analytics framework for survival analysis and biomarker discovery from gene expression data

PONE-D-25-25571R1

Dear Dr. Zupan,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager®  and clicking the ‘Update My Information' link at the top of the page. For questions related to billing, please contact billing support .

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Diego A. Forero, MD; PhD

Academic Editor

PLOS One

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions??>

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously? -->?>

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available??>

The PLOS Data policy

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English??>

Reviewer #2: Yes

Reviewer #3: Yes

**********

Reviewer #2: The paper is now in a very good shape. I only found a few minor spelling issues:

Line 354: a interactive -> an

Line 441: user selected -> user-selected

Line 486: Is the term "breast cancer programme" appropriate here? I know this term in a different meaning.

Line 499: an table defing -> a table

Reviewer #3: This is a strong and timely contribution that introduces a flexible, interactive, and accessible visual analytics framework for survival analysis and biomarker discovery. The manuscript is clearly written, methodologically rigorous, and supported by well-chosen case studies.

Major strengths

Methodological innovation:

The task-oriented abstraction of survival analysis goals and their implementation as reusable visual components is elegant and convincing.

Usability and accessibility:

The visual programming paradigm lowers the barrier for clinical and biomedical researchers, addressing a genuine gap in current survival analysis practice.

Reproducibility and transparency:

Open-source availability of the tool and workflows aligns well with open science principles and enhances the impact of the work.

Well-chosen case studies:

Use of METABRIC and SCAN-B datasets effectively demonstrates both replication of published analyses and exploratory discovery.

Suggestions for improvement (minor revisions)

Exploratory vs confirmatory analysis

Given the interactive and exploratory nature of the framework, it would be helpful to more explicitly discuss:

risks of multiple testing,

data-driven cut-off selection,

and potential inflation of false-positive findings in biomarker discovery.

A short clarification in the Discussion would be sufficient.

Generalizability beyond genomics

While the cancer gene-expression examples are compelling, the authors may briefly comment on applicability to: non-omics clinical covariates, treatment groups, or composite clinical risk scores.

Scalability considerations

The manuscript mentions in-memory processing constraints; adding approximate practical limits (e.g., number of features or samples) would help readers assess feasibility for large-scale datasets.

Comparative summary

A concise table comparing the proposed framework with existing web-based survival tools (e.g., in terms of interactivity, transparency, workflow flexibility) could further clarify the unique contribution.

Overall, this is a high-quality manuscript, and the suggested points are intended to strengthen clarity rather than address fundamental weaknesses. I commend the authors for a thoughtful and well-executed study.

**********

what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy

Reviewer #2: No

Reviewer #3: No

**********

Acceptance letter

Diego Forero

PONE-D-25-25571R1

PLOS One

Dear Dr. Zupan,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS One. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

You will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Diego A. Forero

Academic Editor

PLOS One

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: response-to-reviews.pdf

    pone.0325399.s001.pdf (73.5KB, pdf)

    Data Availability Statement

    The toolbox we developed is available as an open-source add-on “Survival” to Orange (http://orangedatamining.com). The code is available at https://github.com/biolab/orange3-survival-analysis. The workflows from the case studies, together with the data, are available at https://orangedatamining.com/examples under the section “Survival Analysis”.


    Articles from PLOS One are provided here courtesy of PLOS

    RESOURCES