Skip to main content
Briefings in Bioinformatics logoLink to Briefings in Bioinformatics
. 2026 May 25;27(3):bbag244. doi: 10.1093/bib/bbag244

GOLDEN fusion: a graph-oriented learning with domain-embedding network fusion for generating super gene sets in functional genomics

Qi Li 1, Cody Nichols 2, Robert S Welner 3, Jake Y Chen 4,✉, Wei-Shinn Ku 5,✉, Zongliang Yue 6,✉
PMCID: PMC13200546  PMID: 42184114

Abstract

The integrative analysis of gene sets, networks, and pathways is pivotal for deciphering omics data in translational biomedical research. To significantly increase gene coverage and enhance the utility of gene sets from diverse sources, we introduced pathways, annotated gene lists, and gene signatures (PAGs) enriched with metadata to represent biological functions. Furthermore, we established PAG–PAG networks by leveraging gene member similarity and gene regulations. However, in practice, high similarity in descriptions and gene membership often produces redundant, lengthy PAG lists, leading to gene set enrichment results that are difficult to interpret. We present Graph-Oriented Learning with Domain-Embedding Network (GOLDEN) fusion, an integrative framework that jointly leverages (i) connection-based embeddings derived from PAG–PAG relationships and (ii) semantic-based embeddings learned from PAG descriptions with a large language model (LLM). The two representations are combined via early fusion with a tunable weighting to produce a unified embedding on which clustering identifies concise, higher-level super-PAG. To assess when clustering is appropriate, we introduce a Connection Disparity Index, trained on synthetic stochastic block models, as a proxy for network “clusterability.” We further optimize the number of clusters with consensus clustering. On Gene Ontology Annotation biological process benchmarks, GOLDEN fusion recovers is-a structure more accurately than either connection-only or semantic-only baselines, demonstrating consistent gains in Adjusted Rand Index and Normalized Mutual Information. Finally, we generate summaries for each super-PAG by synthesizing its member PAG descriptions using a comparative analysis of LLMs. GOLDEN fusion provides an integrated framework for interpreting omics results.

Keywords: PAGER, connection-based embedding, semantic-based embedding, functional genomics, integrative biology, LLM

Introduction

Systems biology, when coupled with high-throughput omics technologies like proteomics, allows for the discovery of novel pathway biomarkers, which are essential for understanding complex diseases [1]. Functional genomics analysis and systems biology are critical and fundamental for understanding the genetic basis of human health [2, 3]. Previous work has demonstrated how coupled systems biology and proteomics methods can reveal pathway-level biomarkers crucial for exploring complex disease mechanisms [1]. It enhances our knowledge of pathogenic pathways by examining the interactions between different types of molecules, ultimately creating a comprehensive genotype–phenotype map [4]. Early work in signaling network systems biology established the groundwork for these integrative approaches [5]. With a deeper understanding of the molecular processes driven by complex molecular interactions and chemical reactions, biomedical discovery is expedited, leading to numerous applications in the study of complex diseases. These include molecular risk stratification [6–8], preclinical drug screening [9–11], prognosis prediction [12–14], new biomarker discovery [15–17], and precision medicine [18–20]. With the advent of new and advanced techniques for multi-omics high-throughput sequencing, a vast amount of genomics data has been generated, presenting both challenges and opportunities. This data illuminates the complex interactions among genes, gene products, and the environment, ushering in a new era of molecular understanding and leading to novel hypotheses regarding the prevention and treatment of complex diseases. Integrative systems biology approaches, combined with data mining techniques, have been crucial for uncovering the role of genetic variations in diseases and mining disease-specific molecular association profiles across complex datasets [21–25]. Complementary datasets like HIP2 provide foundational plasma proteomics data for benchmarking and network integration [26]. Network-based systems biology approaches have been instrumental in constructing pathway-connected networks, analyzing dose–response relationships, and prioritizing drug targets for repositioning in various diseases, from infectious diseases to cancer [27–29].

Computational functional genomics leverages computational approaches to address challenges in functional genomics, enhancing data interpretability and facilitating novel knowledge discovery. For a deeper understanding of molecular pathways and genetic control mechanisms [30], various tools and databases have been developed to perform gene set enrichment analysis by processing a gene list to extract a statistical measure of shared biological features. These include Gorilla [31], DAVID [32], WebGestalt [33], EnrichR [34], PANTHER Gene List Analysis [35], TermMapper [36], and g:profiler [37], which are frequently used to provide valuable interpretations into high-throughput omics. With increasing demands from multi-omics studies, several challenges arise. These include adequately covering the extensive content of multi-omics data, rendering complex network-based models, and providing advanced features for in-depth insights in integrative analysis [38]. These network-based approaches have been successfully applied to biomarker discovery and subtyping in cancer, such as breast cancer plasma protein studies [39]. Therefore, the integrative gene sets, networks, and pathways analysis (GNPA) has been introduced and leads the new height of information integration in the recently developed GNPA application [40], such as PyGNA [41], NDEx IQuery [42], PAGER web APP [38], and PANGEA [43]. Meanwhile, the incline of heterogeneous resources has significantly enhanced the analytical power, enabling comprehensive analysis from various sources, including pathways (Reactome [44], KEGG [45], BioCarta, WikiPathways [46], DMaps [47], SPIKE, NCI Nature Curated pathway [48], and GeoMx Cancer Transcriptome Atlas [49]), ontology annotations (Gene Ontology Annotation [50] also known as GOA and Human Phenotype Ontology), tissue-specific expressions (GTEx [51], NGS Catalog [52], and TCGA [53], PathologyAtlas [54], and FANTOM5 [55]), cell-specific expressions (CellAtlas [56]), disease phenotypes (GAD, GWAS Catalog [57], Phewas [58], and Online Mendelian Inheritance in Man), drug–targets (PharmGKB [59] and DSigDB [60]), and miRNA–gene interactions (Microcosm Targets, TargetScan [61], and mirTARbase [62]). Pathways, annotated gene lists, and gene signatures (PAGs) have been introduced to standardize gene sets from heterogeneous data sources. However, the integration of multiple heterogeneous terms remains incomplete, leading to high content-similarity [63] or even redundancy [64] in the gene set enrichment analysis and network analysis in practice [65–67].

To address the heterogeneities and inconsistencies of PAGs, we introduce super-PAG to represent clusters of PAGs and develop a new algorithm called Graph-Oriented Learning with Domain-Embedding Network (GOLDEN) fusion to generate super-PAG from regular PAGs. GOLDEN uniquely integrates graph embeddings and large language model (LLM)-based semantic embeddings, addressing redundancy and interpretability challenges, and features three advanced capabilities to mitigate biases inherent to individual embeddings. First, GOLDEN fusion introduces a new metric, the Connection Disparity Index (CDI), as a model-informed proxy for “clusterability.” Currently, the CDI is built on synthetic data from stochastic block models (SBMs) and degree-corrected stochastic block models (DC-SBMs) [68] to infer whether the network can be clustered into super-PAG based on the distribution of the clustering coefficient [69]. Second, GOLDEN fusion achieves optimal performance in super-PAG mining by integrating connection-based features from PAG–PAG networks and semantic-based features from PAG descriptions using a fusion model. Third, GOLDEN fusion provides summaries of the super-PAG by synthesizing descriptions from super-PAG members using LLMs. We tested GOLDEN fusion on the Gene Ontology (GO) network and demonstrated that GOLDEN fusion outperforms baseline models that utilize any individual information in generating super-PAG. We anticipate that super-PAG will play a pivotal role in biology and biomedicine by collecting, standardizing, and organizing gene set knowledge to facilitate multiscale biomedical data integration and analysis.

Methods

Overview design of GOLDEN fusion workflow

GOLDEN fusion is developed to enhance functional genomics analysis by creating abstract biological concepts that integrate both bio-semantic and network information. It employs a complex workflow that leverages graph transformations and machine learning models (Fig. 1).

Figure 1.

ALT Text: Schematic diagram of the GOLDEN fusion framework showing input gene or PAG lists, graph- and text-based embedding pipelines, clustering into super-PAGs, and outputs including CDI scores and summary descriptions.

The framework of GOLDEN fusion. Input: The input can be either a PAG list identified by PAG IDs or a gene list identified by gene Entrez IDs. The system queries the PAGER database for m-type PAG–PAG relationship info and PAG description info. Graph-based embeddings: Converts a graph (m-type PAG–PAG relationship) into PAG embeddings, applies clustering methods to generate super-PAG, and uses a clusterability prediction model to evaluate whether the graph should be subdivided into meaningful subgraphs. Density-based embeddings: Encodes descriptions with an LLM encoder to create embeddings, which are then clustered. Output: Produces a CDI score, super-PAG, and summary descriptions for each super-PAG.

The input for GOLDEN fusion can be either PAGs or a list of genes. PAGER 3.0 will retrieve co-membership-based (m-type) PAG–PAG relationships [70] as connection information and PAG descriptions as domain knowledge. The PAGER database has been instrumental in constructing PAG–PAG relationships and standardizing pathway gene sets for network biology [70]. If a PAG list identified by PAG IDs is provided, PAGER 3.0 will directly retrieve the m-type PAG–PAG relationships and PAG descriptions. If genes are provided as input, PAGER 3.0 will perform gene set enrichment analysis to generate significantly enriched PAGs, along with their m-type PAG–PAG relationships and PAG descriptions.

Subsequently, GOLDEN fusion performs a fusion procedure along two parallel paths: network-based information processing and domain knowledge-based information processing. The details of these processes are described in the following sections. The outputs of these two processes are two embedding matrices, Dg and Ds, representing the connection information and bio-semantic information, respectively. We performed early fusion of this information by concatenating their embeddings and applying a hyperparameter α to adjust the weight of each data source, resulting in a new embedding matrix Df. Clustering methods are then applied to Df to obtain the final clustering results, which form the putative super-PAG. These clustering results are also used as input for summarization models to generate descriptions for each cluster as an additional output.

To improve the robustness and accuracy of GOLDEN fusion’s clustering, we integrated a consensus clustering algorithm into its workflow. Consensus clustering is well-suited for aggregating the results of multiple clustering runs to provide a stable assessment of the clustering solution, mitigating sensitivity to initial conditions. Applied to the embedding fusion matrix Df, which combines connection-based and semantic-based features, consensus clustering helps determine the optimal number of clusters.

GOLDEN fusion generates three types of outputs: the CDI, serving as a proxy for clusterability; the putative super-PAG; and a summary description for each super-PAG.

Generate synthetic networks for evaluating graph-based clusterability modeling

We generate synthetic networks using SBMs with various settings for the probabilities of inter-cluster and intra-cluster connections to evaluate the effectiveness of network-based clustering methods. Initially, we set the probability of inter-cluster connections at 0.5 and intra-cluster connections at 0.1 to test the performance of three main clustering algorithms: the Girvan–Newman Algorithm, the Louvain Algorithm, and Spectral Clustering.

Furthermore, to determine whether a PAG–PAG network is inherently amenable to clustering, we trained a predictive model on synthetic graphs and utilized its calibrated score as a CDI. Specifically, we generated two-block SBMs by exhaustively sweeping the intra- and inter-cluster connection probabilities from 0.1 to 1.0 in increments of 0.1. For each synthetic graph, we computed the clustering coefficient distribution (e.g. mean and variance) and obtained a supervision signal by clustering the graph and scoring the recovery of the planted partition using the Adjusted Rand Index (ARI). The resulting dataset (graph features with ARI-derived labels) was used to fit and compare four classifiers—logistic regression, support vector machine, k-nearest neighbors, and random forest—selecting the best model by cross-validated accuracy, precision, recall, and F1. The selected model’s calibrated output is reported as the CDI and is used to screen graphs and guide preprocessing (e.g. edge-weight thresholding) before applying GOLDEN fusion to real data. Additionally, to enhance the adaptability of the clusterability measurement, we generated synthetic networks using DC-SBMs [68] and trained with extended feature sets (described in the Supplementary Materials) using machine learning algorithms, including logistic regression, random forest, XGBoost, and multilayer perceptron (MLP), to derive CDI-β. The best-performing model was selected to estimate the probability of clusterability, reported as CDI-β.

Generate benchmarking dataset using Gene Ontology Annotation network in PAGER 3.0

We evaluate GOLDEN fusion on the GOA m-type PAG–PAG network (biological process branch), using GOA is-a relations as ground truth. Inputs to GOLDEN fusion are either a list of PAG IDs or a gene list. For PAG inputs, PAGER 3.0 returns co-membership (m-type) PAG–PAG relationships and curated PAG descriptions. For gene inputs, PAGER 3.0 first performs gene set enrichment to obtain significantly associated PAGs, then returns their m-type links and descriptions. To construct fair, nontrivial test cases from the GOA hierarchy, we enumerate candidate groups subject to two constraints: (i) level-matched (nodes lie at the same shortest-path distance from a specified root), and (ii) parent-unique (no two nodes share the same immediate parent). We retain all groups meeting these criteria to form the benchmarks. Two size regimes were evaluated. (i) SPAGs 10–100, defined as GOA terms with larger than or equal to 10 but less than 100 child terms connected through hierarchical is-a relationships, representing candidate super-PAGs. This category included 127 two-member groups (pairs). (ii) SPAGs 5–10, defined as GOA terms with larger than or equal to 5 but less than 10 child terms, serving as auxiliary super-PAGs, with 300 two-member groups identified. For each group, GOLDEN fusion integrates the m-type edges and term descriptions of the child GOA terms within the two-member pair to explore GOA clusters. Model performance is evaluated by its ability to reconstruct putative super-PAGs that approximate the original parent GOA term (SPAG).

To benchmark GOLDEN fusion against the established similarity-based redundancy reduction and clustering methods, including semantic similarity, e.g. REVIGO [71] (default similarity cutoff is 0.7) and the Lin measure via GOSemSim [72, 73] (default similarity cutoff is 0.7), Jaccard-based redundancy control, e.g. ReCiPa [63] (max overlapping is 0.7, and low overlapping is 0.5), and overlap-based clustering, e.g. clusterProfiler [74] (default cutoff is 0.7), we applied all methods to the same GOA-derived benchmark datasets (SPAGs 5–10 and SPAGs 10–100) and evaluated using ARI and Normalized Mutual Information (NMI) against ground-truth labels, following the same repeated random-sampling protocol.

Additionally, to evaluate GOLDEN Fusion performance in pathway datasets, we construct the pathway groups based on the hierarchy of KEGG (Homo sapiens) and Reactome (H. sapiens). For KEGG, pathway descriptions and gene memberships were fetched via the KEGG REST API, and ground-truth labels were derived from the BRITE hierarchy at the B-level (subcategories such as “Carbohydrate metabolism” or “Nervous system”), yielding fine-grained but tractable categories. For Reactome, gene–pathway mappings were downloaded from Ensembl2Reactome_All_Levels.txt and hierarchy structure from ReactomePathwaysRelation.txt; ground-truth labels were obtained by walking each pathway up the parent–child hierarchy to its level-1 ancestor (direct child of a root), producing approximately 26 broad human categories (e.g. signal transduction, metabolism).

For each database, we constructed a pathway–pathway graph using the m-type relationship, computed Node2Vec graph embeddings (384-dimensional) and SentenceTransformer semantic embeddings (all-MiniLM-L6-v2, 384-dimensional), and combined them via the GOLDEN Fusion alpha-blend (α = 0.9 for KEGG, α = 0.9 for Reactome). Isolated nodes (zero graph degree) received zero-vector graph embeddings, ensuring full coverage without discarding any pathway. To obtain statistically robust estimates, we adopted a repeated random-sampling design: in each of 300 independent trials, 2 categories were drawn uniformly at random from all available categories, and up to 20 pathways were sampled without replacement from each selected category. Agglomerative Clustering with k = 2 set to the true number of drawn categories was then applied to the fused embeddings, and ARI and NMI were computed against the ground-truth labels. Results are reported as mean ± standard deviation over 300 trials, reducing variance from individual samples. Per-trial results are retained to ensure full reproducibility.

Graph-based embedding generation

To identify higher-order structure among PAGs, we first build a graph based on shared gene membership (the m-type network). Each node represents a PAG, and edges between PAGs are weighted by the significance of their gene overlap, computed using a hypergeometric test. We denote this network as Inline graphic where V is the set of PAG nodes and W​ij is the weight between PAG i and PAG j, reflecting the statistical strength of their shared gene membership. We then learn a low-dimensional vector representation for each PAG using Node2Vec, which performs biased second-order random walks on the graph and trains a skip-gram model with negative sampling to produce embeddings. These graph-derived embeddings capture both direct and indirect connectivity patterns among PAGs and are later used as input for clustering.

We apply three clustering algorithms to these graph embeddings: k-means, agglomerative hierarchical clustering, and hierarchical density-based spatial clustering of applications with noise (HDBSCAN). Each offers a complementary view of the underlying structure.

  • k-means assigns each PAG to one of k clusters by minimizing within-cluster variance; it is efficient and scalable.

  • Agglomerative Clustering starts with each PAG as its own cluster and iteratively merges clusters based on similarity, producing a dendrogram; it does not require fixing k in advance and can reveal hierarchical organization.

  • HDBSCAN identifies dense regions in the embedding space, can infer the number of clusters automatically, and can leave out poorly fitting PAGs as noise rather than forcing them into a cluster.

Using multiple clustering back-ends provides robustness and reduces bias toward any single geometric assumption (spherical clusters for k-means, linkage structure for agglomerative, local density structure for HDBSCAN). We assess clustering agreement with two complementary indices. The Adjusted Rand Index (ARI) measures overlap between the predicted and ground-truth partitions while correcting for chance; it ranges from −1 to 1 (random ≈ 0; perfect agreement = 1) and is sensitive to exact pairwise co-assignment. The NMI is an information-theoretic measure of shared information between partitions; it is bounded in [0,1] (no shared information = 0; identical partitions = 1) and is less affected by differences in the number or sizes of clusters. Together, ARI emphasizes pairwise label consistency, whereas NMI emphasizes global partition similarity, providing a more balanced evaluation.

Semantic embedding generation

In parallel with the graph-based view, we model functional similarity between PAGs using their textual descriptions. Each PAG’s biological description is encoded into a dense vector using OpenAI’s text-embedding-3-small model. This produces a high-dimensional semantic embedding in which PAGs with similar biological functions are located near one another in the embedding space.

Because the raw description embeddings are higher dimensional than the graph embeddings, we align them for fusion. Specifically, we apply principal component analysis (PCA) to project the description embeddings down to the same dimension used for the Node2Vec graph embeddings, while retaining ~95% of the original variance. We then L2-normalize each projected vector. The resulting matrix, which we refer to as the semantic embedding matrix Ds, reflects functional (semantic) similarity among PAGs and is directly comparable to the graph-based embedding matrix Dg​.

We again apply k-means, Agglomerative Clustering, and HDBSCAN to these semantic embeddings to identify candidate super-PAGs based on functional descriptions alone. PAGs that cluster together in this space tend to share coherent biological themes in their annotations.

Fusion and consensus clustering

Finally, we combine the graph-based and description-based embeddings into a unified representation to capture both topological and semantic relatedness. We form an embedding fusion for each PAG by taking a weighted linear blend of its Node2Vec vector and its description vector. Let Dg be the Node2Vec embedding matrix and Ds the PCA-aligned description embedding matrix. For a mixing weight α∈ [0,1], we define the embedding fusion matrix as follows:

graphic file with name DmEquation1.gif

In practice, this means each PAG’s final feature vector is Inline graphic, a convex combination of the graph-derived features and description-derived features for PAG i. We perform clustering on these vectors (by default using k-means) to produce the final super-PAG groupings. The mixing coefficient α controls the influence of semantic versus network information: α = 0 corresponds to using only the graph embeddings, α = 1 uses only description embeddings, and intermediate values blend the two. We tune α by grid search on a validation split of the data, aiming to maximize clustering performance (e.g. mean ARI and cluster stability). The optimal α, along with the search range tested, is documented in our repository.

For the embedding fusion clustering, we also determine the number of clusters k in a data-driven way. Rather than fixing k a priori, we employ consensus clustering with the cumulative distribution function (CDF)/ΔCDF method to identify a stable number of clusters. In brief, we run the chosen clustering algorithm across multiple resampled subsets and evaluate the CDF of consensus indices; the point at which an increasing k yields diminishing returns (a plateau in the CDF) is selected as the appropriate cluster count. If multiple k-values are similarly stable, we favor the smaller k that achieves high consensus. This approach provides an unbiased criterion for choosing k and ensures that the resulting super-PAG are reproducible and well-separated. While k-means on the embedding fusion is our primary method for defining super-PAG, we also explored alternative clustering techniques as comparisons (summarized in Table 1). These include Spectral Clustering, Louvain community detection (on the graph), agglomerative clustering, HDBSCAN, and the Girvan–Newman algorithm for community finding. By comparing these alternatives, we verify that our fusion is robust and that the identified super-PAG structures are not an artifact of a single clustering method. Overall, this integrative pipeline—combining graph-oriented connection features and domain knowledge semantics features, and leveraging multiple clustering algorithms—allows us to discover coherent groups of gene sets in super-PAG that are supported by both gene overlap and functional description similarity, facilitating downstream biological interpretation of the clusters.

Table 1.

Comparison of clustering methods.

Method Parameters Scalability Use case Geometry
K-Means Number of clusters Very large n, medium clusters General-purpose Euclidean distances
Spectral Clustering Number of clusters Medium n, small clusters Few clusters Graph distance
Agglomerative Clustering Clusters/threshold, linkage, distance Large n and clusters Many clusters, non-Euclidean Any pairwise distance
HDBSCAN Minimum membership, point neighbors Large n, medium clusters Uneven sizes, outlier removal Nearest points distances
Louvain Resolution parameter Very large n Community detection (CD) in large networks Graph-based modularity
Girvan–Newman None (hierarchical edge betweenness) Medium n CD in small to medium networks Graph-based modularity

Utilizing large language models for PAG summarization

In our study, we harnessed the power of LLMs to facilitate the interpretation of PAGs by summarizing their descriptions. Given the often extensive and detailed functional descriptions associated with each PAG, manually synthesizing these into concise summaries for higher-level clusters, or super-PAG, can be laborious and inefficient. To address this, we employed LLMs to automate the summarization process, ensuring that each super-PAG is represented by a clear, informative sentence. We first concatenated all functional descriptions associated with each PAG within a cluster into a single, comprehensive text block, ensuring that LLM receives full contextual information about the cluster’s biological functions. Using this concatenated text, the LLM generated a summary by processing the input and distilling it into a coherent sentence that encapsulates the essence of the cluster’s biological functions. This summary provides a high-level overview of the super-PAG, facilitating easier interpretation by researchers. Given the inherent input size limitations of LLMs, we optimized our method by monitoring the length of the concatenated descriptions. When the input approached the model’s capacity, we applied additional summarization steps to further condense the text before feeding it into the LLM. This process ensured that all relevant information was retained while staying within the model’s input limits.

CDI-based separation of SPAG-to-SPAG pairs validated by functional independence

To evaluate SPAG-to-SPAG pairs exhibiting both high CDI and ARI scores, we assessed functional relevance by examining the GOA term names and descriptions, with supporting evidence. These assessments serve to contextualize CDI-based separation results by examining whether SPAG-to-SPAG pairs correspond to biologically independent or overlapping processes. Each pair was categorized as Strong, Moderate, or Weak based on biological proximity derived from shared pathways, hierarchical relationships, and conceptual linkage within cellular or organismal processes. The assigned relevance level reflects how closely the paired GOA terms contribute to the same biological mechanism, pathway, or regulatory context. Pairs classified as Strong demonstrate clear mechanistic relationships, including (i) involvement in the same biological pathway or process, (ii) representation of sequential or hierarchical steps within the same mechanism (e.g. activation → differentiation → effector function), or (iii) evidence of direct regulatory or causal dependency. Pairs classified as Moderate exhibit related but not strictly dependent biological functions, including cases where terms (i) operate in related processes without obligate interaction; (ii) share overlapping roles, pathways, or cell types; (iii) function within the same biological system (e.g. immune, metabolic, reproductive) at different regulatory levels; or (iv) interact functionally but do not represent consecutive steps in the same pathway. Pairs classified as Weak show limited or indirect functional relationship, such as when terms (i) belong to distinct biological systems or domains; (ii) lack shared pathways, gene annotations, or biological rationale for linkage; (iii) occur in different compartments, developmental stages, or tissue contexts; or (iv) share only broad conceptual similarity (e.g. both regulatory terms) without a meaningful mechanistic connection.

Results

Clustering back-ends and experimental setup

For each representation—graph-only (Node2Vec), description-only (OpenAI text embeddings), and the fusion (concatenation)—we clustered the resulting feature matrix with three back-ends: Agglomerative Clustering, k-means, and HDBSCAN. Agglomerative Clustering (scikit-learn default settings) was run with a fixed number of clusters k, identical to the k used for k-means. k-means used k = num_clusters with a fixed initialization seed. HDBSCAN was run in a parameterization suited to discovering uneven, potentially sparse structure (min_cluster_size = 5, gen_min_span_tree = True), allowing the number of clusters to be determined automatically; points deemed insufficiently dense were labeled as noise (−1). Unless stated otherwise, the same settings were applied across benchmarks (SPAGs 5–10 and SPAGs 10–100) and information sources, and performance was evaluated with ARI and NMI.

Exploring clusterability: the performance of clusterability predictive model

In SBM networks with different probability settings: (inter-cluster versus intra-cluster) as (0.3, 0.1), (0.5, 0.01), (0.6, 0.4), and (0.8, 0.1) across varying configurations (see Fig. S1), we found that Spectral Clustering consistently outperformed the other two algorithms in accurately detecting the underlying cluster structures. We selected Spectral Clustering as the primary method for analyzing synthetic datasets in the subsequent sections of our study. The clusterability predictive model was designed to classify synthetic networks into unclusterable and clusterable categories with an accuracy of 0.88 and an F1 score of 0.9.

The ARI was utilized as the standard for gauging clusterability in the synthetic networks. We employed Spectral Clustering, the best-performing algorithm reported in the connection-based clustering, to predict clusters and evaluate their agreement with the ground truth clusters. As shown in the ARI measurement heatmap in Fig. 2, a clear boundary emerges that separates networks that can be reliably clustered from those that cannot. Based on this observation, we set an ARI threshold of 0.7 (Fig. 2a–c) as a conservative criterion for defining reliable cluster recovery. We further verified that consistent CDI–functional relevance trends were maintained across nearby thresholds (ARI ≈ 0.65–0.75), demonstrating robustness to moderate cutoff variation. This thresholding step transforms network clusterability, as assessed by Spectral Clustering, into a binary classification problem.

Figure 2.

ALT Text: The heatmap showing clustering performance (ARI) under different subgraph proportions and plots comparing clustering coefficient distributions between clusterable and unclusterable network scenarios.

Heatmap of ARI comparing clusterability across three settings. The node composition of two subgraphs is presented with proportions of (a) 0.5 and 0.5, (b) 0.7 and 0.3, and (c) 0.9 and 0.1 generated by an SBM. Higher ARI values indicate more accurate recovery of ground-truth clusters. (d) The two cases illustrate the distribution of clustering coefficients, comparing a clusterable scenario (Case 1) with an unclusterable scenario (Case 2) using Spectral Clustering. An ARI of 0.7 is used as the cutoff for determining clusterability to train the classification models.

We developed a clusterability predictive model described in Algorithm 1. The input of the model is the mean and variance of clustering coefficient distribution and the output is the CDI. In Fig. 2d, we can intuitively identify the differences in clustering coefficient distribution between unclusterable and clusterable networks. The unclusterable network displayed a normal distribution with low clustering coefficients (0.2). In contrast, the clusterable network exhibited a high clustering coefficient (0.5 to 0.6) with a bimodal distribution. Specifically, we employed logistic regression, support vector machines (SVM), random forest, and k-nearest neighbors (KNNs) models. The random forest model demonstrated superior performance with an F1-score of 0.90, signifying a high balance between precision and recall (Table 2). Logistic regression also showed commendable results, particularly in terms of recall.

Table 2.

Comparison of different methods based on performance metrics. KNN represents the k-nearest neighborhood model.

Methods Accuracy Precision Recall F1
Logistic regression 0.76 0.73 1 0.84
SVM 0.67 0.66 1 0.79
Random forest 0.88 1 0.81 0.9
KNN 0.76 1 0.63 0.77

Bold values indicate the best performance among all compared methods.

To test whether CDI is useful beyond synthetic data, we applied the trained random forest model to the same GOA-derived benchmarking datasets used to evaluate GOLDEN fusion. We observed that CDI correlated with downstream clustering performance on real biological groups. In cases where CDI was high (for example, CDI ≈ 0.93 for a PAG pair whose members map to clearly distinct biological concepts), GOLDEN fusion produced two well-separated clusters with high agreement to the GOA is-a ground truth (ARI ≈ 1.0). In contrast, when CDI was low (for example, CDI ≈ 0.40 for a PAG pair whose members share very similar biological annotations), GOLDEN fusion struggled to cleanly split the pair, and agreement with the ground truth dropped (ARI ≈ 0.44).

In the CDI-β performance test, we found that XGBoost was the best-performing model across all cluster-size settings (Table S1). Compared to logistic regression and neural network (MLP), XGBoost exhibited greater robustness to increasing cluster complexity, maintaining stable performance as cluster size increased. While random forest showed competitive performance in small clusters, its performance was less consistent across larger cluster settings. Overall, these results indicate that XGBoost provides the most reliable and scalable estimation of clusterability to derive CDI-β.

Overall, the clusterability predictive model provides a quantitative method for evaluating the validity of clustering algorithms in network clusterability problems. This approach is especially valuable for assessing complex network structures where discerning clear clusterability boundaries is critical.

Algorithm 1 An algorithm to develop a prediction model to determine the clusterability of a graph.

Given:

  • A set of feature vectors of mean and std Inline graphic, where Inline graphic.

  • A set of ARI score variables Inline graphic, where Inline graphic.

  • A threshold value Inline graphic for binarization (commonly Inline graphic).

Binarize target variables:

graphic file with name DmEquation2.gif

Partition data: Split Inline graphic and Inline graphic into training and test sets, Inline graphic and Inline graphic, using a 75% and 25% split.

Model training: Train a binary classification model Inline graphic using Inline graphic.

Prediction: Use the trained model Inline graphic to predict labels for Inline graphic, obtaining predicted labels Inline graphic.

Graph-based clustering performance

Using only the graph signal (Node2Vec embeddings of the m-type PAG–PAG network), we compared k-means, Agglomerative Clustering, and HDBSCAN on both benchmarks. Unless otherwise stated, we used typical Node2Vec hyperparameters for graph embeddings: walk length = 80, walks per node = 10, context window = 10, negative samples = 5, return parameter p = 1.0, and in–out parameter q = 0.25. We examined two embedding dimensions (d = 64 and d = 256), and the resulting node embedding matrix was L2-normalized row-wise.

  • SPAGs 5–10 (Fig. 3a). Agglomerative Clustering achieved the best recovery of the is-a structure with a mean ARI of 0.51. k-means was second (0.28), providing stable but less accurate partitions. HDBSCAN clustered a few items confidently and remained near zero (0.01), indicating density thresholds in the Node2Vec space were too strict for these small graphs.

  • SPAGs 10–100 (Fig. 3b). Absolute scores decreased on the larger, more heterogeneous graphs, but Agglomerative Clustering remained strongest (0.29). k-means again ranked second (0.16). HDBSCAN showed a long-tailed distribution with rare high scores but a low mean (0.03), reflecting unreliable behavior under uneven densities.

    Across both benchmarks, Agglomerative Clustering is the most reliable back-end for the graph-only baseline; k-means is a reasonable and stable alternative; HDBSCAN is generally unsuitable for these Node2Vec representations.

Figure 3.

Violin plots comparing clustering performance (ARI) of HDBSCAN, agglomerative, and k-means algorithms using graph-based embeddings across two SPAG size ranges.

Recovery performance of parent GOA terms measured by ARI, comparing three clustering algorithms—HDBSCAN, agglomerative, and k-means—using graph-based embeddings on (a) SPAGs 5–10 and (b) SPAGs 10–100. Numeric labels indicate mean values.

Semantic-based clustering performance

Using only description embeddings from OpenAI’s text-embedding-3-small, we evaluated k-means, Agglomerative Clustering, and HDBSCAN on the same benchmarks (Fig. 4).

Figure 4.

Violin plots comparing clustering performance (ARI) of HDBSCAN, agglomerative, and k-means algorithms using semantic-based embeddings across two SPAG size ranges.

Recovery performance of parent GOA terms measured by ARI, comparing three clustering algorithms—HDBSCAN, agglomerative, and k-means—using semantic-based embeddings on (a) SPAGs 5–10 and (b) SPAGs 10–100. Numeric labels indicate mean values.

  • SPAGs 5–10 (Fig. 4a). Agglomerative Clustering delivered the highest mean ARI (0.66), indicating strong alignment between semantic similarity and the is-a structure at small node counts. k-means also performed well (0.54), while HDBSCAN trailed with a low mean (0.12), suggesting insufficient density separation in the text-embedding space.

  • SPAGs 10–100 (Fig. 4b). The performance decreased modestly with larger clusters, yet the ordering persisted: Agglomerative Clustering remained best (0.55), followed by k-means (0.45), with HDBSCAN again lowest (0.12).

Across both datasets, Agglomerative Clustering is the most reliable description-only back-end; k-means provides a competitive and stable baseline; HDBSCAN underperforms due to weak density contrasts in the high-dimensional text-embedding space.

GOLDEN fusion outperforms single-source baseline

To contextualize the fusion model (graph + description), we compared two single-source baselines on the GOA benchmarks: a graph-only baseline that clusters PAGs using the m-type PAG–PAG network, and a semantic-only baseline that clusters PAGs using OpenAI text embeddings of PAG descriptions. Each baseline was evaluated with k-means, Agglomerative Clustering, and HDBSCAN, and scored by ARI against the GOA is-a ground truth. Across both SPAGs 5–10 and SPAGs 10–100, GOLDEN fusion (the weighted fusion) achieved higher ARIs than either baseline, indicating that combining network topology and description semantics yields more faithful recovery of the ontology structure.

To determine the fusion weight α and a cost-effective representation size, we (i) swept α ∈ [0,1] and (ii) varied dimensions by training two Node2Vec models (64-d and 256-d) and pairing each with OpenAI embeddings at 64, 256, 512, and 1024 (projected via PCA to match the graph dimension prior to fusion). The best configurations consistently favored the semantic channel (peak performance at α ≈ 0.8, i.e. ~20% graph + ~80% semantic). Across both SPAGs 5–10 and 10–100, the 256–512 pairing (256-d Node2Vec + 512-d OpenAI) delivered the highest mean ARI overall with strong stability. We observed a slight ARI gain with the 256–1024 pairing on the larger SPAGs 10–100 benchmark, but this came at a noticeably higher computational cost. Considering the accuracy–efficiency trade-off, we recommend 256–512 as the default dimensional setting, reserving 256–1024 for scenarios where marginal improvements justify additional compute (see Fig. 5 and Table 3). In comparison with established similarity-based redundancy reduction and clustering methods, GOLDEN fusion consistently and substantially outperformed REVIGO, GOSemSim, ReCiPa, and clusterProfiler across both SPAGs 5–10 and SPAGs 10–100 datasets (Table S2). Particularly, for the graph-based evaluation along, m-type network embeddings yield ARI = 0.51 (SPAGs 5–10) and ARI = 0.29 (SPAGs 10–100) (Fig. 3), outperforming ReCiPa (ARI = 0.07 and 0.01) and clusterProfiler (ARI = 0.43 and 0.24), respectively. For the KEGG and Reactome pathway datasets, GOLDEN fusion demonstrates a little higher performance on Reactome compared to KEGG (Table S3). This difference is consistent with Reactome’s finer-grained hierarchy and richer semantic annotations, which better support joint graph–semantic integration.

Figure 5.

ALT Text: Violin plots showing clustering performance (ARI) under different embedding fusion coefficients for multiple clustering algorithms across two SPAG size ranges.

Coefficient optimization of parent GOA term recovery, measured by ARI, comparing three clustering algorithms—HDBSCAN, agglomerative, and k-means—using embedding fusion on (a) SPAGs 5–10 and (b) SPAGs 10–100. Numeric labels indicate mean values.

Table 3.

Optimization of PAG recovery performance using different combinations of connection embedding and semantic embedding dimensions. Optimal performance was achieved using a 256-dimensional connection embedding and a 512-dimensional semantic embedding.

Super-PAG dataset SPAGs 5–10 SPAGs 10–100
Connection embedding 64 256 64 256
Semantic embedding 1024 512 256 64 1024 512 256 64 1024 512 256 64 1024 512 256 64
agglomerative Alpha 0.8 0.8 0.8 0.8 0.8 0.8 0.8 0.8 0.9 0.9 0.9 0.8 0.9 0.9 0.9 0.8
ARI_Mean 0.72 0.73 0.73 0.72 0.75 0.74 0.74 0.74 0.58 0.58 0.58 0.58 0.58 0.58 0.58 0.58
NMI_Mean 0.73 0.74 0.73 0.72 0.76 0.75 0.75 0.74 0.56 0.55 0.55 0.50 0.56 0.56 0.56 0.50
kmeans Alpha 0.9 0.9 1 1 0.9 0.9 0.9 0.9 1 1 1 1 1 1 1 1
ARI_Mean 0.12 0.12 0.12 0.11 0.13 0.13 0.13 0.12 0.11 0.12 0.12 0.11 0.11 0.12 0.12 0.11
NMI_Mean 0.13 0.13 0.12 0.07 0.14 0.14 0.13 0.07 0.14 0.15 0.14 0.11 0.14 0.15 0.14 0.11
hdbscan Alpha 0.9 0.9 0.9 0.9 0.9 0.9 0.9 0.9 1 1 0.9 0.9 1 1 1 0.9
ARI_Mean 0.54 0.55 0.53 0.49 0.55 0.55 0.53 0.48 0.45 0.45 0.44 0.41 0.45 0.45 0.44 0.41
NMI_Mean 0.58 0.59 0.57 0.53 0.58 0.59 0.56 0.51 0.46 0.46 0.45 0.42 0.46 0.46 0.44 0.42

Bold values represent the best performance under specific parameter settings across the compared methods.

The PAG summarization captures important information in the benchmarking dataset

In this study, we evaluated 10 models for summarizing PAG descriptions, including GPT-4.1, GPT-3.5, BART-based variants, SciFive [75], Pegasus [76], BioGPT [77], BioBART [78], BioRAgent [79], and Flan-T5 [80]. GPT-4.1 and GPT-3.5 are instruction-tuned, decoder-only LLMs that perform well in zero-shot abstractive summarization; both were applied in a zero-shot, single-sentence summarization setting. Encoder–decoder transformer models, including BART variants, SciFive, and Pegasus, served as strong supervised baselines. Across both benchmark datasets, GPT-4.1 achieved the highest cosine similarity, indicating the strongest alignment with original PAG descriptions. Specifically, on SPAGs 5–10, GPT-4.1 reached a cosine similarity of 0.71 ± 0.10, followed by GPT-3.5 (0.71 ± 0.12) and BART-CNN (0.65 ± 0.17). On SPAGs 10–100, GPT-4.1 again led with 0.72 ± 0.13, followed by GPT-3.5 (0.69 ± 0.12) and SciFive (0.58 ± 0.15). In contrast, encoder–decoder models such as SciFive, BART-CNN, and BioBART achieved higher ROUGE-1 F and ROUGE-L F scores [81], reflecting stronger lexical overlap with reference descriptions, albeit with lower semantic alignment as measured by cosine similarity. Models such as Flan-T5 and BioGPT showed comparatively lower performance across both semantic and lexical metrics. Collectively, these results suggest that while supervised summarization models better preserve surface-level textual overlap, larger instruction-tuned LLMs (GPT-4.1 > GPT-3.5) provide superior semantic fidelity, making them more suitable for generating biologically meaningful summaries of PAGs (Table 4).

Table 4.

Comparison of PAG description summarization performance across ten methods (GPT-4.1, GPT-3.5, BART-CNN, SciFive, Pegasus, BioGPT, BioBART, BART-XSum, Flan-T5, and BioRAGent) on SPAGs 5–10 and SPAGs 10–100 datasets.

Evaluation Dataset Model Cosine similarity ROUGE-1 F ROUGE-L F
SPAGs 5–10 GPT-4.1 0.71 ± 0.10 0.34 ± 0.09 0.24 ± 0.07
GPT-3.5 0.71 ± 0.12 0.28 ± 0.11 0.22 ± 0.09
BART-CNN 0.65 ± 0.17 0.43 ± 0.16 0.35 ± 0.16
SciFive 0.63 ± 0.15 0.45 ± 0.15 0.36 ± 0.15
Pegasus 0.58 ± 0.31 0.40 ± 0.30 0.37 ± 0.30
BioGPT 0.57 ± 0.18 0.27 ± 0.14 0.22 ± 0.10
BioBART 0.55 ± 0.09 0.42 ± 0.14 0.36 ± 0.14
BART-XSum 0.52 ± 0.22 0.28 ± 0.13 0.21 ± 0.12
Flan-T5 0.24 ± 0.08 0.17 ± 0.05 0.13 ± 0.05
BioRAGent 0.55 ± 0.19 0.29 ± 0.10 0.20 ± 0.08
SPAGs 10–100 GPT-4.1 0.72 ± 0.13 0.35 ± 0.12 0.24 ± 0.09
GPT-3.5 0.69 ± 0.12 0.28 ± 0.09 0.23 ± 0.08
SciFive 0.58 ± 0.15 0.42 ± 0.15 0.31 ± 0.13
BART-CNN 0.56 ± 0.16 0.39 ± 0.16 0.32 ± 0.17
BART-XSum 0.54 ± 0.19 0.31 ± 0.14 0.23 ± 0.13
Pegasus 0.53 ± 0.27 0.28 ± 0.22 0.24 ± 0.22
BioBART 0.52 ± 0.08 0.40 ± 0.13 0.32 ± 0.15
BioGPT 0.43 ± 0.17 0.24 ± 0.16 0.19 ± 0.13
Flan-T5 0.28 ± 0.11 0.19 ± 0.08 0.14 ± 0.08
BioRAGent 0.47 ± 0.20 0.27 ± 0.11 0.17 ± 0.07

Bold values indicate the best performance achieved among the compared models on the SPAGs 5–10 and SPAGs 10–100 datasets.

High CDI scores correspond to functionally independent SPAG pairs

Across both SPAG-to-SPAG pair evaluations, a clear pattern emerges when comparing functional relevance distributions between CDI-high and CDI-low groups. SPAG pairs with high CDI values show a substantially greater proportion of weak functional relevance, whereas CDI-low groups are more enriched for strong or moderate functional relationships. In the example list of SPAG (5–10) to SPAG (5–10) pairs, weak functional relevance accounts for 40.0% of CDI-high pairs but only 9.1% of CDI-low pairs (Δ = −30.9%), indicating that high CDI values are more likely to separate biologically independent or weakly related GO processes (Table 5, Figs S4 and S5). Conversely, CDI-low pairs show a markedly higher proportion of moderate functional relevance (54.5% versus 30.0%, Δ = +24.5%), suggesting that lower CDI values are associated with closer biological function or pathway proximity. A similar trend is observed in the example list of SPAG (10–100) to SPAG (5–100) pairs. Weak relationships remain more frequent in CDI-high pairs (40.0%) compared with CDI-low (28.6%, Δ = −11.4%), while strong relationships are more represented in CDI-low pairs (42.9%) than CDI-high (30.0%, Δ = +12.9%).

Table 5.

The example lists of SPAG to SPAG pairs with CDI high and CDI low, and their functional relevance. CDI-high SPAG–SPAG pairs are enriched for weak functional relevance, consistent with functional independence.

A list of SPAG to SPAG pairs Functional relevance CDI high CDI low Difference
SPAG (5–10) to SPAG (5–10) Strong 30.0% 36.4% 6.4%
Moderate 30.0% 54.5% 24.5%
Weak 40.0% 9.1% −30.9%
SPAG (10–100) to SPAG (10–100) Strong 30.0% 42.9% 12.9%
Moderate 30.0% 28.6% −1.4%
Weak 40.0% 28.6% −11.4%

Case study of chronic myeloid leukemia tyrosine kinase inhibitor resistant versus sensitive

GOLDEN fusion was applied to a case study as an illustrative example to demonstrate how GOA PAGs are derived from gene set enrichment analysis. The input consisted of a list of differentially expressed genes in chronic myeloid leukemia (CML) samples resistant and sensitive to tyrosine kinase inhibitors (TKIs) [82, 83]. GOLDEN fusion identified two super-PAG structures within the selected PAGs, and consensus clustering showed that the solution stabilized at k = 2 and CDI = 0.997, corresponding to the highest consensus index with a high probability to be clusterable (Fig. S2 and Fig. 6). One cluster summarized the concepts related to the development of resistance to chemotherapy drugs, rendering the treatment ineffective in inhibiting cancer cell proliferation or inducing cell death. This discovery has been repeatedly validated through experimental results from BCR-ABL kinase-independent pathways that promote CML cell survival and proliferation, bypassing TKI inhibition [84, 85]. Conversely, the other cluster consisted of DNA or RNA functions that continued to respond favorably to therapeutic agents (mRNA splicing, maturation of LSU-rRNA, DNA-damage lesion, etc.). Previous studies showed that aberrant RNA splicing in BCR-ABL variants (BCR-ABL35INS) has been associated with poor response to TKI treatment (Imatinib) [86–88]. Additionally, by retrieving the is-a relationships to construct the GOA tree, the two major GOA clusters were recovered in different branches of the tree (Fig. 6 and supplemental material—the interactive network). This real-world application of our framework highlights its potential utility in distinguishing differential cellular responses to treatment in leukemia.

Figure 6.

ALT Text: The tree diagram of two clusters of PAGs connected by is-a relationships, with red and blue points representing distinct groups enriched from gene ontology analysis of leukemia samples.

Visualization of the two super-PAG generated by GOLDEN fusion, with colored dots representing two distinct clusters. The GOs are enriched from a list of differentially expressed genes (DEGs) in a case study comparing CML TKI resistant versus sensitive samples.

Discussion

We demonstrated GOLDEN fusion as a novel way of capturing and representing biologically and functionally important super-PAG from regular PAGs. Routine generation of multi-omics data has greatly increased the diversity of PAGs in the PAGER database. It is critical to perform GOLDEN fusion to ensure that super-PAG clearly and comprehensively represents the results of GNPA. We introduced a critical metric, the clustering coefficient distribution index, for gauging “Clusterability” in PAG networks and evaluated the super-PAG construction using the SBM. The clustering coefficient metric enables the evaluation of any type of network to be clustered or not and further provides guidance for further refining networks with a higher edge confidence cutoff. This choice ensures robust and reliable identification of community structures, especially in networks characterized by complex modularity and connectivity patterns.

As the complexity of the PAG content integration increases while considering the PAG–PAG network and PAG semantic description, GOLDEN fusion implements the embedding fusion from the m-type PAG–PAG relationship and the PAG description to balance the knowledge-based information and gene memberships to achieve the best performance. GOLDEN fusion will be flexible in integrating additional information layers, such as embeddings from gene-miRNA relationships, gene set functional inference similarity, etc. To enhance the interpretability of super-PAG, we performed description extraction and summarization of gene sets with state-of-the-art LLM techniques.

By combining multiple sources of information, GOLDEN fusion offers a powerful and flexible framework for functional genomics analysis, facilitating deeper insights and more accurate interpretations of gene set relationships. Particularly, the semantic-based clustering outcomes were analyzed to assess the effectiveness of the LLM-based feature representation. The results revealed that the embedding generated by the OpenAI’s text-embedding-3-small model enhanced clustering quality, as indicated by improved cluster coherence and separation. Thus, GOLDEN fusion provided deeper insights into the relationships between gene sets and offered a more nuanced understanding compared to traditional clustering methods based on simple numerical features. The integration of semantic features through LLMs, therefore, holds significant promise for advancing the interpretability and accuracy of bioinformatics analyses.

GOLDEN fusion can be extensively used for any gene set summarization based on multi-omics data and single-cell data. The representation of the gene set can be enriched by considering different types of activities from various omics sources, such as mutation burden [89], transcriptional activity [90], proteomics activity [91], and metabolic activity [92], facilitating deeper insights and more comprehensive interpretations of gene sets and putative gene set clusters. All gene set activities can be converted into embeddings to form different super-PAG for different levels of integration. Additionally, with the prevalence of single-cell data analysis, cell-type-specific and cluster-specific super-PAG can be generated using cell-based multi-omics profiles [93]. Therefore, GOLDEN fusion has the potential for broad data implementation and plays a pivotal role in examining non-redundant and comprehensively condensed information in GNPA, making it extremely useful for diverse applications in multi-omics and single-cell studies. Beyond CML, GOLDEN fusion would benefit from additional experimental or literature-based validation of identified super-PAG.

For best practices in GNPA with super-PAG, GOLDEN fusion is poised for potential improvements. In connection-based clustering, the m-type PAG–PAG relationships were used to generate connection-based embeddings. Using a higher threshold can result in better pattern representation but may lead to a tradeoff with a lower network coverage rate, leaving some PAGs uncovered in a PAG–PAG network. One solution could be locally adaptive smoothing with signal denoising [94]. Additionally, the complexity of network modeling increases when integrating multi-modality relationships, such as transcriptional regulatory relationships and post-transcriptional regulatory relationships. Co-embedding of PAG–PAG relationships, PAGs, and nodes can be implemented to model multi-dimensional edge features [95]. In the semantic-based clustering of embeddings from PAG descriptions using LLMs, the current model can be substituted with other LLMs, including the newest ChatGPT versions [96] and LLM2Vec [97]. LLM-generated summaries are intended to support interpretation and navigation of super-PAGs and do not replace curated ontology definitions or expert biological annotation. Therefore, the current implementation of GOLDEN fusion is limited by the absence of human curation for validating LLM-generated summaries. In future work, we plan to develop an interactive platform that incorporates expert feedback to refine and validate generated terms, enabling improved performance through human-in-the-loop curation and enhanced prompt engineering. Currently, super-PAG are regarded as flattened one-level structures above regular PAGs. For multi-omics integration, the connection-based and semantic-based embeddings can be enhanced through matrix addition when the dimensions are the same. The potential benefit of this approach is that setting the coefficient to 0 or 1 can yield exact results from the single embedding. In future work, GOLDEN fusion will be implemented to recover or construct a multi-level architecture using auto-weighted embedding fusion learning. Although GOA is used as the primary benchmarking resource in this study, the GOLDEN fusion framework is ontology-agnostic and requires only (i) gene membership information and (ii) textual descriptions. As such, it can be readily applied to other pathway databases, disease signatures, cell-state programs, and emerging multi-omics gene set collections, extending its utility beyond GO-based analyses.

Conclusion

Overall, GOLDEN fusion takes advantage of network biology and LLM to generate super-PAG with enhanced interpretability and quality for GNPA. It shows potential in comprehensive data integration and knowledge abstractive summarization. We expect that super-PAG generated from GOLDEN fusion will become an extensive and publicly accessible source of nonredundant gene sets with curated biological context. Meanwhile, GOLDEN fusion provides a scalable framework with the potential to improve and enhance the biologists’ experience in GNPA.

Key Points

  • GOLDEN fusion integrates graph-based connectivity and LLM-derived semantic embeddings to generate concise, nonredundant super-PAGs, improving interpretability in functional genomics and gene set network analysis.

  • A novel Connection Disparity Index (CDI) is introduced to interpret a model-informed proxy of clusterability, enabling principled screening of PAG–PAG networks and improving the reliability of downstream clustering.

  • On Gene Ontology benchmarks, GOLDEN fusion consistently outperforms graph-only and semantic-only baselines, achieving higher Adjusted Rand Index (ARI) and Normalized Mutual Information (NMI) in recovering hierarchical structure.

  • GOLDEN fusion outperforms established similarity-based redundancy reduction and clustering methods, including semantic similarity, Jaccard-based redundancy control, and overlap-based clustering.

  • LLM-based summarization provides exploratory descriptions for super-PAGs, further facilitating interpretation from translational and systems biology perspectives.

Supplementary Material

Supplementary_material_bbag244

Acknowledgements

We acknowledge the computational support from the staff who manage the Easley HPC at Auburn University.

Contributor Information

Qi Li, Mathematics and Computer Science Department, School of Natural Sciences Mathematics & Business, Fisk University, 1000 17th Ave N, Nashville, TN 37208, United States.

Cody Nichols, Computer Science and Software Engineering Department, Samuel Ginn College of Engineering, Auburn University, 3101 Shelby Center for Engineering Technology, Auburn, AL 36849, United States.

Robert S Welner, Hematology & Oncology, Heersink School of Medicine, University of Alabama at Birmingham, 1720 2nd Avenue South, Birmingham, AL 35233, United States.

Jake Y Chen, Biomedical Informatics and Data Science, Heersink School of Medicine, University of Alabama at Birmingham, 1720 2nd Avenue South, Birmingham, AL 35294, United States.

Wei-Shinn Ku, Computer Science and Software Engineering Department, Samuel Ginn College of Engineering, Auburn University, 3101 Shelby Center for Engineering Technology, Auburn, AL 36849, United States.

Zongliang Yue, Department of Health Outcomes Research and Policy, Harrison College of Pharmacy, Auburn University, 2316 Walker Building, Auburn, AL 36849, United States.

Authors Contributions

Qi Li (Methodology, Investigation, Writing—original draft, Writing—review & editing), Cody Nichols (Writing—review & editing), Robert S. Welner (Data curation, Writing—review & editing), Jake Y. Chen (Funding acquisition, Writing—review & editing), Wei-Shinn Ku (Supervision, Writing—review & editing), and Zongliang Yue (Funding acquisition, Conceptualization, Supervision, Methodology, Writing—original draft, Writing—review & editing)

Funding

Z.Y. and J.Y.C. acknowledge the grant from the University of Alabama at Birmingham Center for Clinical and Translational Science Pilot Award (UM1TR004771). Z.Y. acknowledges the grant from the Gulf Research Program of the National Academies of Sciences (SCON-10001538) and the subaward from the University of Alabama at Birmingham (UC267384).

Data availability

The source codes and datasets are publicly accessible at https://github.com/ai-pharm-AU/GOLDEN/.

References

  • 1. Zhang  F, Chen  JY. Discovery of pathway biomarkers from coupled proteomics and systems biology methods. BMC Genomics  2010;11:S12. 10.1186/1471-2164-11-S2-S12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Gasperskaja  E, Kučinskas  V. The most common technologies and tools for functional genome analysis. Acta Med Litu  2017;24:1–11. 10.6001/actamedica.v24i1.3457. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Przybyla  L, Gilbert  LA. A new era in functional genomics screens. Nat Rev Genet  2022;23:89–103. 10.1038/s41576-021-00409-w. [DOI] [PubMed] [Google Scholar]
  • 4. Nitash  CG, Adami  C. Information-theoretic characterization of the complete genotype-phenotype map of a complex pre-biotic world: comment on “from genotypes to organisms: state-of-the-art and perspectives of a cornerstone in evolutionary dynamics” by Susanna Manrubia et al.  Phys Life Rev  2021;38:111–4. 10.1016/j.plrev.2021.06.001. [DOI] [PubMed] [Google Scholar]
  • 5. Choi  S. Systems Biology for Signaling Networks. New York: Springer, 2010. [Google Scholar]
  • 6. Woodard  GA, Kratz  JR, Haro  G. et al.  Molecular risk stratification is independent of EGFR mutation status in identifying early-stage non-squamous non-small cell lung cancer patients at risk for recurrence and likely to benefit from adjuvant chemotherapy. Clin Lung Cancer  2021;22:587–95. 10.1016/j.cllc.2021.08.008. [DOI] [PubMed] [Google Scholar]
  • 7. Popa  IP, Serban  DN, Maranduca  MA. et al.  Brugada syndrome: from molecular mechanisms and genetics to risk stratification. Int J Mol Sci  2023;24:3328–51. 10.3390/ijms24043328. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Ge  Q, Li  J, Yang  F. et al.  Molecular classifications of prostate cancer: basis for individualized risk stratification and precision therapy. Ann Med  2023;55:2279235. 10.1080/07853890.2023.2279235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Kaur  P, Potluri  V, Ahuja  VK. et al.  A multi-targeting pre-clinical candidate against drug-resistant tuberculosis. Tuberculosis (Edinb)  2021;129:102104. 10.1016/j.tube.2021.102104. [DOI] [PubMed] [Google Scholar]
  • 10. Dong  H, Li  Z, Bian  S. et al.  Culture of patient-derived multicellular clusters in suspended hydrogel capsules for pre-clinical personalized drug screening. Bioact Mater  2022;18:164–77. 10.1016/j.bioactmat.2022.03.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Ung  MH, Varn  FS, Cheng  C. In silico frameworks for systematic pre-clinical screening of potential anti-leukemia therapeutics. Expert Opin Drug Discovery  2016;11:1213–22. 10.1080/17460441.2016.1243524. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Fan  W, Wang  D, Li  G. et al.  A novel chemokine-based signature for prediction of prognosis and therapeutic response in glioma. CNS Neurosci Ther  2022;28:2090–103. 10.1111/cns.13944. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Colozza  M, Cardoso  F, Sotiriou  C. et al.  Bringing molecular prognosis and prediction to the clinic. Clin Breast Cancer  2005;6:61–76. 10.3816/CBC.2005.n.010. [DOI] [PubMed] [Google Scholar]
  • 14. Liang  J, Guan  X, Bao  G. et al.  Molecular subtyping of small cell lung cancer. Semin Cancer Biol  2022;86:450–62. 10.1016/j.semcancer.2022.05.010. [DOI] [PubMed] [Google Scholar]
  • 15. Montaner  J, Ramiro  L, Simats  A. et al.  Multilevel omics for the discovery of biomarkers and therapeutic targets for stroke. Nat Rev Neurol  2020;16:247–64. 10.1038/s41582-020-0350-6. [DOI] [PubMed] [Google Scholar]
  • 16. Blazquez-Encinas  R, Garcia-Vioque  V, Caro-Cuenca  T. et al.  Altered splicing machinery in lung carcinoids unveils NOVA1, PRPF8 and SRSF10 as novel candidates to understand tumor biology and expand biomarker discovery. J Transl Med  2023;21:879. 10.1186/s12967-023-04754-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Lv  Y, Duanmu  J, Fu  X. et al.  Identifying a new microRNA signature as a prognostic biomarker in colon cancer. PloS One  2020;15:e0228575. 10.1371/journal.pone.0228575. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Spanakis  M. In silico pharmacology for evidence-based and precision medicine. Pharmaceutics  2023;15:1014. 2023 2023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Nayarisseri  A, Khandelwal  R, Tanwar  P. et al.  Artificial intelligence, big data and machine learning approaches in precision medicine & drug discovery. Curr Drug Targets  2021;22:631–55. [DOI] [PubMed] [Google Scholar]
  • 20. Mohammed  AE, Alghamdi  SS, Shami  A. et al.  In silico prediction of Malvaviscus arboreus metabolites and green synthesis of silver nanoparticles--opportunities for safer anti-bacterial and anti-cancer precision medicine. Int J Nanomedicine  2023;2023:2141–62. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Yue  Z, Arora  I, Zhang  EY. et al.  Repositioning drugs by targeting network modules: a Parkinson’s disease case study. BMC Bioinformatics  2017;2017:17–30. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Laufer  VA, Chen  JY, Langefeld  CD. et al.  Integrative approaches to understanding the pathogenic role of genetic variation in rheumatic diseases. Rheum Dis Clin  2017;43:449–66. [DOI] [PubMed] [Google Scholar]
  • 23. Li  J, Zhu  X, Chen  JY. Mining disease-specific molecular association profiles from biomedical literature: a case study. Presented at: Proceedings of the 2008 ACM symposium on Applied computing. 2008;2008. [Google Scholar]
  • 24. Lonardi  S, Chen  J. Data mining in bioinformatics: selected papers from BIOKDD. IEEE/ACM Trans Comput Biol Bioinform  2010;7:195–6. [DOI] [PubMed] [Google Scholar]
  • 25. Huang  F, Welner  RS, Chen  JY. et al.  PAGER-scFGA: unveiling cell functions and molecular mechanisms in cell trajectories through single-cell functional genomics analysis. Front Bioinform  2024;4:1336135. 10.3389/fbinf.2024.1336135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Saha  S, Harrison  SH, Shen  C. et al.  HIP2: an online database of human plasma proteins from healthy individuals. BMC Med Genomics  2008;1:12. 10.1186/1755-8794-1-12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Muhammad  SA, Ahmed  S, Ali  A. et al.  Prioritizing drug targets in Clostridium botulinum with a computational systems biology approach. Genomics  2014;104:24–35. [DOI] [PubMed] [Google Scholar]
  • 28. Chowbina  S, Deng  Y, Ai  J. et al.  A new approach to construct pathway connected networks and its application in dose responsive gene expression profiles of rat liver regulated by 2, 4DNT. BMC Genomics  2010;2010:1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Zhang  F, Chen  JY. Breast cancer subtyping from plasma proteins. BMC Med Genomics  2013;2013:1–16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Lötsch  J, Doehring  A, Mogil  JS. et al.  Functional genomics of pain in analgesic drug development and therapy. Pharmacol Ther  2013;139:60–70. [DOI] [PubMed] [Google Scholar]
  • 31. Eden  E, Navon  R, Steinfeld  I. et al.  GOrilla: a tool for discovery and visualization of enriched GO terms in ranked gene lists. BMC Bioinformatics  2009;2009:1–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Sherman  BT, Hao  M, Qiu  J. et al.  DAVID: a web server for functional enrichment analysis and functional annotation of gene lists (2021 update). Nucleic Acids Res  2022;50:W216–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Liao  Y, Wang  J, Jaehnig  EJ. et al.  WebGestalt 2019: gene set analysis toolkit with revamped UIs and APIs. Nucleic Acids Res  2019;47:W199–205. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Kuleshov  MV, Jones  MR, Rouillard  AD. et al.  Enrichr: a comprehensive gene set enrichment analysis web server 2016 update. Nucleic Acids Res  2016;44:W90–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Mi  H, Muruganujan  A, Huang  X. et al.  Protocol update for large-scale genome and gene function analysis with the PANTHER classification system (v. 14.0). Nat Protoc  2019;14:703–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Boyle  EI, Weng  S, Gollub  J. et al.  GO:: TermFinder—open source software for accessing gene ontology information and finding significantly enriched gene ontology terms associated with a list of genes. Bioinformatics.  2004;20:3710–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Raudvere  U, Kolberg  L, Kuzmin  I. et al.  G: profiler: a web server for functional enrichment analysis and conversions of gene lists (2019 update). Nucleic Acids Res  2019;47:W191–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Yue  Z, Slominski  R, Bharti  S. et al.  PAGER web APP: an interactive, online gene set and network interpretation tool for functional genomics. Front Genet  2022;13:820361. 10.3389/fgene.2022.820361. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Zhang  F, Chen  JY. Breast cancer subtyping from plasma proteins. BMC Med Genomics  2013;6:S6. 10.1186/1755-8794-6-S1-S6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Yue  Z, Zhang  Z, Thanh  Q. et al.  AI-driven gene-sets, networks, pathways, and interactions analyses of multi-omics data. Prog Mol Biol Transl Sci  2026;221:277–313. 10.1016/bs.pmbts.2026.01.023. [DOI] [PubMed] [Google Scholar]
  • 41. Fanfani  V, Cassano  F, Stracquadanio  G. PyGNA: a unified framework for geneset network analysis. BMC Bioinformatics  2020;2020:1–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Pillich  RT, Chen  J, Churas  C. et al.  NDEx IQuery: a multi-method network gene set analysis leveraging the network data exchange. Bioinformatics.  2023;39:btad118. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Hu  Y, Comjean  A, Attrill  H. et al.  PANGEA: a new gene set enrichment tool for Drosophila and common research organisms. Nucleic Acids Res  2023;51:W419–26. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Fabregat  A, Jupe  S, Matthews  L. et al.  The reactome pathway knowledgebase. Nucleic Acids Res  2018;46:D649–55. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Kanehisa  M, Furumichi  M, Sato  Y. et al.  KEGG for taxonomy-based analysis of pathways and genomes. Nucleic Acids Res  2023;51:D587–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Agrawal  A, Balcı  H, Hanspers  K. et al.  WikiPathways 2024: next generation pathway database. Nucleic Acids Res  2024;52:D679–89. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Huang  H, Nguyen  T, Ibrahim  S. et al.  DMAP: a connectivity map database to enable identification of novel drug repositioning candidates. BMC Bioinformatics  2015;16:S4. 10.1186/1471-2105-16-S13-S4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Schaefer  CF, Anthony  K, Krupa  S. et al.  PID: the pathway interaction database. Nucleic Acids Res  2009;37:D674–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Zollinger  DR, Lingle  SE, Sorg  K. et al.  GeoMx™ RNA assay: high multiplex, digital, spatial analysis of RNA in FFPE tissue. In Situ Hybridization Protocols  2020;2020:331–45. [DOI] [PubMed] [Google Scholar]
  • 50. Consortium GO . The gene ontology resource: 20 years and still GOing strong. Nucleic Acids Res  2019;47:D330–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Carithers  LJ, Moore  HM. The genotype-tissue expression (GTEx) project. Biopreserv Biobank  2015;13:307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. Xia  J, Wang  Q, Jia  P. et al.  NGS catalog: a database of next generation sequencing studies in humans. Hum Mutat  2012;33:E2341–55. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53. Tomczak  K, Czerwińska  P, Wiznerowicz  M. Review the cancer genome atlas (TCGA): an immeasurable source of knowledge. Contemp Oncol  2015;2015:68–77. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54. Uhlen  M, Zhang  C, Lee  S. et al.  A pathology atlas of the human cancer transcriptome. Science  2017;357:eaan2507. [DOI] [PubMed] [Google Scholar]
  • 55. Noguchi  S, Arakawa  T, Fukuda  S. et al.  FANTOM5 CAGE profiles of human and mouse samples. Sci Data  2017;4:1–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. Regev  A, Teichmann  SA, Lander  ES. et al.  The Human Cell Atlas. Elife  2017;2017:e27041. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Sollis  E, Mosaku  A, Abid  A. et al.  The NHGRI-EBI GWAS Catalog: knowledgebase and deposition resource. Nucleic Acids Res  2023;51:D977–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Denny  JC, Bastarache  L, Ritchie  MD. et al.  Systematic comparison of phenome-wide association study of electronic medical record data and genome-wide association study data. Nat Biotechnol  2013;31:1102–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59. Barbarino  JM, Whirl-Carrillo  M, Altman  RB. et al.  PharmGKB: a worldwide resource for pharmacogenomic information. Wiley Interdiscip Rev Syst Biol Med  2018;10:e1417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60. Yoo  M, Shin  J, Kim  J. et al.  DSigDB: drug signatures database for gene set analysis. Bioinformatics.  2015;31:3069–71. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. McGeary  SE, Lin  KS, Shi  CY. et al.  The biochemical basis of microRNA targeting efficacy. Science  2019;366:eaav1741. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62. Huang  H-Y, Lin  Y-C-D, Cui  S. et al.  miRTarBase update 2022: an informative resource for experimentally validated miRNA--target interactions. Nucleic Acids Res  2022;50:D222–30. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63. Vivar  JC, Pemu  P, McPherson  R. et al.  Redundancy control in pathway databases (ReCiPa): an application for improving gene-set enrichment analysis in omics studies and “big data” biology. Omics  2013;17:414–22. 10.1089/omi.2012.0083. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64. Balestra  C, Maj  C, Muller  E. et al.  Redundancy-aware unsupervised ranking based on game theory: ranking pathways in collections of gene sets. PloS One  2023;18:e0282699. 10.1371/journal.pone.0282699. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65. Zindl  CL, Witte  SJ, Laufer  VA. et al.  A nonredundant role for T cell-derived interleukin 22 in antibacterial defense of colonic crypts. Immunity.  2022;55:494–511. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66. Yue  Z, Zheng  Q, Neylon  MT. et al.  PAGER 2.0: an update to the pathway, annotated-list and gene-signature electronic repository for human network biology. Nucleic Acids Res  2018;46:D668–76. 10.1093/nar/gkx1040. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67. Z  Yue, RS  Welner, CD  Willey, R  Amin, JY  Chen. GOALS: Gene Ontology Analysis with Layered Shells for Enhanced Functional Insight and Visualization. bioRxiv. 2025:2025.04.22.650095. doi: 10.1101/2025.04.22.650095 [DOI]
  • 68. Karrer  B, Newman  MEJ. Stochastic blockmodels and community structure in networks. Phys Rev E  2011;83:016107. 10.1103/PhysRevE.83.016107. [DOI] [PubMed] [Google Scholar]
  • 69. Opsahl  T, Panzarasa  P. Clustering in weighted networks. Soc Networks  2009;2009:155–63. [Google Scholar]
  • 70. Yue  Z, Kshirsagar  MM, Nguyen  T. et al.  PAGER: constructing PAGs and new PAG-PAG relationships for network biology. Bioinformatics  2015;31:i250–7. 10.1093/bioinformatics/btv265. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71. Supek  F, Bosnjak  M, Skunca  N. et al.  REVIGO summarizes and visualizes long lists of gene ontology terms. PloS One  2011;6:e21800. 10.1371/journal.pone.0021800. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72. Yu  G, Li  F, Qin  Y. et al.  GOSemSim: an R package for measuring semantic similarity among GO terms and gene products. Bioinformatics  2010;26:976–8. 10.1093/bioinformatics/btq064. [DOI] [PubMed] [Google Scholar]
  • 73. Yu  G. Gene ontology semantic similarity analysis using GOSemSim. Methods Mol Biol  2020;2117:207–15. 10.1007/978-1-0716-0301-7_11. [DOI] [PubMed] [Google Scholar]
  • 74. Yu  G, Wang  L-G, Han  Y. et al.  clusterProfiler: an R package for comparing biological themes among gene clusters. OMICS: a journal of. Integr Biol  2012;16:284–7. 10.1089/omi.2011.0118. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75. LN  Phan, JT  Anibal, H  Tran., et al. Scifive: a text-to-text transformer model for biomedical literature. arXiv preprint arXiv:210603598. 2021
  • 76. Deelman  E, Vahi  K, Juve  G. et al.  Pegasus, a workflow management system for science automation. Future Gener Comput Syst  2015;46:17–35. [Google Scholar]
  • 77. Luo  R, Sun  L, Xia  Y. et al.  BioGPT: generative pre-trained transformer for biomedical text generation and mining. Brief Bioinform  2022;23:bbac409. [DOI] [PubMed] [Google Scholar]
  • 78. Yuan  H, Yuan  Z, Gan  R. et al. BioBART: pretraining and evaluation of a biomedical generative language model. In Proceedings of the 21st Workshop on Biomedical Language Processing, 2022;bionlp-1.9:97–109.
  • 79. Bi  M, Bao  Z, Xie  D. et al.  BioRAGent: natural language biomedical querying with retrieval-augmented multiagent systems. Brief Bioinform  2025;26:bbaf539. 10.1093/bib/bbaf539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80. Oza  J, Yadav  H. Enhancing question prediction with flan t5-a context-aware language model approach. Authorea Preprints  2023. [Google Scholar]
  • 81. Lin  C-Y. ROUGE: A Package for Automatic Evaluation of Summaries  2004.
  • 82. Patel  SB, Nemkov  T, Stefanoni  D. et al.  Metabolic alterations mediated by STAT3 promotes drug persistence in CML. Leukemia  2021;35:3371–82. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83. Shah  M, Kumar  H, Qiu  S. et al.  Low c-Kit expression identifies primitive, therapy-resistant CML stem cells. JCI Insight  2023;8:e157421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84. Alves  R, Goncalves  AC, Rutella  S. et al.  Resistance to tyrosine kinase inhibitors in chronic myeloid leukemia-from molecular mechanisms to clinical relevance. Cancers (Basel)  2021;13:4820–55. 10.3390/cancers13194820. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85. Jabbour  EJ, Cortes  JE, Kantarjian  HM. Resistance to tyrosine kinase inhibition therapy for chronic myelogenous leukemia: a clinical perspective and emerging treatment options. Clin Lymphoma Myeloma Leuk  2013;13:515–29. 10.1016/j.clml.2013.03.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86. Itonaga  H, Tsushima  H, Imanishi  D. et al.  Molecular analysis of the BCR-ABL1 kinase domain in chronic-phase chronic myelogenous leukemia treated with tyrosine kinase inhibitors in practice: study by the Nagasaki CML Study Group. Leuk Res  2014;38:76–83. 10.1016/j.leukres.2013.10.022. [DOI] [PubMed] [Google Scholar]
  • 87. Berman  E, Jhanwar  S, Hedvat  C. et al.  Resistance to imatinib in patients with chronic myelogenous leukemia and the splice variant BCR-ABL1(35INS). Leuk Res  2016;49:108–12. 10.1016/j.leukres.2016.08.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88. Gaillard  JB, Arnould  C, Bravo  S. et al.  Exon 7 deletion in the bcr-abl gene is frequent in chronic myeloid leukemia patients and is not correlated with resistance against imatinib. Mol Cancer Ther  2010;9:3083–9. 10.1158/1535-7163.MCT-10-0595. [DOI] [PubMed] [Google Scholar]
  • 89. Li  X, He  Y, Jiang  Y. et al.  PathwayTMB: a pathway-based tumor mutational burden analysis method for predicting the clinical outcome of cancer immunotherapy. Mol Ther Nucleic Acids  2023;2023:34. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90. Wagle  M-C, Kirouac  D, Klijn  C. et al.  A transcriptional MAPK Pathway Activity Score (MPAS) is a clinically relevant biomarker in multiple cancer types. NPJ Precis Oncol  2018;2:7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 91. Soste  M, Charmpi  K, Lampert  F. et al.  Proteomics-based monitoring of pathway activity reveals that blocking diacylglycerol biosynthesis rescues from alpha-synuclein toxicity. Cell Syst  2019;9:309–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92. Temate-Tiagueu  Y, Seesi  SA, Mathew  M. et al.  Inferring metabolic pathway activity levels from RNA-Seq data. BMC Genomics  2016;2016:493–503. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93. Landais  Y, Vallot  C. Multi-modal quantification of pathway activity with MAYA. Nat Commun  2023;14:1668. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94. Wang  Y, Hu  L, Cao  X. et al.  Enhancing locally adaptive smoothing of graph neural networks via Laplacian node disagreement. IEEE Trans Knowl Data Eng  2023;2023:1099–112. [Google Scholar]
  • 95. Zhou  Y, Huo  H, Hou  Z. et al.  Co-embedding of edges and nodes with deep graph convolutional neural networks. Sci Rep  2023;13:16966. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96. OpenAi . ChatGPT (April Version) [Large Language AI Model]  2026.
  • 97. P  Behnam Ghader, V  Adlakha, M  Mosbach, D  Bahdanau, N  Chapados, S  Reddy. Llm2vec: Large language models are secretly powerful text encoders. arXiv preprint arXiv:2404 05961. 2024 2024

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary_material_bbag244

Data Availability Statement

The source codes and datasets are publicly accessible at https://github.com/ai-pharm-AU/GOLDEN/.


Articles from Briefings in Bioinformatics are provided here courtesy of Oxford University Press

RESOURCES