Skip to main content
eLife logoLink to eLife
. 2022 Oct 25;11:e80150. doi: 10.7554/eLife.80150

Comprehensive machine-learning survival framework develops a consensus model in large-scale multicenter cohorts for pancreatic cancer

Libo Wang 1,2,3,, Zaoqu Liu 4,†,, Ruopeng Liang 1,2,3,, Weijie Wang 1,2,3, Rongtao Zhu 1,2,3, Jian Li 1,2,3, Zhe Xing 5, Siyuan Weng 4, Xinwei Han 4,, Yu-ling Sun 1,2,3,
Editors: Tony Ng6, Caigang Liu7
PMCID: PMC9596158  PMID: 36282174

Abstract

As the most aggressive tumor, the outcome of pancreatic cancer (PACA) has not improved observably over the last decade. Anatomy-based TNM staging does not exactly identify treatment-sensitive patients, and an ideal biomarker is urgently needed for precision medicine. Based on expression files of 1280 patients from 10 multicenter cohorts, we screened 32 consensus prognostic genes. Ten machine-learning algorithms were transformed into 76 combinations, of which we selected the optimal algorithm to construct an artificial intelligence-derived prognostic signature (AIDPS) according to the average C-index in the nine testing cohorts. The results of the training cohort, nine testing cohorts, Meta-Cohort, and three external validation cohorts (290 patients) consistently indicated that AIDPS could accurately predict the prognosis of PACA. After incorporating several vital clinicopathological features and 86 published signatures, AIDPS exhibited robust and dramatically superior predictive capability. Moreover, in other prevalent digestive system tumors, the nine-gene AIDPS could still accurately stratify the prognosis. Of note, our AIDPS had important clinical implications for PACA, and patients with low AIDPS owned a dismal prognosis, higher genomic alterations, and denser immune cell infiltrates as well as were more sensitive to immunotherapy. Meanwhile, the high AIDPS group possessed observably prolonged survival, and panobinostat may be a potential agent for patients with high AIDPS. Overall, our study provides an attractive tool to further guide the clinical management and individualized treatment of PACA.

Research organism: Human

Introduction

As the most aggressive tumor, pancreatic cancer (PACA) has a 5-year survival rate of only 11% and ranks fourth among tumor-related deaths in the United States (Siegel et al., 2022). Due to its insidious clinical manifestations and lack of available early detection and screening tools, 80–85% of PACA patients have progressed or metastasized at the time of detection, and lost the opportunity for surgical resection (Mizrahi et al., 2020). Over the past decade, immunotherapy, especially immune checkpoint inhibitors (ICIs), has made encouraging progress in most solid tumors (Billan et al., 2020). Unfortunately, ICIs have yielded disappointing clinical results in PACA because of the complex composition and highly suppressive immune microenvironment (Bear et al., 2020). In terms of molecularly targeted drugs, PARP inhibitors once shed light on BRCA-mutated PACA patients. However, a recent study confirmed that although the PARP inhibitor olaparib extended progression-free survival of patients (3.8 months vs. 7.4 months), the overall survival (OS) was not significantly improved (Golan et al., 2019). Reassuringly, the result of a phase Ib multicenter study showed that the CD40 monoclonal antibody APX005M in combination with chemotherapy achieved a 58% response rate in advanced PACA (O’Hara et al., 2021). Thus, in the era of precision medicine, it is very urgent to explore novel individualized management and combination therapy strategies to markedly improve the prognosis of PACA patients.

In clinical practice, the decision-making, therapeutic management, and follow-up still rely on the traditional anatomy-based TNM staging system (Katz et al., 2008). Although this provides a relatively trustworthy reference for determining whether patients will undergo surgical resection, the high inter- and intra-tumoral heterogeneity of PACA results in a wide range of outcomes even among patients at the same stage (Liu et al., 2022c). With the advancement of high-throughput sequencing and evidence-based medicine, molecular biomarkers such as BRCA1/2 mutations, NTRK fusion, DNA mismatch repair deficiency (dMMR), and microsatellite instability-high (MSI-H) have been gradually brought into clinical guideline (Wattenberg et al., 2020; Doebele et al., 2020; Le et al., 2017). However, given the relatively low incidence but extremely high mortality of PACA, coupled with the current lack of optimal biomarkers to guide treatment decisions, patients may be over- or undertreated, resulting in heavy socioeconomic burden, serious toxic side effects, or rapid disease progression (De Dosso et al., 2021). In response to this problem, numerous multigene panels have been developed to address the wide heterogeneity of PACA and achieve relatively good performance in certain cohorts (Wang et al., 2022; Tan et al., 2020; Yuan et al., 2021). Considering that these prognostic models were based on the expression files of mRNAs, miRNAs, or lncRNAs in a specific pathway (e.g., immunity, metabolic reprogramming, m6A methylation), data utilization is insufficient (Wang et al., 2022; Tan et al., 2020; Yuan et al., 2021). In addition, due to uniqueness and inappropriateness of selected modeling methods, and the lack of strict validation in large multicenter cohorts, expression-based multigene signatures have great shortcomings thereby limiting their wide application in clinical settings (Yokoyama et al., 2020).

To develop an ideal biomarker, based on 32 consensus prognostic genes (CPGs), we constructed and multicenter validated a nine-gene artificial intelligence-derived prognostic signature (AIDPS) via 76 machine-learning algorithm combinations. In 13 multicenter cohorts, AIDPS exhibited robust performance in predicting OS, relapse-free survival (RFS), immunotherapy, and drug efficacy. After incorporating several vital clinicopathological features and 86 published signatures of PACA, our AIDPS also demonstrated stable and dramatically superior predictive capability. In addition, in other common digestive system tumors such as liver hepatocellular carcinoma (LIHC), stomach adenocarcinoma (STAD), colon adenocarcinoma (COAD), and rectum adenocarcinoma (READ), the AIDPS could still accurately stratify the prognosis. Overall, our study provides an important reference for achieving early diagnosis, prognostic evaluation, stratified management, individualized treatment, and follow-up of PACA in clinical practice.

Results

Integrated development of a pancreatic cancer consensus signature

Our workflow is outlined in Figure 1. Based on univariate Cox regression, we screened 32 CPGs from 15,288 intersection genes in the training and nine testing cohorts (Figure 2B). Next, these 32 CPGs were further incorporated into our integration program to develop an AIDPS. In the PACA-AU-Array training cohort, we applied 76 algorithm combinations via ten-fold cross-validation to construct prediction models and calculated the average C-index of each algorithm in the remaining nine testing cohorts. As shown in Figure 2A, the combination of CoxBoost and Survival-SVM with the highest average C-index (0.675) was selected as the final model. We further calculated AIDPS scores of each sample in all 13 cohorts according to the expression files of nine genes included in the AIDPS (Figure 2—source data 1).

Figure 1. The workflow of our research.

Figure 1.

Figure 1—source data 1. Details of baseline information in 13 public datasets.

Figure 2. Construction and testing of the artificial intelligence-derived prognostic signature (AIDPS).

Figure 2.

(A) The C-indexes of 76 machine-learning algorithm combinations in the nine testing cohorts. (B) Discovery of 32 consensus prognosis genes from 10 independent multicenter cohorts. (C–J) The predictive performance of AIDPS was compared with common clinical and molecular variables in the PACA-AU-Array (C), TCGA-PAAD (D), PACA-AU-Seq (E), PACA-CA-Seq (F), E-MTAB-6134 (G), GSE62452 (H), GSE78229 (I), and GSE79668 (J). Z-score test: *p<0.05, **p<0.01, ***p<0.001, ****p<0.0001.

Figure 2—source data 1. The nine genes included in the artificial intelligence-derived prognostic signature (AIDPS).

Consistent prognostic value of AIDPS

To evaluate the prognostic performance of AIDPS, we categorized PACA patients into high and low AIDPS groups according to the median value. The Kaplan–Meier curve for OS and RFS demonstrated the high AIDPS group possessed significantly longer survival in the PACA-AU-Array training cohort (p<0.0001 in OS and p=0.012 in RFS, Figure 3A and B). After removing batch effects, the Meta-Cohort combining 10 cohorts (training and nine testing cohorts) also exhibited the same trend (all p<0.05, Figure 3C and D). In addition, we further enrolled several important clinical traits for multivariate Cox analysis, and the results indicated that AIDPS was an independent protective factor for OS and RFS in the PACA-AU-Array cohort (HR: 0.593 [0.504–0.697] for OS and 0.762 [0.611–0.949] for RFS, both p<0.05, Figure 3E and F). Similar results were also found in the Meta-Cohort (HR: 0.603 [0.531–0.685] for OS and 0.667 [0.552–0.805] for RFS, both p<0.05, Figure 3G and H).

Figure 3. Survival analysis and predictive performance evaluation of artificial intelligence-derived prognostic signature (AIDPS).

(A, B) Kaplan–Meier survival analysis for overall survival (OS) (A) and relapse-free survival (RFS) (B) between the high and low AIDPS groups in the PACA-AU-Array. (C, D) Kaplan–Meier survival analysis for OS (C) and RFS (D) between the high and low AIDPS groups in the Meta-Cohort. (E, F) Multivariate Cox regression analysis of OS (E) and RFS (F) in the PACA-AU-Array. (G, H) Multivariate Cox regression analysis of OS (G) and RFS (H) in the Meta-Cohort. (I, J) Calibration curve for predicting 1-, 2-, and 3-year OS in the PACA-AU-Array (I), and Meta-Cohort (J). (K, L) Time-dependent receiver-operator characteristic (ROC) analysis for predicting 1-, 2-, and 3-year OS in the PACA-AU-Array (K), and Meta-Cohort (L).

Figure 3.

Figure 3—figure supplement 1. Survival analysis of artificial intelligence-derived prognostic signature (AIDPS) in the nine testing cohorts.

Figure 3—figure supplement 1.

(A–I) Kaplan–Meier survival analysis for overall survival (OS) between the high and low AIDPS groups in the TCGA-PAAD (A), PACA-AU-Seq (B), PACA-CA-Seq (C), E-MTAB-6134 (D), GSE62452 (E), GSE28735 (F), GSE78229 (G), GSE79668 (H), and GSE85916 (I). (J–M) Kaplan–Meier survival analysis for relapse-free survival (RFS) between the high and low AIDPS groups in the TCGA-PAAD (J), PACA-AU-Seq (K), PACA-CA-Seq (L), and E-MTAB-6134 (M). (N) Multivariate Cox regression analysis of OS in the TCGA-PAAD.
Figure 3—figure supplement 2. Survival analysis of artificial intelligence-derived prognostic signature (AIDPS) in the nine testing cohorts.

Figure 3—figure supplement 2.

(A–F) Multivariate Cox regression analysis of overall survival (OS) in the PACA-AU-Seq (A), PACA-CA-Seq (B), E-MTAB-6134 (C), GSE79668 (D), GSE62452 (E), and GSE78229 (F). (G–J) Multivariate Cox regression analysis of relapse-free survival (RFS) in the TCGA-PAAD (G), E-MTAB-6134 (H), PACA-CA-Seq (I), and PACA-AU-Seq (J).
Figure 3—figure supplement 3. Predictive performance of artificial intelligence-derived prognostic signature (AIDPS) in the nine testing cohorts.

Figure 3—figure supplement 3.

Time-dependent receiver-operator characteristic (ROC) analysis for predicting 1-, 2-, and 3-year overall survival (OS) in the TCGA-PAAD (A), PACA-AU-Seq (B), PACA-CA-Seq (C), E-MTAB-6134 (D), GSE62452 (E), GSE28735 (F), GSE78229 (G), GSE79668 (H), and GSE85916 (I).
Figure 3—figure supplement 4. Survival analysis and predictive performance of artificial intelligence-derived prognostic signature (AIDPS) in the three external validation cohorts.

Figure 3—figure supplement 4.

(A) Univariate Cox regression analysis of AIDPS and 86 published signatures of pancreatic cancer (PACA) in three external validation cohorts. (B–D) Kaplan–Meier survival analysis for overall survival (OS) in the GSE21501 (B), GSE57495 (C), and GSE71729 (D) cohorts. (E–G) Time-dependent receiver-operator characteristic (ROC) analysis for predicting 1-, 2-, and 3-year OS in the GSE21501 (E), GSE57495 (F), and GSE71729 (G). (H–J) Calibration curve for predicting 1-, 2-, and 3-year OS in the GSE21501 (H), GSE57495 (I), and GSE71729 (J).

In the nine testing cohorts, Kaplan–Meier curves consistently showed a significantly prolonged OS in the high AIDPS group compared with the low AIDPS group (all p<0.05, Figure 3—figure supplement 1A–I). Similarly, the comparison of RFS also demonstrated that patients in the high AIDPS group possessed dramatically lower recurrence rate than low AIDPS group in the TCGA-PAAD (n = 69, p=0.029), PACA-CA-Seq (n = 113, p=0.0023), and E-MTAB-6134 (n = 288, p<0.0001) cohorts (Figure 3—figure supplement 1J, L, M). It is worth mentioning that only 28 samples in the PACA-AU-Seq owned complete RFS information. Although Kaplan–Meier analysis showed a corresponding trend, the log-rank test did not reach statistical significance (p=0.063, Figure 3—figure supplement 1K). After adjustment for available clinicopathological features, such as age, gender, TNM stage, grade, surgical margin, history of radiotherapy or alcohol consumption and KRAS, TP53, or CDKN2A mutations, multivariate Cox analysis results still indicated that AIDPS was an independent prognostic factor for OS (all p<0.05, Figure 3—figure supplements 1N and 2A–F). Consistently, the multivariate results of RFS also revealed that AIDPS remained statistically significant in the TCGA-PAAD, PACA-CA-Seq, and E-MTAB-6134 (all p<0.05, Figure 3—figure supplement 2G–I). However, given the small sample size of PACA-AU-Seq, the p-value was not statistically significant (p=0.338, Figure 3—figure supplement 2J).

Robust predictive performance of AIDPS

To measure the discrimination of AIDPS, we plotted calibration curves and receiver-operator characteristic (ROC) curves. The calibration curves of both the PACA-AU-Array training cohort and Meta-Cohort showed that AIDPS had good prediction performance (Figure 3I and J). The area under the ROC curve (AUCs) of 1-, 2-, and 3-year OS were 0.715, 0.748, and 0.671 in the PACA-AU-Array training cohort and 0.717, 0.719, and 0.719 in the Meta-Cohort (Figure 3K and L). Similarly excellent results were found in the nine testing cohorts, with 0.705, 0.711, and 0.797 in the TCGA-PAAD; 0.749, 0.808, and 0.827 in the PACA-AU-Seq; 0.662, 0.683, and 0.691 in the PACA-CA-Seq; 0.773, 0.698, and 0.675 in the E-MTAB-6134; 0.676, 0.787, and 0.834 in the GSE62452; 0.734, 0.865, and 0.871 in the GSE28735; 0.669, 0.809, and 0.844 in the GSE78229; 0.791, 0.761, and 0.786 in the GSE79668; and 0.748, 0.766, and 0.811 in the GSE85916, respectively (Figure 3—figure supplement 3A–I). The results of AUCs greater than 0.65 in multiple independent cohorts indicated that our AIDPS could stably and robustly predict the prognosis of PACA patients.

In clinical settings, certain clinicopathological features such as surgical margin, stage, and grade are used for prognostic evaluation, clinical stratification management, and treatment decision-making (Ferrone et al., 2005). Therefore, we contrasted the predicted efficacy of AIDPS and these common clinical traits in the eight cohorts containing clinical information. The results of C-index indicated that AIDPS had significantly improved accuracy than these features, including age, gender, race, diabetic history, TNM stage, grade, primary location, history of radiotherapy or alcohol consumption, surgical margin, and KRAS, TP53 or CDKN2A mutations (Figure 2C–J).

In addition, to validate our model more rigorously, we evaluated the predictive performance of AIDPS in the validation cohorts. Kaplan–Meier survival analysis demonstrated that the high AIDPS group owned significantly prolonged OS in the three external validation cohorts (log-rank p=0.0014 in the GSE21501, 0.00045 in the GSE57495, 0.00011 in the GSE71729, Figure 3—figure supplement 4B–D). The AUCs of 1-, 2-, and 3-year OS were 0.677, 0.681, and 0.761 in the GSE21501, 0.682, 0.728, and 0.747 in the GSE57495; 0.676, 0.693, and 0.714 in the GSE71729 (Figure 3—figure supplement 4E–G). The calibration curves also confirmed the good predictive performance of AIDPS (Figure 3—figure supplement 4H–J).

Overall, Kaplan–Meier survival analysis, Cox regression analysis, timeROC curve, C-index, and calibration curve results of the training cohort, nine testing cohorts, Meta-Cohort, and three external validation cohorts consistently indicated that AIDPS could accurately and robustly predict the prognosis of PACA patients, suggesting that AIDPS may become an attractive tool to serve clinical practice.

Re-evaluation of previously 86 published signatures in PACA

The rapid development of high-throughput sequencing has shed light on the stratified management and precise treatment of tumors. In recent years, numerous prognostic signatures of PACA have been constructed via machine-learning algorithms such as LASSO and Stepwise Cox based on large amounts of high-quality data (Wang et al., 2022; Tan et al., 2020; Yuan et al., 2021). Therefore, we additionally collected 86 published mRNA/lncRNA prognostic signatures to compare the predictive accuracy of AIDPS and these models (Figure 4—source data 1). Signatures containing miRNAs were excluded due to the lack of necessary miRNA expression information. The results of univariate Cox regression showed that only our AIDPS and 20-gene signature of Demirkol CS had consistent statistical significance in all 13 independent cohorts and Meta-Cohort (Figure 4A, Figure 3—figure supplement 4A).

Figure 4. Comparisons between artificial intelligence-derived prognostic signature (AIDPS) and 86 expression-based signatures.

(A) Univariate Cox regression analysis of AIDPS and 86 published signatures of pancreatic cancer (PACA). (B) C-indexes of AIDPS and 86 published signatures in the PACA-AU-Array, TCGA-PAAD, PACA-AU-Seq, PACA-CA-Seq, E-MTAB-6134, GSE62452, GSE28735, GSE78229, GSE79668, GSE85916, and Meta-Cohort. Z-score test: *p<0.05, **p<0.01, ***p<0.001, ****p<0.0001.

Figure 4—source data 1. Details of 86 published mRNA/LncRNA signatures in pancreatic cancer (PACA).

Figure 4.

Figure 4—figure supplement 1. Comparison of artificial intelligence-derived prognostic signature (AIDPS) with 86 published signatures in the three validation cohorts and with models constructed by other methods for nine AIDPS genes.

Figure 4—figure supplement 1.

(A) C-indexes of AIDPS and 86 published signatures in the GSE21501. (B) C-indexes of AIDPS and 86 published signatures in the GSE57495. (C) C-indexes of AIDPS and 86 published signatures in the GSE71729. (D) The C-indexes of AIDPS and models constructed by other methods for nine AIDPS genes in the nine testing cohorts and three external validation cohorts. (E) The C-indexes for the six-gene signature of Stratford JK in all 13 cohorts. (F) The C-indexes for the 15-gene signature of Chen DT in all 13 cohorts. (G) The C-indexes for the five-gene signature of Kim J in all 13 cohorts. Z-score test: *p<0.05, **p<0.01, ***p<0.001, ****p<0.0001.

We then compared the predictive power of AIDPS and these 86 signatures via C-index across the training cohort, nine testing cohorts, and Meta-Cohort (Figure 4B). Our AIDPS exhibited distinctly superior accuracy than the other models in almost all cohorts (ranked first in four cohorts, ranked second in three cohorts, and ranked third in two cohorts), revealing the robustness of AIDPS. Of note, various prognostic signatures owned higher C-index in their TCGA-PAAD training cohort (e.g., Zhang C, Xu Q, Li Z, etc.), but performed poorly in other cohorts, which might be due to impaired generalization ability from overfitting (Figure 4B).

In addition, our AIDPS also possessed robust predictive performance across the three external validation cohorts, ranking fourth in the GSE57495 cohort as well as fifth in the GSE21501 and GSE71729 cohorts, which outperformed almost all published signatures (Figure 4—figure supplement 1A–C). Notably, although the six-gene signature of Stratford JK was significantly better than AIDPS in the GSE21501 and GSE71729 cohorts, it was constructed in the GSE21501 cohort and performed very poorly in other cohorts, with C-index even less than 0.6 in the GSE57495, TCGA-PAAD, PACA-AU-Seq, etc. (Figure 4—figure supplement 1E). The 15-gene signature of Chen DT owned observably superior performance in his own training cohort GSE57495, but it was unsatisfactory in the GSE21501, GSE71729, PACA-CA-Seq, and other cohorts (Figure 4—figure supplement 1F). Similarly, Kim J’s five-gene signature performed well in the training cohort GSE71729 as well as GSE21501 and PACA-AU-Seq cohorts, but very poorly in most other cohorts such as GSE85916, GSE57495, PACA-CA-Seq, and E-MTAB-6134 (Figure 4—figure supplement 1G). Furthermore, although the 20-gene signature of Demirkol CS, the 3-gene signature of Chen H, the 6-gene signature of Hou J, the 7-gene signature of Liu X, and the 6-gene signature of Yu X_2 were superior to AIDPS in their training cohort or a few other cohorts, only our AIDPS possessed acceptable performance in all PACA cohorts, and the vast majority of cohorts had good performance with a C-index greater than 0.65 (Figure 4B, Figure 4—figure supplement 1A–C). In conclusion, the above results suggested that the nine-gene AIDPS could robustly predict the prognosis of PACA patients, and fewer genes might make it more valuable for clinical promotion.

The clinical signature of AIDPS

We further compared several familiar clinical characteristics between the high and low AIDPS groups, and the results indicated the absence of statistical differences in age, gender, and TNM stage (Figure 5A–C, Figure 5—figure supplement 1A–L). However, patients with low AIDPS possessed more advanced grades, which might contribute to their worse prognosis (Figure 5D, Figure 5—figure supplement 1M–P).

Figure 5. The clinical signature and functional characteristics of the high and low artificial intelligence-derived prognostic signature (AIDPS) groups.

(A–D) Composition percentage of the two groups in clinical characteristics such as age (A), gender (B), stage (C), and grade (D) in the PACA-AU-Array. (E–H) Kaplan–Meier survival analysis for overall survival (OS) in the TCGA-LIHC (E), TCGA-STAD (F), TCGA-COAD (G), and TCGA-READ (H). (I, J) The top five Gene Ontology (GO)-enriched pathways (I) and Kyoto Encyclopedia of Genes and Genomes (KEGG)-enriched pathways (J) in the high AIDPS groups. (K, L) The top five GO-enriched pathways (K) and KEGG-enriched pathways (L) in the low AIDPS groups.

Figure 5.

Figure 5—figure supplement 1. The clinical characteristics of the high and low artificial intelligence-derived prognostic signature (AIDPS) groups.

Figure 5—figure supplement 1.

(A, E, I, M) Composition percentage of the two groups in clinical characteristics such as age (A), gender (E), stage (I), and grade (M) in the TCGA-PAAD cohort. (B, F, J, N) Composition percentage of the two groups in clinical characteristics such as age (B), gender (F), stage (J), and grade (N) in the PACA-AU-Seq cohort. (C, G, K, O) Composition percentage of the two subtypes in clinical characteristics such as age (C), gender (G), stage (K), and grade (O) in the Meta-Cohort cohort. (D, H, L) Composition percentage of the two groups in clinical characteristics such as age (D), gender (H), and stage (L) in the PACA-CA-Seq cohort. (P) Composition percentage of the two groups on grade in the E-MTAB-6134 cohort.

In addition, given the excellent predictive power of AIDPS in PACA, we additionally tested its performance in several other common digestive system tumors. As shown in Figure 5E–H, the Kaplan–Meier survival curves exhibited significantly dismal OS for patients in the low AIDPS group in four tumors, including LIHC (p=0.016), STAD (p=0.037), COAD (p=0.032), and READ (p=0.026). These results supported our hypothesis, suggesting that AIDPS constructed in PACA, as a biomarker, has broad prospects for generalization to other tumors.

The underlying biological mechanisms of AIDPS

Gene set enrichment analysis (GSEA) was applied to elucidate the potential functional pathways of AIDPS. As illustrated in Figure 5I and J, the high AIDPS group was remarkably enriched for digestive and metabolism-related pathways, such as insulin secretion and regulation, peptide hormone secretion and regulation, fat digestion and absorption, pancreatic secretion, maturity onset diabetes of the young, and type Ⅱ diabetes mellitus. While the low AIDPS group was predominantly correlated with the regulation of T cell proliferation, IL-17 signaling pathway, and other immune-related pathways, as well as cell cycle, nuclear chromosome segregation, homologous recombination, and other proliferation-related biological processes, which partly explained its more advanced grades and worse prognosis (Figure 5K and L).

Genome alteration landscape of AIDPS

To investigate genomic heterogeneity between the high and low AIDPS groups, we performed a comprehensive analysis of mutations and copy number alteration (CNA, Figure 6A). As shown in Figure 6C, the low AIDPS group possessed observably higher tumor mutation burden (TMB). Combining the 10 oncogenic signaling pathways in TCGA (Sanchez-Vega et al., 2018), we found that the classical tumor suppressor genes TP53, CDKN2A, and oncogene KRAS were more frequently mutated in the low AIDPS group than high AIDPS group, whereas the opposite was true for SMAD4, TTN, and RNF43 (Figure 6A and B). Next, based on the popular mutational signatures in PACA, we discovered that mutational signature 3 (BRCA1/2 mutations-related) was enriched in the high AIDPS group, while mutational signature 1 (age-related) was more dominant in low AIDPS group.

Figure 6. Multi-omics analysis based on mutation, copy number alteration (CNA), and methylation.

Figure 6.

(A) Genomic alteration landscape according to artificial intelligence-derived prognostic signature (AIDPS). Tumor mutation burden (TMB), relative contribution of four mutational signatures, top 15 mutated genes and broad-level CNA (>20%), and selected genes located within chromosomes 8q24.21, 9p21.3, and 18q21.2 are shown from the top to the bottom panels. The proportion of the high and low AIDPS groups in each alteration is presented in the right bar charts. (B) Comprehensive comparison of mutation landscapes in 10 oncogenic signaling pathways across the high and low AIDPS groups. Genes are mutated at different frequencies (color intensity indicates the mutation frequency within the entire dataset) by oncogenic mutations (red) and tumor suppressor mutations (blue). Each gene box includes two percentages representing the mutation frequency in the high and low AIDPS groups, and another box representing the statistical p-value. Genes are grouped by signaling pathways, with edges showing pairwise molecular interactions. (C) Comparison of the two groups in TMB. (D) Comparison of the two groups in arm and focal CNA burden. (E, F) Boxplot of DNA methylation level (E) and mRNA expression level (F) for methylation-driven genes in the high and low groups. (G–J) Kaplan–Meier survival analysis between the high and low methylation groups in the MAP3K8 (G), PCDH7 (H), PCDHB1 (I), and SPAG6 (J). *p<0.05, **p<0.01, ***p<0.001.

In addition, we further explored the CNA landscape of the two groups. Compared to the high AIDPS group, the low AIDPS group owned evidently higher amplification or deletion in the focal and chromosome arm levels, such as the amplification of 8q24.21, 19q13.2, and 8p11.22 as well as deletion of 9p21.3, 18q21.2, 6p22.2, and 22q13.31 (Figure 6A and D). This result was again corroborated in gene level by the obvious amplification of the oncogene MYC within 8q24.21, and the distinct deletion of the tumor suppressor genes CDKN2A, CDKN2B, and SMAD4 within 9p21.3 and 18q21.2 (Figure 6A). Overall, oncogenes amplification and tumor suppressor genes deletion in the low AIDPS group might contribute to their poor prognosis.

Methylation-driven events of AIDPS

Referring to our previous process (Liu et al., 2021b; Liu et al., 2021c), we screened four methylation driver genes (MDGs) whose methylation levels were significantly inversely related to matched gene expression levels in PACA. Compared to the low AIDPS group, the high AIDPS group possessed higher MAP3K8 and PCDH7 methylation levels as well as significantly lower mRNA expression levels, while the opposite was true for PCDHB1 and SPAG6 (Figure 6E and F). Furthermore, the Kaplan–Meier analysis showed that higher methylation levels of MAP3K8 and PCDH7 and lower methylation level of SPAG6 brought significantly prolonged OS for the high AIDPS group (all p<0.05, Figure 6G, H and J). PCDHB1 also exhibited a similar trend with SPAG6, although statistical significance was not reached (p=0.07, Figure 6I).

Immune landscape and molecular expression of AIDPS

The above GSEA revealed that several immune-related pathways were highly enriched in the low AIDPS group, and we consequently investigated the immune landscape and immune checkpoint molecules (ICMs) expression between the two groups. According to single-sample gene set enrichment analysis (ssGSEA), we found that the low AIDPS group exhibited a relatively higher infiltration abundance of immune cell types, including activated CD4+ T cells, CD56dim natural killer cells, central memory CD8+ T cells, gamma delta T cells, and type 2T helper cells (all p<0.05, Figure 7A and B). In addition, among the 27 ICMs we included, the low AIDPS group had dramatically increased relative expression level, such as CD274, CD276, PDCD1LG2, CD40, CD70, TNFRSF18, TNFRSF4, TNFRSF9, and NT5E (Figure 7C). Together, these results consistently indicated that PACA patients with low AIDPS were more likely to respond to immunotherapy.

Figure 7. The immune landscape in the high and low artificial intelligence-derived prognostic signature (AIDPS) groups.

(A) The heatmap of 28 immune cell types in the high and low AIDPS groups. (B) Boxplot of relative infiltrate abundance of 28 immune cell types in patients with high and low AIDPS groups. (C) Boxplot of relative expression levels at 27 immune checkpoints profiles between the high and low AIDPS patients. *p<0.05, **p<0.01, ***p<0.001.

Figure 7.

Figure 7—figure supplement 1. Integrated Cox regression analysis of survival variables for artificial intelligence-derived prognostic signature (AIDPS) and nine AIDPS genes in 13 cohorts.

Figure 7—figure supplement 1.

(A–J) Univariate Cox regression analysis of overall survival (OS), disease-free survival (DFS), relapse-free survival (RFS), disease-specific survival (DSS), and progression-free survival (PFS) for AIDPS (A), SELENBP1 (B), PLCB4 (C), DCBLD2 (D), PRR11 (E), UNC13D (F), EREG (G), ADM (H), CDCA4 (I), and TGM2 (J) in the training cohort, nine testing cohorts, and three external validation cohorts. .
Figure 7—figure supplement 2. The correlation of artificial intelligence-derived prognostic signature (AIDPS) and its nine genes with immune molecules and immune cell types.

Figure 7—figure supplement 2.

(A–C) The correlation between AIDPS and its nine genes at expression level in the whole (A), high AIDPS (B) and low AIDPS (C) TCGA-PAAD cohort. (D–F) The correlation of AIDPS and its nine genes with 27 immune checkpoint molecules in the whole (D), high AIDPS (E), and low AIDPS (F) TCGA-PAAD cohort. (G–I) The correlation of AIDPS and its nine genes with 28 immune cell types in the whole (G), high AIDPS (H), and low AIDPS (I) TCGA-PAAD cohort.
Figure 7—figure supplement 3. The relevance of artificial intelligence-derived prognostic signature (AIDPS) and its nine genes with mutation and copy number alteration.

Figure 7—figure supplement 3.

From top to bottom panels, the AIDPS and expression of nine AIDPS genes SELENBP1, PLCB4, DCBLD2, PRR11, UNC13D, EREG, ADM, CDCA4, and TGM2 for each sample; top 15 mutated genes and broad-level copy number alterations (>20%), and selected genes located within chromosomes 8q24.21, 9p21.3, and 18q21.2 are shown in the high and low AIDPS TCGA-PAAD cohort. The proportion of the high and low AIDPS groups in each alteration is presented in the right bar charts.

Prognostic value and biological relevance of nine AIDPS genes

The currently known biological functions of these nine AIDPS genes are summarized in Appendix 1. Based on large multicenter survival data from the training cohort, nine testing cohorts, and three external validation cohorts, we performed an integrated univariate Cox regression analysis of survival variables using AIDPS and its nine genes as continuous variables. As shown in Figure 7—figure supplement 1A, AIDPS was an independent protective factor in all 13 cohorts (consistent with Figure 3—figure supplement 1K, only 28 samples in the PACA-AU-Seq with RFS information, and although exhibited a corresponding trend, it did not reach statistical significance). Correspondingly, because the 32 CPGs used to construct AIDPS with consistent prognostic value in at least 8/10 cohorts, nine AIDPS genes had relatively stable performance in the training and nine testing cohorts (Figure 7—figure supplement 1B–J). However, in the three external validation cohorts, the poor performance of these nine AIDPS genes was hardly satisfactory. Furthermore, based on the expression files of these nine AIDPS genes in the PACA-AU-Array training cohort, we constructed 18 models via 10 common machine-learning algorithms (α values for elastic networks from 0.1 to 0.9). As expected, among all 18 models, the model built by survival-SVM, namely, our nine-gene AIDPS, achieved a maximum mean C-index of 0.666 in the remaining 12 multicenter cohorts (Figure 4—figure supplement 1D). That is, for the nine genes obtained from 32 CPGs after dimensionality reduction by CoxBoost, these results reconfirmed our previous pipeline results (Figure 2A), and the AIDPS constructed by survival-SVM was the best choice. Overall, our AIDPS brings significant performance improvements compared to the nine AIDPS genes alone.

To describe the biological relevance between AIDPS and its nine genes, we performed Pearson correlation analysis referring to previous studies (Zhang et al., 2020). The results showed that SELENBP1 and PLCB4, which were significantly positively correlated with AIDPS, had a moderate negative correlation with seven genes that were significantly negatively correlated with AIDPS in the whole and low AIDPS TCGA-PAAD (Figure 7—figure supplement 2A and C). Interestingly, the overall correlation was lower in the high AIDPS group and numerous genes showed different or even opposite trends (e.g., SELENBP1 changed from positive to negative correlation with AIDPS and PLCB4, Figure 7—figure supplement 2B). In addition, given the obvious impact of AIDPS in the tumor microenvironment (TME), we compared the relationship of AIDPS and its nine genes with 27 ICMs and 28 immune cell types in the whole, high AIDPS, and low AIDPS TCGA-PAAD. The Pearson correlation analysis exhibited that AIDPS and its positively correlated SELENBP1 and PLCB4 had a strong negative correlation with ICMs and immune cell types, while DCBLD2, PRR11, UNC13D, EREG, and TGM2, which were negatively correlated with AIDPS, were significantly positively correlated with ICMs and immune cell types in the whole and high AIDPS TCGA-PAAD (Figure 7—figure supplement 2D, E, G, H). However, the trend in the low AIDPS group was contrary, AIDPS and PLCB4 were observably positively correlated with ICMs and immune cell types, while DCBLD2, PRR11, UNC13D, EREG, ADM, CDCA4, and TGM2 were negatively correlated with ICMs and immune cell types (Figure 7—figure supplement 2F and I).

In terms of genomic alteration, we also observed that SELENBP1 and PLCB4, which were positively correlated with AIDPS, were significantly lower in the low AIDPS group with superior mutation and CNA frequency, suggesting that they were significantly negatively correlated with TMB and CNA burden (Figure 7—figure supplement 3). Correspondingly, DCBLD2, PRR11, UNC13D, EREG, ADM, CDCA4, and TGM2, which were negatively correlated with AIDPS, were remarkably increased in the low AIDPS group, hinting they were significantly positively correlated with TMB and CNA burden (e.g., the low AIDPS group possessed higher TP53 mutation and 8q24.21 amplification, as well as higher DCBLD2 expression, Figure 7—figure supplement 3).

Predictive value of AIDPS for immunotherapy

Given that patients in the low AIDPS group possessed higher genomic alteration frequency and TMB, combined with their relatively activated TME and increased ICMs expression, we speculated that PACA patients with low AIDPS were more sensitive to immunotherapy. Based on the Tumour Immune Dysfunction and Exclusion (TIDE) web tool, the low AIDPS group resulted in significantly lower TIDE scores and higher immunotherapy response rates (Figure 8A and B). The results of the Subclass Mapping (Submap) also suggested that expression patterns of patients with low AIDPS was more similar to those of melanoma patients who responded to ICIs (Figure 8C). Overall, these results demonstrated that the low AIDPS group was more likely to benefit from immunotherapy.

Figure 8. Evaluating therapeutic drug benefits.

Figure 8.

(A) Boxplot of Tumour Immune Dysfunction and Exclusion (TIDE) score between the high and low artificial intelligence-derived prognostic signature (AIDPS) groups. (B) Percentage of immunotherapy responses at high and low AIDPS groups. (C) Submap analysis of the two groups and 47 pretreated patients with comprehensive immunotherapy annotations. For Submap analysis, a smaller p-value implied a more similarity of paired expression profiles. (D) Barplot of ouabain and panobinostat CMap scores in patients with high AIDPS. (E) Schematic outlining the strategy to develop potential therapeutic agents with higher drug sensitivity in the high AIDPS group. (F) Comparison of estimated gemcitabine’s sensitivity between high and low PAK1 expression groups. (G, H) The results of Spearman’s correlation analysis of Cancer Therapeutics Response Portal (CTRP)-derived compounds (G) and profiling relative inhibition simultaneously in mixtures (PRISM)-derived compounds (H). (I, J) The results of differential drug response analysis of CTRP-derived compounds (I) and PRISM-derived compounds (J), the lower values on the y-axis of boxplots imply greater drug sensitivity. CMap, Connectivity Map *p<0.05, **p<0.01, ***p<0.001.

Searching for potential therapeutic agents for the high AIDPS group

As illustrated in Figure 8E, we developed potential agents for PACA patients with high AIDPS using sensitivity data from Cancer Therapeutics Response Portal (CTRP, includes 481 compounds over 835 cancer cell lines [CCLs]) and profiling relative inhibition simultaneously in mixtures (PRISM) (includes 1448 compounds over 482 CCLs) datasets (Yang et al., 2021). To ensure the reliability of our protocol, gemcitabine, as a first-line treatment for PACA, was employed to investigate whether the estimated sensitivity and clinical practice were concordant. A laboratory study found that elevated PAK1 activity was required for gemcitabine resistance in PACA, and that PAK1 inhibition enhanced the efficacy of gemcitabine. Consistent with this study, our results revealed that patients with low PAK1 expression possessed distinctly lower estimated AUC values, suggesting greater sensitivity to gemcitabine (Figure 8F). Afterward, we applied this formula to identify potentially sensitive agents for the high AIDPS group, and finally generated four CTRP-derived agents (brefeldin A, oligomycin A, ouabain, and panobinostat) and nine PRISM-derived agents (aspirin, BAY-87–2243, EVP4593, GSK2656157, I-BET151, LY303511, OTX015, oxaliplatin, and XL388). The estimated AUC values of these agents were not only statistically negatively correlated with AIDPS scores, but also significantly lower in the high AIDPS group (Figure 8G–J).

In addition, based on the differential expression profiles between PACA patients and normal controls, we further applied the Connectivity Map (CMap, https://clue.io/) tool to identify candidate compounds for PACA. After taking the intersection with the results obtained by CTRP and PRISM, we ended up with two candidate compounds: ATPase inhibitor ouabain and histone deacetylase (HDAC) inhibitor panobinostat. Among them, panobinostat with a –98.11 CMap score was highly sensitive in PACA patients, suggesting that it could become a potential therapeutic agent for PACA patients in the high AIDPS group (Figure 8D).

Discussion

Over the past 20 years, the incidence of PACA has increased by 0.5–1.0% per year, but the 5-year survival rate only improved from 5.26% to 10%, without a significant breakthrough (Park et al., 2021). The lack of available biomarkers for screening, stratified management, and prognostic follow-up has been an urgent problem for clinicians and researchers, which may lead to over- or undertreatment. To bridge these gaps, we constructed and validated a nine-gene AIDPS via 76 machine-learning algorithm combinations in 13 independent multicenter cohorts. Compared to several common clinicopathological features and 86 published signatures of PACA, our AIDPS demonstrated robust and superior predictive capacity. Moreover, we substantiated that the low AIDPS group had a dismal prognosis, more advanced grades, enrichment in immune and proliferation-related pathways, higher frequency mutations and CNAs, relatively activated TME and increased ICMs expression, and better immunotherapeutic efficacy. While the high AIDPS group owned remarkably prolonged OS and RFS, a significant enrichment of metabolism-related pathways and mutational signature 3 (BRCA1/2 mutations-related) was more sensitive to the ATPase inhibitor ouabain and HDAC inhibitor panobinostat. Therefore, in clinical settings, our AIDPS may become a reliable platform to further serve individualized decision-making in PACA.

In the era of precision medicine, anatomy-based TNM staging is far from meeting the needs of clinicians for ideal biomarkers that could accurately evaluate the prognosis and predict the efficacy of PACA patients (Katz et al., 2008; Liu et al., 2022a). Recently, numerous prognostic signatures of PACA have been constructed, but most of them are based on a specific biological pathway such as immunity, metabolic reprogramming, and m6A methylation (Wang et al., 2022; Tan et al., 2020; Yuan et al., 2021). This ignored information about other biological processes that played a crucial role in the oncogenesis and progression of PACA. In this study, based on 15,288 intersection genes in the training and nine testing cohorts, we further obtained 32 CPGs via univariate Cox regression analysis. In addition, in the existing studies, people mostly choose the modeling algorithms based on their knowledge limitations and preferences (Liu et al., 2022a; Liu et al., 2022b). To remedy this shortcoming, we collected 10 popular machine-learning algorithms that could be used to construct biomedical prognostic signatures. Among them, RSF, LASSO, CoxBoost, and Stepwise Cox have the function of variable screening and data dimensionality reduction, so we further combined them into 76 algorithm combinations. Ultimately, the combination of CoxBoost and Survival-SVM with the largest average C-index (0.675) in the remaining nine testing cohorts was identified as the final model.

Overfitting is one of the troublesome problems encountered by artificial intelligence and machine learning in biomedical model development, with several models fitting well in the training cohort but poorly in other external validation cohorts (Deo, 2015). After minimizing redundant information by CoxBoost, we finally obtained a nine-gene signature termed AIDPS through Survival-SVM. The results of Kaplan–Meier analysis, univariate Cox regression, ROC curve, and calibration curve all indicated that AIDPS had excellent predictive performance in the training cohort, nine testing cohorts, Meta-Cohort, and three external validation cohorts. Moreover, compared with 86 published PACA signatures, AIDPS exhibited distinctly superior accuracy than other models in almost all cohorts, revealing the robustness of AIDPS. It should be mentioned that, although the 20-gene signature of Demirkol CS, the 6-gene signature of Stratford JK, the 15-gene signature of Chen DT, and the 5-gene signature of Kim J, and so on were better than AIDPS in a certain cohort, but they were unsatisfactory across almost all validation cohorts, which might due to very poor generalization ability from overfitting. In contrast, it contains fewer elements and thus AIDPS has a superior extrapolation possibility, and the findings of 13 independent multicenter cohorts also fully confirm this notion.

In addition, compared with several common clinical and molecular characteristics such as TNM stage, grade, KRAS, TP53, or CDKN2A mutations, our AIDPS showed significantly improved accuracy. After stratifying PACA patients into the high and low AIDPS groups, we demonstrated that there was no outstanding difference in age, gender, and TNM stage, but the low AIDPS group had more advanced grades, which also contributed to its worse prognosis to some extent. Furthermore, given the excellent performance of AIDPS in PACA, we additionally measured its performance in four common digestive system tumors LIHC, STAD, COAD, and READ and found that AIDPS could accurately stratify patients. These findings indicated that AIDPS constructed in PACA, as a biomarker, has broad prospects for generalization to other tumors.

GSEA functional enrichment analysis was applied to elucidate the underlying biological mechanisms of AIDPS. The low AIDPS group was mostly enriched in immune and proliferation-related pathways, which partly explained its more advanced grades and worse prognosis. In addition, many recent studies have reported the emerging promise of epigenetic alterations especially DNA methylation in the early diagnosis and prognostic follow-up of PACA (Yokoyama et al., 2020; Grady et al., 2021). Therefore, we identified four MDGs in PACA patients. Further investigations found that higher methylation levels of MAP3K8 and PCDH7, and lower methylation levels of PCDHB1 and SPAG6 in the high AIDPS, all corresponded to obviously prolonged OS, suggesting that methylation modification might play an indispensable role in its better prognosis.

Based on multi-omics data of TCGA-PAAD, we further investigated the genomic heterogeneity with regard to AIDPS. The results showed that the low AIDPS group owned higher TMB and superior mutation frequencies in the classical tumor suppressor genes TP53, CDKN2A, and oncogene KRAS. Numerous studies have revealed that TP53, CDKN2A, and KRAS mutations promoted invasion, metastasis, and immune escape in PACA patients, resulting in worse prognosis (Hu et al., 2018; Hashimoto et al., 2019). In addition, the results of CNA indicated that the low AIDPS group had evidently increased amplification of 8q24.21, 19q13.2, and 8p11.22 as well as deletion of 9p21.3, 18q21.2, 6p22.2, and 22q13.31 than those in the high AIDPS group. A recent study has shown that amplification of 19q13.2 and consequent overexpression of this loci was correlated with impaired survival in PACA (Sandhu et al., 2016). Morikawa et al., 2018 also found that amplification of 8p11.22 was associated with chemotherapy resistance and shorter OS in ovarian clear cell carcinoma. Baker et al., 2016 reviewed that people with 9p21.3 deletion were more susceptible to multiple types of tumors. Previous studies have demonstrated that deletion of 22q13.31 was an early genetic event in insulinoma independent of other genomic alteration and related to more advanced stage and dismal prognosis (Jonkers et al., 2006). Overall, all this evidence consistently supported our conclusion that genome-driven events might contribute to worse prognosis of the low AIDPS group. On the other hand, relatively high-frequency genomic alteration and higher TMB also provide more neoantigens, which might point the way for immunotherapy in the low AIDPS group (Sha et al., 2020).

Next, we investigated the immune landscape between the high and low AIDPS groups. The results of ssGSEA exhibited that the low AIDPS group possessed superior abundance of immune cell types, including activated CD4+ T cells, CD56dim natural killer cells, and central memory CD8+ T cells. As everyone knows, these increased effector cells will enhance antitumor immunity and bring better immunotherapeutic effects for the low AIDPS group (Borst et al., 2018; Wu et al., 2013). Over the past decade, ICIs targeting ICMs have shed light on the treatment of solid tumors (Billan et al., 2020). As expected, our findings showed that the expression of ICMs such as CD274, CD276, and PDCD1LG2 was dramatically elevated in patients with low AIDPS, suggesting that they were more likely to benefit from ICIs treatment. TIDE and Submap are two widely recognized tools for predicting tumor patient sensitivity to ICIs based on expression profile (Jiang et al., 2018; Hoshida et al., 2007). Consistently, the results confirmed our previous conclusion that patients with low AIDPS possessed a greater response rate to immunotherapy. Overall, these findings indicated that our AIDPS might provide a reference for early identification of immunotherapy-sensitive PACA patients receiving first-line immunotherapy.

Precision medicine requires clinicians to identify patients who are sensitive to various treatments as early as possible for further individualized treatment. Therefore, considering the higher sensitivity of the low AIDPS group to immunotherapy, we integrated CTRP, PRISM, and CMap databases to develop specific drugs for patients in the high AIDPS group (Yang et al., 2021; Subramanian et al., 2017; Malta et al., 2018). Ultimately, an HDAC inhibitor, panobinostat, attracted our attention as a potential drug for patients in the high AIDPS group. The latest studies report that panobinostat can synergistically enhance the antitumor effect of the selective Wee1 kinase inhibitor MK-1775 or CAR-T cell therapy in PACA (Wang et al., 2015; Ali et al., 2021). In the future, more clinical trials are required to confirm the broad prospects of panobinostat in PACA, especially in patients with high AIDPS.

After careful literature research, we found that SELENBP1 that owned lower expression in the low AIDPS group with poor prognosis was associated with better tumor prognosis, and its decreased expression led to poor prognosis of many tumors such as lung adenocarcinoma (Chen et al., 2004). Meanwhile, PRR11, EREG, ADM, and TGM2, which were overexpressed in the low AIDPS group, played a vital role in the proliferation, invasion, and metastasis of many tumors such as breast cancer, colorectal cancer, and PACA, and lead to their chemotherapy resistance and were potential targets for enhanced efficacy (Lee et al., 2020; Neufert et al., 2013; Aggarwal et al., 2012; Malkomes et al., 2021). In addition, our study also found strong biological correlations among nine AIDPS genes, which are also closely related to mutations, CNAs, and TME in PACA. This also essentially supports the important impact of AIDPS on the prognosis and immune microenvironment, as well as its role in the clinical management and precision treatment of PACA.

This study differed from previous studies in the following aspects. (1) We systematically collected 13 large multicenter cohorts and selected the algorithm with the largest average C-index in the 9 testing cohorts to construct our AIDPS. (2) Unlike current prognostic models for a certain pathway, our AIDPS was based on 15,288 intersection genes from training and nine testing cohorts, which avoided the omission of other indispensable biological process in the initiation and progression of PACA. (3) In order to prevent the inappropriate modeling methods due to personal preference, we combined 10 recognized machine-learning algorithms into 76 combinations and selected the best model based on their accuracy. While we have tried to be as rigorous and comprehensive as possible in our research, some limitations should be noted. First, although we collected 13 independent multicenter cohorts, further validation in prospective study was warranted. Second, in spite of the nine genes included in AIDPS having appeared in numerous prognostic signatures of PACA, which indicated their consistent prognostic value. Their roles in PACA remain to be elucidated, and more functional experimental validation is required in the future. Finally, further clinical trials are necessary to affirm the therapeutic effect of panobinostat in PACA patients with high AIDPS.

In conclusion, based on 32 CPGs from training cohort, nine testing cohorts, and three external validation cohorts, we constructed and validated a consensus prognostic signature (termed AIDPS) via 76 machine-learning algorithm combinations. After incorporating several vital clinicopathological features and 86 published signatures, AIDPS also exhibited robust and dramatically superior predictive capability. Of note, our AIDPS has important clinical implications for the clinical management and individualized treatment of PACA, and patients with low AIDPS are more sensitive to immunotherapy, while panobinostat may be a potential agent for patients with high AIDPS. In addition, in other prevalent digestive system tumors, the nine-gene AIDPS could still accurately stratify the prognosis, suggesting a strong possibility of extrapolation. Overall, our study provides an attractive tool for prognostic evaluation, risk stratification, and individualized treatment of PACA patients in clinical practice.

Materials and methods

Data acquisition and preprocessing

We collected datasets from The Cancer Genome Atlas (TCGA, http://portal.gdc.cancer.gov/), International Cancer Genome Consortium (ICGC, http://dcc.icgc.org/), ArrayExpress (https://www.ebi.ac.uk/arrayexpress/), and Gene Expression Omnibus (GEO, https://www.ncbi.nlm.nih.gov/geo/) public databases according to the following procedure: (1) more than 40 samples with survival information; (2) at least 15,000 clearly annotated genes; and (3) patients with primary tumors and no other treatments were given before resection. Finally, we enrolled 1570 samples from 13 cohorts, TCGA-PAAD (n = 176), ICGC-PACA-AU-Seq (PACA-AU-Seq, n = 81), ICGC-PACA-AU-Array (PACA-AU-Array, n = 267), ICGC-PACA-CA (PACA-CA-Seq, n = 182), E-MTAB-6134 (n = 288), GSE62452 (n = 65), GSE28735 (n = 42), GSE78229 (n = 49), GSE79668 (n = 51), GSE85916 (n = 79), GSE21501 (n = 102), GSE57495 (n = 63), and GSE71729 (n = 125). The FPKM data in the TCGA-PAAD was downloaded from UCSC Xena database (https://xenabrowser.net/datapages/) and further converted into log2 (TPM + 1) format. The RNA-Seq data of ICGC were downloaded from its portal and converted into log2 (TPM + 1) format. The normalized exp-Array data from ICGC, ArrayExpress, and GEO were generated directly from their portal. Detailed clinical and pathological information of these 13 cohorts is presented in Figure 1—source data 1.

Univariate Cox regression analysis

Based on intersection genes, we performed univariate Cox regression analysis in the training cohort, nine testing cohorts. We selected consensus prognosis genes (CPGs) for the next study according to the following criteria: p<0.05 and all hazard ratios (HRs) consistently >1 or <1 in more than 8/10 cohorts.

Artificial intelligence-derived prognostic signature

To construct a consensus prognosis model for PACA, we performed our previous workflow (Liu et al., 2022a; Liu et al., 2022b). (1) First, we integrated 10 classical algorithms: random forest (RSF), least absolute shrinkage and selection operator (LASSO), gradient boosting machine (GBM), survival support vector machine (Survival-SVM), supervised principal components (SuperPC), ridge regression, partial least squares regression for Cox (plsRcox), CoxBoost, Stepwise Cox, and elastic network (Enet). Among them, RSF, LASSO, CoxBoost, and Stepwise Cox have the function of dimensionality reduction and variable screening, and we combined them with other algorithms into 76 machine-learning algorithm combinations. (2) Next, we utilized the PACA-AU-Array with larger sample size in ICGC as the training cohort and used these 76 combinations to construct signatures separately in the expression files with 32 CPGs. (3) Finally, in the nine testing cohorts (TCGA-PAAD, PACA-AU-Seq, PACA-CA-Seq, E-MTAB-6134, GSE62452, GSE28735, GSE78229, GSE79668, GSE85916), we calculated the AIDPS score for each cohort using the signature obtained in the training cohort. Based on the average C-index of the nine testing cohorts, we finally picked the best consensus prognosis model for PACA.

Validating the prognostic value of AIDPS in 14 datasets

Patients in the training cohort, nine testing cohorts, Meta-Cohort (obtained by removing batch effects and repetitions from training cohort and nine testing cohorts), and three external validation cohorts (GSE21501, GSE57495, and GSE71729) were categorized into high and low AIDPS groups according to the median value. The prognostic value of AIDPS was evaluated by Kaplan–Meier curve and multivariate Cox regression analysis. The calibration curve and receiver-operator characteristic (ROC) curve were plotted to assess the predictive accuracy of AIDPS.

Collection and calculation of PACA published signatures

With the attention paid to the stratified management and precise treatment of PACA, many prognostic signatures have been constructed, including m6A-related lncRNA signature, metabolic reprogramming-related signature, and SMAD4-driven immune signature, etc. (Wang et al., 2022; Tan et al., 2020; Yuan et al., 2021). To compare the predictive performance of AIDPS and these published signatures, we systematically searched PubMed for published prognostic model articles up to January 1, 2022. Afterward, we calculated their risk scores in the 14 cohorts based on the genes and coefficients provided by the article, and comprehensively evaluated their prognostic performance in PACA by univariate Cox analysis and C-index.

Evaluating clinical significance of AIDPS

We compared the differences in several pivotal clinical traits such as age, gender, TNM stage, and grade between the high and low AIDPS groups. In addition, to explore the application value of AIDPS in other prevalent gastrointestinal tumors, we acquired the mRNA expression and survival data of LIHC, STAD, COAD, and READ in the same way as TCGA-PAAD, and further performed Kaplan–Meier analysis.

Gene set enrichment analysis

GSEA was applied to identify specific functional pathways in the high and low AIDPS groups. After differential analysis using the DESeq2 package, all genes were ranked in descending order according to log2FoldChange (log2FC). Next, we identified GO and KEGG enriched pathways by the clusterProfiler package and further selected the top five pathways in normalized enrichment score (NES) for visualization.

Genomic alteration landscape

To investigate the genomic alteration landscape in the high and low AIDPS groups, we performed a comprehensive analysis of mutation and CNA data in the TCGA-PAAD. (1) After obtaining the raw mutation file, we calculated the TMB of each sample and visualized the top 15 genes through the maftools package. (2) As described in Lu et al., 2021, we applied the deconstructSigs package to extract the mutational signatures for each PACA patients, and selected mutational signature 1 (age-related), mutational signature 2 (APOBEC activity-related), mutational signature 3 (BRCA1/2 mutations-related), and mutational signature 6 (dMMR-related) with higher frequency of occurrence in PACA for visualization (Alexandrov et al., 2013). (3) Recurrent amplified or deleted genome regions were decoded and localized through GISTIC 2.0 module in Firebrowse tool (http://firebrowse.org/). We finally selected regions with broad-level CNA frequency >20% and several genes located within chromosomes 8q24.21, 9p21.3, and 18q21.2 for display.

Estimation of methylation-driven events

Following the pipeline developed in previous studies (Liu et al., 2021b; Liu et al., 2021a), we identified MDGs for TCGA-PAAD. Furthermore, we compared the differences in the methylation levels and mRNA expression levels of MDGs in the two groups, and further evaluated the effect of MDGs methylation levels on the prognosis by Kaplan–Meier survival curve.

Immune molecule expression and tumor microenvironment evaluation

The ssGSEA was utilized to comprehensively infer the infiltration abundance of immune and stromal component in the high and low AIDPS groups (Wang et al., 2022; Liu et al., 2021c). In addition, we recruited 27 ICMs from our previous study, including B7-CD28 family, TNF superfamily, etc., and measured their expression levels between the two groups (Wang et al., 2022).

Response to immunotherapy

TIDE web tool was used to predict responsiveness to ICIs between the high and low AIDPS groups, and lower TIDE scores suggested better immunotherapeutic efficacy (Jiang et al., 2018). Additionally, we applied the Submap to calculate the expression similarity between patients in the high and low AIDPS groups and patients who responded/non-responded to ICIs, and then speculated immunotherapy efficacy (Hoshida et al., 2007).

Development and validation of potential therapeutic agents

As shown in Figure 8D, we developed potential therapeutic agents for the high AIDPS group according to the protocol of Yang et al., 2021. (1) First, we acquired drug sensitivity data for CCLs from the CTRP as well as PRISM repurposing datasets, and expression data of CCLs from the Cancer Cell Line Encyclopedia (CCLE) database. (2) The CTRP and PRISM datasets own AUC values, and lower AUC values suggest increased sensitivity to this compound. Moreover, as a first-line chemotherapeutic drug for PACA, we further selected gemcitabine to verify the scientific and rigor of this approach. (3) Based on Wilcoxon rank-sum test, we performed a differential analysis of drug response between the high AIDPS (first 10%) and low AIDPS (last 10%) groups, and the threshold log2FC > 0.2 was set to identify compounds with lower AUC values in the high AIDPS group. (4) Next, we applied Spearman correlation to further screen compounds with AUC values that had negative correlation coefficients with AIDPS (setting threshold R<−0.4). (5) Finally, we identified potential drugs for patients in the high AIDPS group by the intersection of the compounds obtained from (3) and (4).

The CMap (https://clue.io/) is a publicly available web tool for discovering candidate compounds that may target AIDPS-related pathways based on gene expression signature (Subramanian et al., 2017; Malta et al., 2018). Based on differential expression analysis, we identified potential compounds in PACA using CMap to further validate the results obtained from the CTRP and PRISM databases.

Statistical analysis

All data cleaning, analysis, and result visualization for this research were performed in R 4.1.2. Continuous variables were analyzed by Wilcoxon rank-sum test or Student’s t-test. Categorical variables were statistically compared using Chi-square test or Fisher’s exact test. The survival package was used for univariate, multivariate Cox as well as Kaplan–Meier survival analysis. The timeROC package and rms package were utilized to plot ROC curve and calibration curve, respectively. The MethylMix package was applied to identify MDGs. p-Value (two-sided) < 0.05 was considered statistically significant.

Data availability

All data generated during this study are included in the manuscript and supporting files. The basic script for our AIDPS model is available on the GitHub website (https://github.com/Zaoqu-Liu/AIDPS, copy archived at swh:1:rev:f9d929456fa9f0cd7721cea6a5e2a1412ffae4a7; Liu, 2022); the researchers entered the expression matrix of these nine AIDPS genes and could obtain patient-specific risk scores. Source data files have been provided for Figures 1, 2 and 4.

Acknowledgements

We sincerely thank the research group that contributed pancreatic cancer sequencing data as well as the staff who developed the R package. This study was supported by the National Natural Science Foundation of China (nos. 81870457, 82172944).

Appendix 1

Current research progress on the nine AIDPS genes

The nine AIDPS genes were rarely studied in tumors, most of which focused on their roles in biological phenotypes such as tumorigenesis and progression, and a few studies investigated their roles and guiding significance in PACA immune microenvironment and treatment. Specifically, we found that SELENBP1-owned lower expression in the low AIDPS group with poor prognosis was associated with better tumor prognosis, and its decreased expression resulted in poor prognosis of many tumors such as lung adenocarcinoma. Meanwhile, DCBLD2, PRR11, EREG, ADM, and TGM2, which were overexpressed in the low AIDPS group, played an essential role in the proliferation, invasion, and metastasis of many tumors such as PACA, hepatocellular carcinoma, and colorectal cancer, and lead to their chemotherapy resistance and were potential targets for enhanced efficacy. However, the functional roles and mechanisms of UNC13D and CDCA4 in tumors are not well understood, and more high-quality studies are needed in the future. These findings are consistent with our study, and the specific functional characteristics are summarized as follows:

  1. SELENBP1, encoding a novel human methanethiol oxidase, whose expression is significantly decreased in the progression of Barrett’s esophagus to adenocarcinoma and can affect chemotherapy sensitivity (Silvers et al., 2010). This is consistent with our results that SELENBP1 expression was decreased in the low AIDPS group with worse prognosis (Figure 7—figure supplement 3).

  2. PLCB4 encodes a phospholipase, and activating PLCB4 mutation was recently identified in primary leptomeningeal melanocytic tumors (Van de nes et al., 2017).

  3. DCBLD2 is upregulated in glioblastoma and head and neck cancer, and phosphorylation of DCBLD2 Y750 activates AKT pathway, which in turn enhances EGFR-driven tumorigenesis (Feng et al., 2014). DCBLD2 has also been found to play a crucial role in the invasion, progression, and metastasis of neuroendocrine tumors (Hofsli et al., 2008). These results are consistent with an increased expression of DCBLD2 in the low AIDPS group with a dismal prognosis.

  4. Proline-rich protein 11 (PRR11) is a novel tumor-related gene that has been found to promote breast cancer growth and anti-estrogen resistance through the PI3K pathway (Lee et al., 2020). In addition, it has also been demonstrated that PRR11 affects autophagy and promotes proliferation in non-small cell lung cancer (NSCLC) through the Akt/mTOR pathway (Zhang et al., 2018; Wei et al., 2022), and recent studies have also found that PRR11 can promote the tumorigenesis and progression of renal clear cell carcinoma (ccRCC) by regulating E2F1 stability (Chen et al., 2021). Overall, these results are consistent with higher expression of PRR11 in the low AIDPS group with a worse prognosis.

  5. UNC13D mutation plays an essential role in familial hemophagocytic lymphohistiocytosis (FHL), but its role in tumors remains unknown and needs to be further explored (Meeths et al., 2011; Cichocki et al., 2014; Spessott et al., 2015; Borte et al., 2014).

  6. EREG, as an EGFR ligand epithelial regulatory protein, plays a fundamental role in the growth and proliferation of breast and colorectal cancers (Farooqui et al., 2015; Neufert et al., 2013) and is associated with tamoxifen resistance in breast cancer (He et al., 2019) and efficacy of panitumumab and adjuvant chemotherapy in colorectal cancer (Smyth et al., 2016; Thomaidis et al., 2014).

  7. Adrenomedullin (ADM) encodes a pre-prohormone that is cleaved into two bioactive peptides, which can dilate blood vessels, regulate hormone secretion, and promote angiogenesis. Many studies have confirmed that ADM plays a major role in the proliferation, invasion, angiogenesis, and metastasis of PACA, hepatocellular carcinoma, prostate cancer, melanoma, ovarian cancer, and endometrial cancer and may become a novel therapeutic target (Aggarwal et al., 2012; Ramachandran et al., 2007; Park et al., 2008; Berenguer-Daizé et al., 2013; Chen et al., 2011; Deng et al., 2012; Oehler et al., 2001).

  8. In addition, currently one of the few studies supports the oncogenic role of cell division cycle-associated protein 4 (CDCA4) in tumors and nuclear factors induced as E2F transcription factor families that regulate E2F-dependent transcriptional activation and cell proliferation, but their potential mechanism, especially effects on PACA tumorigenesis and progression, requires further investigation (Fang et al., 2022; Hayashi et al., 2006).

  9. Transglutaminase 2 (TGM2), a promoter of stemness and radiotherapy resistance in glioma (Berg et al., 2021), has been confirmed in many studies to promote colorectal cancer progression via P53 and Wnt/β-catenin signaling pathways (Malkomes et al., 2021; Gu et al., 2019), as well as is associated with tumor-promoting inflammation in gastric cancer (Cho et al., 2020). These results are consistent with the TGM2 expression dramatically increased in the low AIDPS group with worse prognosis, suggesting that TGM2 may play an important role in the development and progression of PACA.

Funding Statement

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Contributor Information

Zaoqu Liu, Email: liuzaoqu@163.com.

Xinwei Han, Email: fcchanxw@zzu.edu.cn.

Yu-ling Sun, Email: ylsun@zzu.edu.cn.

Tony Ng, King's College London, United Kingdom.

Caigang Liu, Shengjing Hospital of China Medical University, China.

Funding Information

This paper was supported by the following grants:

  • National Natural Science Foundation of China 81870457 to Yu-ling Sun.

  • National Natural Science Foundation of China 82172944 to Yu-ling Sun.

Additional information

Competing interests

No competing interests declared.

No competing interests declared.

Author contributions

Data curation, Formal analysis, Validation, Investigation, Visualization, Writing – original draft.

Conceptualization, Resources, Software, Methodology, Project administration, Writing – review and editing.

Validation, Writing – review and editing.

Writing – review and editing.

Writing – review and editing.

Writing – review and editing.

Resources, Data curation, Writing – review and editing.

Resources, Data curation, Writing – review and editing.

Supervision, Writing – review and editing.

Supervision, Funding acquisition, Writing – review and editing.

Additional files

MDAR checklist

Data availability

Figure 1-source data 1, Figure 2-source data 1 and Figure 4-source data 1 contain the numerical data used to generate the figures.

The following previously published datasets were used:

Goldman MJ, Craft B, Hastie M. 2020. GDC TCGA Pancreatic Cancer (PAAD) The Cancer Genome Atlas. TCGA-PAAD

Zhang J, Bajari R, Andric D. 2019. exp_seq. PACA-AU. International Cancer Genome Consortium. PACA-AU-Seq

Zhang J, Bajari R, Andric D. 2019. exp_array. PACA-AU. International Cancer Genome Consortium. PACA-AU-Array

Zhang J, Bajari R, Andric D. 2019. exp_seq. PACA-CA. International Cancer Genome Consortium. PACA-CA-Seq

Puleo F, Nicolle R, Blum Y. 2018. mRNA profiling by array for pancreatic ductal adenocarcinoma for clinical application. ArrayExpress. E-MTAB-6134

Yang S, He P, Wang J. 2016. Microarray gene-expression profiles of 69 pancreatic tumors and 61 adjacent non-tumor tissue from patients with pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE62452

Zhang G, He P, Tan H. 2012. Microarray gene-expression profiles of 45 matching pairs of pancreatic tumor and adjacent non-tumor tissues from 45 patients with pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE28735

Wang J, Yang S, He P. 2017. Microarray gene-expression profiles of 50 pancreatic tumors tissue from patients with pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE78229

Kirby MK, Ramaker RC. 2016. RNA-sequencing of human pancreatic adenocarcinoma cancer tissues. NCBI Gene Expression Omnibus. GSE79668

Puleo F, Maréchal R, Demetter P. 2018. Patients with human resected pancreatic cancer. NCBI Gene Expression Omnibus. GSE85916

Stratford JK, Yeh JJ. 2010. A six-gene signature predicts survival of patients with localized pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE21501

Chen D, Malafa MP. 2015. Development of a prognostic gene signature in pancreatic cancer. NCBI Gene Expression Omnibus. GSE57495

Jen Jen Y. 2015. Virtual Microdissection of Pancreatic Ductal Adenocarcinoma Reveals Tumor and Stroma Subtypes. NCBI Gene Expression Omnibus. GSE71729

References

  1. Aggarwal G, Ramachandran V, Javeed N, Arumugam T, Dutta S, Klee GG, Klee EW, Smyrk TC, Bamlet W, Han JJ, Rumie Vittar NB, de Andrade M, Mukhopadhyay D, Petersen GM, Fernandez-Zapico ME, Logsdon CD, Chari ST. Adrenomedullin is up-regulated in patients with pancreatic cancer and causes insulin resistance in β cells and mice. Gastroenterology. 2012;143:1510–1517. doi: 10.1053/j.gastro.2012.08.044. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Alexandrov LB, Nik-Zainal S, Wedge DC, Aparicio SAJR, Behjati S, Biankin AV, Bignell GR, Bolli N, Borg A, Børresen-Dale A-L, Boyault S, Burkhardt B, Butler AP, Caldas C, Davies HR, Desmedt C, Eils R, Eyfjörd JE, Foekens JA, Greaves M, Hosoda F, Hutter B, Ilicic T, Imbeaud S, Imielinski M, Imielinsk M, Jäger N, Jones DTW, Jones D, Knappskog S, Kool M, Lakhani SR, López-Otín C, Martin S, Munshi NC, Nakamura H, Northcott PA, Pajic M, Papaemmanuil E, Paradiso A, Pearson JV, Puente XS, Raine K, Ramakrishna M, Richardson AL, Richter J, Rosenstiel P, Schlesner M, Schumacher TN, Span PN, Teague JW, Totoki Y, Tutt ANJ, Valdés-Mas R, van Buuren MM, van ’t Veer L, Vincent-Salomon A, Waddell N, Yates LR, Australian Pancreatic Cancer Genome Initiative. ICGC Breast Cancer Consortium. ICGC MMML-Seq Consortium. ICGC PedBrain. Zucman-Rossi J, Futreal PA, McDermott U, Lichter P, Meyerson M, Grimmond SM, Siebert R, Campo E, Shibata T, Pfister SM, Campbell PJ, Stratton MR. Signatures of mutational processes in human cancer. Nature. 2013;500:415–421. doi: 10.1038/nature12477. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Ali AI, Wang M, Scheidt B, Dominguez PM, Harrison AJ, Tantalo DGM, Kang J, Oliver AJ, Chan JD, Du X, Bai Y, Lee B, Johnstone RW, Darcy PK, Kershaw MH, Slaney CY. A histone deacetylase inhibitor, panobinostat, enhances chimeric antigen receptor T-cell antitumor effect against pancreatic cancer clinical cancer research. Clin Cancer Research. 2021;27:6222–6234. doi: 10.1158/1078-0432.CCR-21-1141. [DOI] [PubMed] [Google Scholar]
  4. Baker MJ, Goldstein AM, Gordon PL, Harbaugh KS, Mackley HB, Glantz MJ, Drabick JJ. An interstitial deletion within 9p21.3 and extending beyond CDKN2A predisposes to melanoma, neural system tumours and possible haematological malignancies. Journal of Medical Genetics. 2016;53:721–727. doi: 10.1136/jmedgenet-2015-103446. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Bear AS, Vonderheide RH, O’Hara MH. Challenges and opportunities for pancreatic cancer immunotherapy. Cancer Cell. 2020;38:788–802. doi: 10.1016/j.ccell.2020.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Berenguer-Daizé C, Boudouresque F, Bastide C, Tounsi A, Benyahia Z, Acunzo J, Dussault N, Delfino C, Baeza N, Daniel L, Cayol M, Rossi D, El Battari A, Bertin D, Mabrouk K, Martin P-M, Ouafik L. Adrenomedullin blockade suppresses growth of human hormone-independent prostate tumor xenograft in mice. Clinical Cancer Research. 2013;19:6138–6150. doi: 10.1158/1078-0432.CCR-13-0691. [DOI] [PubMed] [Google Scholar]
  7. Berg TJ, Marques C, Pantazopoulou V, Johansson E, von Stedingk K, Lindgren D, Jeannot P, Pietras EJ, Bergström T, Swartling FJ, Governa V, Bengzon J, Belting M, Axelson H, Squatrito M, Pietras A. The irradiated brain microenvironment supports glioma stemness and survival via astrocyte-derived transglutaminase 2. Cancer Research. 2021;81:2101–2115. doi: 10.1158/0008-5472.CAN-20-1785. [DOI] [PubMed] [Google Scholar]
  8. Billan S, Kaidar-Person O, Gil Z. Treatment after progression in the era of immunotherapy. The Lancet. Oncology. 2020;21:e463–e476. doi: 10.1016/S1470-2045(20)30328-4. [DOI] [PubMed] [Google Scholar]
  9. Borst J, Ahrends T, Bąbała N, Melief CJM, Kastenmüller W. Cd4+ T cell help in cancer immunology and immunotherapy. Nature Reviews Immunology. 2018;18:635–647. doi: 10.1038/s41577-018-0044-0. [DOI] [PubMed] [Google Scholar]
  10. Borte S, Meeths M, Liebscher I, Krist K, Nordenskjöld M, Hammarström L, von Döbeln U, Henter J-I, Bryceson YT. Combined newborn screening for familial hemophagocytic lymphohistiocytosis and severe T- and B-cell immunodeficiencies. The Journal of Allergy and Clinical Immunology. 2014;134:226–228. doi: 10.1016/j.jaci.2014.04.026. [DOI] [PubMed] [Google Scholar]
  11. Chen G, Wang H, Miller CT, Thomas DG, Gharib TG, Misek DE, Giordano TJ, Orringer MB, Hanash SM, Beer DG. Reduced selenium-binding protein 1 expression is associated with poor outcome in lung adenocarcinomas. The Journal of Pathology. 2004;202:321–329. doi: 10.1002/path.1524. [DOI] [PubMed] [Google Scholar]
  12. Chen P, Huang Y, Bong R, Ding Y, Song N, Wang X, Song X, Luo Y. Tumor-Associated macrophages promote angiogenesis and melanoma growth via adrenomedullin in a paracrine and autocrine manner. Clinical Cancer Research. 2011;17:7230–7239. doi: 10.1158/1078-0432.CCR-11-1354. [DOI] [PubMed] [Google Scholar]
  13. Chen S, He Z, Peng T, Zhou F, Wang G, Qian K, Ju L, Xiao Y, Wang X. Prr11 promotes ccrcc tumorigenesis by regulating E2F1 stability. JCI Insight. 2021;6:e145172. doi: 10.1172/jci.insight.145172. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Cho SY, Oh Y, Jeong EM, Park S, Lee D, Wang X, Zeng Q, Qin H, Hu F, Gong H, Liu X, Zhang G, Na D, Lee J, Chae J, Suh YS, Kong SH, Lee HJ, Kim JI, Park H. Amplification of transglutaminase 2 enhances tumor-promoting inflammation in gastric cancers experimental & molecular medicine. Nature. 2020;52:854–864. doi: 10.1038/s12276-020-0444-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Cichocki F, Schlums H, Li H, Stache V, Holmes T, Lenvik TR, Chiang SCC, Miller JS, Meeths M, Anderson SK, Bryceson YT. Transcriptional regulation of Munc13-4 expression in cytotoxic lymphocytes is disrupted by an intronic mutation associated with a primary immunodeficiency. The Journal of Experimental Medicine. 2014;211:1079–1091. doi: 10.1084/jem.20131131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. De Dosso S, Siebenhüner AR, Winder T, Meisel A, Fritsch R, Astaras C, Szturz P, Borner M. Treatment landscape of metastatic pancreatic cancer. Cancer Treatment Reviews. 2021;96:102180. doi: 10.1016/j.ctrv.2021.102180. [DOI] [PubMed] [Google Scholar]
  17. Deng B, Zhang S, Miao Y, Han Z, Zhang X, Wen F, Zhang Y. Adrenomedullin expression in epithelial ovarian cancers and promotes HO8910 cell migration associated with upregulating integrin α5β1 and phosphorylating FAK and paxillin. Journal of Experimental & Clinical Cancer Research. 2012;31:19. doi: 10.1186/1756-9966-31-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Deo RC. Machine learning in medicine circulation. Circulation. 2015;132:1920–1930. doi: 10.1161/CIRCULATIONAHA.115.001593. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Doebele RC, Drilon A, Paz-Ares L, Siena S, Shaw AT, Farago AF, Blakely CM, Seto T, Cho BC, Tosi D, Besse B, Chawla SP, Bazhenova L, Krauss JC, Chae YK, Barve M, Garrido-Laguna I, Liu SV, Conkling P, John T. Entrectinib in patients with advanced or metastatic NTRK fusion-positive solid tumours: integrated analysis of three phase 1-2 trials the lancet oncology. Lancet Oncology. 2020;21:271–282. doi: 10.1016/S1470-2045(19)30691-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Fang H, Sheng S, Chen B, Wang J, Mao D, Han Y, Liu Y, Wang X, Gui S, Zhang T, Zhang L, Li C, Hu X, Deng W, Liu X, Xu H, Xu W, Wang X, Liu R, Kong W. A pan-cancer analysis of the oncogenic role of cell division cycle-associated protein 4 (CDCA4) in human tumors. Frontiers in Immunology. 2022;13:826337. doi: 10.3389/fimmu.2022.826337. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Farooqui M, Bohrer LR, Brady NJ, Chuntova P, Kemp SE, Wardwell CT, Nelson AC, Schwertfeger KL. Epiregulin contributes to breast tumorigenesis through regulating matrix metalloproteinase 1 and promoting cell survival. Molecular Cancer. 2015;14:138. doi: 10.1186/s12943-015-0408-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Feng H, Lopez GY, Kim CK, Alvarez A, Duncan CG, Nishikawa R, Nagane M, Su A-JA, Auron PE, Hedberg ML, Wang L, Raizer JJ, Kessler JA, Parsa AT, Gao W-Q, Kim S-H, Minata M, Nakano I, Grandis JR, McLendon RE, Bigner DD, Lin H-K, Furnari FB, Cavenee WK, Hu B, Yan H, Cheng S-Y. Egfr phosphorylation of DCBLD2 recruits TRAF6 and stimulates AKT-promoted tumorigenesis. The Journal of Clinical Investigation. 2014;124:3741–3756. doi: 10.1172/JCI73093. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Ferrone CR, Kattan MW, Tomlinson JS, Thayer SP, Brennan MF, Warshaw AL. Validation of a postresection pancreatic adenocarcinoma nomogram for disease-specific survival. Journal of Clinical Oncology. 2005;23:7529–7535. doi: 10.1200/JCO.2005.01.8101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Golan T, Hammel P, Reni M, Van Cutsem E, Macarulla T, Hall MJ, Park JO, Hochhauser D, Arnold D, Oh DY, Reinacher-Schick A, Tortora G, Algül H, O’Reilly EM, McGuinness D, Cui KY, Schlienger K, Locker GY, Kindler HL. Maintenance olaparib for germline -mutated metastatic pancreatic cancer. The New England Journal of Medicine. 2019;381:317–327. doi: 10.1056/NEJMoa1903387. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Grady WM, Yu M, Markowitz SD. Epigenetic alterations in the gastrointestinal tract: current and emerging use for biomarkers of cancer. Gastroenterology. 2021;160:690–709. doi: 10.1053/j.gastro.2020.09.058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Gu C, Cai J, Xu Z, Zhou S, Ye L, Yan Q, Zhang Y, Fang Y, Liu Y, Tu C, Wang X, He J, Li Q, Han L, Lin X, Li A, Liu S. MiR-532-3p suppresses colorectal cancer progression by disrupting the ETS1/TGM2 axis-mediated wnt/β-catenin signaling. Cell Death & Disease. 2019;10:739. doi: 10.1038/s41419-019-1962-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Hashimoto S, Furukawa S, Hashimoto A, Tsutaho A, Fukao A, Sakamura Y, Parajuli G, Onodera Y, Otsuka Y, Handa H, Oikawa T, Hata S, Nishikawa Y, Mizukami Y, Kodama Y, Murakami M, Fujiwara T, Hirano S, Sabe H. ARF6 and AMAP1 are major targets of and mutations to promote invasion PD-L1 dynamics, and immune evasion of pancreatic cancer. PNAS. 2019;116:17450. doi: 10.1073/pnas.1901765116. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Hayashi R, Goto Y, Ikeda R, Yokoyama KK, Yoshida K. CDCA4 is an E2F transcription factor family-induced nuclear factor that regulates E2F-dependent transcriptional activation and cell proliferation. The Journal of Biological Chemistry. 2006;281:35633–35648. doi: 10.1074/jbc.M603800200. [DOI] [PubMed] [Google Scholar]
  29. He M, Jin Q, Chen C, Liu Y, Ye X, Jiang Y, Ji F, Qian H, Gan D, Yue S, Zhu W, Chen T. The mir-186-3p/EREG axis orchestrates tamoxifen resistance and aerobic glycolysis in breast cancer cells. Oncogene. 2019;38:5551–5565. doi: 10.1038/s41388-019-0817-3. [DOI] [PubMed] [Google Scholar]
  30. Hofsli E, Wheeler TE, Langaas M, Laegreid A, Thommesen L. Identification of novel neuroendocrine-specific tumour genes. British Journal of Cancer. 2008;99:1330–1339. doi: 10.1038/sj.bjc.6604565. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Hoshida Y, Brunet JP, Tamayo P, Golub TR, Mesirov JP. Subclass mapping: identifying common subtypes in independent disease data sets. PLOS ONE. 2007;2:18030330. doi: 10.1371/journal.pone.0001195. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Hu C, Hart SN, Polley EC, Gnanaolivu R, Shimelis H, Lee KY, Lilyquist J, Na J, Moore R, Antwi SO, Bamlet WR, Chaffee KG, DiCarlo J, Wu Z, Samara R, Kasi PM, McWilliams RR, Petersen GM, Couch FJ. Association between inherited germline mutations in cancer predisposition genes and risk of pancreatic cancer. JAMA. 2018;319:2401–2409. doi: 10.1001/jama.2018.6228. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Jiang P, Gu S, Pan D, Fu J, Sahu A, Hu X, Li Z, Traugh N, Bu X, Li B, Liu J, Freeman GJ, Brown MA, Wucherpfennig KW, Liu XS. Signatures of T cell dysfunction and exclusion predict cancer immunotherapy response. Nature Medicine. 2018;24:1550–1558. doi: 10.1038/s41591-018-0136-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Jonkers YMH, Claessen SMH, Feuth T, van Kessel AG, Ramaekers FCS, Veltman JA, Speel E-JM. Novel candidate tumour suppressor gene loci on chromosomes 11q23-24 and 22q13 involved in human insulinoma tumourigenesis. The Journal of Pathology. 2006;210:450–458. doi: 10.1002/path.2072. [DOI] [PubMed] [Google Scholar]
  35. Katz MHG, Hwang R, Fleming JB, Evans DB. Tumor-node-metastasis staging of pancreatic adenocarcinoma. CA. 2008;58:111–125. doi: 10.3322/CA.2007.0012. [DOI] [PubMed] [Google Scholar]
  36. Le DT, Durham JN, Smith KN, Wang H, Bartlett BR, Aulakh LK, Lu S, Kemberling H, Wilt C, Luber BS, Wong F, Azad NS, Rucki AA, Laheru D, Donehower R, Zaheer A, Fisher GA, Crocenzi TS, Lee JJ, Greten TF, Duffy AG, Ciombor KK, Eyring AD, Lam BH, Joe A, Kang SP, Holdhoff M, Danilova L, Cope L, Meyer C, Zhou S, Goldberg RM, Armstrong DK, Bever KM, Fader AN, Taube J, Housseau F, Spetzler D, Xiao N, Pardoll DM, Papadopoulos N, Kinzler KW, Eshleman JR, Vogelstein B, Anders RA, Diaz LA., Jr Mismatch repair deficiency predicts response of solid tumors to PD-1 blockade. Science. 2017;357:409–413. doi: 10.1126/science.aan6733. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Lee KM, Guerrero-Zotano AL, Servetto A, Sudhan DR, Lin CC, Formisano L, Jansen VM, González-Ericsson P, Sanders ME, Stricker TP, Raj G, Dean KM, Fiolka R, Cantley LC, Hanker AB, Arteaga CL. Proline rich 11 (PRR11) overexpression amplifies PI3K signaling and promotes antiestrogen resistance in breast cancer. Nature Communications. 2020;11:5488. doi: 10.1038/s41467-020-19291-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Liu Z, Liu L, Lu T, Wang L, Li Z, Jiao D, Han X. Hypoxia molecular characterization in hepatocellular carcinoma identifies one risk signature and two nomograms for clinical management. Journal of Oncology. 2021a;2021:6664386. doi: 10.1155/2021/6664386. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Liu Z, Lu T, Li J, Wang L, Xu K, Dang Q, Liu L, Guo C, Jiao D, Sun Z, Han X. Clinical significance and inflammatory landscape of anovel recurrence-associated immune signature in stage II/III colorectal cancer. Frontiers in Immunology. 2021b;12:702594. doi: 10.3389/fimmu.2021.702594. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Liu Z, Wang L, Liu L, Lu T, Jiao D, Sun Y, Han X. The identification and validation of two heterogenous subtypes and a risk signature based on ferroptosis in hepatocellular carcinoma. Frontiers in Oncology. 2021c;11:619242. doi: 10.3389/fonc.2021.619242. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Liu Z. AIDPS. swh:1:rev:f9d929456fa9f0cd7721cea6a5e2a1412ffae4a7Software Heritage. 2022 https://archive.softwareheritage.org/swh:1:dir:41e9535fdc99b12dbf6bcec81c7c6c313287b78e;origin=https://github.com/Zaoqu-Liu/AIDPS;visit=swh:1:snp:2a2e205b2ccb604faea2a739d88bcab9e10d9b08;anchor=swh:1:rev:f9d929456fa9f0cd7721cea6a5e2a1412ffae4a7
  42. Liu Z, Guo C, Dang Q, Wang L, Liu L, Weng S, Xu H, Lu T, Sun Z, Han X. Integrative analysis from multi-center studies identities a consensus machine learning-derived lncrna signature for stage II/III colorectal cancer. EBioMedicine. 2022a;75:103750. doi: 10.1016/j.ebiom.2021.103750. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Liu Z, Liu L, Weng S, Guo C, Dang Q, Xu H, Wang L, Lu T, Zhang Y, Sun Z, Han X. Machine learning-based integration develops an immune-derived lncrna signature for improving outcomes in colorectal cancer. Nature Communications. 2022b;13:816. doi: 10.1038/s41467-022-28421-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Liu X, Wang W, Liu X, Zhang Z, Yu L, Li R, Guo D, Cai W, Quan X, Wu H, Dai M, Liang Z. Multi-omics analysis of intra-tumoural and inter-tumoural heterogeneity in pancreatic ductal adenocarcinoma. Clinical and Translational Medicine. 2022c;12:e670. doi: 10.1002/ctm2.670. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Lu X, Meng J, Su L, Jiang L, Wang H, Zhu J, Huang M, Cheng W, Xu L, Ruan X, Yeh S, Liang C, Yan F. Multi-Omics consensus ensemble refines the classification of muscle-invasive bladder cancer with stratified prognosis, tumour microenvironment and distinct sensitivity to frontline therapies. Clinical and Translational Medicine. 2021;11:e601. doi: 10.1002/ctm2.601. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Malkomes P, Lunger I, Oppermann E, Abou-El-Ardat K, Oellerich T, Günther S, Canbulat C, Bothur S, Schnütgen F, Yu W, Wingert S, Haetscher N, Catapano C, Dietz MS, Heilemann M, Kvasnicka HM, Holzer K, Serve H, Bechstein WO, Rieger MA. Transglutaminase 2 promotes tumorigenicity of colon cancer cells by inactivation of the tumor suppressor p53. Oncogene. 2021;40:4352–4367. doi: 10.1038/s41388-021-01847-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Malta TM, Sokolov A, Gentles AJ, Burzykowski T, Poisson L, Weinstein JN, Kamińska B, Huelsken J, Omberg L, Gevaert O, Colaprico A, Czerwińska P, Mazurek S, Mishra L, Heyn H, Krasnitz A, Godwin AK, Lazar AJ, Cancer Genome Atlas Research Network. Stuart JM, Hoadley KA, Laird PW, Noushmehr H, Wiznerowicz M. Machine learning identifies stemness features associated with oncogenic dedifferentiation. Cell. 2018;173:338–354. doi: 10.1016/j.cell.2018.03.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Meeths M, Chiang SCC, Wood SM, Entesarian M, Schlums H, Bang B, Nordenskjöld E, Björklund C, Jakovljevic G, Jazbec J, Hasle H, Holmqvist B-M, Rajic L, Pfeifer S, Rosthøj S, Sabel M, Salmi TT, Stokland T, Winiarski J, Ljunggren H-G, Fadeel B, Nordenskjöld M, Henter J-I, Bryceson YT. Familial hemophagocytic lymphohistiocytosis type 3 (FHL3) caused by deep intronic mutation and inversion in UNC13D. Blood. 2011;118:5783–5793. doi: 10.1182/blood-2011-07-369090. [DOI] [PubMed] [Google Scholar]
  49. Mizrahi JD, Surana R, Valle JW, Shroff RT. Pancreatic cancer. Lancet. 2020;395:2008–2020. doi: 10.1016/S0140-6736(20)30974-0. [DOI] [PubMed] [Google Scholar]
  50. Morikawa A, Hayashi T, Kobayashi M, Kato Y, Shirahige K, Itoh T, Urashima M, Okamoto A, Akiyama T. Somatic copy number alterations have prognostic impact in patients with ovarian clear cell carcinoma. Oncology Reports. 2018;40:309–318. doi: 10.3892/or.2018.6419. [DOI] [PubMed] [Google Scholar]
  51. Neufert C, Becker C, Türeci Ö, Waldner MJ, Backert I, Floh K, Atreya I, Leppkes M, Jefremow A, Vieth M, Schneider-Stock R, Klinger P, Greten FR, Threadgill DW, Sahin U, Neurath MF. Tumor fibroblast-derived epiregulin promotes growth of colitis-associated neoplasms through ERK. The Journal of Clinical Investigation. 2013;123:1428–1443. doi: 10.1172/JCI63748. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Oehler MK, Norbury C, Hague S, Rees MC, Bicknell R. Adrenomedullin inhibits hypoxic cell death by upregulation of Bcl-2 in endometrial cancer cells: a possible promotion mechanism for tumour growth. Oncogene. 2001;20:2937–2945. doi: 10.1038/sj.onc.1204422. [DOI] [PubMed] [Google Scholar]
  53. O’Hara MH, O’Reilly EM, Varadhachary G, Wolff RA, Wainberg ZA, Ko AH, Fisher G, Rahma O, Lyman JP, Cabanski CR, Mick R, Gherardini PF, Kitch LJ, Xu J, Samuel T, Karakunnel J, Fairchild J, Bucktrout S, LaVallee TM, Selinsky C, Till JE, Carpenter EL, Alanio C, Byrne KT, Chen RO, Trifan OC, Dugan U, Horak C, Hubbard-Lucey VM, Wherry EJ, Ibrahim R, Vonderheide RH. CD40 agonistic monoclonal antibody APX005M (sotigalimab) and chemotherapy, with or without nivolumab, for the treatment of metastatic pancreatic adenocarcinoma: an open-label, multicentre, phase 1b study. The Lancet. Oncology. 2021;22:118–131. doi: 10.1016/S1470-2045(20)30532-5. [DOI] [PubMed] [Google Scholar]
  54. Park SC, Yoon JH, Lee JH, Yu SJ, Myung SJ, Kim W, Gwak GY, Lee SH, Lee SM, Jang JJ, Suh KS, Lee HS. Hypoxia-Inducible adrenomedullin accelerates hepatocellular carcinoma cell growth. Cancer Letters. 2008;271:314–322. doi: 10.1016/j.canlet.2008.06.019. [DOI] [PubMed] [Google Scholar]
  55. Park W, Chawla A, O’Reilly EM. Pancreatic cancer. JAMA. 2021;326:851. doi: 10.1001/jama.2021.13027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Ramachandran V, Arumugam T, Hwang RF, Greenson JK, Simeone DM, Logsdon CD. Adrenomedullin is expressed in pancreatic cancer and stimulates cell proliferation and invasion in an autocrine manner via the adrenomedullin receptor, ADMR. Cancer Research. 2007;67:2666–2675. doi: 10.1158/0008-5472.CAN-06-3362. [DOI] [PubMed] [Google Scholar]
  57. Sanchez-Vega F, Mina M, Armenia J, Chatila WK, Luna A, La KC, Dimitriadoy S, Liu DL, Kantheti HS, Saghafinia S, Chakravarty D, Daian F, Gao Q, Bailey MH, Liang W-W, Foltz SM, Shmulevich I, Ding L, Heins Z, Ochoa A, Gross B, Gao J, Zhang H, Kundra R, Kandoth C, Bahceci I, Dervishi L, Dogrusoz U, Zhou W, Shen H, Laird PW, Way GP, Greene CS, Liang H, Xiao Y, Wang C, Iavarone A, Berger AH, Bivona TG, Lazar AJ, Hammer GD, Giordano T, Kwong LN, McArthur G, Huang C, Tward AD, Frederick MJ, McCormick F, Meyerson M, Cancer Genome Atlas Research Network. Van Allen EM, Cherniack AD, Ciriello G, Sander C, Schultz N. Oncogenic signaling pathways in the cancer genome atlas. Cell. 2018;173:321–337. doi: 10.1016/j.cell.2018.03.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Sandhu V, Wedge DC, Bowitz Lothe IM, Labori KJ, Dentro SC, Buanes T, Skrede ML, Dalsgaard AM, Munthe E, Myklebost O, Lingjærde OC, Børresen-Dale AL, Ikdahl T, Van Loo P, Nord S, Kure EH. The genomic landscape of pancreatic and periampullary adenocarcinoma. Cancer Research. 2016;76:5092–5102. doi: 10.1158/0008-5472.CAN-16-0658. [DOI] [PubMed] [Google Scholar]
  59. Sha D, Jin Z, Budczies J, Kluck K, Stenzinger A, Sinicrope FA. Tumor mutational burden as a predictive biomarker in solid tumors. Cancer Discovery. 2020;10:1808–1825. doi: 10.1158/2159-8290.CD-20-0522. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Siegel RL, Miller KD, Fuchs HE, Jemal A. Cancer statistics, 2022. CA. 2022;72:7–33. doi: 10.3322/caac.21708. [DOI] [PubMed] [Google Scholar]
  61. Silvers AL, Lin L, Bass AJ, Chen G, Wang Z, Thomas DG, Lin J, Giordano TJ, Orringer MB, Beer DG, Chang AC. Decreased selenium-binding protein 1 in esophageal adenocarcinoma results from posttranscriptional and epigenetic regulation and affects chemosensitivity. Clinical Cancer Research. 2010;16:2009–2021. doi: 10.1158/1078-0432.CCR-09-2801. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Smyth EC, Khan K, Cunningham D. AREG and EREG as predictive biomarkers for Ras wild-type colorectal cancer treated with panitumumab: a fresh approach to an old puzzle. JAMA Oncology. 2016;2:578–579. doi: 10.1001/jamaoncol.2015.6274. [DOI] [PubMed] [Google Scholar]
  63. Spessott WA, Sanmillan ML, McCormick ME, Patel N, Villanueva J, Zhang K, Nichols KE, Giraudo CG. Hemophagocytic lymphohistiocytosis caused by dominant-negative mutations in STXBP2 that inhibit SNARE-mediated membrane fusion. Blood. 2015;125:1566–1577. doi: 10.1182/blood-2014-11-610816. [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Subramanian A, Narayan R, Corsello SM, Peck DD, Natoli TE, Lu X, Gould J, Davis JF, Tubelli AA, Asiedu JK, Lahr DL, Hirschman JE, Liu Z, Donahue M, Julian B, Khan M, Wadden D, Smith IC, Lam D, Liberzon A, Toder C, Bagul M, Orzechowski M, Enache OM, Piccioni F, Johnson SA, Lyons NJ, Berger AH, Shamji AF, Brooks AN, Vrcic A, Flynn C, Rosains J, Takeda DY, Hu R, Davison D, Lamb J, Ardlie K, Hogstrom L, Greenside P, Gray NS, Clemons PA, Silver S, Wu X, Zhao WN, Read-Button W, Wu X, Haggarty SJ, Ronco LV, Boehm JS, Schreiber SL, Doench JG, Bittker JA, Root DE, Wong B, Golub TR. A next generation connectivity map: L1000 platform and the first 1,000,000 profiles. Cell. 2017;171:1437–1452. doi: 10.1016/j.cell.2017.10.049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Tan Z, Lei Y, Xu J, Shi S, Hua J, Zhang B, Meng Q, Liu J, Zhang Y, Wei M, Yu X, Liang C. The value of a metabolic reprogramming-related gene signature for pancreatic adenocarcinoma prognosis prediction. Aging. 2020;12:24228–24241. doi: 10.18632/aging.104134. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Thomaidis T, Maderer A, Formentini A, Bauer S, Trautmann M, Schwarz M, Neumann W, Kittner JM, Schad A, Link KH, Rey JW, Weinmann A, Hoffman A, Galle PR, Kornmann M, Moehler M. Proteins of the VEGFR and EGFR pathway as predictive markers for adjuvant treatment in patients with stage II/III colorectal cancer: results of the FOGT-4 trial. Journal of Experimental & Clinical Cancer Research. 2014;33:83. doi: 10.1186/s13046-014-0083-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Van de nes JP, Koelsche C, Gessi M, Möller I, Sucker A, Scolyer RA, Buckland ME, Pietsch T, Murali R, Schadendorf D, Griewank KG. Activating CYSLTR2 and PLCB4 mutations in. Primary Leptomeningeal Melanocytic Tumors The Journal of Investigative Dermatology. 2017;137:2033–2035. doi: 10.1016/j.jid.2017.04.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  68. Wang G, Niu X, Zhang W, Caldwell JT, Edwards H, Chen W, Taub JW, Zhao L, Ge Y. Synergistic antitumor interactions between MK-1775 and panobinostat in preclinical models of pancreatic cancer. Cancer Letters. 2015;356:656–668. doi: 10.1016/j.canlet.2014.10.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  69. Wang L, Liu Z, Zhu R, Liang R, Wang W, Li J, Zhang Y, Guo C, Han X, Sun Y. Multi-omics landscape and clinical significance of a smad4-driven immune signature: implications for risk stratification and frontline therapies in pancreatic cancer. Computational and Structural Biotechnology Journal. 2022;20:1154–1167. doi: 10.1016/j.csbj.2022.02.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Wattenberg MM, Asch D, Yu S, O’Dwyer PJ, Domchek SM, Nathanson KL, Rosen MA, Beatty GL, Siegelman ES, Reiss KA. Platinum response characteristics of patients with pancreatic ductal adenocarcinoma and a germline BRCA1, BRCA2 or PALB2 mutation. British Journal of Cancer. 2020;122:333–339. doi: 10.1038/s41416-019-0582-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. Wei Z, Wang R, Yin X, Zhang L, Lei Y, Zhang Y, Li Y, Wu J, Bu Y, Jin G, Zhang C. Prr11 induces filopodia formation and promotes cell motility via recruiting Arp2/3 complex in non-small cell lung cancer cells. Genes & Diseases. 2022;9:230–244. doi: 10.1016/j.gendis.2021.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  72. Wu F, Zhang W, Shao H, Bo H, Shen H, Li J, Liu Y, Wang T, Ma W, Huang S. Human effector T cells derived from central memory cells rather than CD8 (+) T cells modified by tumor-specific TCR gene transfer possess superior traits for adoptive immunotherapy. Cancer Letters. 2013;339:195–207. doi: 10.1016/j.canlet.2013.06.009. [DOI] [PubMed] [Google Scholar]
  73. Yang C, Huang X, Li Y, Chen J, Lv Y, Dai S. Prognosis and personalized treatment prediction in TP53-mutant hepatocellular carcinoma. An in Silico Strategy towards Precision Oncology Briefings In Bioinformatics. 2021;22:164. doi: 10.1093/bib/bbaa164. [DOI] [PubMed] [Google Scholar]
  74. Yokoyama S, Hamada T, Higashi M, Matsuo K, Maemura K, Kurahara H, Horinouchi M, Hiraki T, Sugimoto T, Akahane T, Yonezawa S, Kornmann M, Batra SK, Hollingsworth MA, Tanimoto A. Predicted prognosis of patients with pancreatic cancer by machine learning clinical cancer research. Cancer Research. 2020;26:2411–2421. doi: 10.1158/1078-0432.CCR-19-1247. [DOI] [PubMed] [Google Scholar]
  75. Yuan Q, Ren J, Li L, Li S, Xiang K, Shang D. Development and validation of a novel N6-methyladenosine (m6a)-related multi- long non-coding RNA (lncrna) prognostic signature in pancreatic adenocarcinoma. Bioengineered. 2021;12:2432–2448. doi: 10.1080/21655979.2021.1933868. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Zhang L, Lei Y, Zhang Y, Li Y, Bu Y, Song F, Zhang C. Silencing of PRR11 suppresses cell proliferation and induces autophagy in NSCLC cells. Genes & Diseases. 2018;5:158–166. doi: 10.1016/j.gendis.2017.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  77. Zhang C, Zhang Z, Zhang G, Zhang Z, Luo Y, Wang F, Wang S, Che Y, Zeng Q, Sun N, He J. Clinical significance and inflammatory landscapes of a novel recurrence-associated immune signature in early-stage lung adenocarcinoma. Cancer Letters. 2020;479:31–41. doi: 10.1016/j.canlet.2020.03.016. [DOI] [PubMed] [Google Scholar]

Editor's evaluation

Tony Ng 1

This work sets out to develop a better machine learning-based predictor of survival/prognosis for patients diagnosed with pancreatic cancer. To achieve this, the authors developed a large combinatorial family of machine learning methods based on a high-dimensional set of -omics and other patient data features; using ten publicly available data sets. By finding the combined ML method(s) that performed best on the task, the authors were able to identify a reduced set of features (giving rise to a signature called AIDPS that involves 9 genes) which, when measured in the patient, allow for fairly accurate prediction of patient survival and prognosis. Importantly, three new external data sets GSE21501, GSE57495, GSE71729 were used in the validation.

Decision letter

Editor: Tony Ng1
Reviewed by: Anthony CC Coolen2

Our editorial process produces two outputs: i) public reviews designed to be posted alongside the preprint for the benefit of readers; ii) feedback on the manuscript for the authors, including requests for revisions, shown below. We also include an acceptance summary that explains what the editors found interesting or important about the work.

Decision letter after peer review:

Thank you for submitting your article "Comprehensive machine-learning survival framework develop a consensus model in large scale multi-center cohorts for pancreatic cancer" for consideration by eLife. Your article has been reviewed by 3 peer reviewers, and the evaluation has been overseen by Caigang Liu as the Senior Editor. The following individual involved in the review of your submission has agreed to reveal their identity: Anthony C C Coolen (Reviewer #2).

The reviewers have discussed their reviews with one another, and the Reviewing Editor has drafted this to help you prepare a revised submission.

Essential revisions:

1. The authors should repeat their complete pipeline after randomizing within each of their ten data sets the clinical outcomes (i.e. shuffle the time-to-event outcomes). If one would obtain again a signature with comparable prognostic features, then one can be sure that what is reported here is largely a manifestation of overfitting due to dimension mismatch, and hence of no interest.

2. The authors should provide a better understanding of why agreement/optimization amongst a large number of combined ML methods was chosen as a way to drive feature selection. Comparing to existing methods is one thing, currently, there isn't really a clear comparison here to other feature selection approaches.

3. The authors should provide a thorough explanation of the biological relevance of the 9 genes in relation to the mutational load/copy number changes/ immunological infiltration found in low AIDPS patients.

Reviewer #1 (Recommendations for the authors):

Things I think would strengthen the paper:

1. A better understanding of why agreement/optimization amongst a large number of combined ML methods was chosen as a way to drive feature selection. Comparing to existing methods is one thing, but there isn't really a clear comparison here to other feature selection approaches, nor much discussion of why this one was chosen. Is this meant to be a reproducible approach, for other problems, or is the point just to get the AIDPS features? Why is this approach to feature selection preferred/superior.

2. Right now the current pipeline seems highly unwieldy because of all the models considered. Is this meant to be a general and reproducible approach? if so, the authors need to demonstrate more clearly that this same approach can be done by others with ease.

3. Everything in the subsequent analyses comparing high and low AIDPS groups hinges on the assumed accuracy and generality of the model. Once you have 9 genes, though, you should be able to study those features using a range of methods, some of which are picked to have high interpretability. I am sorry if I missed this, but at the moment it is not clear to me what best an ML method can do is using the 9 genes, and whether there is an interpretable method that works well but might imply a non-trivial relationship amongst the genes that matters to the outcome. This seems more informative than studying the statistics of high and low AIDPS groups

Reviewer #2 (Recommendations for the authors):

To rescue their claims one could suggest to the authors the following simple but clean and fair test. The authors could repeat their complete pipeline after randomizing within each of their ten data sets the clinical outcomes (i.e. shuffle the time-to-event outcomes). If that exercise is found to make the signal disappear (i.e. the separation of KM curves, and the nontrivial AUROC values), then their present results should be studied further as possibly relevant. If, on the contrary, one would obtain again a signature with comparable prognostic features, then one can be sure that what is reported here is largely a manifestation of overfitting due to dimension mismatch, and hence of no interest.

Reviewer #3 (Recommendation for the authors):

From the biological point of view, currently, there was little explanation of the biological relevance of the 9 genes in relation to the mutational load/copy number changes/ immunological infiltration found in low AIDPS patients. Please discuss these in sufficient detail.

[Editors' note: further revisions were suggested prior to acceptance, as described below.]

Thank you for resubmitting your work entitled "Comprehensive machine-learning survival framework develop a consensus model in large scale multi-center cohorts for pancreatic cancer" for further consideration by eLife. Your revised article has been evaluated by Caigang Liu (Senior Editor) and a Reviewing Editor.

The manuscript has been improved but there are some remaining issues that need to be addressed, as outlined below:

1. The improvements to figure 7 (in the supplementary figures linked to Figure 7) meant to address Reviewer #1's request seem to all focus on treating the aidps features separately. Please show the accuracy when these aidps features are considered together as a nine dimensional feature vector in one model.

2. For reviewer #2, please remove the newly added material called `performance of AIDPS in randomly split cohorts', as this adds nothing relevant (as it s again testing on discovery data). Please take out all mentioning of `validation' or `validated' from the manuscript, other than when discussing the tests on the three new data sets GSE21501, GSE57495, GSE71729; only the latter can be called validation sets. Please compare the performance of existing signatures to that of the authors' own signature on the three new data sets GSE21501, GSE57495, GSE71729.

The main reason for this suggestion is that the revised manuscript still tests their own signature on discovery data but that of the competitors on unseen data, which is not a fair comparison. Unless the authors remedy this they should (i) remove all mentioning of superior performance of their signature (since the comparison did not involve a level paying field) and (ii) remove all mentioning of `validation' other than in relation to the three new data sets.

3. Please include (4. Current research progress on these nine AIDPS genes) in the rebuttal, which is a summary of what is known about the biological function of the nine genes, as an Appendix or Supplementary information in the manuscript.

Reviewer #1 (Recommendations for the authors):

The authors have largely addressed the concerns raised in my previous review. As best I can tell, they have not yet shown how a simple ML model (such as linear regression or xgboost) performs on the same task when only fed with the 9 aidps features simultaneously. The improvements to figure 7 meant to address my request seem to all focus on treating the aidps features separately, so it useful to know they perform poorly when separate… what about when they are considered together as a nine dimensional feature vector in one model?

Reviewer #2 (Recommendations for the authors):

In my first report I put forward two points. First, that the authors used the same data sets both in the discovery stage and the validation stage. Second, that they compared the performance of competitor signatures to theirs by using these same data. This has the following consequences: 1. They could not claim that their signature had been validated, because what they called validation data were in fact the discovery data (the potential impact of overfitting is hence unclear). 2. The comparison between their signature and the existing ones was not fair (their own signature was tested on its corresponding discovery data, but the competitors' signatures on what for those signatures would be independent validation data). Therefore, all claims on their signature having been validated and on it being superior to existing signatures were not supported by the available evidence. I also suggested that they could test for overfitting impact by repeating their previous analyses step by step with outcome-randomized versions of the original data. This should make all true signals disappear and is hence a clean and fair test.

In the revised version of their manuscript the authors did not carry out the requested re-analysis with outcome-randomized data. Instead they (a) sampled several new data sets from their original data (without outcome randomization), and (b) tested their signature on three independent new data sets. Exercise (a) seems pointless; of course the signature would again be able to predict, since one is testing it once more on samples from the discovery set. Exercise (b), although not what was requested by this referee, is more useful. Here the authors report again significant performance of their signature, with AUC values in the range 0.68-0.70, lending weight to the suggestion that their signature makes sense.

I conclude from the authors' reply and from the new version of the paper that point 1. above has been partly addressed, but not point 2. If the authors, as it seems, do not wish to carry out the requested analysis with outcome randomization, then they have the following options:

Option A;

– Remove the newly added material called `performance of AIDPS in randomly split cohorts', this adds nothing relevant (see my notes above, it is again testing performance on discovery data).

– Take out all mentioning of `validation' or `validated' from the manuscript, other than when discussing the tests on the three new data sets GSE21501, GSE57495, GSE71729; only the latter can be called validation sets.

– Remove all performance comparisons between the new signature and the existing ones (since this comparison is presently not fair) and all conclusions based on these comparisons.

Option B:

– Remove the newly added material called `performance of AIDPS in randomly split cohorts', this adds nothing relevant (see my notes above, it is again testing on discovery data).

– Take out all mentioning of `validation' or `validated' from the manuscript, other than when discussing the tests on the three new data sets GSE21501, GSE57495, GSE71729; only the latter can be called validation sets.

– Compare the performance of existing signatures to that of their own signature on the three new data sets GSE21501, GSE57495, GSE71729; this comparison would be fair.

I would personally strongly suggest option B, since otherwise the paper would in my view be too weak in terms of the amount of justified conclusions to warrant publication (but that is a decision for the editor to make). In addition, I would still hope that the authors choose to comply with my original request for application of the full pipeline to outcome-randomized discovery data. This would clarify objectively, for the authors' own benefit, the extent to which their original tests and conclusions may have been affected by overfitting.

Reviewer #3 (Recommendations for the authors):

The authors have addressed my comments. I find the following v useful as a summary of what is known about the biological function of the nine genes and wonder if it can be incorporated as an Appendix or Supplementary information:

"The nine AIDPS genes were rarely studied in tumors, most of which focused on their roles in biological phenotypes such as tumorigenesis and progression, and few studies investigated their roles and guiding significance in PACA immune microenvironment and treatment. Specifically, we found that SELENBP1 owned lower expression in the low AIDPS group with poor prognosis was associated with better tumor prognosis, and its decreased expression resulted in poor prognosis of many tumors such as lung adenocarcinoma. Meanwhile, DCBLD2, PRR11, EREG, ADM and TGM2, which were overexpressed in the low AIDPS group, played an essential role in the proliferation, invasion and metastasis of many tumors such as PACA, hepatocellular carcinoma and colorectal cancer, and lead to their chemotherapy resistance and were potential targets for enhanced efficacy. However, the functional roles and mechanisms of UNC13D and CDCA4 in tumors are not well understood, and more high-quality studies are needed in the future. These findings are consistent with our study, and the specific functional characteristics are summarized as follows:

1. SELENBP1, encoding a novel human methanethiol oxidase, whose expression is significantly decreased in the progression of Barrett's esophagus to adenocarcinoma and can affect chemotherapy sensitivity (PMID: 20332323). This is consistent with our results that SELENBP1 expression was decreased in the low AIDPS group with worse prognosis (Figure 7—figure supplement 3).

2. PLCB4 encodes a phospholipase, and activating PLCB4 mutation was recently identified in primary leptomeningeal melanocytic tumors (PMID: 28499758).

3. DCBLD2 is upregulated in glioblastoma and head and neck cancer, and phosphorylation of DCBLD2 Y750 activates AKT pathway which in turn enhances EGFR-driven tumorigenesis (PMID: 25061874). DCBLD2 has also been found to play a crucial role in the invasion, progression, and metastasis of neuroendocrine tumors (PMID: 18827820). These results are consistent with an increased expression of DCBLD2 in the low AIDPS group with a dismal prognosis.

4. Proline-rich protein 11 (PRR11) is a novel tumor-related gene, which has been found can promote breast cancer growth and anti-estrogen resistance through the PI3K pathway (PMID: 33127913). In addition, it has also been demonstrated that PRR11 affects autophagy and promotes proliferation in non-small cell lung cancer (NSCLC) through the Akt/mTOR pathway (PMID: 30258945; 35005120), and recent studies have also found that PRR11 can promote the tumorigenesis and progression of renal clear cell carcinoma (ccRCC) by regulating E2F1 stability (PMID: 34499617). Overall, these results are consistent with higher expression of PRR11 in the low AIDPS group with a worse prognosis.

5. UNC13D mutation play an essential role in familial hemophagocytic lymphohistiocytosis (FHL), but its role in tumors remains unknown and needs to be further explored (PMID: 21931115; 24842371; 25564401; 24882743).

6. EREG, as an EGFR ligand epithelial regulatory protein, plays a fundamental role in the growth and proliferation of breast and colorectal cancers (PMID: 26215578; 23549083) and is associated with tamoxifen resistance in breast cancer (PMID: 30967627) and efficacy of panitumumab and adjuvant chemotherapy in colorectal cancer (PMID: 26869404; 25272957).

7. Adrenomedullin (ADM) encodes a pre-prohormone that is cleaved into two bioactive peptides, which can dilate blood vessels, regulate hormone secretion, and promoting angiogenesis. Many studies have confirmed that ADM plays a major role in the proliferation, invasion, angiogenesis, and metastasis of PACA, hepatocellular carcinoma, prostate cancer, melanoma, ovarian cancer, and endometrial cancer and may become a novel therapeutic target (PMID: 22960655; 17363587; 18657357; 24100627; 21994414; 22400488; 11420706).

8. In addition, currently one of the few studies support the oncogenic role of cell division cycle associated protein 4 (CDCA4) in tumors and nuclear factors induced as E2F transcription factor families that regulate E2F-dependent transcriptional activation and cell proliferation, but their potential mechanism, especially effect on PACA tumorigenesis and progression require further investigation (PMID: 35251007; 16984923).

9. Transglutaminase 2 (TGM2), a promoter of stemness and radiotherapy resistance in glioma (PMID: 33483373), has been confirmed in many studies to promote colorectal cancer progression via P53 and Wnt/β-catenin signaling pathways (PMID: 34103685; 31570702), as well as is associated with tumor-promoting inflammation in gastric cancer (PMID: 32467608). These results are consistent with the TGM2 expression dramatically increased in the low AIDPS group with worse prognosis, suggesting that TGM2 may play an important role in the development and progression of PACA."

eLife. 2022 Oct 25;11:e80150. doi: 10.7554/eLife.80150.sa2

Author response


Essential revisions:

1. The authors should repeat their complete pipeline after randomizing within each of their ten data sets the clinical outcomes (i.e. shuffle the time-to-event outcomes). If one would obtain again a signature with comparable prognostic features, then one can be sure that what is reported here is largely a manifestation of overfitting due to dimension mismatch, and hence of no interest.

Thank you and reviewer 2 for your insightful recommendations. In response to this problem, we supplement the contents of Figure 3—figure supplement 4-5, and detailed explanations are given in lines 584-637 of this author’s response. The results from 22 randomized split validation cohorts and three external test cohorts consistently confirmed that AIDPS can robustly predict the prognosis of pancreatic cancer (PACA) patients. Thanks again for your advice, which we are sure makes our validation of AIDPS more rigorous, reliable and meaningful.

2. The authors should provide a better understanding of why agreement/optimization amongst a large number of combined ML methods was chosen as a way to drive feature selection. Comparing to existing methods is one thing, currently, there isn't really a clear comparison here to other feature selection approaches.

Thank you and reviewer 1 for your questions. As to why we choose agreement/optimization as our feature selection method, we conducted in-depth thinking and careful investigation again, and made a detailed and rigorous discussion. Specific responses are presented in the recommendation section of reviewer 1 in lines 120-213.

3. The authors should provide a thorough explanation of the biological relevance of the 9 genes in relation to the mutational load/copy number changes/ immunological infiltration found in low AIDPS patients.

Thank you and reviewer 3 for your recommendations. As you mentioned, our study explored the genomic landscape such as mutation and copy number alteration (CNA) of the 9-gene AIDPS and their impact on the tumor microenvironment (TME), focusing on its guiding value for decision-making and clinical management in PACA patients, while ignoring the biological functions of these nine genes as independent individuals. To compensate for this defect, we supplemented two parts, Figure 7—figure supplement 2-3, to explore the biological functions of AIDPS and its nine genes related to mutation, CNA, and immune infiltration in four aspects. A detailed response to this section can be found in the recommendation section of reviewer 3 in lines 644-799.

Reviewer #1 (Recommendations for the authors):

Things I think would strengthen the paper:

1. A better understanding of why agreement/optimization amongst a large number of combined ML methods was chosen as a way to drive feature selection. Comparing to existing methods is one thing, but there isn't really a clear comparison here to other feature selection approaches, nor much discussion of why this one was chosen. Is this meant to be a reproducible approach, for other problems, or is the point just to get the AIDPS features? Why is this approach to feature selection preferred/superior.

With advancements in high-throughput sequencing techniques and computational biology, numerous predictive signatures have been proposed according to various machine-learning approaches. However, two questions worth considering are why a particular algorithm should be selected and which solution is the optimal one. The selection of algorithms by researchers may rely largely on their own preferences and bias. Thus, to generate a consensus signature, we collected 10 prevalent algorithms and then combined them into 76 combinations. As to why we use agreement/optimization as a feature selection method, we will next answer from the following five aspects:

1. Why perform feature selection?

For clinical prediction model development, the 10 events per variable (10 EPV) rule recommends that feature variables should be included according to the number of positive events, which in general requires more than 10-fold higher number of positive events than the independent variable included (PMID: 32188600; 8970487). According to the 10 EPV rule, 1280 samples from our ten cohorts contained 772 positive events (OS of 1), which means that the independent variables included in our study at the beginning should be less than 77. However, given that there are 15,288 intersection genes in the ten cohorts, we need to conduct the first stage of variable screening for the initial covariates that are severely mismatched with the sample size. There are two commonly used variable screening methods: one is differential expression analysis of tumor and normal samples, and it is believed that differentially expressed variables may play a crucial role in the tumorigenesis and progression (e.g., PMID: 33028695; 32754277; 33391469; 34108619), and the other is univariate Cox regression analysis of survival variables, and variables with independent prognostic significance are selected for subsequent analysis (e.g., PMID: 35145098; 34922323; 33302293; 31350847; 32201203; 33038770) ; and even some studies combine the two methods (e.g., PMID: 32719094; 34237133). Because the ten cohorts lacked normal samples (there were only 4 normal samples in the TCGA-PAAD and even no normal samples in the PACA-AU-Array used for modeling), univariate Cox regression analysis was used for variable screening in this study.

2. Why choose consistent prognostic genes (agreement)?

It is well-known that the widespread tumor heterogeneity caused by different genetic background, pathological type, differentiation state and even living environment poses a great challenge to treatment and is also an urgent problem to be solved in precision medicine. Because of spatiotemporal heterogeneity, the same gene may have different prognostic performance in different cohorts, for example, A1BG was a protective factor in the TCGA-PAAD and GSE79668, and had no significant prognostic value in most cohorts, but it was indeed a risk factor in the GSE71729. Therefore, in order to obtain more stable prognostic genes, drawing on previous experience (PMID: 35145098; 34922323; 34394098), we obtained 32 consensus prognostic genes in the first stage for subsequent machine-learning modeling according to the screening criteria of consistent prognostic significance in at least 8/10 cohorts.

3. Why build machine-learning algorithm combinations?

Based on the 32 consensus prognostic genes obtained from the appeal step, we selected the PACA-AU-Array with larger sample size as the training set to construct the consensus model. However, according to the 10 EPV rule, the PACA-AU-Array (267 samples, of which 161 positive events) allowed up to 16 variables to be included for subsequent model construction. To solve this problem, among the ten machine-learning algorithms we collected, RSF, LASSO, CoxBoost and Stepwise Cox have the function of dimensionality reduction and variable screening. Therefore, we combined them with other algorithms to make the model more simplified and more conducive to clinical translation.

4. Why choose the largest average C-index (optimization)?

The pros and cons of a model lies in whether it can maintain good predictive ability in the validation sets, that is, it has strong generalization ability. In existing studies, the concordance index (C-index, PMID: 22532584; 28068175; 28687838) and the time-dependent ROC curve (timeROC, PMID: 26813360; 33667676; 34157487) are the most common and widely recognized indicators for evaluating the predictive performance of machine-learning survival models. Among them, C-index can be used to judge the accuracy and discrimination ability for global prediction, and the performance is relatively stable. While the area under the timeROC curve (AUC) depends on the time node, reflecting the prediction accuracy at a certain moment, and the overall performance is not very stable. Therefore, we chose C-index to evaluate the predictive performance of the 76 algorithm combinations.

In addition, the aim of our study was to obtain a predictive model with strong generalization ability that could maintain excellent performance in each validation cohort and have a good likelihood of clinical translation. Some models, such as random survival forest (RSF) model, performed extremely well on the PACA-AU-Array training set (C-index = 0.914), but it performed very poorly on the nine validation sets (C-index: TCGA-PAAD = 0.57, and PACA-CA-Seq = 0.61). This is mainly because some algorithms are easy to overfit in the training set. In this situation, we thus cannot say that RSF is the optimal model. Therefore, in order to avoid the impact of model overfitting as much as possible, following the previous workflow (PMID: 35145098; 34922323), we chose the largest average C-index of nine validation sets as our feature selection method.

5. From the results, how is the effect of our feature selection approach?

In summary, based on the feature selection criteria of consistent prognostic value (agreement) and the largest average C-index (optimization), we combined CoxBoost and Survival-SVM to construct a 9-gene AIDPS. In nine validation sets, in addition to owning an average C-index of 0.675, AIDPS also exhibited robust and superior predictive capability (all AUCs >0.65) in another recognized indicators, timeROC, and outperformed the existing 86 gene expression signatures. Meanwhile, the composition of 9-gene AIDPS is relatively simple, and it is more likely to construct a multigene panel for clinical translation. In addition, as recommended by reviewer 2, we randomly split the Meta-Cohort into 22 validation cohorts (from Cohort_100 to Cohort_1150) and again thoroughly collected three external test cohorts, including GSE21501 (n = 102), GSE57495 (n = 63) and GSE71729 (n = 125). The univariate Cox regression analysis, Kaplan-Meier survival curves, AUCs of timeROC curves, C-index, and calibration curves consistently demonstrated robust and good predictive performance of AIDPS (Figure 3—figure supplement 4-5). Therefore, based on the above results, we can preliminarily illustrate that AIDPS generated by our machine-learning survival framework has great potential for clinical application in PACA patients with insidious onset and poor prognosis.

2. Right now the current pipeline seems highly unwieldy because of all the models considered. Is this meant to be a general and reproducible approach? if so, the authors need to demonstrate more clearly that this same approach can be done by others with ease.

Thank you for your questions. In existing predictive models, researchers mostly chose the modelling algorithms based on their knowledge limitations and preferences, and it is worth thinking about which method is more suitable or which solution is optimal. Therefore, to construct a consensus model with robust predictive performance and stronger generalization ability and extrapolation possibilities, we collected ten classical machine-learning algorithms, among which RSF, LASSO, CoxBoost and Stepwise Cox have the functions of dimensionality reducing and variable screening. Given that our training set has only 161 positive events and a maximum of 16 variables can be accommodated for subsequent model construction according to the 10 EPV rule, we combined these four algorithms with other algorithms to generate 76 combinations to make the model more simplified and more conductive to clinical translation. This does make our pipeline seem unwieldy, but at present this method has better performance and application prospects, and the same pipeline has also been applied to the following high-level studies:

(1) In February 2022, our team published an article entitled: “Machine learning-based integration develops an immune-derived lncRNA signature for improving outcomes in colorectal cancer” in Nature Communications (PMID: 35145098). In this study, based on 43 immune-related lncRNAs with consistent prognostic significance obtained by univariate Cox regression analysis, we combined ten machine-learning algorithms into 101 algorithm combinations and demonstrated that the model constructed by Lasso combined with stepwise Cox (direction = both) possessed the best predictive performance in a training set and six validation sets (average C-index of 0.696). In addition, we confirmed that the high-risk group was sensitive to fluorouracil-based adjuvant chemotherapy, whereas the low-risk group showed more abundant immune cells infiltration and was more sensitive to pembrolizumab.

(2) In January 2022, our team published another article entitled: “Integrative analysis from multi-center studies identities a consensus machine learning-derived lncRNA signature for stage II/III colorectal cancer” in EBioMedicine (PMID: 34922323). In this study, based on 27 stable recurrence-related lncRNAs, we combined ten machine-learning algorithms into 76 algorithm combinations and demonstrated that CMDLncS generated by Lasso combined with stepwise Cox could accurately detect recurrence in patients with II/III colorectal cancer (average C-index of 0.777). In addition, patients in the high CMDLncS group were likely to benefit from fluorouracil-based adjuvant chemotherapy, whereas the low CMDLncS group showed greater sensitivity to bevacizumab.

(3) Recently, Nan Zhang et al., from Xiangya Hospital of Central South University, published the other article entitled “Machine learning-based identification of tumor-infiltrating immune cell-associated lncRNAs for improving outcomes and immunotherapy responses in patients with low-grade glioma” in Theranostics (PMID: 35966587). The authors identified 136 tumor-infiltrating immune cell-associated lncRNA (TIIClncRNA) of low-grade glioma (LGG) by comprehensive analyzing the sequencing data of purified immune cells, LGG cell lines, and bulk LGG tissues. After that, based on 46 prognostic TIIClncRNAs obtained by univariate Cox regression analysis, the authors combined ten machine-learning algorithms into 101 algorithm combinations, and picked out TIIClnc signature that derived by combining RSF and CoxBoost algorithms using the largest mean C-index (0.744) in the TCGA training set, Xiangya in-house validating set, and two external validating sets. In addition, the authors found that TIIClnc signature was significantly associated with the expression of CD8, PD-1, and PD-L1, as well as immune characteristics such as microsatellite instability, tumor mutation burden, interferon γ. Results from multiple datasets demonstrate that TIIClnc signature accurately predicts superior immunotherapy response across cancer types.

In addition, the complete flow and essential scripts of our pipeline has also been published in the GitHub website (https://github.com/Zaoqu-Liu/IRLS). To our knowledge, some people have been applying our pipeline in solid tumors such as melanoma, bladder cancer, hepatocellular carcinoma, gastric cancer and have achieved good results. For PACA, our AIDPS model has also been uploaded to the corresponding catalogue (https://github.com/Zaoqu-Liu/AIDPS), and the researchers entered the expression matrix of these nine AIDPS genes to obtain patient-specific risk score. Thanks again for your questions, which let us think again about the extensibility and generalizability of our pipeline.

3. Everything in the subsequent analyses comparing high and low AIDPS groups hinges on the assumed accuracy and generality of the model. Once you have 9 genes, though, you should be able to study those features using a range of methods, some of which are picked to have high interpretability. I am sorry if I missed this, but at the moment it is not clear to me what best an ML method can do is using the 9 genes, and whether there is an interpretable method that works well but might imply a non-trivial relationship amongst the genes that matters to the outcome. This seems more informative than studying the statistics of high and low AIDPS groups

Thanks for your questions and suggestions. As you said, once we have these nine AIDPS genes, we can conduct a series of studies. Therefore, we supplemented Figure 7—figure supplement 1-3 to further explore the relationship between AIDPS and nine AIDPS genes and prognosis, immune cells infiltration and immune checkpoint molecules (ICMs) expression. Next, we will explain our findings in following four sections:

1. Prognostic performance of AIDPS and nine AIDPS genes

Our previous results consistently indicated that AIDPS could accurately predict the prognosis of PACA patients (Figure 3-4 and Figure 3—figure supplement 1-3). According to your advice, based on large multi-center data from the training set, nine validation sets, and three newly collected external test sets, we performed an integrated analysis of survival variables using AIDPS and nine AIDPS genes as continuous variables. As shown in Figure 7—figure supplement 1A, AIDPS was an independent protective factor in all cohorts (among them, there were only 26 positive and 2 negative events in the PACA_AU_Seq, although there was a corresponding trend, it did not reach statistical significance). Correspondingly, because the 32 consensus prognostic genes used to construct AIDPS with consistent prognostic value in at least 8/10 cohorts, nine AIDPS genes had relatively consistent prognostic performance in the ten cohorts (Figure 7—figure supplement 1B-J). However, in the three external test sets, GSE21501, GSE57495 and GSE71729, the performance of nine AIDPS genes was hardly satisfactory. Overall, compared with the nine independent AIDPS genes, our AIDPS constructed by CoxBoost and Survival-SVM brings significant performance improvement, and its simple composition and robust performance also have greater possibility of clinical translation and extrapolation.

2. Correlation between AIDPS and its nine genes at expression level

To describe the biological relevance between AIDPS and its nine genes, we performed Pearson correlation analysis referring to previous studies (PMID: 32853987; 32201203). As shown in Figure 7—figure supplement 2A, SELENBP1 and PLCB4 had strong positive correlations with AIDPS (R = 0.46 and 0.57), while DCBLD2, PRR11, UNC13D, EREG, ADM, CDCA4, and TGM2 had very strong negative correlations with AIDPS (R from -0.57 to -0.75) in the whole TCGA-PAAD. Moreover, there was a positive correlation between the two genes positively correlated with AIDPS (R = 0.23). Similarly, there were also positive correlation between the seven genes negatively correlated with AIDPS (R from 0.19 to 0.59), while there were moderate negative correlation between the two genes positively correlated AIDPS and the seven genes negatively correlated AIDPS (R from 0 to -0.55). Based on the rationale of weighted gene co-expression network analysis (WGCNA, PMID: 19114008): genes with similar expression patterns may be co-regulated, functionally correlated or in the same pathway. The strong correlation within the nine genes explains the rationality of our AIDPS from the perspective of biological function to some extent.

In addition, to investigate the changes of the nine AIDPS genes with AIDPS changes, we performed Pearson correlation analysis again in the high and low AIDPS TCGA-PAAD, respectively, and the low AIDPS group exhibited a consistent trend with the whole TCGA-PAAD (Figure 7—figure supplement 2C). Interestingly, the overall correlation was lower in the high AIDPS group and numerous genes showed different or even opposite trends to the whole and the low AIDPS group (e.g., SELENBP1 changed from positive to negative correlation with AIDPS and PLCB4), suggesting that AIDPS may have stronger biological relevance and potential function in PACA patients with low AIDPS (Figure 7—figure supplement 2B).

3. Relationship between nine AIDPS genes and immune molecules and immune cells

Given the obvious impact of AIDPS in the TME and its guiding significance for immunotherapy, we compared the relationship of AIDPS and its nine genes with 27 ICMs and 28 immune cells in the whole, high AIDPS, and low AIDPS TCGA-PAAD. The results again corroborate our previous finding that the low AIDPS group had higher immune cells infiltration and ICMs expression (Figure 7). In the whole TCGA-PAAD, AIDPS showed a prominent negative correlation with ICMs and immune cells, and SELENBP1 and PLCB4, which were positively correlated with AIDPS, also exhibited a corresponding trend. However, DCBLD2, PRR11, UNC13D, EREG, and TGM2, which were negatively correlated with AIDPS, had a significant positive correlation with ICMs and immune cells (Figure 7—figure supplement 2D and G). The high AIDPS group also showed the similar results as the whole cohort (Figure 7—figure supplement 2E and H). Interestingly, in the low AIDPS group, AIDPS showed an observably positive correlation with ICMs and immune cells different from the whole and high AIDPS cohort. Meanwhile, PLCB4, which was positively correlated with AIDPS, showed a similar trend, while DCBLD2, PRR11, UNC13D, EREG, ADM, CDCA4 and TGM2, which were negatively correlated with AIDPS, were negatively correlated with ICMs and immune cells (Figure 7—figure supplement 2F and I).

4. Current research progress on these nine AIDPS genes

After careful literature research, we found that SELENBP1 that owned lower expression in the low AIDPS group with poor prognosis was associated with better tumor prognosis, and its decreased expression led to poor prognosis of many tumors such as lung adenocarcinoma. Meanwhile, DCBLD2, PRR11, EREG, ADM and TGM2, which were overexpressed in the low AIDPS group, played a vital role in the proliferation, invasion and metastasis of many tumors such as PACA, hepatocellular carcinoma and colorectal cancer, and lead to their chemotherapy resistance and were potential targets for enhanced efficacy. However, the functional roles and mechanisms of UNC13D and CDCA4 in tumors are not well understood, and more high-quality studies are needed in the future. These findings are consistent with our study. The specific functional characteristics of these nine AIDPS genes are summarized as follows:

(1) SELENBP1, encoding a novel human methanethiol oxidase, whose expression is significantly decreased in the progression of Barrett’s esophagus to adenocarcinoma and can affect chemotherapy sensitivity (PMID: 20332323). This is consistent with our results that SELENBP1 expression was decreased in the low AIDPS group with worse prognosis (Figure 7—figure supplement 3).

(2) PLCB4 encodes a phospholipase, and activating PLCB4 mutation was recently identified in primary leptomeningeal melanocytic tumors (PMID: 28499758).

(3) DCBLD2 is upregulated in glioblastoma and head and neck cancer, and phosphorylation of DCBLD2 Y750 activates AKT pathway which in turn enhances EGFR-driven tumorigenesis (PMID: 25061874). DCBLD2 has also been found to play a crucial role in the invasion, progression, and metastasis of neuroendocrine tumors (PMID: 18827820). These results are consistent with an increased expression of DCBLD2 in the low AIDPS group with a dismal prognosis.

(4) Proline-rich protein 11 (PRR11) is a novel tumor-related gene, which has been found can promote breast cancer growth and anti-estrogen resistance through the PI3K pathway (PMID: 33127913). In addition, it has also been demonstrated that PRR11 affects autophagy and promotes proliferation in non-small cell lung cancer (NSCLC) through the Akt/mTOR pathway (PMID: 30258945; 35005120), and recent studies have also found that PRR11 can promote the tumorigenesis and progression of renal clear cell carcinoma (ccRCC) by regulating E2F1 stability (PMID: 34499617). Overall, these results are consistent with higher expression of PRR11 in the low AIDPS group with a worse prognosis.

(5) UNC13D mutation play an essential role in familial hemophagocytic lymphohistiocytosis (FHL), but its role in tumors remains unknown and needs to be further explored (PMID: 21931115; 24842371; 25564401; 24882743).

(6) EREG, as an EGFR ligand epithelial regulatory protein, plays a fundamental role in the growth and proliferation of breast and colorectal cancers (PMID: 26215578; 23549083) and is associated with tamoxifen resistance in breast cancer (PMID: 30967627) and efficacy of panitumumab and adjuvant chemotherapy in colorectal cancer (PMID: 26869404; 25272957).

(7) Adrenomedullin (ADM) encodes a pre-prohormone that is cleaved into two bioactive peptides, which can dilate blood vessels, regulate hormone secretion, and promoting angiogenesis. Many studies have confirmed that ADM plays a major role in the proliferation, invasion, angiogenesis, and metastasis of PACA, hepatocellular carcinoma, prostate cancer, melanoma, ovarian cancer, and endometrial cancer and may become a novel therapeutic target (PMID: 22960655; 17363587; 18657357; 24100627; 21994414; 22400488; 11420706).

(8) In addition, currently one of the few studies support the oncogenic role of cell division cycle associated protein 4 (CDCA4) in tumors and nuclear factors induced as E2F transcription factor families that regulate E2F-dependent transcriptional activation and cell proliferation, but their potential mechanism, especially effect on PACA tumorigenesis and progression require further investigation (PMID: 35251007; 16984923).

(9) Transglutaminase 2 (TGM2), a promoter of stemness and radiotherapy resistance in glioma (PMID: 33483373), has been confirmed in many studies to promote colorectal cancer progression via P53 and Wnt/β-catenin signaling pathways (PMID: 34103685; 31570702), as well as is associated with tumor-promoting inflammation in gastric cancer (PMID: 32467608). These results are consistent with the TGM2 expression dramatically increased in the low AIDPS group with worse prognosis, suggesting that TGM2 may play an important role in the development and progression of PACA.

In summary, our study demonstrated that AIDPS outperformed nine AIDPS genes alone in prediction performance, so we chose AIDPS instead of the nine genes alone for subsequent analysis. The biological relevance studies exhibited that AIDPS and its nine genes had inconsistent or even opposite performances in the high and low AIDPS groups, suggesting that the high and low AIDPS groups owned relatively strong biological heterogeneity. In addition, our literature survey found that these nine AIDPS genes were rarely studied in tumors, and most of these focus on their roles in biological phenotypes such as tumorigenesis and progression, and few studies investigated their roles and guiding significance in PACA immune microenvironment and treatment. Meanwhile, our study showed that the high and low AIDPS groups had observably different prognosis, functional characteristics, immune infiltration, genomic variant landscape, and treatment response. Moreover, stratifying PACA patients into high and low AIDPS groups for individualized treatment and clinical management is also in line with the concept of precise treatment. Therefore, in this study, we focused on the high and low AIDPS groups. Relevant contents have been added and marked in red in the corresponding section of the revised manuscript. Thanks again for your questions and suggestions, and we are sure that your suggestions have enriched and refined our research.

Reviewer #2 (Recommendations for the authors):

To rescue their claims one could suggest to the authors the following simple but clean and fair test. The authors could repeat their complete pipeline after randomizing within each of their ten data sets the clinical outcomes (i.e. shuffle the time-to-event outcomes). If that exercise is found to make the signal disappear (i.e. the separation of KM curves, and the nontrivial AUROC values), then their present results should be studied further as possibly relevant. If, on the contrary, one would obtain again a signature with comparable prognostic features, then one can be sure that what is reported here is largely a manifestation of overfitting due to dimension mismatch, and hence of no interest.

Thank you for your advice. During the construction of AIDPS, in order to eliminate the heterogeneity between different cohorts as much as possible and obtain relatively stable prognostic genes in PACA, we performed univariate Cox regression analysis and identified 32 consensus prognostic genes according to the following criteria of consistent prognostic significance in at least 8/10 cohorts. Afterwards, we selected the PACA-AU-Array with larger sample size as the training set and validated the model using the remaining nine cohorts and Meta-Cohort, and confirmed that AIDPS has robust and good predictive performance. In doing so, as you are concerned, there is indeed the possibility of applying validation sets to train the model and resulting in a lack of rigor in the validation results. But we did this to make more adequate use of the 10 PACA cohorts to obtain a robust model. In a sense, if we also use the genes of a specific biological pathway for modeling according to popular practice, then our model will be like the collected 86 signatures and is hard to generalize in other cohorts or populations, and unable to further clinical translation and serve the clinical management and precision treatment of PACA patients. To rescue our claims, as you recommended, we supplemented the contents of Figure 3—figure supplement 4-5 to further test the performance of AIDPS. The details are as follows:

1. Performance of AIDPS in randomly split cohorts

Following your recommendations, we used the sample function of R software to perform non-return random sampling from Meta-Cohort synthesized from 10 PACA cohorts, and 100, 150, 200, 250, 300, 350, 400, 450, 500, 550, 600, 650, 700, 750, 800, 850, 900, 950, 1000, 1050, 1100, and 1150 samples were successively selected to form a new cohort. Kaplan-Meier survival analysis, univariate Cox regression analysis, timeROC, and C-index were used to measure the performance of AIDPS in these cohorts. The Figure 3—figure supplement 4 is presented from left to right as follows: the results of Kaplan-Meier survival analysis showed that the survival curves of patients in the high and low AIDPS groups were remarkably separated (curves not shown; Log-rank P = 0.0019 in the Cohort_100, and <0.0001 in the other cohorts); univariate Cox regression analysis also exhibited that AIDPS was an independent protective factor in these cohorts (P <0.001 in the Cohort_100 and <0.0001 in the other cohorts); the timeROC curves for 1-, 2-, 3-, 4-, and 5-years OS also showed that AIDPS owned AUCs greater than 0.7 in the vast majority of cohorts, and at least greater than 0.65 in the relatively poor Cohort_100, Cohort_200, and Cohort_300; plus C-index greater than 0.65 in all cohorts, suggesting that our AIDPS can accurately predict OS in PACA patients.

2. Performance of AIDPS in three additional independent test cohorts

Furthermore, to more objectively test the performance of AIDPS, in addition to the training and validation sets mentioned earlier, we again screened and searched for three external test cohorts, GSE21501 (n = 102), GSE57495 (n = 63), and GSE71729 (n = 125). The results of univariate Cox regression analysis showed that AIDPS was an independent protective factor in all three cohorts (Figure 3—figure supplement 5A). Kaplan-Meier survival analysis also exhibited that patients in the low AIDPS group owned a significantly shorter OS (Figure 3—figure supplement 5B-D, Log-rank P = 0.0014 in GSE21501, 0.00045 in GSE57495, 0.00011 in GSE71729). The AUCs of 1-, 2-, and 3-year OS were 0.677, 0.681, and 0.761 in the GSE21501; 0.682, 0.728, and 0.747 in the GSE57495; 0.676, 0.693, and 0.714 in the GSE71729 (Figure 3—figure supplement 5E-G). In addition, the calibration curves of these three external test cohorts also confirmed the good predictive performance of AIDPS (Figure 3—figure supplement 5H-J).

Overall, the results of the above randomized split validation cohorts and three external test cohorts consistently confirmed that AIDPS can robustly predict the prognosis of PACA patients. Thanks again for your suggestions, and we are sure that your suggestions makes our verification more rigorous, reliable and meaningful.

Reviewer #3 (Recommendation for the authors):

From the biological point of view, currently, there was little explanation of the biological relevance of the 9 genes in relation to the mutational load/copy number changes/ immunological infiltration found in low AIDPS patients. Please discuss these in sufficient detail.

Thank you for your recommendations. As you mentioned, our study explored the genomic landscape such as mutation and copy number alteration (CNA) of the 9-gene AIDPS and their impact on the tumor microenvironment (TME), focusing on its guiding value for decision-making and clinical management in PACA patients, while ignoring the biological functions of these nine genes as independent individuals. To compensate for this defect, we supplemented the correlation analysis between AIDPS and nine AIDPS genes in the whole, high AIDPS, and low AIDPS TCGA-PAAD. Considering the outstanding different TME between the high and low AIDPS groups, we added a correlation analysis of AIDPS and its nine genes with 27 immune checkpoint molecules (ICMs) and 28 immune cells obtained by ssGSEA in the whole, high AIDPS, and low AIDPS TCGA-PAAD. In addition, to describe the overall relationship between AIDPS and its nine genes and mutation/CNA in PACA patients, we added expression information of these genes in the process of Figure 6A to generate Figure 7—figure supplement 3. Next, we will explore the biological relevance between AIDPS and its nine genes with mutation, CNA, and immune infiltration from the following four aspects:

1. Correlation between AIDPS and its nine genes at expression level

To describe the biological relevance between AIDPS and its nine genes, we first performed Pearson correlation analysis referring to previous studies (PMID: 32853987; 32201203). As shown in Figure 7—figure supplement 2A, SELENBP1 and PLCB4 had strong positive correlations with AIDPS (R = 0.46 and 0.57), while DCBLD2, PRR11, UNC13D, EREG, ADM, CDCA4, and TGM2 had very strong negative correlations with AIDPS (R from -0.57 to -0.75) in the whole TCGA-PAAD. Moreover, there was a positive correlation between the two genes positively correlated with AIDPS (R = 0.23). Similarly, there were also positive correlation between the seven genes negatively correlated with AIDPS (R from 0.19 to 0.59), while there were moderate negative correlation between the two genes positively correlated AIDPS and the seven genes negatively correlated AIDPS (R from 0 to -0.55). Based on the rationale of weighted gene co-expression network analysis (WGCNA, PMID: 19114008): genes with similar expression patterns may be co-regulated, functionally correlated or in the same pathway. The strong correlation within the nine genes explains the rationality of our AIDPS from the perspective of biological function to some extent.

In addition, to investigate the changes of the nine AIDPS genes with AIDPS changes, we performed Pearson correlation analysis again in the high and low AIDPS TCGA-PAAD, respectively, and the low AIDPS group exhibited a consistent trend with the whole TCGA-PAAD (Figure 7—figure supplement 2C). Interestingly, the overall correlation was lower in the high AIDPS group and numerous genes showed different or even opposite trends to the whole and the low AIDPS group (e.g., SELENBP1 changed from positive to negative correlation with AIDPS and PLCB4), suggesting that AIDPS may have stronger biological relevance and potential function in PACA patients with low AIDPS (Figure 7—figure supplement 2B).

2. Relationship between nine AIDPS genes and immune molecules and immune cells

Given the obvious impact of AIDPS in the TME and its guiding significance for immunotherapy, we compared the relationship of AIDPS and its nine genes with 27 ICMs and 28 immune cells in the whole, high AIDPS, and low AIDPS TCGA-PAAD. The results again corroborate our previous finding that the low AIDPS group had superior immune cells infiltration and ICMs expression (Figure 7). In the whole TCGA-PAAD, AIDPS showed a prominent negative correlation with ICMs and immune cells, and SELENBP1 and PLCB4, which were positively correlated with AIDPS, also exhibited a corresponding trend. However, DCBLD2, PRR11, UNC13D, EREG, and TGM2, which were negatively correlated with AIDPS, had a significant positive correlation with ICMs and immune cells (Figure 7—figure supplement 2D and G). The high AIDPS group also showed the similar results as the whole cohort (Figure 7—figure supplement 2E and H). Interestingly, the tread in the low AIDPS group was contrary, AIDPS and PLCB4 were observably positively correlated with ICMs and immune cells. Meanwhile, DCBLD2, PRR11, UNC13D, EREG, ADM, CDCA4 and TGM2, which were negatively correlated with AIDPS, were negatively correlated with ICMs and immune cells (Figure 7—figure supplement 2F and I).

The disparate result of AIDPS and its nine genes in the high and low AIDPS groups indicated that these AIDPS genes may be closely related to the immune regulatory pathway, which may play a crucial role in anti-tumor immune and immunotherapy. This also provides a rationale to some extent that AIDPS can accurately predict immunotherapy response in PACA patients.

3. Relevance of nine AIDPS genes with mutation and copy number alteration

Our previous study found that the low AIDPS group owned outstandingly higher genomic alterations such as tumor mutation burden (TMB) and CNA load, which could provide more neoantigens for anti-tumor immune and immunotherapy and lead to better immunotherapeutic efficacy (Figure 6A-D). As shown in Figure 7—figure supplement 3, the proportion of top 15 gene mutation and CNA loci (frequency >20%) were obviously higher in the low AIDPS group. In addition, we also found that SELENBP1 and PLCB4, which were positively correlated with AIDPS, were significantly lower in the low AIDPS group, suggesting that they were significantly negatively correlated with TMB and CNA burden. Correspondingly, DCBLD2, PRR11, UNC13D, EREG, ADM, CDCA4, and TGM2, which were negatively correlated with AIDPS, was remarkably increased in the low AIDPS group, hinting they were significantly positively correlated with TMB and CNA burden (e.g., the low AIDPS group possessed higher TP53 mutation and 8q24.21 amplification, as well as higher DCBLD2 expression).

4. Current research progress on these nine AIDPS genes

After careful literature research, we found that the nine AIDPS genes were rarely studied in tumors, most of which focused on their roles in biological phenotypes such as tumorigenesis and progression, and few studies investigated their roles and guiding significance in PACA immune microenvironment and treatment. Specifically, we found that SELENBP1 owned lower expression in the low AIDPS group with poor prognosis was associated with better tumor prognosis, and its decreased expression resulted in poor prognosis of many tumors such as lung adenocarcinoma. Meanwhile, DCBLD2, PRR11, EREG, ADM and TGM2, which were overexpressed in the low AIDPS group, played an essential role in the proliferation, invasion and metastasis of many tumors such as PACA, hepatocellular carcinoma and colorectal cancer, and lead to their chemotherapy resistance and were potential targets for enhanced efficacy. However, the functional roles and mechanisms of UNC13D and CDCA4 in tumors are not well understood, and more high-quality studies are needed in the future. These findings are consistent with our study, and the specific functional characteristics are summarized as follows:

(1) SELENBP1, encoding a novel human methanethiol oxidase, whose expression is significantly decreased in the progression of Barrett’s esophagus to adenocarcinoma and can affect chemotherapy sensitivity (PMID: 20332323). This is consistent with our results that SELENBP1 expression was decreased in the low AIDPS group with worse prognosis (Figure 7—figure supplement 3).

(2) PLCB4 encodes a phospholipase, and activating PLCB4 mutation was recently identified in primary leptomeningeal melanocytic tumors (PMID: 28499758).

(3) DCBLD2 is upregulated in glioblastoma and head and neck cancer, and phosphorylation of DCBLD2 Y750 activates AKT pathway which in turn enhances EGFR-driven tumorigenesis (PMID: 25061874). DCBLD2 has also been found to play a crucial role in the invasion, progression, and metastasis of neuroendocrine tumors (PMID: 18827820). These results are consistent with an increased expression of DCBLD2 in the low AIDPS group with a dismal prognosis.

(4) Proline-rich protein 11 (PRR11) is a novel tumor-related gene, which has been found can promote breast cancer growth and anti-estrogen resistance through the PI3K pathway (PMID: 33127913). In addition, it has also been demonstrated that PRR11 affects autophagy and promotes proliferation in non-small cell lung cancer (NSCLC) through the Akt/mTOR pathway (PMID: 30258945; 35005120), and recent studies have also found that PRR11 can promote the tumorigenesis and progression of renal clear cell carcinoma (ccRCC) by regulating E2F1 stability (PMID: 34499617). Overall, these results are consistent with higher expression of PRR11 in the low AIDPS group with a worse prognosis.

(5) UNC13D mutation play an essential role in familial hemophagocytic lymphohistiocytosis (FHL), but its role in tumors remains unknown and needs to be further explored (PMID: 21931115; 24842371; 25564401; 24882743).

(6) EREG, as an EGFR ligand epithelial regulatory protein, plays a fundamental role in the growth and proliferation of breast and colorectal cancers (PMID: 26215578; 23549083) and is associated with tamoxifen resistance in breast cancer (PMID: 30967627) and efficacy of panitumumab and adjuvant chemotherapy in colorectal cancer (PMID: 26869404; 25272957).

(7) Adrenomedullin (ADM) encodes a pre-prohormone that is cleaved into two bioactive peptides, which can dilate blood vessels, regulate hormone secretion, and promoting angiogenesis. Many studies have confirmed that ADM plays a major role in the proliferation, invasion, angiogenesis, and metastasis of PACA, hepatocellular carcinoma, prostate cancer, melanoma, ovarian cancer, and endometrial cancer and may become a novel therapeutic target (PMID: 22960655; 17363587; 18657357; 24100627; 21994414; 22400488; 11420706).

(8) In addition, currently one of the few studies support the oncogenic role of cell division cycle associated protein 4 (CDCA4) in tumors and nuclear factors induced as E2F transcription factor families that regulate E2F-dependent transcriptional activation and cell proliferation, but their potential mechanism, especially effect on PACA tumorigenesis and progression require further investigation (PMID: 35251007; 16984923).

(9) Transglutaminase 2 (TGM2), a promoter of stemness and radiotherapy resistance in glioma (PMID: 33483373), has been confirmed in many studies to promote colorectal cancer progression via P53 and Wnt/β-catenin signaling pathways (PMID: 34103685; 31570702), as well as is associated with tumor-promoting inflammation in gastric cancer (PMID: 32467608). These results are consistent with the TGM2 expression dramatically increased in the low AIDPS group with worse prognosis, suggesting that TGM2 may play an important role in the development and progression of PACA.

In conclusion, previous studies and our analysis results consistently indicate that the nine AIDPS genes are correlated with mutation, CNA, and TME in PACA. This also essentially supports the important impact of AIDPS on the prognosis and immune microenvironment, as well as its role in the clinical management and precision treatment of PACA. The relevant contents have been added and marked in red in the corresponding section of the revised manuscript. Thanks again for your valuable comments, and we are sure that your hard work has made our study more rigorous and meaningful.

[Editors' note: further revisions were suggested prior to acceptance, as described below.]

The manuscript has been improved but there are some remaining issues that need to be addressed, as outlined below:

1. The improvements to figure 7 (in the supplementary figures linked to Figure 7) meant to address Reviewer #1's request seem to all focus on treating the aidps features separately. Please show the accuracy when these aidps features are considered together as a nine dimensional feature vector in one model.

Thank you and Reviewer #1 for your reminder. As you mentioned, in this revision, we supplemented the content of Figure 4—figure supplement 1D, focusing on exploring the performance of this 9 AIDPS genes in other machine-learning algorithms. The results exhibited that our AIDPS model constructed by survival-SVM is the best choice for 9 AIDPS genes obtained after dimensionality reduction by CoxBoost from 32 consensus prognostic genes, which is also consistent with our previous pipeline results (Figure 2A). Specific responses are presented in the recommendations section of Reviewer #1 in lines 69-88.

2. For reviewer #2, please remove the newly added material called `performance of AIDPS in randomly split cohorts', as this adds nothing relevant (as it s again testing on discovery data). Please take out all mentioning of `validation' or `validated' from the manuscript, other than when discussing the tests on the three new data sets GSE21501, GSE57495, GSE71729; only the latter can be called validation sets. Please compare the performance of existing signatures to that of the authors' own signature on the three new data sets GSE21501, GSE57495, GSE71729.

The main reason for this suggestion is that the revised manuscript still tests their own signature on discovery data but that of the competitors on unseen data, which is not a fair comparison. Unless the authors remedy this they should (i) remove all mentioning of superior performance of their signature (since the comparison did not involve a level paying field) and (ii) remove all mentioning of `validation' other than in relation to the three new data sets.

Thank you and Reviewer #2 for your suggestions. Following the Option B of Reviewer #2’s recommendations, we have removed all contents related to the “randomly split cohorts” added in the first revision. In addition, in our latest manuscript, we refer to the PACA-AU-Array as the training cohort, the remaining nine cohorts involved in screening consensus prognostic genes as the testing cohorts, while the three external datasets GSE21501, GSE57495, and GSE71729 are called the validation cohorts. Moreover, in this revised manuscript, we checked our wording again and used the “validated” and “validation” only in these three validation cohorts. Furthermore, to remedy our claims, we compared the performance of our AIDPS with 86 published signatures in the three new validation cohorts GSE21501, GSE57495 and GSE71729, and again demonstrated our AIDPS stability and superior performance (Figure 4—figure supplement 1). A detailed response to this section can be found in the recommendations section of Reviewer #2 in lines 151-190.

3. Please include (4. Current research progress on these nine AIDPS genes) in the rebuttal, which is a summary of what is known about the biological function of the nine genes, as an Appendix or Supplementary information in the manuscript.

Thank you and Reviewer #3 for your suggestions, and we have placed the section “the current research progress of these nine AIDPS genes” in Appendix 1 and uploaded it with this revised manuscript.

Reviewer #1 (Recommendations for the authors):

The authors have largely addressed the concerns raised in my previous review. As best I can tell, they have not yet shown how a simple ML model (such as linear regression or xgboost) performs on the same task when only fed with the 9 aidps features simultaneously. The improvements to figure 7 meant to address my request seem to all focus on treating the aidps features separately, so it useful to know they perform poorly when separate… what about when they are considered together as a nine dimensional feature vector in one model?

Thank you for your recommendations. As you mentioned, in the last revision, we confirmed that nine AIDPS genes alone do not predict the prognosis of PACA patients, ignoring their performance as a nine-dimensional feature vector. In this revision, we supplemented the content of Figure 4—figure supplement 1D, focusing on exploring the performance of this 9 AIDPS genes in other machine-learning algorithms. It is worth pointing out that since these nine AIDPS genes are already dimensionality reduced from 32 consensus prognostic genes by CoxBoost, machine-learning algorithm combinations are no longer considered here. Therefore, we used the expression files of these nine AIDPS genes in the PACA-AU-Array training cohort to construct 18 models via 10 common machine-learning algorithms (α values for elastic networks from 0.1-0.9) and interrogated their performance in the remaining 12 multi-center cohorts. The results are shown as follows:

As expected, among all 18 models, the model built by survival-SVM, namely our 9-gene AIDPS, achieved a maximum mean C-index of 0.666 in the remaining 12 multi-center cohorts. That is, for the 9 genes obtained from 32 consensus prognostic genes after dimensionality reduction by CoxBoost, these results reconfirmed our previous pipeline results (Figure 2A), and the AIDPS model constructed by survival-SVM was the best choice. Thanks again for your reminder, we are sure that your suggestions make our study more rigorous and meaningful.

Reviewer #2 (Recommendations for the authors):

In my first report I put forward two points. First, that the authors used the same data sets both in the discovery stage and the validation stage. Second, that they compared the performance of competitor signatures to theirs by using these same data. This has the following consequences: 1. They could not claim that their signature had been validated, because what they called validation data were in fact the discovery data (the potential impact of overfitting is hence unclear). 2. The comparison between their signature and the existing ones was not fair (their own signature was tested on its corresponding discovery data, but the competitors' signatures on what for those signatures would be independent validation data). Therefore, all claims on their signature having been validated and on it being superior to existing signatures were not supported by the available evidence. I also suggested that they could test for overfitting impact by repeating their previous analyses step by step with outcome-randomized versions of the original data. This should make all true signals disappear and is hence a clean and fair test.

In the revised version of their manuscript the authors did not carry out the requested re-analysis with outcome-randomized data. Instead they (a) sampled several new data sets from their original data (without outcome randomization), and (b) tested their signature on three independent new data sets. Exercise (a) seems pointless; of course the signature would again be able to predict, since one is testing it once more on samples from the discovery set. Exercise (b), although not what was requested by this referee, is more useful. Here the authors report again significant performance of their signature, with AUC values in the range 0.68-0.70, lending weight to the suggestion that their signature makes sense.

I conclude from the authors' reply and from the new version of the paper that point 1. above has been partly addressed, but not point 2. If the authors, as it seems, do not wish to carry out the requested analysis with outcome randomization, then they have the following options:

Option A;

– Remove the newly added material called `performance of AIDPS in randomly split cohorts', this adds nothing relevant (see my notes above, it is again testing performance on discovery data).

– Take out all mentioning of `validation' or `validated' from the manuscript, other than when discussing the tests on the three new data sets GSE21501, GSE57495, GSE71729; only the latter can be called validation sets.

– Remove all performance comparisons between the new signature and the existing ones (since this comparison is presently not fair) and all conclusions based on these comparisons.

Option B:

– Remove the newly added material called `performance of AIDPS in randomly split cohorts', this adds nothing relevant (see my notes above, it is again testing on discovery data).

– Take out all mentioning of `validation' or `validated' from the manuscript, other than when discussing the tests on the three new data sets GSE21501, GSE57495, GSE71729; only the latter can be called validation sets.

– Compare the performance of existing signatures to that of their own signature on the three new data sets GSE21501, GSE57495, GSE71729; this comparison would be fair.

I would personally strongly suggest option B, since otherwise the paper would in my view be too weak in terms of the amount of justified conclusions to warrant publication (but that is a decision for the editor to make). In addition, I would still hope that the authors choose to comply with my original request for application of the full pipeline to outcome-randomized discovery data. This would clarify objectively, for the authors' own benefit, the extent to which their original tests and conclusions may have been affected by overfitting.

Thank you for your thoughtful suggestions. Following the Option B, we have removed all contents related to the “randomly split cohorts” added in the first revision. In addition, in our latest manuscript, we refer to the PACA-AU-Array as the training cohort, the remaining nine cohorts involved in screening consensus prognostic genes including TCGA-PAAD, PACA-AU-Seq, PACA-CA-Seq, E-MTAB-6134, GSE62452, GSE28735, GSE78229, GSE79668, and GSE85916 cohorts as the testing cohorts, while the three external datasets GSE21501, GSE57495, and GSE71729 are called the validation cohorts. Moreover, in this revised manuscript, we checked our wording again and used the “validated” and “validation” only in these three validation cohorts. Furthermore, to remedy our claims, we compared the performance of our AIDPS with 86 published signatures in the three new validation cohorts GSE21501, GSE57495 and GSE71729, and again demonstrated our AIDPS stability and superior performance. The results are exhibited in Figure 4—figure supplement 1:

As shown in Figure 4—figure supplement 1A-C, our AIDPS has robust predictive performance, ranking fourth in the GSE57495 cohort as well as fifth in the GSE21501 and GSE71729 cohorts, which is superior to almost all existing signatures. Notably, although the 6-gene signature of Stratford JK was significantly better than AIDPS in the GSE21501 and GSE71729 cohorts, it was constructed in the GSE21501 cohort and performed very poorly in other cohorts, with C-index even less than 0.6 in the GSE57495, TCGA-PAAD, PACA-AU-Seq, et al. (Figure 4—figure supplement 1E). The 15-gene signature of Chen DT had observably superior performance in his own training cohort GSE57495, but it was unsatisfactory in the GSE21501, GSE71729, PACA-CA-Seq, and other cohorts (Figure 4—figure supplement 1F). Similarly, Kim J’s 5-gene signature performed well in the training cohort GSE71729 as well as GSE21501 and PACA-AU-Seq, but very poorly in most other cohorts such as GSE85916, GSE57495, PACA-CA-Seq, and E-MTAB-6134 (Figure 4—figure supplement 1G). In addition, as shown in Author response image 1, although the 20-gene signature of Demirkol CS, the 3-gene signature of Chen H, the 6-gene signature of Hou J, the 7-gene signature of Liu X, and the 6-gene signature of Yu X_2 were superior to AIDPS in their training cohort or a few other cohorts, only our AIDPS possessed acceptable performance in all PACA cohorts, and the vast majority of cohorts had good performance with a C-index greater than 0.65.

Author response image 1.

Author response image 1.

Overall, using the PACA-AU-Array as the training cohort, nine PACA cohorts as the testing cohorts, the three external datasets GSE21501, GSE57495, and GSE71729 as the validation cohorts, the results of all cohorts confirmed that our AIDPS could better predict the prognosis of PACA patients. Thank you again for your questions and we are sure that your suggestions make our validation more rigorous, credible and persuasive.

Reviewer #3 (Recommendations for the authors):

The authors have addressed my comments. I find the following v useful as a summary of what is known about the biological function of the nine genes and wonder if it can be incorporated as an Appendix or Supplementary information:

Thank you for your suggestions, and we have placed the section “the current research progress of these nine AIDPS genes” in Appendix 1 and uploaded it with this revised manuscript.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Citations

    1. Goldman MJ, Craft B, Hastie M. 2020. GDC TCGA Pancreatic Cancer (PAAD) The Cancer Genome Atlas. TCGA-PAAD
    2. Zhang J, Bajari R, Andric D. 2019. exp_seq. PACA-AU. International Cancer Genome Consortium. PACA-AU-Seq [DOI] [PubMed]
    3. Zhang J, Bajari R, Andric D. 2019. exp_array. PACA-AU. International Cancer Genome Consortium. PACA-AU-Array
    4. Zhang J, Bajari R, Andric D. 2019. exp_seq. PACA-CA. International Cancer Genome Consortium. PACA-CA-Seq [DOI] [PubMed]
    5. Puleo F, Nicolle R, Blum Y. 2018. mRNA profiling by array for pancreatic ductal adenocarcinoma for clinical application. ArrayExpress. E-MTAB-6134
    6. Yang S, He P, Wang J. 2016. Microarray gene-expression profiles of 69 pancreatic tumors and 61 adjacent non-tumor tissue from patients with pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE62452
    7. Zhang G, He P, Tan H. 2012. Microarray gene-expression profiles of 45 matching pairs of pancreatic tumor and adjacent non-tumor tissues from 45 patients with pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE28735
    8. Wang J, Yang S, He P. 2017. Microarray gene-expression profiles of 50 pancreatic tumors tissue from patients with pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE78229
    9. Kirby MK, Ramaker RC. 2016. RNA-sequencing of human pancreatic adenocarcinoma cancer tissues. NCBI Gene Expression Omnibus. GSE79668
    10. Puleo F, Maréchal R, Demetter P. 2018. Patients with human resected pancreatic cancer. NCBI Gene Expression Omnibus. GSE85916
    11. Stratford JK, Yeh JJ. 2010. A six-gene signature predicts survival of patients with localized pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE21501 [DOI] [PMC free article] [PubMed]
    12. Chen D, Malafa MP. 2015. Development of a prognostic gene signature in pancreatic cancer. NCBI Gene Expression Omnibus. GSE57495
    13. Jen Jen Y. 2015. Virtual Microdissection of Pancreatic Ductal Adenocarcinoma Reveals Tumor and Stroma Subtypes. NCBI Gene Expression Omnibus. GSE71729

    Supplementary Materials

    Figure 1—source data 1. Details of baseline information in 13 public datasets.
    Figure 2—source data 1. The nine genes included in the artificial intelligence-derived prognostic signature (AIDPS).
    Figure 4—source data 1. Details of 86 published mRNA/LncRNA signatures in pancreatic cancer (PACA).
    MDAR checklist

    Data Availability Statement

    All data generated during this study are included in the manuscript and supporting files. The basic script for our AIDPS model is available on the GitHub website (https://github.com/Zaoqu-Liu/AIDPS, copy archived at swh:1:rev:f9d929456fa9f0cd7721cea6a5e2a1412ffae4a7; Liu, 2022); the researchers entered the expression matrix of these nine AIDPS genes and could obtain patient-specific risk scores. Source data files have been provided for Figures 1, 2 and 4.

    Figure 1-source data 1, Figure 2-source data 1 and Figure 4-source data 1 contain the numerical data used to generate the figures.

    The following previously published datasets were used:

    Goldman MJ, Craft B, Hastie M. 2020. GDC TCGA Pancreatic Cancer (PAAD) The Cancer Genome Atlas. TCGA-PAAD

    Zhang J, Bajari R, Andric D. 2019. exp_seq. PACA-AU. International Cancer Genome Consortium. PACA-AU-Seq

    Zhang J, Bajari R, Andric D. 2019. exp_array. PACA-AU. International Cancer Genome Consortium. PACA-AU-Array

    Zhang J, Bajari R, Andric D. 2019. exp_seq. PACA-CA. International Cancer Genome Consortium. PACA-CA-Seq

    Puleo F, Nicolle R, Blum Y. 2018. mRNA profiling by array for pancreatic ductal adenocarcinoma for clinical application. ArrayExpress. E-MTAB-6134

    Yang S, He P, Wang J. 2016. Microarray gene-expression profiles of 69 pancreatic tumors and 61 adjacent non-tumor tissue from patients with pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE62452

    Zhang G, He P, Tan H. 2012. Microarray gene-expression profiles of 45 matching pairs of pancreatic tumor and adjacent non-tumor tissues from 45 patients with pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE28735

    Wang J, Yang S, He P. 2017. Microarray gene-expression profiles of 50 pancreatic tumors tissue from patients with pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE78229

    Kirby MK, Ramaker RC. 2016. RNA-sequencing of human pancreatic adenocarcinoma cancer tissues. NCBI Gene Expression Omnibus. GSE79668

    Puleo F, Maréchal R, Demetter P. 2018. Patients with human resected pancreatic cancer. NCBI Gene Expression Omnibus. GSE85916

    Stratford JK, Yeh JJ. 2010. A six-gene signature predicts survival of patients with localized pancreatic ductal adenocarcinoma. NCBI Gene Expression Omnibus. GSE21501

    Chen D, Malafa MP. 2015. Development of a prognostic gene signature in pancreatic cancer. NCBI Gene Expression Omnibus. GSE57495

    Jen Jen Y. 2015. Virtual Microdissection of Pancreatic Ductal Adenocarcinoma Reveals Tumor and Stroma Subtypes. NCBI Gene Expression Omnibus. GSE71729


    Articles from eLife are provided here courtesy of eLife Sciences Publications, Ltd

    RESOURCES