Skip to main content
Journal of Personalized Medicine logoLink to Journal of Personalized Medicine
. 2023 Feb 24;13(3):409. doi: 10.3390/jpm13030409

Nomograms for Predicting the Risk and Prognosis of Liver Metastases in Pancreatic Cancer: A Population-Based Analysis

Huaqing Shi 1, Xin Li 2, Zhou Chen 2, Wenkai Jiang 1, Shi Dong 1, Ru He 2, Wence Zhou 1,3,*
Editor: Vincenzo Ricci
PMCID: PMC10056156  PMID: 36983591

Abstract

The liver is the most prevalent location of distant metastasis for pancreatic cancer (PC), which is highly aggressive. Pancreatic cancer with liver metastases (PCLM) patients have a poor prognosis. Furthermore, there is a lack of effective predictive tools for anticipating the diagnostic and prognostic techniques that are needed for the PCLM patients in current clinical work. Therefore, we aimed to construct two nomogram predictive models incorporating common clinical indicators to anticipate the risk factors and prognosis for PCLM patients. Clinicopathological information on pancreatic cancer that referred to patients who had been diagnosed between the years of 2004 and 2015 was extracted from the Surveillance, Epidemiology, and End Results (SEER) database. Univariate and multivariate logistic regression analyses and a Cox regression analysis were utilized to recognize the independent risk variables and independent predictive factors for the PCLM patients, respectively. Using the independent risk as well as prognostic factors derived from the multivariate regression analysis, we constructed two novel nomogram models for predicting the risk and prognosis of PCLM patients. The area under the curve (AUC) of the receiver operating characteristic (ROC) curve, the consistency index (C-index), and the calibration curve were then utilized to establish the accuracy of the nomograms’ predictions and their discriminability between groups. Using a decision curve analysis (DCA), the clinical values of the two predictors were examined. Finally, we utilized Kaplan–Meier curves to examine the effects of different factors on the prognostic overall survival (OS). As many as 1898 PCLM patients were screened. The patient’s sex, primary site, histopathological type, grade, T stage, N stage, bone metastases, lung metastases, tumor size, surgical resection, radiotherapy, and chemotherapy were all found to be independent risks variables for PCLM in a multivariate logistic regression analysis. Using a multivariate Cox regression analysis, we discovered that age, histopathological type, grade, bone metastasis, lung metastasis, tumor size, and surgery were all independent prognostic variables for PCLM. According to these factors, two nomogram models were developed to anticipate the prognostic OS as well as the risk variables for the progression of PCLM in PCLM patients, and a web-based version of the prediction model was constructed. The diagnostic nomogram model had a C-index of 0.884 (95% CI: 0.876–0.892); the prognostic model had a C-index of 0.686 (95% CI: 0.648–0.722) in the training cohort and a C-index of 0.705 (95% CI: 0.647–0.758) in the validation cohort. Subsequent AUC, calibration curve, and DCA analyses revealed that the risk and predictive model of PCLM had high accuracy as well as efficacy for clinical application. The nomograms constructed can effectively predict risk and prognosis factors in PCLM patients, which facilitates personalized clinical decision-making for patients.

Keywords: nomogram, pancreatic cancer, liver metastases, predictive models, overall survival, SEER database

1. Introduction

Pancreatic cancer is among the most fatal malignancies, and patients have a poor prognosis [1,2]. According to Cancer Statistics 2022, PC is the fourth biggest cause of cancer-related fatalities, following lung, prostate, breast, and colorectal cancers [3]. It is predicted that PC will become the third biggest cause of cancer mortalities in European countries by 2025 [4]. Because the pancreas is located in the retroperitoneum, its location is deep, the early symptoms of PC are not obvious, the opportunity for early diagnosis and treatment is often missed, and the five-year survival rate is below 10% [5,6,7]. Surgery is currently the only curative method available, but only about 20% of patients are suitable for radical surgery, with a five-year survival rate of about 21% following surgery; in the two years following surgery, over 80% of patients will have a recurrence or metastasis [8,9,10]. Distant metastases are the main cause of poor prognoses in PC patients, with a systemic metastasis rate of more than 50% [11,12]. The median survival of patients with distant metastases from untreated PC is less than 6 months, and the combination of adjuvant chemotherapy with gemcitabine and albumin paclitaxel remains as the first-line treatment option in clinical practice [13,14].

The liver is the most frequent site of distant metastasis in PC, followed by the peritoneum and lung [15,16]. In a study involving 13,233 patients with distant metastases from pancreatic cancer, Oweira et al. found that liver metastases accounted for 76% of PC patients [17]. It has been found that surgical resection, radiotherapy, and radiofrequency ablation of the liver are feasible for improving the prognosis of PCLM patients according to their liver metastases [18,19,20,21]. The TNM staging method of the American Joint Committee on Cancer (AJCC) has been utilized to assess the prognosis of pancreatic cancer patients; there is a lack of comprehensive and effective models for anticipating and assessing the risk factors and prognosis of PCLM patients [22]. Although some artificial intelligence (AI) models have been applied in the medical field, there are limitations in terms of hardware, computing power, and data [23,24]. We used the relatively convenient R software to build nomogram models that were specifically designed for the study of PCLM patients. Therefore, clinically relevant information needs to be integrated to determine the risk factors and prognosis of liver metastasis in PC patients. Previous studies have constructed nomogram models of distant metastases in pancreatic cancer patients, including those for bone metastases and lung metastases, to predict risk factors and prognosis, respectively [11,25,26]. However, predictive models for liver metastasis in PC patients have not been adequately studied.

The nomogram prediction model outperforms the traditional TNM staging system [27]. A nomogram can integrate multiple clinical factors and personalize the patient’s situation to accurately and effectively assess the causes and factors affecting the prognosis. [28,29]. Nomogram prediction models have been widely used in the prognosis and risk assessment of various tumors such as gastric, colorectal, prostate, breast, and liver cancers [30,31,32,33,34]; its visual interface and web-based model facilitate practical use by clinicians and patients, facilitating individualized patient treatment [35]. Currently, no nomogram model exists to anticipate the risk and prognosis in PCLM patients. Therefore, we used a large sample of the SEER database’s clinical information, combined with commonly used clinical indicators, to construct two nomograms that anticipate the risk and prognosis of patients suffering from PCLM; in addition, we also web-based the models for clinical use.

2. Methods

2.1. Data Sources and Extraction

PC patient data from 2004 to 2015 were extracted from the SEER database for this investigation. About 47.9% of U.S. residents is covered by the SEER database, which is a widely-used and dependable public cancer database [36]. The clinicopathological data of PC patients were extracted from the SEER database (Database name = Incidence − SEER Research Plus Data, 18 Registries, Nov 2020 Sub (2000–2018)—Linked To County Attributes—Total U.S., 1969–2019 Counties) utilizing SEER*Stat 8.4.0 (http://seer.cancer.gov (accessed on 17 August 2022)). The patient information used from the SEER database is public, anonymous, and does not require signed informed permission or approval from an ethics review board. The account number for this authorization is 15071-Nov2021. The inclusion criteria for the PC patients in this study were as follows: (1) histopathologically confirmed diagnosis of pancreatic cancer; (2) tumor primary site was the pancreas; (3) complete clinicopathological information was available; and (4) follow-up information was complete and valid. Exclusion criteria were: (1) patients with a survival time of 0; (2) unknown surgical status; (3) patients with a pathological type other than pancreatic cancer; and (4) case data from cases obtained by autopsy and retention of death reports only. Finally, a total of 12,327 pancreatic cancer patients were enrolled, of which 1898 had liver metastases.

2.2. Nomogram Construction and Validation

In our study, variables such as: age; sex; race; main site; histological type grade; T stage; N stage; tumor size; metastases to the brain, bone, and lungs; and treatment with surgery, radiation, and chemotherapy were utilized to recognize risk and predictive variables for liver metastases pancreatic cancer patients. All patients formed a diagnostic cohort for the risk factor analysis and for the construction of diagnostic models. In a 7:3 ratio, PCLM patients were randomized into two groups, a “training cohort” and a “validation cohort”. In the training cohort, independent predictive variables for PCLM patients were evaluated utilizing univariate and multivariate Cox regression analyses, and nomograms were created to anticipate the PCLM patients’ OS at 1, 3, and 5 years. We then used the C-index, AUC, and calibration curves to analyze the discriminatory ability and accuracy of the models, and we used the DCA to examine the clinical efficacy of the two models. OS was the major result for predicting survival in this study, which was identified as the period from the date of diagnosis until the date of death or latest follow-up.

2.3. Statistical Analysis

In this study, categorical factors were reported as integers and percentages, and factors were compared utilizing chi-square tests or Fisher exact tests. In the first diagnostic cohort, univariate and multivariate logistic regression analyses were conducted and multivariate logistic analyses were carried out to calculate the odds ratio (OR) and the matching 95% confidence interval (CI) for every distinct risk variable. The training cohort was then subjected to univariate and multivariate Cox regression analyses, and multivariate Cox regression analysis was used to obtain independent predictive variables.

On the basis of these independent risk and predictive variables, two nomograms were subsequently developed to anticipate risk and prognosis in PCLM patients. In the training and validation cohorts, PCLM patients were split into high- and low-risk groups due to median risk scores, and the potential differences in OS between these predictive variables were compared using Kaplan–Meier curves. Statistical analyses and model construction were conducted utilizing the SPSS 22.0 tool (IBM, Chicago, IL, USA) and R tool (version 4.0.3) (https://www.r-project.org/ (accessed on 17 August 2022)); the results were judged as statistically significant if p < 0.05.

3. Results

3.1. Baseline Characteristics of Patients

Based on the screening criteria, we screened a total of 12,327 PC patients from the SEER database, of which 1898 patients had liver metastases. According to Table 1, we found that age was not statistically significant in patients with and without LM (p > 0.05), and the number of patients between the ages of 50 and 64 years as well as the number between 65 and 74 years was similar (34.8% vs. 32.7%). There were more male patients (51.1%) among all patients, and they were predominantly white (78.5%). The main location of the tumor was at the pancreatic head in 57.5% of patients, followed by the tail of the body of the pancreas in 28.8% of patients. The histopathological type was predominantly adenocarcinoma (53.2%), of which 42.5% were moderately differentiated. Patients with T3 staging accounted for 59.5% of the sample, followed by T2 accounting for 18%. N stage typing accounted for 50% of each total case, but N0 accounted for 55.9% of LM patients. Regarding the patients, 98.9% were without bone metastases, 99.9% were without brain metastases, and 96.5% were without lung metastases. The tumor size was predominantly 2–4 cm (48.1%), followed by a size of >4 cm accounting for 31.2% of patients. In terms of treatment, surgical patients accounted for 69.9% of the sample and chemotherapy patients accounted for 59.7%; however, radiotherapy patients were less common, accounting for 22.9% of the sample.

Table 1.

Baseline clinical features and treatment regimens in 12,327 patients with pancreatic cancer.

Variables n (%) Without LM Cohort n (%) With LM Cohort n (%) p
Age 12,327 10,429 1898
≤49 1043 (8.5) 870 (8.3) 173 (9.1) 0.088
50–64 4294 (34.8) 3602 (34.5) 692 (36.5)
65–74 4032 (32.7) 3417 (32.8) 615 (32.4)
≥75 2958 (24.0) 2540 (24.4) 418 (22.0)
Sex
Female 6029 (48.9) 5187 (49.7) 842 (44.4) <0.001
Male 6298 (51.1) 5242 (50.3) 1056 (55.6)
Race
Black 1586 (12.9) 1281 (12.3) 305 (16.1) <0.001
Other 1066 (8.6) 921 (8.8) 145 (7.6)
White 9675 (78.5) 8227 (78.9) 1448 (76.3)
Primary sites
Other 1686 (13.7) 1320 (12.7) 366 (19.3) <0.001
Pancreatic body tail 3552 (28.8) 2820 (27.0) 732 (38.6)
Pancreatic head 7089 (57.5) 6289 (60.3) 800 (42.1)
Histopathology
Adenocarcinoma 6555 (53.2) 5243 (50.3) 1312 (69.1) <0.001
Infiltrating duct carcinoma 3173 (25.7) 3028 (29.0) 145 (7.6)
Neuroendocrine carcinoma 1160 (9.4) 923 (8.9) 237 (12.5)
Other 1439 (11.7) 1235 (11.8) 204 (10.7)
Grade
I (Well) 2673 (21.7) 2439 (23.4) 234 (12.3) <0.001
II (Moderately) 5244 (42.5) 4551 (43.6) 693 (36.5)
III (Poorly) 4172 (33.8) 3263 (31.3) 909 (47.9)
IV (Undifferentiated) 238 (1.9) 176 (1.7) 62 (3.3)
T stage
T1 1246 (10.1) 1172 (11.2) 74 (3.9) <0.001
T2 2223 (18.0) 1648 (15.8) 575 (30.3)
T3 7331 (59.5) 6521 (62.5) 810 (42.7)
T4 1527 (12.4) 1088 (10.4) 439 (23.1)
N stage
N0 6158 (50.0) 5097 (48.9) 1061 (55.9) <0.001
N1 6169 (50.0) 5332 (51.1) 837 (44.1)
Bone metastasis
No 12,194 (98.9) 10,387 (99.6) 1807 (95.2) <0.001
Yes 133 (1.1) 42 (0.4) 91 (4.8)
Brain metastasis
No 12,316 (99.9) 10,423 (99.9) 1893 (99.7) 0.019
Yes 11 (0.1) 6 (0.1) 5 (0.3)
Lung metastasis
No 11,895 (96.5) 10,245 (98.2) 1650 (86.9) <0.001
Yes 432 (3.5) 184 (1.8) 248 (13.1)
Tumor size
≤2 cm 2099 (17.0) 1978 (19.0) 121 (6.4) <0.001
2–4 cm 5933 (48.1) 5213 (50.0) 720 (37.9)
>4 cm 3848 (31.2) 2935 (28.1) 913 (48.1)
Unknown 447 (3.6) 303 (2.9) 144 (7.6)
Surgery
No 3708 (30.1) 2153 (20.6) 1555 (81.9) <0.001
Yes 8619 (69.9) 8276 (79.4) 343 (18.1)
Radiotherapy
None/Unknown 9502 (77.1) 7725 (74.1) 1777 (93.6) <0.001
Yes 2825 (22.9) 2704 (25.9) 121 (6.4)
Chemotherapy
None/Unknown 4972 (40.3) 4270 (40.9) 702 (37.0) 0.001
Yes 7355 (59.7) 6159 (59.1) 1196 (63.0)

3.2. Independent Risk Factors of PCLM

The univariate logistic analysis of 15 common clinical indicators (age, sex, race, primary site, histological subtype, grading, T stage, N stage, bone metastasis, brain metastasis, lung metastasis, tumor size, surgery, radiotherapy, and chemotherapy) revealed that age was not statistically significant (p > 0.05). A subsequent multivariate logistic regression analysis revealed that sex, primary site, histological subtype, grade, T stage, N stage, bone metastasis, lung metastasis, tumor size, surgery, radiotherapy, and chemotherapy were independent risk variables for PCLM (Table 2).

Table 2.

Univariate and multivariate logistic regression analysis of the risk factors in patients of pancreatic cancer with liver metastases.

Univariate Analysis Multivariate Analysis
Variables OR 95% CI p OR 95% CI p
Age
≤49 Ref
50–64 0.966 0.805–1.159 0.711
65–74 0.905 0.753–1.088 0.289
≥75 0.828 0.682–1.004 0.055
Sex
Female Ref
Male 1.241 1.125–1.369 0 1.171 1.037–1.322 0.011
Race
Black Ref
Other 0.661 0.532–0.818 0 0.804 0.618–1.045 0.103
White 0.739 0.646–0.849 0 0.875 0.739–1.036 0.121
Primary sites
Other Ref
Pancreatic body tail 0.936 0.813–1.079 0.361 1.338 1.121–1.597 0.001
Pancreatic head 0.459 0.400–0.527 0 0.751 0.633–0.890 0.001
Histopathology
Adenocarcinoma Ref
Infiltrating duct carcinoma 0.191 0.160–0.228 0 0.676 0.550–0.832 0
Neuroendocrine carcinoma 1.026 0.877–1.196 0.745 3.69 2.931–4.645 0
Other 0.660 0.561–0.773 0 1.576 1.261–1.970 0
Grade
I (Well) Ref
II (Moderately) 1.587 1.360–1.859 0 1.903 1.557–2.325 0
III (Poorly) 2.904 2.496–3.390 0 2.652 2.170–3.240 0
IV (Undifferentiated) 3.672 2.654–5.028 0 1.918 1.278–2.879 0.002
T stage
T1 Ref
T2 5.526 4.317–7.171 0 1.591 1.019–2.484 0.041
T3 1.967 1.549–2.535 0 1.207 0.785–1.858 0.391
T4 6.390 4.959–8.343 0 0.955 0.610–1.495 0.841
N stage
N0 Ref
N1 0.754 0.683–0.832 0 1.49 1.307–1.698 0
Bone metastasis
No Ref
Yes 12.454 8.672–18.179 0 3.982 2.552–6.212 0
Brain metastasis
No Ref
Yes 4.588 1.321–15.250 0.012 0.569 0.146–2.214 0.416
Lung metastasis
No Ref
Yes 8.369 6.873–10.208 0 1.907 1.515–2.400 0
Tumor size
≤2 cm Ref
2–4 cm 2.258 1.857–2.768 0 1.292 0.914–1.827 0.147
>4 cm 5.085 4.189–6.226 0 1.734 1.226–2.452 0.002
Unknown 7.769 5.934–10.192 0 1.537 1.028–2.298 0.036
Surgery
No Ref
Yes 0.057 0.051–0.065 0 0.066 0.056–0.078 0
Radiotherapy
None/Unknown Ref
Yes 0.195 0.160–0.234 0 0.190 0.153–0.236 0
Chemotherapy
None/Unknown Ref
Yes 1.181 1.068–1.307 0.001 1.359 1.190–1.551 0

OR, Odds ratio; CI, confidence intervals.

3.3. Diagnostic Nomogram Construction and Validation

On the basis of the independent risk variables obtained from a multivariate logistic regression analysis of the diagnostic cohort, we constructed a nomogram for predicting PCLM risk factors (Figure 1) and web-based the model at the following link: https://shqycmx.shinyapps.io/Diagnostic_Model/ (accessed on 17 August 2022). The C-index of the model was 0.884 (95% CI: 0.876–0.892), and the AUC value was 0.872. By observing the calibration curve, it was found that the reported findings closely matched the anticipated findings, and these results indicated that the model possessed a greater level of prediction accuracy and discrimination capability. The DCA analysis revealed that the model was more selective than the old TNM staging approach used in clinical practice (Figure 2).

Figure 1.

Figure 1

Diagnostic nomogram for predicting the risk of liver metastasis in patients with pancreatic cancer.

Figure 2.

Figure 2

ROC curve, calibration curve, and decision curve analysis of the nomogram model for the risk of liver metastasis in pancreatic cancer. (A) AUC values were used to evaluate the predictive performance of the nomogram. (B) Calibration curves of the nomogram model. The diagonal 45-degree line indicates a perfect prediction. (C) Comparison of the diagnostic nomograms and TNM staging DCA curves. The net benefit, calculated by adding the true positives minus the false positives, corresponds to the measurement on the Y-axis; the X-axis represents the threshold probability.

3.4. Independent Prognostic Factors of PCLM

At a 7:3 ratio, 1898 PCLM patients were randomized into a training cohort and validation cohort, and chi-square and Fisher exact tests established no significant variations between all variables in the two cohorts (Table 3, p > 0.05). A univariate Cox regression analysis of the training cohort demonstrated that age, histopathological type, tumor differentiation degree, T stage, bone metastasis, lung metastasis, tumor size, and surgery were statistically significant variables (p < 0.05). Age, histological type, degree of tumor differentiation, bone metastases, lung metastases, tumor size, and surgical treatment were independent predictive variables for the predictive OS in PCLM patients, as determined by a multivariate Cox regression analysis (Table 4).

Table 3.

Demographic and clinicopathologic characteristics of 1898 patients of pancreatic cancer with liver metastases.

Variables n (%) Training Cohort n (%) Validation Cohort n (%) p
Age 1898 1328 570
≤49 173 (9.1) 128 (9.6) 45 (7.9) 0.176
50–64 692 (36.5) 464 (34.9) 228 (40.0)
65–74 615 (32.4) 438 (33.0) 177 (31.1)
≥75 418 (22.0) 298 (22.4) 120 (21.1)
Sex
Female 842 (44.4) 572 (43.1) 270 (47.4) 0.094
Male 1056 (55.6) 756 (56.9) 300 (52.6)
Race
Black 305 (16.1) 204 (15.4) 101 (17.7) 0.426
Other 145 (7.6) 101 (7.6) 44 (7.7)
White 1448 (76.3) 1023 (77.0) 425 (74.6)
Primary sites
Other 366 (19.3) 264 (19.9) 102 (17.9) 0.224
Pancreatic body tail 732 (38.6) 521 (39.2) 211 (37.0)
Pancreatic head 800 (42.1) 543 (40.9) 257 (45.1)
Histopathology
Adenocarcinoma 1312 (69.1) 919 (69.2) 393 (68.9) 0.493
Infiltrating duct carcinoma 145 (7.6) 105 (7.9) 40 (7.0)
Neuroendocrine carcinoma 237 (12.5) 157 (11.8) 80 (14.0)
Other 204 (10.7) 147 (11.1) 57 (10.0)
Grade
I (Well) 234 (12.3) 157 (11.8) 77 (13.5) 0.061
II (Moderately) 693 (36.5) 469 (35.3) 224 (39.3)
III (Poorly) 909 (47.9) 652 (49.1) 257 (45.1)
IV (Undifferentiated) 62 (3.3) 50 (3.8) 12 (2.1)
T stage
T1 74 (3.9) 52 (3.9) 22 (3.9) 0.897
T2 575 (30.3) 397 (29.9) 178 (31.2)
T3 810 (42.7) 574 (43.2) 236 (41.4)
T4 439 (23.1) 305 (23.0) 134 (23.5)
N stage
N0 1061 (55.9) 745 (56.1) 316 (55.4) 0.829
N1 837 (44.1) 583 (43.9) 254 (44.6)
Bone metastasis
No 1807 (95.2) 1260 (94.9) 547 (96.0) 0.37
Yes 91 (4.8) 68 (5.1) 23 (4.0)
Brain metastasis
No 1893 (99.7) 1324 (99.7) 569 (99.8) 0.999
Yes 5 (0.3) 4 (0.3) 1 (0.2)
Lung metastasis
No 1650 (86.9) 1150 (86.6) 500 (87.7) 0.554
Yes 248 (13.1) 178 (13.4) 70 (12.3)
Tumor size
≤2 cm 121 (6.4) 89 (6.7) 32 (5.6) 0.682
2–4 cm 720 (37.9) 510 (38.4) 210 (36.8)
>4 cm 913 (48.1) 630 (47.4) 283 (49.6)
Unknown 144 (7.6) 99 (7.5) 45 (7.9)
Surgery
No 1555 (81.9) 1087 (81.9) 468 (82.1) 0.947
Yes 343 (18.1) 241 (18.1) 102 (17.9)
Radiotherapy
None/Unknown 1777 (93.6) 1238 (93.2) 539 (94.6) 0.321
Yes 121 (6.4) 90 (6.8) 31 (5.4)
Chemotherapy
None/Unknown 702 (37.0) 472 (35.5) 230 (40.4) 0.053
Yes 1196 (63.0) 856 (64.5) 340 (59.6)

Table 4.

Univariate and multivariate Cox regression models for overall survival in patients of pancreatic cancer with liver metastases.

Univariate Analysis Multivariate Analysis
Variables HR 95% CI p HR 95% CI p
Age
≤49 Ref
50–64 1.822 1.462–2.27 0 1.37 1.09–1.71 0.006
65–74 1.916 1.536–2.389 0 1.34 1.07–1.68 0.011
≥75 2.913 2.313–3.67 0 2.06 1.63–2.61 0
Sex
Female Ref
Male 1.004 0.896–1.125 0.942
Race
Black Ref
Other 0.94 0.729–1.211 0.63
White 0.978 0.836–1.146 0.786
Primary sites
Other Ref
Pancreatic body tail 0.92 0.786–1.076 0.294
Pancreatic head 1.062 0.91–1.239 0.446
Histopathology
Adenocarcinoma Ref
Infiltrating duct carcinoma 0.791 0.644–0.97 0.025 1.2 0.97–1.5 0.092
Neuroendocrine carcinoma 0.251 0.204–0.31 0 0.4 0.32–0.51 0
Other 0.402 0.328–0.494 0 0.59 0.48–0.74 0
Grade
I (Well) Ref
II (Moderately) 2.62 2.108–3.255 0 1.51 1.19–1.9 0.001
III (Poorly) 3.957 3.198–4.896 0 2.18 1.73–2.74 0
IV (Undifferentiated) 3.178 2.241–4.505 0 2.62 1.84–3.73 0
T stage
T1 Ref
T2 1.667 1.206–2.303 0.002 0.9 0.56–1.45 0.664
T3 1.264 0.919–1.738 0.149 0.76 0.48–1.2 0.241
T4 1.755 1.264–2.435 0.001 0.8 0.5–1.28 0.349
N stage
N0 Ref
N1 0.909 0.812–1.019 0.102
Bone metastasis
No Ref
Yes 1.481 1.157–1.895 0.002 1.51 1.17–1.94 0.001
Brain metastasis
No Ref
Yes 1.834 0.687–4.897 0.226
Lung metastasis
No Ref
Yes 1.72 1.464–2.02 0 1.22 1.04–1.44 0.016
Tumor size
≤2 cm Ref
2–4 cm 1.428 1.117–1.825 0.005 1.18 0.83–1.7 0.356
>4 cm 1.392 1.092–1.774 0.007 1.32 0.92–1.88 0.126
Unknown 2.168 1.6–2.938 0 1.53 1.03–2.29 0.036
Surgery
No Ref
Yes 0.289 0.244–0.343 0 0.46 0.38–0.55 0
Radiotherapy
None/Unknown Ref
Yes 0.852 0.682–1.065 0.16
Chemotherapy
None/Unknown Ref
Yes 0.989 0.875–1.117 0.856

HR, hazard ratio. CI, confidence intervals.

3.5. Predictive Nomogram Construction and Validation

On the basis of the independent predictive variables obtained by the multivariate Cox regression analysis in the training cohort, we created a predictive model for PCLM patients (Figure 3), which was also web-based at the following link: https://shqycmx.shinyapps.io/Prognostic_model/ (accessed on 17 August 2022). In the training cohort, the AUC values for the prediction of the 1-year, 3-year, and 5-year OS were 0.764, 0.903, and 0.937, respectively. In the validation cohort, the AUC values were 0.783, 0.909, and 0.937, respectively (Figure 4). It was found that as the prediction time became longer, the prediction capability of the model became stronger. The C-index and calibration curves were utilized to validate the prediction power of the predictive model. The nomogram’s C-index was 0.686 (95% CI: 0.648–0.722) and 0.705 (95% CI: 0.647–0.758) in the training cohort and validation cohort, respectively. Observing the calibration curves at 1, 3, and 5 years for both cohorts found a substantial correlation between the actual data and the model’s predictions (Figure 5). The DCA results showed that the model exhibited a significantly good net gain in terms of mortality risk and outperformed the TNM staging method, showing high clinical utility for anticipating OS in PCLM patients (Figure 6). The Kaplan–Meier survival analysis by independent prognostic factors and high- and low-risk cohorts revealed significant differences in the survival between subgroups (Figure 7, p < 0.05).

Figure 3.

Figure 3

Nomogram model for predicting the overall survival in patients with liver metastases from pancreatic cancer. The scale corresponds to the variable axis according to the patient variables. The overall probability of patient survival at 1, 3, and 5 years can be assessed by drawing a vertical line upward to determine the score for each variable corresponding to the point where the sum of these point scores lies on the total point axis and by drawing a vertical line downward on the survival axis.

Figure 4.

Figure 4

Time-dependent ROC curves. (AC) Time-dependent ROC curves for the prognostic nomogram show AUC values of 0.764, 0.903, and 0.937 for predicting the 1-year, 3-year, and 5-year overall survival in the training cohort, respectively. (DF) The AUC values were 0.783, 0.909, and 0.937 for predicting the 1-, 3-, and 5-year overall survival in the validation cohort, respectively.

Figure 5.

Figure 5

Calibration curves of the prognostic nomogram model. (AC) Calibration curves for the 1-year, 3-year, and 5-year overall survival of patients with liver metastases from pancreatic cancer in the training cohort and (DF) validation cohort. The black line represents the ideal reference line, and the blue line is calculated by bootstrapping (resampling: 1000) and represents the nomogram performance. The closer the solid red line is to the black line, the more accurate the model is at predicting overall survival.

Figure 6.

Figure 6

Decision curve analysis of the prognostic nomogram and TNM staging system for predicting the overall survival in patients with liver metastases from pancreatic cancer. (AC) Survival benefits at 1, 3, and 5 years in the training cohort. (DF) Survival benefits at 1, 3, and 5 years in the validation cohort.

Figure 7.

Figure 7

Kaplan–Meier analysis of the prognostic overall survival in patients with liver metastases from pancreatic cancer. (A) Age; (B) histopathology; (C) grade; (D) bone metastasis; (E) surgery; (F) lung metastasis; (G) tumor size; (H) train cohort risk stratification; and (I) validation cohort risk stratification.

4. Discussion

Pancreatic cancer, especially pancreatic ductal adenocarcinoma (which accounts for more than 90% of pancreatic cancer), is a severe aggressive tumor of the digestive system. About 80% of pancreatic cancer is already locally advanced or has distant metastases when detected [37,38]. The blood supply of the pancreas also determines that the liver is the most prevalent location of distant pancreatic metastasis. The pancreatic head mostly obtains its blood supply from branches of the gastroduodenal and superior mesenteric arteries, whereas the tail of the pancreas’ body obtains its blood supply primarily from splenic artery branches. The pancreatic venous blood flow eventually enters the liver through the portal vein, and when pancreatic cancer invades the blood vessels, the shed cells tend to colonize the liver with the blood flow [39,40]. In the last decade, the prognosis of PC has not improved as much as other tumors with the advancement of medical technology [41]. The prevalence of PC remains at 3%, but the mortality rate has increased from 6% in 2012 to 8% in 2022 [3,42]. There is evidence that for patients with PCLM who respond well to chemotherapy and are physically able to tolerate surgery, surgery after chemotherapy may be beneficial [43,44]. However, in PC patients with multiple liver metastases, the opportunity for surgery is often lost, and this is an important reason for the poor prognosis of PCLM patients [45]. Therefore, we need to identify risk and predictive variables for liver metastasis in patients with PC, facilitate early detection and prevention, and assess the prognosis of PCLM patients. In this paper, by constructing the diagnostic and prognostic nomograms of PCLM, we are able to calculate the diagnostic- and prognostic-related scores by combining the actual conditions of the patients and by providing guidance for individualized patient treatment.

We know that artificial intelligence is currently being used in many areas, including in healthcare. Deep learning is an important branch of artificial intelligence [46]. Deep learning evolved from the study of artificial neural networks; however, it is not identical to conventional neural networks. Nevertheless, in terms of vocabulary, the many deep learning algorithms, including deep reinforcement learning, generative adversarial networks, recurrent neural networks, and convolutional neural networks, use the phrase “neural network” [47,48,49,50]. Deep learning can be thought of as a semi-theoretical, semi-empirical modelling approach that employs human understanding of mathematics and computer algorithms, along with as much training information as is possible, to construct an architectural framework, utilizing the massive computing power of computers to tune the internal criteria to approximate the issue’s objectives as closely as possible [51]. There are many advantages to predictive models built using deep learning over our nomogram predictive models: deep learning technology performs very well and is very capable of learning; the neural networks of deep learning have many layers and are so wide that they can theoretically map to arbitrary functions so that they can overcome very difficult issues [52]; deep learning is extremely reliant on data, and more data are better for its performance; platform compatibility is high, etc. [53]. Similarly, the disadvantages of deep learning when compared with nomogram prediction models are prominent. Deep learning demands large amounts of data and computer power, making it expensive. In addition, numerous programs are not yet compatible with mobile devices. Deep learning demands a great level of computational power, and standard CPUs can no longer match its requirements, such that the hardware requirements are high and so are the costs. The model design for deep learning demands a substantial commitment of time and resources to build new algorithms and models, so it is highly complex [47]. Most people can only use off-the-shelf models. As deep learning is data-dependent and is not very interpretable, it is easy to have bias, etc. [54]. In summary, we chose to use R software to process the SEER data and construct the nomograms prediction model.

Few articles have researched PCLM risk factors alone. In gastrointestinal tumors such as liver, gastric, and colorectal cancers, the risk of concomitant liver metastases was significantly associated with advanced age, pathological type, poor tumor differentiation, bone metastases, lung metastases, high TNM stage, and unsystematic treatment [55,56,57]. In this investigation, we found that the risk variables for PC patients with concomitant liver metastasis were: male, main tumor site, pathological type, grade, T2 stage, N1 stage, metastases in the lungs and bones, larger tumor, and chemotherapy, which was a similar outcome to the results of previous studies [25]. Previous research has found that radiotherapy is a risk variable for bone metastases from pancreatic cancer; however, in our study, we found that radiotherapy was actually beneficial for patients with liver metastases [26]. This is probably because, on the one hand, the liver is relatively located on a superficial location, which facilitates stereotactic radiotherapy including 3D conformal radiotherapy techniques; on the other hand, pancreatic cancer has dense fibrous connective tissue, and this characteristic limits drug penetration to produce drug resistance while relatively limiting the tumor spread. Radiotherapy with radioactive particle implantation may be beneficial for patients with PCLM [58,59,60,61,62,63,64,65]. Based on these risk factors for liver metastasis, prompt CT or MRI imaging is clinically indicated for patients with suspected PCLM. We found by the multivariate Cox analysis that the age, type of pathology, degree of tumor differentiation, surgery, tumor size, bone metastasis, and lung metastasis were independent predictive variables of LM in PC patients. Combined with the risk and predictive variables that were acquired herein, the prognostic OS of PCLM patients can be more effectively assessed clinically to further guide the clinical decision-making and evaluation of PCBM patients.

In our study, we found that the main age group of PCLM patients was between 50 and 74 years. According to the Kaplan–Meier survival analysis, the prognosis of older patients had worse OS compared with younger patients [66,67]. This confirms earlier findings that older patients could be more susceptible to tumor immune escape as their autoimmune capacity decreases [68]. Epithelial–mesenchymal transition is closely related to tumor immune escape and can cause immune escape and distant metastasis by inducing the suppression of the CD8+ T cell role and by creating a local tumor suppressive microenvironment [69,70]. In the U.S., PC occurrence is slightly higher in men than in women, and in our study, we found more male patients with PCLM, accounting for 55.6% of the sample, which could be linked to men’s bad diet and lifestyle habits; however, the specific mechanism needs further study [71].

It has been reported that 60–70% of PC occurs in the head of the pancreas and about 15% each in the tail or the body of the pancreas [72]. In this study, the primary tumor site being in the tail of the pancreatic body was a risk factor for liver metastasis. This is related to the anatomical site of the pancreatic body. Besides invading the portal vein, pancreatic body tumors also tend to locally invade the liver and superior mesenteric vessels; meanwhile, besides invading the splenic vein, the growth of pancreatic tail tumors is usually unimpeded due to fewer adjacent structures [73]. Adenocarcinoma is the most common type of pathology in PC and is the one with the worst prognosis [74]. This is consistent with our findings, and the best relative prognosis for neuroendocrine cancer was found by survival analysis. In our study, the degree of tumor differentiation, bone metastases, brain metastases, and tumor size were risk and predictive variables for PCLM. Moreover, surgery was determined to be beneficial for patients with PCLM, whereas chemotherapy and radiotherapy had few results in terms of improving the prognosis of patients with advanced disease [75,76].

We used the clinical information of a large sample from the SEER database to construct a relatively complete and valid comprehensive evaluation model that could effectively assess the risk and outcome of PCLM patients. This study elucidated the function of multiple risk variables in estimating the outcome of PCLM patients. Constructing a web-based nomogram facilitates the actual use of the model, which is easy for clinicians to evaluate and make decisions based on the actual condition of patients; additionally, it also facilitates patients to actively cooperate with the treatment according to their prognosis. However, this research has certain drawbacks: first, it has some selection bias due to its retrospective nature, and subsequent prospective studies are needed; second, some clinical treatment information, such as tumor markers, is currently missing from the SEER database, and subsequent external validation is needed; finally, the clinical data are mainly from the U.S. population, and global multicenter investigations are needed for validating and improving the model applicability.

5. Conclusions

In this study, we identified risk variables for PCLM using univariate and multivariate logistic regression analyses and predictive factors for PCLM utilizing univariate and multivariate Cox regression analyses to establish two nomograms to anticipate the risk and outcome of PCLM. We then built a web-based nomogram that allows clinicians to facilitate early diagnosis, select personalized therapy strategies for PCLM patients, and improve patient prognosis.

Acknowledgments

We are grateful for the SEER database being an open platform, which facilitated our data collection and analysis.

Author Contributions

W.Z. designed the study; H.S. wrote the manuscript; H.S., X.L., Z.C., W.J., S.D. and R.H. collected and analyzed the data. The authors declare no potential conflict of interest and agree to publish and sign on the paper. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Ethics statement

The patient information in the SEER database is anonymous, and ethical consent was not required for using these data.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors without undue reservation.

Conflicts of Interest

The authors declare that they have no conflicting financial interests.

Funding Statement

This study was supported by the National Natural Science Foundation of China (82260555), Gansu Provincial TCM Research Project Fund (GZKP-2020-28), Medical Innovation and Development Project of Lanzhou University (lzuyxcx-2022-177), and Science and Technology Program of Chengguan District, Lanzhou City (2020-2-11-4).

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.Chen W., Zheng R., Baade P.D., Zhang S., Zeng H., Bray F., Jemal A., Yu X.Q., He J. Cancer statistics in China, 2015. CA Cancer J. Clin. 2016;66:115–132. doi: 10.3322/caac.21338. [DOI] [PubMed] [Google Scholar]
  • 2.Sung H., Ferlay J., Siegel R.L., Laversanne M., Soerjomataram I., Jemal A., Bray F. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J. Clin. 2021;71:209–249. doi: 10.3322/caac.21660. [DOI] [PubMed] [Google Scholar]
  • 3.Siegel R.L., Miller K.D., Fuchs H.E., Jemal A. Cancer statistics, 2022. CA Cancer J. Clin. 2022;72:7–33. doi: 10.3322/caac.21708. [DOI] [PubMed] [Google Scholar]
  • 4.Ferlay J., Partensky C., Bray F. More deaths from pancreatic cancer than breast cancer in the EU by 2017. Acta Oncol. 2016;55:1158–1160. doi: 10.1080/0284186X.2016.1197419. [DOI] [PubMed] [Google Scholar]
  • 5.Li Y.-X., Zhu X.-X., Wu X., Li J.-H., Ni X.-H., Li S.-J., Zhao W., Yin X.-X. ACLP promotes activation of cancer-associated fibroblasts and tumor metastasis via ACLP-PPARγ-ACLP feedback loop in pancreatic cancer. Cancer Lett. 2022;544:215802. doi: 10.1016/j.canlet.2022.215802. [DOI] [PubMed] [Google Scholar]
  • 6.Bello H.R., Sekhar A., Filice R.W., Radmard A.R., Davarpanah A.H. Pancreaticoduodenal Groove: Spectrum of Disease and Imaging Features. Radiographics. 2022;42:1062–1080. doi: 10.1148/rg.210168. [DOI] [PubMed] [Google Scholar]
  • 7.Fahmy U.A., Badr-Eldin S.M., Aldawsari H.M., Alhakamy N.A., Ahmed O.A.A., Radwan M.F., Eid B.G., Sayed S.R.M., Sherbiny G.A.E., Abualsunun W. Potentiality of raloxifene loaded melittin functionalized lipidic nanovesicles against pancreatic cancer cells. Drug Deliv. 2022;29:1863–1877. doi: 10.1080/10717544.2022.2072544. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Mayo S.C., Nathan H., Cameron J.L., Olino K., Edil B.H., Herman J.M., Hirose K., Schulick R.D., Choti M.A., Wolfgang C.L., et al. Conditional survival in patients with pancreatic ductal adenocarcinoma resected with curative intent. Cancer. 2012;118:2674–2681. doi: 10.1002/cncr.26553. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Groot V.P., Rezaee N., Wu W., Cameron J.L., Fishman E.K., Hruban R.H., Weiss M.J., Zheng L., Wolfgang C.L., He J. Patterns, Timing, and Predictors of Recurrence Following Pancreatectomy for Pancreatic Ductal Adenocarcinoma. Ann. Surg. 2018;267:936–945. doi: 10.1097/SLA.0000000000002234. [DOI] [PubMed] [Google Scholar]
  • 10.Stathis A., Moore M.J. Advanced pancreatic carcinoma: Current treatment and future challenges. Nat. Rev. Clin. Oncol. 2010;7:163–172. doi: 10.1038/nrclinonc.2009.236. [DOI] [PubMed] [Google Scholar]
  • 11.Shi S., Luo Y., Wang M., Lin Z., Song M., Li Z., Peng Z., Feng S.-T. Tumor fibrosis correlates with the survival of patients with pancreatic adenocarcinoma and is predictable using clinicoradiological features. Eur. Radiol. 2022;32:6314–6326. doi: 10.1007/s00330-022-08745-z. [DOI] [PubMed] [Google Scholar]
  • 12.Wood L.D., Canto M.I., Jaffee E.M., Simeone D.M. Pancreatic Cancer: Pathogenesis, Screening, Diagnosis, and Treatment. Gastroenterology. 2022;163:386–402.E1. doi: 10.1053/j.gastro.2022.03.056. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Guenther M., Boeck S., Heinemann V., Werner J., Engel J., Ormanns S. The impact of adjuvant therapy on outcome in UICC stage I pancreatic cancer. Int. J. Cancer. 2022;151:914–919. doi: 10.1002/ijc.34044. [DOI] [PubMed] [Google Scholar]
  • 14.Shi S., Liang C., Xu J., Meng Q., Hua J., Yang X., Ni Q., Yu X. The Strain Ratio as Obtained by Endoscopic Ultrasonography Elastography Correlates with the Stroma Proportion and the Prognosis of Local Pancreatic Cancer. Ann. Surg. 2020;271:559–565. doi: 10.1097/SLA.0000000000002998. [DOI] [PubMed] [Google Scholar]
  • 15.Kamisawa T., Isawa T., Koike M., Tsuruta K., Okamoto A. Hematogenous metastases of pancreatic ductal carcinoma. Pancreas. 1995;11:345–349. doi: 10.1097/00006676-199511000-00005. [DOI] [PubMed] [Google Scholar]
  • 16.Disibio G., French S.W. Metastatic patterns of cancers: Results from a large autopsy study. Arch. Pathol. Lab. Med. 2008;132:931–939. doi: 10.5858/2008-132-931-MPOCRF. [DOI] [PubMed] [Google Scholar]
  • 17.Oweira H., Petrausch U., Helbling D., Schmidt J., Mannhart M., Mehrabi A., Mehrabi A., Schöb O., Giryes A., Decker M., et al. Prognostic value of site-specific metastases in pancreatic adenocarcinoma: A Surveillance Epidemiology and End Results database analysis. World J. Gastroenterol. 2017;23:1872–1880. doi: 10.3748/wjg.v23.i10.1872. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Sato H., Yoshida R., Yasui K., Umeda Y., Yoshida K., Fuji T., Kumano K., Takagi K., Yagi T., Fujiwara T. Feasibility of local therapy for recurrent pancreatic cancer. Pancreatology. 2022;22:774–781. doi: 10.1016/j.pan.2022.05.004. [DOI] [PubMed] [Google Scholar]
  • 19.Yamada S., Kobayashi A., Nakamori S., Baba H., Yamamoto M., Yamaue H., Fujii T. Resection for recurrent pancreatic cancer in the remnant pancreas after pancreatectomy is clinically promising: Results of a project study for pancreatic surgery by the Japanese Society of Hepato-Biliary-Pancreatic Surgery. Surgery. 2018;164:1049–1056. doi: 10.1016/j.surg.2018.05.050. [DOI] [PubMed] [Google Scholar]
  • 20.Kurahara H., Maemura K., Mataki Y., Tanoue K., Iino S., Kawasaki Y., Idichi T., Arigami T., Mori S., Shinden Y., et al. Lung recurrence and its therapeutic strategy in patients with pancreatic cancer. Pancreatology. 2020;20:89–94. doi: 10.1016/j.pan.2019.11.015. [DOI] [PubMed] [Google Scholar]
  • 21.Shi W., Jiang R., Liang F., Yu G., Long J., Zhao J. Definitive chemoradiotherapy and salvage chemotherapy for patients with isolated locoregional recurrence after radical resection of primary pancreatic cancer. Cancer Manag. Res. 2019;11:5065–5073. doi: 10.2147/CMAR.S202543. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Yan L., Deng W., Guan L., Xu H. Nomogram forecasting 3-, 5-, and 8-year overall survival and cancer-specific survival of gingival squamous cell carcinoma. Cancer Med. 2020;9:8266–8274. doi: 10.1002/cam4.3436. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Khaliq F., Oberhauser J., Wakhloo D., Mahajani S. Decoding degeneration: The implementation of machine learning for clinical detection of neurodegenerative disorders. Neural Regen. Res. 2023;18:1235–1242. doi: 10.4103/1673-5374.355982. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Ahsan M.M., Uddin M.R., Ali M.S., Islam M.K., Farjana M., Sakib A.N., Momin K.A., Luna S.A. Deep transfer learning approaches for Monkeypox disease diagnosis. Expert Syst. Appl. 2023;216:119483. doi: 10.1016/j.eswa.2022.119483. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Zhang W., Ji L., Zhong X., Zhu S., Zhang Y., Ge M., Kang Y., Bi Q. Two Novel Nomograms Predicting the Risk and Prognosis of Pancreatic Cancer Patients with Lung Metastases: A Population-Based Study. Front. Public Health. 2022;10:884349. doi: 10.3389/fpubh.2022.884349. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Zhang W., Ji L., Wang X., Zhu S., Luo J., Zhang Y., Tong Y., Feng F., Kang Y., Bi Q. Nomogram Predicts Risk and Prognostic Factors for Bone Metastasis of Pancreatic Cancer: A Population-Based Analysis. Front. Endocrinol. 2021;12:752176. doi: 10.3389/fendo.2021.752176. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Sternberg C.N. Are nomograms better than currently available stage groupings for bladder cancer? J. Clin. Oncol. 2006;24:3819–3820. doi: 10.1200/JCO.2006.07.1290. [DOI] [PubMed] [Google Scholar]
  • 28.Duan C., Zhou X., Wang J., Li N., Liu F., Gao S., Liu X., Xu W. A radiomics nomogram for predicting the meningioma grade based on enhanced WI images. Br. J. Radiol. 2022;95:20220141. doi: 10.1259/bjr.20220141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Huang X., Luo Z., Fu D.-Y. ASO Author Reflections: Simplified Nomogram Predictive of Survival for Young Breast Cancer Patients. Ann. Surg. Oncol. 2022;29:5782–5783. doi: 10.1245/s10434-022-11966-7. [DOI] [PubMed] [Google Scholar]
  • 30.Ni Z., Wu B., Li M., Han X., Hao X., Zhang Y., Cheng W., Guo C. Prediction Model and Nomogram of Early Recurrence of Hepatocellular Carcinoma after Radiofrequency Ablation Based on Logistic Regression Analysis. Ultrasound Med. Biol. 2022;48:1733–1744. doi: 10.1016/j.ultrasmedbio.2022.04.217. [DOI] [PubMed] [Google Scholar]
  • 31.Huang X., Luo Z., Liang W., Xie G., Lang X., Gou J., Liu C., Xu X., Fu D. Survival Nomogram for Young Breast Cancer Patients Based on the SEER Database and an External Validation Cohort. Ann. Surg. Oncol. 2022;29:5772–5781. doi: 10.1245/s10434-022-11911-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Nakauchi M., Court C.M., Tang L.H., Gönen M., Janjigian Y.Y., Maron S.B., Molena D., Coit D.G., Brennan M.F., Strong V.E. Validation of the Memorial Sloan Kettering Gastric Cancer Post-Resection Survival Nomogram: Does It Stand the Test of Time? J. Am. Coll. Surg. 2022;235:294–304. doi: 10.1097/XCS.0000000000000251. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Peters M., Eldred-Evans D., Kurver P., Falagario U.G., Connor M.J., Shah T.T., Verhoeff J.J., Taimen P., Aronen H.J., Knaapila J., et al. Predicting the Need for Biopsy to Detect Clinically Significant Prostate Cancer in Patients with a Magnetic Resonance Imaging-detected Prostate Imaging Reporting and Data System/Likert ≥ 3 Lesion: Development and Multinational External Validation of the Imperial Rapid Access to Prostate Imaging and Diagnosis Risk Score. Eur. Urol. 2022;82:559–568. doi: 10.1016/j.eururo.2022.07.022. [DOI] [PubMed] [Google Scholar]
  • 34.Cheng P., Chen H., Huang F., Li J., Liu H., Zheng Z., Lu Z. Nomograms predicting cancer-specific survival for stage IV colorectal cancer with synchronous lung metastases. Sci. Rep. 2022;12:13952. doi: 10.1038/s41598-022-18258-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Iasonos A., Schrag D., Raj G.V., Panageas K.S. How to build and interpret a nomogram for cancer prognosis. J. Clin. Oncol. 2008;26:1364–1370. doi: 10.1200/JCO.2007.12.9791. [DOI] [PubMed] [Google Scholar]
  • 36.Sasaki K., Ravandi F., Kadia T.M., DiNardo C.D., Short N.J., Borthakur G., Jabbour E., Kantarjian H.M. De novo acute myeloid leukemia: A population-based study of outcome in the United States based on the Surveillance, Epidemiology, and End Results (SEER) database, 1980 to 2017. Cancer. 2021;127:2049–2061. doi: 10.1002/cncr.33458. [DOI] [PubMed] [Google Scholar]
  • 37.Chen H., Kong Y., Yao Q., Zhang X., Fu Y., Li J., Liu C., Wang Z. Three hypomethylated genes were associated with poor overall survival in pancreatic cancer patients. Aging. 2019;11:885–897. doi: 10.18632/aging.101785. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Li D., Xie K., Wolff R., Abbruzzese J.L. Pancreatic cancer. Lancet. 2004;363:1049–1057. doi: 10.1016/S0140-6736(04)15841-8. [DOI] [PubMed] [Google Scholar]
  • 39.Bertelli E., Di Gregorio F., Bertelli L., Mosca S. The arterial blood supply of the pancreas: A review. I. The superior pancreaticoduodenal and the anterior superior pancreaticoduodenal arteries. An anatomical and radiological study. Surg. Radiol. Anat. 1995;17:97–106. doi: 10.1007/BF01627566. [DOI] [PubMed] [Google Scholar]
  • 40.Azizoglu D.B., Chong D.C., Villasenor A., Magenheim J., Barry D.M., Lee S., Marty-Santos L., Fu S., Dor Y., Cleaver O. Vascular development in the vertebrate pancreas. Dev. Biol. 2016;420:67–78. doi: 10.1016/j.ydbio.2016.10.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Hu J.-X., Zhao C.-F., Chen W.-B., Liu Q.-C., Li Q.-W., Lin Y.-Y., Gao F. Pancreatic cancer: A review of epidemiology, trend, and risk factors. World J. Gastroenterol. 2021;27:4298–4321. doi: 10.3748/wjg.v27.i27.4298. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Siegel R., Naishadham D., Jemal A. Cancer statistics, 2012. CA Cancer J. Clin. 2012;62:10–29. doi: 10.3322/caac.20138. [DOI] [PubMed] [Google Scholar]
  • 43.Wright G.P., Poruk K.E., Zenati M.S., Steve J., Bahary N., Hogg M.E., Zuriekat A.H., Wolfgang C.L., 3rd H.J.Z., Weiss M.J. Primary Tumor Resection Following Favorable Response to Systemic Chemotherapy in Stage IV Pancreatic Adenocarcinoma with Synchronous Metastases: A Bi-institutional Analysis. J. Gastrointest. Surg. 2016;20:1830–1835. doi: 10.1007/s11605-016-3256-2. [DOI] [PubMed] [Google Scholar]
  • 44.Crippa S., Bittoni A., Sebastiani E., Partelli S., Zanon S., Lanese A., Andrikou K., Muffatti F., Balzano G., Reni M., et al. Is there a role for surgical resection in patients with pancreatic cancer with liver metastases responding to chemotherapy? Eur. J. Surg. Oncol. 2016;42:1533–1539. doi: 10.1016/j.ejso.2016.06.398. [DOI] [PubMed] [Google Scholar]
  • 45.Gleisner A.L., Assumpcao L., Cameron J.L., Wolfgang C.L., Choti M.A., Herman J.M., Schulick R.D., Pawlik T.M. Is resection of periampullary or pancreatic adenocarcinoma with synchronous hepatic metastasis justified? Cancer. 2007;110:2484–2492. doi: 10.1002/cncr.23074. [DOI] [PubMed] [Google Scholar]
  • 46.Koike T., Tomii N., Watanabe Y., Azuma T., Takagi S. Deep learning for hetero-homo conversion in channel-domain for phase aberration correction in ultrasound imaging. Ultrasonics. 2023;129:106890. doi: 10.1016/j.ultras.2022.106890. [DOI] [PubMed] [Google Scholar]
  • 47.Abd El-Wahab B.S., Nasr M.E., Khamis S., Ashour A.S. BTC-fCNN: Fast Convolution Neural Network for Multi-class Brain Tumor Classification. Health Inf. Sci. Syst. 2023;11:3. doi: 10.1007/s13755-022-00203-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Diao Y., Jelescu I. Parameter estimation for WMTI-Watson model of white matter using encoder-decoder recurrent neural network. Magn. Reson. Med. 2023;89:1193–1206. doi: 10.1002/mrm.29495. [DOI] [PubMed] [Google Scholar]
  • 49.Shi R., Sheng C., Jin S., Zhang Q., Zhang S., Zhang L., Ding C., Wang L., Wang L., Han Y., et al. Generative adversarial network constrained multiple loss autoencoder: A deep learning-based individual atrophy detection for Alzheimer’s disease and mild cognitive impairment. Hum. Brain Mapp. 2023;44:1129–1146. doi: 10.1002/hbm.26146. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Chen Y., Han S., Chen G., Yin J., Wang K.N., Cao J. A deep reinforcement learning-based wireless body area network offloading optimization strategy for healthcare services. Health Inf. Sci. Syst. 2023;11:8. doi: 10.1007/s13755-023-00212-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.LeCun Y., Bengio Y., Hinton G. Deep learning. Nature. 2015;521:436–444. doi: 10.1038/nature14539. [DOI] [PubMed] [Google Scholar]
  • 52.Wu X., Li R., He Z., Yu T., Cheng C. A value-based deep reinforcement learning model with human expertise in optimal treatment of sepsis. NPJ Digit. Med. 2023;6:15. doi: 10.1038/s41746-023-00755-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Yuan D., Liu Y., Xu Z., Zhan Y., Chen J., Lukasiewicz T. Painless and accurate medical image analysis using deep reinforcement learning with task-oriented homogenized automatic pre-processing. Comput. Biol. Med. 2023;153:106487. doi: 10.1016/j.compbiomed.2022.106487. [DOI] [PubMed] [Google Scholar]
  • 54.Daneshjou R., Smith M.P., Sun M.D., Rotemberg V., Zou J. Lack of Transparency and Potential Bias in Artificial Intelligence Data Sets and Algorithms: A Scoping Review. JAMA Dermatol. 2021;157:1362–1369. doi: 10.1001/jamadermatol.2021.3129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Liu C., Wang T., Yang J., Zhang J., Wei S., Guo Y., Yu R., Tan Z., Wang S., Dong W. Distant Metastasis Pattern and Prognostic Prediction Model of Colorectal Cancer Patients Based on Big Data Mining. Front. Oncol. 2022;12:878805. doi: 10.3389/fonc.2022.878805. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Lin Z., Wang R., Zhou Y., Wang Q., Yang C.-Y., Hao B.-C., Ke C.-F. Prediction of distant metastasis and survival prediction of gastric cancer patients with metastasis to the liver, lung, bone, and brain: Research based on the SEER database. Ann. Transl. Med. 2022;10:16. doi: 10.21037/atm-21-6295. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Chen X., Lu Y., Shi X., Chen X., Rong D., Han G., Zhang L., Ni C., Zhao J., Gao Y., et al. Morbidity, Prognostic Factors, and Competing Risk Nomogram for Combined Hepatocellular-Cholangiocarcinoma. J. Oncol. 2021;2021:3002480. doi: 10.1155/2021/3002480. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Van der Velden J., Willmann J., Spałek M., Oldenburger E., Brown S., Kazmierska J., Andratschke N., Menten J., Linden Y.V.D., Hoskin P. ESTRO ACROP guidelines for external beam radiotherapy of patients with uncomplicated bone metastases. Radiother. Oncol. 2022;173:197–206. doi: 10.1016/j.radonc.2022.05.024. [DOI] [PubMed] [Google Scholar]
  • 59.Moustakis C., Blanck O., Chan M.K.H., Boda-Heggemann J., Andratschke N., Duma M.-N., Albers D., Bäumer C., Fehr R., Körber S.A., et al. Planning Benchmark Study for Stereotactic Body Radiation Therapy of Liver Metastases: Results of the DEGRO/DGMP Working Group on Stereotactic Radiation Therapy and Radiosurgery. Int. J. Radiat. Oncol. Biol. Phys. 2022;113:214–227. doi: 10.1016/j.ijrobp.2022.01.008. [DOI] [PubMed] [Google Scholar]
  • 60.Nakamura A., Hiraoka M., Itasaka S., Nakamura M., Akimoto M., Ishihara Y., Mukumoto N., Goto Y., Kishi T., Yoshimura M., et al. Evaluation of Dynamic Tumor-tracking Intensity-modulated Radiotherapy for Locally Advanced Pancreatic Cancer. Sci. Rep. 2018;8:17096. doi: 10.1038/s41598-018-35402-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Liu Y., Lyu S.-C., Wang X.-Q., Wang Y.-B. Application of preoperative three-dimensional model design in radioactive particle implantation for advanced pancreatic cancer. OncoTargets Ther. 2018;11:8685–8693. doi: 10.2147/OTT.S164880. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Hosein A.N., Brekken R.A., Maitra A. Pancreatic cancer stroma: An update on therapeutic targeting strategies. Nat. Rev. Gastroenterol. Hepatol. 2020;17:487–505. doi: 10.1038/s41575-020-0300-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Montemurro N., Condino S., Carbone M., Cattari N., D’Amato R., Cutolo F., Ferrari V. Brain Tumor and Augmented Reality: New Technologies for the Future. Int. J. Environ. Res. Public Health. 2022;19:6347. doi: 10.3390/ijerph19106347. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Templin R., Tabriz N., Hoffmann M., Uslar V.N., Lück T., Schenk A., Malaka R., Zachmann G., Kluge A., Weyhe D. Case Report: Virtual and Interactive 3D Vascular Reconstruction Before Planned Pancreatic Head Resection and Complex Vascular Anatomy: A Bench-To-Bedside Transfer of New Visualization Techniques in Pancreatic Surgery. Front. Surg. 2020;7:38. doi: 10.3389/fsurg.2020.00038. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Grützmann R., Kersting S., Distler M., Weitz J. Arterial reconstruction in pancreatic carcinoma–demonstration of surgical techniques. Zentralbl. Chir. 2014;139:261–264. doi: 10.1055/s-0034-1368573. [DOI] [PubMed] [Google Scholar]
  • 66.Xu Y., Zhang Y., Han S., Jin D., Xu X., Kuang T., Wu W., Wang D., Luo W. Prognostic Effect of Age in Resected Pancreatic Cancer Patients: A Propensity Score Matching Analysis. Front. Oncol. 2022;12:789351. doi: 10.3389/fonc.2022.789351. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Van Dongen J.C., van der Geest L.G.M., de Meijer V.E., van Santvoort H.C., de Vos-Geelen J., Besselink M.G., Koerkamp B.G., Wilmink J.W., Eijck C.H.J.V., Group D.P.C. Age and prognosis in patients with pancreatic cancer: A population-based study. Acta Oncol. 2022;61:286–293. doi: 10.1080/0284186X.2021.2016949. [DOI] [PubMed] [Google Scholar]
  • 68.Liu Y., Kang R., Zheng H., Wang P., Jiang W., Xiong B., Chen J., Xu J. Female Colon Cancer Metastasis Pattern and Prognosis: A SEER-Based Study. Biomed Res. Int. 2022;2022:3865601. doi: 10.1155/2022/3865601. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
  • 69.Chen L., Gibbons D.L., Goswami S., Cortez M.A., Ahn Y.-H., Byers L.A., Zhang X., Yi X., Dwyer D., Lin W., et al. Metastasis is regulated via microRNA-200/ZEB1 axis control of tumour cell PD-L1 expression and intratumoral immunosuppression. Nat. Commun. 2014;5:5241. doi: 10.1038/ncomms6241. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Ortiz-Cuaran S., Swalduz A., Foy J.-P., Marteau S., Morel A.-P., Fauvet F., Souza G.D., Michon L., Boussageon M., Gadot N., et al. Epithelial-to-mesenchymal transition promotes immune escape by inducing CD70 in non-small cell lung cancer. Eur. J. Cancer. 2022;169:106–122. doi: 10.1016/j.ejca.2022.03.038. [DOI] [PubMed] [Google Scholar]
  • 71.Park W., Chawla A., O’Reilly E.M. Pancreatic Cancer: A Review. JAMA. 2021;326:851–862. doi: 10.1001/jama.2021.13027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Godeau D., Petit A., Richard I., Roquelaure Y., Descatha A. Return-to-work, disabilities and occupational health in the age of COVID-19. Scand. J. Work. Environ. Health. 2021;47:408–409. doi: 10.5271/sjweh.3960. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Schmidt-Hansen M., Berendse S., Hamilton W. Symptoms of Pancreatic Cancer in Primary Care: A Systematic Review. Pancreas. 2016;45:814–818. doi: 10.1097/MPA.0000000000000527. [DOI] [PubMed] [Google Scholar]
  • 74.Pokrzywa C.J., Abbott D.E., Matkowskyj K.A., Ronnekleiv-Kelly S.M., Winslow E.R., Weber S.M., Fisher A.V. Natural History and Treatment Trends in Pancreatic Cancer Subtypes. J. Gastrointest. Surg. 2019;23:768–778. doi: 10.1007/s11605-019-04113-3. [DOI] [PubMed] [Google Scholar]
  • 75.Yip D., Karapetis C., Strickland A., Steer C.B., Goldstein D. Chemotherapy and radiotherapy for inoperable advanced pancreatic cancer. Cochrane Database Syst. Rev. 2006;19:CD002093. doi: 10.1002/14651858.CD002093.pub2. [DOI] [PubMed] [Google Scholar]
  • 76.Middleton G., Ghaneh P., Costello E., Greenhalf W., Neoptolemos J.P. New treatment options for advanced pancreatic cancer. Expert Rev. Gastroenterol. Hepatol. 2008;2:673–696. doi: 10.1586/17474124.2.5.673. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors without undue reservation.


Articles from Journal of Personalized Medicine are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES