Skip to main content
Cancers logoLink to Cancers
. 2020 May 14;12(5):1235. doi: 10.3390/cancers12051235

A Preoperative Clinical Risk Score Including C-Reactive Protein Predicts Histological Tumor Characteristics and Patient Survival after Surgery for Sporadic Non-Functional Pancreatic Neuroendocrine Neoplasms: An International Multicenter Cohort Study

Florian Primavesi 1, Valentina Andreasi 2, Frederik JH Hoogwater 3, Stefano Partelli 2, Dominik Wiese 4, Charlotte Heidsma 5, Benno Cardini 1, Eckhard Klieser 6, Katharina Marsoner 7, Uwe Fröschl 8, Sabine Thalhammer 9, Ines Fischer 8, Georg Göbel 10, Andreas Hauer 11, Tobias Kiesslich 12, Philipp Ellmerer 13, Reinhold Klug 11, Daniel Neureiter 6, Helwig Wundsam 8, Franz Sellner 9, Peter Kornprat 7, Reinhold Függer 8, Dietmar Öfner 1, Elisabeth JM Nieveen van Dijkum 5, Detlef K Bartsch 4, Ruben HJ de Kleine 3, Massimo Falconi 2, Stefan Stättner 1,*
PMCID: PMC7280962  PMID: 32423000

Abstract

Background: Oncological survival after resection of pancreatic neuroendocrine neoplasms (panNEN) is highly variable depending on various factors. Risk stratification with preoperatively available parameters could guide decision-making in multidisciplinary treatment concepts. C-reactive Protein (CRP) is linked to inferior survival in several malignancies. This study assesses CRP within a novel risk score predicting histology and outcome after surgery for sporadic non-functional panNENs. Methods: A retrospective multicenter study with national exploration and international validation. CRP and other factors associated with overall survival (OS) were evaluated by multivariable cox-regression to create a clinical risk score (CRS). Predictive values regarding OS, disease-specific survival (DSS), and recurrence-free survival (RFS) were assessed by time-dependent receiver-operating characteristics. Results: Overall, 364 patients were included. Median CRP was significantly higher in patients >60 years, G3, and large tumors. In multivariable analysis, CRP was the strongest preoperative factor for OS in both cohorts. In the combined cohort, CRP (cut-off ≥0.2 mg/dL; hazard-ratio (HR):3.87), metastases (HR:2.80), and primary tumor size ≥3.0 cm (HR:1.83) showed a significant association with OS. A CRS incorporating these variables was associated with postoperative histological grading, T category, nodal positivity, and 90-day morbidity/mortality. Time-dependent area-under-the-curve at 60 months for OS, DSS, and RFS was 69%, 77%, and 67%, respectively (all p < 0.001), and the inclusion of grading further improved the predictive potential (75%, 84%, and 78%, respectively). Conclusions: CRP is a significant marker of unfavorable oncological characteristics in panNENs. The proposed internationally validated CRS predicts histological features and patient survival.

Keywords: pancreatic neuroendocrine tumors, C-reactive protein, risk score, neuroendocrine neoplasms, pancreas, surgery, survival

1. Introduction

Pancreatic neuroendocrine neoplasms (panNENs) represent heterogeneous and rare tumors despite a rising incidence [1]. Treatment and outcome are determined by underlying genetic syndromes (e.g., multiple endocrine neoplasia), functional activity (e.g., insulinoma), symptoms (flushing, pain, jaundice), and histopathological variables like grading or lymph node status [2,3,4]. Accordingly, the therapeutic landscape comprises a variety of treatments, including somatostatin analogs, peptide receptor radionuclide therapy (PRRT), chemotherapy, surgery, and ablation [5]. However, in most panNENs, surgery remains the cornerstone of curative intent therapy in resectable disease [6].

Several risk-scoring systems have been proposed [7,8,9], and most of them are composed of factors not reliably available before surgery, e.g., lymph node positivity or microvascular/perineural invasion. Additionally, tumor grading is often included, but assessment by means of preoperative biopsy with the Ki-67 proliferative index may be challenging due to insufficient samples or intratumoral heterogeneity [10,11,12]. Thus, for the prediction of postoperative morbidity, histological features, and estimated overall, disease-specific, and recurrence-free survival (OS, DSS, and RFS), a risk score with preoperative ideally non-invasively available factors is highly desirable for guidance of potential (neo-)adjuvant therapeutic concepts, especially in high-risk individuals [13,14].

The systemic inflammatory status affects tumor growth, metastatic behavior, and the host response in numerous malignancies, including pancreatic and esophageal carcinoma, colorectal cancer, and gastroenteropancreatic neuroendocrine tumors. C-reactive protein (CRP) has been assessed as a marker of outcome in a plethora of tumor entities [15,16,17,18,19,20]. Furthermore, its potential to promote malignancy in panNENs has been shown in an in vitro study [21], and an association with long-term patient outcomes was confirmed in a retrospective single-center analysis [22]. However, conclusions from the latter study are limited since it included a rather heterogeneous cohort and lacked external validation or correlation of CRP with postoperative complications.

The present work utilized national multicenter data (Austrian Society of Surgical Oncology/ASSO cohort [2]) validated by an international multicenter cohort (IMC) to evaluate the association of preoperative CRP with postoperative histology, surgical short-term, and oncological long-term outcomes after curative intent resection of sporadic non-functional (NF) panNENs. Furthermore, a novel predictive risk score based on purely preoperatively available factors is presented.

2. Results

2.1. Patient Characteristics, Procedures, and Outcomes

In summary, 364 patients undergoing curative intent pancreatic resection were included, 160 from the ASSO cohort and 204 from the IMC. In total, 104 patients (28.6%) underwent pancreaticoduodenectomy, 190 (52.2%) distal resection, 52 (14.3%) enucleation, and 18 (4.9%) total pancreatectomy. Here, 90-day mortality was 2.7%, and overall and severe morbidity were 58% and 10.2%, respectively. Overall morbidity (p = 0.773) and severe morbidity (p = 0.854) were not associated with OS. Table 1 presents the characteristics of patients and tumors as well as the outcomes according to the two cohorts. The national cohort was comprised of patients with a higher median age, and preoperative CRP, as well as significantly more advanced panNENs in terms of grading, T categories, and the presence of metastases.

Table 1.

Comparison of the national Austrian Society of Surgical Oncology (ASSO) cohort and international multicenter cohort (IMC) of patients undergoing curative intent surgery for pancreatic neuroendocrine neoplasm (panNEN).

Characteristics ASSO (n = 160) IMC (n = 204) P
Female gender 76 (47.5%) 87 (42.6%) 0.355
Age (years; median; IQR) 62.4 (53.2; 69.5) 60.0 (50.0; 67.0) 0.037
Preoperative symptoms 0.093
No symptoms 105 (65.6%) 134 (65.7%)
Pain 23 (14.4%) 43 (21.1%)
Others (including jaundice) or multiple 32 (20.0%) 27 (13.2%)
Preoperative Bilirubin ≥ 4 mg/dL 7 (4.4%) 10 (4.9%) 0.813
Preoperative CRP (mg/dL; median; IQR) 0.30 (0.12; 0.69) 0.25 (0.19; 0.65) 0.037
Metastases present 27 (16.9%) 13 (6.4%) 0.001
Primary tumor size ≥3 cm 79 (49.4%) 84 (41.2%) 0.118
Tumor location 0.068
Head 55 (34%) 81 (39.7%)
Body/Tail 96 (60.0%) 120 (58.8%)
Multiple 9 (5.6%) 3 (1.5%)
ENETS T-category 0.003
T1/T2 90 (56.3%) 145 (71.1%)
T3/T4 70 (43.8%) 59 (28.9%)
Nodal status 0.249
Nodal-negative 102 (63.8%) 114 (55.9%)
Nodal-positive 40 (25.0%) 57 (27.9%)
Nodal-status unknown (Nx) 18 (11.3%) 33 (16.2%)
Tumor grading (missing: 6) 0.002
G1 66 (42.0%) 120 (59.7%)
G2 71 (45.2%) 68 (33.8%)
G3 20 (12.7%) 13 (6.5%)
R0 resection margin (missing: 3) 141 (89.8%) 184 (90.2%) 0.903
90-day severe morbidity 20 (12.5%) 17 (8.3%) 0.192
90-day mortality 6 (3.8%) 4 (2.0%) 0.345
Follow-up for OS (months; median; IQR) 57.5 (28.3; 83.3) 38.2 (20.1; 73.2) 0.006
Death during follow-up 37 (23.1%) 27 (13.2%) 0.014
Estimated 5-yr/10-yr OS after resection * 80.1%/57% 89.5%/76.4% 0.069
Estimated 5-yr/10-yr DSS after resection * 87.0%/76.9% 96.5%/90.7% 0.037
Recurrence during follow-up (missing: 4) 43 (27.6%) 43 (21.1%) 0.153

* median not reached in the ASSO cohort, therefore 5/10-year survival is presented. ASSO = Austrian Society of Surgical Oncology; CRP = C-reactive protein; DSS = Disease-specific survival; ENETS = European Neuroendocrine Tumor Society; IMC = International Multicenter Cohort; IQR = Interquartile range; OS = Overall survival; yr = year.

The estimated 5-year and 10-year OS was 84.7% and 66.2% in the whole cohort (median: 321.9 months; 95%CI not computable), with 80.1% and 57.0% in the ASSO and 89.5% and 76.4% in the IMC cohort (p = 0.069). The 5-year and 10-year DSS was 91.2% and 79.2% in the whole cohort (median not reached), with 87.0% and 76.9% in the ASSO and 96.5% and 90.7% in the IMC cohort (p = 0.037). The estimated 5-year and 10-year RFS was 72.2% and 59.2% in the whole cohort (median not reached), with no significant difference between the ASSO and IMC cohort (70.8% and 56.9% compared to 72.7% and 60.9%; p = 0.358).

2.2. Association of Increased CRP with Other Factors and Outcome

The median CRP levels were significantly higher in patients ≥60 years and in cases with tumor size ≥3 cm or with G3 grading (Figure 1). Optimal cut-offs in regard to association with OS and DSS were calculated at ≥0.2 mg/dL for high versus low CRP and ≥3.0 cm for small versus large tumor size. Patients with CRP values ≥0.2 mg/dL (n = 226 of 364) revealed a significantly increased median age as well as a higher frequency of symptoms other than pain (see Table S1, Supplemental Digital Content). Additionally, tumor characteristics associated with an aggressive biology, such as G3 grading (p = 0.048) and size ≥3 cm (p = 0.090), were more common in the high-CRP group.

Figure 1.

Figure 1

C-reactive protein levels in the whole cohort stratified by patients’ age, grading, tumor size, and presence of metastases (bar charts indicate median values and 95% confidence intervals).

2.3. Analysis of Preoperative Factors and Survival

Univariable analysis of preoperative factors and OS after surgery in the ASSO cohort (Figure 2 and Table 2) showed a significant association with CRP ≥0.2 mg/dL (HR 4.13; 95%CI 1.46–11.7), metastases (HR: 3.32; 95%CI 1.64–6.71), tumor-size ≥3 cm (HR 2.41; 95%CI 1.21–4.82), symptoms other than pain (HR 2.18; 95%CI 1.03–4.62), and age (HR: 1.59 per 10 years; 95%CI 1.18–2.13). Multivariable analysis confirmed the independent association of CRP with decreased OS in the ASSO (HR 2.98) and the IMC cohort (HR 6.30), alongside the presence of metastases (HR 2.57 in the ASSO cohort) and age (HR 1.6 in both cohorts; all p < 0.05). In the combined analysis of all 364 patients, CRP ≥0.2 mg/dL (HR 3.87; 95%CI 1.65–9.07; p = 0.002), metastases (HR 2.80; 1.49–5.25; p = 0.001), tumor size ≥3 cm (HR 1.83; 95%CI 1.05–3.16; p = 0.034), and age (HR 1.56 per 10 years; 95%CI 1.24–1.97; p < 0.001) remained significant factors for OS. Due to the limited availability of preoperative biopsies with grading in our cohort, we did not include this variable into the initial regression analysis.

Figure 2.

Figure 2

Kaplan–Meier curves for overall survival in the national ASSO cohort stratified by (A) preoperative CRP (cut-off 0.2 mg/dL; p = 0.004), (B) tumor size (cut-off 3 cm; p = 0.010), (C) metastases (p < 0.001), (D) symptoms (no symptoms versus pain p = 0.178; no symptoms versus other/multiple symptoms p = 0.037). CRP = C-reactive protein.

Table 2.

Univariable and multivariable analysis of preoperative factors associated with overall survival.

Univariable Analysis Multivariable Analysis
Factor ASSO Cohort (n = 160) ASSO Cohort (n = 160) IMC Cohort (n = 204) Combined (n = 364)
HR (95%CI) p HR (95%CI) p HR (95%CI) p HR (95%CI) p
Male sex 1.23 (0.64–2.35) 0.525 1.26 (0.65–2.44) 0.499 0.83 (0.37–1.86) 0.647 1.02 (0.62–1.69) 0.931
CRP (≥0.2 mg/dL) 4.13 (1.46–11.7) 0.007 2.98 (1.03–8.62) 0.044 6.30 (1.46–27.3) 0.014 3.87 (1.65–9.07) 0.002
TU size (≥3 cm) 2.41 (1.21–4.82) 0.013 1.58 (0.75–3.32) 0.231 2.29 (0.97–5.42) 0.059 1.83 (1.05–3.19) 0.034
Metastases 3.32 (1.64–6.71) 0.001 2.57 (1.20–5.53) 0.016 3.26 (0.88–12.0) 0.076 2.80 (1.49–5.25) 0.001
Age (10yrs.) 1.59 (1.18–2.13) 0.002 1.59 (1.17–2.15) 0.003 1.60 (1.10–2.32) 0.015 1.56 (1.24–1.97) <0.001
TU location
Head Ref. - - -
Body/Tail 0.61 (0.31–1.20) 0.155 - - -
Multiple 1.50 (0.43–5.18) 0.526 - - -
Symptoms
None Ref.
Pain 1.79 (0.78–4.13) 0.172 1.89 (0.80–4.47) 0.146 1.40 (0.53–3.69) 0.493 1.58 (0.84–2.97) 0.154
Others 2.18 (1.03–4.62) 0.042 1.47 (0.66–3.28) 0.341 1.75 (0.53–5.81) 0.360 1.44 (0.76–2.73) 0.260

Tumor location was not included in the multivariable analysis due to multicollinearity. ASSO = Austrian Society of Surgical Oncology; CRP = C-reactive protein; HR = Hazards ratio; IMC = International multicenter; Ref. = Reference category; TU = pancreatic tumor; yrs = years.

2.4. Association of Preoperative CRP with OS, DSS, and RFS

To investigate the underlying causal coherences of CRP and decreased OS, we further investigated factors associated with recurrence. Relapse of panNEN was significantly associated with decreased OS (median 117.5 months vs. median not reached; 5-year OS: 67.7% vs. 91.9%; p < 0.001). Additionally, CRP ≥0.2 mg/dL was linked to pan-NEN-related deaths (both median not reached; 5-year DSS: 87.7% vs. 98% and 10-year DSS: 78.2% vs. 98%; p = 0.002) However, CRP ≥0.2 mg/dL was not associated with inferior RFS (both median not reached; 5-year RFS: 72.2% vs. 70.4%; p = 0.893) or a significantly increased recurrence rate (25.6% vs. 21.2%; p = 0.343) We therefore hypothesized that recurrence in high-CRP cases might not occur earlier or more often but may be associated with more aggressive behavior of tumor relapse and impaired host-defensive abilities. Patients with increased CRP were found to have more multisite or extra-pancreatic/extra-hepatic recurrence (43.9% vs. 34.5%), although this was not statistically significant (p = 0.403). Additionally, survival after recurrence was used as a surrogate to determine if relapse more frequently leads to patient death in cases with high baseline CRP. In patients with recurrence (n = 86), median OS from the time point of recurrence was markedly different between patients with high CRP (n = 57) versus low CRP (n = 29): 29.3 months (95%CI 8.5–50.0) versus 62.2 months (95%CI 0.0–132.8; p = 0.004). This also applied to panNEN-related death rates after recurrence with a 5-year DSS of 40.3% compared to 88% (median 42.5 months, 95%CI 27.4–57.6 vs. not median reached; p = 0.003).

2.5. Development of a Clinical Risk Score Including CRP

To create a preoperative clinical risk score (CRS) allowing an estimate of postoperative patient survival, we combined three factors most strongly associated with OS in the multivariable model (CRP ≥0.2 mg/dL, presence of metastases, and tumor size ≥3 cm). Each factor was assigned one point, resulting in four scoring groups with increasing risk (CRS:0 to CRS:3). The characteristics of patients in each group in the combined panNEN cohort are presented in Table 3. A higher CRS was associated with histologically aggressive characteristics, such as G2/G3 grading (p < 0.001), T3/T4 category (p < 0.001), and lymph node positivity (p = 0.002). Moreover, the 90-day overall morbidity (p = 0.006) and mortality (p = 0.004) were increased in CRS-high patients, reflecting the technical challenges of resection in advanced disease cases. Ultimately, the 5-year and 10-year OS, DSS, and RFS were all markedly reduced in these patients (p < 0.001), even after removing patients with 90-day mortality (all p < 0.001).

Table 3.

Patient characteristics, postoperative histopathological details, and outcomes according to pancreatic neuroendocrine neoplasm (panNEN) clinical risk score groups (combined cohort; n = 364).

CRS: 0
(n = 82)
CRS: 1
(n = 157)
CRS: 2
(n = 103)
CRS: 3
(n = 22)
Risk score variables Number (Percentage)
CRP ≥0.2 mg/dL 0 (0%) 112 (71.3%) 92 (89.3%) 22 (100%)
Tumor size ≥3 cm 0 (0%) 43 (27.4%) 98 (95.1%) 22 (100%)
Metastases present 0 (0%) 2 (1.3%) 16 (15.5%) 22 (100%)
Patient and tumor characteristics Number (Percentage) p
Male gender 48 (58.5%) 88 (56.1%) 52 (50.5%) 13 (59.1%) 0.688
Age (years; median; IQR) 59.7 (15.0) 61.2 (16.8) 61.9 (16.1) 63.2 (18.6) 0.664
Grading (missing = 6) <0.001
G1 55 (67.1%) 90 (58.1%) 37 (37.0%) 4 (19.0%)
G2 26 (31.7%) 55 (35.5%) 46 (46.0%) 12 (57.1%)
G3 1 (1.2%) 10 (6.5%) 17 (17.0%) 5 (23.8%)
T3/T4 category 5 (6.1%) 32 (20.4%) 73 (70.9%) 19 (86.4%) <0.001
Positive nodal status 16 (19.5%) 35 (22.3%) 34 (33.0%) 12 (54.5%) 0.002
R1 resection margin (missing = 3) 5 (6.2%) 13 (8.4%) 15 (14.6%) 3 (13.6%) 0.214
Outcome Number (Percentage) p
90-day overall complications 41 (50.0%) 83 (52.9%) 69 (67.0%) 18 (81.8%) 0.006
Pancreatic fistula ISGPF B/C 12 (14.6%) 21 (13.3%) 15 (14.3%) 3 (13.6%) 0.817
90-day severe complications 8 (9.8%) 15 (9.6%) 10 (9.7%) 4 (18.2%) 0.620
90-day mortality 1 (1.2%) 1 (0.6%) 5 (4.9%) 3 (13.6%) 0.004
5-year/10-year OS (estimated) 94.8%/94.8% 90.8%/74.0% 77.8%/51.4% 45.5%/34.1% <0.001
5-year/10-year DSS (estimated) 98.0%/98.0% 97.3%/88.4% 85.7%/78.1% 52.7%/39.5% <0.001
5-year/10-year RFS (estimated) 91.9%/84.2% 79.1%/66.3% 61.3%/48.8% 9.4%/0% <0.001

CRP = C-reactive protein; CRS = clinical risk score; DSS = Disease-specific survival; IQR = Interquartile range; ISGPF = International study group for pancreatic fistula; OS = Overall survival; panNEN = pancreatic neuroendocrine neoplasm; RFS = Recurrence-free survival.

In line with the abovementioned different baseline characteristics of the ASSO and IMC cohorts (Table 1), 43.1% of patients presented with a CRS:2 or CRS:3 in the ASSO cohort, while only 27.4% were graded similarly in the IMC cohort (p = 0.004).

2.6. Oncological Outcome According to the Clinical Risk Score

From CRS:0 to CRS:3, each additional risk factor resulted in an increased probability of death (OS) during follow-up with an HR of 2.62 (95%CI 1.91–3.60; p < 0.001) and panNEN-related death (DSS) with an HR of 3.53 (95%CI 2.20–5.68; p < 0.001; Cox-proportional hazards regression). Figure 3 depicts the Kaplan–Meier curves for OS, DSS, and RFS stratified by CRS groups in the combined cohort. The score significantly predicted OS (Figure 3A; overall p < 0.001), although with limited discrimination between low-risk subgroups (p = 0.143). Time-dependent ROC analysis revealed an AUC of 68.9 (95%CI 61.5–76.4) to predict OS at 60 months. The score was significantly associated with DSS (overall p < 0.001; Figure 3B), again with limited discrimination between CRS:0 and CRS:1 patients (p = 0.357) but with a markedly higher 60-month AUC of 77.3 (95%CI 67.2–87.5). Finally, although not initially created for recurrence prediction, the CRS showed a solid value for RFS estimation with an AUC of 66.5 (95%CI 58.9–74.2) and significant discrimination (overall p < 0.001; Figure 3C). Despite the differences in characteristics between the ASSO and IMC cohort, the CRS showed a significant association with OS, DSS, and RFS in both cohorts independently (all overall p ≤ 0.005; see Figure S1, Supplemental Digital Content).

Figure 3.

Figure 3

Kaplan–Meier curves with time-dependent receiver operating characteristics (ROC) (+95% confidence intervals) over 120 months and area under the curve (AUC) at 60 months showing the survival and predictive value according to the proposed clinical risk score with three factors (presence of metastases, CRP ≥0.2 mg/dL, and primary tumor-size ≥3 cm) for the whole cohort (n = 364) (A) Overall survival (B) Disease-specific survival (death due to panNEN progression) (C) Recurrence-free survival. AUC = Area under the curve; CRS = Clinical risk score; ROC = receiver operating characteristics; t60 = timepoint 60 months; timeROC = time-dependent receiver operating characteristics.

2.7. Implementation of Grading in the Proposed Risk Score

According to the plethora of evidence on the association of grading with panNEN outcomes, we further analyzed the value of including grading in the proposed CRS. In our cohort, preoperative biopsies were performed in 134 of 364 patients (36.8%), and 38 of these were reported as insufficient tissue material for Ki67 staining or showed inconclusive histology. There was no significant difference in the rate of availability of preoperative grading between the ASSO and IMC cohort (23.1% vs. 28.9%; p = 0.213). Of the 96 patients with positive biopsy and available grading, 49 were preoperatively graded as G1, 37 as G2, and 9 as G3. Notably, their final surgical specimen grading was only concordant in 66 cases (69.5%). In view of the long study period, we assessed, whether the latest developments in biopsy and imaging techniques recently led to increased utilization of preoperative tissue acquisition resulting in correct grading in a higher percentage of patients. Intriguingly, within the last three years of our inclusion period (2016–2018), the rate of patients with representative preoperative samples (47.3%) as well as correct grading (32.3% of all patients) was significantly higher than in the years before (1990–2015; 19.2% and 13.7%). Accordingly, and in order to maximize statistical power, we therefore used the surgical specimen grading as a surrogate for preoperative grading. When resection specimen grading was included as an additional factor in multivariable analysis, it showed an independent significant association with OS (HR 2.09; 95%CI 1.17–3.74; p = 0.013; Table S2, Supplemental Digital Content). Amending the proposed CRS by adding grading (presence of G2 or G3 versus G1 as another point in the risk score) resulted in a further significant improvement of the predictive ROC values throughout all different types of survival analysis (see Figure 4A–C).

Figure 4.

Figure 4

Kaplan–Meier curves with time-dependent ROC (+95% CI) over 120 months and AUC at 60 months showing the survival and predictive value according to the extended version of the proposed clinical risk score with 4 factors (World Health Organization (WHO) grading G1 vs. G2/G3, presence of metastases, CRP ≥0.2 mg/dL, and primary tumor-size ≥3 cm) for the whole cohort (n = 358; grading missing = 6) (A) Overall survival (B) Disease-specific survival (death due to panNEN progression) (C) Recurrence-free survival. AUC = Area under the curve; CRS = Clinical risk score; ROC = receiver operating characteristics; t60 = timepoint 60 months; timeROC = time-dependent receiver operating characteristics

2.8. Applicability of the CRS in the Presence of Positive Functional Imaging

Besides recently increased rates of preoperative biopsy, more frequent application of functional somatostatin-receptor (SSR) imaging (e.g., octreotide scan or DOTATOC-positron emission tomography computed tomography (PET-CT)) has also substantially changed preoperative assessment for panNENs lately. Functional imaging was performed in 217 of 364 patients (59.6%), and panNEN-typical tracer uptake was more common with DOTATOC-PET-CT (129 of 138; 93.5%) compared to the octreotide scan (61 of 79; 77.2%; p < 0.001). Within the most recent years (2016–2018), 82.8% of all patients received preoperative functional imaging compared to 51.7% in the years before (1990–2015; p < 0.001). More specifically, this was caused by increased application of DOTATOC-PET-CT (78.5% vs. 24%) with concurrent reduced utilization of octreotide scans (4.3% vs. 27.7%; p < 0.001). This ultimately also resulted in increased SSR imaging positivity recently (94.8% vs. 83.6%; p = 0.018).

In the whole cohort, when selecting SSR imaging-positive patients only, both the three-risk factor CRS and modified four-risk factor CRS remained highly significantly associated with overall, disease-specific, and recurrence-free survival (overall p-values for 3-factor CRS: OS 0.002, DSS <0.001, RFS <0.001; for 4-factor CRS: OS 0.001, DSS <0.001, RFS <0.001).

Taken together with the findings described above on grading, these results confirm that our CRS is specifically applicable in a state-of-the-art setting of panNEN assessment in specialized centers with routine availability of accurate preoperative grading and SSR imaging.

All patient data used for this study are provided in anonymized form in a supplement excel file in the Supplementary Material (Table S3).

3. Discussion

This international study assessed the value of preoperative CRP to predict histological features as well as postoperative outcome after resection of sporadic NF panNENs. Increased CRP is associated with patient factors (age, symptoms), as well as tumor characteristics (grading, tumor size) and OS. Analysis of DSS, type of recurrence, and survival after relapse suggests that CRP is linked to biologically more aggressive panNENs. We furthermore showed that a CRS incorporating CRP ≥0.2 mg/dL, tumor-size ≥3 cm, and the presence of metastases enables preoperative stratification by the prediction of postoperative 90-day morbidity and mortality, unfavorable oncological parameters (grading, T category, and lymph node involvement), rate of recurrence, and poor long-term survival. Importantly, these findings were not only explored on a national multicenter level but also independently validated in four European large-scale units for pancreatic surgery (including three ENETS centers of excellence). Further inclusion of grading in a modified scoring version and evaluation of both CRSs in SSR imaging-positive patients suggests the usefulness in state-of-the-art panNEN management and a clinically relevant potential for stratification in future studies on (neo)adjuvant therapies or personalized follow-up.

Previous risk scores for panNEN rely on postoperatively assessed factors or include biomarkers without broad availability, limiting clinical applicability for preoperative stratification. Genc et al. and Zaidi et al. recently presented scoring systems to predict recurrence for G1/G2 NF-panNENs based on mostly postoperatively available factors [7,9]. Their scores mainly aid in decision-making regarding an indication for adjuvant treatment and intervals of follow-up. An analysis comparable to our work assessed chromogranin A (CgA) regarding recurrence after panNEN surgery [8], combining CgA (>5× upper normal limit) with tumor size (≥4 cm) and G2/G3 grading to design a preoperative risk score. Despite a 95% negative predictive value for recurrence in patients with zero points, the scoring system is limited by the restricted availability of CgA in some centers and possible falsely elevated CgA levels [23]. To overcome parts of these limitations, vasostatin-1 (VS-1), a cleavage fragment of CgA, has recently been explored as a prognostic biomarker, but VS-1 assessment is also not generally available and prospective validation is pending [24,25].

We therefore primarily focused on risk stratification prior to surgical resection through the inclusion of a simple cost-effective laboratory test (CRP) and established imaging. The novel CRS not only represents a valuable tool to inform patients on their perioperative risk and potential long-term outcome but also seems potentially useful to stratify high-risk panNEN patients for neoadjuvant PRRT, a therapeutic concept that is soon to be investigated in a prospective multicenter setting in Italy. In the future, inflammatory markers may also guide treatment strategies regarding immune therapy in panNEN patients [21,26,27,28].

The role of the systemic inflammatory response has been extensively characterized in a variety of different malignancies [29]. Regarding operable cancers, >300 studies on different inflammatory parameters and scores have recently been investigated in a meta-analysis [30]. In summary, the systemic inflammatory response has independent prognostic value for OS and cancer-specific survival across many tumor types. This enormous evidence calls for routine perioperative assessment of the host inflammatory status. In panNENs, the existing evidence is far less extensive, where the neutrophil-lymphocyte ratio (NLR) was assessed in only two single-center studies [31,32], confirming an association with disease progression and OS. CRP has been examined in one retrospective single-center cohort including a variety of different panNENs and treatments [22], and the authors found a CRP cutoff of ≥0.5 mg/dL optimally predicting OS. None of these studies was designed to draw valid conclusions regarding prognosis after surgery of sporadic NF panNENs.

In our study, the ideal cut-off for CRP to predict OS was considerably low with ≥0.2 mg/dL. Although this lies well below the upper normal range for detecting inflammation as defined by most laboratories around Europe (usually 0.7 mg/dL), this calculated value showed the highest significance in discriminating survival curves for OS in our analysis. Many initial studies on inflammation and cancer used a cut-off of 1.0 mg/dL, for example, as proposed in the original Glasgow prognostic score (GPS) [33]. However, more recently, the increased application of high-sensitivity CRP detection assays and lower cut-offs (usually around 0.3 mg/dL) within a “high-sensitivity” GPS has been shown to significantly improve patient risk stratification in a number of studies, e.g., on gastric cancer, lung cancer, and hepatocellular carcinoma [30,34,35,36].

The pathophysiological role of CRP as an acute-phase protein has been extensively investigated [37], but the causal relationship between raised CRP and poor survival in cancer patients seems unclear. It remains debatable if an increased inflammatory status is a byproduct of tumorigenesis, a reflection of the host responding to more aggressive tumor behavior, or a sign of an impaired ability of the host to control further tumor spread. It has been shown that increasing CRP during (healthy) ageing is a matter of fact [38]. In the elderly, elevated CRP is linked to poor physical status and cognitive performance, and individuals with increased inflammatory markers encounter an at least two times higher cancer incidence compared to those with normal values [39]. Additionally, chronically increased CRP is associated with disease severity in a number of comorbidities, such as cardiovascular disease or cirrhosis [39,40]. These medical conditions might also limit systemic or local treatment options in cancer patients with progressive recurrent disease after curative intent resection, and hereby CRP may also play an indirect role in poor cancer survival.

In our study, CRP was associated with tumor size and grading, suggesting a systemic measurable effect of pronounced host–tumor interactions. Schimmack et al. confirmed this through experimental studies in panNEN cell lines and patient tissue samples. Their results suggested a positive feedback mechanism between CRP and interleukin-6 (IL-6) in monocytes/macrophages maintaining systemic inflammation, leading to activation of the IL-6/AKT/signal transducer and activator of transcription protein 3 (STAT3)/CRP axis, which further promotes invasion and metastases [21,41,42]. Interestingly, in our cohort, although increased CRP did not correlate with decreased RFS, these patients showed more advanced recurrences and a significantly diminished OS and DSS. Additionally, in the case of recurrence, our patients with CRP ≥0.2 mg/dL experienced dramatically reduced OS in the further course of the disease.

The present works’ main limitation lies in its retrospective nature, making it difficult to draw high-level evidence-based conclusions. While prospective validation of our CRS would certainly be highly desirable, panNEN represents a rare and heterogeneous entity with a comparatively long survival, with possible changes in management over time. These inherent restrictions have particularly become evident during retrospective evaluation of histological grading and imaging. Late during the study inclusion period, in 2017, the World Health Organization (WHO) classification of panNENs was updated [43], introducing a differentiation between two sub-groups within G3 panNENs (G3 neuroendocrine tumour/NET vs. G3 neuroendocrine carcinoma/NEC). Histological subclassification of G3 panNENs was not routinely assessed in our cohort in the previous years and therefore our results should be interpreted with caution, especially regarding a potential influence of the G3 NEC subtype affecting preoperative CRP, recommended treatment options, and patient outcome. Furthermore, preoperative SSR imaging application and its diagnostic accuracy changed over different time periods as shown in the results. Interestingly enough, these diagnostics, nowadays considered to be standard of care according to guidelines, have only very recently been routinely implemented even in well-established international large units. Therefore, confirmation of our very specific but clinically relevant and intriguing findings will require a large-scale prospective validation approach with standardized pathological and imaging assessment. However, incorporating CRP and our risk score in treatment algorithms could substantially change clinical strategies for resectable sporadic NF panNENs.

4. Materials and Methods

4.1. Patient Cohort

This retrospective analysis was based on a national and international multicenter cohort. As previously described [2], the panNEN study group of the Austrian Society of Surgical Oncology (ASSO) collected the data of patients undergoing pancreatic resection in 6 Austrian centers. The international multicenter cohort (IMC) consists of four high-volume units, including three ENETS centers of excellence (IRCCS San Raffaele Hospital, Milan, Italy; University Hospital Marburg, Germany; Academic Medical Center Amsterdam, Netherlands; University Medical Center Groningen, Netherlands). Individual centers were free to choose their inclusion time period depending on data availability. Accordingly, reported patients underwent index pancreatic resection between 1998–2017 in the ASSO cohort and between 1990–2018 in the IMC.

4.2. Inclusion Criteria and Collected Variables

Inclusion criteria covered curative intent pancreatic resections for sporadic non-functional (NF) panNEN with postoperative histological diagnosis and availability of preoperative CRP (last value within 7 days before resection). Cases with simultaneous metastases were included only when a curative intent strategy for all lesions was performed (single- or multi-stage resection/ablation). Palliative debulking procedures were excluded, as were patients with simultaneous pancreatic adenocarcinoma. Postoperative 90-day complications were graded according the Clavien–Dindo-classification (severe: grade >3a) [44,45], pancreatic fistula according the ISGPF-2005 classification [46]. Here, 90-day mortality was validated through national registries in Austrian hospitals [47]. Tumor variables included intrapancreatic location, presence/location of metastases (assessed by cross-sectional imaging), and grading according the 2010 World Health Organization (WHO) classification (morphological mitotic rate (<2 in 10 high-power fields (HPFs): G1, 2-20/HPF: G2, and >20/HPF: G3) or proliferative activity by Ki-67-positive cells (G1, G2, and G3: ≤2%, 3–20%, >20%)). Staging was based on the European Neuroendocrine Tumor Society (ENETS) classification [48]. Nodal status was assessed on surgical specimens. Resection margin status was R0 for complete resections without microscopic residual tumor at the margin or R1 (positive margins) or Rx (missing).

Preoperative CRP was measured in a routine laboratory from whole-blood obtained plasma with a latex particle-enhanced turbidimetric assay in all centers. Primary tumor size was assessed through preoperative cross-sectional imaging when available or as described by pathology in the surgical specimen. OS was defined as the time from the first panNEN surgery to death/last follow-up, DSS as the time to panNEN related-death/last follow-up (non-panNEN-related deaths were censored), and RFS as the time from completion of the initial curative-intent concept to recurrence/last follow-up.

Data fusion and analysis was performed at Medical University of Innsbruck by two consultant HPB surgeons (S.S. and F.P.), reviewing each dataset concerning integrity and plausibility. Ethics committee approval was obtained independently by each participating department according to local regulations; no individual informed consent was claimed due to the retrospective study design. The EC approval numbers of the coordinating centers are 415-EP/73/408-2014 (Ethikkommission Land Salzburg) and AN2013-0023/AN2016-0128 (Ethikkommission der Medizinischen Universität Innsbruck). The study is reported according to the STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) guidelines (see STROBE Checklist, Supplemental Digital Content) [49].

4.3. Statistical Analysis

Patient and tumor characteristics are described as a median with an interquartile range (IQR); for categorical variables, numbers and proportions are displayed. After testing for normal distribution with the Shapiro–Wilk test, medians were compared by the Mann–Whitney-U test between two groups and by the Kruskal–Wallis test for >2 groups. CRP-level bar charts are presented as a median with 95% confidence intervals (95%CI). Optimal cut-offs for CRP and tumor size regarding OS and DSS were established by systematically evaluating different values and selecting those with the lowest p-value in the log-rank-test and -2log-likelihood in Cox-regression. Cox-proportional hazards regression modeling was performed for an estimation of hazard ratios (HRs) with 95% CI of factors associated with survival. Sensitivity analysis was conducted to detect multicollinearity before entering factors into the multivariable model. Kaplan–Meier survival curves were plotted and the log rank test was used to assess subgroup differences. Time-dependent receiver-operating characteristics (ROC) area-under-the-curve (AUC) analysis was conducted using the timeROC package in R (www.r-project.org). This created a time-dependent ROC curve from censored survival data to calculate the AUC for predictive factors at a given time point (e.g., 60 months), as described by Blanche et al. [50]. All other statistical analyses were performed with SPSS v21.0 (IBM Corp. Armonk, NY, USA). A two-tailed p-value <0.05 was considered significant throughout all analysis.

5. Conclusions

Preoperative CRP is associated with unfavorable patient and tumor characteristics and independently predicts disease-associated survival in resected sporadic non-functional panNENs. Our internationally validated clinical risk score, including CRP, primary tumor size, and metastases (plus grading if available), facilitates easy clinical applicability and allows for risk stratification, potential guidance in future (neo-)adjuvant treatment regimens, and individualized follow-up recommendations.

Acknowledgments

We thank Romana Urbas, Fergül Cakar-Beck and Tim Takkenkamp for assistance in data collection and Matthias Zitt for support in organizing the ASSO panNEN working group.

Supplementary Materials

The following are available online at https://www.mdpi.com/2072-6694/12/5/1235/s1. Figure S1: Patient survival stratified by the Clinical Risk Score in the exploration and validation cohort; Table S1: Patient and Tumor Characteristics According to Preoperative C-Reactive Protein Values; Table S2: Association of Grading with Overall Survival; Table S3: Anonymized Patient Data; Supplement File: STROBE Checklist.

Author Contributions

Conceptualization, F.P., S.S., P.E., G.G., M.F., D.N., R.F.; methodology, F.P., S.S., G.G., D.N.; validation, F.P., S.S., G.G.; formal analysis, F.P., G.G., P.E.; investigation, F.P., S.S., B.C., V.A., S.P., F.J.H.H., D.W., C.H., E.K., T.K., K.M., U.F., I.F., H.W., S.T., F.S., A.H.; resources, S.S., D.Ö., M.F., R.H.J.d.K., D.K.B., E.J.M.N.v.D., D.N., P.K., R.F., F.S., R.K.; data curation, F.P., S.S., G.G.; writing—original draft preparation, F.P., S.S., P.E., G.G., D.N.; writing—review and editing, F.P., S.S., B.C., P.E., V.A., D.Ö., G.G., S.P., M.F., F.J.H.H., R.H.J.d.K., D.W., D.K.B., C.H., E.J.M.N.v.D., E.K., D.N., T.K., K.M., P.K., U.F., I.F., H.W., R.F., S.T., F.S., A.H., R.K.; visualization, F.P., P.E., G.G.; supervision, F.P., S.S., G.G., D.Ö.; project administration, F.P., S.S.; All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding. The APC was funded by the Open Access Publication Fund of Medical University of Innsbruck. PhD Scholarship of Dr. Valentina Andreasi was supported by Gioja Bianca Costanza Legacy Fund.

Conflicts of Interest

The authors declare no conflict of interest.

References

  • 1.Lawrence B., Gustafsson B.I., Chan A., Svejda B., Kidd M., Modlin I.M. The epidemiology of gastroenteropancreatic neuroendocrine tumors. Endocrinol. Metab. Clin. N. Am. 2011;40:1–18. doi: 10.1016/j.ecl.2010.12.005. [DOI] [PubMed] [Google Scholar]
  • 2.Primavesi F., Klieser E., Cardini B., Marsoner K., Froschl U., Thalhammer S., Fischer I., Hauer A., Urbas R., Kiesslich T., et al. Exploring the surgical landscape of pancreatic neuroendocrine neoplasia in austria: Results from the asso pnen study group. Eur. J. Surg. Oncol. 2019;45:198–206. doi: 10.1016/j.ejso.2018.08.016. [DOI] [PubMed] [Google Scholar]
  • 3.Jensen R.T., Norton J.A. Treatment of Pancreatic Neuroendocrine Tumors in Multiple Endocrine Neoplasia Type 1: Some Clarity but Continued Controversy. Pancreas. 2017;46:589–594. doi: 10.1097/MPA.0000000000000825. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Milione M., Maisonneuve P., Pellegrinelli A., Spaggiari P., Centonze G., Coppa J., Delconte G., Droz Dit Busset M., Lanhazo O., Pruneri G., et al. Ki-67 and presence of liver metastases identify different progression-risk classes in pancreatic neuroendocrine neoplasms (pnen) undergoing resection. Eur. J. Surg. Oncol. 2019;45:755–760. doi: 10.1016/j.ejso.2018.10.052. [DOI] [PubMed] [Google Scholar]
  • 5.Falconi M., Eriksson B., Kaltsas G., Bartsch D.K., Capdevila J., Caplin M., Kos-Kudla B., Kwekkeboom D., Rindi G., Kloppel G., et al. Enets consensus guidelines update for the management of patients with functional pancreatic neuroendocrine tumors and non-functional pancreatic neuroendocrine tumors. Neuroendocrinology. 2016;103:153–171. doi: 10.1159/000443171. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Fischer L., Bergmann F., Schimmack S., Hinz U., Priess S., Muller-Stich B.P., Werner J., Hackert T., Buchler M.W. Outcome of surgery for pancreatic neuroendocrine neoplasms. Br. J. Surg. 2014;101:1405–1412. doi: 10.1002/bjs.9603. [DOI] [PubMed] [Google Scholar]
  • 7.Genc C.G., Jilesen A.P., Partelli S., Falconi M., Muffatti F., van Kemenade F.J., van Eeden S., Verheij J., van Dieren S., van Eijck C.H.J., et al. A new scoring system to predict recurrent disease in grade 1 and 2 nonfunctional pancreatic neuroendocrine tumors. Ann. Surg. 2018;267:1148–1154. doi: 10.1097/SLA.0000000000002123. [DOI] [PubMed] [Google Scholar]
  • 8.Fisher A.V., Lopez-Aguiar A.G., Rendell V.R., Pokrzywa C., Rocha F.G., Kanji Z.S., Poultsides G.A., Makris E.A., Dillhoff M.E., Beal E.W., et al. Predictive value of chromogranin a and a pre-operative risk score to predict recurrence after resection of pancreatic neuroendocrine tumors. J. Gastrointest. Surg. 2019;23:651–658. doi: 10.1007/s11605-018-04080-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Zaidi M.Y., Lopez-Aguiar A.G., Switchenko J.M., Lipscomb J., Andreasi V., Partelli S., Gamboa A.C., Lee R.M., Poultsides G.A., Dillhoff M., et al. A novel validated recurrence risk score to guide a pragmatic surveillance strategy after resection of pancreatic neuroendocrine tumors: An international study of 1006 patients. Ann. Surg. 2019 doi: 10.1097/SLA.0000000000003461. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Grillo F., Valle L., Ferone D., Albertelli M., Brisigotti M.P., Cittadini G., Vanoli A., Fiocca R., Mastracci L. Ki-67 heterogeneity in well differentiated gastro-entero-pancreatic neuroendocrine tumors: When is biopsy reliable for grade assessment? Endocrine. 2017;57:494–502. doi: 10.1007/s12020-017-1364-8. [DOI] [PubMed] [Google Scholar]
  • 11.Fujimori N., Osoegawa T., Lee L., Tachibana Y., Aso A., Kubo H., Kawabe K., Igarashi H., Nakamura K., Oda Y., et al. Efficacy of endoscopic ultrasonography and endoscopic ultrasonography-guided fine-needle aspiration for the diagnosis and grading of pancreatic neuroendocrine tumors. Scand. J. Gastroenterol. 2016;51:245–252. doi: 10.3109/00365521.2015.1083050. [DOI] [PubMed] [Google Scholar]
  • 12.Larghi A., Capurso G., Carnuccio A., Ricci R., Alfieri S., Galasso D., Lugli F., Bianchi A., Panzuto F., De Marinis L., et al. Ki-67 grading of nonfunctioning pancreatic neuroendocrine tumors on histologic samples obtained by eus-guided fine-needle tissue acquisition: A prospective study. Gastrointest. Endosc. 2012;76:570–577. doi: 10.1016/j.gie.2012.04.477. [DOI] [PubMed] [Google Scholar]
  • 13.D’Haese J.G., Tosolini C., Ceyhan G.O., Kong B., Esposito I., Michalski C.W., Kleeff J. Update on surgical treatment of pancreatic neuroendocrine neoplasms. World J. Gastroenterol. 2014;20:13893–13898. doi: 10.3748/wjg.v20.i38.13893. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.van Vliet E.I., van Eijck C.H., de Krijger R.R., Nieveen van Dijkum E.J., Teunissen J.J., Kam B.L., de Herder W.W., Feelders R.A., Bonsing B.A., Brabander T., et al. Neoadjuvant treatment of nonfunctioning pancreatic neuroendocrine tumors with [177lu-dota0,tyr3]octreotate. J. Nucl. Med. 2015;56:1647–1653. doi: 10.2967/jnumed.115.158899. [DOI] [PubMed] [Google Scholar]
  • 15.Kim W.R., Han Y.D., Min B.S. C-reactive protein level predicts survival outcomes in rectal cancer patients undergoing total mesorectal excision after preoperative chemoradiation therapy. Ann. Surg. Oncol. 2018;25:3898–3905. doi: 10.1245/s10434-018-6828-4. [DOI] [PubMed] [Google Scholar]
  • 16.Feng J.F., Zhao H.G., Liu J.S., Chen Q.X. Significance of preoperative c-reactive protein as a parameter in patients with small cell carcinoma of the esophagus. Onco Targets. 2013;6:1147–1151. doi: 10.2147/OTT.S50039. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Komac O., Bengi G., Sagol O., Akarsu M. C-reactive protein may be a prognostic factor for the whole gastroenteropancreatic neuroendocrine tumor group. World J. Gastrointest. Oncol. 2019;11:139–152. doi: 10.4251/wjgo.v11.i2.139. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Hang J., Xue P., Yang H., Li S., Chen D., Zhu L., Huang W., Ren S., Zhu Y., Wang L. Pretreatment c-reactive protein to albumin ratio for predicting overall survival in advanced pancreatic cancer patients. Sci. Rep. 2017;7:2993. doi: 10.1038/s41598-017-03153-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Pastorino U., Morelli D., Leuzzi G., Rolli L., Suatoni P., Taverna F., Bertocchi E., Boeri M., Sozzi G., Cantarutti A., et al. Baseline and postoperative c-reactive protein levels predict long-term survival after lung metastasectomy. Ann. Surg. Oncol. 2019;26:869–875. doi: 10.1245/s10434-018-07116-7. [DOI] [PubMed] [Google Scholar]
  • 20.Aziz M.H., Sideras K., Aziz N.A., Mauff K., Haen R., Roos D., Saida L., Suker M., van der Harst E., Mieog J.S., et al. The systemic-immune-inflammation index independently predicts survival and recurrence in resectable pancreatic cancer and its prognostic value depends on bilirubin levels: A retrospective multicenter cohort study. Ann. Surg. 2019;270:139–146. doi: 10.1097/SLA.0000000000002660. [DOI] [PubMed] [Google Scholar]
  • 21.Schimmack S., Yang Y., Felix K., Herbst M., Li Y., Schenk M., Bergmann F., Hackert T., Strobel O., Yang Y. C-reactive protein (CRP) promotes malignant properties in pancreatic neuroendocrine neoplasms. Endocr. Connect. 2019;8:1007–1019. doi: 10.1530/EC-19-0132. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Wiese D., Kampe K., Waldmann J., Heverhagen A.E., Bartsch D.K., Fendrich V. C-reactive protein as a new prognostic factor for survival in patients with pancreatic neuroendocrine neoplasia. J. Clin. Endocrinol. Metab. 2016;101:937–944. doi: 10.1210/jc.2015-3114. [DOI] [PubMed] [Google Scholar]
  • 23.Gut P., Czarnywojtek A., Fischbach J., Baczyk M., Ziemnicka K., Wrotkowska E., Gryczynska M., Ruchala M. Chromogranin A—Unspecific neuroendocrine marker. Clinical utility and potential diagnostic pitfalls. Arch. Med. Sci. 2016;12:1–9. doi: 10.5114/aoms.2016.57577. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Corsello A., Di Filippo L., Massironi S., Sileo F., Dolcetta Capuzzo A., Gemma M., Carlucci C., Cusini C., Colombo B., Dallatomasina A., et al. Vasostatin-1: A novel circulating biomarker for ileal and pancreatic neuroendocrine neoplasms. PLoS ONE. 2018;13:e0196858. doi: 10.1371/journal.pone.0196858. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Andreasi V., Partelli S., Manzoni M., Muffatti F., Colombo B., Corti A., Falconi M. Association between preoperative vasostatin-1 and pathological features of aggressiveness in localized nonfunctioning pancreatic neuroendocrine tumors (nf-pannet) Pancreatology. 2019;19:57–63. doi: 10.1016/j.pan.2018.11.005. [DOI] [PubMed] [Google Scholar]
  • 26.Bosch F., Bruwer K., Altendorf-Hofmann A., Auernhammer C.J., Spitzweg C., Westphalen C.B., Boeck S., Schubert-Fritschle G., Werner J., Heinemann V., et al. Immune checkpoint markers in gastroenteropancreatic neuroendocrine neoplasia. Endocr. Relat. Cancer. 2019;26:293–301. doi: 10.1530/ERC-18-0494. [DOI] [PubMed] [Google Scholar]
  • 27.Cunha L.L., Marcello M.A., Rocha-Santos V., Ward L.S. Immunotherapy against endocrine malignancies: Immune checkpoint inhibitors lead the way. Endocr. Relat. Cancer. 2017;24:T261–T281. doi: 10.1530/ERC-17-0222. [DOI] [PubMed] [Google Scholar]
  • 28.Dammeijer F., Lau S.P., van Eijck C.H.J., van der Burg S.H., Aerts J. Rationally combining immunotherapies to improve efficacy of immune checkpoint blockade in solid tumors. Cytokine Growth Factor. Rev. 2017;36:5–15. doi: 10.1016/j.cytogfr.2017.06.011. [DOI] [PubMed] [Google Scholar]
  • 29.Roxburgh C.S., McMillan D.C. Cancer and systemic inflammation: Treat the tumour and treat the host. Br. J. Cancer. 2014;110:1409–1412. doi: 10.1038/bjc.2014.90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Dolan R.D., Lim J., McSorley S.T., Horgan P.G., McMillan D.C. The role of the systemic inflammatory response in predicting outcomes in patients with operable cancer: Systematic review and meta-analysis. Sci. Rep. 2017;7:16717. doi: 10.1038/s41598-017-16955-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Luo G., Liu C., Cheng H., Jin K., Guo M., Lu Y., Long J., Xu J., Ni Q., Chen J., et al. Neutrophil-lymphocyte ratio predicts survival in pancreatic neuroendocrine tumors. Oncol. Lett. 2017;13:2454–2458. doi: 10.3892/ol.2017.5716. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Gaitanidis A., Patel D., Nilubol N., Tirosh A., Sadowski S., Kebebew E. Markers of systemic inflammatory response are prognostic factors in patients with pancreatic neuroendocrine tumors (pnets): A prospective analysis. Ann. Surg. Oncol. 2018;25:122–130. doi: 10.1245/s10434-017-6241-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Forrest L.M., McMillan D.C., McArdle C.S., Angerson W.J., Dunlop D.J. Evaluation of cumulative prognostic scores based on the systemic inflammatory response in patients with inoperable non-small-cell lung cancer. Br. J. Cancer. 2003;89:1028–1030. doi: 10.1038/sj.bjc.6601242. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Kawashima M., Murakawa T., Shinozaki T., Ichinose J., Hino H., Konoeda C., Tsuchiya T., Murayama T., Nagayama K., Nitadori J., et al. Significance of the Glasgow Prognostic Score as a prognostic indicator for lung cancer surgery. Interact. Cardiovasc. Thorac. Surg. 2015;21:637–643. doi: 10.1093/icvts/ivv223. [DOI] [PubMed] [Google Scholar]
  • 35.Takeno S., Hashimoto T., Shibata R., Maki K., Shiwaku H., Yamana I., Yamashita R., Yamashita Y. The high-sensitivity modified Glasgow prognostic score is superior to the modified Glasgow prognostic score as a prognostic predictor in patients with resectable gastric cancer. Oncology. 2014;87:205–214. doi: 10.1159/000362601. [DOI] [PubMed] [Google Scholar]
  • 36.Ishizuka M., Kubota K., Kita J., Shimoda M., Kato M., Sawada T. Usefulness of a modified inflammation-based prognostic system for predicting postoperative mortality of patients undergoing surgery for primary hepatocellular carcinoma. J. Surg. Oncol. 2011;103:801–806. doi: 10.1002/jso.21857. [DOI] [PubMed] [Google Scholar]
  • 37.Pepys M.B., Hirschfield G.M. C-reactive protein: A critical update. J. Clin. Investig. 2003;111:1805–1812. doi: 10.1172/JCI200318921. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Tang Y., Fung E., Xu A., Lan H.Y. C-reactive protein and ageing. Clin. Exp. Pharm. Physiol. 2017;44(Suppl. 1):9–14. doi: 10.1111/1440-1681.12758. [DOI] [PubMed] [Google Scholar]
  • 39.Watson J., Salisbury C., Banks J., Whiting P., Hamilton W. Predictive value of inflammatory markers for cancer diagnosis in primary care: A prospective cohort study using electronic health records. Br. J. Cancer. 2019;120:1045–1051. doi: 10.1038/s41416-019-0458-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Cervoni J.P., Amorós À., Bañares R., Luis Montero J., Soriano G., Weil D., Moreau R., Pavesi M., Thévenot T., Di Martino V. Prognostic value of C-reactive protein in cirrhosis: External validation from the CANONIC cohort. Eur. J. Gastroenterol. Hepatol. 2016;28:1028–1034. doi: 10.1097/MEG.0000000000000676. [DOI] [PubMed] [Google Scholar]
  • 41.Yang Y., Yang L., Li Y. Neuropilin-1 (nrp-1) upregulated by il-6/stat3 signaling contributes to invasion in pancreatic neuroendocrine neoplasms. Hum. Pathol. 2018;81:192–200. doi: 10.1016/j.humpath.2018.06.030. [DOI] [PubMed] [Google Scholar]
  • 42.Yang L., Yu X., Yang Y. Autotaxin upregulated by stat3 activation contributes to invasion in pancreatic neuroendocrine neoplasms. Endocr. Connect. 2018;7:1299–1307. doi: 10.1530/EC-18-0356. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Inzani F., Petrone G., Rindi G. The New World Health Organization Classification for Pancreatic Neuroendocrine Neoplasia. Endocrinol. Metab. Clin. N. Am. 2018;47:463–470. doi: 10.1016/j.ecl.2018.04.008. [DOI] [PubMed] [Google Scholar]
  • 44.Bolliger M., Kroehnert J.A., Molineus F., Kandioler D., Schindl M., Riss P. Experiences with the standardized classification of surgical complications (clavien-dindo) in general surgery patients. Eur. Surg. 2018;50:256–261. doi: 10.1007/s10353-018-0551-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Dindo D., Demartines N., Clavien P.A. Classification of surgical complications: A new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann. Surg. 2004;240:205–213. doi: 10.1097/01.sla.0000133083.54934.ae. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Bassi C., Dervenis C., Butturini G., Fingerhut A., Yeo C., Izbicki J., Neoptolemos J., Sarr M., Traverso W., Buchler M., et al. Postoperative pancreatic fistula: An international study group (isgpf) definition. Surgery. 2005;138:8–13. doi: 10.1016/j.surg.2005.05.001. [DOI] [PubMed] [Google Scholar]
  • 47.Statistik-Austria Statistics Austria Mortality Register. [(accessed on 31 December 2017)]; Available online: http://www.statistik.at.
  • 48.Rindi G., Kloppel G., Alhman H., Caplin M., Couvelard A., de Herder W.W., Erikssson B., Falchetti A., Falconi M., Komminoth P., et al. Tnm staging of foregut (neuro)endocrine tumors: A consensus proposal including a grading system. Virchows Arch. 2006;449:395–401. doi: 10.1007/s00428-006-0250-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.von Elm E., Altman D.G., Egger M., Pocock S.J., Gotzsche P.C., Vandenbroucke J.P., Initiative S. The strengthening the reporting of observational studies in epidemiology (strobe) statement: Guidelines for reporting observational studies. Lancet. 2007;370:1453–1457. doi: 10.1016/S0140-6736(07)61602-X. [DOI] [PubMed] [Google Scholar]
  • 50.Blanche P., Dartigues J.F., Jacqmin-Gadda H. Estimating and comparing time-dependent areas under receiver operating characteristic curves for censored event times with competing risks. Stat. Med. 2013;32:5381–5397. doi: 10.1002/sim.5958. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials


Articles from Cancers are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES