Abstract
Objectives
To investigate the prognostic significance of the systemic immune-inflammation index (SII) in patients after radical cholecystectomy for gallbladder cancer (GBC) using overall survival (OS) as the primary outcome measure.
Methods
Based on data from a multi-institutional registry of patients with GBC, significant prognostic factors after radical cholecystectomy were identified by multivariate Cox proportional hazards model. A novel staging system was established, visualized as a nomogram. The response to adjuvant chemotherapy was compared between patients in different subgroups according to the novel staging system.
Results
Of the 1072 GBC patients enrolled, 691 was randomly selected in the discovery cohort and 381 in the validation cohort. SII>510 was found to be an independent predictor of OS (hazard ratio [HR] 1.90, 95% confidence interval [CI] 1.42-2.54). Carbohydrate antigen 199(CA19-9), tumor differentiation, T stage, N stage, margin status and SII were involved in the nomogram. The nomogram showed a superior prediction compared with models without SII (1-, 3-, 5-year integrated discrimination improvement (IDI):2.4%, 4.1%, 5.4%, P<0.001), and compared to TNM staging system (1-, 3-, 5-year integrated discrimination improvement (IDI):5.9%, 10.4%, 12.2%, P<0.001). The C-index of the nomogram in predicting OS was 0.735 (95% CI 0.683-0.766). The novel staging system based on the nomogram showed good discriminative ability for patients with T2 or T3 staging and with negative lymph nodes after R0 resection. Adjuvant chemotherapy offered significant survival benefits to these patients with poor prognosis.
Conclusions
SII was an independent predictor of OS in patients after radical cholecystectomy for GBC. The new staging system identified subgroups of patients with T2 or T3 GBC with negative lymph nodes who benefited from adjuvant chemotherapy.
Clinical Trial Registration
ClinicalTrials.gov, identifier (NCT04140552).
Keywords: gallbladder carcinoma, nomogram, systemic immune-inflammation index, chemotherapy, prognostic marker
Introduction
Gallbladder cancer (GBC) is a highly malignant tumor that accounts for 80%-95% of biliary tract malignancies (1). Its relatively low incidence and indistinct symptomatology result in most patients presenting with an advanced disease at the time of diagnosis, thus, contributing to its dismal prognosis (2). American Joint Committee on Cancer(AJCC; eighth version) TNM Staging System is the most widely used system for GBC (3). However, survival outcomes vary widely for patients even within the same stage in this system, as multiple factors affect long-term survival of an individual patient (4, 5). Recently, accumulating evidences have suggested that the inflammation pathway is closely related to tumor development and progression (6–8). Inflammatory indices such as neutrophil-to-lymphocyte ratio (NLR), platelet-to-lymphocyte ratio (PLR) and Glasgow prognostic score (GPS) have been proven to have prognostic values for GBC (9–11). On the other hand, the systemic immune-inflammation index (SII), which is based on neutrophil, lymphocyte and platelet counts as first described in hepatocarcinoma cancer (12), has rarely been studied in GBC (13).
Nomogram, as a predictive statistical model for individual patients (14), have been shown to demonstrate advantages over the traditional staging systems in predicting long-term survival outcomes of patients (15–19). Many nomograms have been proposed as a practical tool to guide treatment for cancer (17, 20).
This study aimed to compare the prognostic value of several inflammatory indices, and to develop a nomogram by combining preoperative examinations and clinicopathological factors. Moreover, whether adjuvant therapy is necessary for patients after R0 radical cholecystectomy with negative regional lymph nodes is still controversial. The American Hepato-Pancreato-Biliary Association (AHPBA) consensus recommends adjuvant therapy for patients with stage II GBC or higher, but whether adjuvant chemotherapy or chemoradiation should be given is unknown (21). The National Comprehensive Cancer Network (NCCN, 2021 V.2) guideline suggests that GBC patients with negative lymph nodes after radical cholecystectomy should be followed-up with observation, or should receive the treatment regimens consisting of either fluoropyrimidine chemoradiation or chemotherapy with fluoropyrimidine or gemcitabine (22). To address this issue, a novel staging system was established in this study by integrating multiple clinicopathological factors to stratify T2 or T3 staging patients with negative lymph nodes and R0 resection margins to investigate whether adjuvant therapy was beneficial for these patients with unfavorable prognosis.
Methods
Patients
The Chinese Research Group of Gallbladder Cancer (CRGGC) is a multi-institutional registry cohort that retrospectively collected medical records of GBC patients in China, with a standardized protocol detailed in (23). This study enrolled consecutive patients who underwent radical cholecystectomy between January 2002 and January 2019 in 35 tertiary medical centers in China from the CRGGC. The inclusion criteria were as following (1): pathologically diagnosed GBC according to International Classification of Disease for Oncology (ICD-O-3); (2) data containing detailed preoperative blood results; (3) radical cholecystectomy performed for GBC. The exclusion criteria were patients with: (1) unknown T staging; (2) M1 staging or T4 staging, according to the AJCC 8th staging system; (3) Tis or T1a staging after simple cholecystectomy; (4) clinical evidence of infection or other inflammatory conditions; (5) overall survival (OS) of less than 3 months, potentially due to postoperative complications ( Supplementary Figure 1 ). Patients enrolled in the study were randomly selected into the validation cohort until the number of event had reached 200 to achieve an ideal sample size for validation (24).
To verify the response to adjuvant chemotherapy of different subgroups in the novel staging system, a different cohort of patients who underwent radical cholecystectomy between January 2008 and June 2019 at Renji Hospital Affiliated to Shanghai Jiao Tong University School of Medicine and Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine were retrospectively studied. The selection criteria for inclusion were patients: (1) with AJCC 8thT2 or T3 GBC; (2) with specific information of adjuvant chemotherapy. The exclusion criteria were patients with: (1) histologically confirmed positive lymph nodes; (2) chemotherapeutic agents beyond the NCCN 2021 V.2 guideline; (3) long-term oral administration of Traditional Chinese Medicine after surgery; (4) OS of less than 3 months.
Data Collection
Available pre-operative laboratory examination within a week before the data of surgery were collected. Results of pre-operative laboratory examination were identified from medical records, including: total bilirubin, CA19-9, absolute neutrophil, absolute lymphocyte, platelet, and absolute monocyte counts. The inflammatory indices were defined as neutrophil-to-lymphocyte ratio (NLR, absolute neutrophil count divided by absolute lymphocyte count), platelet-to-lymphocyte ratio (PLR, absolute platelet count divided by absolute lymphocyte count), lymphocyte-to-monocyte ratio (LMR, absolute lymphocyte count divided by absolute monocyte count), and SII (platelet count times NLR).
Overall survival (OS) was calculated from the date of surgery to the date of death or last follow-up, whichever came last. This study was censored on June 2020. Pathologic staging was done following the AJCC 8th Staging System. For each variable, we required duplicated entry by two trained professionals. If any discrepancies were found, a third specialist would be brought in for discussion and make a final decision.
Statistical Analysis
Continuous variables were transformed into categorical variables based on routine cutoffs in clinical application. Parameters such as NLR and SII were grouped as high and low by optimal cut-off points using the cut p function (R package survMisc).
Continuous data were compared using the unpaired t test, and categorical data using the chi-square test or Fisher’s exact test. Ordinal categorical variables were compared by Wilcoxon rank sum test. OS was examined by the Kaplan-Meier method and compared using the log-rank test. The associations of bilirubin and CA19-9 with SII levels were estimated using the Spearman rank-correlation coefficient.
Univariable Cox proportional hazards models were applied to select covariates with a significance level <0.05 into the following multivariate model. Harrell’s concordance index (C-index) was calculated for each model. Patients with missing data for covariates of interest were excluded.
Multivariable Cox regression was applied to establish a prediction model, then visualized by a nomogram. The final prediction model was selected by the backward stepdown selection process with the Akaike information criterion (AIC). The predictive accuracy and discriminative ability were determined by C-index and calibration curve, and assessed by comparing the nomogram-predicted against observed survival on application of bootstrapping with 1000 resamples. The integrated discrimination improvement (IDI) and decision curve analysis (DCA) was used to evaluate the predictive performance of different models. The total point of each patient in the validation cohort was calculated according to the established nomogram, and then Cox regression was performed for this cohort using the total points as a variate. Each patient was then assigned a score based on the nomogram, and the cut-off points were calculated using the spline curve.
All tests were two-sided, and P values of less than 0.05 were considered statistically significant. All statistical analyses were performed using the software R version 3.6.1.
Results
Clinicopathological Characteristics
Of the 1072 patients included in this study, 691 patients (64.5%) were randomly assigned into the discovery cohort, and 381 (35.5%) in the validation cohort. The median OS for the discovery and validation cohorts were 40.4 months (95% confidence interval [CI], 32.0-51.4 months) and 41.4 months (95% CI, 31.9-53.5 months), respectively. The corresponding median follow-up times for the 2 cohorts were 53.8 (range 3 months to 18 years) and 52.9 months (range 3 months to 12.6 years). The baseline clinicopathological characteristics were summarized in Table 1 .
Table 1.
Discovery cohort (N=691) | Validation cohort (N=381) | P value | |
---|---|---|---|
Age† | 62(57-69.5) | 63(57-70) | 0.48 |
Sex | 0.68 | ||
Male | 270 | 144 | |
Female | 421 | 237 | |
CA19-9 | 0.96 | ||
≤40 U/ml | 350 | 192 | |
>40 U/m | 221 | 122 | |
NA | 120 | 67 | |
Surgical approach | 0.78 | ||
RC | 405 | 240 | |
ERC | 38 | 23 | |
LC+RC | 127 | 67 | |
NA | 121 | 51 | |
Total bilirubin | 0.96 | ||
≤35 μmol/L | 553 | 311 | |
>35 μmol/L | 108 | 60 | |
NA | 30 | 10 | |
Margin status | 0.30 | ||
R0 | 65 | 27 | |
R1 | 567 | 334 | |
Rx | 59 | 20 | |
Pathological type | 0.97 | ||
ADC | 569 | 310 | |
ADSC | 35 | 13 | |
PADC | 27 | 16 | |
NEC | 10 | 7 | |
Other | 50 | 35 | |
Tumor differentiation | 0.96 | ||
Low | 145 | 76 | |
Low to medium | 118 | 68 | |
Medium | 256 | 130 | |
Medium to high | 40 | 23 | |
High | 62 | 34 | |
T stage‡ | 0.17 | ||
T1 | 91 | 52 | |
T2 | 74 | 55 | |
T3 | 526 | 274 | |
N stage‡ | 0.62 | ||
N0 | 304 | 164 | |
N1 | 159 | 85 | |
N2 | 41 | 22 | |
Nx | 187 | 110 | |
Microvascular invasion | 0.64 | ||
Yes | 68 | 31 | |
No | 550 | 308 | |
NA | 73 | 42 | |
Perineural invasion | 0.43 | ||
Yes | 118 | 54 | |
No | 519 | 294 | |
NA | 54 | 33 | |
Platelets | 0.02 | ||
≤300*10^9/L | 591 | 306 | |
>300*10^9/L | 100 | 75 | |
NLR | 0.14 | ||
≤2.3 | 331 | 165 | |
>2.3 | 360 | 216 | |
LMR | 0.22 | ||
≤10 | 400 | 206 | |
>10 | 291 | 175 | |
PLR | 0.56 | ||
≤144 | 370 | 197 | |
>144 | 321 | 184 | |
SII | 0.40 | ||
≤510 | 343 | 179 | |
>510 | 348 | 202 |
†Age is presented as the median (first quartile-third quartile).
‡T stage and N stage was classified according to the AJCC 8th edition staging system.
ADC, adenocarcinoma; ADSC, adenosquamous carcinoma;PADC, papillary adenocarcinoma; NEC, neuroendocrine carcinoma; LC, laparoscopic cholecystectomy; RC, radical cholecystectomy; ERC, extended radical cholecystectomy; NLR, neutrophil-to-lymphocyte ratio; PLR, platelet-to-lymphocyte ratio; LMR, lymphocyte-to-monocyte ratio; SII, systemic immune-inflammation index.
Discovery Cohort
The optimal cut-offs were 510 for SII, 2.3 for NLR, 144 for PLR, and 10 for LMR. The following predictors were associated with worse OS: age, CA19-9>40 U/ml, total bilirubin>35 µmol/L, more advanced surgical approach, R1 resection margin status, pathological type, poor tumor differentiation, microvascular invasion, perineural invasion, advanced T staging, advanced N staging, PLR>144, NLR>2.3, LMR>10, and SII>510 ( Table 2 ). Multivariate analysis without preoperative inflammatory indices showed following predictors still associated with worse OS with statistical significance: CA19-9 levels, R1 resection margin status, poor tumor differentiation, and advanced T and N staging ( Table 2 ).
Table 2.
Univariate Analysis | Multivariate Analysis | Selected Factors for Building the Model | ||||
---|---|---|---|---|---|---|
HR (95% CI) | P value | HR (95% CI) | P value | HR (95% CI) | P value | |
Age | ||||||
>60 versus ≤60 years | 1.32 (1.06-1.64) | 0.01 | 1.31 (0.92-1.86) | 0.13 | NA | |
Sex | ||||||
Female versus Male | 0.95 (0.77-1.17) | 0.63 | NA | NA | ||
CA19-9 | ||||||
>40 versus ≤40 U/ml | 2.19 (1.74-2.76) | <0.001 | 1. 59 (1.08-2.34) | 0.01 | 1.67 (1.25-2.24) | <0.001 |
Total bilirubin | ||||||
>35 versus ≤35 µmol/L | 2.00 (1.55-2.58) | <0.001 | 1.32 (0.83-2.10) | 0.22 | NA | |
Surgical approach | ||||||
ERC versus RC | 1.76 (1.20-2.61) | 0.003 | 1.69 (0.92-3.10) | 0.08 | ||
LC+RC versus RC | 0.97 (0.74-1.28) | 0.87 | 1.16 (0.70-1.91) | 0.56 | ||
Margin status | ||||||
R1 versus R0 | 2.63 (1.94-3.57) | <0.001 | 2.10 (1.19-3.68) | 0.009 | 1.55 (1.01-2.39) | 0.04 |
Pathological type | ||||||
ADSC versus ADC | 1.23 (0.77-1.96) | 0.37 | 1.05 (0.51-2.14) | 0.88 | NA | |
PADC versus ADC | 0.24 (0.10-0.59) | 0.001 | 0.45 (0.05-3.57) | 0.45 | ||
NEC versus ADC | 1.60 (0.75-3.39) | 0.21 | 4.61 (0.84-25.21) | 0.07 | ||
Else versus ADC | 1.14(0.78-1.67) | 0.48 | 1.20 (0.54-2.66) | 0.64 | ||
Tumor differentiation | ||||||
Low to medium versus Low | 0.84 (0.62-1.15) | 0.28 | 0.59 (0.35-1.01) | 0.054 | 0.63 (0.42-0.96) | 0.03 |
Medium versus Low | 0.61 (0.47-0.80) | <0.001 | 0.53 (0.33-0.82) | 0.005 | 0.53 (0.37-0.75) | <0.001 |
Medium to high versus Low | 0.41 (0.24-0.70) | 0.001 | 0.43 (0.18-1.04) | 0.06 | 0.42 (0.21-0.84) | 0.01 |
High versus Low | 0.25 (0.15-0.42) | <0.001 | 0.38 (0.17-0.85) | 0.01 | 0.40 (0.19-0.83) | 0.01 |
T stage | ||||||
T2 versus T1 | 2.08 (1.25-3.47) | 0.004 | 1.71 (0.70-4.12) | 0.23 | 1.39 (0.66-2.92) | 0.38 |
T3 versus T1 | 3.10 (2.05-4.67) | <0.001 | 2.71 (1.18-6.24) | 0. 01 | 2.58 (1.31-5.10) | 0.006 |
N stage | ||||||
N1 versus N0 | 1.80 (1.38-2.35) | <0.001 | 1.14 (0.72-1.80) | 0.56 | 1.11 (0.77-1.59) | 0.56 |
N2 versus N0 | 3.34 (2.26-4.94) | <0.001 | 2.84 (1.50-5.39) | 0.001 | 2.43 (1.42-4.17) | 0.001 |
Nx† versus N0 | 1.53 (1.18-1.98) | 0.001 | 1.42 (0.88-2.28) | 0.14 | 1.40 (0.97-2.01) | 0.06 |
Microvascular invasion | ||||||
Yes versus No | 2.12 (1.55-2.90) | <0.001 | 1.73 (0.97-3.08) | 0.06 | ||
Perineural invasion | ||||||
Yes vs No | 1.76 (1.35-2.28) | <0.001 | 1.13 (0.69-1.85) | 0.61 | ||
Platelets | ||||||
>300 versus ≤300×109/L | 1.19 (0.89-1.60) | 0.31 | NA | |||
LMR | ||||||
>10 versus ≤10 | 1.39 (1.13-1.71) | 0.001 | NA | |||
NLR | ||||||
>2.3 versus ≤2.3 | 1.97 (1.59-2.44) | <0.001 | NA | |||
PLR | ||||||
>144 versus ≤144 | 1.58 (1.28-1.94) | <0.001 | NA | |||
SII | ||||||
>510 versus ≤510 | 1.99 (1.61-2.45) | <0.001 | NA | 1.90(1.42-2.54) | <0.001 |
†Nx means that the N stage could not be judged from the pathological record or the surgeon did not obtain a sufficient number of lymph nodes.
HR, hazard ratio; CI, confidence interval; LC, laparoscopic cholecystectomy; RC, radical cholecystectomy; ERC, extended radical cholecystectomy; NA, not applicable.
As NLR, PLR, LMR and SII were predictors of OS on univariate analysis, multivariate models were compared to find out which index to include for further multivariate analysis ( Supplementary Table 1 ). SII had the lowest AIC when compared to NLR (1249 versus 1255, log likelihood ratio test P value<0.001); PLR (1249 versus 1263, log likelihood ratio test P value<0.001) and LMR (1249 versus 1262, log likelihood ratio test P value<0.001). Moreover, SII had the highest C-index (0.735, compared to 0.732 for PLR, 0.732 for NLR and 0.722 for LMR). Indeed, all these models showed a higher C-index and lower AIC than the base model. In addition, the platelet count, which was included in SII but not in NLR, had a hazard ratio (HR) >1 (1.19, P=0.31). Based on these findings, SII was included for subsequent analyses.
Patients’ clinicopathologic characteristics categorized by high and low SII are summarized in Supplementary Table 2 . Patients with high SII had significantly higher CA19-9 levels, total bilirubin and platelets levels and had more advanced tumor progression including T stage, microvascular invasion, nerve invasion and poorer tumor differentiation.
Subgroup Analyses Showed the Effect of SII Depended on Obstructive Jaundice, CA19-9 Levels and Microvascular Invasion
The associations between SII and OS were found in the discovery ( Supplementary Figure 2A ), validation ( Supplementary Figure 2B ) and total cohorts ( Supplementary Figure 2C ). Aziz et al. (25) reported that SII lost its prognostic ability with increase in bilirubin. Subgroup analyses showed no interaction between SII with any factors with the exception of bilirubin, CA19-9 levels and microvascular invasion. Significant associations were observed between SII and bilirubin levels (P=0.006), CA19-9 levels (P=0.03) or microvascular invasion(P=0.02) ( Figure 1 ).
Of the 661 patients in the discovery cohort with available data on preoperative bilirubin levels, 108 presented with obstructive jaundice. Patients with SII<510 had significantly lower mean bilirubin levels than those with SII>510 (30.1μmol/L vs 58.5μmol/L, P<0.001). SII was correlated with pre-operative bilirubin levels (rs =0.19, P<0.001). The associations between OS and SII in the settings of low (<35 µmol/L) and high (>35 µmol/L) bilirubin levels are shown in Supplementary Figures 3A, D . Similar results were observed in the validation cohort ( Supplementary Figures 3B, E ).
CA19-9 levels were found having similar association with the prognostic ability of SII. Patients with SII<510 had significantly lower mean CA19-9 levels than those with SII>510 (145.6 U/ml versus 238.1 U/ml, P=0.04). SII was correlated with CA19-9 levels (rs =0.21, P<0.001). The prognostic ability of SII was then examined in different CA19-9 groups (≤40 U/ml versus >40 U/ml). We observed that the prognostic role of SII did not persist at high CA19-9 levels in the discovery ( Supplementary Figures 4A, D ), and validation cohort ( Supplementary Figures 4B, E )
The prognostic ability of SII was also examined in patients with or without microvascular invasion in the discovery ( Supplementary Figures 5A, D ) and validation cohort ( Supplementary Figures 5B, E ). Patients with SII>510 were more likely to have microvascular invasion (P<0.001) and SII seemed to lose its prognostic value in patients with microvascular invasion.
Prognostic Nomogram for OS
As we observed an interaction between CA19-9 and SII (p for interaction <0.05), the interaction term was included into multivariable Cox analysis. The HR of SII*CA19-9 was 0.88 (95% CI 0.50-1.55), with a P value=0.67 ( Supplementary Table 1 ). A nomogram was then established ( Figure 2 ). The nomogram showed that T staging and tumor differentiation shared the largest contributions to prognosis, followed by N staging and SII. CA19-9 levels and resection margin status had moderate impact on prognosis.
The calibration curve plots showed agreement between nomogram predictions and actual observations in the discovery cohort, and acceptable consistency in the validation cohort ( Supplementary Figure 6 ). In the discovery cohort, Harrell’s C-index for the nomogram in predicting OS (0.735, 95% CI, 0.697-0.782) was significantly higher than that for the base model without SII (0.726, 95% CI, 0.683-0.773, P<0.01) and higher than the AJCC 8th TNM prediction (0.639, 95% CI, 0.601-0.676, p<0.01, P<0.01). In the validation cohort, the C-index was also significantly higher for the nomogram (0.686, 95% CI, 0.633-0.738) than the base model (0.674, 95% CI, 0.621-0.727, P<0.01) and higher than the AJCC 8th TNM prediction (0.608, 95% CI, 0.568-0.647, p<0.01, P<0.01). The IDIs of the nomogram comparing with the multivariate model without SII were 2.4%, 4.1% and 5.4% for 1-,3-, and 5- year OS in the discovery cohort and 3.3%, 3.6%, 3.8% in the validation cohort, respectively ( Supplementary Figure 7 ), Compared to the TNM staging system, the nomogram also showed better accuracy in estimating OS (IDI: 5.9%, 10.4%, 12.2% for 1,3,5 years OS in the discovery cohort and 6.6%, 7.9%, 7.6% in the validation cohort, data not shown). The DCA plot also indicated the nomogram was superior to the model without SII and TNM staging system ( Supplementary Figure 8 ).
Construction of the Novel Staging System
Based on the nomogram, an individual predictive score of OS for each patient can be estimated. When patients with scores of 0-90, 90-200, 200-310, and ≥310 were classified into stages I (n=70), II (n=274), II (n=280) and IV (n=61), respectively ( Figure 3F ), the groups showed distinct separation on long-term prognoses. The median OS was not calculable for stage I patients due to insufficient follow up time. However, for stage II, Ш and IV patients, the median OS were 82.6, 26.9 and 12.2 months, respectively. Of the 775 patients with TNM staging, the number of patients in TNM stages of I, II, Ш and IV were 87, 71, 554 and 63, respectively ( Figure 3C ). The discriminating ability of the nomogram was superior to the AJCC TNM staging system in the discovery ( Figures 3A, D ), and validation cohort ( Figures 3B, E ).
Association Between the Nomogram and Survival Benefit From Adjuvant Chemotherapy in Patients With T2N0 or T3N0 GBC
The patients with T2N0 and T3N0 GBC who underwent R0 radical cholecystectomy in the total cohort were stratified using the nomogram to study whether there were subgroups of patients with significantly worse long-term survival. For patients with T2N0 GBC after radical cholecystectomy, the nomogram stratified these patients into separate groups with distinguished prognosis, with 5-year OS rates for stages I, II, Ш being 74%, 36%, and 33% (P=0.018, Supplementary Figure 9A ), respectively. For patients with T3N0 GBC after radical cholecystectomy, the 5-year overall survival rates for stages II, Ш, IV were 65%, 24% and 11%, respectively (P<0.01, Supplementary Figure 9B ).
Till now, there is no definitive conclusion whether postoperative adjuvant therapy is necessary for T2N0 or T3N0 patients after radical cholecystectomy. As the novel staging system resulted in good stratification of these patients, this system was hypothesized to be able to identify patients who could benefit from adjuvant chemotherapy. To verify this hypothesis, another cohort of patients ( Supplementary Table 3 ) who underwent radical cholecystectomy with or without adjuvant chemotherapy were enrolled. The chemotherapy regimens used between the two groups of patients were similar (P=0.97). Adjuvant chemotherapy provided significant survival benefit in this group of patients with T2N0 and T3N0 GBC who were known to have poor prognosis after radical cholecystectomy ( Figures 4D–F ), when compared to patients with good prognosis ( Figures 4A–C ). These results indicated the novel staging system was able to identify patients with unfavorable prognosis who could benefit from adjuvant chemotherapy.
Discussion
Mounting evidences have accumulated to support that inflammatory biomarker plays an important role in prognostication of cancers. Prior studies focused on NLR, PLR and LMR showed these inflammatory biomarkers to be of prognostic value in GBC (9, 10). The prognostic significance of several inflammatory biomarkers were assessed in this study and SII performed significantly better than NLR, PLR and LMR. Furthermore, the inclusion of SII substantially improved the prognostic estimates in patients with GBC.
The relation between SII and bilirubin levels has been studied in pancreatic cancer (25). The current study supported the prognostic value of SII for GBC, as in pancreatic cancer, decreased with higher total bilirubin levels. To our knowledge, no prior study has evaluated the prognostic value of SII with CA19-9 levels and microvascular invasion (26). The current study showed SII to lose its prognostic value at high CA19-9 levels, indicating that SII has the potential to be a prognostic marker only in the setting of a CA19-9 level<40 U/ml. Thus, SII should be used with caution in the setting of high CA19-9 levels.
After radical cholecystectomy for GBC, long-term survival in an individual patient stratified by the TNM system can vary tremendously and is difficult to predict. This study sought to develop a nomogram by combining various factors in predicting long-term survival outcomes after radical cholecystectomy for GBC. This nomogram performed well in predicting survival, as supported by the C-indexes of 0.735 and 0.686 for the discovery and validation cohorts, respectively.
Researchers have been actively finding effective adjuvant therapies for GBC which has a high recurrence rate after radical cholecystectomy (27). However, the efficacy and benefit of postoperative chemotherapy in these patients have been controversial. Negative results were found in a randomized phase Ш trial for a gemcitabine-based regimen (28). In a systematic review and meta-analysis of patients with biliary tract cancer, Horgan et al. (29) reported an insignificant improvement in OS using adjuvant therapy for GBC patients when compared with surgery alone. Retrospective studies concluded that adjuvant chemotherapy improved OS in patients with T2N1 or T3N1 GBC with microscopic residual diseases (R1) (30–33). However, no definitive conclusion could be drawn on postoperative adjuvant therapy for patients with T2N0 or T3N0 GBC after radical cholecystectomy. The nomogram and the novel staging system in this study were able to identify patients with unfavorable long-term prognosis after radical cholecystectomy (the novel stages II, Ш for T2N0 and novel stages Ш, IV for T3N0). They can also be used as a predictive tool for pathological response to adjuvant chemotherapy in patients with GBC. Future studies on postoperative adjuvant therapy should be conducted on this group of patients.
Prior studies on nomograms for GBC have identified different significant factors in predicting long-term survival outcomes (34–37). These nomograms showed better prognostic values than the commonly used TNM staging system. However, very few of these nomograms used preoperative inflammatory indices for prediction. Supplementary Table 4 summarizes the major studies on nomograms in predicting OS in GBC. In this study, models including and excluding SII were compared. The nomogram which combined inflammatory indices with pathological features performed better (0.735 versus 0.726, p<0.01), indicating that preoperative inflammatory laboratory tests should be included in the nomogram.
Incorporating prognostic biomarkers in clinical practice is challenging. SII cannot be used to select patients to undergo radical cholecystectomy, and surgical resection is still the only curative treatment for GBC patients. This study did not compare the differences in SII between surgical and non-surgical patients, and whether to perform operation was dependent on the TNM staging (21).However, it is still important to study preoperative biomarkers as recent evidences showed inflammatory biomarkers was associated with pathological response to neoadjuvant chemotherapy and immunotherapy (38–41) and the application of immune checkpoint inhibitors in treating various cancers (42) has made studies on immune-specific biomarkers even more important, The easy accessibility of SII makes it a potentially useful candidate biomarker for clinical studies on immunotherapy for GBC.
Surveillance, Epidemiology, and End Results (SEER) has been one of the most commonly used cancer registry database which included 13373 gallbladder cancer patients. However, preoperative blood tests of patients are not available. The Chinese Research Group of Gallbladder Cancer (CRGGC) Project is a national multicenter retrospective tumor registry which has collected from 2000 to 2019 data of more than 9496 patients, and the number is still increasing. This project contains preoperative laboratory tests in calculating inflammatory indices.
There are several limitations of this study. First, it is a retrospective study with its inherent defects, including limited availability of laboratory data at various preoperative time points. Second, some pathological features, including vascular invasion and nerve invasion, are not available. Third, as there are no universally accepted standards on the cut-off points used in converting continuous variables into category variables, this study calculated the cut-off point of SII based on statistical methods, and it was different from the cut-off points used for other cancers (25, 43). Whether the differences in the cut-off points used are due to different types of tumors or due to insufficient number of patients used in the studies are still unknown. Fourth, this study spanned over a relatively long period of time, and progress in surgical technology and techniques can affect OS to some extent. The validation cohort was divided into 2 groups as patients before 2014 and patients after 2014, and difference of predictive performance of the nomogram was noticed. The C-index in patients before 2014 was 0.661(95% CI:0.591-0.731) and in patients after 2014 was 0.709 (95% CI:0.627-0.791). Finally, external validation of these findings in other cohorts, which is essential, has not been done.
In conclusion, this study is a large study on the value of SII in patients with GBC after radical cholecystectomy. A nomogram was constructed by combining both preoperative and pathological features. This nomogram showed good accuracy in predicting long-term survival outcomes of patients with GBC after radical cholecystectomy; and the new staging system could be used to identify groups of lymph node negative patients with T2 and T3 GBC with unfavorable prognosis who could benefit from adjuvant therapy. Further prospective studies are needed to confirm the findings of this study.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
Ethical approval was obtained from the Ethics Committee of Renji Hospital Affiliated to Shanghai Jiao Tong University School of Medicine.
Author Contributions
LL: Data curation, formal analysis, investigation, methodology, project administration, software, validation, visualization, writing – original draft, and writing – review and editing. TR: Methodology, project administration, software, validation, visualization, writing – original draft, and writing – review and editing. KL: Methodology, project administration, software, validation, visualization, and writing – original draft, writing – review and editing. M-LL: Data curation, formal analysis, validation, visualization, and writing – review and editing. YY: Methodology, software, visualization, and writing – review and editing. H-FL: Funding acquisition, resources, supervision, and writing – review and editing. X-CL: Methodology, software, visualization, and writing – review and editing. R-FB: Methodology, resources, and supervision. Y-JS: Resources and supervision. HW: Methodology, software, and visualization. WG: Project administration, resources, validation, and writing – review and editing. WL: Project administration, resources, validation, and writing – review and editing. X-SW: Conceptualization, funding acquisition, investigation, methodology, supervision, validation, and writing – review and editing. Y-BL: Conceptualization, funding acquisition, project administration, resources, supervision, and writing – review and editing. All authors contributed to the article and approved the submitted version.
Funding
This study was supported by Shanghai Key Laboratory of Biliary Tract Disease Research Foundation(17DZ2260200), the National Natural Science Foundation of China (No. 81502433, 81773043, 91440203, 81702315), Clinical Research Program of Xinhua Hospital (19XHCR3D), Multi-center Clinical Research Project of Shanghai Jiaotong University School of Medicine(DLY201507), the Project of Excellent Young Scholars from Shanghai Municipal Health and Family Planning Commission (No. 2018YQ10), the Talent Development Fund from Shanghai Municipal Human Resources and Social Security Bureau (No. 2018048), and the Project of Experimental Animal Research from Science and Technology Commission Shanghai Municipality (No. 19140902700) and Shanghai Sailing Program (No.21YF1428700), Shanghai national science foundation (20ZR1435200) and Shanghai joint research projects on emerging frontier technologies (SHDC12018107).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We would like to thank our collaborators for their contributions to the CRGGC study, as follows: Professor Houbao Liu at Zhongshan Hospital, Professor Chong Jin at Taizhou Municipal Hospital, Professor Xiaoyong Li at The Fifth Affiliated Hospital of Zhengzhou University, Professor Xiaoliang Chen at Jiangxi Provincial People’s Hospital, Professor Xueli Zhang at Shanghai Fengxian District Central Hospital, Professor Jianfeng Gu at Changshu No.1 People’s Hospital, Professor Yuzhen Xu at Xuzhou Central Hospital, Professor Zhewei Fei at Xinhua (Chongming) Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Professor Yudong Qiu at Nanjing Drum Tower Hospital, Professor Xuewen Zhang at The Second Hospital of Jilin University, Professor Hongyu Cai at Nantong Tumor Hospital, Professor Yi Wang at The First People’s Hospital of Taicang, Professor Zaiyang Zhang at Shaoxing Second Hospital, Professor Kunhua Wang at The First Affiliated Hospital of Kunming Medical University, Professor Xiaoqing Jiang at Eastern Hepatobiliary Surgery Hospital, Professor Hong Cao at China-Japan Union Hospital of Jilin University, Professor Defei Hong at Sir Run Run Shaw Hospital, Professor Yongjun Chen at Ruijin Hospital, Professor Bei Sun at The First Affiliated Hospital of Harbin Medical University, Professor Chunfu Zhu at Changzhou No.2 People’s Hospital, Professor Qiyun Li at Jiangxi Cancer Hospital, Professor Jingyu Cao at The Affiliated Hospital of Qingdao University, Professor Chaoliu Dai at Shengjing Hospital of China Medical University, Professor Yunfu Cui at The Second Affiliated Hospital of Harbin Medical University, Professor Jihui Hao at Tianjin Medical University Cancer Hospital, Professor Bing Li at Harbin Medical University Cancer Hospital, Professor Linhui Zheng at The First Affiliated Hospital of Nanchang University, Professor Yeben Qian at The First Affiliated Hospital of Anhui Medical University, Dr Bo Yang at The First Affiliated Hospital of Wenzhou Medical University, Professor Chang Liu at The First Affiliated Hospital of Xi’an Jiaotong University, Professor Jun Liu at Shangdong Provincial Hospital, Professor Changjun Liu at People’s Hospital of Hunan Province, Professor Xueyi Dang at Shanxi Provincial Cancer Hospital and Professor Lin Wang at Xijing Hospital.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2021.692647/full#supplementary-material
References
- 1. Song X, Hu Y, Li Y, Shao R, Liu F, Liu Y. Overview of Current Targeted Therapy in Gallbladder Cancer. Signal Transduct Target Ther (2020) 5(1):230. 10.1038/s41392-020-00324-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Li H, Hu Y, Jin Y, Zhu Y, Hao Y, Liu F, et al. Long Noncoding RNA lncGALM Increases Risk of Liver Metastasis in Gallbladder Cancer Through Facilitating N-cadherin and IL-1β-Dependent Liver Arrest and Tumor Extravasation. Clin Transl Med (2020) 10(7):e201. 10.1002/ctm2.201 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Amin MB, Edge S, Greene F, Byrd DR, Brookland RK, Washington MK, et al. AJCC Cancer Staging Manual. Chicago, IL: American Joint Committee on Cancer: Springer; (2017). [Google Scholar]
- 4. Cai ZQ, Guo P, Si SB, Geng ZM, Chen C, Cong LL. Analysis of Prognostic Factors for Survival After Surgery for Gallbladder Cancer Based on a Bayesian Network. Sci Rep (2017) 7(1):293. 10.1038/s41598-017-00491-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Agrawal S, Lawrence A, Saxena R. Does CA 19-9 Have Prognostic Relevance in Gallbladder Carcinoma (Gbc)? J Gastrointest Cancer (2018) 49(2):144–9. 10.1007/s12029-016-9914-5 [DOI] [PubMed] [Google Scholar]
- 6. Gukovsky I, Li N, Todoric J, Gukovskaya A, Karin M. Inflammation, Autophagy, and Obesity: Common Features in the Pathogenesis of Pancreatitis and Pancreatic Cancer. Gastroenterology (2013) 144(6):1199–209.e4. 10.1053/j.gastro.2013.02.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Yang L, Karin M. Roles of Tumor Suppressors in Regulating Tumor-Associated Inflammation. Cell Death Differ (2014) 21(11):1677–86. 10.1038/cdd.2014.131 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Roxburgh CS, McMillan DC. Role of Systemic Inflammatory Response in Predicting Survival in Patients With Primary Operable Cancer. Future Oncol (2010) 6(1):149–63. 10.2217/fon.09.136 [DOI] [PubMed] [Google Scholar]
- 9. Mady M, Prasai K, Tella SH, Yadav S, Hallemeier CL, Rakshit S, et al. Neutrophil to Lymphocyte Ratio as a Prognostic Marker in Metastatic Gallbladder Cancer. HPB (Oxford) (2020) 22(10):1490–5. 10.1016/j.hpb.2020.02.002 [DOI] [PubMed] [Google Scholar]
- 10. Jansson H, Cornillet M, Björkström NK, Sturesson C, Sparrelid E. Prognostic Value of Preoperative Inflammatory Markers in Resectable Biliary Tract Cancer - Validation and Comparison of the Glasgow Prognostic Score and Modified Glasgow Prognostic Score in a Western Cohort. Eur J Surg Oncol (2020) 46(5):804–10. 10.1016/j.ejso.2019.12.008 [DOI] [PubMed] [Google Scholar]
- 11. Saqib R, Pathak S, Smart N, Nunes Q, Rees J, Finch Jones M, et al. Prognostic Significance of Pre-Operative Inflammatory Markers in Resected Gallbladder Cancer: A Systematic Review. ANZ J Surg (2018) 88(6):554–9. 10.1111/ans.14300 [DOI] [PubMed] [Google Scholar]
- 12. Hu B, Yang XR, Xu Y, Sun YF, Sun C, Guo W, et al. Systemic Immune-Inflammation Index Predicts Prognosis of Patients After Curative Resection for Hepatocellular Carcinoma. Clin Cancer Res (2014) 20(23):6212–22. 10.1158/1078-0432.CCR-14-0442 [DOI] [PubMed] [Google Scholar]
- 13. Sun L, Jin Y, Hu W, Zhang M, Jin B, Xu H, et al. The Impacts of Systemic Immune-Inflammation Index on Clinical Outcomes in Gallbladder Carcinoma. Front Oncol (2020) 10:554521. 10.3389/fonc.2020.554521 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Kattan MW, Scardino PT. Evidence for the Usefulness of Nomograms. Nat Clin Pract Urol (2007) 4(12):638–9. 10.1038/ncpuro0968 [DOI] [PubMed] [Google Scholar]
- 15. Han DS, Suh YS, Kong SH, Lee HJ, Choi Y, Aikou S, et al. Nomogram Predicting Long-Term Survival After D2 Gastrectomy for Gastric Cancer. J Clin Oncol (2012) 30(31):3834–40. 10.1200/JCO.2012.41.8343 [DOI] [PubMed] [Google Scholar]
- 16. Wang Y, Li J, Xia Y, Gong R, Wang K, Yan Z, et al. Prognostic Nomogram for Intrahepatic Cholangiocarcinoma After Partial Hepatectomy. J Clin Oncol (2013) 31(9):1188–95. 10.1200/JCO.2012.41.5984 [DOI] [PubMed] [Google Scholar]
- 17. Mariani L, Miceli R, Kattan MW, Brennan MF, Colecchia M, Fiore M, et al. Validation and Adaptation of a Nomogram for Predicting the Survival of Patients With Extremity Soft Tissue Sarcoma Using a Three-Grade System. Cancer (2005) 103(2):402–8. 10.1002/cncr.20778 [DOI] [PubMed] [Google Scholar]
- 18. Tang LQ, Li CF, Li J, Chen WH, Chen QY, Yuan LX, et al. Establishment and Validation of Prognostic Nomograms for Endemic Nasopharyngeal Carcinoma. J Natl Cancer Inst (2015) 108(1):djv291. 10.1093/jnci/djv291 [DOI] [PubMed] [Google Scholar]
- 19. Liang W, Zhang L, Jiang G, Wang Q, Liu L, Liu D, et al. Development and Validation of a Nomogram for Predicting Survival in Patients With Resected non-Small-Cell Lung Cancer. J Clin Oncol (2015) 33(8):861–9. 10.1200/JCO.2014.56.6661 [DOI] [PubMed] [Google Scholar]
- 20. Karakiewicz PI, Briganti A, Chun FK, Trinh QD, Perrotte P, Ficarra V, et al. Multi-Institutional Validation of a New Renal Cancer-Specific Survival Nomogram. J Clin Oncol (2007) 25(11):1316–22. 10.1200/JCO.2006.06.1218 [DOI] [PubMed] [Google Scholar]
- 21. Aloia TA, Járufe N, Javle M, Maithel SK, Roa JC, Adsay V, et al. Gallbladder Cancer: Expert Consensus Statement. HPB (2015) 17(8):681–90. 10.1111/hpb.12444 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Benson AB, D’Angelica MI, Abbott DE, Anaya DA, Anders R, Are C, et al. Hepatobiliary Cancers, Version 2.2021, NCCN Clinical Practice Guidelines in Oncology. J Natl Compr Canc Netw (2021) 19(5):541–65. 10.6004/jnccn.2021.0022 [DOI] [PubMed] [Google Scholar]
- 23. Ren T, Li Y, Zhang X, Geng Y, Shao Z, Li M, et al. Protocol for a Gallbladder Cancer Registry Study in China: The Chinese Research Group of Gallbladder Cancer (CRGGC) Study. BMJ Open (2021) 11(2):e038634. 10.1136/bmjopen-2020-038634 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Collins GS, Ogundimu EO, Altman DG. Sample Size Considerations for the External Validation of a Multivariable Prognostic Model: A Resampling Study. Stat Med (2016) 35(2):214–26. 10.1002/sim.6787 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Aziz MH, Sideras K, Aziz NA, Mauff K, Haen R, Roos D, et al. The Systemic-Immune-Inflammation Index Independently Predicts Survival and Recurrence in Resectable Pancreatic Cancer and its Prognostic Value Depends on Bilirubin Levels: A Retrospective Multicenter Cohort Study. Ann Surg (2019) 270(1):139–46. 10.1097/SLA.0000000000002660 [DOI] [PubMed] [Google Scholar]
- 26. Strom BL, Maislin G, West SL, Atkinson B, Herlyn M, Saul S, et al. Serum CEA and CA 19-9: Potential Future Diagnostic or Screening Tests for Gallbladder Cancer? Int J Cancer (1990) 45(5):821–4. 10.1002/ijc.2910450505 [DOI] [PubMed] [Google Scholar]
- 27. Jarnagin WR, Ruo L, Little SA, Klimstra D, D’Angelica M, DeMatteo RP, et al. Patterns of Initial Disease Recurrence After Resection of Gallbladder Carcinoma and Hilar Cholangiocarcinoma: Implications for Adjuvant Therapeutic Strategies. Cancer (2003) 98(8):1689–700. 10.1002/cncr.11699 [DOI] [PubMed] [Google Scholar]
- 28. Edeline J, Benabdelghani M, Bertaut A, Watelet J, Hammel P, Joly JP, et al. Gemcitabine and Oxaliplatin Chemotherapy or Surveillance in Resected Biliary Tract Cancer (Prodige 12-ACCORD 18-UNICANCER Gi): A Randomized Phase Iii Study. J Clin Oncol (2019) 37(8):658–67. 10.1200/JCO.18.00050 [DOI] [PubMed] [Google Scholar]
- 29. Horgan AM, Amir E, Walter T, Knox JJ. Adjuvant Therapy in the Treatment of Biliary Tract Cancer: A Systematic Review and Meta-Analysis. J Clin Oncol (2012) 30(16):1934–40. 10.1200/JCO.2011.40.5381 [DOI] [PubMed] [Google Scholar]
- 30. Gold DG, Miller RC, Haddock MG, Gunderson LL, Quevedo F, Donohue JH, et al. Adjuvant Therapy for Gallbladder Carcinoma: The Mayo Clinic Experience. Int J Radiat Oncol Biol Phys (2009) 75(1):150–5. 10.1016/j.ijrobp.2008.10.052 [DOI] [PubMed] [Google Scholar]
- 31. Kim Y, Amini N, Wilson A, Margonis GA, Ethun CG, Poultsides G, et al. Impact of Chemotherapy and External-Beam Radiation Therapy on Outcomes Among Patients With Resected Gallbladder Cancer: A Multi-Institutional Analysis. Ann Surg Oncol (2016) 23(9):2998–3008. 10.1245/s10434-016-5262-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Kim K, Chie EK, Jang JY, Kim SW, Han SW, Oh DY, et al. Postoperative Chemoradiotherapy for Gallbladder Cancer. Strahlenther Onkol (2012) 188(5):388–92. 10.1007/s00066-012-0074-7 [DOI] [PubMed] [Google Scholar]
- 33. Cho SY, Kim SH, Park SJ, Han SS, Kim YK, Lee KW, et al. Adjuvant Chemoradiation Therapy in Gallbladder Cancer. J Surg Oncol (2010) 102(1):87–93. 10.1002/jso.21544 [DOI] [PubMed] [Google Scholar]
- 34. Bai Y, Liu ZS, Xiong JP, Xu WY, Lin JZ, Long JY, et al. Nomogram to Predict Overall Survival After Gallbladder Cancer Resection in China. World J Gastroenterol (2018) 24(45):5167–78. 10.3748/wjg.v24.i45.5167 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Wang SJ, Lemieux A, Kalpathy-Cramer J, Ord CB, Walker GV, Fuller CD, et al. Nomogram for Predicting the Benefit of Adjuvant Chemoradiotherapy for Resected Gallbladder Cancer. J Clin Oncol (2011) 29(35):4627–32. 10.1200/JCO.2010.33.8020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Zhang W, Hong HJ, Chen YL. Establishment of a Gallbladder Cancer-Specific Survival Model to Predict Prognosis in Non-metastatic Gallbladder Cancer Patients After Surgical Resection. Digest Dis Sci (2018) 63(9):2251–8. 10.1007/s10620-018-5103-7 [DOI] [PubMed] [Google Scholar]
- 37. Geng ZM, Cai ZQ, Zhang Z, Tang ZH, Xue F, Chen C, et al. Estimating Survival Benefit of Adjuvant Therapy Based on a Bayesian Network Prediction Model in Curatively Resected Advanced Gallbladder Adenocarcinoma. World J Gastroenterol (2019) 25(37):5655–66. 10.3748/wjg.v25.i37.5655 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Hasegawa S, Eguchi H, Tomokuni A, Tomimaru Y, Asaoka T, Wada H, et al. Pre-Treatment Neutrophil to Lymphocyte Ratio as a Predictive Marker for Pathological Response to Preoperative Chemoradiotherapy in Pancreatic Cancer. Oncol Lett (2016) 11(2):1560–6. 10.3892/ol.2015.4057 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Chen Y, Chen K, Xiao X, Nie Y, Qu S, Gong C, et al. Pretreatment Neutrophil-to-Lymphocyte Ratio is Correlated With Response to Neoadjuvant Chemotherapy as an Independent Prognostic Indicator in Breast Cancer Patients: A Retrospective Study. BMC Cancer (2016) 16:320. 10.1186/s12885-016-2352-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Ferrucci PF, Ascierto PA, Pigozzo J, Del Vecchio M, Maio M, Antonini Cappellini GC, et al. Baseline Neutrophils and Derived Neutrophil-to-Lymphocyte Ratio: Prognostic Relevance in Metastatic Melanoma Patients Receiving Ipilimumab. Ann Oncol (2016) 27(4):732–8. 10.1093/annonc/mdw016 [DOI] [PubMed] [Google Scholar]
- 41. Kuzman JA, Stenehjem DD, Merriman J, Agarwal AM, Patel SB, Hahn AW, et al. Neutrophil-Lymphocyte Ratio as a Predictive Biomarker for Response to High Dose Interleukin-2 in Patients With Renal Cell Carcinoma. BMC Urol (2017) 17(1):1. 10.1186/s12894-016-0192-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Johansson H, Andersson R, Bauden M, Hammes S, Holdenrieder S, Ansari D. Immune Checkpoint Therapy for Pancreatic Cancer. World J Gastroenterol (2016) 22(43):9457–76. 10.3748/wjg.v22.i43.9457 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Jomrich G, Paireder M, Kristo I, Baierl A, Ilhan-Mutlu A, Preusser M, et al. High Systemic Immune-Inflammation Index is an Adverse Prognostic Factor for Patients With Gastroesophageal Adenocarcinoma. Ann Surg (2021) 273(3):532–41. 10.1097/SLA.0000000000003370 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.