Skip to main content
JAMA Network logoLink to JAMA Network
. 2024 Jul 24;159(10):1139–1147. doi: 10.1001/jamasurg.2024.2485

Futility of Up-Front Resection for Anatomically Resectable Pancreatic Cancer

Stefano Crippa 1, Giuseppe Malleo 2, Vincenzo Mazzaferro 3,, Serena Langella 4, Claudio Ricci 5,6, Fabio Casciani 2, Giulio Belfiori 1, Sara Galati 4, Vincenzo D’Ambra 5,6, Gabriella Lionetto 2, Alessandro Ferrero 4, Riccardo Casadei 5,6, Giorgio Ercolani 6,7, Roberto Salvia 2, Massimo Falconi 1, Alessandro Cucchetti 6,7
PMCID: PMC11270270  PMID: 39046713

This study attempts to develop a futility risk model using a multi-institutional database and provide unified criteria associated with a futility likelihood below a safety threshold of 20%.

Key Points

Question

What are the rates and factors associated with a futile up-front pancreatectomy in patients with anatomically resectable pancreatic ductal adenocarcinoma?

Findings

In this observational study that included 1426 patients, the rate of futile pancreatectomy (death or disease recurrence within 6 months of the operation) was 18.9%. A preoperative model including American Society of Anesthesiologists class, cancer antigen 19.9 levels serum levels, and radiologic tumor size was implemented using a web-based calculator for personalized prediction.

Meaning

These results demonstrate that the ability to predict futile pancreatectomy could help select patients for up-front resection or neoadjuvant therapy.

Abstract

Importance

There are currently no clinically relevant criteria to predict a futile up-front pancreatectomy in patients with anatomically resectable pancreatic ductal adenocarcinoma.

Objectives

To develop a futility risk model using a multi-institutional database and provide unified criteria associated with a futility likelihood below a safety threshold of 20%.

Design, Setting, and Participants

This retrospective study took place from January 2010 through December 2021 at 5 high- or very high-volume centers in Italy. Data were analyzed during April 2024. Participants included consecutive patients undergoing up-front pancreatectomy at the participating institutions.

Exposure

Standard management, per existing guidelines.

Main Outcomes and Measures

The main outcome measure was the rate of futile pancreatectomy, defined as an operation resulting in patient death or disease recurrence within 6 months. Dichotomous criteria were constructed to maintain the futility likelihood below 20%, corresponding to the chance of not receiving postneoadjuvant resection from existing pooled data.

Results

This study included 1426 patients. The median age was 69 (interquartile range, 62-75) years, 759 patients were male (53.2%), and 1076 had head cancer (75.4%). The rate of adjuvant treatment receipt was 73.7%. For the model construction, the study sample was split into a derivation (n = 885) and a validation cohort (n = 541). The rate of futile pancreatectomy was 18.9% (19.2% in the development and 18.6% in the validation cohort). Preoperative variables associated with futile resection were American Society of Anesthesiologists class (95% CI for coefficients, 0.68-0.87), cancer antigen (CA) 19.9 serum levels (95% CI, for coefficients 0.05-0.75), and tumor size (95% CI for coefficients, 0.28-0.46). Three risk groups associated with an escalating likelihood of futile resection, worse pathological features, and worse outcomes were identified. Four discrete conditions (defined as CA 19.9 levels-adjusted-to-size criteria: tumor size less than 2 cm with CA 19.9 levels less than 1000 U/mL; tumor size less than 3 cm with CA 19.9 levels less than 500 U/mL; tumor size less than 4 cm with CA 19.9 levels less than 150 U/mL; and tumor size less than 5 cm with CA 19.9 levels less than 50 U/mL) were associated with a futility likelihood below 20%. Both disease-free survival and overall survival were significantly longer in patients fulfilling the criteria.

Conclusions and relevance

In this study, a preoperative model (MetroPancreas) and dichotomous criteria to determine the risk of futile pancreatectomy were developed. This might help in selecting patients for up-front resection or neoadjuvant therapy.

Introduction

A combination of tumor resection and systemic treatment is the only chance for long-term survival in patients with pancreatic ductal adenocarcinoma (PDAC).1 Current indications for immediate pancreatectomy in surgically fit patients include absence or minimal solid tumor contact with peripancreatic vasculature and no concern for occult metastatic disease.2 However, primary resection is associated with a high incidence of postoperative complications with a profound impact on hospital stay, patient recovery, and delay, or even omission of adjuvant chemotherapy.3,4 Furthermore, up to 35% of patients have disease recurrence within a year of the operation.5,6,7,8 The poor prognostic outlook associated with early recurrence has challenged the effectiveness of pancreatectomy as the primary therapeutic strategy. However, the outcomes from randomized trials of alternative approaches, such as neoadjuvant treatment, have been mixed.9,10,11,12 Because randomized trials were not stratified by radiological, biological, or conditional factors, from a real-life perspective, the selection criteria for up-front pancreatectomy or neoadjuvant therapy based on a quantitative estimation of early recurrence risk are ill defined.

The present study aimed to develop a futility risk model for up-front pancreatectomy using a multi-institutional database of patients with anatomically resectable PDAC. In surgical research, an operation is defined as futile when it is not expected to improve the patient’s health, alleviate their symptoms, or prolong life, and when the potential risks and complications outweigh any anticipated benefit.13,14 Specifically, we sought to identify pretreatment variables associated with futile pancreatectomy (defined as an operation resulting in patient death or disease recurrence within 6 months) and develop a web-based tool (MetroPancreas) for individual prognostication. Furthermore, unified criteria were searched to maintain the likelihood of a futile pancreatectomy below a safety threshold, weighted against the chance of not receiving postneoadjuvant resection.

Methods

Patient Management and Data Collection

Data for patients who underwent up-front pancreatectomy for anatomically resectable PDAC were abstracted from a multi-institutional Italian database, including 2928 consecutive patients who underwent resection between January 2010 and December 2021. Resectability status was defined according to the National Comprehensive Cancer Network (NCCN) and the International Consensus on Definition and Criteria of borderline resectable PDAC, summarized in the eTable in Supplement 1.2,15 In resectable disease, a clear fat plane around peripancreatic vasculature with no artery/vein contour irregularity or lumen narrowing was always evident. Exclusion criteria were: (1) anatomic borderline resectable PDAC or locally advanced PDAC, (2) preoperative or intraoperative evidence of metastatic disease, (3) receipt of neoadjuvant therapy, (4) final pathologic diagnosis other than PDAC, (5) incomplete clinical or survival data, and (6) early censoring (less than 6 months postoperatively).

Preoperative staging included a thin-slice, triphasic contrast-enhanced computed tomography of the chest/abdomen within 30 to 40 days before surgery, which was reviewed by dedicated radiologists during multidisciplinary evaluation. External imaging was repeated when considered of poor quality. Although indications for up-front pancreatectomy changed over time and among centers, they were commonly based on the perceived probability of success on the grounds of radiologic features (tumor size, necrotic core, soft tissue stranding), clinical features (symptoms, weight loss, nutritional status), cancer antigen (CA) 19.9 levels, age/life expectancy, and in some cases patient’s preference. Clinical details included demographics, body mass index (BMI), American Society of Anesthesiology (ASA) class, symptoms, tumor markers, radiological staging, and type of resection. Pathologic data included the primary tumor size and grading, the number of harvested and metastatic lymph nodes, the positive to-lymph node ratio, and perineural invasion. Any surgical margin was classified as tumor free if no microscopic tumor was evident within 1 mm of the transection line.16

Adjuvant therapy was always considered within 12 weeks of the operation. All patients underwent chest/abdomen contrast-enhanced computed tomography scan and CA 19.9 measurement before adjuvant therapy receipt. The chemotherapy regimens used during the study period varied among participating centers. Most patients received gemcitabine-based chemotherapy with or without radiation therapy. An active radiologic follow-up strategy was performed in all patients with a biannual frequency for the first 2 to 3 years and yearly thereafter. The overall survival (OS) duration was calculated from the time of pancreatectomy until death or last follow-up and the disease-free survival (DFS) was calculated from the time of pancreatectomy until evidence of tumor recurrence or death. Data were locked on October 2023. The study is compliant with Regulation (European Union) 2016/679 of the European Parliament, of the Council of April 27, 2016, and according to Italian law (resolution March 1, 2012, Gazzetta Ufficiale No. 72 of March 26, 2012) on the use and protection of personal data. Ethics approval and informed consent were not required, owing to the retrospective design, the use of anonymized data, and the noninterventional nature of the study. The study is compliant with the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD).17

Outcome Measures

The primary outcome measure was the rate of a futile up-front pancreatectomy. A potentially curative up-front pancreatectomy was defined as futile when death from postoperative complications, PDAC–related events, or cancer recurrence occurred within 6 months of the operation. The reasons for setting a 6-month time mark were multifold. First, we assumed that very early recurrence/death is primarily related to an undetected micrometastatic disease or an incomplete resection.5,6,7,8 Second, we assumed that neoadjuvant treatment would have been a viable alternative in case of a futile up-front pancreatectomy.18 In this framework, the 6-month time mark corresponds to the immortal time relative to a neoadjuvant therapy course in previous trials and landmark analyses.19,20

Statistical Analysis and Model Development

The overall cohort was split into a derivation cohort including patients from a very high-volume center (Verona), 2 high-volume centers (Bologna and Forlì), an external validation cohort from a very high-volume center (Milan), and a high-volume center (Turin), with a ratio of 62% to 38%. This ratio was set to keep a similar distribution between very high- and high-volume centers within cohorts. In high-volume centers, at least 80 pancreatic resections were performed annually compared with more than 200 resections in very high-volume centers.21 Continuous variables were reported as medians with interquartile range (IQR) and were compared using the Mann-Whitney or the Kruskal-Wallis test, as appropriate. Categorical variables were presented as frequencies with percentages and were compared using the χ2 or Fisher exact test, as appropriate. Trends were assessed using the Cochran-Armitage test.

A backward logistic regression analysis was performed in the derivation cohort to identify preoperative variables independently associated with futile resection (P < .05). Next, a K-fold cross-validation was carried out to correct for overfitting. The number of folds was determined using 20% of the cohort as out-of-sample records of the derivation cohort. Coefficients resulting from the K-fold cross-validation were averaged and discrete risk groups were identified based on tertiles of the linear predictor. The futility risk model was correlated with outcome variables, including histological features, receipt of adjuvant chemotherapy, disease recurrence, and overall survival. Lastly, the model was tested in the external validation cohort and an online calculator was implemented (primary end point). All regression analyses were conducted using robust estimation of standard errors to account for the clustered nature of the multicentric data. Discrimination was assessed through C-statistic22, and calibration was evaluated using the Hosmer-Lemeshow test. Specifically, the test calculates if the observed event rates match the expected event rates in population subgroups, with several subgroups set at the number of K-fold cross-validations. A P value >.05 at the test indicated that the model is well calibrated.

The secondary end point was to work out unified, dichotomous criteria for surgical candidacy through a simplified version of the algorithm. To this end, a threshold that would allow for a likelihood of a futile up-front resection less than 20% was set under the premise that the harm after a futile up-front pancreatectomy should at least balance the worst scenario of not receiving resection following neoadjuvant therapy. The threshold corresponds to the lower bound of the 95% CI of the postneoadjuvant resection rate from the most recent meta-analyses (resection rate, 0.90; 95% CI, 0.80-1.01; heterogeneity 0%).23,24

The OS and DFS curves were constructed using the Kaplan-Meier method and pairwise differences between groups were assessed using the log-rank test. All the analyses were conducted using Stata version 18.0 (StataCorp).

Results

A total of 1426 patients met the inclusion criteria and were included in the analysis. The study flowchart is shown in the eFigure in Supplement 1. The median age was 69 (IQR, 62-75) years. Most patients were male (759 [53.2%]) with ASA class I or II (860 [60.6%]). Pancreatoduodenectomy was the most common procedure (945 [66.3%]) and 1051 patients received adjuvant treatment (73.7%). Within 6 months of pancreatectomy, tumor recurrence was diagnosed in 199 patients (14.0%), 97 patients died of postoperative complications or other causes (6.8%), and 27 (1.8%) died of disease. Therefore, pancreatectomy proved to be futile in 269 patients (18.9%). In the overall cohort, the median follow-up was 25.2 (IQR, 14.3-44.1) months, the median DFS was 16.2 months (95% CI, 15.1-17-4), and the median OS was 34.1 months (95% CI, 32.2-37.1).

The derivation cohort included 885 patients and the validation cohort included 541 patients. While most of the preoperative clinical features were significantly different between the 2 cohorts, oncologic outcomes, including DFS and OS, were comparable (Table 1).

Table 1. Preoperative Clinical Characteristics and Outcome Measures of Derivation and Validation Cohorts After Up-Front Surgery of Anatomically Resectable Pancreatic Ductal Adenocarcinoma.

Characteristic Cohort, No. (%) P value
Derivation (n = 885)a Validation (n = 541)
Clinical features
Age, y, median (IQR) 68 (61-74) 71 (64-76) .001
Sex
Female 419 (47.3) 249 (45.8) .31
Male 466 (52.7) 293 (54.2%)
Symptoms at diagnosis
Pain 128 (14.5) 101 (18.7) .02
Weight loss 397 (44.9) 184 (34.0) .001
Jaundice 496 (56.1) 294 (54.3) .28
Head location 649 (73.3) 427 (78.9) .01
ASA class
I 29 (3.3) 20 (3.7) .01
II 535 (60.5) 280 (51.8)
III 321 (36.3) 241 (44.6)
Radiological size, median (IQR), cm 2.7 (2.0-3.1) 2.5 (2.0-3.0) .04
CA 19-9 level, median (IQR), U/mL 93 (26-249) 47 (3-199) .001
Log CA 19-9 level, median (IQR), U/mL 1.96 (1.41- 2.39) 1.76 (0.48-2.29) .001
Type of operation
Pancreatoduodenectomy 552 (62.4) 393 (72.6) .001
Distal pancreatectomy 218 (24.6) 107 (19.8)
Total pancreatectomy 115 (13.0) 41 (7.6)
Adjuvant treatment 672 (75.9) 379 (70.1) .02
Outcomes
30-d Mortality 12 (1.4) 11 (2.0) .39
90-d Mortality 39 (4.4) 22 (4.1) .79
Death within 6 mo 56 (6.3) 41 (7.6) .39
Recurrence within 6 mo 117 (13.2) 82 (15.2) .30
Futility of up-front surgeryb 165 (18.6) 104 (19.2) .78
DFS median (95% CI), mo 16.5 (15.0-18.1) 15.9 (14.3-17.8) .96
OS, median (95% CI), mo 35.1 (32.1-37.4) 33.7 (28.8-38.6) .45
Follow-up length, median (IQR) 24.8 (14.2-44.3) 25.8 (14.7-44.1) .81

Abbreviations: ASA, American Society of Anesthesiology; CA, cancer antigen; DFS, disease-free survival; IQR, interquartile range; OS, overall survival.

a

The derivation cohort was formed by 3 very high-volume centers (Verona) and 2 high-volume centers (Bologna and Forlì). The external validation cohort was formed by 1 very high-volume center (Milan) and 1 high-volume center (Turin).

b

Defined as death or recurrence within 6 months of resection. Twenty-seven patients (8 in the derivation cohort and 19 in the validation cohort) had recurrence/died within this time frame.

Futility Risk Model

The preliminary regression model identified ASA class (95% CI for coefficients, 0.68-0.87; P = .001), preoperative CA 19.9 serum (95% CI for coefficients, 0.05-0.75; P = .04), and radiological tumor size (95% CI for coefficients, 0.28-0.46; P = .001) as the most robust independent variables associated with futile pancreatectomy. These 3 variables entered the subsequent K-fold cross-validation regression (Table 2). After averaging variable coefficients, the C-statistic of the out-of-sample cohorts was 0.68 (95% CI, 0.63-0.72), indicating good discrimination and likely avoiding model overfit. The Hosmer-Lemeshow test P value was 0.39, indicating adequate calibration. An individual case prognostication algorithm (MetroPancreas) is available online.25

Table 2. Modeling Futility (Recurrence or Death Within 6 Months) After Up-Front Surgery of Anatomically Resectable Pancreatic Ductal Adenocarcinoma Based on Preoperative Clinical Features in the Derivation Cohort.

k-Fold cross validation Pooled (95% CI)
1 2 3 4 5
In-sample cohorts, No. 708 708 708 708 708 885
Coefficients (95% CI)
ASA class III 0.906 (0.805-1.006) 0.681 (0.603-0.759) 0.687 (0.575-0.798) 0.781 (0.647-0.915) 0.841 (0.803-0.880) 0.779 (0.687-0.871)
Tumor size, cm 0.399 (0.301-0.496) 0.384 (0.309-0.459) 0.334 (0.250-0.417) 0.424 (0.391-0.458) 0.332 (0.148 to 0.517) 0.375 (0.280-0.469)
Ca 19-9 level (per log10) 0.450 (0.009-0.892) 0.251 (0.169-0.671) 0.409 (0.003-0.814) 0.389 (0.016-0.763) 0.392 (0.148 to 0.636) 0.378 (0.005-0.751)
Constant value −3.775 (−0.485 to −2.901) −3.335 (−4.233 to −2.437) −3.493 (−4.422 to −2.564) −3.788 (−4.944 to −2.632) −3.524 (−3.781 to −3.266) −3.603 (−4.442 to −2.764)
C-statistic (95% CI) 0.706 (0.657-0.754) 0.667 (0.617-0.716) 0.671 (0.621-0.720) 0.690 (0.640-0.740) 0.673 (0.624-0.723) NA
Hosmer-Lemeshow, P value .32 .33 .26 .28 .26 NA
Out-of-sample cohorts, No. 177 177 177 177 177 885
C-statistic (95% CI) 0.568 (0.465-0.672) 0.739 (0.645-0.834) 0.720 (0.620-0.820) 0.644 (0.546-0.742) 0.706 (0.608-0.803) 0.681 (0.636-0.725)
Hosmer-Lemeshow, P valuea .04 .70 .83 .17 .60 .39

Abbreviations: ASA, American Society of Anesthesiology; NA, not applicable.

a

The Hosmer-Lemeshow P > .05 indicated that the model fits reasonably well. The model’s linear predictor can be calculated as follows: 0.799 if ASA 3 + 0.375 × tumor size in cm + 0.378 × log10 of CA 19-9 level of –3.603. The linear predictors’ tertiles were quarter 1, less than −1.961; quarter 2, between −1.961 and – 1.331; and quarter 3, less than −1.331. The probability of futility can be calculated as 1 / (1 + EXP [ − linear predictor]).

Three risk groups (low, intermediate, and high) were identified based on tertiles of the model linear predictor. Lastly, applying the model in the external validation cohort was associated with a C-statistic of 0.65 (95% CI, 0.60-0.70) and a Hosmer-Lemeshow P = .19, indicating adequate discrimination and calibration. In the derivation cohort, the rate of futile pancreatectomy was 9.2% in the low-risk group, 18.0% in the intermediate-risk group, and 28.7% in the high-risk group, respectively (P < .001 for trend). In the validation cohort, the futility rate was 10.9% in the low-risk group, 20.2% in the intermediate-risk group, and 29.2% in the high-risk group (P < .001 for trend). In both cohorts, the risk groups were also associated with an escalating likelihood of adverse pathologic features and with a sharp decrease in DFS and OS durations (Table 3). Figure 1 summarizes, in a contour plot, variations in the likelihood of a futile pancreatectomy as a function of independent predictors (radiological tumor size on the x-axis and preoperative CA 19.9 serum levels on the y-axis, at the mean of the ASA III class in the whole cohort).

Table 3. Futility, Pathological Features, Likelihood of Adjuvant Therapy Receipt, and Oncologic Outcomes Stratified by Risk Classes in the Derivation and Validation Cohorts.

Variable Risk, No. (%) P value for trend
Low Intermediate High
Derivation cohort, No. 295 295 295 NA
Histology
Grade 3-grade 4 77 (26.1) 78 (26.8) 82 (27.8) .04
Node-positive 212 (71.9) 244 (82.7) 255 (86.4) .001
PLNR >20% 51 (17.3) 67 (22.7) 83 (28.1) .002
R0 191 (64.8) 164 (55.6) 146 (49.5) .001
Adjuvant chemotherapy 250 (84.8) 223 (75.6) 199 (67.5) .001
Futility 27 (9.2) 53 (18.0) 85 (28.7) .001
Death 7 (2.4) 17 (5.8) 32 (10.9) .001
Recurrence 20 (6.8) 36 (12.2) 61 (20.7) .001
DFS, median (95% CI), mo 24.0 (18.8-28.2) 15.6 (13.7-18.5) 12.3 (10.6-14.4) .001
OS, median (95% CI), mo 50.2 (40.8-61.3) 33.2 (27.5-37.4) 24.4 (21.4-27.8) .001
Validation cohort, No. 212 168 161 NA
Histology
Grade 3-grade 4 103 (48.6) 105 (62.5) 112 (69.6) .001
Node-positive 154 (72.6) 136 (81.0) 135 (83.9) .01
PLNR >20% 42 (19.8) 48 (28.6) 48 (29.8) .02
R0 142 (67.0) 100 (59.5) 91 (56.5) .04
Adjuvant chemotherapy 161 (75.9) 112 (66.7) 106 (65.8) .03
Futility 23 (10.9) 34 (20.2) 47 (29.2) .001
Death 8 (3.8) 12 (7.1) 21 (13.0) .001
Recurrence 18 (8.5) 27 (16.1) 37 (23.0) .001
DFS, median (95% CI), mo 24.0 (18.2-32.6) 14.0 (11.2-16.5) 12.3 (9.5-15.1) .001
OS, median (95% CI), mo 51.0 (40.3-66.8) 27.7 (24.1-32.4) 23.9 (19.2-28.8) .001

Abbreviations: DFS, disease-free survival; NA, not applicable; OS, overall survival; PNLR, positive to lymph node ratio; R0, no residual tumor.

Figure 1. Contour Plot Outlining the Likelihood of Futile Up-Front Pancreatectomy as a Function of Tumor Size and Serum Carbohydrate Antigen (CA) 19.9.

Figure 1.

The dotted line represents the futility threshold, set at 20% (A). Dichotomous (in/out) criteria associated with a likelihood of futile pancreatectomy below the 20% threshold (B).

Another end point was to provide unified, dichotomous criteria for treatment allocation that would allow for a likelihood of a futile up-front resection less than 20%. This was satisfied in 4 preoperative conditions, defining the CA 19-9-adjusted-to-size criteria, summarized in Figure 1: (1) tumor size less than 2 cm with CA 19.9 levels less than 1000 U/mL, (2) tumor size less than 3 cm with CA 19.9 levels less than 500 U/mL, (3) tumor size less than 4 cm with CA 19.9 levels less than 150 U/mL, and (4) tumor size less than 5 cm with CA 19.9 levels less than 50 U/mL. In the study cohort, 1065 of 1426 patients (74.7%) met these criteria with an overall rate of futile pancreatectomy approaching 15% (159 patients). The upper 99% confidence limit was 18.0%, within the initial threshold set at 20%. As outlined in Figure 2, the DFS was considerably worse in patients who did not fulfill the CA 19.9-adjusted-to-size criteria (median DFS of 11.2 months; 95% CI, 9.8-13.0 vs 18.4 months; 95% CI, 17.0-19.7; P = .001). The median OS of patients within the CA 19-9-adjusted-to-size criteria was 38.5 months (95% CI, 35.7-41.7) compared with 22.1 months (95% CI, 19.7-25.0) in patients not fulfilling these criteria (P = .001; Figure 2B). Data on the association between futile pancreatectomy, tumor site, and receipt of adjuvant therapy are provided in the eResults in Supplement 1. Detailed outcomes of patients outside the CA 19-9-adjusted-to-size criteria are provided in the eResults in Supplement 1.

Figure 2. Disease-Free Survival and Overall Survival After Up-Front Resection in Patients Who Fulfilled the Cancer Antigen 19-9-Adjusted-to-Size Criteria and Those Who Did Not.

Figure 2.

Discussion

The primary treatment of anatomically resectable PDAC is a matter of controversy. While the 2023 European Society for Medical Oncology guidelines endorse a surgery-first approach,26 the NCCN guidelines (version 1.2024) recommend either up-front resection (in the absence of risk features for occult metastatic disease) or neoadjuvant treatment (regardless of the presence or absence of risk features).2 Nonetheless, the concept of high risk is mainly qualitative, as the definition includes elevated CA 19.9 serum levels, large primary tumor, suspicion of nodal metastases on imaging, excessive weight loss, and significant pain.2 Despite the derivation of different CA 19.9 serum levels thresholds (1000 U/mL per the MD Anderson Cancer Center criteria and 500 U/mL per the International Association of Pancreatology criteria)15,27 or the application of anatomy/biology/conditional classification for enucleating patients with so-called biologic borderline-resectable PDAC,28 a clear-cut definition of high-risk resectable disease remains undetermined.

In the present analysis, we investigated the pretreatment variables associated with a futile primary resection (death for postoperative complications, PDAC–related events, or disease recurrence within 6 months postoperatively) and implemented a risk model for futility. The 6-month time mark corresponds to the definition of very early recurrence,7 although the cutoffs used throughout the present literature to classify PDAC recurrence as very early or early are arbitrary or defined as the point with the lowest log-rank P value for overall and postrecurrence survival function split.5,6,7,8,29,30 Despite these methodology issues, it is biologically likely that a recurrence within 6 months of pancreatectomy was due to undetected micro-metastatic disease at baseline or incomplete resection. Furthermore, we assumed that neoadjuvant treatment would have been viable in patients at high risk for futile up-front pancreatectomy.23 In this framework, the 6-month time mark fits with the immortal time associated with a neoadjuvant therapy course in previous landmark analyses and clinical trials, where the period between baseline evaluation and resection ranged from 3.5 to 7 months.19,20,31

The main variables associated with futile pancreatectomy were ASA class, preoperative CA 19.9 serum, and radiological tumor size. The resulting model identified 3 risk categories based on the linear predictor tertiles, which not only were associated with futility, but also with adverse pathological features, receipt of adjuvant therapy, recurrence rates, and OS in both cohorts. An online calculator (MetroPancreas) was implemented to quantify the likelihood of futility and assign a risk class to any individual patient. Remarkably, the model showed adequate discrimination and very good calibration in the out-of-sample and validation cohorts despite substantial baseline differences relative to the derivation cohort. This was due to the 5-fold cross-validation approach, which reduced the model over optimism in the derivation cohort, improving its generalizability.

Furthermore, the concept of futile pancreatectomy as a function of radiological tumor size and baseline CA 19.9 levels was simplified, identifying 4 discrete conditions (defined as CA 19.9-adjusted-to-size criteria) that maintain the likelihood of a futile pancreatectomy below 20%. This safety threshold was set under the premise that the harm of a futile pancreatectomy should be equal to the chance of not receiving postneoadjuvant resection, expressed as the lower bound of the 95% CI for resection rates in published meta-analyses (0.80).23,24

Both the DFS and the OS duration of patients fulfilling the criteria (tumor size less than 2 cm with CA 19.9 levels less than 1000 U/mL, tumor size less than 3 cm with CA 19.9 levels less than 500 U/mL, tumor size less than 4 cm with CA 19.9 levels less than 150 U/mL, or tumor size less than 5 cm with CA 19.9 levels less than 50 U/mL) were significantly longer than patients outside the criteria. While preoperative tumor size and CA 19.9 serum levels have been variously associated with survival, their impact was primarily investigated in isolation.32,33,34,35,36 The few available prognostic scores based on pretreatment variables were closely associated with OS. Still, they lacked information on early recurrence and were not constructed to identify patients at risk for futile procedures.37,38

The methodological approach adopted here stems from the liver transplant oncology experience some of us had. Clinical criteria for transplant eligibility of patients with hepatocellular carcinoma have been available since 199639 and refined to the more recent flexible Metroticket 2.0 model concept.40 In the context of hepatocellular carcinoma, eligibility criteria for transplant are necessary due to organ shortage. In PDAC, eligibility criteria can be used during baseline assessment to limit surgical futility and redirect to neoadjuvant therapy patients at the highest risk of early recurrence or death.

Limitations

This study also has significant limitations, primarily related to its retrospective design. Preoperative imaging was not revised with possible variability in the assignment of resectability classes per the NCCN criteria.41 Furthermore, there were institutional differences in the selection process for up-front pancreatectomy and not all patients presenting with jaundice underwent preoperative biliary drainage. In those who did not receive biliary drainage, hyperbilirubinemia may have altered CA 19.9 serum levels with possible biases to the model. The model cannot be applied to CA 19.9 nonsecretors, who account for 10% of patients with PDAC. Also, all types of pancreatic resection were analyzed together. While tumor location was not associated with futile pancreatectomy in sensitivity analysis and did not affect outcomes in previous studies,42 differences in the model performance could exist when stratifying by head vs body-tail tumors. Furthermore, the overall discrimination was only adequate (C-index of 0.68 in the derivation cohort and 0.65 in the validation cohort). Integration with other variables not included in the present dataset (ie, radiomic signatures) and machine learning approaches could improve the prediction ability in future efforts.43 Lastly, the model was not externally validated. Additional validation from other health care systems (ie, Eastern or US patient cohorts) would improve its global uptake.

Conclusions

Considering these limitations, the present study provided a prognostic model to identify patients with anatomically resectable PDAC who are unlikely to benefit from up-front pancreatectomy because of death or tumor recurrence within 6 months of the operation. The likelihood of a futile resection was modeled as a function of ASA class, preoperative tumor size, and CA 19.9 levels to construct a readily available online risk calculator (MetroPancreas).25 Furthermore, unified CA 19.9-adjusted-to-size criteria were provided, which can further help in the triaging process and trial design, assuming that neoadjuvant therapy would be a viable option when the criteria are unmet.

Supplement 1.

eTable. Criteria defining resectability status at diagnosis

eFigure. Study flowchart

eResults. Role of adjuvant treatment; location and futility; outcomes of patients at high risk of futile resection

jamasurg-e242485-s001.pdf (220.9KB, pdf)
Supplement 2.

Data sharing statement

References

  • 1.Park W, Chawla A, O’Reilly EM. Pancreatic cancer: a review. JAMA. 2021;326(9):851-862. doi: 10.1001/jama.2021.13027 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.National Comprehensive Cancer Network . NCCN Guidelines—treatment by cancer type. Accessed July 1, 2024. https://www.nccn.org/guidelines/category_1
  • 3.Malleo G, Vollmer CM Jr. Postpancreatectomy complications and management. Surg Clin North Am. 2016;96(6):1313-1336. doi: 10.1016/j.suc.2016.07.013 [DOI] [PubMed] [Google Scholar]
  • 4.Paiella S, Malleo G, Lionetto G, et al. Adjuvant therapy after upfront resection of resectable pancreatic cancer: patterns of omission and use-a prospective real-life study. Ann Surg Oncol. 2024;31(5):2892-2901. doi: 10.1245/s10434-024-14951-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Jones RP, Psarelli EE, Jackson R, et al. ; European Study Group for Pancreatic Cancer . Patterns of recurrence after resection of pancreatic ductal adenocarcinoma: a secondary analysis of the ESPAC-4 randomized adjuvant chemotherapy trial. JAMA Surg. 2019;154(11):1038-1048. doi: 10.1001/jamasurg.2019.3337 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Matsumoto I, Murakami Y, Shinzeki M, et al. Proposed preoperative risk factors for early recurrence in patients with resectable pancreatic ductal adenocarcinoma after surgical resection: a multi-center retrospective study. Pancreatology. 2015;15(6):674-680. doi: 10.1016/j.pan.2015.09.008 [DOI] [PubMed] [Google Scholar]
  • 7.Daamen LA, Dorland G, Brada LJH, et al. ; Dutch Pancreatic Cancer Group . Preoperative predictors for early and very early disease recurrence in patients undergoing resection of pancreatic ductal adenocarcinoma. HPB (Oxford). 2022;24(4):535-546. doi: 10.1016/j.hpb.2021.09.004 [DOI] [PubMed] [Google Scholar]
  • 8.Groot VP, Gemenetzis G, Blair AB, et al. Defining and predicting early recurrence in 957 patients with resected pancreatic ductal adenocarcinoma. Ann Surg. 2019;269(6):1154-1162. doi: 10.1097/SLA.0000000000002734 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Reni M, Balzano G, Zanon S, et al. Safety and efficacy of preoperative or postoperative chemotherapy for resectable pancreatic adenocarcinoma (PACT-15): a randomised, open-label, phase 2-3 trial. Lancet Gastroenterol Hepatol. 2018;3(6):413-423. doi: 10.1016/S2468-1253(18)30081-5 [DOI] [PubMed] [Google Scholar]
  • 10.Versteijne E, van Dam JL, Suker M, et al. ; Dutch Pancreatic Cancer Group . Neoadjuvant chemoradiotherapy versus upfront surgery for resectable and borderline resectable pancreatic cancer: long-term results of the dutch randomized PREOPANC trial. J Clin Oncol. 2022;40(11):1220-1230. doi: 10.1200/JCO.21.02233 [DOI] [PubMed] [Google Scholar]
  • 11.Seufferlein T, Uhl W, Kornmann M, et al. Perioperative or only adjuvant gemcitabine plus nab-paclitaxel for resectable pancreatic cancer (NEONAX)-a randomized phase II trial of the AIO pancreatic cancer group. Ann Oncol. 2023;34(1):91-100. doi: 10.1016/j.annonc.2022.09.161 [DOI] [PubMed] [Google Scholar]
  • 12.Labori KJ, Bratlie SO, Andersson B, et al. ; Nordic Pancreatic Cancer Trial-1 study group . Neoadjuvant FOLFIRINOX versus upfront surgery for resectable pancreatic head cancer (NORPACT-1): a multicentre, randomised, phase 2 trial. Lancet Gastroenterol Hepatol. 2024;9(3):205-217. doi: 10.1016/S2468-1253(23)00405-3 [DOI] [PubMed] [Google Scholar]
  • 13.Bernat JL. Medical futility: definition, determination, and disputes in critical care. Neurocrit Care. 2005;2(2):198-205. doi: 10.1385/NCC:2:2:198 [DOI] [PubMed] [Google Scholar]
  • 14.Udwadia FR, Zhu J, Khan HM, Das S. Futility considerations in surgical ethics. Ann Med Surg (Lond). 2023;85(1):1-5. doi: 10.1097/MS9.0000000000000114 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Isaji S, Mizuno S, Windsor JA, et al. International consensus on definition and criteria of borderline resectable pancreatic ductal adenocarcinoma 2017. Pancreatology. 2018;18(1):2-11. doi: 10.1016/j.pan.2017.11.011 [DOI] [PubMed] [Google Scholar]
  • 16.Verbeke CS, Gladhaug IP. Resection margin involvement and tumour origin in pancreatic head cancer. Br J Surg. 2012;99(8):1036-1049. doi: 10.1002/bjs.8734 [DOI] [PubMed] [Google Scholar]
  • 17.Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med. 2015;162(1):55-63. doi: 10.7326/M14-0697 [DOI] [PubMed] [Google Scholar]
  • 18.Cucchetti A, Djulbegovic B, Crippa S, et al. ; Reg-PanC study group . Regret affects the choice between neoadjuvant therapy and upfront surgery for potentially resectable pancreatic cancer. Surgery. 2023;173(6):1421-1427. doi: 10.1016/j.surg.2023.01.016 [DOI] [PubMed] [Google Scholar]
  • 19.Labori KJ. Short-course or total neoadjuvant chemotherapy in resectable and borderline resectable pancreatic cancer—current status and future perspectives. Front Surg. 2022;9:839339. doi: 10.3389/fsurg.2022.839339 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Sugawara T, Rodriguez Franco S, Sherman S, et al. Neoadjuvant chemotherapy versus upfront surgery for resectable pancreatic adenocarcinoma: an updated nationwide study. Ann Surg. 2024;279(2):331-339. doi: 10.1097/SLA.0000000000005925 [DOI] [PubMed] [Google Scholar]
  • 21.Crippa S, Malleo G, Langella S, et al. Cure probabilities after resection of pancreatic ductal adenocarcinoma: a multi-institutional analysus of 2554 patients. Ann Surg. 2023. doi: 10.1097/SLA.0000000000006166 [DOI] [PubMed] [Google Scholar]
  • 22.Pencina MJ, D’Agostino RB Sr. Evaluating discrimination of risk prediction models: the C statistic. JAMA. 2015;314(10):1063-1064. doi: 10.1001/jama.2015.11082 [DOI] [PubMed] [Google Scholar]
  • 23.Cucchetti A, Crippa S, Dajti E, et al. Trial sequential analysis of randomized controlled trials on neoadjuvant therapy for resectable pancreatic cancer. Eur J Surg Oncol. 2022;48(9):1994-2001. doi: 10.1016/j.ejso.2022.04.011 [DOI] [PubMed] [Google Scholar]
  • 24.van Dam JL, Janssen QP, Besselink MG, et al. ; Dutch Pancreatic Cancer Group . Neoadjuvant therapy or upfront surgery for resectable and borderline resectable pancreatic cancer: a meta-analysis of randomised controlled trials. Eur J Cancer. 2022;160:140-149. doi: 10.1016/j.ejca.2021.10.023 [DOI] [PubMed] [Google Scholar]
  • 25.Italian Chapter of European Regional Association of the International Hepato-Pancreato-Biliary Association . The Metroticket Project. Accessed July 1, 2024. https://aicep.website/metropancreas/
  • 26.Conroy T, Pfeiffer P, Vilgrain V, et al. ; ESMO Guidelines Committee. Electronic address: clinicalguidelines@esmo.org . Pancreatic cancer: ESMO clinical practice guideline for diagnosis, treatment and follow-up. Ann Oncol. 2023;34(11):987-1002. doi: 10.1016/j.annonc.2023.08.009 [DOI] [PubMed] [Google Scholar]
  • 27.Katz MH, Pisters PW, Evans DB, et al. Borderline resectable pancreatic cancer: the importance of this emerging stage of disease. J Am Coll Surg. 2008;206(5):833-846. doi: 10.1016/j.jamcollsurg.2007.12.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Uzunoglu FG, Welte MN, Gavazzi F, et al. Evaluation of the MDACC clinical classification system for pancreatic cancer patients in an European multicenter cohort. Eur J Surg Oncol. 2019;45(5):793-799. doi: 10.1016/j.ejso.2018.12.012 [DOI] [PubMed] [Google Scholar]
  • 29.Nishio K, Kimura K, Amano R, et al. Preoperative predictors for early recurrence of resectable pancreatic cancer. World J Surg Oncol. 2017;15(1):16. doi: 10.1186/s12957-016-1078-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Yamamoto Y, Ikoma H, Morimura R, et al. Optimal duration of the early and late recurrence of pancreatic cancer after pancreatectomy based on the difference in the prognosis. Pancreatology. 2014;14(6):524-529. doi: 10.1016/j.pan.2014.09.006 [DOI] [PubMed] [Google Scholar]
  • 31.Sohal DPS, Duong M, Ahmad SA, et al. Efficacy of perioperative chemotherapy for resectable pancreatic adenocarcinoma: a phase 2 randomized clinical trial. JAMA Oncol. 2021;7(3):421-427. doi: 10.1001/jamaoncol.2020.7328 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Marchegiani G, Andrianello S, Malleo G, et al. Does size matter in pancreatic cancer?: reappraisal of tumour dimension as a predictor of outcome beyond the TNM. Ann Surg. 2017;266(1):142-148. doi: 10.1097/SLA.0000000000001837 [DOI] [PubMed] [Google Scholar]
  • 33.van Roessel S, Kasumova GG, Verheij J, et al. International validation of the eighth edition of the American Joint Committee on Cancer (AJCC) TNM staging system in patients with resected pancreatic cancer. JAMA Surg. 2018;153:e183617. doi: 10.1001/jamasurg.2018.3617 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Sugiura T, Uesaka K, Kanemoto H, et al. Serum CA19-9 is a significant predictor among preoperative parameters for early recurrence after resection of pancreatic adenocarcinoma. J Gastrointest Surg. 2012;16(5):977-985. doi: 10.1007/s11605-012-1859-9 [DOI] [PubMed] [Google Scholar]
  • 35.Hartwig W, Strobel O, Hinz U, et al. CA19-9 in potentially resectable pancreatic cancer: perspective to adjust surgical and perioperative therapy. Ann Surg Oncol. 2013;20(7):2188-2196. doi: 10.1245/s10434-012-2809-1 [DOI] [PubMed] [Google Scholar]
  • 36.Ono S, Adachi T, Ohtsuka T, et al. Predictive factors for early recurrence after pancreaticoduodenectomy in patients with resectable pancreatic head cancer: a multicenter retrospective study. Surgery. 2022;172(6):1782-1790. doi: 10.1016/j.surg.2022.08.004 [DOI] [PubMed] [Google Scholar]
  • 37.Guo SW, Shen J, Gao JH, et al. A preoperative risk model for early recurrence after radical resection may facilitate initial treatment decisions concerning the use of neoadjuvant therapy for patients with pancreatic ductal adenocarcinoma. Surgery. 2020;168(6):1003-1014. doi: 10.1016/j.surg.2020.02.013 [DOI] [PubMed] [Google Scholar]
  • 38.Hank T, Hinz U, Reiner T, et al. A pretreatment prognostic score to stratify survival in pancreatic cancer. Ann Surg. 2022;276(6):e914-e922. doi: 10.1097/SLA.0000000000004845 [DOI] [PubMed] [Google Scholar]
  • 39.Mazzaferro V, Regalia E, Doci R, et al. Liver transplantation for the treatment of small hepatocellular carcinomas in patients with cirrhosis. N Engl J Med. 1996;334(11):693-699. doi: 10.1056/NEJM199603143341104 [DOI] [PubMed] [Google Scholar]
  • 40.Mazzaferro V, Sposito C, Zhou J, et al. Metroticket 2.0 model for analysis of competing risks of death after liver transplantation for hepatocellular carcinoma. Gastroenterology. 2018;154(1):128-139. doi: 10.1053/j.gastro.2017.09.025 [DOI] [PubMed] [Google Scholar]
  • 41.Giannone F, Capretti G, Abu Hilal M, et al. Resectability of pancreatic cancer is in the eye of the observer: a multicenter, blinded, prospective assessment of interobserver agreement on NCCN resectability status criteria. Ann Surg Open. 2021;2(3):e087. doi: 10.1097/AS9.0000000000000087 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Malleo G, Maggino L, Ferrone CR, et al. Does site matter? Impact of tumor location on pathologic characteristics, recurrence, and survival of resected pancreatic ductal adenocarcinoma. Ann Surg Oncol. 2020;27(10):3898-3912. doi: 10.1245/s10434-020-08354-4 [DOI] [PubMed] [Google Scholar]
  • 43.Xiang F, He X, Liu X, et al. Development and Validation of a nomogram for preoperative prediction of early recurrence after upfront surgery in pancreatic ductal adenocarcinoma by integrating deep learning and radiological variables. Cancers (Basel). 2023;15(14):3543. doi: 10.3390/cancers15143543 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement 1.

eTable. Criteria defining resectability status at diagnosis

eFigure. Study flowchart

eResults. Role of adjuvant treatment; location and futility; outcomes of patients at high risk of futile resection

jamasurg-e242485-s001.pdf (220.9KB, pdf)
Supplement 2.

Data sharing statement


Articles from JAMA Surgery are provided here courtesy of American Medical Association

RESOURCES