Nomogram to predict ypN status after chemoradiation in patients with locally advanced rectal cancer

Abstract

Background:

Pelvic lymph node (LN) status after preoperative chemoradiotherapy (CRT) is an important indicator of oncologic outcome in patients with locally advanced rectal cancer. The purpose of this study was to develop a nomogram to predict LN status after preoperative CRT in locally advanced rectal cancer patients.

Methods:

The nomogram was developed in a training cohort (n=891) using logistic regression analyses and validated in a validation cohort (n=258) from a prospectively registered tumour registry at Asan Medical Center. The model was internally and externally validated for discrimination and calibration using bootstrap resampling. Model performance was evaluated by the concordance index (c-index) and calibration curve.

Results:

Pretreatment ypT stage, patient age, preCRT tumour differentiation, cN stage, lymphovascular invasion, and perineural invasion were reliable predictors of LN metastasis after preoperative CRT. The nomogram developed using these parameters had c-indices of 0.81 (training) and 0.77 (validation). The calibration plot suggested good agreement between actual and nomogram-predicted LN status after preoperative CRT.

Conclusions:

This nomogram improves prediction of LN status after preoperative CRT in patients with locally advanced rectal cancer. It will be useful for counselling patients as well as for the design and stratification of patients in clinical trials.

Preoperative chemoradiotherapy (CRT) followed by total mesorectal excision (TME) is the current standard of care for locally advanced rectal cancer to achieve better local control and overall survival (Sauer et al, 2004; Folkesson et al, 2005; Park et al, 2011). The potential advantages of preoperative CRT are both downsizing and downstaging of the tumour. Approximately 8–25% of patients have pathologic complete response (pCR) after preoperative CRT (Sauer et al, 2004; Shivnani et al, 2007; Park et al, 2011), and this pCR is associated with favourable treatment outcome (Maas et al, 2010). Increasing data suggest that the downsizing and downstaging effect of preoperative CRT may warrant expansion of the applicability of local excision to more advanced tumours (Borschitz et al, 2008; Callender et al, 2010; Belluco et al, 2011; Bujko et al, 2013). The rationale for performing local excision is based on the assumption that mesorectal lymph nodes (LNs) are completely eradicated and that the risk of residual disease in the mesorectum is very low. Therefore, accurate preoperative assessment of LN status after CRT is crucial for planning optimal therapy. However, the accuracy of current clinical imaging modalities in restaging LN status after CRT is limited (Cho et al, 2009; Pomerri et al, 2011).

To the best of our knowledge, the clinical predictors of LN status after preoperative CRT remain largely unknown. Some retrospective studies on the clinical predictors of LN status reported inconsistent and equivocal results (Pucciarelli et al, 2005; Hughes et al, 2006; Das et al, 2007; Cho et al, 2009; Chen et al, 2012). To overcome the inaccuracies of current diagnostic modalities for restaging after preoperative CRT in rectal cancer patients, a model that accurately predicts the postCRT LN status on the basis of each patient's overall characteristics, rather than a single parameter, is needed. The purpose of the present study was to investigate the predictive factors for LN status after preoperative CRT and to develop a nomogram using these factors to predict LN status in patients who underwent preoperative CRT for rectal cancer.

Materials and Methods

Study Population

This study was approved by the institutional review board of Asan Medical Center (AMC). The study cohort was created from a prospectively maintained tumour registry of the Department of Radiation Oncology at AMC. Using the registry, we identified a total of 1166 patients who underwent preoperative CRT followed by TME at AMC for non-metastatic rectal adenocarcinoma, including mucinous or signet ring cell type between 2007 and 2013. Because we believed radiation dose under 40 Gy was insufficient to treat metastatic regional LN, patients who received doses of less than 40 Gy (n=17) were excluded. Most patients had locally advanced disease (cT3 or cT4 or positive regional LN) on endorectal ultrasonography (EUS), magnetic resonance imaging (MRI), or abdominopelvic computed tomography (CT) scan; however, seven patients had cT2N0 distal rectal cancer. Patients were divided into the nomogram development (n=891) or the validation (n=258) cohort according to treatment time, that is, from 2007 to 2011 and from 2012 to 2013, respectively. All the development and the validation cohort patients were treated with three-dimensional conformal radiotherapy with a fraction size of 1.8–2 Gy, except the 17 patients who underwent intensity modulated radiotherapy. The median total dose was 50 Gy (range, 40–55 Gy), including up to 46 Gy to the whole pelvis. Preoperative chemotherapy was administered concurrently with radiation in all patients except for three in the development cohort. The concurrent chemotherapy regimen was capecitabine in 415 (36.1%), 5-FU with leucovorin in 664 (57.8%), and other drug added to capecitabine or 5-FU in 67 (5.8%) patients. The median interval period between CRT and surgery was 6.4 weeks (range, 3.0–19.4 weeks). The sphincter was spared in 875 patients (76.2%), while it was not spared in 274 patients (23.8%). The median number of harvested LNs was 16 (range, 1–68). All surgical specimens were processed according to standard procedures at AMC. Tumour regression grade was microscopically evaluated using the scale proposed by Dworak et al (1997) Each patient was clinically and pathologically staged according to the 2010 American Joint Committee on Cancer (AJCC) staging classification system (AJCC, 2010). Tumour grade was assessed according to the 2000 World Health Organization criteria (Hosmer and Lemeshow, 2000).

Statistical analysis

The primary end point of interest in this study was the presence or absence of pathologic LN metastasis (ypN) after preoperative CRT, which was determined by the assessment of pathologic specimen obtained from curative surgery. Multivariate regression analysis was performed using a logistic regression model, and this model formed the basis for the ypN prediction model. The potential predictors for ypN status analysed in this study included age, gender, chemotherapy regimen, radiation dose, interval period between radiation and surgery, distance from anal verge, cT stage, cN stage, preCRT tumour differentiation, preCRT CEA level, postCRT CEA level, ypT stage, perineural invasion, lymphovascular invasion, and tumour regression grade. An initial univariate logistic regression model was fitted to evaluate the prognostic value of each variable. To select variables for the final multivariate model, we resorted to the bootstrapping resampling method (500 repetitions), which determines the predictive robustness of candidate variables. A 50% relative frequency of selection and clinical relevance were the criteria for the inclusion of variables in the final model. Selection of the final model was based on the method described by Jin et al (2012). The prediction model was implemented into a nomogram to be applicable on plain paper. The discrimination and calibration abilities of the prognostic model were measured by receiver operating characteristic techniques and the Hosmer–Lemeshow test, respectively (Hanley and McNeil, 1982; Hosmer and Lemeshow, 2000). Discrimination was evaluated using the concordance index (c-index), which measures the probability that, given a pair of randomly selected patients, the model correctly predicts which patient will experience an event first. The c-index of the model can range between 0.5, which represents random chance, and 1.0, which represents a perfectly discriminating model (Harrell et al, 1982). The second validation measure evaluated was calibration, which compares the predicted LN metastasis probability with actual LN metastasis. This was evaluated with a calibration curve, where patients are grouped by predicted node metastasis and then plotted as actual vs predicted LN metastasis. Both discrimination and calibration were evaluated in the development and the validation cohort, respectively. All statistical analyses were performed using SPSS version 13.0 (SPSS, Chicago, IL, USA) and R software version 2.12.0 (http://www.r-project.org/), with an optional package installed, called rms (Harrell, 2012). In addition, R package of survival (available at http://cran.r-project.org/web/packages/) was used in this study.

Results

The clinical and pathologic characteristics of patients in both cohorts are listed in Table 1. Median age at diagnosis was 58 (range, 25–82 years) in the nomogram development cohort and 61 (range, 28–83 years) in the external validation cohort. There were 599 (67.2%) and 167 (64.7%) male patients in the development and the validation cohort, respectively. Pathology analysis of surgical specimens showed that 307 (26.7%) patients had LNs harbouring tumour cells. The risk for LN involvement increased with advancing grade of remaining mural tumour; positive LNs were detected in 16 of the 204 (7.8%) ypT0 patients, in three of the 26 (11.5%) ypTis patients, in six of the 64 (9.4%) ypT1 patients, in 53 of the 310 (17.1%) ypT2 patients, in 226 of the 528 (42.8%) ypT3 patients, and in three of the 13 (23.1%) ypT4 patients in both cohorts collectively. The results of the univariate and the multivariate regression analysis models are shown in Table 2. In univariate analysis, younger age, cN stage, preCRT tumour differentiation, ypT stage, lymphovascular invasion, perineural invasion, and tumour regression grade were significant predictors of pathologic LN metastasis. Six variables, including patient age, cN stage, preCRT tumour differentiation, ypT stage, lymphovascular invasion, and perineural invasion, showed relative frequencies >50% by the bootstrapping method. When applied to the multivariable model, these six covariates were found to be significant. A nomogram predicting the pathologic LN metastasis was constructed with these six parameters including three determined before CRT and three determined after CRT based on the multivariable model (Figure 1). To use the nomogram, a vertical line is drawn up to the top point row to assign points for each variable. Then, the total number of points is calculated, and a vertical line is drawn downwards from the total point row to obtain the probability of positive LN. For example, patients with 90, 176, and 228 points had estimated positive LN probability of 10%, 50%, and 80%, respectively. The predictive accuracy measured by the c-index was 0.81. The nomogram was well calibrated, and there was good correlation and no deviation between predicted and observed outcome across the spectrum of predictions (Figure 2A). In the external validation cohort (n=258), the accuracy of the model was 0.77. Calibration plots of the nomogram-predicted probabilities and the actual number of LN metastasis in the external cohort are displayed in Figure 2B.

Table 1. Clinical characteristics of 1149 patients undergoing TME after preoperative CRT.

	Development (n=891)		Validate (n=258)
	No. of patients	%	No. of patients	%	P-value
Tumour location (cm), median (range)	5 (0–15)		4 (0–13)		0.002
Initial CEA	2.6 (0.3–345.0)		2.4 (0.3–124.0)		0.342
Initial tumour differentiation					0.172
Well or moderate	782	87.8	245	95.0
Poor, mucinous, or signet ring cell	63	7.1	11	4.3
cT stage					0.475
T2	19	2.1	5	1.9
T3	694	77.9	210	81.4
T4	178	20.0	43	16.7
cN stage					0.001
N0	25	2.8	18	7.0
N1	200	22.4	71	27.5
N2	666	74.7	169	65.5
cAJCC stage					0.005
I	3	0.3	4	1.6
II	22	2.5	14	5.4
III	866	97.2	240	93.0
Tumour regression grade					0.636
Total	162	18.2	45	17.4
Near total	203	22.8	52	20.2
Moderate	404	45.3	118	45.7
Minimal	122	13.7	42	16.3
ypT stage					0.791
Tx	160	18.0	45	17.4
Tis	22	2.5	5	1.9
T1	53	5.9	11	4.3
T2	235	26.4	75	29.1
T3	409	45.9	119	46.1
T4	10	1.1	3	1.2
ypN stage					0.270
N0	643	72.2	198	76.7
N1	192	21.5	44	17.1
N2	56	6.3	15	5.8
Lymphovascular invasion	73	8.2	24	9.3	0.610
Perineural invasion	136	15.3	24	9.3	0.014

Abbreviations: CEA=carcinoembryonic antigen; CRT=chemoradiotherapy; TME=total mesorectal excision.

Table 2. Predictors of LN metastasis after preoperative CRT.

	Univariate analysis			Multivariate analysis
	OR	95% CI	P-value	OR	95% CI	P-value
Age	0.98	0.96–0.99	0.001	0.98	0.96–0.99	0.003
Female	1.18	0.87–1.61	0.284
Poorly differentiated, mucinous, and signet ring cell	2.19	1.30–3.70	0.003	3.29	1.78–6.11	0.000
cT stage
T2	1.00	Referent	—	—	—	—
T3	3.37	0.77–14.72	0.106	—	—	—
T4	3.23	0.72–14.49	0.126	—	—	—
cN stage
N0	1.00	Referent	—	1.77	1.21–2.61	0.004
N1	2.04	1.33–3.22	0.001	—	—	—
N2	2.44	1.83–7.18	0.000	—	—	—
ypT stage
T0	1.00	Referent	—	1.68	1.43–1.97	0.000
Tis	0.46	0.06–3.67	0.464	—	—	—
T1	1.23	0.45–3.36	0.681	—	—	—
T2	2.10	1.12–3.94	0.020	—	—	—
T3	7.67	4.36–13.52	0.000	—	—	—
T4	4.14	0.97–17.72	0.055	—	—	—
Lymphovascular invasion	3.78	2.32–6.16	0.000	2.24	1.31–3.84	0.003
Perineural invasion	3.69	2.53–5.38	0.000	1.87	1.22–2.85	0.004
Tumour regression grade
Total	1.00	Referent	—	0.45	0.15–1.70	0.149
Near total	2.79	1.49–5.22	0.001	—	—	—
Moderate	5.37	3.04–9.49	0.000	—	—	—
Minimal	5.73	3.00–10.93	0.000	—	—	—
PreRT CEA	1.00	1.00–1.01	0.419	—	—	—
PostRT CEA	1.00	0.99–1.01	0.857	—	—	—
RT dose	0.97	0.83–1.14	0.701	—	—	—
RT-surgery interval duration	1.05	0.94–1.17	0.375	—	—	—
Distance from anal verge	1.05	0.99–1.10	0.086	—	—	—
Chemotherapy regimen
Capecitabine	1.00	Referent	—	—	—	—
FL	1.32	0.97–1.79	0.081	—	—	—
Others	1.06	0.58–1.94	0.843	—	—

Abbreviations: CEA=carcinoembryonic antigen; CI=confidence interval; CRT=chemoradiotherapy; FL=fluorouracil+leucovorin; LN=lymph node; OR=odds ratio; RT=radiation therapy.

Figure 1.

Nomogram predicting LN metastasis probability after preoperative CRT for locally advanced rectal cancer. Each variable value is assigned a point, and the sum of points is converted to a probability in the lowest scale.

Figure 2.

Calibration plots in the internal validation cohort (A) and the external validation cohort (B). The solid line indicates a reference line where an ideal nomogram would lie. Dots indicate the performance of the current nomogram.

Discussion

The present study demonstrates that ypT stage, age, preCRT tumour differentiation, cN stage, lymphovascular invasion, and perineural invasion (in order of relevance) are reliable predictors for LN metastasis after preoperative CRT in patients with locally advanced rectal cancer. To predict the risk of residual LN metastasis after CRT, we used these predictors to develop a nomogram with a continuous scale and a discriminative accuracy of 0.81. When validated in an independent population, this nomogram provided good discrimination with a c-index of 0.77 for predicting postCRT LN metastasis.

Several studies have investigated full-thickness transanal local excision as a primary treatment for selected patients with clinical stage I rectal cancers to avoid postoperative complications and unsatisfactory functional outcomes following TME (Rutten et al, 2008; Greenberg et al, 2008; Paun et al, 2010). The tumour downstaging effect of preoperative CRT observed in both primary tumour and mesorectal metastatic LNs results in a ypCR rate of up to 25% in locally advanced rectal cancer patients (Shivnani et al, 2007). In addition, patients who achieve ypCR after CRT have more favourable long-term outcome (Maas et al, 2010). In view of these data, local excision has been considered for a subset of patients with locally advanced rectal cancer and good response after CRT (Borschitz et al, 2008; Callender et al, 2010; Belluco et al, 2011; Bujko et al, 2013). However, from an oncologic point of view, local excision after preoperative CRT has the risk of leaving nodal disease in the mesorectum. Therefore, it is important to restage accurately after CRT, particularly to rule out any residual cancer in the mesorectum. However, the most commonly used imaging modalities, such as EUS, MRI, and CT scanning, or additional diagnostic tools such as FDG-PET scanning for initial staging of rectal cancer, have a limited accuracy of 62–75% to identify regional LN metastases after preoperative CRT (Cho et al, 2009; Pomerri et al, 2011). Post-irradiation inflammatory or desmoplastic changes, as well as controversy over which criteria to use (i.e., size vs morphology), for predicting metastatic LN make the diagnosis of postCRT LN status difficult.

Several studies investigated the predictive factors for ypN status, but results are inconsistent. Whether the ypT classification correlates with LN status or any other predictive parameters for postCRT LN status in rectal cancer patients treated with preoperative CRT remains under debate (Pucciarelli et al, 2005; Hughes et al, 2006; Cho et al, 2009). The rate of LN metastasis with no residual mural tumour (ypT0N+) after preoperative CRT has been reported to be up to 17% (Pucciarelli et al, 2005). While Glynne-Jones et al (Hughes et al, 2006) failed to show predictive value of ypT, Pucciarelli et al (2005) reported consistent results to that of the current paper that ypT, young age, and positive pretreatment nodal status are predictors for postCRT LN metastasis.

Biologic responses and compliance to cancer treatment seem to change with age: elderly patients show a lower rate of postCRT LN metastasis than younger patients, although Steinhagen et al (2013) reported similar rates of response to neoadjuvant CRT in patients with early-age-onset rectal cancer and in non-age-based cohorts. Understanding this difference warrants further investigation. Kim et al (Cho et al, 2009) also examined the correlation between postCRT LN status and tumour regression grade, but found that only patients with complete regression were associated with a low incidence of LN metastasis. Therefore, the authors concluded the pathologic regression grade does not demonstrate any additional benefit over the ypT classification. Similarly, only complete tumour regression could predict the postCRT LN status, while other levels of tumour regression had no correlation with ypN status in our analysis. Besides these clinical parameters, Chen et al (2012) reported that chromosomal copy number alterations could help identify rectal cancer patients at risk of LN metastasis after preoperative CRT with 86% of accuracy. Some studies suggested different cut-off values of CEA as a predictor for tumour response to neoadjuvant CRT (Yoon et al, 2007; Park et al, 2009). We analysed serum CEA as a continuous variable instead of dichotomous variable, because the cut-off value could be somewhat arbitrary and consequentially reduce predictive accuracy. However, the current study failed to demonstrate the predictive value of CEA level based on continuous scale before or after CRT.

There are potential applications for this nomogram. First, it may act as a tool to assist both physicians and patients in treatment selection. For example, a reliable predictor of treatment outcome based both on this nomogram and on the results of conventional imaging modalities, such as EUS, MRI, or CT, may help a patient decide whether to undergo local excision after preoperative CRT. If the patient is at high risk of LN metastasis after local excision, clinicians should consider radical surgery. In addition, when local excision is inevitable due to patient comorbidity or strong refusal of expected stoma, risk appraisal of residual LN in mesorectum could help determine the follow-up schedule or use of adjuvant chemotherapy. The nomogram may also be valuable in the design of clinical trials. As further evidence for local excision after preoperative CRT should be generated from randomised control trials, this nomogram could help to identify patients most likely to benefit from local excision by quantifying the probability of postCRT LN metastasis. Selection of candidates and verification of adequate randomisation would be facilitated by comprehensive risk estimation rather than comparing individual predictors, which may not as easily produce homogenous groups of patients. The nomogram is also useful to visualise the associations between each predictor variable and the risk of LN metastasis. Because this tool considers multiple predictive factors simultaneously, including continuous values, more complex relationships between known predictors of ypN status can be assessed.

The present study has several limitations. The major limitation is that this nomogram is based on a retrospective analysis of our database. In addition, its applicability to the general population requires further testing despite our external validation. However, the current cohort of patients was derived from a single institution's homogenous population and the management protocols for locally advanced rectal cancer including surgery, radiotherapy, pathologic review, and diagnostic work-up were consistent during the study period, indicating that this nomogram is a reliable reference that can be used for further investigation. The current nomogram merely predicts LN metastasis probability but not long-term clinical outcomes (i.e., local recurrence and disease-free survival). Physicians and patients should be cautious when deciding between local excision and radical surgery following preoperative CRT, especially in good responders.

We need to further test our model performance by external validation using other patient databases. Other regression modelling techniques should also be explored to determine whether predictive accuracy can be further improved. If more specific patient and tumour information, such as genetic data and molecular tumour markers, become routinely available in the future, use of these types of predictive models will become more specific and valuable.

In conclusion, we present a prediction model for LN metastasis that can be used to determine individualised treatment choices after preoperative CRT in patients with locally advanced rectal cancer. Our model predicts that patients with low cN stage and well to moderately differentiated non-metastatic rectal adenocarcinoma downstaged to ypT0-1 without perineural or lymphovascular invasion after preoperative CRT have a low likelihood of positive LN, when preoperative imaging studies show no metastatic LN after preoperative CRT. The nomogram can assist clinicians and patients in quantifying the benefit of curative surgery compared with local excision after preoperative CRT for rectal cancer.

The authors declare no conflict of interest.