Skip to main content
BMC Medicine logoLink to BMC Medicine
. 2017 Jul 14;15:129. doi: 10.1186/s12916-017-0892-7

The prognostic value of lymph node yield in the earliest stage of colorectal cancer: a multicenter cohort study

Yara Backes 1, Sjoerd G Elias 2, Bibie S Bhoelan 1, John N Groen 3, Jeroen van Bergeijk 4, Tom C J Seerden 5, Hendrikus J M Pullens 6, Bernhard W M Spanier 7, Joost M J Geesing 8, Koen Kessels 9, Marjon Kerkhof 10, Peter D Siersema 1,11, Wouter H de Vos tot Nederveen Cappel 12, Niels van Lelyveld 13, Frank H J Wolfhagen 14, Frank ter Borg 15, G Johan A Offerhaus 16, Miangela M Lacle 16, Leon M G Moons 1,; on behalf of the Dutch T1 CRC Working Group
PMCID: PMC5512847  PMID: 28705200

Abstract

Background

In patients with stage II colorectal cancer (CRC) the number of surgically retrieved lymph nodes (LNs) is associated with prognosis, resulting in a minimum of 10–12 retrieved LNs being recommended for this stage. Current guidelines do not provide a recommendation regarding LN yield in T1 CRC. Studies evaluating LN yield in T1 CRC suggest that such high LN yields are not feasible in this early stage, and a lower LN yield might be appropriate. We aimed to validate the cut-off of 10 retrieved LNs on risk for recurrent cancer and detection of LN metastasis (LNM) in T1 CRC, and explored whether this number is feasible in clinical practice.

Methods

Patients diagnosed with T1 CRC and treated with surgical resection between 2000 and 2014 in thirteen participating hospitals were selected from the Netherlands Cancer Registry. Medical records were reviewed to collect additional information. The association between LN yield and recurrence and LNM respectively were analyzed using 10 LNs as cut-off. Propensity score analysis using inverse probability weighting (IPW) was performed to adjust for clinical and histological confounding factors (i.e., age, sex, tumor location, size and morphology, presence of LNM, lymphovascular invasion, depth of submucosal invasion, and grade of differentiation).

Results

In total, 1017 patients with a median follow-up time of 49.0 months (IQR 19.6–81.5) were included. Four-hundred five patients (39.8%) had a LN yield ≥ 10. Forty-one patients (4.0%) developed recurrence. LN yield ≥ 10 was independently associated with a decreased risk for recurrence (IPW-adjusted HR 0.20; 95% CI 0.06–0.67; P = 0.009). LNM were detected in 84 patients (8.3%). LN yield ≥ 10 was independently associated with increased detection of LNM (IPW-adjusted OR 2.27; 95% CI 1.39–3.69; P = 0.001).

Conclusions

In this retrospective observational study, retrieving < 10 LNs was associated with an increased risk of CRC recurrence, advocating the importance to perform an appropriate oncologic resection of the draining LNs and diligent LN search when patients with T1 CRC at high-risk for LNM are referred for surgical resection. Given that both gastroenterologists, surgeons and pathologists will encounter T1 CRCs with increasing frequency due to the introduction of national screening programs, awareness on the consequences of an inadequate LN retrieval is of utmost importance.

Electronic supplementary material

The online version of this article (doi:10.1186/s12916-017-0892-7) contains supplementary material, which is available to authorized users.

Keywords: Malignant polyps, T1 colorectal carcinoma, Lymph node metastasis, Lymph node retrieval

Background

With the introduction of colorectal cancer (CRC) screening programs, there has been a shift towards an increased detection of T1 CRC as compared to more advanced cancers [1, 2]. Endoscopic resection is considered curative for low-risk T1 CRC. However, surgical resection is recommended for patients with T1 CRC with a considerable risk of lymph node metastasis (LNM), as determined by histological high-risk factors [3, 4]. The prognosis of these patients depends to a large extent on the lymph node (LN) status, with a CRC-related 5-year survival of ≥ 95% in the absence of LNM (American Joint Committee on Cancer (AJCC) stage I T1 CRC), decreasing to 68–90% in the presence of LNM (AJCC stage III T1 CRC) [5, 6].

In contrast to AJCC stage II CRC (T3–4 CRC), in which a higher LN yield has been associated with improved survival, little is known on the association between LN yield and recurrence in T1 CRC [7, 8]. Therefore, international guidelines restrict their recommendation for a minimum yield of 10–12 LNs to AJCC stage II CRC [912]. It is questionable whether the recommended cut-off in advanced CRC can be extrapolated to T1 CRC, given that more advanced tumor depth has been associated with an increased LN yield [1315]. Accordingly, reported LN yields in T1 CRC are much lower, with mean and median LN yields between 4 and 7 in studies performed between 1988 and 2003 [13, 1618]. One might hypothesize that the additional value of retrieving more LNs might be less relevant for T1 CRCs as LNM are reported in only 8–12% of patients and recurrence after surgical resection is reported in only 2–5% of patients [3, 4, 19]. Two small single-center studies argued that a minimum of 4 and 8 retrieved LNs, respectively, should be appropriate for staging T1 CRC [16, 20], whereas La Torre et al. [21] concluded that a limited resection does not affect oncological outcome in this early stage. However, these studies were either small or not informed about long-term recurrence rates.

In this longitudinal multicenter retrospective cohort study consisting of patients who underwent surgical resection of T1 CRC, we aimed to explore the association between LN yield and the risk for recurrence, and to assess the association between LN yield and the detection of LNM. Moreover, we aimed to explore whether a minimum of 10 LNs is feasible in a routine clinical setting.

Methods

Patients and study design

This is a multicenter retrospective cohort study. Patients diagnosed with T1 CRC in 13 participating hospitals (1 academic and 12 non-academic hospitals) between 1 January 2000 and 31 December 2014 were selected from the Netherlands Cancer Registry. The electronic medical records of all patients were reviewed. Only cases in which the local pathologist clearly confirmed the diagnosis T1 CRC in the pathology report were selected, which was defined as tumors with invasion through the muscularis mucosa and into, but not beyond, the submucosa [22]. Patients were included if they were treated with surgical resection of T1 CRC. Transanal endoscopic microsurgery was considered an endoscopic treatment, as no lymphadenectomy is performed. Exclusion criteria were hereditary predisposition for CRC, inflammatory bowel disease, synchronous CRC (defined as CRC in the previous 5 years before detection of T1 CRC, or elsewhere in the colorectum at the time of detection of T1 CRC), non-CRC-related death within 1 year, non-adenocarcinoma, neo-adjuvant radiotherapy, unknown number of retrieved LNs, and AJCC stage IV T1 CRC at diagnosis.

This study was approved by the Medical Ethics Review Committee of the University Medical Center Utrecht (reference number 15-487/C) and was carried out in accordance with the Helsinki Declaration. The study conforms to the STROBE guideline for cohort studies [23].

Endpoints

In each participating center, study variables were collected from the electronic medical records, and the corresponding endoscopy, surgery, pathology, and radiology reports. Primary endpoint was incidence of recurrent cancer, either local or distant. Local recurrence was defined as malignant tissue at the site of the anastomosis. Distant recurrence was defined as metastasis to extra-colonic organs, bone or peritoneum confirmed with imaging or histology. A new primary CRC elsewhere in the colon or rectum was defined as a metachronous lesion, not as recurrence. Secondary endpoint was prevalence of LNM at time of surgery, defined as positive LNs in the resection specimen as reported in the pathology report.

Determinant and confounding factors

The determinant of interest was number of retrieved LNs, as reported in the pathology reports. We dichotomized LN yield using 10 retrieved LNs as cut-off, as this is the lowest recommended minimum for AJCC stage II CRC in current (inter)national guidelines [9, 11, 12].

Established risk factors (based on previous literature) for recurrent cancer and LNM were considered potential confounding factors [3, 4, 7, 24]. Data on potential clinical confounders were collected from the medical records and endoscopy reports, and included age, sex, tumor location (right colon vs. left colon vs. rectum), tumor size and tumor morphology (pedunculated vs. non-pedunculated) [3, 7, 24]. Right colon was defined as caecum, ascending and transverse colon including the splenic curve. Left colon was defined as the descending and sigmoid colon. Tumor morphology was defined as pedunculated if the presence of a stalk or Paris 0-Ip was reported in the endoscopy report [25]. Flat and sessile tumors were defined as non-pedunculated T1 CRCs [26]. Potential histological confounders were collected from the pathology reports, and included lymphovascular invasion (absent vs. present), depth of submucosal invasion (superficial vs. deep invasion), and grade of differentiation (good vs. moderate vs. poor) [4]. Deep submucosal invasion was defined as invasion depth ≥ 1 mm or sm2/3 for non-pedunculated T1 CRC, and Haggitt 4 for pedunculated T1 CRC [4]. For the endpoint recurrent cancer, the list of potential confounders was extended with LNM as a confounding factor [7].

Additional patient characteristics (not causally related to recurrent cancer or LNM and therefore not considered potential confounders) and follow-up characteristics were collected from medical records. Patient characteristics were body mass index (calculated as weight in kilograms divided by height in meters squared) and comorbidity according to the American Society of Anesthesiologists Physical Status classification [27]. Follow-up was performed according to routine clinical care. Follow-up started at the date of diagnosis and ended at the date of detection of recurrence, death, or last follow-up.

Statistical analysis

Categorical data were expressed as frequencies and percentages; continuous variables as means with standard deviation (SD) or medians with interquartile range (IQR).

Primary aim of this study was to evaluate the association between number of retrieved LNs and recurrent cancer. Despite our large multicenter cohort of patients spanning an inclusion period of many years, the absolute number of recurrences was expected to be small, since recurrent cancer after surgical resection of T1 CRC is a rare event. We therefore used propensity scores allowing for the adjustment for more confounders than would have been feasible using standard multivariable adjustment approaches [2830]. Inverse probability weighting (IPW) was used to account for baseline differences in predictive characteristics between patients with LN yield < 10 vs. ≥ 10. A propensity score was derived by fitting a logistic regression model with the dichotomized number of retrieved LNs as the dependent variable and potential confounders as predictors. We adjusted for confounders in a two-step approach. For the primary analysis, we adjusted for clinical confounding factors (i.e., age, sex, tumor location, tumor size, tumor morphology, and presence of LNM). Secondary supporting analyses were performed to additionally correct for histological confounding factors (i.e., lymphovascular invasion, depth of submucosal invasion, grade of differentiation), which were not included in the primary analysis as they were missing in a considerable number of cases (Table 1). Continuous variables (i.e., age and tumor size) were fitted in the propensity models by restricted cubic spline functions, dummies were used for categorical variables (no interaction terms). Then, the inverse of the (propensity score-derived) predicted probability for actual LN yield was used to weigh patients in a Cox regression model relating the dichotomized LN yield as the sole determinant of recurrent cancer, yielding hazard ratios (HR) for a high (≥10) vs. low (< 10) retrieval of LNs. Patients who did not develop recurrent cancer were censored at the last follow-up moment or date of death. No violation of the proportionality of the hazard assumption was observed following inspection of the scaled Schoenfeld residuals. Bootstrapping was performed to obtain two-sided P values and 95% confidence intervals (CI) for IPW-derived estimates.

Table 1.

Baseline characteristics for patients with a LN yield < 10 vs. ≥ 10

Baseline characteristics original cohort Baseline characteristics LN yield < 10 vs. ≥ 10
Unadjusted dataa IPW adjusted data for the confounders considered for the primary analysisa,c IPW adjusted data for the confounders considered for the secondary supporting analysisa,d
N = 1017a Missing (%)b LN yield < 10 N = 612 LN yield
≥ 10 N = 405
P value LN yield
< 10 N = 612
LN yield ≥ 10 N = 405 P value LN yield
< 10 N = 612
LN yield ≥ 10 N = 405 P value
Age in years 69.1 0.5 68.6 69.7 0.07 69.1 69.0 0.47 69.1 69.1 0.74
Male sex 54.6 0 55.7 52.8 0.40 54.6 54.0 0.30 54.5 53.7 0.35
BMI in kg/m2 26.9 27.9 26.9 27.0 0.70 26.8 27.0 0.54 26.7 27.1 0.46
ASA score 0.4
 - ASA I
 - ASA II
 - ASA III–IV
29.7
49.5
20.8
31.6
47.5
20.9
26.9
52.3
20.7
0.13
0.15
0.99
30.3
47.8
21.8
29.0
52.0
18.9
0.67
0.20
0.24
30.1
48.0
21.9
29.1
51.8
19.0
0.79
0.25
0.25
Tumor location 0
 - Right colon
 - Left colon
 - Rectum
24.1
58.8
17.1
15.2
68.6
16.2
37.5
44.0
18.5
<0.001
<0.001
0.38
24.2
58.7
17.0
24.1
58.8
17.1
0.62
0.89
0.67
23.9
59.0
17.1
23.9
58.9
17.2
0.84
0.83
0.85
Tumor morphology 5.0
 - Pedunculated
 - Non-pedunculated
33.4
66.6
39.3
60.7
24.1
75.9
<0.001
<0.001
33.3
66.7
33.7
66.3
0.39
0.39
33.4
66.6
33.7
66.3
0.68
0.68
Tumor size in cm 2.7 9.4 2.6 2.9 0.003 2.7 2.7 0.82 2.7 2.7 0.82
Lymph node metastasis 8.3 0 6.0 11.6 0.002 8.6 8.5 0.91 8.3 8.4 0.75
Adjuvant chemotherapy 4.4 0 3.6 5.7 0.15 4.6 4.5 0.92 4.4 4.6 0.82
Lymphovascular invasion 53.8
 - Absent
 - Present
79.2
20.8
70.1
29.9
79.8
20.2
0.04
0.04
69.7
30.3
78.9
21.1
0.03
0.03
73.3
26.7
73.2
26.8
0.70
0.70
Differentiation grade 18.5
 - Well
 - Moderate
 - Poor
14.0
80.6
5.4
14.9
79.4
5.7
12.7
82.3
5.0
0.44
0.31
0.63
15.1
79.6
5.4
12.9
82.0
5.1
0.47
0.41
0.59
14.1
80.6
5.3
14.2
80.7
5.1
0.71
0.73
0.62
Invasion depth 50.3
 - Haggitt I/II/III or SM1
 - Haggitt IV or SM2/3
44.9
55.1
47.3
52.7
41.4
58.6
0.21
0.21
43.7
56.3
45.8
54.2
0.67
0.67
44.6
55.4
44.3
55.7
0.83
0.83

ASA American Society of Anesthesiologists, BMI body mass index, cm centimeter, IPW inverse probability weighting, kg kilogram, LN lymph node, m meter

aValues are means for continuous variables and percentages for categorical variables

bPercentage of patients with missing data in the original cohort

cInverse probability weighting was based on age, sex, tumor location, tumor size, tumor morphology and the presence of lymph node metastasis (primary analysis)

dInverse probability weighting was based on age, sex, tumor location, tumor size, tumor morphology, invasion depth, presence of lymphovascular invasion, differentiation grade, and presence of lymph node metastasis (secondary supporting analysis)

Assuming that a low LN yield risks understaging and these understaged patients would fail to receive chemotherapy that could prevent recurrence [31], we additionally repeated our main analysis restricted to patients in whom no LNM were observed [32]. Analyses were performed in the same manner with IPW analysis as described above, adjusting for the same potential confounders.

Furthermore, to assess the sensitivity of our results for the way we dichotomized LN yield in our analyses, the number of retrieved LNs was also analyzed continuously in univariable regression analyses. Moreover, sensitivity analyses were performed using 12 retrieved LNs as cut-off (using similar analysis as used for 10 retrieved LNs as cut-off), as this cut-off is often used as a quality measure for adequate staging in AJCC stage II CRC [9].

Several checks were performed to evaluate the appropriateness of the IPW analysis, namely (1) baseline characteristics before and after IPW adjustment for confounders were compared; (2) the c-index of the propensity models was assessed using the propensity model’s own IPWs (a c-index of 0.5 indicates a successfully obtained balance of confounders after adjusting; a c-index of 1.0 indicates extreme remaining imbalance); and (3) the maximum weight of a single patient used in the IPW-adjusted analysis to obtain balance in potential confounders was assessed as a quality instrument to assess whether a single or a few cases influence the risk estimate excessively [33, 34].

The secondary aim was to explore the association between LN yield and detection of LNM. Like recurrence, a low number of LNM were observed. Therefore, analyses were performed in the same manner with IPW analysis as described above with the presence of LNM as the endpoint, correcting for the same confounders except for the presence of LNM itself. Inverse probability weighted logistic regression analysis was used yielding odds ratios (OR) for a high (≥ 10) vs. low (< 10) retrieval of LNs on the outcome LNM.

Information on LN yield and the presence of LNM was available for all patients; however, several clinicopathological confounding variables had missing data (Table 1). As simply excluding patients with missing data is inefficient and increases the risk of selection bias, we used multiple imputation before data analysis [35]. Missing data was assumed to be missing at random. Multivariate imputation by chained equations (10 imputation datasets, 25 iterations, healthy convergence) was performed [36]. Rubin’s rules were used to pool results across imputation datasets [37]. Percentage of complete cases (i.e., percentage of patients with no imputed values) were reported for each analysis, together with the percentage of observed data points. For the primary outcome, a sensitivity analysis excluding patients with missing values was performed (complete-case analysis) to determine whether this agreed with the imputed results (Additional file 1: Table S1).

GraphPad Prism version 6.02 (GraphPad software Inc., San Diego, CA, USA) was used to draw figures. IBM SPSS Statistics version 21 (SPSS Inc., Chicago, IL, USA) and R version 3.2.2 (RStudio Inc., Boston, MA, USA) were used for statistical analysis. A two-sided P value < 0.05 was considered significant.

Results

Patient characteristics

A total of 2253 patients with T1 CRC diagnosed between 2000 and 2014 were identified in the participating hospitals. A total of 1017 patients treated for pT1 CRC with surgical resection remained eligible for analysis (Fig. 1). Mean age of the cohort was 69.1 years (SD 9.6) and 54.6% of patients were male. A total of 405 patients (39.8%) had a LN yield ≥ 10. An overview of the baseline characteristics of patients with a LN yield < 10 vs. ≥ 10 before and after IPW adjustment for the confounders considered for the primary analysis (adjustment for clinical factors) and the secondary supporting analysis (adjustment for clinical and histological factors) is provided in Table 1. Before adjustment by IPW, patients with a LN yield ≥ 10 had T1 CRCs that were more often located in the right colon (37.5% vs. 15.2%, P < 0.001), had more often a non-pedunculated morphology (75.9% vs. 60.7%, P < 0.001), had a larger tumor size (2.9 vs. 2.6 cm, P = 0.003), more often had LNM (11.6% vs. 6.0%, P = 0.002), and less often showed lymphovascular invasion (20.2% vs. 29.9%, P = 0.04). Following adjustment, baseline characteristics between groups were comparable.

Fig. 1.

Fig. 1

Study flowchart. AJCC American Joint Committee on Cancer; CRC colorectal cancer; LN lymph node

LN yield in a routine clinical setting

Median LN yield was 7 (IQR 3–12; range 0–52). Median LN yield increased over time from 4 (IQR 2–8) from 2000 to 2009 (N = 574) to 11 (IQR 7–15) from 2010 to 2014 (N = 443) (P < 0.001). If a minimum of 10 LNs retrieved was considered an adequate resection, this threshold value was achieved in 19.5% (112/574) of patients treated before 2010 versus 66.1% (293/443) of patients treated from 2010 onwards (P < 0.001). A scatterplot of LN retrieval over the years is presented in Fig. 2.

Fig. 2.

Fig. 2

Scatterplot of LN retrieval in T1 CRC over the years. Each dot represents one patient. The squares indicate the median LN yield per year

LN yield and recurrence

During the 4581 person-years of follow-up (median 49.0 months; IQR 19.6–81.5), 41 patients (4.0%) were diagnosed with recurrent cancer, corresponding to 9.0 events (95% CI 6.5–12.0) per 1000 person years of follow-up (Table 2). Recurrences occurred most frequently in distant organs (N = 23), followed by local (N = 11) or both local and distant recurrences (N = 7). Distant metastases were most often located in lung (N = 13) and liver (N = 16). Recurrences were detected after a median duration of 26.9 months (IQR 13.9–44.4).

Table 2.

Recurrent cancer and LNM in T1 CRC, stratified for LN yield (< 10 vs. ≥ 10)

Recurrent cancer LNM
N N (%) Total person-years of follow-up Rate/1000 person-years of follow-up (95% CI) N (%)
Total cohort 1017 41 (4.0) 4581 9.0 (6.5–12.0) 84 (8.3)
LN yield < 10 612 37 (6.0) 3403 10.9 (7.8–14.8) 37 (6.0)
LN yield ≥ 10 405 4 (1.0) 1179 3.4 (1.1–8.2) 47 (11.6)

CI confidence interval, CRC colorectal cancer, LN lymph node, LNM lymph node metastasis

Among 612 patients in whom < 10 LNs were retrieved, 37 patients (6.0%) developed recurrence. Among 405 patients in whom ≥ 10 LNs were retrieved, 4 patients (1.0%) developed recurrence (Table 2). In univariable analysis, LN yield ≥ 10 was associated with decreased risk for recurrence (unadjusted HR 0.27; 95% CI 0.10–0.76; P = 0.01) (Table 3). After adjustment for clinical confounders (i.e., age, sex, tumor location, tumor size, tumor morphology, and presence of LNM), LN yield ≥ 10 remained associated with a decreased risk for recurrence (adjusted HR 0.19; 95% CI 0.06–0.60; P = 0.005). Findings persisted after further adjusting for histological factors (adjusted HR 0.20; 95% CI 0.06–0.67; P = 0.009). Sensitivity analysis excluding patients with imputed values did not alter the outcomes (Additional file 1: Table S1).

Table 3.

Unadjusted and adjusted association between LN yield (≥ 10 vs. < 10) and recurrent cancer after surgical resection of T1 CRC

Hazard ratio (95% CI) P value Maximum (97.5th percentile) IPWc Post-IPW c-indexd Complete case (%)e Observed data points (%)f
Total cohort
N = 1017
Unadjusted 0.27 (0.10–0.76) 0.01 100 100
Adjusted for clinical factorsa 0.19 (0.06–0.60) 0.005 5.4 (4.4) 0.48 88 98
Adjusted for clinical & histological factorsb 0.20 (0.06–0.67) 0.009 7.1 (4.4) 0.50 18 88
LN negative patients
N = 933
Unadjusted 0.25 (0.08–0.83) 0.02 100 100
Adjusted for clinical factorsa 0.21 (0.06–0.77) 0.02 5.6 (4.5) 0.48 88 98
Adjusted for clinical & histological factorsb 0.23 (0.06–0.81) 0.02 7.1 (4.5) 0.49 17 87

CI confidence interval, CRC colorectal cancer, IPW inverse probability weighting, LN lymph node

aAge (continuously), sex (male vs. female), tumor location (right colon vs. left colon vs. rectum), tumor size (continuously), tumor morphology (pedunculated vs. non-pedunculated) and lymph node metastasis (presence vs. absence) (the latter only in the total cohort, not in the analysis with LN-negative patients)

bAge (continuously), sex (male vs. female), tumor location (right colon vs. left colon vs. rectum), tumor size (continuously), tumor morphology (pedunculated vs. non-pedunculated), invasion depth (deep vs. superficial submucosal invasion), lymphovascular invasion (presence vs. absence), differentiation grade (poor vs. moderate vs. good), and lymph node metastasis (presence vs. absence) (the latter only in the total cohort, not in the analysis with LN-negative patients)

cThe maximum weight of a single patient used in the IPW adjusted analysis to obtain balance in potential confounders. This is a quality instrument to assess whether a single or a few cases influence the risk estimate excessively. As a rule of thumb this should be lower than 10% of the analyzed dataset (i.e., smaller than 100 and 90 for the total cohort and LN-negative patients, respectively)

dThis is an estimate of the balance of confounders after adjusting by inverse probability weighting (0.50 complete balance, 1.00 complete unbalance)

ePercentage of complete cases (i.e., cases with no imputed values for any of the evaluated variables of that analysis). Note: analysis was performed on the imputed dataset concerning all cases

fPercentage of available data points before imputation. Note: analysis was performed on the imputed dataset concerning all cases

In patients without LNM (N = 933 patients; N = 35 recurrences), LN yield ≥ 10 remained associated with decreased risk for recurrence, also after adjusting for clinicopathological factors (adjusted HR 0.23; 95% CI 0.06–0.81; P = 0.02). Kaplan–Meier curves of recurrence-free patients stratified for LN yield (< 10 vs. ≥ 10) and LNM (presence vs. absence) are presented in Fig. 3.

Fig. 3.

Fig. 3

Kaplan–Meier curve of percentage of recurrence-free T1 CRC patients in relation to LN yield and presence of LNM. Green line: patients with T1 CRC without LNM and LN yield ≥ 10; orange line: patients with T1 CRC (with and without LNM) and LN yield ≥ 10; purple line: patients with T1 CRC without LNM and LN yield < 10; blue line: patients with T1 CRC (with and without LNM) and LN yield < 10; red line: patients with T1 CRC with LNM (irrespective of LN yield). The inset shows the same data on an enlarged y axis. Abbreviations: CRC: colorectal cancer; LN: lymph node; LNM: lymph node metastasis; nr: number

To assess the sensitivity of our results for the way we dichotomized LN yield, sensitivity analyses were performed with the number of retrieved LNs without thresholds and using 12 LNs as cut-off. Without thresholds, LN yield remained associated with a decreased risk for recurrence (per retrieved LN: HR 0.90; 95% CI 0.84–0.97; P = 0.007). Of the 749 patients in whom < 12 LNs were retrieved, 37 patients (4.9%) developed recurrences. Of the 268 patients in whom ≥ 12 LNs were retrieved, 4 patients (1.5%) developed recurrences. Similar to a LN yield ≥ 10, the HR of a LN yield ≥ 12 pointed towards a decreased risk for recurrence, albeit non-significant (adjusted HR 0.41; 95% CI 0.12–1.34; P = 0.14) (Additional file 1: Table S2).

LN yield and LNM

LNM were detected in 84 patients, corresponding to a prevalence of 8.3% (84/1017) (Table 2); 1 positive LN was detected in 54 patients, 2 in 18 patients, 3 in 4 patients, and ≥ 4 in 8 patients, with a maximum of 8 positive LNs per patient. In 6 patients with LNM, recurrence occurred during follow-up. In univariable analysis, the number of retrieved LNs (without thresholds) was associated with increased detection of LNM (per retrieved LN: OR 1.04; 95% CI 1.01–1.07; P = 0.006).

LNM were detected in 37 patients (6.0%) with a LN yield < 10 and in 47 patients (11.6%) with a LN yield ≥ 10 (Table 2). In univariable analysis, LN yield ≥ 10 was positively associated with increased detection of LNM (unadjusted OR 2.04; 95% CI 1.30–3.20; P = 0.002) (Table 4). After adjusting for clinical confounding factors, LN yield ≥ 10 remained associated with increased detection of LNM (adjusted OR 2.09; 95% CI 1.28–3.42). Further adjusting for histological confounding factors did not alter the outcomes (adjusted OR 2.27; 95% CI 1.39–3.69; P = 0.001).

Table 4.

Unadjusted and adjusted association between LN yield (≥ 10 vs. < 10) and detection of LNM in T1 CRC

Odds ratio (95% CI) P value Maximum (97.5th percentile) IPWc Post-IPW c-indexd Complete case (%)e Observed data points (%)f
Unadjusted 2.04 (1.30–3.20) 0.002 100 100
Adjusted for clinical factorsa 2.09 (1.28–3.42) 0.003 5.1 (4.2) 0.48 88 98
Adjusted for clinical and histological factorsb 2.27 (1.39–3.69) 0.001 6.6 (4.3) 0.49 18 85

CI confidence interval, CRC: colorectal cancer,IPW inverse probability weighting, LN lymph node, LNM lymph node metastasis

aAge (continuously), sex (male vs. female), tumor location (right colon vs. left colon vs. rectum), tumor size (continuously), and tumor morphology (pedunculated vs. non-pedunculated)

bAge (continuously), sex (male vs. female), tumor location (right colon vs. left colon vs. rectum), tumor size (continuously), tumor morphology (pedunculated vs. non-pedunculated), invasion depth (deep vs. superficial submucosal invasion), lymphovascular invasion (presence vs. absence), and differentiation grade (poor vs. moderate vs. good)

cThe maximum weight of a single patient used in the IPW adjusted analysis to obtain balance in potential confounders. This is a quality instrument to assess whether a single or a few cases influence the risk estimate excessively. As a rule of thumb this should be lower than 10% of the analyzed dataset (i.e., smaller than 100)

dThis is an estimate of the balance of confounders after adjusting by inverse probability weighting (0.50 complete balance, 1.00 complete unbalance)

ePercentage of complete cases (i.e., cases with no imputed values for any of the evaluated variables of that analysis). Note: analysis was performed on the imputed dataset concerning all cases

fPercentage of available data points before imputation. Note: analysis was performed on the imputed dataset concerning all cases

Discussion

To the best of our knowledge, this is the first large-scale study evaluating the association between LN yield and long-term recurrence rates in patients with T1 CRC when adjusting for multiple confounding factors. A LN yield < 10 was associated with an increased risk for recurrence after surgical resection of T1 CRC, even when adjusting for clinical and histological characteristics. Furthermore, LN yield ≥ 10 was independently associated with an increased detection of LNM. These findings underline the importance of performing an appropriate oncologic resection of the draining LNs and diligent LN search by the pathologist when patients with T1 CRC at high-risk for LNM are referred for surgical resection and question the legitimacy of a limited resection for these patients.

In contrast to earlier smaller studies, we validated a cut-off (≥ 10) that was chosen based on current recommendations for AJCC stage II CRC, instead of evaluating multiple study-specific cut-off points and selecting the most suitable one [16, 20]. This approach is less prone to the introduction of overestimation of the difference in outcomes between groups, and enhances the generalizability and external validity of the results [38]. To assess the sensitivity of our results for the manner in which the LN yield was dichotomized, we performed sensitivity analyses with the number of retrieved LNs analyzed continuously and additionally used 12 retrieved LNs as the cut-off. In all analyses, the HR indicated a decreased risk for recurrence.

Our findings build on a study conducted with data from the Surveillance, Epidemiology, and End Results cancer registry in patients with AJCC stage I CRC, comprising both T1N0 and T2N0 CRC [31]. An increased LN yield was associated with improved overall survival. However, this study used a population-based registry, and could therefore only evaluate the association between LN yield and mortality due to all causes. As the vast majority (≥ 95%) of patients with T1 CRC without LNM do not die as a result of CRC, recurrence rates rather than survival rates are informative when evaluating factors associated with prognosis in this early stage [5, 6].

Several explanations can be hypothesized for the observed association with recurrence. The first is understaging, with positive nodes missed when an insufficient number of LNs is retrieved. Consequently, chemotherapy will not be considered in these patients and the missed residual cancer cells may metastasize to distant organs. Evidence on the benefit of chemotherapy in patients with T1 CRC with LNM is limited. However, it is currently advised in these patients [39]. Our finding that ≥ 10 retrieved LNs resulted in a significantly higher percentage of nodal positive patients supports this explanation, as was also demonstrated in previous work for advanced CRC stages [31, 40]. However, a population-based retrospective observational study questioned this mechanism as the main cause of the observed association, as patients with higher LN yields were only slightly more likely to have LNM, suggesting that some other unmeasured factors resulted in better patient outcomes [8]. It has been hypothesized that the number of retrieved LNs might reflect tumor biology [41]. The tumor microenvironment and the host’s immune response have been shown to be of major importance in tumor progression [42]. Thus, a higher LN yield may reflect a stronger immune response, reducing the risk for recurrence.

Some limitations should be mentioned. Although the present cohort is one of the largest on T1 CRCs to date with long-term follow-up enabling the evaluation of the association between LN yield and recurrence when adjusting for multiple confounding factors, it is an observational study on a retrospective cohort. Inherent to the design, we had to deal with missing data. Information on histological potential confounders was missing in a considerable number of patients, resulting in one or more variables having to be imputed in more than 82% of patients in the secondary supporting analysis. Nevertheless, the estimates resulting from the secondary analyses with and without imputation were similar, suggesting that selection bias due to missingness – if present – was rather limited (results without imputation can be found in Additional file 1: Table S1). Furthermore, due to the retrospective design, no data was available on the effort of the surgeon for adequate lymphadenectomy, such as the extent of the mesentery excised, and no standardized pathologic evaluation of the resection specimen was performed. This could have shed some light on the role of the surgeon and pathologist on the LN yield. However, the primary aim of this study was to explore the association between LN yield and recurrence in T1 CRC, not to explore the influence of the pathologist and surgeon, as has been done in previous studies [17, 4346]. Taking the results of these studies into account, we believe LN yield is a shared responsibility of both surgeon and pathologist.

Secondly, although we corrected as efficiently as possible for the measured confounders, it remains unclear how well the unmeasured confounders have been adjusted for. New predictive markers in CRC have been identified in the past two decades, including tumor budding as prognostic marker for LNM and macroscopic pathological assessment of the quality of the circumferential resection margin (CRM) as a prognostic marker for recurrence in rectal cancer [4, 47, 48]. Standardized pathologic reporting of the quality of the CRM was only introduced in Dutch guidelines in recent years, and consensus on the standardized assessment of tumor budding has only recently been achieved (International Tumor Budding Consensus Conference 2016) [49]. Therefore, this hampered the evaluation of these factors in our analysis. To explore the magnitude of potential bias introduced by lack of information on the quality of the CRM, we repeated the main analysis when excluding patients with rectal T1 cancer, yielding similar results, suggesting that the introduced potential bias is limited (Additional file 1: Table S3).

Thirdly, we were not informed on tumor biology such as genetic mutations, microsatellite instable status, or consensus molecular subtype classification [50, 51]. However, similar to data from the Surveillance, Epidemiology, and End Results cancer registry, we observed an increased LN yield over the years, suggesting that the observed survival benefit cannot be completely attributed to tumor biology [8, 9]. It is not unlikely that the Dutch Surgical Colorectal Audit, introduced in 2008, and the implementation of LN yield as a quality indicator in 2009 have contributed to the observed increment in LN yield from 2010 onwards. This finding shows that retrieving higher number of LNs is achievable in daily clinical practice, and should be aimed for. Moreover, a previous study observed that LN retrieval differed between different types of hospitals, suggesting that other quality issues may influence LN retrieval [52].

Finally, it should be emphasized that, despite our multicenter cohort spanning an inclusion period of many years, the absolute number of patients with recurrent cancer or LNM was still low. Although we resorted to statistical analysis techniques suited for such data and performed several checks to evaluate the appropriateness of our analysis, the low number of events unavoidably resulted in relatively broad CIs.

Conclusion

In conclusion, in this observation cohort study, the retrieval of less than 10 LNs was associated with an increased risk for recurrence and decreased detection of LNM in T1 CRC. Given that gastroenterologists, surgeons and pathologists will all encounter T1 CRCs with increasing frequency due to the introduction of CRC screening programs, awareness on the consequences of an inadequate LN retrieval is of utmost importance.

Acknowledgements

Not applicable.

Funding

None.

Availability of data and materials

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.

Authors’ contributions

Study concept and design: YB, SE, LM. Acquisition of data: all authors. Analysis and interpretation of data: all authors. Drafting of the manuscript: YB. Critical revision of the manuscript for important intellectual content: all authors. Statistical analysis: YB, SE, LM. Study supervision: YB, LM. All authors read and approved the final manuscript.

Authors’ information

All authors are member of the Dutch T1 CRC working group.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

This study was approved by the Medical Ethics Review Committee of the University Medical Center Utrecht (reference number 15-487/C) and was carried out in accordance with the Helsinki Declaration. Informed consent from patients was not required for this study, as they were not asked to follow rules of behavior. Patient data were coded and anonymity of patients was guaranteed.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Abbreviations

AJCC

American Joint Committee on Cancer

CI

confidence interval

CRC

colorectal cancer

CRM

circumferential resection margin

HR

hazard ratio

IPW

inverse probability weighting

IQR

interquartile range

LN

lymph node

LNM

lymph node metastasis

OR

odds ratio

SD

standard deviation

Additional file

Additional file 1: Table S1. (19.3KB, docx)

Sensitivity analysis comparing the complete case hazard ratio and the multiple imputation hazard ratio for the association between lymph node (LN) yield ≥ 10 versus < 10 and the primary outcome recurrent cancer. Table S2. Unadjusted and adjusted association between LN yield ≥ 12 (N = 268 patients, N = 4 recurrences) versus LN yield < 12 (N = 749 patients, N = 37 recurrences) and recurrent cancer after surgical resection of T1 colorectal cancer. Table S3. Main analysis restricted to patients with T1 colon cancer (843 T1 colon cancers with 29 recurrences) in order to explore the magnitude of potential bias introduced by lack of information on the quality of the circumferential resection margin in rectal T1 cancer. (DOCX 18 kb)

Footnotes

Electronic supplementary material

The online version of this article (doi:10.1186/s12916-017-0892-7) contains supplementary material, which is available to authorized users.

Contributor Information

Yara Backes, Email: y.backes@umcutrecht.nl.

Sjoerd G. Elias, Email: s.elias@umcutrecht.nl

Bibie S. Bhoelan, Email: b.s.bhoelan@students.uu.nl

John N. Groen, Email: jn.groen@stjansdal.nl

Jeroen van Bergeijk, Email: bergeijkj@zgv.nl.

Tom C. J. Seerden, Email: tseerden@amphia.nl

Hendrikus J. M. Pullens, Email: hjm.pullens@meandermc.nl

Bernhard W. M. Spanier, Email: mspanier@rijnstate.nl

Joost M. J. Geesing, Email: jgeesing@diakhuis.nl

Koen Kessels, Email: k.kessels@antoniusziekenhuis.nl.

Marjon Kerkhof, Email: marjon.kerkhof@ghz.nl.

Peter D. Siersema, Email: peter.siersema@radboudumc.nl

Wouter H. de Vos tot Nederveen Cappel, Email: w.h.de.vos@isala.nl.

Niels van Lelyveld, Email: n.van.lelyveld@antoniusziekenhuis.nl.

Frank H. J. Wolfhagen, Email: f.wolfhagen@asz.nl

Frank ter Borg, Email: f.terborg@dz.nl.

G. Johan A. Offerhaus, Email: gofferha@umcutrecht.nl

Miangela M. Lacle, Email: m.m.lacle@umcutrecht.nl

Leon M. G. Moons, Phone: 0031-6-145 99 001, Email: l.m.g.moons@umcutrecht.nl

References

  • 1.Amri R, Bordeianou LG, Sylla P, Berger DL. Impact of screening colonoscopy on outcomes in colon cancer surgery. JAMA Surg. 2013;148(8):747–54. doi: 10.1001/jamasurg.2013.8. [DOI] [PubMed] [Google Scholar]
  • 2.Yang DX, Gross CP, Soulos PR, Yu JB. Estimating the magnitude of colorectal cancers prevented during the era of screening: 1976 to 2009. Cancer. 2014;120(18):2893–901. doi: 10.1002/cncr.28794. [DOI] [PubMed] [Google Scholar]
  • 3.Ikematsu H, Yoda Y, Matsuda T, Yamaguchi Y, Hotta K, Kobayashi N, Fujii T, Oono Y, Sakamoto T, Nakajima T, et al. Long-term outcomes after resection for submucosal invasive colorectal cancers. Gastroenterology. 2013;144(3):551–9. doi: 10.1053/j.gastro.2012.12.003. [DOI] [PubMed] [Google Scholar]
  • 4.Bosch SL, Teerenstra S, de Wilt JH, Cunningham C, Nagtegaal ID. Predicting lymph node metastasis in pT1 colorectal cancer: a systematic review of risk factors providing rationale for therapy decisions. Endoscopy. 2013;45(10):827–34. doi: 10.1055/s-0033-1344238. [DOI] [PubMed] [Google Scholar]
  • 5.Gunderson LL, Jessup JM, Sargent DJ, Greene FL, Stewart AK. Revised TN categorization for colon cancer based on national survival outcomes data. J Clin Oncol. 2010;28(2):264–71. doi: 10.1200/JCO.2009.24.0952. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Edge SB, Compton CC. The American Joint Committee on Cancer: the 7th edition of the AJCC cancer staging manual and the future of TNM. Ann Surg Oncol. 2010;17(6):1471–4. doi: 10.1245/s10434-010-0985-4. [DOI] [PubMed] [Google Scholar]
  • 7.Chang GJ, Rodriguez-Bigas MA, Skibber JM, Moyer VA. Lymph node evaluation and survival after curative resection of colon cancer: systematic review. J Natl Cancer Inst. 2007;99(6):433–41. doi: 10.1093/jnci/djk092. [DOI] [PubMed] [Google Scholar]
  • 8.Parsons HM, Tuttle TM, Kuntz KM, Begun JW, McGovern PM, Virnig BA. Association between lymph node evaluation for colon cancer and node positivity over the past 20 years. JAMA. 2011;306(10):1089–97. doi: 10.1001/jama.2011.1285. [DOI] [PubMed] [Google Scholar]
  • 9.Parsons HM, Begun JW, Kuntz KM, Tuttle TM, McGovern PM, Virnig BA. Lymph node evaluation for colon cancer in an era of quality guidelines: who improves? J Oncol Pract. 2013;9(4):e164–71. doi: 10.1200/JOP.2012.000812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Labianca R, Nordlinger B, Beretta GD, Mosconi S, Mandala M, Cervantes A, Arnold D. Early colon cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2013;24(Suppl 6):vi64–72. doi: 10.1093/annonc/mdt354. [DOI] [PubMed] [Google Scholar]
  • 11.Engstrom PF, Arnoletti JP, Benson AB, 3rd, Chen YJ, Choti MA, Cooper HS, Covey A, Dilawari RA, Early DS, Enzinger PC, et al. NCCN Clinical Practice Guidelines in Oncology: colon cancer. J Natl Compr Canc Netw. 2009;7(8):778–831. doi: 10.6004/jnccn.2009.0056. [DOI] [PubMed] [Google Scholar]
  • 12.Colorectaal Carcinoom, Landelijke Richtlijn, Versie: 3.0, April 2014. http://www.oncoline.nl/colorectaalcarcinoom.
  • 13.Morris EJ, Maughan NJ, Forman D, Quirke P. Identifying stage III colorectal cancer patients: the influence of the patient, surgeon, and pathologist. J Clin Oncol. 2007;25(18):2573–9. doi: 10.1200/JCO.2007.11.0445. [DOI] [PubMed] [Google Scholar]
  • 14.Kritsanasakul A, Boonpipattanapong T, Wanitsuwan W, Phukaoloun M, Prechawittayakul P, Sangkhathat S. Impact of lymph node retrieval on surgical outcomes in colorectal cancers. J Surg Oncol. 2012;106(3):238–42. doi: 10.1002/jso.22156. [DOI] [PubMed] [Google Scholar]
  • 15.Baxter NN, Virnig DJ, Rothenberger DA, Morris AM, Jessurun J, Virnig BA. Lymph node evaluation in colorectal cancer patients: a population-based study. J Natl Cancer Inst. 2005;97(3):219–25. doi: 10.1093/jnci/dji020. [DOI] [PubMed] [Google Scholar]
  • 16.Maggard MA, Yermilov I, Tomlinson JS, Ko CY. Are 12 nodes needed to accurately stage T1 and T2 colon cancers? Dig Dis Sci. 2009;54(3):640–7. doi: 10.1007/s10620-008-0373-0. [DOI] [PubMed] [Google Scholar]
  • 17.Mekenkamp LJ, van Krieken JH, Marijnen CA, van de Velde CJ, Nagtegaal ID. Lymph node retrieval in rectal cancer is dependent on many factors--the role of the tumor, the patient, the surgeon, the radiotherapist, and the pathologist. Am J Surg Pathol. 2009;33(10):1547–53. doi: 10.1097/PAS.0b013e3181b2e01f. [DOI] [PubMed] [Google Scholar]
  • 18.Wasif N, Etzioni D, Maggard MA, Tomlinson JS, Ko CY. Trends, patterns, and outcomes in the management of malignant colonic polyps in the general population of the United States. Cancer. 2011;117(5):931–7. doi: 10.1002/cncr.25657. [DOI] [PubMed] [Google Scholar]
  • 19.Kobayashi H, Mochizuki H, Morita T, Kotake K, Teramoto T, Kameoka S, Saito Y, Takahashi K, Hase K, Oya M, et al. Characteristics of recurrence after curative resection for T1 colorectal cancer: Japanese multicenter study. J Gastroenterol. 2011;46(2):203–11. doi: 10.1007/s00535-010-0341-2. [DOI] [PubMed] [Google Scholar]
  • 20.Benhaim L, Benoist S, Bachet JB, Julie C, Penna C, Nordlinger B. Salvage colectomy for endoscopically removed malignant colon polyps: is it possible to determine the optimal number of lymph nodes that need to be harvested? Colorectal Dis. 2012;14(1):79–86. doi: 10.1111/j.1463-1318.2011.02533.x. [DOI] [PubMed] [Google Scholar]
  • 21.La Torre M, Nigri G, Mazzuca F, Ferri M, Botticelli A, Lorenzon L, Pilozzi E, Ziparo V. Standard versus limited colon resection for high risk T1 colon cancer. A matched case-control study. J Gastrointestin Liver Dis. 2014;23(3):285–90. doi: 10.15403/jgld.2014.1121.233.mlt. [DOI] [PubMed] [Google Scholar]
  • 22.Sobin LH, Gospodarowics MK, Wittekind C. TNM Classification of Malignant Tumours (ed 7) West Sussex: Wiley-Blackwell; 2009. [Google Scholar]
  • 23.Editors PM. Observational studies: getting clear about transparency. PLoS Med. 2014;11(8) doi: 10.1371/journal.pmed.1001711. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Hassan C, Zullo A, Risio M, Rossini FP, Morini S. Histologic risk factors and clinical outcome in colorectal malignant polyp: a pooled-data analysis. Dis Colon Rectum. 2005;48(8):1588–96. doi: 10.1007/s10350-005-0063-3. [DOI] [PubMed] [Google Scholar]
  • 25.The Paris endoscopic classification of superficial neoplastic lesions: esophagus, stomach, and colon: November 30 to December 1, 2002. Gastrointest Endosc. 2003;58(6 Suppl):S3–43. [DOI] [PubMed]
  • 26.Kudo S. Endoscopic mucosal resection of flat and depressed types of early colorectal cancer. Endoscopy. 1993;25(7):455–61. doi: 10.1055/s-2007-1010367. [DOI] [PubMed] [Google Scholar]
  • 27.Reid BC, Alberg AJ, Klassen AC, Koch WM, Samet JM. The American Society of Anesthesiologists’ class as a comorbidity index in a cohort of head and neck cancer surgical patients. Head Neck. 2001;23(11):985–94. doi: 10.1002/hed.1143. [DOI] [PubMed] [Google Scholar]
  • 28.Robins JM, Hernan MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11(5):550–60. doi: 10.1097/00001648-200009000-00011. [DOI] [PubMed] [Google Scholar]
  • 29.Curtis LH, Hammill BG, Eisenstein EL, Kramer JM, Anstrom KJ. Using inverse probability-weighted estimators in comparative effectiveness analyses with observational databases. Med Care. 2007;45(10 Supl 2):S103–7. doi: 10.1097/MLR.0b013e31806518ac. [DOI] [PubMed] [Google Scholar]
  • 30.Weintraub WS, Grau-Sepulveda MV, Weiss JM, O'Brien SM, Peterson ED, Kolm P, Zhang Z, Klein LW, Shaw RE, McKay C, et al. Comparative effectiveness of revascularization strategies. N Engl J Med. 2012;366(16):1467–76. doi: 10.1056/NEJMoa1110717. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Chen SL, Bilchik AJ. More extensive nodal dissection improves survival for stages I to III of colon cancer: a population-based study. Ann Surg. 2006;244(4):602–10. doi: 10.1097/01.sla.0000237655.11717.50. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Peters E, Nagtegaal I, van der Velde C, Krieken J. Lymph node examination rate, survival rate, and quality of care in colon cancer. JAMA. 2008;299(8):896–7. doi: 10.1001/jama.299.8.896-b. [DOI] [PubMed] [Google Scholar]
  • 33.Franklin JM, Rassen JA, Ackermann D, Bartels DB, Schneeweiss S. Metrics for covariate balance in cohort studies of causal effects. Stat Med. 2014;33(10):1685–99. doi: 10.1002/sim.6058. [DOI] [PubMed] [Google Scholar]
  • 34.Moore KL, Neugebauer R, van der Laan MJ, Tager IB. Causal inference in epidemiological studies with strong confounding. Stat Med. 2012;31(13):1380–404. doi: 10.1002/sim.4469. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Little R, Rubin D. Statistical Analysis with Missing Data. New York: Wiley; 2002. A taxonomy of missing-data methods (Chapter 1.4) [Google Scholar]
  • 36.Van Buuren S, Groothuis-Oudshoorn K. Mice: Multivariate Imputation by Chained Equations in R. J Stat Softw. 2011;45(3):1–67. doi: 10.18637/jss.v045.i03. [DOI] [Google Scholar]
  • 37.Marshall A, Altman DG, Holder RL, Royston P. Combining estimates of interest in prognostic modelling studies after multiple imputation: current practice and guidelines. BMC Med Res Methodol. 2009;9:57. doi: 10.1186/1471-2288-9-57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Metze K, Adam RL. Is there a reliable minimum number of lymph nodes for T1 and T2 colon cancer? Dig Dis Sci. 2009;54(4):914–5. doi: 10.1007/s10620-008-0555-9. [DOI] [PubMed] [Google Scholar]
  • 39.Ganapathi AM, Speicher PJ, Englum BR, Castleberry AW, Migaly J, Hsu DS, Mantyh CR. Adjuvant chemotherapy for t1 node-positive colon cancers provides significant survival benefit. Dis Colon Rectum. 2014;57(12):1341–8. doi: 10.1097/DCR.0000000000000245. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Baxter NN, Ricciardi R, Simunovic M, Urbach DR, Virnig BA. An evaluation of the relationship between lymph node number and staging in pT3 colon cancer using population-based data. Dis Colon Rectum. 2010;53(1):65–70. doi: 10.1007/DCR.0b013e3181c70425. [DOI] [PubMed] [Google Scholar]
  • 41.Ricciardi R, Baxter NN. Association versus causation versus quality improvement: setting benchmarks for lymph node evaluation in colon cancer. J Natl Cancer Inst. 2007;99(6):414–5. doi: 10.1093/jnci/djk106. [DOI] [PubMed] [Google Scholar]
  • 42.Pages F, Berger A, Camus M, Sanchez-Cabo F, Costes A, Molidor R, Mlecnik B, Kirilovsky A, Nilsson M, Damotte D, et al. Effector memory T cells, early metastasis, and survival in colorectal cancer. N Engl J Med. 2005;353(25):2654–66. doi: 10.1056/NEJMoa051424. [DOI] [PubMed] [Google Scholar]
  • 43.Etzioni D, Spencer M. Nodal harvest: surgeon or pathologist? Dis Colon Rectum. 2008;51(3):366–7. doi: 10.1007/s10350-007-9113-3. [DOI] [PubMed] [Google Scholar]
  • 44.Stocchi L, Fazio VW, Lavery I, Hammel J. Individual surgeon, pathologist, and other factors affecting lymph node harvest in stage II colon carcinoma. is a minimum of 12 examined lymph nodes sufficient? Ann Surg Oncol. 2011;18(2):405–12. doi: 10.1245/s10434-010-1308-5. [DOI] [PubMed] [Google Scholar]
  • 45.Jeganathan AN, Shanmugan S, Bleier JI, Hall GM, Paulson EC. Colorectal Specialization Increases Lymph Node Yield: Evidence from a National Database. Ann Surg Oncol. 2016;23(7):2258–65. doi: 10.1245/s10434-016-5122-6. [DOI] [PubMed] [Google Scholar]
  • 46.Rieger NA, Barnett FS, Moore JW, Ananda SS, Croxford M, Johns J, Gibbs P. Quality of pathology reporting impacts on lymph node yield in colon cancer. J Clin Oncol. 2007;25(4):463. doi: 10.1200/JCO.2006.09.2304. [DOI] [PubMed] [Google Scholar]
  • 47.Rogers AC, Winter DC, Heeney A, Gibbons D, Lugli A, Puppa G, Sheahan K. Systematic review and meta-analysis of the impact of tumour budding in colorectal cancer. Br J Cancer. 2016;115(7):831–40. doi: 10.1038/bjc.2016.274. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Quirke P, Steele R, Monson J, Grieve R, Khanna S, Couture J, O'Callaghan C, Myint AS, Bessell E, Thompson LC, et al. Effect of the plane of surgery achieved on local recurrence in patients with operable rectal cancer: a prospective study using data from the MRC CR07 and NCIC-CTG CO16 randomised clinical trial. Lancet. 2009;373(9666):821–8. doi: 10.1016/S0140-6736(09)60485-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Loughrey MB, Quirke P, Shepherd NA. Dataset for colorectal cancer histopathology reports. The Royal College of Pathologists. Version 3, July 2014. https://www.rcpath.org/resourceLibrary/dataset-for-colorectal-cancer-histopathology-reports%2D-3rd-edition-.html
  • 50.Gryfe R, Kim H, Hsieh ET, Aronson MD, Holowaty EJ, Bull SB, Redston M, Gallinger S. Tumor microsatellite instability and clinical outcome in young patients with colorectal cancer. N Engl J Med. 2000;342(2):69–77. doi: 10.1056/NEJM200001133420201. [DOI] [PubMed] [Google Scholar]
  • 51.Guinney J, Dienstmann R, Wang X, de Reynies A, Schlicker A, Soneson C, Marisa L, Roepman P, Nyamundanda G, Angelino P, et al. The consensus molecular subtypes of colorectal cancer. Nat Med. 2015;21(11):1350–6. doi: 10.1038/nm.3967. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Bianco F, De Franciscis S, Belli A, Di Lena M, Avallone A, Bianco MA, Di Marzo S, Gigli L, Rotondano G, Spena SR, et al. Surgery has a key role for quality assurance of colorectal cancer screening programs: impact of the third level multidisciplinary team on lymph nodal staging. Int J Color Dis. 2016;31(3):587–92. doi: 10.1007/s00384-015-2472-7. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.


Articles from BMC Medicine are provided here courtesy of BMC

RESOURCES