Abstract
Introduction
We aimed to evaluate the generalizability of retrospective single-center cohort studies on prognosis of hepatocellular carcinoma (HCC) by comparing overall survival (OS) after various treatments between a nationwide multicenter cohort and a single-center cohort of HCC patients.
Methods
Patients newly diagnosed with HCC between January 2008 and December 2018 were analyzed using data from the Korean Primary Liver Cancer Registry (multicenter cohort, n=16,443), and the Asan Medical Center HCC registry (single-center cohort, n=15,655). The primary outcome, OS after initial treatment, was compared between the two cohorts for both the entire population and for subcohorts with Child-Pugh A liver function (n=2797 and n=5151, respectively) treated according to the Barcelona-Clinic-Liver-Cancer (BCLC) strategy, using Log rank test and Cox proportional hazard models.
Results
Patients of BCLC stages 0 and A (59.3% vs 35.2%) and patients who received curative treatment (42.1% vs 32.1%) were more frequently observed in the single-center cohort (Ps<0.001). Multivariable analysis revealed significant differences between the two cohorts in OS according to type of treatment: the multicenter cohort was associated with higher risk of mortality among patients who received curative (adjusted hazard ratio [95% confidence interval], 1.48 [1.39–1.59]) and non-curative (1.22 [1.17–1.27]) treatments, whereas the risk was lower in patients treated with systemic therapy (0.83 [0.74–0.92]) and best supportive care (0.85 [0.79–0.91]). Subcohort analysis also demonstrated significantly different OS between the two cohorts, with a higher risk of mortality in multicenter cohort patients who received chemoembolization (1.72 [1.48–2.00]) and ablation (1.44 [1.08–1.92]).
Conclusion
Comparisons of single-center and multicenter cohorts of HCC patients revealed significant differences in OS according to treatment modality after adjustment for prognostic variables. Therefore, the results of retrospective single-center cohort studies of HCC treatments may not be generalizable to real-world practice.
Keywords: BCLC, UICC, liver cancer, retrospective cohort, external validation
Introduction
Of the various observational study designs, retrospective cohort studies allow relatively quick, cost-effective, and practicable analyses of the associations between multiple exposures and the corresponding outcomes.1 These outcomes are established on the basis of existing data for a representative patient population under broad inclusion criteria, thereby providing more generalizable results. In the clinical setting, retrospective cohort studies are especially important in hepatocellular carcinoma (HCC), a disease with heterogeneous tumor characteristics and treatment options depending on staging and underlying liver function.2–4 Due to its nature, randomized controlled trials (RCT) are less likely to reveal the variable clinical course of HCC and may not reflect real-world treatment outcomes. This highlights the need for observational studies that can objectively portray overall survival (OS) in actual clinical practice.5 However, retrospective cohort studies have several limitations, of which external validity and selection bias are considered of major concern.6
Retrospective cohort studies are often conducted at a multicenter level to overcome this problem,7 but the rationale for this approach is mostly based on evidence acquired from RCTs.8 In previous RCTs, single-center trials have shown larger intervention effects than multicenter trials,9,10 or, in other cases, positive results of single-center trials have been contradicted by subsequent multicenter trials.8,11,12 However, the differences in outcomes seen in RCTs have not yet been demonstrated in retrospective cohort studies despite their frequency and significant role in clinical practice. Due to the differences between RCTs and retrospective cohort studies in study design and patient population,13 it is unclear whether retrospective single-center cohort studies have the same drawbacks as single-center RCTs. If retrospective single-center cohort studies were capable of providing comparable results to those of multicenter cohort studies, researchers might be spared the time and effort needed to achieve uniformity of data among different institutions while obtaining a similar degree of external validity. Furthermore, demonstration of similar treatment outcomes between single-center and multicenter cohorts would conceivably enhance acceptance of the quality of single-center research and provide guidance for applying evidence achieved from these studies in clinical practice.
We thus hypothesized that a well-conducted single-center study could fully reflect the heterogeneous disease course and tumor features of HCC and potentially establish survival outcomes comparable to that of a multicenter cohort.
Methods
Study Design and Patient Selection
We conducted a retrospective analysis of de-identified patients newly diagnosed with HCC using data from a nationwide multicenter cohort and a single-center cohort in South Korea between January 2008 and December 2018. Diagnosis of HCC was made histologically or radiologically according to the criteria of the American Association for the Study of Liver Disease (AASLD), European Association for the Study of the Liver (EASL), and the Korean Liver Cancer Association (KLCA).2–4,14 The Korean Primary Liver Cancer Registry (KPLCR) was selected as the multicenter cohort, and the Asan Medical Center (AMC) HCC registry, developed using the well-established Research Electronic Data Capture (REDCap) Cloud platform at South Korea’s largest cancer institute and hospital (https://eng.amc.seoul.kr), was selected as the single-center cohort.15,16 The KPLCR is a database containing approximately 15% of the patients newly-diagnosed with HCC registered in the South Korean Central Cancer Registry, from which patients are randomly selected each year using the probability-proportional-to-size method and stratification by region (54 hospitals, with a variety of levels of care).17 Eligible patients were male and female patients aged 18 years or over, and patients for whom no information was available regarding the number of tumors, treatment modality, and age at diagnosis were excluded. This study was approved by the Institutional Review Board of the Asan Medical Center (IRB no.:2022–1274), which waived a requirement for informed consent owing to the retrospective nature of the study.
Variables
Baseline characteristics of the study population included age, sex, body mass index, underlying hypertension or diabetes mellitus, and presence of viral hepatitis, which was defined as any of the following: positive hepatitis B surface antigen or hepatitis C antibody, positive viral titer, or previous history of antiviral therapy. Baseline liver function was assessed by Child Pugh score and Model for End-stage Liver Disease (MELD) score. Tumors were staged according to the Barcelona Clinic Liver Cancer (BCLC) strategy and the modified Union for International Cancer Control (mUICC) system.18,19 Index date was set as the date of diagnosis.
Treatment Modalities
Initial treatments used in the two cohorts consisted of the following: surgical resection, liver transplantation, local ablation therapy (LAT), transarterial chemoembolization/radioembolization (TACE/TARE), radiotherapy, systemic therapy, and best supportive care. These treatment modalities were further categorized as curative treatment (surgical resection, liver transplantation, and LAT), non-curative treatment (TACE/TARE, radiotherapy, and systemic therapy), and best supportive care. TARE and radiotherapy were excluded from the treatment options in the subcohort analysis as they are currently not standardized as primary treatment options in the BCLC recommendations. In principle, the medical, surgical, and interventional procedures for HCC carried out by Korean clinicians were based on the Korean Liver Cancer Association’s own practice guidelines internationally recommended for use without modification.4,20–22
Outcomes
The primary outcome of this study was OS. Death certificate data were accessed from the national statistical data collected by the Ministry of Government Administration and Home Affairs in South Korea, and patients who were recorded as alive without a specified follow-up date were in all cases labelled with the last evaluation date of a patient diagnosed in the same year. OS according to sex, liver function, mUICC staging, and type of initial treatment were obtained, and OS of the entire cohorts were additionally analyzed using propensity score (PS) matching to balance the distribution of confounding variables.
Although the BCLC staging system is designed to guide the choice of treatment for each stage in accordance with AASLD and EASL practice guidelines, primary treatment of HCC in clinical practice varies widely among patients of the same stage due to differences in underlying liver function and tumor features.5,23 Therefore, patients with preserved liver function (Child-Pugh class A) who received the BCLC-recommended treatment options for each stage (BCLC stage 0 or A, single tumor: surgical resection, BCLC stage A with 3 or less nodules each up to 3 cm: LAT, BCLC stage B: TACE, BCLC stage C: systemic therapy),18 and patients with any degree of liver function who received a liver transplant according to the Milan criteria were further grouped together for the subcohort analysis. OS of these subcohorts were then compared to evaluate whether there were differences between the two cohorts even in patients treated according to the same criteria.2,3
Statistical Analysis
With regard to baseline characteristics, differences in the distribution of categorical variables were analyzed by the Chi-square test and differences between continuous variables were analyzed by Student’s t-test or the Wilcoxon rank-sum test. Multivariable Cox proportional hazard models with 95% confidence intervals (CI) were used to assess OS, and survival curves were estimated using the Kaplan-Meier method and Log rank test. Because of the retrospective nature of the study, missing data were handled in one or other of two ways: either by analysis with missing data substituted, using the multiple imputation technique, or analysis with missing data classified as a category. Multiple imputation by Markov Chain Monte Carlo methods was used to fill-out incomplete baseline variables, on the assumption that data were missing at random,24 while interaction analysis was used to evaluate whether the effect of the registry was different within subgroups (sex, liver function, mUICC staging, type of initial treatment). PS matching was performed by matching patients 1:1 using the nearest neighbor method with a 0.05 caliper in order to adjust for differences in baseline variables.25 PS were determined by taking into account the following variables: sex, age, body mass index, Child-Pugh class, BCLC staging, mUICC staging, and type of initial treatment. All statistical analyses were conducted using SAS version 9.4 (SAS Institute Inc, Cary, NC, USA). Two-sided P-values ≤0.05 were considered statistically significant.
Results
Study Population
Between January 2008 and December 2018, a total of 16,781 patients newly diagnosed with HCC were registered in the KPLCR database (multicenter cohort), and 15,707 patients were recorded in the AMC HCC registry (single-center cohort). After applying the exclusion criteria, a total of 32,098 patients (16,443 patients in the multicenter cohort and 15,655 patients in the single-center cohort) were included in the study (Figure 1).
Figure 1.
Patient flowchart of the study population.
Abbreviations: AMC, Asan Medical Center; HCC, hepatocellular carcinoma; KPLCR, Korean Primary Liver Cancer Registry.
Baseline characteristics of the two cohorts with missing data excluded from analysis are presented in Table 1. The mean ages at diagnosis were 57.7 years (standard deviation [SD], 10.4) and 61.1 years (SD, 11.5) in the single-center and multicenter cohorts, respectively. The single-center cohort had a higher proportion of early-stage patients than the multicenter cohort according to BCLC. Consequently, the use of curative treatment modalities was higher in the single-center cohort, and the use of best supportive care lower. After PS matching, on the other hand, the two cohorts were generally well-balanced. Results with missing data classified as a category are presented in Supplementary Table 1, and the baseline characteristics of the propensity score-matched populations are given in Supplementary Table 2.
Table 1.
Baseline Characteristics of the Study Populationsa
| Variable | Single-Center Cohort (n=15,655) | Multicenter Cohort (n=16,443) | P-value |
|---|---|---|---|
| Age (years) | 57.7 ± 10.4 | 61.1 ± 11.5 | <0.001 |
| Male | 12,690 (81.1%) | 13,045 (79.3%) | <0.001 |
| Body mass index (kg/m2) | 24.3 ± 3.3 | 24.0 ± 3.4 | <0.001 |
| Diabetes mellitus | 3314 (22.0%) | 5779 (40.0%) | <0.001 |
| Hypertension | 4564 (30.2%) | 4347 (33.4%) | <0.001 |
| Hepatitis Bb | 10,622 (73.1%) | 9879 (62.3%) | <0.001 |
| Hepatitis Cc | 1410 (10.4%) | 1883 (12.7%) | <0.001 |
| mUICC staging | <0.001 | ||
| Stage I | 2626 (16.8%) | 2532 (15.4%) | |
| Stage II | 6176 (39.5%) | 6168 (37.6%) | |
| Stage III | 4712 (30.1%) | 4147 (25.3%) | |
| Stage IVA | 1291 (8.3%) | 1920 (11.7%) | |
| Stage IVB | 850 (5.4%) | 1627 (9.9%) | |
| BCLC staging | <0.001 | ||
| Stage 0 | 2572 (16.4%) | 1312 (9.3%) | |
| Stage A | 6719 (42.9%) | 3655 (25.9%) | |
| Stage B | 2293 (14.7%) | 2722 (19.3%) | |
| Stage C | 3563 (22.8%) | 5402 (38.3%) | |
| Stage D | 508 (3.2%) | 1013 (7.2%) | |
| Child-Pugh class | <0.001 | ||
| Class A | 12,126 (78.0%) | 11,476 (73.1%) | |
| Class B | 2904 (18.7%) | 3469 (22.1%) | |
| Class C | 510 (3.3%) | 747 (4.8%) | |
| MELD score | 8 (7–10) | 8 (7–11) | <0.001 |
| Type of initial treatment | <0.001 | ||
| Curatived | 6586 (42.1%) | 5282 (32.1%) | |
| Non-curativee | 7626 (48.7%) | 8070 (49.1%) | |
| Best supportive care | 1443 (9.2%) | 3091 (18.8%) | |
| Initial treatment modality | <0.001 | ||
| Surgical resection | 5162 (33.0%) | 3304 (20.1%) | |
| Liver transplantation | 211 (1.3%) | 156 (0.9%) | |
| LAT | 1213 (7.7%) | 1822 (11.1%) | |
| TACE/TARE | 6825 (43.6%) | 6839 (41.6%) | |
| Radiotherapy | 186 (1.2%) | 245 (1.5%) | |
| Systemic therapy | 615 (3.9%) | 986 (6.0%) | |
| Best supportive care | 1443 (9.2%) | 3091 (18.8%) |
Notes: Data are presented as mean ± standard deviation, median (interquartile range), or frequency (proportion). aMissing data was excluded from the analysis. bHepatitis B was defined as any of the following: positive hepatitis B surface antigen, positive viral titer, or previous history of antiviral therapy. cHepatitis C was defined as any of the following: positive hepatitis C antibody, positive viral titer, or previous history of antiviral therapy. dCurative treatment was defined as surgical resection, liver transplantation, and local ablation therapy. eNon-curative treatment was defined as TACE/TARE, radiotherapy, and systemic therapy.
Abbreviations: BCLC, Barcelona Clinic Liver Cancer; LAT, local ablation therapy; MELD, Model for End-stage Liver Disease; mUICC, modified Union for International Cancer Control; TACE, transarterial chemoembolization; TARE, transarterial radioembolization.
Distribution of Liver Function by Initial Treatment
The distribution of liver function according to Child-Pugh class was identified for each initial treatment modality to evaluate differences in distribution between the two cohorts (Supplementary Table 3). There was no significant difference among the patients who received LAT, whereas the multicenter cohort had a significantly higher proportion of patients with Child-Pugh class A liver function than the single-center cohort among those who received liver transplants (44.4% vs 30.0%), radiotherapy (58.2% vs 39.7%), systemic therapy (61.8% vs 55.1%), and best supportive care (40.5% vs 29.6%) (Ps<0.001 for all comparisons).
Survival Outcomes of the Entire Cohorts and PS-Matched Cohorts
The median follow-up duration of single-center and multicenter cohort was 36.2 (interquartile range [IQR]=9.7–66.9) and 30.0 (IQR=6.1–60.0) months, respectively. The single-center cohort had a significantly higher OS than the multicenter cohort, with median survival times of 73.6 (95% CI=69.6–77.5) and 34.0 (95% CI=33.0–35.0) months, respectively (Figure 2, P<0.001 by Log rank test), and this was confirmed by PS matching with adjustment for prognostic variables (Supplementary Figure 1, P<0.001). This finding was also consistent regardless of sex, liver function according to Child-Pugh class, and mUICC staging (Supplementary Figures 2–4, Ps<0.001 for all comparisons). In univariate analysis, the multicenter cohort was associated with a significantly higher risk of mortality compared to the single-center cohort (hazards ratio [HR]=1.55, 95% CI=1.50–1.59, P<0.001). Multivariable analysis also showed significantly higher risk of death in the multicenter cohort after adjustment for cancer variables and patient demographics (adjusted hazards ratio [aHR]=1.16, 95% CI=1.13–1.20, P<0.001) (Table 2).
Figure 2.
Kaplan–Meier estimates of overall survival in the two cohorts.
Table 2.
Cox Regression Analysis of Factors Associated with Mortality in the Entire Cohortsa
| Variable | Univariate Analysis | Multivariable Analysis with Multiple Imputation | ||
|---|---|---|---|---|
| HR (95% CI) | P-value | Adjusted HR (95% CI) | P-value | |
| Cohort | ||||
| Single-center | 1 (reference) | 1 (reference) | ||
| Multicenter | 1.55 (1.50–1.59) | <0.001 | 1.16 (1.13–1.20) | <0.001 |
| Age ≥ 60 years | 1.22 (1.19–1.26) | <0.001 | 1.13 (1.10–1.17) | <0.001 |
| Female (vs Male) | 0.83 (0.80–0.87) | <0.001 | 0.93 (0.89–0.96) | <0.001 |
| Hepatitis Bb | 0.77 (0.75–0.80) | <0.001 | 0.95 (0.91–0.98) | 0.003 |
| Hepatitis Cc | 1.18 (1.13–1.24) | <0.001 | 1.06 (1.00–1.11) | 0.04 |
| mUICC staging | ||||
| Stage I | 1 (reference) | 1 (reference) | ||
| Stage II | 1.56 (1.47–1.65) | <0.001 | 1.50 (1.42–1.58) | <0.001 |
| Stage III | 3.81 (3.60–4.03) | <0.001 | 2.78 (2.62–2.94) | <0.001 |
| Stage IVA | 9.32 (8.76–9.92) | <0.001 | 5.55 (5.20–5.92) | <0.001 |
| Stage IVB | 14.59 (13.67–15.58) | <0.001 | 8.07 (7.54–8.63) | <0.001 |
| Child-Pugh class | ||||
| Class A | 1 (reference) | 1 (reference) | ||
| Class B | 3.09 (2.99–3.20) | <0.001 | 1.94 (1.87–2.01) | <0.001 |
| Class C | 5.05 (4.74–5.37) | <0.001 | 3.12 (2.92–3.34) | <0.001 |
| Type of initial treatment | ||||
| Curatived | 1 (reference) | 1 (reference) | ||
| Non-curativee | 3.64 (3.50–3.78) | <0.001 | 2.39 (2.30–2.49) | <0.001 |
| Best supportive care | 12.89 (12.31–13.50) | <0.001 | 5.71 (5.42–6.01) | <0.001 |
| Initial treatment modality | ||||
| Surgical resection | 1 (reference) | |||
| Liver transplantation | 0.76 (0.61–0.95) | 0.02 | ||
| LAT | 1.43 (1.33–1.54) | <0.001 | ||
| TACE/TARE | 3.55 (3.39–3.72) | <0.001 | ||
| Radiotherapy | 8.75 (7.83–9.78) | <0.001 | ||
| Systemic therapy | 14.82 (13.85–15.85) | <0.001 | ||
| Best supportive care | 14.70 (13.95–15.50) | <0.001 | ||
Notes: aMissing data was imputed. bHepatitis B was defined as any of the following: positive hepatitis B surface antigen, positive viral titer, or previous history of antiviral therapy. cHepatitis C was defined as any of the following: positive hepatitis C antibody, positive viral titer, or previous history of antiviral therapy. dCurative treatment was defined as surgical resection, liver transplantation, and local ablation therapy. eNon-curative treatment was defined as TACE/TARE, radiotherapy, and systemic therapy.
Abbreviations: CI, confidence interval; HR, hazard ratio; LAT, local ablation therapy; mUICC, modified Union for International Cancer Control; TACE, transarterial chemoembolization; TARE, transarterial radioembolization.
Comparisons of OS in the entire cohorts according to first-line treatment yielded variable results (Table 3 and Supplementary Figures 5 and 6). Multivariable analysis with multiple imputation revealed a higher risk of mortality in the multicenter cohort in patients who received surgical resection (aHR=1.32, 95% CI=1.22–1.44, P<0.001), LAT (aHR=1.50, 95% CI=1.32–1.71, P<0.001), TACE/TARE (aHR=1.24, 95% CI=1.19–1.29, P<0.001), and liver transplantation (aHR=2.10, 95% CI=1.30–3.38, P=0.002). Overall, there was a higher risk of death among patients in the multicenter cohort who received curative treatment (aHR=1.48, 95% CI=1.39–1.59, P<0.001) or non-curative treatment (aHR=1.22, 95% CI=1.17–1.27, P<0.001), and death was significantly lower in patients who received systemic therapy (aHR=0.83, 95% CI=0.74–0.92, P=0.001) and best supportive care (aHR=0.85, 95% CI=0.79–0.91, P<0.001). OS following radiotherapy as an initial option, however, did not differ significantly between the two cohorts (aHR=1.14, 95% CI=0.91–1.42, P=0.25). The results of multivariable analysis with missing data classified as a category are presented in Supplementary Tables 4 and 5, which gave similar outcomes.
Table 3.
Cox Regression Analysis of Risk of Mortality by Initial Treatment in the Entire Cohortsa
| Initial Treatment Modality | Univariate Analysis | Multivariable Analysis with Multiple Imputationb | ||
|---|---|---|---|---|
| HR (95% CI) | P-value | Adjusted HR (95% CI) | P-value | |
| Surgical resection | ||||
| Single-center (n=5162) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=3304) | 1.38 (1.27–1.50) | <0.001 | 1.32 (1.22–1.44) | <0.001 |
| Liver transplantation | ||||
| Single-center (n=211) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=156) | 2.22 (1.41–3.51) | <0.001 | 2.10 (1.30–3.38) | 0.002 |
| LAT | ||||
| Single-center (n=1213) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=1822) | 1.64 (1.45–1.87) | <0.001 | 1.50 (1.32–1.71) | <0.001 |
| TACE/TARE | ||||
| Single-center (n=6825) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=6839) | 1.25 (1.20–1.31) | <0.001 | 1.24 (1.19–1.29) | <0.001 |
| Radiotherapy | ||||
| Single-center (n=186) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=245) | 1.16 (0.94–1.43) | 0.16 | 1.14 (0.91–1.42) | 0.25 |
| Systemic therapy | ||||
| Single-center (n=615) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=986) | 0.86 (0.78–0.96) | 0.007 | 0.83 (0.74–0.92) | 0.001 |
| Curative treatmentc | ||||
| Single-center (n=6586) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=5282) | 1.54 (1.44–1.65) | <0.001 | 1.48 (1.39–1.59) | <0.001 |
| Non-curative treatmentd | ||||
| Single-center (n=7626) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=8070) | 1.28 (1.23–1.33) | <0.001 | 1.22 (1.17–1.27) | <0.001 |
| Best supportive care | ||||
| Single-center (n=1443) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=3091) | 0.85 (0.80–0.91) | <0.001 | 0.85 (0.79–0.91) | <0.001 |
Notes: aMissing data was imputed. bAdjusted for sex, age, hepatitis B, hepatitis C, Child-Pugh class, and modified Union for International Cancer Control (mUICC) staging. cCurative treatment was defined as surgical resection, liver transplantation, and local ablation therapy. dNon-curative treatment was defined as TACE/TARE, radiotherapy, and systemic therapy.
Abbreviations: CI, confidence interval; HR, hazard ratio; LAT, local ablation therapy ablation; TACE, transarterial chemoembolization; TARE, transarterial radioembolization.
Subcohort Analysis of Patients Treated According to BCLC Guidelines
Subcohort analysis was conducted to further compare survival outcomes between two subcohorts (n=2797 and n=5151 for multicenter and single-center subsets, respectively) comprised of patients with preserved liver function (Child-Pugh class A) who received treatment according to the BCLC strategy, and patients with any level of liver function who received liver transplants according to the Milan criteria.
OS did not differ between the two subcohorts in patients who received surgical resection (P=0.17 by Log rank test; Figure 3A), liver transplants (P=0.38; Figure 3B), and systemic therapy (median survival time, 5.5 [IQR=5.0–6.1] and 5.1 [IQR=4.5–6.0] months, respectively, P=0.23; Figure 3E). These findings were confirmed in multivariable analysis: risk of mortality among patients with preserved liver function who received surgical resection (aHR=1.07, 95% CI=0.93–1.23, P=0.33) or systemic therapy (aHR=0.94, 95% CI=0.81–1.10, P=0.44) did not differ between the two cohorts, and for patients who received liver transplants within the Milan criteria (aHR=1.30, 95% CI=0.65–2.60, P=0.45) (Table 4).
Figure 3.
Kaplan–Meier estimates of overall survival of patients who received (A) surgical resection, (B) liver transplants, (C) LAT, (D) TACE, and (E) systemic therapy according to the treatment indications*.
Notes: *Treatment indications: patients of BCLC stage 0 or A, single tumor: surgical resection, BCLC stage A with 3 or less nodules each up to 3 cm: LAT, BCLC stage B: TACE, BCLC stage C:systemic therapy, and patients with any degree of liver function who meet the Milan’s criteria: liver transplantation.
Abbreviations: BCLC, Barcelona Clinic Liver Cancer; LAT, local ablation therapy; TACE, transarterial chemoembolization.
Table 4.
Cox Regression Analysis of Risk of Mortality by Initial Treatment in BCLC-Guided Subcohortsa
| Initial Treatment Modality | Univariate Analysis | Multivariable Analysis with Multiple Imputationb | ||
|---|---|---|---|---|
| HR (95% CI) | P-value | Adjusted HR (95% CI) | P-value | |
| Surgical resection | ||||
| Single-center (n=3771) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=1481) | 1.10 (0.96–1.26) | 0.17 | 1.07 (0.93–1.23) | 0.33 |
| Liver transplantation | ||||
| Single-center (n=146) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=90) | 1.35 (0.69–2.66) | 0.38 | 1.30 (0.65–2.60) | 0.45 |
| LAT | ||||
| Single-center (n=280) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=346) | 1.42 (1.07–1.90) | 0.02 | 1.44 (1.08–1.92) | 0.01 |
| TACE | ||||
| Single-center (n=661) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=366) | 1.74 (1.50–2.02) | <0.001 | 1.72 (1.48–2.00) | <0.001 |
| Systemic therapy | ||||
| Single-center (n=293) | 1 (reference) | 1 (reference) | ||
| Multicenter (n=514) | 0.93 (0.80–1.08) | 0.33 | 0.94 (0.81–1.10) | 0.44 |
Notes: aMissing data was imputed. bAdjusted for sex, age, hepatitis B, hepatitis C, Child-Pugh class, and modified Union for International Cancer Control (mUICC) staging.
Abbreviations: BCLC, Barcelona Clinic Liver Cancer; CI, confidence interval; HR, hazard ratio; LAT, local ablation therapy; TACE, transarterial chemoembolization.
Among patients with preserved liver function who received either LAT (P=0.02 by Log rank test; Figure 3C) or TACE (P<0.001; Figure 3D) in accordance with the BCLC treatment strategy, the multicenter subcohort was associated with a higher risk of death than the single-center subcohort. These differences were also demonstrated in both univariate (HR=1.42, 95% CI=1.07–1.90, P=0.02; and HR=1.74, 95% CI=1.50–2.02, P<0.001, respectively) and multivariable analyses (aHR=1.44, 95% CI=1.08–1.92, P=0.01; and aHR=1.72, 95% CI=1.48–2.00, P<0.001, respectively). Similar outcomes were obtained in multivariable analysis with missing data classified as individual categories (Supplementary Table 6).
Subcohort Analysis of Patients with Child-Pugh Class B Liver Function
In addition to BCLC-guided subcohort analysis, OS according to initial treatment was compared among Child-Pugh class B patients (n=2183 and n=2103 for multicenter and single-center subsets, respectively) and the results are presented in Supplementary Table 7.
While multivariable analysis did not show significant differences in OS between the two subcohorts among patients who received surgical resection (aHR=1.14, 95% CI=0.83–1.55, P=0.42), liver transplantation (aHR=2.03, 95% CI=0.94–4.39, P=0.07), and LAT (aHR=1.26, 95% CI=0.97–1.64, P=0.09), the multicenter cohort patients treated with TACE had a higher risk of death (aHR=1.10, 95% CI=1.01–1.20, P=0.03), and patients who received systemic therapy had a significantly lower risk of death (aHR=0.72, 95% CI=0.60–0.86, P<0.001); this effect resembled the outcomes of systemic therapy in the cohorts as a whole.
Subgroup Analysis
Interaction analysis performed to evaluate the effect of type of registry in the different subgroups showed that the multicenter cohort was associated with a significantly higher risk of mortality in both sexes, for all degrees of liver function, as well as for all stages of the mUICC system (Ps<0.001 for all subgroups) (Table 5 and Supplementary Table 8). In terms of initial treatment modality, subgroups of the multicenter cohort who received curative or non-curative treatment had higher risks of mortality, but OS was higher in the subgroup that received best supportive care (Ps<0.001 for all).
Table 5.
Subgroup Analysisa
| Subgroup | Single-Center Cohort | Multicenter Cohort | |||||
|---|---|---|---|---|---|---|---|
| Cases | Events (%) | Cases | Events (%) | Crude HR (95% CI)b | P-value | P for interaction | |
| Sex | 0.013 | ||||||
| Male | 12,690 | 6126 (48.3%) | 13,045 | 8893 (68.2%) | 1.52 (1.48–1.58) | <0.001 | |
| Female | 2965 | 1190 (40.1%) | 3398 | 2142 (63.0%) | 1.68 (1.57–1.81) | <0.001 | |
| mUICC staging | <0.001 | ||||||
| Stage I | 2626 | 527 (20.1%) | 2532 | 1058 (41.8%) | 2.13 (1.91–2.36) | <0.001 | |
| Stage II | 6176 | 1991 (32.2%) | 6168 | 3273 (53.1%) | 1.65 (1.56–1.74) | <0.001 | |
| Stage III | 4712 | 2954 (62.7%) | 4147 | 3267 (78.8%) | 1.29 (1.23–1.36) | <0.001 | |
| Stage IVA | 1291 | 1100 (85.2%) | 1920 | 1807 (94.1%) | 1.32 (1.23–1.42) | <0.001 | |
| Stage IVB | 850 | 744 (87.5%) | 1627 | 1586 (97.5%) | 1.34 (1.23–1.46) | <0.001 | |
| Child-Pugh class | <0.001 | ||||||
| Class A | 12,126 | 4738 (39.1%) | 11,476 | 6717 (58.5%) | 1.55 (1.49–1.61) | <0.001 | |
| Class B | 2904 | 2156 (74.2%) | 3469 | 3039 (87.6%) | 1.26 (1.19–1.33) | <0.001 | |
| Class C | 510 | 391 (76.7%) | 747 | 686 (91.8%) | 1.53 (1.35–1.73) | <0.001 | |
| Type of initial treatment | <0.001 | ||||||
| Curativec | 6586 | 1523 (23.1%) | 5282 | 1945 (36.8%) | 1.58 (1.47–1.67) | <0.001 | |
| Non-curatived | 7626 | 4533 (59.4%) | 8070 | 6222 (77.1%) | 1.27 (1.22–1.32) | <0.001 | |
| Best supportive care | 1443 | 1260 (87.3%) | 3091 | 2868 (92.8%) | 0.75 (0.70–0.80) | <0.001 | |
Notes: aMissing data was imputed. bCrude hazard ratio for multicenter vs single-center cohort. cCurative treatment was defined as surgical resection, liver transplantation, and local ablation therapy. dNon-curative treatment was defined as TACE/TARE, radiotherapy, and systemic therapy.
Abbreviations: CI, confidence interval; HR, hazard ratio; mUICC, modified Union for International Cancer Control.
Discussion
In this outcome-comparison study, we found that the single-center cohort (AMC group) was generally associated with significantly higher OS than the multicenter cohort (KPLCR group); moreover, these results were consistent after PS matching and across treatment modalities except for systemic therapy and best supportive care (Supplementary Table 9).
These findings are noteworthy because, to the best of our knowledge, this is the first study to compare the OS of all-staged HCC patients in a retrospective cohort setting using two large cohorts, comprised of a nationwide multicenter cohort and a single-center cohort. The retrospective design reflects real-life clinical practice in HCC patients with heterogeneous tumor features and variable prognoses, whereas this may be limited in RCTs as they involve highly-selected patient populations enrolled under strict eligibility criteria.5 The differences observed between the two cohorts in OS are consistent with the findings of past studies that have compared the treatment outcomes of single-center and multicenter RCTs. These earlier studies showed that single-center RCTs produced larger treatment effects than multicenter RCTs,9,10,26 and a review article has also highlighted the limited external validity of single-center RCTs by noting many instances in intensive care medicine in which the positive treatment outcomes found in single-center studies were not confirmed in multicenter RCTs.8 However, the validity of retrospective studies of single-center cohorts has not been examined despite its clinical significance.
The higher OS observed above for systemic therapy and best supportive care in the multicenter cohort compared to the single-center cohort may be attributed to a center effect: in a previous study, patients who visited tertiary hospitals tended to receive more chemotherapy than patients who visited hospitals of secondary or primary levels.27 In the tertiary hospital chosen as the single center in our investigation, a greater proportion of patients with unpreserved liver function received systemic treatment or best supportive care than in the multicenter series. As the survival of HCC patients is primarily dependent on baseline liver function,5 one might anticipate that clinical outcomes would be less favorable in the single-center cohort in patients with on average poorer liver function receiving systemic therapy and best supportive care.
On the other hand, the association of the single-center cohort with better survival outcomes for both surgical and loco-regional treatment modalities is likely to be related to the use of relatively homogeneous indications and the provision of standardized interventions by teams of high expertise in high volume single-centers.10,26,28 In addition, treatment outcomes obtained at different centers with varying treatment strategies and levels of experience, especially for difficult-to-treat cases, may not directly reflect the setting of any particular center-favorable outcomes in large centers, and therefore may be overshadowed by the inclusion of a number of small volume centers with higher mortality in the multicenter series.29,30 This may apply especially to HCC, as patients of the same stage can be treated differently due to individual tumor features as well as the variety of available or feasible treatment modalities, specific indications, and levels of skill among the different healthcare centers.5
Due to this heterogeneity, we established subcohorts to additionally compare the survival outcomes of treatments administered strictly according to the BCLC algorithm and the Milan criteria. These gave variable results; while there were no differences in OS between the two subcohorts for surgically and systemically-treated patients with favorable liver function as well as transplant patients with any level of liver function, the multicenter cohort was associated with a significantly higher risk of mortality in patients who were locally treated with TACE or LAT as a standard option. The absence of a difference between patients who received liver transplants may be explained by the evidence that postoperative survival is not associated with transplant center volume, but is more likely attributable to other factors including donor age and patient characteristics such as age and MELD score.31 Similarly, there was no significant difference in OS following surgical resection among Child-Pugh class A patients, as in studies that found no association between center type or volume and OS after surgical treatment of various cancers.32–34 Surgical resection in most cases results in complete removal of the neoplasm,35 making it an effective choice of curative treatment in patients who satisfy the indications. Also, advances in surgical techniques and perioperative management may have decreased the gap in treatment outcomes between centers, at least for cases with preserved function.36 Survival outcomes of systemic therapy also did not differ between the two subcohorts with good hepatic function as opposed to other malignancies.37,38 The lack of difference in survival outcomes for systemic therapy was probably related to the period when the study was performed: until 2018, sorafenib was the only approved treatment option for advanced HCC and it had only a modest survival benefit.39 As numerous anticancer drugs for HCC have been approved since 2018,40–42 we believe that further studies are required to examine this interpretation.
The survival outcomes of TACE and LAT were, however, significantly different in the Child-Pugh class A subset: the multicenter cohort was associated with a higher risk of mortality than the single-center cohort, similar to the outcomes observed between the entire cohorts. This finding may be attributable to the specialized nature of these modalities and hence the influence that the interventional radiologists’ skill and experience have upon the risk of recurrence as well as the post-procedural morbidity and mortality.43–45 Previous studies have shown that differences in skill have a greater impact on the efficacy of non-pharmacologic interventions than pharmacologic ones, as the level of expertise of care providers plays a more significant role in the former.46–48 This may also explain why we detected significant differences in OS between the two cohorts in patients who received TACE or LAT, but not in those who received systemic therapy.
This study has potential limitations, which are mostly inherent in the retrospective nature of the study and the nature of the corresponding data sources. The variables reported, especially in the nationwide data, lacked some details such as family history of cancer, smoking status, and specific grade of performance. Additionally, data on disease recurrence and specific cause of death were unavailable and as a result, the impact of disease recurrence and subsequent treatment on OS could not be assessed. Because recurrence or progression is common in HCC, progression-free survival might provide additional information regarding comparative treatment outcomes.49 Completeness of the datasets was another issue, but we treated unavailable data in two ways to deal with that issue. We included the results of analyses performed with missing data classified both as a category and with the missing data substituted by multiple imputation, and we showed that the results obtained with the two methods did not differ significantly. Another possible limitation may be selection bias. The single-center cohort included a significantly higher proportion of early-stage patients according to BCLC staging (BCLC stage 0 or A) than the multicenter cohort. Consequently, the frequency of curative treatment as initial modality was higher, and the frequency of best supportive care lower in the single-center cohort than in the multicenter cohort. However, adjustment for these confounding variables, using both multivariable analysis and PS matching, yielded similar outcomes, which supports the consistency of our study findings. Additionally, while there is an overlap of approximately 14–15% of patients between the KPLCR cohort and the AMC HCC registry, this should not significantly impact our findings as patients in the KPLCR cohort were sampled from 54 diverse hospitals. This sampling strategy employed a probability-proportional-to-size method along with regional stratification, ensuring a balanced representation across different healthcare settings17 and minimizing the potential bias that might arise from the overlap with the AMC registry. Lastly, the single-center data in our series were recruited from the highest-volume hospital in South Korea, and this could have led to the superior outcomes in terms of several modalities compared to the multicenter data. In general, however, the amount of retrospective HCC data from a low-volume single-center would not be sufficient to provide less bias and adequate statistical power, and so would undermine the purpose of this study.
In conclusion, comparison of OS between the multicenter and single-center cohorts of patients with HCC revealed significant differences according to primary treatment modality possibly due to heterogeneity related to volume-specific center effect and variability in treatment strategies. The prognostic discrepancies between the two retrospective cohorts suggest that retrospective single-center studies should be interpreted with caution, particularly when evaluating HCC treatment outcomes beyond the BCLC criteria, and should involve careful consideration of center volume and patient population. In short, good generalizability of treatment outcomes may still require collaboration between multiple centers.
Acknowledgments
We thank the Korean Liver Cancer Association and the Korea Central Cancer Registry for providing the Korean Primary Liver Cancer Registry dataset for this study.
Funding Statement
This study did not receive any funding or support from any commercial sources. This study was supported by grants from the Basic Science Research Program through the National Research Foundation of Korea (NRF-2022R1A2C3008956 and NRF-2021R1A6A1A03040260), a grant from Asan Institute for Life Sciences, Asan Medical Center (2022IT0013), and a grant from the “Elimination of Cancer Project Fund” of the Asan Cancer Institute of Asan Medical Center, Seoul, Republic of Korea. The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of data; preparation, review, or approval of the manuscript; or in the decision to submit the manuscript for publication.
Statement of Ethics
This study was approved by the Institutional Review Board of the Asan Medical Center (IRB no.:2022-1274) in accordance with the declaration of Helsinki. Due to the retrospective nature of this study, informed consent was waived.
Author Contributions
Ye Rim Kim and Sung Won Chung contributed equally as co-first authors. All authors made a significant contribution to the work reported, whether that is in the conception, study design, execution, acquisition of data, analysis and interpretation, or in all these areas; took part in drafting, revising or critically reviewing the article; gave final approval of the version to be published; have agreed on the journal to which the article has been submitted; and agree to be accountable for all aspects of the work.
Disclosure
No potential conflict of interest relevant to this article was reported.
References
- 1.Velengtas P, Mohr P, Messner DA. Making Informed Decisions: Assessing the Strengths and Weaknesses of Study Designs and Analytic Methods for Comparative Effectiveness Research. National Pharmaceutical Council; 2012. [Google Scholar]
- 2.Galle PR, Forner A, Llovet JM, et al. EASL clinical practice guidelines: management of hepatocellular carcinoma. J Hepatol. 2018;69(1):182–236. [DOI] [PubMed] [Google Scholar]
- 3.Heimbach JK, Kulik LM, Finn RS, et al. AASLD guidelines for the treatment of hepatocellular carcinoma. Hepatology. 2018;67(1):358–380. doi: 10.1002/hep.29086 [DOI] [PubMed] [Google Scholar]
- 4.Park JW. 2022 KLCA-NCC Korea practice guidelines for the management of hepatocellular carcinoma. Clin Mol Hepatol. 2022;28(4):583–705. doi: 10.3350/cmh.2022.0294 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Park JW, Chen M, Colombo M, et al. Global patterns of hepatocellular carcinoma management from diagnosis to death: the BRIDGE Study. Liver Int. 2015;35(9):2155–2166. doi: 10.1111/liv.12818 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Euser AM, Zoccali C, Jager KJ, et al. Cohort studies: prospective versus retrospective. Nephron Clin Pract. 2009;113(3):c214–c217. doi: 10.1159/000235241 [DOI] [PubMed] [Google Scholar]
- 7.Meinart C. Single-center versus multicenter trials. In: Meinart CL, Tonascia S, editors. Clinical Trials: Design, Conduct and Analysis. New York: Oxford University Press; 1986:23–30. [Google Scholar]
- 8.Bellomo R, Warrillow SJ, Reade MC. Why we should be wary of single-center trials. Crit Care Med. 2009;37(12):3114–3119. doi: 10.1097/CCM.0b013e3181bc7bd5 [DOI] [PubMed] [Google Scholar]
- 9.Unverzagt S, Prondzinsky R, Peinemann F. Single-center trials tend to provide larger treatment effects than multicenter trials: a systematic review. J Clin Epidemiol. 2013;66(11):1271–1280. doi: 10.1016/j.jclinepi.2013.05.016 [DOI] [PubMed] [Google Scholar]
- 10.Dechartres A, Boutron I, Trinquart L, et al. Single-center trials show larger treatment effects than multicenter trials: evidence from a meta-epidemiologic study. Ann Internal Med. 2011;155(1):39–51. doi: 10.7326/0003-4819-155-1-201107050-00006 [DOI] [PubMed] [Google Scholar]
- 11.Drakulovic MB, Torres A, Bauer TT, et al. Supine body position as a risk factor for nosocomial pneumonia in mechanically ventilated patients: a randomised trial. Lancet. 1999;354(9193):1851–1858. doi: 10.1016/S0140-6736(98)12251-1 [DOI] [PubMed] [Google Scholar]
- 12.van Nieuwenhoven CA, Vandenbroucke-Grauls C, van Tiel FH, et al. Feasibility and effects of the semirecumbent position to prevent ventilator-associated pneumonia: a randomized study. Crit Care Med. 2006;34(2):396–402. doi: 10.1097/01.CCM.0000198529.76602.5E [DOI] [PubMed] [Google Scholar]
- 13.Kim H-S, Lee S, Kim JH. Real-world evidence versus randomized controlled trial: clinical research based on electronic medical records. J Korean Med Sci. 2018;33(34). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Goh MJ, Sinn DH, Kim JM, et al. Clinical practice guideline and real-life practice in hepatocellular carcinoma: a Korean perspective. Clin Mol Hepatol. 2023;29(2):197. doi: 10.3350/cmh.2022.0404 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Harris PA, Taylor R, Minor BL, et al. The REDCap consortium: building an international community of software platform partners. J biomed informat. 2019;95:103208. doi: 10.1016/j.jbi.2019.103208 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Jin S, Choi W-M, Shim JH, et al. Subclassification of advanced-stage hepatocellular carcinoma with macrovascular invasion: combined transarterial chemoembolization and radiotherapy as an alternative first-line treatment. J Liver Cancer. 2023;23(1):177–188. doi: 10.17998/jlc.2023.03.04 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Chon YE, Lee HA, Yoon JS, et al. Hepatocellular carcinoma in Korea between 2012 and 2014: an analysis of data from the Korean nationwide cancer registry. J Liver Cancer. 2020;20(2):135–147. doi: 10.17998/jlc.20.2.135 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Reig M, Forner A, Rimola J, et al. BCLC strategy for prognosis prediction and treatment recommendation: the 2022 update. J Hepatol. 2022;76(3):681–693. doi: 10.1016/j.jhep.2021.11.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Kudo M, Kitano M, Sakurai T, et al. General rules for the clinical and pathological study of primary liver cancer, nationwide follow-up survey and clinical practice guidelines: the outstanding achievements of the liver cancer study group of Japan. Dig Dis. 2015;33(6):765–770. doi: 10.1159/000439101 [DOI] [PubMed] [Google Scholar]
- 20.Cho Y, Choi JW, Kwon H, et al. Transarterial chemoembolization for hepatocellular carcinoma: 2023 expert consensus-based practical recommendations of the Korean liver cancer association. Korean J Radiol. 2023;24(7):606. doi: 10.3348/kjr.2023.0385 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Gavriilidis P, Roberts KJ, Askari A, et al. Evaluation of the current guidelines for resection of hepatocellular carcinoma using the appraisal of guidelines for research and evaluation II instrument. J Hepatol. 2017;67(5):991–998. doi: 10.1016/j.jhep.2017.06.028 [DOI] [PubMed] [Google Scholar]
- 22.Park MK, Kim YJ. What should be done to reduce the discrepancy between guidelines and real-life practice for hepatocellular carcinoma in Korea? Clin Mol Hepatol. 2023;29(2):332. doi: 10.3350/cmh.2023.0080 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Cho Y, Kim BH, Park J-W. Overview of Asian clinical practice guidelines for the management of hepatocellular carcinoma: an Asian perspective comparison. Clin Mol Hepatol. 2023;29(2):252. doi: 10.3350/cmh.2023.0099 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Rubin DB. Multiple Imputation for Nonresponse in Surveys. John Wiley & Sons; 2004. [Google Scholar]
- 25.Lunt M. Selecting an appropriate caliper can be essential for achieving good balance with propensity score matching. Am J Epidemiol. 2014;179(2):226–235. doi: 10.1093/aje/kwt212 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Bafeta A, Dechartres A, Trinquart L, et al. Impact of single centre status on estimates of intervention effects in trials with continuous outcomes: meta-epidemiological study. BMJ. 2012;344(feb14 1):e813–e813. doi: 10.1136/bmj.e813 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Rochigneux P, Raoul JL, Beaussant Y, et al. Use of chemotherapy near the end of life: what factors matter? Ann Oncol. 2017;28(4):809–817. doi: 10.1093/annonc/mdw654 [DOI] [PubMed] [Google Scholar]
- 28.Samaga D, Hornung R, Braselmann H, et al. Single-center versus multi-center data sets for molecular prognostic modeling: a simulation study. Radiat Oncol. 2020;15(1):1–14. doi: 10.1186/s13014-020-01543-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.McCarthy JF, McCarthy PM, Massad MG, et al. Risk factors for death after heart transplantation: does a single-center experience correlate with multicenter registries? Ann Thorac Surg. 1998;65(6):1574–1578. doi: 10.1016/S0003-4975(98)00138-6 [DOI] [PubMed] [Google Scholar]
- 30.Senn SJ, Lewis RJ. Treatment effects in multicenter randomized clinical trials. JAMA. 2019;321(12):1211–1212. doi: 10.1001/jama.2019.1480 [DOI] [PubMed] [Google Scholar]
- 31.Northup P, Pruett TL, Stukenborg GJ, et al. Survival after adult liver transplantation does not correlate with transplant center case volume in the MELD era. Am J Transplant. 2006;6(10):2455–2462. doi: 10.1111/j.1600-6143.2006.01501.x [DOI] [PubMed] [Google Scholar]
- 32.Berger NG, Silva JP, Mogal H, et al. Overall survival after resection of retroperitoneal sarcoma at academic cancer centers versus community cancer centers: an analysis of the national cancer data base. Surgery. 2018;163(2):318–323. doi: 10.1016/j.surg.2017.07.009 [DOI] [PubMed] [Google Scholar]
- 33.Meyerhardt JA, Tepper JE, Niedzwiecki D, et al. Impact of hospital procedure volume on surgical operation and long-term outcomes in high-risk curatively resected rectal cancer: findings from the Intergroup 0114 Study. J Clin Oncol. 2004;22(1):166–174. doi: 10.1200/JCO.2004.04.172 [DOI] [PubMed] [Google Scholar]
- 34.Kozower BD, Stukenborg GJ. Hospital esophageal cancer resection volume does not predict patient mortality risk. Ann Thorac Surg. 2012;93(5):1690–1698. doi: 10.1016/j.athoracsur.2012.01.111 [DOI] [PubMed] [Google Scholar]
- 35.Ferrari FS, Stella A, Pasquinucci P, et al. Treatment of small hepatocellular carcinoma: a comparison of techniques and long-term results. Eur J Gastroenterol Hepatol. 2006;18(6):659–672. doi: 10.1097/00042737-200606000-00014 [DOI] [PubMed] [Google Scholar]
- 36.Do You D, Kim DG, Seo CH, et al. Prognostic factors after curative resection hepatocellular carcinoma and the surgeon’s role. Ann Surg Treat Res. 2017;93(5):252–259. doi: 10.4174/astr.2017.93.5.252 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Haj Mohammad N, Bernards N, Besselink MGH, et al. Volume matters in the systemic treatment of metastatic pancreatic cancer: a population-based study in the Netherlands. J Cancer Res Clin Oncol. 2016;142(6):1353–1360. doi: 10.1007/s00432-016-2140-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Malik AT, Alexander JH, Khan SN, et al. Is treatment at a high-volume center associated with an improved survival for primary malignant bone tumors? Clin Orthop Relat Res. 2020;478(3):631–642. doi: 10.1097/CORR.0000000000001034 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Llovet JM, Ricci S, Mazzaferro V, et al. Sorafenib in Advanced Hepatocellular Carcinoma. N Engl J Med. 2008;359(4):378–390. doi: 10.1056/NEJMoa0708857 [DOI] [PubMed] [Google Scholar]
- 40.Bruix J, Qin S, Merle P, et al. Regorafenib for patients with hepatocellular carcinoma who progressed on sorafenib treatment (RESORCE): a randomised, double-blind, placebo-controlled, Phase 3 trial. Lancet. 2017;389(10064):56–66. doi: 10.1016/S0140-6736(16)32453-9 [DOI] [PubMed] [Google Scholar]
- 41.Finn RS, Qin S, Ikeda M, et al. Atezolizumab plus bevacizumab in unresectable hepatocellular carcinoma. N Engl J Med. 2020;382(20):1894–1905. doi: 10.1056/NEJMoa1915745 [DOI] [PubMed] [Google Scholar]
- 42.Sankar K, Gong J, Osipov A, et al. Recent advances in the management of hepatocellular carcinoma. Clin Mol Hepatol. 2024;30(1):1. doi: 10.3350/cmh.2023.0125 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Lee T-Y, Lin J-T, Ho HJ, et al. Evaluation of the effect of cumulative operator experience on hepatocellular carcinoma recurrence after primary treatment with radiofrequency ablation. Radiology. 2015;276(1):294–301. doi: 10.1148/radiol.15141864 [DOI] [PubMed] [Google Scholar]
- 44.Poon RT, Ng KK, Lam CM, et al. Learning curve for radiofrequency ablation of liver tumors: prospective analysis of initial 100 patients in a tertiary institution. Ann Surg. 2004;239(4):441. doi: 10.1097/01.sla.0000118565.21298.0a [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Raoul J-L, Sangro B, Forner A, et al. Evolving strategies for the management of intermediate-stage hepatocellular carcinoma: available evidence and expert opinion on the use of transarterial chemoembolization. Cancer Treat Rev. 2011;37(3):212–220. doi: 10.1016/j.ctrv.2010.07.006 [DOI] [PubMed] [Google Scholar]
- 46.Biau DJ, Halm JA, Ahmadieh H, et al. Provider and center effect in multicenter randomized controlled trials of surgical specialties: an analysis on patient-level data. Ann Surg. 2008;247(5):892–898. doi: 10.1097/SLA.0b013e31816ffa99 [DOI] [PubMed] [Google Scholar]
- 47.Boutron I, Tubach F, Giraudeau B, Ravaud P. Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of Hip and knee osteoarthritis. JAMA. 2003;290(8):1062–1070. doi: 10.1001/jama.290.8.1062 [DOI] [PubMed] [Google Scholar]
- 48.Jo D. The interpretation bias and trap of multicenter clinical research. Korean J Pain. 2020;33(3):199–200. doi: 10.3344/kjp.2020.33.3.199 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Llovet JM, Villanueva A, Marrero JA, et al. Trial design and endpoints in hepatocellular carcinoma: AASLD consensus conference. Hepatology. 2021;73(S1):158–191. doi: 10.1002/hep.31327 [DOI] [PubMed] [Google Scholar]