Abstract
The development and progression of hepatocellular carcinoma (HCC) is accompanied with persistent oxidative stress, but the molecular basis is not well defined. Superoxide dismutase 2 (SOD2) is an important mitochondrial antioxidant and a key aging factor. Here we investigated the expression and clinical significance of SOD2 in a large cohort of HBV-positive HCC tumors. Both SOD2 mRNA and protein are reduced in human primary HCCs compared with matching liver tissues. Consistently, the SOD2 DNA copy numbers are decreased in HCCs, providing a genetic basis for the decrease in SOD2 mRNA expression. Reduced SOD2 expression in HCCs is correlated with older age, larger tumor size, multiple tumor nodules and tumor emboli, and cancer recurrence. Moreover, low SOD2 expression is strongly associated with poor overall survival (OS) and recurrence-free survival (RFS). Univariate and multivariate Cox regression analyses indicates that SOD2 is an independent prognostic predictor for OS and RFS. Intriguingly, reduced SOD2 mRNA is strongly associated with poor survival in a separate cohort of HCC patients carrying mutant p53. Altogether, our results provide clinical evidence for the importance of SOD2 in tumor progression and mortality, and the close relationship of SOD2 and p53 in HCC.
Keywords: Superoxide Dismutase 2 (SOD2), Reactive Oxygen Species (ROS), liver, Hepatocellular Carcinoma (HCC), cancer
INTRODUCTION
Reactive oxygen species (ROS) are oxygen-containing free radicals and reactive molecules such as superoxide (O2−), hydroxyl (OH−) and hydrogen peroxide (H2O2) [1]. ROS is generated during mitochondrial respiration and in enzyme-catalyzed reactions [2]. Mitochondrial respiration is a main source of ROS due to production of superoxide anion from Complex I and III of the electron transport chain, estimated at 1-2% oxygen consumed by the cell [3]. Superoxide anion is further converted into other ROS species such as hydroxyl free radical and hydrogen peroxide. ROS also plays an important regulatory role in many cellular activities such as metabolism and signal transduction [4, 5]. For example, H2O2 regulates protein tyrosine and lipid phosphatases, thereby dictating the signal transduction strength by receptor tyrosine kinases [6, 7]. However, under pathological conditions, ROS can reach excessively high levels, which is a major cause of aging and aging-related diseases such as Alzheimer's disease and cancer [8-10].
Because of the importance of ROS in normal physiology and diseases, eukaryotic cells have developed a sophisticated antioxidant network to maintain redox homeostasis. The superoxide dismutases (SOD), catalases, thioredoxin and glutathione are key antioxidant enzymes that remove ROS from the cellular environment. SOD is a family of evolutionarily conserved enzymes that dismutate superoxide free radicals. In mammals, SOD family has three distinct members: SOD1 or the copper/zinc SOD, SOD2 or the manganese SOD and SOD3 or the extracellular SOD [11, 12]. SOD1 is the major type of SOD that is found in the cytoplasm, nucleus and mitochondrial inter-membrane space [13, 14]. SOD2 is only localized in the mitochondrial matrix [15] where it is associated with mtDNA and thought to prevent oxidization of mtDNA and mtDNA polymerase from being oxidized [16]. Mutations of SOD2 have been shown to alter lifespan in a variety of model organisms such as C. elegance and Drosophila [17, 18]. SOD2 level and activity may contribute to metabolic reprogramming in response to nutrient and stressful conditions [19]. Homozygous SOD2 knockout mice die shortly after birth [20], while heterozygous SOD1 knockout mice exhibit elevated mitochondrial oxidative stress and age-dependent decline of mitochondrial function [21].
Liver cancer is one of the most prevalent and deadly human malignancies [22, 23]. Hepatocellular Carcinoma (HCC), the predominant type of liver cancer, accounts for about 85% of total liver cancer cases [24]. Hepatic resection is the main curative treatment for early stage diseases. Unfortunately, patients after hepatectomy still have a high rate of distant metastasis and inhepatic relapse, with approximately 50% chance of 5-years recurrence. Therefore, it is important to identify molecular markers to predict disease recurrence and prognosis. Due to the important role of SOD1 in mitochondrial function and integrity, it is not surprisingly that SOD2 has been linked to tumorigenesis [11, 12]. SOD2 expression was found to be down in breast [19], esophageal [25], and pancreatic cancer [26], but up in ovarian [27], gastric [28] and colorectal cancer [29]. Thus the role of SOD2 appears to be tumor-suppressive or -promoting, dependent on tissue types and/or disease stages. Mitochondria play crucial roles in the normal physiological functions and pathogenesis of the liver [30]. Despite the importance of SOD2 in mitochondria, to date, SOD2 has not been studied in liver cancer. This study was aimed to determine the expression and clinical significance of SOD2 in HCC.
RESULTS
SOD2 expression is reduced in human HCC
Altered SOD2 level has been reported in several cancer types, but the pattern is complex with down-regulation in some tumors but up-regulation in others. Thus far, SOD2 expression has not been investigated in HCC. Given the importance of SOD2 in mitochondrial integrity and liver biology, we investigated SOD2 expression in HCC. To this end, SOD2 mRNA level was analyzed in 40 pairs of human primary HCC and matching adjacent non-cancerous liver (NCL) tissues by RT-qPCR. SOD2 mRNA expression was found to be significantly reduced in 30 of 40 tumors, representing 75% of the HCC tissues compared with the NCL tissues (p = 0.001, Fig. 1a and 1b). In tumors with SOD2 down-regulation, SOD2 expression was reduced by as much as 12-fold, with the median decrease nearly 2-fold (Fig. 1b).
To verify this finding, we investigated SOD2 protein expression by immunohistochemistry (IHC) staining of a large cohort of 160 paraffin-fixed human primary HCC tumors and matching adjacent NCL tissues. Based on the study of genomic mRNA expression profiling in different mouse tissues [31], liver is one of the tissues where SOD2 is highly expressed in mice (Fig. S1). Consistently, SOD2 was found to be abundant as indicated by strong IHC staining in most of the NCL tissues (Fig. 2a). However, in tumor tissues, SOD2 protein expression showed considerably variations, ranging from negative, low, moderate to high IHC staining (Fig. 2a). Quantification of SOD2 staining IHC scores confirmed that SOD2 is indeed significantly decreased in HCC tissues as compared with their matched NCL tissues (p < 0.001, Fig. 2b). SOD2 protein expression was found to be largely reduced in 111 of 160 (69%) patients HCC tissues compared with the NCL tissues (p < 0.0001, Fig. 2b and 2c). In these 111 patients' HCC tissues, SOD2 expression was reduced by as much as 30-fold, with the median decrease 1.67-fold (Fig. 2c). Together, these results show that SOD2 expression is reduced at both mRNA and protein level in HCC.
Mechanism of SOD2 down-regulation in HCC
To understand the relationship between SOD2 mRNA and protein expression in HCC, we analyzed a panel of 10 HCC cell lines and an immortalized human hepatocyte cell line by RT-qPCR and Western blotting. Compared with the immortalized hepatocyte cell line MIHA, SOD2 mRNA was found to be lower in 7 of the 10 HCC cell lines (Fig. 3a), and protein level was lower in 8 of 10 HCC cell lines (Fig. 3b and 3c). The mRNA and protein level are largely correlated with each other (Fig. 3d), suggesting that SOD2 mRNA abundance is the primary determinant of SOD2 expression. However, there are some exceptions. Specifically, although SOD2 mRNA in HepG2 cells was higher than MIHA cells, SOD2 protein level was actually lower in HepG2 cells. QSG-7703 showed decreased SOD2 mRNA but not protein compared with MIHA cells. Thus, translational and post-translational mechanisms are likely to be involved in these cases. To understand the mechanism for altered SOD2 mRNA expression, we analyzed SOD2 copy number changes in one cohort of 97 HCC, 59 normal liver and 57 blood samples from the TCGA cancer genomic database (http://cancergenome.nih.gov). There was a pronounced decrease in SOD2 copy number in HCC versus blood and normal liver samples (Fig. 4a). Essentially the same phenomenon was observed with another cohort of 99 HCC and 86 normal liver samples obtained from the Oncomine genomic database (Fig. 4b) [32]. These observations indicate that loss of SOD2 locus is a mechanism for the decrease in SOD2 mRNA expression in HCC.
Loss of SOD2 expression is associated with advanced age and cancer progression in HCC patients
Frequent down-regulation of SOD2 suggests that it plays an important role in HCC pathogenesis. We therefore investigated the relationship between SOD2 expression and clinicopathological features of HCC. Based on the IHC scores, we divided HCC patients into SOD2 high-expression and low-expression subgroups using the median IHC score of 180 as the cutoff value. We then analyzed the correlation between SOD2 expression and 15 widely recognized clinicopathologic parameters in the cohort of 160 HCC specimens (Table 1). Consistent with the established role of SOD2 in aging, chi-square analysis shows that there is a statistically significant correlation between low expression of SOD2 and older patients (≥ 50 y, p = 0.007). Moreover, low expression of SOD2 is associated with multiple primary tumors (p = 0.012), tumor embolus (p = 0.016), tumor recurrence (p = 0.039), and advanced tumor stages as classified by the Primary Tumor, Lymph Nodes and Metastasis (TNM) (p = 0.006), and Barcelona clinic liver cancer (BCLC) (p = 0.001) staging systems. These observations suggest that low SOD2 expression is involved in the progression of HCC.
Table 1. Correlation between the clinicopathological features and SOD2 protein expression.
Features | SOD2 protein expression | |||
---|---|---|---|---|
No. of cases | Low | High | p value | |
Age | ||||
≥ 50 years | 83 | 53 (63.9%) | 30 (36.1%) | 0.007 |
< 50 years | 77 | 32 (41.6%) | 45 (59.4%) | |
Gender | ||||
Female | 18 | 12 (66.7%) | 6 (33.3%) | 0.316 |
Male | 142 | 73 (51.4%) | 69 (48.6%) | |
HBV DNA copy | ||||
≤ 1000 | 58 | 31 (53.4%) | 27 (46.6%) | 0.516 |
> 1000 | 102 | 54 (52.9%) | 48 (47.1%) | |
Serum HBsAg | ||||
Negative | 13 | 6 (46.2%) | 7 (53.8%) | 0.414 |
Positive | 145 | 78 (53.8%) | 67 (46.2%) | |
Serum AFP (ng/ml) | ||||
< 400 | 71 | 32 (45.1%) | 39 (54.9%) | 0.112 |
≥ 400 | 92 | 53 (57.6%) | 39 (43.4%) | |
Liver Cirrhosis | ||||
NO | 63 | 37 (56.9%) | 26 (43.1%) | 0.262 |
YES | 97 | 48 (49.5%) | 49 (50.5%) | |
Tumor Differentiation | ||||
I-II | 92 | 48 (52.2%) | 44 (47.8%) | 0.873 |
III-IV | 68 | 37 (54.4%) | 31 (45.6%) | |
Tumor Size (cm) | ||||
< 5 | 59 | 31 (52.5%) | 28 (47.5%) | 0.520 |
≥5 | 101 | 54 (53.5%) | 47 (46.5%) | |
Tumor Number | ||||
1 | 117 | 55 (47.0%) | 62 (53.0%) | 0.012 |
> 1 | 43 | 30 (69.8%) | 13 (30.2%) | |
Tumor Capsule | ||||
Complete | 128 | 68 (53.1%) | 60 (46.9%) | 0.579 |
Incomplete | 32 | 17 (53.1%) | 15 (46.9%) | |
Tumor Embolus | ||||
No | 135 | 66 (48.9%) | 64 (51.1%) | 0.016 |
Yes | 25 | 19 (76.0%) | 6 (24.0%) | |
Postoperative Metastasis | ||||
No | 151 | 79 (52.3%) | 72 (47.7%) | 0.503 |
Yes | 9 | 6 (66.7%) | 3 (33.3%) | |
Recurrence | ||||
No | 97 | 44 (45.4%) | 53 (54.6%) | 0.039 |
Early (<24 months) | 39 | 24 (65.1%) | 15 (34.9%) | |
Late (≥24 months) | 24 | 17 (45.4%) | 7 (54.6%) | |
TNM Stage | ||||
I-II | 121 | 57 (47.1%) | 64 (52.9%) | 0.006 |
III | 39 | 28 (71.8%) | 11 (28.2%) | |
BCLC Stage | ||||
0-A | 102 | 44 (43.1%) | 58 (56.9%) | 0.001 |
B-C | 58 | 41 (42.5%) | 17 (57.5%) |
Reduced SOD2 expression is significantly correlated with poor prognosis of HCC patients
Because loss of SOD2 is associated with HCC progression, we investigated that whether differential SOD2 expression is linked to the prognosis of HCC patients. To this end, Kaplan-Meier and the log-rank test analysis were used to evaluate the survival of these HCC patients. As shown in Fig. 5a, patients with low SOD2 expression had statistically significant, shorter overall survival (OS) and relapse-free survival (RFS) than those with high SOD1 expression (p = 0.005 and p = 0.004, respectively). The postoperative median OS and RFS times of the entire cohort of 160 HCC patients were 40.87 months and 30.08 months respectively, and for the 75 patients with high SOD2 expression were 50.27 and 46.17 months, respectively. In contrast, the postoperative median OS and RFS times for the 85 cases with low SOD2 expression were 34.1 and 29.03 months, respectively. Furthermore, low SOD2 protein expression correlates with worse prognosis for patients with large tumors (tumor size > 5cm) (Fig. 5b).
Interestingly, low SOD2 expression is also associated with shorter OS and RFS in subgroups of patients characteristic of less advanced disease, including low AFP concentration (< 400 ng/μl) (Fig. 5c), no tumor embolus (Fig. 5d), no liver cirrhosis (Fig. 5e), high differentiation (Grade I+II) (Fig. 5f) and complete tumor capsule (p = 0.035) subgroup, suggesting that SOD2 is involved in the development and progression of HCC during early disease stages. Low SOD2 expression also appears to be associated with poorer prognosis in more advanced disease stages (Fig. S2). However, surgical HCC samples were usually obtained in relatively early disease stages, which limits the sample size and thus statistical significance. Further study will be necessary to elucidate the clinical significance of SOD2 expression in advanced HCC.
SOD2 is an independent prognostic predictor for HCC patients
To investigate the prognostic value of SOD2 protein expression, univariate analysis of SOD2 protein level and clinicopathological features was carried out using the Cox proportional hazard model. The result shows that low SOD2 protein expression (p = 0.005), higher serum AFP (p = 0.002), larger tumor size (p = 0.010), multiple tumors (p < 0.001), tumor embolus (p = 0.004) advanced TNM (p = 0.001) and BCLC stage (p < 0.001) are predictors for poor OS of HCC patients (Table 2). On the other hand, low SOD2, higher Serum AFP, tumor embolus, multiple tumors, advanced TNM, BCLC, and postoperative metastasis were statistically significantly correlated with shorter RFS in HCC patients (Table 2). To determine if SOD2 low expression can be an independent prognostic factor, multivariate Cox regression was further performed on those variables significantly associated with poor survival of HCC patients. The results demonstrate that low SOD2 protein expression is indeed an independent predictor for poor OS (HR = 2.310, 95% CI = 1.031-5.178, p = 0.042) and RFS (HR = 1.809, 95% CI = 1.037-3.156, p = 0.037) in patients with HCC (Table 2), suggesting that SOD2 protein is a useful prognostic biomarker for HCC patients.
Table 2. Univariate and multivariate Cox regression analysis of SOD2 associated with survival and recurrence in patients with HCC.
Univariate analysis | Multivariate analysis | |||||
---|---|---|---|---|---|---|
Variables | HR | 95% CI | p value | HR | 95% CI | p value |
Overall Survival | ||||||
SOD2 Expression (low vs. high) | 2.036 | 1.024-4.427 | 0.038 | 1.774 | 1.167-3.570 | 0.042 |
Gender (Male vs. Female) | 0.643 | 0.269-1.539 | 0.321 | |||
Age (≥ 50y vs. < 50y) | 0.817 | 0.431-1.551 | 0.537 | |||
HBV DNA copy (≥ 1000 vs. < 1000) | 0.924 | 0.473-1.808 | 0.818 | |||
Serum HBsAg (positive vs. negative) | 0.720 | 0.255-2.030 | 0.534 | |||
Serum AFP (≥ 400 vs. < 400 ng/ml) | 2.556 | 1.348-4.845 | 0.004 | 2.328 | 1.097-4.943 | 0.016 |
Liver Cirrhosis (yes vs. no) | 0.863 | 0.455-1.636 | 0.651 | |||
Tumor Differentiation (I—II vs. III—IV) | 0.799 | 0.413-1.546 | 0.506 | |||
Tumor Size (≥ 5 cm vs. < 5 cm) | 2.161 | 1.049-4.364 | 0.037 | |||
Tumor Number (> 1 vs. 1) | 2.530 | 1.316-4.861 | 0.005 | 2.144 | 1.101-4.175 | 0.025 |
Tumor Embolus (yes vs. no) | 2.653 | 1.185-5.940 | 0.018 | |||
Tumor Capsule (yes vs. no) | 1.301 | 0.592-2.858 | 0.513 | |||
TNM Stage (I-II vs. III) | 3.276 | 1.703-6.303 | < 0.001 | |||
BCLC Stage (0-A vs. B-C) | 3.701 | 1.919-7.139 | < 0.001 | |||
Postoperative Metastasis (yes vs. no) | 1.930 | 0.683-5.452 | 0.214 | |||
RECURRENCE-FREE SURVIVAL | ||||||
SOD2 Expression (low vs. high) | 2.429 | 1.200-4.919 | 0.017 | 1.704 | 1.003-2.894 | 0.029 |
Gender (Male vs. Female) | 0.860 | 0.409-1.807 | 0.690 | |||
Age (≥ 50y vs. < 50y) | 1.429 | 0.749-2.727 | 0.279 | |||
HBV DNA copy (≥ 1000 vs. < 1000) | 0.510 | 0.241-1.078 | 0.078 | |||
Serum HBsAg (positive vs. negative) | 1.344 | 0.487-3.705 | 0.568 | |||
Serum AFP (≥ 400 vs. < 400 ng/ml) | 1.911 | 1.147-3.184 | 0.013 | |||
Tumor Differentiation (I-II vs. III-IV) | 0.271 | 0.119-0.618 | 0.002 | 0.240 | 0.104-0.554 | 0.008 |
Tumor Size (≥ 5 cm vs. < 5 cm) | 1.496 | 0.762-2.939 | 0.242 | |||
Tumor Number (> 1 vs. 1) | 3.055 | 1.588-5.877 | 0.001 | 2.737 | 1.411-5.309 | 0.001 |
Tumor Embolus (yes vs. no) | 1.015 | 0.354-2.905 | 0.979 | |||
Tumor Capsule (yes vs. no) | 1.090 | 0.476-2.498 | 0.838 | |||
TNM Stage (I-II vs. III) | 2.745 | 1392-5.411 | 0.004 | |||
BCLC Stage (0-A vs. B-C) | 2.605 | 1.358-4.998 | 0.004 | |||
Postoperative Metastasis (yes vs. no) | 2.784 | 1.081-7.170 | 0.032 | 2.887 | 1.104-7.547 | 0.031 |
Increased mortality of HCC patients with low SOD2 expression is p53-dependent
The tumor-suppressor p53 plays an important role in oxidative stress response. It has been shown that SOD2 is a p53 target gene at the transcriptional level: p53 normally binds to SOD2 promoter and represses SOD2 transcription [33], but activates SOD2 expression during oxidative stress [34]. Because TP53 is frequently mutated in liver cancer, we investigated the relationship between TP53 mutations and SOD2 expression in the survival of HCC patients using genomic and clinical data from cBioPortal for Cancer Genomics (http://www.cbioportal.org). HCC patients were divided into the SOD2 high expression and low expression subgroups using the median SOD2 mRNA value of 12645.314 as the cutoff. Kaplan-Meier and the log-rank test analysis showed that differential SOD2 mRNA expression is not statistically significantly correlated with patient survival in this cohort of HCC patients (Fig. 6a). We therefore further divided HCC patients into wild type and mutant TP53 subgroups. Strikingly, low SOD2 mRNA expression is associated with much shorter OS (p < 0.034) and RFS (p < 0.028) in HCC patients carrying the mutant TP53, but not the wild type TP53 (Fig. 6b). These results suggest that low SOD2 expression alters the mortality of this HCC patient population in a p53-dependent manner.
DISCUSSION
In this study, we demonstrate that the SOD2 mRNA expression, protein expression and DNA copy number are significantly decreased in HCC tissues compared with the matched NCL tissues. Consistently, mRNA and protein expression of SOD2 in HCC cell lines is also markedly down-regulated, indicating that down-regulation of SOD2 is a common feature of HCC. Compared with matching liver and blood samples, there is also a pronounced loss of SOD2 copy number in the liver cancer tissues. Thus deletion of the SOD2 DNA locus is likely to be responsible for the reduced SOD2 transcription in HCC. The decrease in SOD2 mRNA is generally well correlated with reduced SOD2 protein expression. However, in HepG2 cells, SOD2 protein level is low despite of high SOD2 transcripts, indicating that post-transcriptional mechanism such as ubiquitin-mediated degradation [35] is involved.
Oxidative stress due to elevated ROS level, especially in the mitochondria, has been shown to play an important role in hepatocarcinogenesis [36-38]. As an important mitochondrial antioxidant enzyme, SOD2 has been shown to play a key role in mitochondrial function and integrity. Not surprisingly, SOD2 is increasingly recognized for its role in tumorigenesis. However, the expression of SOD2 in malignancies of different tissue origin varies significantly, from down-regulation in esophageal, pancreatic and breast cancer, to elevated level in ovarian, gastric and colorectal cancer. These observations indicate that the role of SOD2 is highly complex, which may act as a tumor suppressor or an oncogene, dependent on tumor tissue origin and/or disease stages. Homozygous SOD2 knockout mice is embryonic lethal [20], making it difficult to study the role of SOD2 deficiency in tumorigenesis in mice. SOD2+/−Gpx1−/−mice has increased incidents of tumorigenesis, but the tumors are primarily lymphoma and to a lesser degree lung adenocarcinoma [39]. The availability of large cohorts of primary human HCC tissue samples and genomic data provide extraordinary opportunity to understand the potential role of SOD2 expression in hepatocarcinogenesis. In this study, we show that SOD2 expression is commonly reduced in HCC, suggesting that it primarily has a tumor suppressive function in liver tumorigenesis.
It has been shown that SOD2+/−Gpx1−/− mice develop lymphoma and lung adenocarcinomas in advanced age [39]. In agreement with SOD2 as a key aging factor, we found that reduced SOD2 protein expression in HCC is significantly associated with Chinese HCC patients in the older age group (> 50 year). Moreover, down-regulation of SOD2 protein expression is correlated with multiple tumors, tumor embolus, cancer recurrence, and more advanced tumor stages as defined by the TNM and BCLC staging systems. Kaplan-Meier analysis indicates the HCC patients with low SOD2 expression have a worse OS and RFS. Multivariate Cox regression analysis further shows that SOD2 protein level is an independent predictor for prognosis. These clinical data suggest that SOD2 has a tumor suppressive function in HCC tumorigenesis and progression and that SOD2 protein expression is a potentially useful prognostic biomarker in this patient population.
p53 is an important aging factor that controls cellular senescence [40, 41]. p53 regulates mitochondrial functions [42, 43] and redox homeostasis in part through the control of SOD2 expression [33, 34]. p53 is an important tumor suppressor in human cancer and TP53 is estimated to be mutated in 30-50% of human liver cancer according to the cBioPortal (http://www.cbioportal.org). We have analyzed of the genomic data available for a total of 312 HCC patients in the TCGA cancer genomic database. Differential SOD2 mRNA expression was found to be not statistically significant correlated with survival, which is in contrast to the data for the cohort of Chinese HCC patients that shows low SOD2 protein level is associated with higher mortality rate. A possible explanation for the difference is etiology of HCC in the two different cohorts. While virtually all of the Chinese patients are HBV-positive, the TCGA patients are largely HBV-negative. The different etiology may explain the influence on mortality by SOD2. Another key difference is that the two studies used SOD2 protein and mRNA expression, respectively, as measuring metrics. Further comprehensive comparative study is necessary to fully understand the role of SOD2 in the disease development, progression and prognosis of HCC patients with distinct etiology. In the TCGA data, HCC patients with SOD2 low mRNA expression is significantly associated with much shorter OS (p < 0.034) and RFS (p < 0.028) in HCCs with mutant TP53 than those with wild type TP53. Further study the relationship between p53 and SOD2 could lead to insights into the pathogenesis of liver cancer and may lead to new approaches to HCC prevention and therapy.
MATERIALS AND METHODS
Clinical specimens and cell lines
Formalin-fied paraffin-embedded (FFPE) HCC and matchingnon-cancerous liver (NCL)tissues from 160 patients with primary HCC, who underwent curative hepatectomy from January 2004 to August 2012, were collected from the Department of pathology of the Sun Yat-sen University Cancer Center, Guangzhou, China. The detailed clinicopathological features of patients are summarized in Table 1 and Table S1. The criteria of the 7th Edition tumor-node-metastasis (TNM) classification of the American Joint Committee on Cancer Staging [44] and the Barcelona Clinic Liver Cancer (BCLC) staging system [45] were used to determine the clinical stages. The cases were followed up regularly since the date of primary liver resection and the median follow-up time was 40.7 months. Overall survival (OS) was defined as the interval elapsed between the date of primary liver resection and the date of HCC-associated death or last follow-up. Recurrence-free survival (RFS) was calculated from the date of primary liver resection to the date of HCC-associated death, relapse, metastasis, or last follow-up. In addition, another 40 pairs of frozen HCC and matched NCL tissues were used for mRNA expression analysis. All the paired tissues were confirmed histologically by two pathologists of this cancer center. Written informed consent was obtained from all patients for this research. This study was approved by the Institutional Review Board and Human Ethics Committee of Sun Yat-Sen University Cancer Center prior to the study.
Human HCC cell line BEL-7402 is maintained in RPMI-1640 medium (Gibco, Carlsbad, CA) supplemented with 10% FBS. Human HCC cell lines CRL-8024, HEP-3B, HEP-G2, HUH-7, MHCC-97H, MHCC-97L, QSG-7703, SK-HEP-1 and SMMC-7721, and the immortalized human hepatocyte cell line MIHA, were cultured in DMEM (Life Technologies, Inc.) with supplemental 10% FBS. All cell lines were incubated at 37°C with 5% CO2.
RNA extraction and RT-qPCR
Total RNA was extracted from the aforementioned cell lines and snap-frozen HCC/NCL tissues using the TRIzol reagent (Invitrogen, 15596-018, USA) according to the manufacturer's instruction. Two-step RT-qPCR was performed to assess the mRNA level of SOD2 as previously described [46]. First strand cDNA was synthesized by GoScript™ reverse transcriptas and random primers (Promega, A5001, Madison, WI, USA). cDNA was quantified in triplicate by GoTaq® qPCR Master Mix (Promega, A6001, Madison, WI, USA) on Roche LightCycler480(Roche, Basel, Switzerland). GAPDH was used as an internal control. Relative SOD2 mRNA expression was presented by 2−ΔΔCT method. Paired primer sequences used for SOD2 are: 5′-GACAAACCTCAGCCCTAACG-3′ (forward) and 5′-GAAACCAAGCCAACCCCAAC-3′ (reverse); for GAPDH: 5′-TGCACCACCAACTGCTTAGC-3′ (forward) and 5′-GGCATGGACTGTGGTCATGAG-3′ (reverse).
Western blotting
Total proteins were extracted from the above-mentioned cell lines and fresh tissues by using a whole cell lysis kit (Keygen, KGP2100, China). The Western blot procedure is as previously described [47]. Briefly, 30 μg of total protein from each sample was separated in 12% SDS-PAGE gel and transferred to PVDF membrane (Millipore, Billerica, MA). After blocking in PBS buffer containing 6% nonfat milk at room temperature for 1 hr, the membrane was incubated with rabbit anti-SOD2 (1:5000, Cat No. ab13533, Abcam, USA) and anti-GAPDH (1:5000, Cat No. 5174, Cell Signaling Technology, USA) primary antibodies at 4°C overnight. After washing with TBS buffer containing 0.1% Triton X-100 for three times, the membrane was then probed with anti-rabbit HRP-conjugated secondary antibodies (dilution for 1:5000, Jackson Immunoresearch Inc, PA, USA) and detected by using the enhanced chemiluminescence substrates (PerkinElmer, MA, USA). GAPDH was used as a loading control. The intensity of immunoblot signals was determined using the Bio-Rad software Quantity One (Bio-Rad Laboratories Inc., Hercules, California, USA).
Immunohistochemistry
Immunohistochemistry (IHC) was performed on 4 μM thick sections that were cut from the FFPE tissue blocks. The sections first were dried in an oven at 60°C for 2 hr, deparaffinized three times with xylene for 10 min each, rehydrated in a graded series of decreased alcohol solutions, washed three times with PBS for 10 min to remove the residual alcohol, immersed in 0.3% H2O2 in methanol to block endogenous peroxidase activity, washed three times with PBS for 10 min each to remove the residual H2O2 and methanol, boiled in 0.01 M sodium citrate buffer (pH 6.0) using a microwave oven for 15 min at low heat to retrieve the antigens, and cooled to room temperature by running water. After incubating in 10% FBS for 30 min to prevent nonspecific staining, the sections were incubated with rabbit anti-SOD2 (1:400, Cat No 13533, Abcam, USA) antibodies at 4°C overnight. In the second day, the tissue sections were rinsed three times with PBST (0.1% Triton-X100 in PBS), labeled with secondary antibody conjugated with horseradish peroxidase (Dako Corp., Carpinteria, CA) for 30 min at 37°C, washed three times with PBS for 10 min each to remove the remaining secondary antibodies, developed with 3, 3′-diaminoben-benzidine (Dako Corp., Carpinteria, CA), counterstained with hematoxylin (Sigma), dehydrated in increased concentration of alcohol, and dried on the air and mounted with neutral resins. All tissue slides were evaluated using the semi-quantitative immunostaining score (ISS) method by two pathologists who were blind to all clinical and biological variables. The score of immunostaining was defined as 0 – 3 (0, negative; 1, weak; 2, moderate; 3, strong). The percentage of positive immunostaining was scored as 0 to 100%, yielding an overall score ranging from 0 to 300 points. The median score was used as a cutoff for classification of patients into high and low expression groups.
Statistical analysis
The SPSS software package for windows (version 17.0; Chicago, IL, USA) was used for all statistical analysis. Paired Student's t test was used to analyze the difference of mRNA and protein expression levels between the paired HCC and NCL tissues. The chi-square test was performed to determine the correlation of SOD2 expression with the patients' clinicopathological features. The Kaplan-Meier method and log-rank test were used to analyze survival of HCC patients. To determine if SOD2 is an independent factor of survival and recurrence, univariate and multivariate survival analyses were performed using the Cox proportional hazards regression model. The two-sided p value less than 0.05 was defined as statistically significant for all statistical analyses.
Analysis of TCGA and Oncomine genomic data
We downloaded and analyzed SOD2 mRNA expression (RNA Seq V2 RSEM) data, the p53 mutant data and the clinical data of the Hepatocellular Carcinoma (TCGA, provisional) from the website cBioPortal (http://www.cbioportal.org/data_sets.jsp) [48, 49]. The SOD2 copy number data of TCGA (http://cancergenome.nih.gov/) and Guichard Liver [32] were downloaded and analyzed from the OncoMine cancer genomic database (https://www.oncomine.org/).
SUPPLEMENTARY DATA FIGURES AND TABLE
Acknowledgments
We thank Jia Hong Wang for the statistical analysis assistance.
Footnotes
Funding
This work was supported by the National Natural Science Foundation of China (No: 81372600, 81572440), the Recruitment Program of Global Experts, the Leading Talent of Guangdong Province, and the Natural Science Foundation of Guangdong Province for Distinguished Young Scholar (No: 2015A030306047), the Research Fund of State Key Laboratory of Oncology in South China.
Authors' contribution
R.W., C.Y. and X.X.L. designed and performed the studies, and prepared the figures and tables; X.Z.Y., Y.Y. and M.Y.Z. provided with technical and statistical assistance. X.F.Z. and H.Y.W. conceived and guided the overall project; W.R., C.Y., X.X.L., H.Y.W. and X.F.Z. wrote and edited the manuscript.
Conflict of interest statement
The authors have no conflict of interests to declare.
REFERENCES
- 1.Landry WD, Cotter TG. ROS signalling, NADPH oxidases and cancer. Biochemical Society transactions. 2014;42:934–938. doi: 10.1042/BST20140060. [DOI] [PubMed] [Google Scholar]
- 2.Dansen TB, Wirtz KW. The peroxisome in oxidative stress. IUBMB life. 2001;51:223–230. doi: 10.1080/152165401753311762. [DOI] [PubMed] [Google Scholar]
- 3.Stowe DF, Camara AKS. Mitochondrial Reactive Oxygen Species Production in Excitable Cells: Modulators of Mitochondrial and Cell Function. Antioxidants & Redox Signaling. 2009;11:1373–1414. doi: 10.1089/ars.2008.2331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.D'Autreaux B, Toledano M. ROS as signalling molecules: mechanisms that generate specificity in ROS homeostasis. Nat Rev Mol Cell Biol. 2007;8:813–824. doi: 10.1038/nrm2256. [DOI] [PubMed] [Google Scholar]
- 5.Finkel T. Signal transduction by reactive oxygen species. The Journal of Cell Biology. 2011;194:7–15. doi: 10.1083/jcb.201102095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Denu JM, Tanner KG. Specific and reversible inactivation of protein tyrosine phosphatases by hydrogen peroxide: evidence for a sulfenic acid intermediate and implications for redox regulation. Biochemistry. 1998;37:5633–5642. doi: 10.1021/bi973035t. [DOI] [PubMed] [Google Scholar]
- 7.Lee S-R, Kwon K-S, Kim S-R, Rhee SG. Reversible Inactivation of Protein-tyrosine Phosphatase 1B in A431 Cells Stimulated with Epidermal Growth Factor. Journal of Biological Chemistry. 1998;273:15366–15372. doi: 10.1074/jbc.273.25.15366. [DOI] [PubMed] [Google Scholar]
- 8.Imlay JA, Chin SM, Linn S. Toxic DNA damage by hydrogen peroxide through the Fenton reaction in vivo and in vitro. Science. 1988;240:640–642. doi: 10.1126/science.2834821. [DOI] [PubMed] [Google Scholar]
- 9.Maynard S, Schurman SH, Harboe C, de Souza-Pinto NC, Bohr VA. Base excision repair of oxidative DNA damage and association with cancer and aging. Carcinogenesis. 2009;30:2–10. doi: 10.1093/carcin/bgn250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Imlay JA. Pathways of oxidative damage. Annual review of microbiology. 2003;57:395–418. doi: 10.1146/annurev.micro.57.030502.090938. [DOI] [PubMed] [Google Scholar]
- 11.Che M, Wang R, Li X, Wang HY, Zheng XF. Expanding roles of superoxide dismutases in cell regulation and cancer. Drug discovery today. 2016;21:143–149. doi: 10.1016/j.drudis.2015.10.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Miao L, St. Clair DK. Regulation of superoxide dismutase genes: Implications in disease. Free Radical Biology and Medicine. 2009;47:344–356. doi: 10.1016/j.freeradbiomed.2009.05.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Sturtz LA, Diekert K, Jensen LT, Lill R, Culotta VC. A Fraction of Yeast Cu,Zn-Superoxide Dismutase and Its Metallochaperone, CCS, Localize to the Intermembrane Space of Mitochondria: A physiological role for SOD1 in guarding against mitochondrial oxidative damage. Journal of Biological Chemistry. 2001;276:38084–38089. doi: 10.1074/jbc.M105296200. [DOI] [PubMed] [Google Scholar]
- 14.Tsang CK, Liu Y, Thomas J, Zhang Y, Zheng XFS. Superoxide dismutase 1 acts as a nuclear transcription factor to regulate oxidative stress resistance. Nat Commun. 2014:5. doi: 10.1038/ncomms4446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Slot JW, Geuze HJ, Freeman BA, Crapo JD. Intracellular localization of the copper-zinc and manganese superoxide dismutases in rat liver parenchymal cells. Lab Invest. 1986;55:363–371. [PubMed] [Google Scholar]
- 16.Kienhöfer J, Häussler DJF, Ruckelshausen F, Muessig E, Weber K, Pimentel D, Ullrich V, Bürkle A, Bachschmid MM. Association of mitochondrial antioxidant enzymes with mitochondrial DNA as integral nucleoid constituents. The FASEB Journal. 2009;23:2034–2044. doi: 10.1096/fj.08-113571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Duttaroy A, Paul A, Kundu M, Belton A. A Sod2 null mutation confers severely reduced adult life span in Drosophila. Genetics. 2003;165:2295–2299. doi: 10.1093/genetics/165.4.2295. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Van Raamsdonk JM, Hekimi S. Deletion of the mitochondrial superoxide dismutase sod-2 extends lifespan in Caenorhabditis elegans. PLoS genetics. 2009;5:e1000361. doi: 10.1371/journal.pgen.1000361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Papa L, Hahn M, Marsh EL, Evans BS, Germain D. SOD2 to SOD1 switch in breast cancer. J Biol Chem. 2014;289:5412–5416. doi: 10.1074/jbc.C113.526475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Li Y, Huang TT, Carlson EJ, Melov S, Ursell PC, Olson JL, Noble LJ, Yoshimura MP, Berger C, Chan PH, Wallace DC, Epstein CJ. Dilated cardiomyopathy and neonatal lethality in mutant mice lacking manganese superoxide dismutase. Nat Genet. 1995;11:376–381. doi: 10.1038/ng1295-376. [DOI] [PubMed] [Google Scholar]
- 21.Kokoszka JE, Coskun P, Esposito LA, Wallace DC. Increased mitochondrial oxidative stress in the Sod2 (+/?) mouse results in the age-related decline of mitochondrial function culminating in increased apoptosis. Proceedings of the National Academy of Sciences. 2001;98:2278–2283. doi: 10.1073/pnas.051627098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Torre LA, Bray F, Siegel RL, Ferlay J, Lortet-Tieulent J, Jemal A. Global cancer statistics, 2012. CA Cancer J Clin. 2015;65:87–108. doi: 10.3322/caac.21262. [DOI] [PubMed] [Google Scholar]
- 23.Chen W, Zheng R, Baade PD, Zhang S, Zeng H, Bray F, Jemal A, Yu XQ, He J. Cancer statistics in China, 2015. CA Cancer J Clin. 2016;66:115–132. doi: 10.3322/caac.21338. [DOI] [PubMed] [Google Scholar]
- 24.Llovet JM, Burroughs A, Bruix J. Hepatocellular carcinoma. Lancet. 2003;362:1907–1917. doi: 10.1016/S0140-6736(03)14964-1. [DOI] [PubMed] [Google Scholar]
- 25.Sun GG, Wang YD, Chen LQ, Wang SJ, Liu GL, Yu XR, Cheng YJ, Liu Q. Novel cancer suppressor gene for esophageal cancer: manganese superoxide dismutase. Diseases of the esophagus : official journal of the International Society for Diseases of the Esophagus / ISDE. 2011;24:346–353. doi: 10.1111/j.1442-2050.2010.01149.x. [DOI] [PubMed] [Google Scholar]
- 26.Cullen JJ, Mitros FA, Oberley LW. Expression of antioxidant enzymes in diseases of the human pancreas: another link between chronic pancreatitis and pancreatic cancer. Pancreas. 2003;26:23–27. doi: 10.1097/00006676-200301000-00005. [DOI] [PubMed] [Google Scholar]
- 27.Hu Y, Rosen DG, Zhou Y, Feng L, Yang G, Liu J, Huang P. Mitochondrial manganese-superoxide dismutase expression in ovarian cancer: role in cell proliferation and response to oxidative stress. J Biol Chem. 2005;280:39485–39492. doi: 10.1074/jbc.M503296200. [DOI] [PubMed] [Google Scholar]
- 28.Izutani R, Kato M, Asano S, Imano M, Ohyanagi H. Expression of manganese superoxide disumutase influences chemosensitivity in esophageal and gastric cancers. Cancer detection and prevention. 2002;26:213–221. doi: 10.1016/s0361-090x(02)00059-4. [DOI] [PubMed] [Google Scholar]
- 29.Govatati S, Malempati S, Saradamma B, Divyamaanasa D, Naidu BP, Bramhachari PV, Narayana N, Shivaji S, Bhanoori M, Tamanam RR, Rao PS, Nallanchakravarthula V. Manganese-superoxide dismutase (Mn-SOD) overexpression is a common event in colorectal cancers with mitochondrial microsatellite instability. Tumour biology : the journal of the International Society for Oncodevelopmental Biology and Medicine. 2016 doi: 10.1007/s13277-016-4918-0. [DOI] [PubMed] [Google Scholar]
- 30.Grattagliano I, Russmann S, Diogo C, Bonfrate L, Oliveira PJ, Wang DQ, Portincasa P. Mitochondria in chronic liver disease. Current drug targets. 2011;12:879–893. doi: 10.2174/138945011795528877. [DOI] [PubMed] [Google Scholar]
- 31.Su AI, Cooke MP, Ching KA, Hakak Y, Walker JR, Wiltshire T, Orth AP, Vega RG, Sapinoso LM, Moqrich A, Patapoutian A, Hampton GM, Schultz PG, et al. Large-scale analysis of the human and mouse transcriptomes. Proc Natl Acad Sci U S A. 2002;99:4465–4470. doi: 10.1073/pnas.012025199. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Guichard C, Amaddeo G, Imbeaud S, Ladeiro Y, Pelletier L, Maad IB, Calderaro J, Bioulac-Sage P, Letexier M, Degos F, Clement B, Balabaud C, Chevet E, et al. Integrated analysis of somatic mutations and focal copy-number changes identifies key genes and pathways in hepatocellular carcinoma. Nature genetics. 2012;44:694–698. doi: 10.1038/ng.2256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Drane P, Bravard A, Bouvard V, May E. Reciprocal down-regulation of p53 and SOD2 gene expression-implication in p53 mediated apoptosis. Oncogene. 2001;20:430–439. doi: 10.1038/sj.onc.1204101. [DOI] [PubMed] [Google Scholar]
- 34.Hussain SP, Amstad P, He P, Robles A, Lupold S, Kaneko I, Ichimiya M, Sengupta S, Mechanic L, Okamura S, Hofseth LJ, Moake M, Nagashima M, et al. p53-induced up-regulation of MnSOD and GPx but not catalase increases oxidative stress and apoptosis. Cancer research. 2004;64:2350–2356. doi: 10.1158/0008-5472.can-2287-2. [DOI] [PubMed] [Google Scholar]
- 35.Kim MS, Ramakrishna S, Lim KH, Kim JH, Baek KH. Protein stability of mitochondrial superoxide dismutase SOD2 is regulated by USP36. Journal of cellular biochemistry. 2011;112:498–508. doi: 10.1002/jcb.22940. [DOI] [PubMed] [Google Scholar]
- 36.Waris G, Huh KW, Siddiqui A. Mitochondrially associated hepatitis B virus X protein constitutively activates transcription factors STAT-3 and NF-kappa B via oxidative stress. Molecular and cellular biology. 2001;21:7721–7730. doi: 10.1128/MCB.21.22.7721-7730.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Gong G, Waris G, Tanveer R, Siddiqui A. Human hepatitis C virus NS5A protein alters intracellular calcium levels, induces oxidative stress, and activates STAT-3 and NF-kappa B. Proceedings of the National Academy of Sciences of the United States of America. 2001;98:9599–9604. doi: 10.1073/pnas.171311298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Hagen TM, Huang S, Curnutte J, Fowler P, Martinez V, Wehr CM, Ames BN, Chisari FV. Extensive oxidative DNA damage in hepatocytes of transgenic mice with chronic active hepatitis destined to develop hepatocellular carcinoma. Proceedings of the National Academy of Sciences of the United States of America. 1994;91:12808–12812. doi: 10.1073/pnas.91.26.12808. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Zhang Y, Ikeno Y, Qi W, Chaudhuri A, Li Y, Bokov A, Thorpe SR, Baynes JW, Epstein C, Richardson A, Van Remmen H. Mice Deficient in Both Mn Superoxide Dismutase and Glutathione Peroxidase-1 Have Increased Oxidative Damage and a Greater Incidence of Pathology but No Reduction in Longevity. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences. 2009;64A:1212–1220. doi: 10.1093/gerona/glp132. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Demidenko ZN, Korotchkina LG, Gudkov AV, Blagosklonny MV. Paradoxical suppression of cellular senescence by p53. Proc Natl Acad Sci U S A. 2010;107:9660–9664. doi: 10.1073/pnas.1002298107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Korotchkina LG, Leontieva OV, Bukreeva EI, Demidenko ZN, Gudkov AV, Blagosklonny MV. The choice between p53-induced senescence and quiescence is determined in part by the mTOR pathway. Aging (Albany NY) 2010;2:344–352. doi: 10.18632/aging.100160. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Qiao C, Lu N, Zhou Y, Ni T, Dai Y, Li Z, Guo Q, Wei L. Oroxylin a modulates mitochondrial function and apoptosis in human colon cancer cells by inducing mitochondrial translocation of wild-type p53. Oncotarget. 2016 doi: 10.18632/oncotarget.7927. Epub ahead of print. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Tavallai M, Booth L, Roberts JL, McGuire WP, Poklepovic A, Dent P. Ruxolitinib synergizes with DMF to kill via BIM+BAD-induced mitochondrial dysfunction and via reduced SOD2/TRX expression and ROS. Oncotarget. 2016 doi: 10.18632/oncotarget.8039. Epub ahead of print. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Asham EH, Kaseb A, Ghobrial RM. Management of hepatocellular carcinoma. The Surgical clinics of North America. 2013;93:1423–1450. doi: 10.1016/j.suc.2013.08.008. [DOI] [PubMed] [Google Scholar]
- 45.Forner A, Reig ME, de Lope CR, Bruix J. Current strategy for staging and treatment: the BCLC update and future prospects. Seminars in liver disease. 2010;30:61–74. doi: 10.1055/s-0030-1247133. [DOI] [PubMed] [Google Scholar]
- 46.Xu BH, Li XX, Yang Y, Zhang MY, Rao HL, Wang HY, Zheng XF. Aberrant amino acid signaling promotes growth and metastasis of hepatocellular carcinomas through Rab1A-dependent activation of mTORC1 by Rab1A. Oncotarget. 2015;6:20813–20828. doi: 10.18632/oncotarget.5175. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Tsang CK, Liu Y, Thomas J, Zhang Y, Zheng XF. Superoxide dismutase 1 acts as a nuclear transcription factor to regulate oxidative stress resistance. Nat Commun. 2014;5:3446. doi: 10.1038/ncomms4446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Cerami E, Gao J, Dogrusoz U, Gross BE, Sumer SO, Aksoy BA, Jacobsen A, Byrne CJ, Heuer ML, Larsson E, Antipin Y, Reva B, Goldberg AP, et al. The cBio cancer genomics portal: an open platform for exploring multidimensional cancer genomics data. Cancer discovery. 2012;2:401–404. doi: 10.1158/2159-8290.CD-12-0095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Gao J, Aksoy BA, Dogrusoz U, Dresdner G, Gross B, Sumer SO, Sun Y, Jacobsen A, Sinha R, Larsson E, Cerami E, Sander C, Schultz N. Integrative analysis of complex cancer genomics and clinical profiles using the cBioPortal. Science signaling. 2013;6:pl1. doi: 10.1126/scisignal.2004088. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.