Skip to main content
International Journal of Molecular Sciences logoLink to International Journal of Molecular Sciences
. 2020 Aug 28;21(17):6229. doi: 10.3390/ijms21176229

Combination Therapy with Cinnamaldehyde and Hyperthermia Induces Apoptosis of A549 Non-Small Cell Lung Carcinoma Cells via Regulation of Reactive Oxygen Species and Mitogen-Activated Protein Kinase Family

Jinbong Park 1, Seung Ho Baek 2,*
PMCID: PMC7504317  PMID: 32872198

Abstract

Lung cancer is the largest cause of cancer-induced deaths. Non-small cell lung cancer (NSCLC) is the most frequently observed subtype of lung cancer. Although recent studies have provided many therapeutic options, there is still a need for effective and safe treatments. This paper reports the combined effects of cinnamaldehyde (CNM), a flavonoid from cinnamon, together with hyperthermia, a therapeutic option for cancer treatment, on the A549 NSCLC cell line. A hyperthermia treatment of 43 °C potentiated the cytotoxicity of CNM in A549 cells. This was attributed to an increase in the apoptosis markers and suppression of the survival/protective factors, as confirmed by Western blot assays. Flow cytometry supported this result because the apoptotic profile, cell health profile, and cell cycle profile were regulated by CNM and hyperthermia combination therapy. The changes in reactive oxygen species (ROS) and its downstream target pathway, mitogen-activated protein kinases (MAPK), were evaluated. The CNM and hyperthermia combination increased the generation of ROS and MAPK phosphorylation. N-acetylcysteine (NAC), a ROS inhibitor, abolished the apoptotic events caused by CNM and hyperthermia co-treatment, suggesting that the cytotoxic effect was dependent of ROS signaling. Therefore, we suggest CNM and hyperthermia combination as an effective therapeutic option for the NSCLC treatment.

Keywords: non-small cell lung cancer, cinnamaldehyde, hyperthermia therapy, synergy, apoptosis, reactive oxygen species, mitogen-activated protein kinase

1. Introduction

Cancer is one of the most crucial health issues worldwide. Among the 9.6 million deaths from cancer, lung cancer accounts for approximately 20% of global cancer mortality [1]. Approximately 80–85% of lung cancer patients express a histological subtype known as non-small cell lung cancer (NSCLC) [2]. Progress in treating this fatal disease has been promising over the past 20 years, but the majority of options are still limited to cytotoxic chemotherapy, despite side effects, and drug resistance [3].

Therefore, natural products have attracted interest as an alternative therapy for NSCLC. Cinnamaldehyde (CNM), the main ingredient of cinnamon, is a widely used flavoring agent [4]. Several studies have reported the beneficial effects of CNM in various types of cancers, including leukemia [5], melanoma [6], colorectal cancer [7], and lung cancer [8,9].

Hyperthermia is another potential method that may trigger cancer cell death. High-temperature stimulation leads to several physiological responses, including changes in the membrane permeability or cytoskeleton system, alteration in macromolecule synthesis or intracellular signaling, and inhibition of DNA repair [10]. In lung cancer, hyperthermia treatment induces cell death via cytoskeletal alteration [11], an increase in caspase-3-dependent apoptosis [12], or the induction of reactive oxygen species-related autophagy [13]. In addition, the effects of gemicitabine [14], paclitaxel/carboplatin [15], doxorubicin [16], cisplatin [17], or even radiotherapy [18] can be increased when combined with hyperthermia. Moreover, many studies of a combination of hyperthermia with natural products, such as beta-lapachon [19], Rhizoma paridis [20], and β-elemene [21], have been carried out to show the beneficial use of nature-derived agents when combined with hyperthermia. To date, there are no reports on the combination treatment of hyperthermia with CNM, a well-known nature-derived material with anti-cancerous effects, in NSCLC. This study evaluated the synergism between CNM and hyperthermia treatment in the NSCLC cell line, A549 cells, and investigated the underlying mechanisms.

2. Results

2.1. Combination Therapy of CNM and Hyperthermia Synergistically Inhibits Cell Proliferation of A549 Cells

First, the anti-proliferative effects of CNM (Figure 1) and hyperthermia co-treatment were evaluated using an MTT assay. CNM treatment in normothermia (37 °C) or hyperthermia (42 and 43 °C) condition showed a decrease in the cell viability of A549 cells. In particular, a co-treatment with hyperthermia of 42 and 43 °C inhibited cell proliferation compared to that at 37 °C (Figure 2a). We calculated the combination index using the CompuSyn software to find out CNM combined with hyperthermia (42 and 43 °C) showed combination indexes lower than 1 (Figure 2b), which indicates synergistic combination. Crystal violet staining of viable cells indicated a dramatic decrease in colony formation in A549 cells treated with a combination of CNM and 43 °C hyperthermia, while hyperthermia treatment or CNM treatment in normothermia conditions resulted in a moderate decrease (Figure 2c). Visual observation of the cell morphology also showed a decrease in the cell numbers (Figure 2d), confirming the anti-proliferative effect of CNM and hyperthermia combination. Additional wound healing assays verified the inhibition of cell migration by the co-treatment of CNM and hyperthermia (Figure 2e). Furthermore, the dead cell portion determined by a Trypan blue staining assay was increased markedly by the co-treatment therapy (Figure 2f).

Figure 1.

Figure 1

Molecular structure of cinnamaldehyde (CNM).

Figure 2.

Figure 2

Effect of CNM and hyperthermia combination therapy on cell viability in A549 cells. A549 cells were treated with CNM (0, 150 or 200 μM) with or without hyperthermia and incubated for 24 h. (a) The cell viability was determined by an MTT assay. ** p < 0.01, *** p < 0.001 vs. 37 °C + 0 μM group; †† p < 0.01 vs. 42 °C + 0 μM group; ## p < 0.01, ### p < 0.001 vs. 43 °C + 0 μM group; (b) The combination index on cytotoxicity effect was determined using CompuSyn Software; (c) a clonogenic assay was performed by staining cells with Crystal violet staining; (d) morphological changes reflecting apoptosis were visualized under a regular light microscope (magnification ×100); (e) wound healing assays were performed; (f) the live and dead cell portion was determined by Trypan blue staining. * p < 0.05, ** p < 0.01, *** p < 0.001 vs. control group; ### p < 0.001 vs. 43 °C + 0 μM group.

2.2. Combination Therapy of CNM and Hyperthermia Increases Apoptosis Markers and Suppresses Survival Markers in A549 Cells

The expression levels of the factors related to apoptosis, proliferation, metastasis, and angiogenesis were next examined to verify the action mechanism of CNM and hyperthermia co-treatment. As a result, co-treatment with CNM 200 μM and hyperthermia of 43 °C induced the cleavage of caspase-3 (Figure 3a), which is the final step in programmed apoptosis [22]. On the other hand, such an effect was not observed under the 37 °C condition. Further proteins in the apoptosis pathway were investigated by additional Western blot assays. In line with the result of cleaved caspase-3, the level of caspase-9 expression decreased in a dose-dependent manner, but only by the CNM and 43 °C hyperthermia co-treatment (Figure 3a). In addition, the anti-apoptotic members of the B-cell lymphoma (Bcl)-2 family, Bcl-2, Bcl-xL, and Survivin [23], were also suppressed by the combination treatment of CNM and 43 °C (Figure 3b). Western blot assays were conducted to determine if heat shock protein 70 (HSP70) was involved in the action of CNM and hyperthermia. The results show that CNM co-treatment reversed the increase in HSP70 expression in response to hyperthermia (Figure 3c). Moreover, the CNM and hyperthermia co-treatment regulated the cell cycle while reducing the metastatic potential of A549 cells. This was illustrated by the inhibition of the expression of Cyclin D1, vascular endothelial growth factor (VEGF), matrix metallopeptidase (MMP)-2 and MMP-9 by the combination of CNM and 43 °C hyperthermia (Figure 3d).

Figure 3.

Figure 3

Effect of CNM and hyperthermia combination therapy on the protein levels of apoptosis and survival markers in A549 cells. A549 cells were treated with CNM (0, 150 or 200 μM) with or without hyperthermia and incubated for 24 h. Whole-cell extracts were prepared, then equal concentrations of lysates were analyzed by Western blot analysis. Protein expression of (a) caspase-3, caspase-9, (b) Bcl-2, Bcl-xL, Survivin, (c) HSP70, (d) Cyclin D1, VEGF, MMP-2 and MMP-9 was measured using Western blot assays. β-actin was used as a loading control. Representative blots are shown.

2.3. Combination of CNM and Hyperthermia Induces Apoptosis by Arresting Cell Cycle in A549 Cells

Cell cycle arrest is closely related to the induction of apoptosis and is frequently used as the therapeutic target of anti-cancer agents [24]. Flow cytometry analyses were carried out to determine if cell cycle arrest also occurs in the action mechanism of CNM and hyperthermia combination treatment. CNM with hyperthermia treatment of 43 °C increased the Annexin V-associated apoptotic profile of A549 cells. The CNM treatment at 37 °C increased the rate of apoptosis from 8.97% to 25.24%, but when combined with hyperthermia, the number of apoptotic cells grew to 46.93% of the total cells (Figure 4a). In addition, as shown in Figure 4b, when the mitochondrial membrane potential of A549 cells was measured to determine the changes in the cell health profile, the CNM treatment accompanied by 43 °C hyperthermia regulated the dead cell ratio of A549 cells after 24 h to 47.74% of the total cells compared to either a sole treatment of 43 °C hyperthermia (20.24%) or a combination of CNM and 37 °C normothermia (18.61%). Next, the cell cycle in A549 cells treated with CNM and hyperthermia was analyzed. The results indicate that cell cycle arrest was induced at the G2/M phase by a co-treatment of CNM and 43 °C hyperthermia (Figure 4c) accompanied with the decrease in Cyclin B1 (Supplementary Figure S1), a key regulator of cellular mitosis [25].

Figure 4.

Figure 4

Effect of CNM and hyperthermia combination therapy on the apoptosis profile, cell health profile and cell cycle profile in A549 cells. A549 cells were treated with CNM (0, 200 μM) with or without hyperthermia and incubated for 2 h. Annexin V and 7-AAD staining was used to detect apoptosis and then analyzed by a flow cytometer. Flow cytometry analysis on (a) apoptosis profile, (b) mitochondrial membrane potential profile and (c) cell cycle profile was performed.

2.4. Combination Therapy of CNM and Hyperthermia Increases Reactive Oxygen Species (ROS) Production and Induces Its Downstream Mitogen-Activated Protein Kinase (MAPK) Pathway

ROS signaling is one of the target mechanisms to induce apoptosis in cancer cells that hyperthermia and several natural products share [26,27]. Therefore, the next goal was to evaluate the role of ROS in the pro-apoptotic effect from the combination of CNM and hyperthermia treatment. When assessed by flow cytometry, ROS release was increased significantly by the CNM plus hyperthermia combination treatment (Figure 5a). The levels of MAPKs phosphorylation, which is an important downstream pathway of ROS signaling [28], were evaluated by Western blot assays. As shown in Figure 5b, increases in phosphorylation of all three MAPKs, extracellular signal-regulated kinase (ERK), c-Jun NH2-terminal kinase (JNK) and p38, along with Akt were observed in A549 cells treated with the CNM and hyperthermia combination. In particular, the peak of p-ERK was observed at 2 h post-treatment. Phosphorylation of p38 showed a similar time-dependent pattern as ERK, while p-JNK showed a gradual increase until 4 h. On the other hand, phosphorylation of Akt showed a time-dependent increase starting from right after treatment until 6 h post-treatment.

Figure 5.

Figure 5

Effect of CNM and hyperthermia combination therapy on reactive oxygen species (ROS) generation and MAPK pathway in A549 cells. A549 cells were treated with CNM (0 or 200 μM) with or without hyperthermia and incubated for the indicated time. (a) Flow cytometry analysis on ROS generation was performed; (b) Protein expressions of p-ERK, ERK, p-JNK, JNK, p-p38, p38, p-Akt and Akt were measured using western blot assays. Representative blots are shown.

2.5. Apoptotic Effect by Combination Therapy of CNM and Hyperthermia in A549 Cells Is Dependent On ROS Signaling

The cells were pretreated with N-acetylcysteine (NAC), a free radical scavenger, and thus a ROS inhibitor, before the combination treatment of CNM and thermal stimulation. As shown in Figure 6a, the NAC pre-treatment blocked the effects of CNM and 43 °C hyperthermia on ROS production. Furthermore, Annexin V staining indicated that CNM and hyperthermia treatment failed to induce apoptosis in A549 cells in the presence of NAC, suggesting the key role of ROS in the effects of this combination treatment (Figure 6b). Western blot analysis showed that when NAC blocked ROS generation, the effect of CNM plus hyperthermia co-treatment on levels of MAPKs phosphorylation (Figure 6c) and the cleavage of caspase-3 (Figure 6d) were interrupted.

Figure 6.

Figure 6

Effect of CNM and hyperthermia combination therapy on ROS generation, apoptosis markers and MAPK pathway in ROS-inhibited A549 cells. A549 cells were pre-treated with N-acetylcysteine (NAC) and then treated with CNM (0 or 200 μM) with or without hyperthermia and incubated for the indicated time. Flow cytometry analysis on (a) ROS generation and (b) apoptosis profile was performed. β-actin was used as a loading control. Protein expressions of (c) caspase-3, caspase-9, (d) p-ERK, ERK, p-JNK, JNK, p-Akt and Akt were measured using Western blot assays. Representative blots are shown. (−), absence of NAC or CNM; (+), presence of NAC or CNM.

3. Discussion

Lung cancer is the most responsible for cancer-associated death, causing approximately 1.6 million deaths per year. Although recent progress has been promising, major challenges remain [29]. This paper suggests a novel approach for NSCLC treatment using a less harmful natural compound, CNM, together with hyperthermia therapy.

CNM, a component of cinnamon, is considered a promising therapeutic agent for cancer treatment. Cinnamon is the dried bark of Cinnamomum cassia, used widely as an herbal medicine in traditional Korean medicine to improve blood circulation [30]. CNM is an organic compound comprising 90% of the essential oil of cinnamon, giving the scent and flavor [31]. Studies reported the anti-cancer effects of CNM in experimental models of cancer [5,6,7,8,9]. This study aimed to verify not only its anti-cancer effect in NSCLC but also to focus on combination therapy with hyperthermia, another potential treatment method that has been used to enhance the effects of anti-cancer agents.

Research has shown that a hyperthermal treatment in cancer patients can kill cancer cells and shrink tumors, while minimally affecting the normal tissues [32]. Although further evidence will be needed before hyperthermia can be recognized as a standard procedure, some trials have reported the beneficial effects of hyperthermia therapy for cancer treatment [33,34]. Furthermore, studies have shown that a combination treatment of hyperthermia with natural products may potentiate the anti-cancer effects [19,20,21]. Therefore, this study attempted to verify the combined effects of hyperthermia and CNM on the A549 NSCLC cell line. The results, including assessments of the cell viability, morphology, and migration, suggest that the CNM and hyperthermia co-treatment synergistically inhibited the proliferation of A549 cells (Figure 2).

Apoptosis is considered one of the most important targets for cancer management. The intrinsic pathway of apoptosis involves the response of the mitochondria. During apoptosis, cytochrome c is released from the mitochondria and binds with apoptotic protease activating factor-1 and ATP, then binds to pro-caspase-9 to form an apoptosome complex, which cleaves caspase-9 and in turn activates the cleavage of caspase-3 [22]. The results show that CNM and hyperthermia synergistically increased the cleavage of caspase-3 and 9 (Figure 3a), suggesting that the combination treatment enhanced the induction of apoptosis. Furthermore, intrinsic apoptosis, which is dependent on the balance between the pro-apoptotic and anti-apoptotic members of the Bcl-2 family members, such as Bcl-xL and Bcl-2 [22], was also suppressed by CNM and hyperthermia, as shown by the levels of Survivin, Bcl-xL, and Bcl-2 (Figure 3b). Mitochondrial membrane potential, one of the many indicators of the cell health profile, has been implicated as being associated in apoptotic cell death [35]. Further assays on Annexin V expression and mitochondrial membrane potential changes showed that CNM and hyperthermia co-treatment led to apoptosis of A549 cells (Figure 4a,b).

The eukaryotic cell cycle has four phases: G1, S, G2, and M phases. After DNA replication in the S phase, the cells continue to grow during the G2 phase and then enter the mitotic M phase, in which they divide into two daughter cells. A common feature most cancers share is disturbed apoptosis, which is caused by hyperactivated cell cycles [36]. Cyclin B1 and Cyclin D1 control mitosis, cell adhesion, and migration within the cell cycle; hence, they are associated with cancer cell development and metastasis [37]. In NSCLC cells, decrease in Cyclin B1 results in G2 phase cell cycle arrest to trigger apoptosis [38], whereas Cyclin D1 is also shown to be an important component during the arrest of the cell cycle [39]. Concomitantly, our results show that combination therapy with CNM and hyperthermia induced cell cycle arrest in A549 cells (Figure 4c). In addition, the metastatic potential of A549 cells was suppressed by the combination treatment. VEGF, the key molecule of angiogenesis [40], and MMP-2 and MMP-9, which are members of the metastasis-regulating MMP family [41], were decreased significantly by a co-treatment with CMN and hyperthermia (Figure 3d), indicating the beneficial effects of CNM and hyperthermia co-treatment in the improvement of metastasis.

HSP70 is a ubiquitous chaperone that controls a range of cellular processes, such as protein folding and maturation [42]. In particular, in response to thermal stress, HSP70 acts to protect cells. HSP70 also induces oncogenesis, proliferation, migration, and metastasis while suppressing apoptosis, specifically in cancer [43]. In the present study, while neither the sole normothermia treatment nor combination with CNM affected HSP70 expression, the hyperthermia treatment led to an increase in HSP70, suggesting activation of the defense mechanism against heat. However, combination with CNM inhibited this increase in HSP70, leading to the efficient induction of apoptosis. This suggests that CNM can potentiate the effect of hyperthermia by suppressing the defense mechanism against heat (Figure 3c).

The ROS signaling pathway is a widely accepted action mechanism of the apoptotic events in cancer cells by hyperthermia [10]. ROS are already a promising molecular target for the treatment of cancer [26] and are novel targets for herbal treatments [27]. Reports from hyperthermic chemotherapy revealed the definite involvement of ROS in hyperthermia treatment [44]. Moreover, the synergistic combination of hyperthermia with chemotherapy agents [45], nutritional support [46,47], or nature-derived materials, such as baicalin [48] and shikonin [49], involve ROS signaling. Similarly, the present results show that a co-treatment of CNM with 43 °C hyperthermia could also be a novel therapeutic approach towards NSCLC. Through a combination with CNM and hyperthermia, ROS signaling was induced in A549 cells, and MAPKs, the downstream targets of ROS, were also increased by the combination therapy of CNM and hyperthermia (Figure 5). The Akt pathway plays repressive roles in apoptosis via the canonical pathway [50]. On the other hand, several studies reported that Akt activation does not necessarily reduce apoptosis, but, in turn, remodels the sensitivity of cancer cells to metabolic stress [51,52,53]. In particular, when mitochondrial ROS are involved, Akt acts as the upstream channel that induces ROS signaling [54]. Moreover, the present results identify increased Akt phosphorylation along with induced ROS (Figure 5b). An additional study regarding a ROS scavenger work proved that ROS signaling was necessary for the apoptotic effects of CNM and hyperthermia combination treatment (Figure 6). These results may provide critical evidence for selecting ROS-targeted combination therapy of CNM and hyperthermia.

Overall, the results clearly show the apoptotic effect of combination therapy with CNM and hyperthermia treatment in A549 cells, which is dependent on the increase in ROS. This indicates the possible use of a combination treatment of CNM and hyperthermia as an effective approach for NSCLC treatment.

4. Materials and Methods

4.1. Reagents

CNM was purchased from Sigma-Aldrich (St. Louis, MO, USA) and prepared in dimethyl sulfoxide (DMSO) (Samchun Chem, Seoul, Korea). Anti-caspase-3, anti-heat shock protein (HSP) 70, anti-caspase-8, anti-caspase-9, anti-p-ERK (Thr202/Tyr204), anti-ERK, anti-p-p38 (Thr180/Tyr182), anti-p38, anti-p-JNK (Thr183/Tyr185), and anti-JNK antibodies were supplied by Cell Signaling Technology (Danvers, MA, USA). Anti-β-actin, anti-Bcl-2, anti-Bcl-xL, anti-Cyclin D1, anti-VEGF, anti-MMP-2, and anti-MMP-9 were obtained from Santa Cruz Biotechnology, Inc. (Dallas, TX, USA), and anti-cleaved caspase antibodies were acquired from GeneTex, Inc. (Irvine, CA, USA).

4.2. Cell Culture

The NSCLC cell line, A549 cells, were obtained from the Korean Cell Line Bank (Seoul, Korea) and maintained in DMEM medium supplemented with 10% fetal bovine serum (FBS) (Gibco, Grand Island, NY, USA) and 1% penicillin-strep (Gibco, Grand Island, NY, USA) at 37 °C in an incubator with humidified air containing 5% CO₂, as described elsewhere [55].

4.3. Hyperthermia Treatment

The A549 cells were seeded in a 6-well plate (3 × 105 cells/well), suspended in 3 mL of media, followed by immersion in a temperature-controlled water bath at 37 or 43 °C for 30 min. CNM at the indicated concentrations (150 and 200 μM) was added 60 min before the hyperthermia treatment.

4.4. MTT Assay

An MTT assay was used to evaluate the cell viability after exposure to CNM with hyperthermia. Briefly, A549 cells were seeded in 96-well plates (1.5 × 10⁴ cells/mL) and allowed to adhere overnight. Various concentrations of CNM (150 and 200 μM) were added, and the plates were incubated at 37 °C for 1 h in a humidified atmosphere containing 5% CO2. The resulting plates were then immersed in a temperature-controlled water bath at 37, 42, or 43 °C for 30 min. After 48 h of incubation at 37 °C, 5% CO2, an MTT solution (AMRESCO, Solon, OH, USA) was added and incubated for an additional 2 h. The culture medium was discarded, and the cells were lysed in 100 μL of DMSO. The absorbance was measured using an automated spectrophotometric plate reader at 570 nm. The cell viability was normalized as the relative percentages in comparison with the untreated controls. The synergistic effects of the CNM and hyperthermia combination were determined based on the combination index, which was calculated using CompuSyn software ver. 1.0 (ComboSyn, Inc., Paramus, NJ, USA).

4.5. Trypan Blue Staining

Live/dead cell ratio was determined by Trypan blue staining. Briefly, A549 cells were seeded in 6-well plate (3 × 105 cells/well) and treated with CNM for 1 h and hyperthermia for 30 min. After 24 h of post-treatment incubation, cells were harvested, diluted in PBS (1:4), stained with Trypan blue (Sigma-Aldrich, St. Louis, MO, USA), then viable cells and formed colonies were counted. Cell survival rate was calculated as follows:

Cell survival rate (%)=Viable cell countTotal cell count × 100   (1)

4.6. Morphology Assay

A549 cells were seeded in a six-well plate (3 × 105 cells/well), treated with 150 or 200 μM of CNM for 1 h, and incubated at 37 or 43 °C for 30 min. After 24 h, the cells were visualized, and representative images were obtained under a regular optical microscope (CX-40, Olympus, Tokyo, Japan).

4.7. Wound healing Assay

The cells were seeded in a six-well plate at a density of 5 × 105 cells and cultured at 37 °C. After confluence, a thin scratch was produced in each well with a yellow pipette tip. The culture medium was removed after 24 h, and representative images were obtained under a regular optical microscope (CX-40, Olympus, Tokyo, Japan).

4.8. Clonogenic Assay

Four hundred cells/well were seeded in a six-well plate and incubated overnight. The following day, the cells were treated with 200 μM CNM for 1 h and incubated at 37 or 43 °C for 30 min for the hyperthermia treatment. After two weeks, the cells were stained with a crystal violet (Sigma-Aldrich, St. Louis, MO, USA) solution at RT for 10 min and washed with PBS. Images of the colonies were obtained under a regular optical microscope (CX-40, Olympus, Tokyo, Japan).

4.9. Western Blot Analysis

Western blot analysis was performed as described elsewhere [56]. Briefly, after the protein concentrations from isolated A549 cells were determined, equal amounts of lysates resolved by sodium dodecyl sulfate (SDS)-polyacrylamide gel electrophoresis were transferred to a polyvinylidene difluoride membrane, and the membrane was blocked with 1x TBS containing 0.1% Tween 20 and 5% skim milk at RT. The membranes were incubated overnight at 4 °C with the respective primary antibodies followed by washing and incubation (1 h, RT) with diluted horseradish peroxidase-conjugated anti-rabbit or anti-mouse IgG antibodies (Santa Cruz Biotechnology, Inc., Dallas, TX, USA). The immunoblot signals were detected using an enhanced chemiluminescence kit (EMD Merck Millipore, Billerica, MA, USA). Membranes were incubated in stripping buffer containing 2% SDS, 62.5 mM Tris-HCl (pH 6.8) and 0.7% mercaptoethanol in D.W. at RT for 30 min to detach antibodies to confirm the total forms of ERK, p38, JNK and Akt after detecting their phosphorylation forms.

4.10. Apoptosis Assay

A Muse® Annexin V and Dead cell kit (Part Number: MCH100105) (EMD Merck Millipore, Billerica, MA, USA) was used to measure the ratio of apoptosis. A549 cells were seeded in 6-well plates at a density of 3 × 105 cells/well. Twenty-four hours after treatment with CNM and hyperthermia, A549 cells were collected, and pellets were subjected to an Annexin V and 7-amino-actinomycin D (7-AAD) staining according to the manufacturer’s instructions. After incubation, the cells were analyzed using the Muse® Cell Analyzer (EMD Merck Millipore, Billerica, MA, USA).

4.11. Cell Cycle Analysis

A549 cells (3 × 105 cells/well) in six-well plates were exposed to co-treatments for 24 h, and the cell cycle phase was analyzed. The cells were then collected, fixed overnight in 70% ice-cold EtOH, washed with PBS, and resuspended in PBS containing 1 mg/mL PI, 10 mg/mL RNase A in a dark room for 10 min. The cell cycle was determined using a Muse® Cell Analyzer (EMD Merck Millipore, Billerica, MA, USA).

4.12. Analysis of Reactive Oxygen Species (ROS)

The levels of ROS generation were measured using a ROS assay kit (Part Number: MCH100111) (EMD Merck Millipore, Billerica, MA, USA). Twenty-four hours after the co-treatment of CNM and hyperthermia, the A549 cells were treated with an oxidative stress working solution and incubated for 30 min at 37 °C. The ROS levels were analyzed using the Muse® Cell Analyzer (EMD Merck Millipore, Billerica, MA, USA). The cells were treated with NAC, the ROS inhibitor [57], for 1.5 h before treatment with CNM and hyperthermia.

4.13. Statistical Analysis

All numeric values are represented as the mean ± SD. The statistical significance of the data compared to the untreated control was determined using Student’s unpaired t-test * p < 0.05, ** p < 0.01 and *** p < 0.001 were considered significant.

Abbreviations

NSCLC non-small cell lung cancer
CNM cinnamaldehyde
Bcl B-cell lymphoma
HSP70 heat shock protein 70
VEGF vascular endothelial growth factor
MMP matrix metallopeptidase
ROS reactive oxygen species
MAPK mitogen-activated protein kinase
ERK extracellular signal-regulated kinase
JNK c-Jun NH2-terminal kinase
NAC N-acetylcysteine
DMSO dimethyl sulfoxide
FBS fetal bovine serum

Supplementary Materials

Supplementary materials can be found at https://www.mdpi.com/1422-0067/21/17/6229/s1, Figure S1: Effect of CNM and hyperthermia combination on Cyclin B1 expression in A549 cells.

Author Contributions

Conceptualization, S.H.B.; formal analysis, J.P. and S.H.B.; investigation, J.P. and S.H.B.; resources, S.H.B.; writing—original draft preparation, J.P.; writing—review and editing, J.P. and S.H.B.; visualization, J.P. and S.H.B.; supervision, S.H.B.; project administration, S.H.B.; funding acquisition, J.P. and S.H.B. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (NRF-2020R1C1C1009721 and 2020R1I1A3063625).

Conflicts of Interest

The authors declare no conflict of interest.

References

  • 1.Bray F., Ferlay J., Soerjomataram I., Siegel R.L., Torre L.A., Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 2018;68:394–424. doi: 10.3322/caac.21492. [DOI] [PubMed] [Google Scholar]
  • 2.Molina J.R., Yang P., Cassivi S.D., Schild S.E., Adjei A.A. Non-small cell lung cancer: Epidemiology, risk factors, treatment, and survivorship. Mayo Clin. Proc. 2008;83:584–594. doi: 10.1016/S0025-6196(11)60735-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Osmani L., Askin F., Gabrielson E., Li Q.K. Current WHO guidelines and the critical role of immunohistochemical markers in the subclassification of non-small cell lung carcinoma (NSCLC): Moving from targeted therapy to immunotherapy. Semin. Cancer Biol. 2018;52:103–109. doi: 10.1016/j.semcancer.2017.11.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Friedman M., Kozukue N., Harden L.A. Cinnamaldehyde content in foods determined by gas chromatography-mass spectrometry. J. Agric. Food Chem. 2000;48:5702–5709. doi: 10.1021/jf000585g. [DOI] [PubMed] [Google Scholar]
  • 5.Zhang J.H., Liu L.Q., He Y.L., Kong W.J., Huang S.A. Cytotoxic effect of trans-cinnamaldehyde on human leukemia K562 cells. Acta Pharmacol. Sin. 2010;31:861–866. doi: 10.1038/aps.2010.76. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Cabello C.M., Bair W.B., 3rd, Lamore S.D., Ley S., Bause A.S., Azimian S., Wondrak G.T. The cinnamon-derived Michael acceptor cinnamic aldehyde impairs melanoma cell proliferation, invasiveness, and tumor growth. Free Radic. Biol. Med. 2009;46:220–231. doi: 10.1016/j.freeradbiomed.2008.10.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Li J., Teng Y., Liu S., Wang Z., Chen Y., Zhang Y., Xi S., Xu S., Wang R., Zou X. Cinnamaldehyde affects the biological behavior of human colorectal cancer cells and induces apoptosis via inhibition of the PI3K/Akt signaling pathway. Oncol. Rep. 2016;35:1501–1510. doi: 10.3892/or.2015.4493. [DOI] [PubMed] [Google Scholar]
  • 8.Wu C., Zhuang Y., Jiang S., Tian F., Teng Y., Chen X., Zheng P., Liu S., Zhou J., Wu J., et al. Cinnamaldehyde induces apoptosis and reverses epithelial-mesenchymal transition through inhibition of Wnt/beta-catenin pathway in non-small cell lung cancer. Int. J. Biochem. Cell Biol. 2017;84:58–74. doi: 10.1016/j.biocel.2017.01.005. [DOI] [PubMed] [Google Scholar]
  • 9.Tian F., Yu C.T., Ye W.D., Wang Q. Cinnamaldehyde induces cell apoptosis mediated by a novel circular RNA hsa_circ_0043256 in non-small cell lung cancer. Biochem. Biophys. Res. Commun. 2017;493:1260–1266. doi: 10.1016/j.bbrc.2017.09.136. [DOI] [PubMed] [Google Scholar]
  • 10.Ahmed K., Tabuchi Y., Kondo T. Hyperthermia: An effective strategy to induce apoptosis in cancer cells. Apoptosis. 2015;20:1411–1419. doi: 10.1007/s10495-015-1168-3. [DOI] [PubMed] [Google Scholar]
  • 11.Pawlik A., Nowak J.M., Grzanka D., Gackowska L., Michalkiewicz J., Grzanka A. Hyperthermia induces cytoskeletal alterations and mitotic catastrophe in p53-deficient H1299 lung cancer cells. Acta Histochem. 2013;115:8–15. doi: 10.1016/j.acthis.2012.02.006. [DOI] [PubMed] [Google Scholar]
  • 12.Zhao Y.Y., Wu Q., Wu Z.B., Zhang J.J., Zhu L.C., Yang Y., Ma S.L., Zhang S.R. Microwave hyperthermia promotes caspase3-dependent apoptosis and induces G2/M checkpoint arrest via the ATM pathway in nonsmall cell lung cancer cells. Int. J. Oncol. 2018;53:539–550. doi: 10.3892/ijo.2018.4439. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Yang Y., Yang C.L., Zhao Z.J., Zuo X.X., Liang T.S., Yang Y., Ma S.L., Yang D.K. Microwave hyperthermia enhances the sensitivity of lung cancer cells to gemcitabine through reactive oxygen speciesinduced autophagic death. Oncol. Rep. 2019;41:3100–3110. doi: 10.3892/or.2019.7085. [DOI] [PubMed] [Google Scholar]
  • 14.Vertrees R.A., Das G.C., Popov V.L., Coscio A.M., Goodwin T.J., Logrono R., Zwischenberger J.B., Boor P.J. Synergistic interaction of hyperthermia and Gemcitabine in lung cancer. Cancer Biol. Ther. 2005;4:1144–1153. doi: 10.4161/cbt.4.10.2074. [DOI] [PubMed] [Google Scholar]
  • 15.Ohguri T., Imada H., Narisada H., Yahara K., Morioka T., Nakano K., Miyaguni Y., Korogi Y. Systemic chemotherapy using paclitaxel and carboplatin plus regional hyperthermia and hyperbaric oxygen treatment for non-small cell lung cancer with multiple pulmonary metastases: Preliminary results. Int. J. Hyperth. 2009;25:160–167. doi: 10.1080/02656730802610357. [DOI] [PubMed] [Google Scholar]
  • 16.Lee H., Kim S., Choi B.H., Park M.T., Lee J., Jeong S.Y., Choi E.K., Lim B.U., Kim C., Park H.J. Hyperthermia improves therapeutic efficacy of doxorubicin carried by mesoporous silica nanocontainers in human lung cancer cells. Int. J. Hyperth. 2011;27:698–707. doi: 10.3109/02656736.2011.608217. [DOI] [PubMed] [Google Scholar]
  • 17.Dou Y.N., Dunne M., Huang H., McKee T., Chang M.C., Jaffray D.A., Allen C. Thermosensitive liposomal cisplatin in combination with local hyperthermia results in tumor growth delay and changes in tumor microenvironment in xenograft models of lung carcinoma. J Drug Target. 2016;24:865–877. doi: 10.1080/1061186X.2016.1191079. [DOI] [PubMed] [Google Scholar]
  • 18.Son B., Jeon J., Lee S., Kim H., Kang H., Youn H., Jo S., Youn B. Radiotherapy in combination with hyperthermia suppresses lung cancer progression via increased NR4A3 and KLF11 expression. Int. J. Radiat. Biol. 2019;95:1696–1707. doi: 10.1080/09553002.2019.1665213. [DOI] [PubMed] [Google Scholar]
  • 19.Song C.W., Chae J.J., Choi E.K., Hwang T.S., Kim C., Lim B.U., Park H.J. Anti-cancer effect of bio-reductive drug beta-lapachon is enhanced by activating NQO1 with heat shock. Int. J. Hyperth. 2008;24:161–169. doi: 10.1080/02656730701781895. [DOI] [PubMed] [Google Scholar]
  • 20.Zhao P., Jiang H., Su D., Feng J., Ma S., Zhu X. Inhibition of cell proliferation by mild hyperthermia at 43 C with Paris Saponin I in the lung adenocarcinoma cell line PC-9. Mol. Med. Rep. 2015;11:327–332. doi: 10.3892/mmr.2014.2655. [DOI] [PubMed] [Google Scholar]
  • 21.Wu Z., Wang T., Zhang Y., Zheng Z., Yu S., Jing S., Chen S., Jiang H., Ma S. Anticancer effects of beta-elemene with hyperthermia in lung cancer cells. Exp. Ther. Med. 2017;13:3153–3157. doi: 10.3892/etm.2017.4350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Ichim G., Tait S.W. A fate worse than death: Apoptosis as an oncogenic process. Nat. Rev. Cancer. 2016;16:539–548. doi: 10.1038/nrc.2016.58. [DOI] [PubMed] [Google Scholar]
  • 23.Hata A.N., Engelman J.A., Faber A.C. The BCL2 Family: Key Mediators of the Apoptotic Response to Targeted Anticancer Therapeutics. Cancer Discov. 2015;5:475–487. doi: 10.1158/2159-8290.CD-15-0011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Evan G.I., Vousden K.H. Proliferation, cell cycle and apoptosis in cancer. Nature. 2001;411:342–348. doi: 10.1038/35077213. [DOI] [PubMed] [Google Scholar]
  • 25.Nigg E.A. Mitotic kinases as regulators of cell division and its checkpoints. Nat. Rev. Mol. Cell Biol. 2001;2:21–32. doi: 10.1038/35048096. [DOI] [PubMed] [Google Scholar]
  • 26.Teppo H.R., Soini Y., Karihtala P. Reactive Oxygen Species-Mediated Mechanisms of Action of Targeted Cancer Therapy. Oxid. Med. Cell. Longev. 2017;2017:1485283. doi: 10.1155/2017/1485283. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Qian Q., Chen W., Cao Y., Cao Q., Cui Y., Li Y., Wu J. Targeting Reactive Oxygen Species in Cancer via Chinese Herbal Medicine. Oxid. Med. Cell. Longev. 2019;2019:9240426. doi: 10.1155/2019/9240426. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Zhang J., Wang X., Vikash V., Ye Q., Wu D., Liu Y., Dong W. ROS and ROS-Mediated Cellular Signaling. Oxid. Med. Cell. Longev. 2016;2016:4350965. doi: 10.1155/2016/4350965. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Herbst R.S., Morgensztern D., Boshoff C. The biology and management of non-small cell lung cancer. Nature. 2018;553:446–454. doi: 10.1038/nature25183. [DOI] [PubMed] [Google Scholar]
  • 30.Choi H.M., Jung Y., Park J., Kim H.L., Youn D.H., Kang J., Jeong M.Y., Lee J.H., Yang W.M., Lee S.G., et al. Cinnamomi Cortex (Cinnamomum verum) Suppresses Testosterone-induced Benign Prostatic Hyperplasia by Regulating 5alpha-reductase. Sci. Rep. 2016;6:31906. doi: 10.1038/srep31906. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.National Center for Biotechnology Information PubChem Compound Summary for CID 637511, Cinnamaldehyde. [(accessed on 1 July 2020)]; Available online: https://pubchem.ncbi.nlm.nih.gov/compound/Cinnamaldehyde.
  • 32.Wust P., Hildebrandt B., Sreenivasa G., Rau B., Gellermann J., Riess H., Felix R., Schlag P.M. Hyperthermia in combined treatment of cancer. Lancet Oncol. 2002;3:487–497. doi: 10.1016/S1470-2045(02)00818-5. [DOI] [PubMed] [Google Scholar]
  • 33.Sulyok I., Fleischmann E., Stift A., Roth G., Lebherz-Eichinger D., Kasper D., Spittler A., Kimberger O. Effect of preoperative fever-range whole-body hyperthermia on immunological markers in patients undergoing colorectal cancer surgery. Br. J. Anaesth. 2012;109:754–761. doi: 10.1093/bja/aes248. [DOI] [PubMed] [Google Scholar]
  • 34.Lutgens L.C., Koper P.C., Jobsen J.J., van der Steen-Banasik E.M., Creutzberg C.L., van den Berg H.A., Ottevanger P.B., van Rhoon G.C., van Doorn H.C., Houben R., et al. Radiation therapy combined with hyperthermia versus cisplatin for locally advanced cervical cancer: Results of the randomized RADCHOC trial. Radiother. Oncol. 2016;120:378–382. doi: 10.1016/j.radonc.2016.02.010. [DOI] [PubMed] [Google Scholar]
  • 35.Ly J.D., Grubb D.R., Lawen A. The mitochondrial membrane potential (deltapsi(m)) in apoptosis; an update. Apoptosis. 2003;8:115–128. doi: 10.1023/A:1022945107762. [DOI] [PubMed] [Google Scholar]
  • 36.Otto T., Sicinski P. Cell cycle proteins as promising targets in cancer therapy. Nat. Rev. Cancer. 2017;17:93–115. doi: 10.1038/nrc.2016.138. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Fuste N.P., Fernandez-Hernandez R., Cemeli T., Mirantes C., Pedraza N., Rafel M., Torres-Rosell J., Colomina N., Ferrezuelo F., Dolcet X., et al. Cytoplasmic cyclin D1 regulates cell invasion and metastasis through the phosphorylation of paxillin. Nat. Commun. 2016;7:11581. doi: 10.1038/ncomms11581. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Zhang L.L., Feng Z.L., Su M.X., Jiang X.M., Chen X., Wang Y., Li A., Lin L.G., Lu J.J. Downregulation of Cyclin B1 mediates nagilactone E-induced G2 phase cell cycle arrest in non-small cell lung cancer cells. Eur. J. Pharmacol. 2018;830:17–25. doi: 10.1016/j.ejphar.2018.04.020. [DOI] [PubMed] [Google Scholar]
  • 39.Żuryń A., Litwinie A., Safiejko-Mroczka B., Klimaszewska-Wiśniewska A., Gagat M., Krajewski A., Gackowska L., Grzanka D. The effect of sulforaphane on the cell cycle, apoptosis and expression of cyclin D1 and p21 in the A549 non-small cell lung cancer cell line. Int. J. Oncol. 2016;48:2521–2533. doi: 10.3892/ijo.2016.3444. [DOI] [PubMed] [Google Scholar]
  • 40.Saharinen P., Eklund L., Pulkki K., Bono P., Alitalo K. VEGF and angiopoietin signaling in tumor angiogenesis and metastasis. Trends Mol. Med. 2011;17:347–362. doi: 10.1016/j.molmed.2011.01.015. [DOI] [PubMed] [Google Scholar]
  • 41.Deryugina E.I., Quigley J.P. Matrix metalloproteinases and tumor metastasis. Cancer Metastasis Rev. 2006;25:9–34. doi: 10.1007/s10555-006-7886-9. [DOI] [PubMed] [Google Scholar]
  • 42.Rosenzweig R., Nillegoda N.B., Mayer M.P., Bukau B. The Hsp70 chaperone network. Nat. Rev. Mol. Cell Biol. 2019;20:665–680. doi: 10.1038/s41580-019-0133-3. [DOI] [PubMed] [Google Scholar]
  • 43.Rylander M.N., Feng Y., Bass J., Diller K.R. Thermally induced injury and heat-shock protein expression in cells and tissues. Ann. N. Y. Acad. Sci. 2005;1066:222–242. doi: 10.1196/annals.1363.009. [DOI] [PubMed] [Google Scholar]
  • 44.Lehmann K., Rickenbacher A., Jang J.H., Oberkofler C.E., Vonlanthen R., von Boehmer L., Humar B., Graf R., Gertsch P., Clavien P.A. New insight into hyperthermic intraperitoneal chemotherapy: Induction of oxidative stress dramatically enhanced tumor killing in in vitro and in vivo models. Ann. Surg. 2012;256:730–737. doi: 10.1097/SLA.0b013e3182737517. [DOI] [PubMed] [Google Scholar]
  • 45.Song X., Kim S.Y., Lee Y.J. The role of Bcl-xL in synergistic induction of apoptosis by mapatumumab and oxaliplatin in combination with hyperthermia on human colon cancer. Mol. Cancer Res. 2012;10:1567–1579. doi: 10.1158/1541-7786.MCR-12-0209-T. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Fukumura H., Sato M., Kezuka K., Sato I., Feng X., Okumura S., Fujita T., Yokoyama U., Eguchi H., Ishikawa Y., et al. Effect of ascorbic acid on reactive oxygen species production in chemotherapy and hyperthermia in prostate cancer cells. J. Physiol. Sci. 2012;62:251–257. doi: 10.1007/s12576-012-0204-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Cui Z.G., Piao J.L., Kondo T., Ogawa R., Tsuneyama K., Zhao Q.L., Feril L.B., Jr., Inadera H. Molecular mechanisms of hyperthermia-induced apoptosis enhanced by docosahexaenoic acid: Implication for cancer therapy. Chem. Biol. Interact. 2014;215:46–53. doi: 10.1016/j.cbi.2014.03.005. [DOI] [PubMed] [Google Scholar]
  • 48.Zakki S.A., Cui Z.G., Sun L., Feng Q.W., Li M.L., Inadera H. Baicalin Augments Hyperthermia-Induced Apoptosis in U937 Cells and Modulates the MAPK Pathway via ROS Generation. Cell. Physiol. Biochem. 2018;45:2444–2460. doi: 10.1159/000488263. [DOI] [PubMed] [Google Scholar]
  • 49.Piao J.L., Jin Y.J., Li M.L., Zakki S.A., Sun L., Feng Q.W., Zhou D., Kondo T., Cui Z.G., Inadera H. Excessive Oxidative Stress in the Synergistic Effects of Shikonin on the Hyperthermia-Induced Apoptosis. Curr. Mol. Med. 2018;18:322–334. doi: 10.2174/1566524018666181024161704. [DOI] [PubMed] [Google Scholar]
  • 50.Vivanco I., Sawyers C.L. The Phosphatidylinositol 3-Kinase AKT Pathway in Human Cancer. Nat. Rev. Cancer. 2002;2:489–501. doi: 10.1038/nrc839. [DOI] [PubMed] [Google Scholar]
  • 51.Elstrom R.L., Bauer D.E., Buzzai M., Karnauskas R., Harris M.H., Plas D.R., Zhuang H., Cinalli R.M., Alavi A., Rudin C.M., et al. Akt Stimulates Aerobic Glycolysis in Cancer Cells. Cancer Res. 2004;64:3892–3899. doi: 10.1158/0008-5472.CAN-03-2904. [DOI] [PubMed] [Google Scholar]
  • 52.Nogueira V., Park Y., Chen C.C., Xu P.Z., Chen M.L., Tonic I., Unerman T., Hay N. Akt Determines Replicative Senescence and Oxidative or Oncogenic Premature Senescence and Sensitizes Cells to Oxidative Apoptosis. Cancer Cell. 2008;14:458–470. doi: 10.1016/j.ccr.2008.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Los M., Maddika S., Erb B., Schulze-Osthoff K. Switching Akt: From Survival Signaling to Deadly Response. Bioessays. 2009;31:492–495. doi: 10.1002/bies.200900005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Redza-Dutordoir M., Averill-Bates D.A. Activation of Apoptosis Signalling Pathways by Reactive Oxygen Species. Biochim. Biophys. Acta. 2016;1863:2977–2992. doi: 10.1016/j.bbamcr.2016.09.012. [DOI] [PubMed] [Google Scholar]
  • 55.Baek S.H., Ko J.H., Lee J.H., Kim C., Lee H., Nam D., Lee J., Lee S.G., Yang W.M., Um J.Y., et al. Ginkgolic Acid Inhibits Invasion and Migration and TGF-beta-Induced EMT of Lung Cancer Cells Through PI3K/Akt/mTOR Inactivation. J. Cell. Physiol. 2017;232:346–354. doi: 10.1002/jcp.25426. [DOI] [PubMed] [Google Scholar]
  • 56.Park J., Kim H.L., Jung Y., Ahn K.S., Kwak H.J., Um J.Y. Bitter Orange (Citrus aurantium Linne) Improves Obesity by Regulating Adipogenesis and Thermogenesis through AMPK Activation. Nutrients. 2019;11:1988. doi: 10.3390/nu11091988. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Sun S.Y. N-acetylcysteine, reactive oxygen species and beyond. Cancer Biol. Ther. 2010;9:109–110. doi: 10.4161/cbt.9.2.10583. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials


Articles from International Journal of Molecular Sciences are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES