Abstract
Background
The process of translation occurs at a nexus point downstream of a number of signal pathways and developmental processes. Modeling activation of the PTEN/AKT/mTOR pathway in the Eμ-Myc mouse is a valuable tool to study tumor genotype/chemosensitivity relationships in vivo. In this model, blocking translation initiation with silvestrol, an inhibitor of the ribosome recruitment step has been showed to modulate the sensitivity of the tumors to the effect of standard chemotherapy. However, inhibitors of translation elongation have been tested as potential anti-cancer therapeutic agents in vitro, but have not been extensively tested in genetically well-defined mouse tumor models or for potential synergy with standard of care agents.
Methodology/Principal Findings
Here, we chose four structurally different chemical inhibitors of translation elongation: homoharringtonine, bruceantin, didemnin B and cycloheximide, and tested their ability to alter the chemoresistance of Eμ-myc lymphomas harbouring lesions in Pten, Tsc2, Bcl-2, or eIF4E. We show that in some genetic settings, translation elongation inhibitors are able to synergize with doxorubicin by reinstating an apoptotic program in tumor cells. We attribute this effect to a reduction in levels of pro-oncogenic or pro-survival proteins having short half-lives, like Mcl-1, cyclin D1 or c-Myc. Using lymphomas cells grown ex vivo we reproduced the synergy observed in mice between chemotherapy and elongation inhibition and show that this is reversed by blocking protein degradation with a proteasome inhibitor.
Conclusion/Significance
Our results indicate that depleting short-lived pro-survival factors by inhibiting their synthesis could achieve a therapeutic response in tumors harboring PTEN/AKT/mTOR pathway mutations.
Introduction
Recent large scale analysis of gene mutations, deletions, and amplifications in human tumors have revealed that cancers exhibit on average ∼60–90 genetic alterations per tumor [1], [2]. The majority of these genetic alterations target players in a limited set of signalling transduction pathways or processes [1], [2]. These analyses suggest that therapeutic targeting of specific altered oncogenes may be too narrow an approach for drug development, but rather targeting nodes that reside downstream of these pathways may offer broader acting therapies [1], [2]. Indeed, the process of translation is a node for several signalling pathways and has been shown to be a potential therapeutic target.
One approach to study genotype-drug response relationships has been the use of mechanism-based mouse cancer models, such as the Eμ-Myc lymphoma model [3]. In this model, activating lesions in PI3K/AKT/mTOR signalling not only accelerate tumorigenesis, but also modulate chemosensitivity [4], [5], [6]. Resistance to doxorubicin (Dxr) or cyclophosphamide in myr-AKT activated or PTEN+/−Eμ-Myc lymphomas has been linked to (a) defective apoptotic program(s) dependent on increased mTOR activity and linked to elevated translation initiation rates.
mTOR impinges on the translation process by regulating the assembly of eukaryotic initiation factor (eIF) 4F, a heterotrimeric complex consisting of: eIF4E, a cap (m7GpppN, where N in any nucleotide) binding protein; eIF4A, a DEAD-box RNA helicase; and eIF4G, a large scaffolding protein involved in recruiting the 40S ribosome (and associated factors) [7]. Increased eIF4F activity is thought to increase translation rates since eIF4E is the least abundant translation factor and initiation is generally rate-limiting for translation [8], [9]. Increased eIF4F activity stimulates preferentially the translation of mRNA with G+C rich, highly-structured 5′UTRs (weak mRNAs) without significantly affecting translation of mRNAs with short and unstructured 5′UTRs (strong mRNAs) [10], [11], [12]. Typically, strong mRNAs encode house keeping genes like β-actin and GAPDH whereas weak mRNAs encode potent growth and survival factors, such as the angiogenesis factors VEGF and FGF-2, the proto-oncoproteins cyclin D1 and c-Myc, and the pro-survival factors myeloid cell leukemia sequence 1 (Mcl-1) and survivin [13], [14], [15].
Preventing eIF4F assembly by inhibiting mTOR signalling with rapamycin (Rap) [6], [16] or blocking eIF4F activity with silvestrol, an inhibitor of the ribosome-recruitment step of translation initiation [17], can sensitize Eμ-Myc lymphomas with elevated mTOR signalling to the cytotoxic action of Dxr, though neither of these treatments on their own is effective. eIF4E is oncogenic in vivo and in Eμ-Myc lymphomas over-expressing this factor, rapamycin is unable to modulate chemosensitivity whereas silvestrol can [6], [16], [18], [19]. The mechanism by which Rap and silvestrol alter chemosensitivity is not clear but may involve remodelling of the oncoproteome through differential mRNA recruitment into initiation complexes [13], with preferred inhibition of “weak” mRNAs encoding pro-survival signals, such as Mcl-1 [4], [17], [20]
Interestingly, several inhibitors of translation elongation have also been reported to exert significant anti-cancer activity. This creates somewhat of a paradox as elongation inhibitors are not expected to be selective in their mode of action and would be expected to possess a narrow therapeutic window. Yet, homoharringtonine (HHT) (a cephalotaxus alkaloid) has demonstrated activity in patients with chronic myeloid leukemia after imatinib failure [21]. Aplidine [a didemnim (Did) family member] has shown activity in phase I clinical trials for many cancer types but especially in advanced medullar thyroid carcinoma [22]. Bruceantin [(Bru); a quassinoid], showed efficacy in a RPMI 8226 human-SCID xenografts mouse model [23].
To address whether inhibitors of translation elongation could also synergize with DNA damaging agents (e.g. Dxr), we tested the potential of four elongation inhibitors to modulate chemosensitivity in the Eμ-myc model harboring lymphomas with loss of Pten or Tsc2 or over-expressing Bcl-2 or eIF4E. We find that all inhibitors tested can alter the chemosensitivity of tumors harboring activated mTOR, but not in Bcl-2-driven tumors. We observe that these compounds reduce Mcl-1 levels and postulate that they cause a reduction in the levels of short-lived proteins, some of which are pro-survival factors. We propose that this resets the apoptotic program. These results provide a mechanism by which elongation inhibitors sensitize cells to apoptotic triggers.
Materials and Methods
Ethics Statement
Animal studies were approved by the McGill University Faculty of Medicine Animal Care Committee.
Compound preparation and storage
HHT (Sigma-Aldrich, St.-Louis, MO), cycloheximide (CHX) (BioShop, Burlington, On), didemnin B (Did B) (NCI-DTP), Bru (NCI-DTP) and MG132 (Sigma-Aldrich, St.-Louis, MO) were resuspended in DMSO and stored at −70°C. Doxorubicin (Sigma-Aldrich, St.-Louis, MO) was dissolved in water and stored at 4°C. Rap (LC Laboratories, Woburn, MA) was resuspended in 100% ethanol and stored at −70°C.
Cell culture and in vitro synergy assays
Mice bearing palpable Tsc2+/−Eμ-myc lymphomas were sacrificed, lymph nodes extracted, and tumor cells harvested by gently crushing the lymph nodes between two microscope slides. Cells were then put into culture in B-cell medium (BCM) (50% DMEM/50% IMDM) (Invitrogen, Carlsbad, CA), supplemented with 55 µM β-mercaptoethanol, Pen/Strep (Invitrogen, Carlsbad, CA) and Glutamine (Invitrogen, Carlsbad, CA) over an irradiated NIH3T3 feeder layer. For ex vivo synergy experiments, 105 Tsc2+/−Eμ-myc cells were plated in 96-well plates in the presence of HHT (0.625 nM to 160 nM), MG132 (0.039 µM to 20 µM), Dxr (0.0975 µg/ml to 10 ug/ml) or various combinations thereof. Sixteen hours later, cell viability was assessed with the CellTiter 96® Non-Radioactive Cell Proliferation Assay (MTT) according to the manufacturer recommendations (Promega, Madison, WI). Synergy between compound treatments was calculated using compusyn software (ComboSyn Inc.).
Treatment studies
The generation of Pten+/−Eμ-Myc, Tsc2+/−Eμ-Myc, Eμ-Myc/Bcl-2 and Eμ-Myc/eIF4E lymphomas has been previously described [6], [16]. A total of 106 secondary lymphoma cells were injected into the tail vein of 6–8 week old female C57BL/6 mice. When well-palpable tumors arose, mice were treated with Dxr (once at 10 mg/kg), Rap (4 mg/kg daily for 5 days), HHT (0.25 mg/kg daily for 5 days), Bru (0.5 mg/kg daily for 5 days), Did B (0.05 mg/kg daily for 5 days), or CHX (12.5 mg/kg for 5 days). The compounds were diluted into 5.2% PEG400/5.2% Tween 80 immediately prior to intraperitoneal (IP) injection. In combination studies, Rap, HHT, Bru, Did B or CHX were administered once daily for 5 consecutive days, with Dxr being administered once on day two. The presence of the tumors was monitored by daily palpation and blood smears (twice/week) stained with Hema-3® stain (Fisher Scientific, Pittsburg, PA). Tumor-free survival is defined as the time between tumor disappearance and reappearance of a palpable lymphoma. Overall survival is defined as the time after tumor disappearance required for the mice to reach a terminal stage at which point the animals were sacrificed. The data were analyzed in the Kaplan-Meier format using the log-rank (Mantel-Cox) test for statistical significance (SigmaStat software).
TUNEL (terminal deoxyribonucleotide transferase-mediate nick-end labeling) assays and Western blotting
For TUNEL assays, 6–8 week old C57Bl/6 mice bearing well-palpable tumors were treated once with Rap (4 mg/kg), HHT (0.25 mg/kg), Bru (0.5 mg/kg), Did B (0.5 mg/kg), or CHX (12.5 mg/kg) and the next day were treated again with or without Dxr (10 mg/kg). Four hours later, tumors were removed and fixed in 10% Neutral Buffered Formalin (NBF) overnight and embedded in paraffin. Tumor sections (4 µm) were used in TUNEL assays according to the manufacturer's recommendations (Roche Applied Science, Indianapolis, IN) and stained with Hematoxylin to visualize cell boundaries. For Western blot analysis, mice were treated for the indicated times, the tumors harvested, total cell lysates prepared using RIPA buffer, and proteins separated by SDS-PAGE. The antibodies used were: β-actin (Sigma-Aldrich, St.-Louis, MI), cleaved PARP (Cell Signalling, Beverly, MA), Mcl-1 (Rockland antibodies, Gilbertsville, PA), cyclin D1 (Cell signalling, Beverly, MA), c-Myc (Santa cruz biotechnology, Santa Cruz, CA), and α-tubulin (Sigma-Aldrich, St.-Louis, MI). Total protein content of each extract was determined using the DC protein assay (Biorad, Richmond, CA).
Ribosome binding and polysome analysis
Ribosome binding experiments were performed as previously described [24]. In brief, 32P-labelled CAT mRNA was incubated with rabbit reticulocyte lysate in the presence of 10 µM HHT+600 µM CHX, 10 µM Bru+600 µM CHX, CHX alone or no compounds for 10 min at 30°C. Translation initiation complexes formed were resolved on 10–30% glycerol gradients by centrifugation for 3.5 h at 39,000 rpm (187,000×g) in an SW41 rotor. The gradients were then fractionated using a UA-6 UV detector (ISCO, Lincoln, NE) with a Brandel tube piercer and the radioactivity in each fraction was determined by Cerenkov counting.
For polysome analysis, mice bearing well-palpable lymphomas were injected IP with HHT (0.25 mg/kg) or Bru (0.5 mg/kg) diluted into 5.2% PEG400/5.2% Tween 80. Two hours later, the tumors were harvested, washed with PBS and lysed in hypotonic lysis buffer (5 mM Tris7.5, 2.5 mM MgCl2, 1.5 mM KCl, 2 mM DTT, 1% Triton X-100, 0.5% Sodium Deoxycholate) in the presence of 100 µg/mL CHX. The extracts were centrifuged through a 10–50% sucrose gradient at 35,000 rpm (150,000×g) for 2 h in an SW40 rotor, followed by fractionation of the gradients using a UA-6 UV detector (ISCO, Lincoln, NE) using a Brandel tube piercer. Total RNA from every second fraction was isolated using Trizol (Invitrogen Carlsbad, CA). The amount of Mcl-1, Cyclin D1, c-Myc and β-actin mRNAs were detected by qRT-PCR using the Roche Diagnostics LightCycler instrument and LightCycler RNA master SYBR green I kit according to the manufacturer's instruction. The primers used for qRT-PCR were: c-Myc: 5′TGCGACTGACCCAACATCAG3′ and 5′CCTGTCCTGGCTCGCAGATT3′ ; Cyclin D1: 5′CAGGTTCCTGTTCACAATACCTCA3′ and 5′AGACCGCCCACCTGCC3′ , Mcl-1 5′AGCACATTTCTGATGCCGCCT3′ and 5′GTGCCTTTGTGGCCAAACACT3′ ; and β-actin: 5′TCACTATTGGCAACGAGCGGTT3′ and 5′TGTCAGCAATGCCTGGGTACAT3′ .
Results
Inhibition of translation elongation can alter chemosensitivity
A large number of translation elongation inhibitors have been tested in NIH's Developmental Therapeutics Program to assess the chemotherapeutic potential of small molecules in various mouse cancer models as single agents (Fig. S1). A significant fraction of these show activity, although in many cases, these results are restricted to a single dose, delivery route, or cancer model. In addition, a shortcoming of these assays is that they do not assess for a compounds' ability to modulate chemosensitivity. We therefore chose to use the Eμ-Myc lymphoma model to assess the anti-cancer and chemosensitization activity of translation elongation inhibitors. In this study, we used four structurally different elongation inhibitors: HHT, CHX, Bru, and Did B (Fig. 1A). HHT and Bru inhibit the first steps of elongation whereas Did B and CHX block translocation by interfering with elongation factor and E site function, respectively ([25], and this report).
Compounds were tested in combination with Dxr, using a delivery regiment consisting of 5 daily injections of compound, with delivery of one bolus of Dxr on the second day of treatment [16]. For these studies, we used mice bearing Pten+/−Eμ-Myc lymphomas since mTOR is activated in these tumors and they respond to the combination of Dxr and Rap treatment [16], as well as to combinations of Dxr and the translation initiation inhibitor, silvestrol [17]. As single agents, none of the elongation inhibitors tested induced remissions (Fig. 1B). Dxr and Rap as single agents induced a slight remission that lasted on average 5 days, as previously reported [17]. In contrast, all four elongation inhibitors and Rap synergized with Dxr to extend the tumor-free period and overall survival 2–3 fold (Figs 1B and S2). Enhanced drug sensitivity was associated with increased apoptosis for all drug treatment combinations, compared to single agent treatments (Fig. 1C). Consistent with this interpretation, the observed enhanced sensitivity to Dxr/elongation inhibitor combination was also associated with elevated PARP cleavage (Fig. 1D). As single agents, none of the inhibitors significantly induced PARP cleavage (Fig. 1D).
To assess the efficacy of translation elongation inhibitors on Rap-resistant lymphomas, we examined the activity of these compounds on Eμ-Myc/eIF4E lymphomas. These lymphomas over-express eIF4E and are resistant to Dxr+Rap combination treatment [6], [16] (Fig. 2A), but sensitive to the combination of Dxr and silvestrol, an eIF4A activity modulator [17]. As observed with Pten+/−Eμ-Myc lymphomas, treatment of mice bearing Eμ-Myc/eIF4E lymphomas with any of the elongation inhibitors alone was not effective in inducing remissions (Fig. 2A). Treatment with Dxr, Rap, or Rap+Dxr caused a short-lived remission (∼5 days) in ∼50% of the mice (Fig. 2A). However, combination therapy with any one of the four translation inhibitors and Dxr produced tumor-free remissions that lasted up to 25 days (Fig. 2A) and also extended the survival of the mice (Fig. S3A). We do not believe that an inherent feature of Eμ-Myc lymphomas make them particularly sensitive to the effects of elongation inhibitor/Dxr combination since Eμ-Myc/Bcl-2 lymphomas showed significant resistance to these drug combinations (Fig. 2B). Bcl-2 was able to protect against PARP cleavage by these treatments (Fig. 2C). All treatments that extend the tumor-free period in mice bearing Eμ-Myc/eIF-4E lymphomas had no effect on overall survival in mice bearing Eμ-Myc/Bcl-2 tumors (Fig. S3B).
Degradation of short-lived proteins following exposure to translation elongation inhibitors
Several of the proteins that play important regulatory roles in cancer progression and apoptosis have short half-lives (e.g. cyclin D1 (∼25 min) [26]; c-Myc (∼25 min) [27]; myeloid cell leukemia-1 (Mcl-1) (∼40 min) [28]. The level of these proteins is particularly sensitive to ongoing protein synthesis rates and can be affected by cellular stresses or treatment with translation inhibitors in cell culture. For example, the anti-apoptotic factor Mcl-1, a short-lived Bcl-2 family member essential for normal haematopoiesis and constitutively targeted to the proteasome by the E3 Ligase MULE [29], is rapidly degraded upon UV-irradiation [30] or HHT treatment [31]. c-Myc protein levels have been shown to rapidly decline upon CHX treatment [32]. Since the inhibitors we were using are predicted to affect global translation, we rationalized that one mechanism by which they could be affecting survival is through allowing the rapid loss of short-lived pro-survival factors from cells treated with translation inhibitors to facilitate pro-apoptotic triggering.
We then sought to verify the levels of three short-lived proteins in vivo in Pten+/−Eμ-Myc lymphomas treated in tumor-bearing mice (Fig. 3). Following delivery of 2 doses of compound over a 24-hr period, tumors were isolated 4 hrs after the 2nd injection. By 28 hrs post-drug delivery, there was a reduction in the amount of Mcl-1, Cyclin D1, and c-Myc protein levels in Pten+/−Eμ-Myc lymphomas relative to vehicle-treated controls (Fig. 3A, compare lanes 2–6 to 1) whereas the levels of β-actin or Bcl-2 did not appreciably change over this time period. Using the same treatment schedule, no significant change in Mcl-1, cyclin D1, and c-Myc mRNA level was observed in the tumors with the elongation inhibitors (Fig 3B).
HHT and Bru block translation in Pten+/−Eμ-Myc lymphomas
To provide direct evidence that the compounds being used actually are targeting the translation process in tumor cells in vivo; we analyzed the polyribosome content of Pten+/−Eμ-Myc tumors from mice treated with the elongation inhibitors. We focussed on HHT and Bru, since the polysomes from CHX or Did B treated tumors would resemble untreated controls, as both of these compounds cause ribosome stalling on mRNA templates [25]. Although HHT and Bru are regarded as elongation inhibitors, their mode of action has not been well defined. Both compounds inhibit the peptidyl transferase reaction [33], [34], [35], [36] and are thought to bind tighter to free ribosomes than translating ribosomes [33], [34]. When added to actively translating reactions, there is a 2–4 minute lag before onset of inhibition is observed [33], [37], suggesting that the compounds allow ribosome run-off. To obtain more direct evidence that both these compounds block elongation and do not affect ribosome loading, we tested their ability to counter the formation of the CHX-induced stable 80S complexes on mRNA templates in in vitro ribosome binding assays. Sedimentation velocity centrifugation was used to separate 80S complexes from unbound radiolabelled mRNA (Fig. S4). HHT and Bru were thus tested in combination with CHX, to monitor their effect on ribosome loading. The results indicate that, both HHT and Bru do not significantly interfere with the trapping of 80S complexes by CHX when compared to the binding obtained without CHX. Furthermore, when tested as single agents in this assay, HHT and Bru induce a peak comparable in height to the one obtained with CHX alone (data not shown). Taken together with the fact that these compounds allow ribosome run-off, we conclude that they do not affect ribosome loading but rather block the first step of elongation. The polyribosomal content of Pten+/−Eμ-Myc tumors that had been treated with vehicle, HHT, or Bru indicates a drop in the polyribosomal content of the HHT− and Bru-treated tumors with a concomitant increase in amount of 80S ribosomes (Fig. 4). We found that the polysome to monosome ratio (P/M) in drug-treated tumors decreased ∼4–6 fold compared to vehicle-treated samples (Fig. 4).
Decreased levels of Mcl-1, Cyclin D1, and c-Myc in Pten+/−Eμ-Myc tumors treated with translation elongation inhibitors
We next addressed whether the decrease in Mcl-1, Cyclin D1, and c-Myc observed upon treatment of Pten+/−Eμ-Myc tumors with elongation inhibitor was due to a reduction in their translation. To this end, we isolated RNA from fractions that spanned the polyribosomes of Pten+/−Eμ-Myc tumors taken 2 hr after treatment with HHT−, Bru- or vehicle (Fig. 4). The relative amount of mRNA in every second fraction was determined by qRT-PCR and plotted as a percentage of total mRNA (Fig. 5). Treatment of mice bearing Pten+/−Eμ-Myc tumors with either HHT or Bru led to a shift in Mcl-1, cyclin D1, c-Myc, and β-actin mRNAs from heavy polysomes (fractions 20–24) into lighter polysomes (fractions 6–12), consistent with these compounds partially inhibiting global protein synthesis in vivo. The reasons for the partial inhibition of protein synthesis will be addressed in the Discussion.
If a reduction in levels of essential short-lived proteins is associated with the synergistic effects observed between inhibitors of elongation and Dxr, then one might expect that the presence of a proteasome inhibitor in this system might antagonize the effects of protein synthesis blockade. For this purpose, we used Tsc2+/−Eμ-Myc lymphomas cultured ex vivo [20]. As documented for Pten+/−Eμ-Myc lymphomas, inhibiting translation elongation in Tsc2+/−Eμ-Myc lymphomas also synergizes with Dxr to induce remissions in mice that lasted for up to 28 days (Fig. S5A). Rap also synergized with Dxr in this setting as previously established [4] and was able to inhibit mTOR activity as determined by p-S6 blotting (Fig. S5B). As well, HHT is able to block translation in mice bearing Tsc2+/−Eμ-Myc lymphomas as revealed by polysome analysis of tumors two hours following compound administration (Fig. S5C). Tsc2+/−Eμ-Myc lymphomas were cultured ex vivo and exposed for various times to a concentration of compound sufficient to completely block global protein synthesis (Fig. S6). Treatments also included a 30-min pre-exposure to the proteasome-inhibitor MG132 [38]. Following incubation, the levels of Mcl-1, c-Myc, Cyclin D1 and β-actin were determined by Western blotting (Fig. 6A–D). As predicted, exposure of cells to HHT, Did B, Bru or CHX lead to a drastic reduction in Mcl-1, cyclin D1, and c-Myc protein levels (compare lanes 2–4 to lane 1). Consistent with this being a selective loss of proteins, β-actin levels did not significantly change (Fig. 6A–D, compare lanes 2–4) nor was the Coomassie-visible protein profile altered (data not shown) when comparing pre- and post-drug exposure. Pre-exposure of cells to MG132 followed by addition of elongation inhibitors strongly blocked the reduction in Mcl-1, Cyclin D1, and c-Myc protein levels (Fig. 6A–D, compare lanes 6–8 to 2–4). Given this result, we sought to determine what effect MG132 would have on HHT− or Rap-induced cell death in Tsc2+/−Eμ-Myc lymphomas. Tumor cells were exposed to HHT or Rap in the presence or absence of a fixed concentration of MG132 (10 µM) and cell viability determined (Fig 7A). The results indicate that inhibition of the proteasome antagonizes the toxicity of HHT and Rap on these cells with at least 2–3 fold more cells surviving at the highest dose of translation inhibition tested. These results are in agreement with previous work that showed that MG132 can protect against CHX-induced apoptosis in U397 cells [39]. To assess if MG132 would also antagonize the synergy we observed between elongation inhibitors and Dxr, we exposed Tsc2+/−Eμ-myc lymphomas to HHT or Rap with Dxr. Median effect analysis indicated a combination index (CI) below 1 for Dxr+HHT and Rap+Dxr indicative of synergy [40] (Fig 7B). The presence of MG132 antagonized both Dxr+HHT and Dxr+Rap combinations, with CI values extending above 1 (Fig 7B). The ability of the proteasome inhibitor MG132 to curtail the synergy between HHT and Dxr is consistent with HHT modulating drug sensitivity by causing loss of short-lived pro-survival factors.
Discussion
Inhibitors of elongation have been previously tested in murine cancer models for their anti-cancer properties as single agents (Fig. S1), as well as identified as genotype-selective antitumor agents in synthetic lethal screens [41]. The potential synergy between translation elongation inhibitors and DNA damaging agents has only been tested in cell culture. CHX has been reported to enhance the cytotoxicity of the anthracycline, epirubicin, against P388 murine leukemic cells [42] and to potentiate Dxr toxicity in RKO-E6 cells [43]. Sparsomycin, pretazettine, and HHT also show synergy with antitumor agents against tumor cells ex vivo [44], [45], [46], [47]. Finally, translation elongation inhibitors have been shown to sensitize PC3 cells to TRAIL-induced apoptosis [48] and A549 lung cancer or K562 leukemia cells to cisplatin [49]. In other settings however, CHX and anguidine have protected cells against the cytotoxic effects of antitumor drugs [50], [51], [52]. Differences in underlying genetic lesions among tumors could be responsible for these different responses [53]. Despite the large amount of studies documenting the behaviour of translation elongation inhibitors in cell lines, testing the potential of elongation inhibitors to synergize with standard-of-care agents in animal models has not been systematically approached.
We demonstrate here that the elongation inhibitors HHT, Bru, Did B and CHX modulate the chemosensitivity of Pten+/−Eμ-Myc, Tsc2+/−Eμ-Myc and Eμ-Myc/eIF4E tumors to the effects of Dxr whereas Eμ-Myc/Bcl2 tumors were largely refractory to combination therapy. These treatments in the Pten+/−Eμ-Myc induce an apoptotic response in these chemoresistant tumors as determined by TUNEL analysis and PARP cleavage (Fig. 1). The mechanism by which inhibitors modulate chemoresponsiveness remains to be clearly established, but at the doses tested we observed a correlation between tumor disappearance and inhibition of translation in the tumors (Fig 4A). However, we note that only partial inhibition of protein synthesis was observed in vivo with these compounds (Figs. 4A and 5). Pharmacological properties of some of these compounds (serum binding, serum half-life, clearance, or cell permeability) may be the underlying reason why some inhibitors function better than others. The terminal half-life of HHT has been determined to be 14.4 hrs in human [54] and 40.6 hrs in dogs [55]. The clearance of Did B from the blood of human patients is biphasic with apparent half-lives of 0.12 and 4.8 hrs [56] and its observed terminal half-life in mice is 16.2 hrs [57]. The elimination half-life of Bru in mice has been estimated to be greater than 12 hrs and in human serum it is biphasic and progresses through an initial fast half-life of 15 min followed by a second half-life of 0.7–13.8 hrs depending on the patients [58]. Clearly, these compounds display a wide range of pharmacokinetic and pharmacodynamic behaviour.
Our results suggest that a decrease in the levels of factors, like Mcl-1, cyclin D1, and c-Myc might reorganize the onco-proteome allowing transformed cells to become sensitive to Dxr through mechanisms that include re-establishment of the apoptotic program (Fig. 1C). The role of Mcl-1 in enhancing cell survival by blocking activation of the pro-apoptotic factors Bak and Bax has been well-established in culture [39], [59], [60] and c-Myc controls the expression of genes involved in many aspects of cell growth including cell cycle progression and survival [61]. Cyclin D1 has been shown to bind to CDK4 and CDK6 leading to inactivation of Rb1, thus facilitating the transition from G1 to S phase and overcoming the transition inhibition by cyclin dependent kinase inhibitors [62], [63]. It is noteworthy that as single agents, none of these compounds showed activity in the Eμ-myc model, compared to other mouse models where activity was sometimes detected (Fig. S1). Similar results have been documented for the mTOR inhibitor, rapamycin [5], [6], and the eIF4A modulator, silvestrol [17], and suggests that the tumors derived from the Eμ-Myc model require a DNA damage trigger to undergo apoptosis when translation is inhibited.
Many possiblities could explain the resistance of the Eμ-Myc/Bcl-2 tumors to Dxr/elongation inhibitor combination (Fig. 2B). This could be due to the longer half-life of this anti-apoptotic factor (∼10 hrs) [64] combined to the only partial inhibition of protein synthesis achieved in vivo by these compounds (Fig. 5). Alternatively, reduced levels of short-lived proteins (e.g. Mcl-1, cyclin D1, or c-Myc) could be better tolerated in the Eμ-Myc/Bcl-2 tumors than in the other models. Further work would be required to formally demonstrate the mechanism of resistance by Bcl-2 overexpression in this mouse model. We cannot exclude the possibility that the compounds tested herein modulate the cytotoxicity of Dxr through other mechanisms, such as affecting serum half-life of Dxr, increasing intracellular drug levels by altering the expression of polypeptide(s) involved in transport, or by affecting detoxification [49].
Why would inhibiting translation elongation achieve a therapeutic index, since it is expected that translation of all mRNAs would be inhibited to the same extent by such inhibitors? It is possible that, by having higher translation rates [4], [65] transformed cells are more sensitive to these compounds even when they exert partial inhibitory activity. Alternatively, as the cells transform into cancer cells, they are thought to select for higher oncogene activity or expression and become “addicted” to these oncogenes [66]. Some of these oncogenic proteins possess short half-lives and are likely to be selectively depleted by elongation inhibitors driving the transformed cells towards apoptosis. Our work provides a rationale for using elongation inhibitors to modulate chemosensitivity in tumors.
Supporting Information
Footnotes
Competing Interests: The authors have declared that no competing interests exist.
Funding: This work was supported by NCIC (#17099) and CIHR (MOP-79385) grants to J. Pelletier. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Sjoblom T, Jones S, Wood LD, Parsons DW, Lin J, et al. The consensus coding sequences of human breast and colorectal cancers. Science. 2006;314:268–274. doi: 10.1126/science.1133427. [DOI] [PubMed] [Google Scholar]
- 2.Wood LD, Parsons DW, Jones S, Lin J, Sjoblom T, et al. The genomic landscapes of human breast and colorectal cancers. Science. 2007;318:1108–1113. doi: 10.1126/science.1145720. [DOI] [PubMed] [Google Scholar]
- 3.Schmitt CA, Lowe SW. Apoptosis and chemoresistance in transgenic cancer models. J Mol Med. 2002;80:137–146. doi: 10.1007/s00109-001-0293-3. [DOI] [PubMed] [Google Scholar]
- 4.Mills JR, Hippo Y, Robert F, Chen SM, Malina A, et al. mTORC1 promotes survival through translational control of Mcl-1. Proc Natl Acad Sci U S A. 2008;105:10853–10858. doi: 10.1073/pnas.0804821105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Wendel HG, De Stanchina E, Fridman JS, Malina A, Ray S, et al. Survival signalling by Akt and eIF4E in oncogenesis and cancer therapy. Nature. 2004;428:332–337. doi: 10.1038/nature02369. [DOI] [PubMed] [Google Scholar]
- 6.Wendel HG, Malina A, Zhao Z, Zender L, Kogan SC, et al. Determinants of sensitivity and resistance to rapamycin-chemotherapy drug combinations in vivo. Cancer Res. 2006;66:7639–7646. doi: 10.1158/0008-5472.CAN-06-0419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Hay N, Sonenberg N. Upstream and downstream of mTOR. Genes Dev. 2004;18:1926–1945. doi: 10.1101/gad.1212704. [DOI] [PubMed] [Google Scholar]
- 8.Duncan R, Milburn SC, Hershey JW. Regulated phosphorylation and low abundance of HeLa cell initiation factor eIF-4F suggest a role in translational control. Heat shock effects on eIF-4F. J Biol Chem. 1987;262:380–388. [PubMed] [Google Scholar]
- 9.Raught B, Gingras A-C, Sonenberg N. Regulation of ribosome recruitment in eukaryotes. In: Sonenberg N, Hershey JWB, Mathews MB, editors. Translational control of gene expression. Cold Spring Harbor: Cold Spring Harbor Laboratory Press; 2000. pp. 245–293. [Google Scholar]
- 10.Pelletier J, Sonenberg N. Insertion mutagenesis to increase secondary structure within the 5′ noncoding region of a eukaryotic mRNA reduces translational efficiency. Cell. 1985;40:515–526. doi: 10.1016/0092-8674(85)90200-4. [DOI] [PubMed] [Google Scholar]
- 11.Larsson O, Perlman DM, Fan D, Reilly CS, Peterson M, et al. Apoptosis resistance downstream of eIF4E: posttranscriptional activation of an anti-apoptotic transcript carrying a consensus hairpin structure. Nucleic Acids Res. 2006;34:4375–4386. doi: 10.1093/nar/gkl558. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.De Benedetti A, Graff JR. eIF-4E expression and its role in malignancies and metastases. Oncogene. 2004;23:3189–3199. doi: 10.1038/sj.onc.1207545. [DOI] [PubMed] [Google Scholar]
- 13.Mamane Y, Petroulakis E, Martineau Y, Sato TA, Larsson O, et al. Epigenetic activation of a subset of mRNAs by eIF4E explains its effects on cell proliferation. PLoS ONE. 2007;2:e242. doi: 10.1371/journal.pone.0000242. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Rajasekhar VK, Viale A, Socci ND, Wiedmann M, Hu X, et al. Oncogenic Ras and Akt signaling contribute to glioblastoma formation by differential recruitment of existing mRNAs to polysomes. Mol Cell. 2003;12:889–901. doi: 10.1016/s1097-2765(03)00395-2. [DOI] [PubMed] [Google Scholar]
- 15.Graff JR, Konicek BW, Carter JH, Marcusson EG. Targeting the eukaryotic translation initiation factor 4E for cancer therapy. Cancer Res. 2008;68:631–634. doi: 10.1158/0008-5472.CAN-07-5635. [DOI] [PubMed] [Google Scholar]
- 16.Wendel H-G, de Stanchina E, Fridman JS, Malina A, Ray S, et al. Survival signalling by Akt and eIF4E in oncogenesis and cancer therapy. Nature. 2004;428:332–337. doi: 10.1038/nature02369. [DOI] [PubMed] [Google Scholar]
- 17.Bordeleau ME, Robert F, Gerard B, Lindqvist L, Chen SM-H, et al. Therapeutic suppression of translation initiation modulates chemosensitivity in a mouse lymphoma model. J Clin Inv. 2008;118:1–11. doi: 10.1172/JCI34753. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Lazaris-Karatzas A, Montine KS, Sonenberg N. Malignant transformation by a eukaryotic initiation factor subunit that binds to mRNA 5′ cap. Nature. 1990;345:544–547. doi: 10.1038/345544a0. [DOI] [PubMed] [Google Scholar]
- 19.Ruggero D, Montanaro L, Ma L, Xu W, Londei P, et al. The translation factor eIF-4E promotes tumor formation and cooperates with c-Myc in lymphomagenesis. Nat Med. 2004;10:484–486. doi: 10.1038/nm1042. [DOI] [PubMed] [Google Scholar]
- 20.Mills JR, Hippo Y, Robert F, Chen SMH, Malina A, et al. mTORC1 promotes survival through translational control of Mcl-1. Proc Natl Acad Sci U S A. 2008;105:10853–10858. doi: 10.1073/pnas.0804821105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Quintas-Cardama A, Kantarjian H, Garcia-Manero G, O'Brien S, Faderl S, et al. Phase I/II study of subcutaneous homoharringtonine in patients with chronic myeloid leukemia who have failed prior therapy. Cancer. 2007;109:248–255. doi: 10.1002/cncr.22398. [DOI] [PubMed] [Google Scholar]
- 22.Le Tourneau C, Raymond E, Faivre S. Aplidine: a paradigm of how to handle the activity and toxicity of a novel marine anticancer poison. Curr Pharm Des. 2007;13:3427–3439. [PubMed] [Google Scholar]
- 23.Cuendet M, Pezzuto JM. Antitumor activity of bruceantin: an old drug with new promise. J Nat Prod. 2004;67:269–272. doi: 10.1021/np030304+. [DOI] [PubMed] [Google Scholar]
- 24.Novac O, Guenier AS, Pelletier J. Inhibitors of protein synthesis identified by a high throughput multiplexed translation screen. Nucleic Acids Res. 2004;32:902–915. doi: 10.1093/nar/gkh235. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Pelletier J, Peltz SW. Therapeutic Opportunities in Translation. In: Matthews M, Hershey JW, Sonenberg N, editors. Cold Spring Harbor: Cold Spring Harbor Laboratories; 2007. [Google Scholar]
- 26.Diehl JA, Cheng M, Roussel MF, Sherr CJ. Glycogen synthase kinase-3beta regulates cyclin D1 proteolysis and subcellular localization. Genes Dev. 1998;12:3499–3511. doi: 10.1101/gad.12.22.3499. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Hann SR, Eisenman RN. Proteins encoded by the human c-myc oncogene: differential expression in neoplastic cells. Mol Cell Biol. 1984;4:2486–2497. doi: 10.1128/mcb.4.11.2486. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Schubert KM, Duronio V. Distinct roles for extracellular-signal-regulated protein kinase (ERK) mitogen-activated protein kinases and phosphatidylinositol 3-kinase in the regulation of Mcl-1 synthesis. Biochem J. 2001;356:473–480. doi: 10.1042/0264-6021:3560473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Chen D, Kon N, Li M, Zhang W, Qin J, et al. ARF-BP1/Mule is a critical mediator of the ARF tumor suppressor. Cell. 2005;121:1071–1083. doi: 10.1016/j.cell.2005.03.037. [DOI] [PubMed] [Google Scholar]
- 30.Nijhawan D, Fang M, Traer E, Zhong Q, Gao W, et al. Elimination of Mcl-1 is required for the initiation of apoptosis following ultraviolet irradiation. Genes Dev. 2003;17:1475–1486. doi: 10.1101/gad.1093903. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Tang R, Faussat AM, Majdak P, Marzac C, Dubrulle S, et al. Semisynthetic homoharringtonine induces apoptosis via inhibition of protein synthesis and triggers rapid myeloid cell leukemia-1 down-regulation in myeloid leukemia cells. Mol Cancer Ther. 2006;5:723–731. doi: 10.1158/1535-7163.MCT-05-0164. [DOI] [PubMed] [Google Scholar]
- 32.Alarcon-Vargas D, Tansey WP, Ronai Z. Regulation of c-myc stability by selective stress conditions and by MEKK1 requires aa 127–189 of c-myc. Oncogene. 2002;21:4384–4391. doi: 10.1038/sj.onc.1205543. [DOI] [PubMed] [Google Scholar]
- 33.Fresno M, Jimenez A, Vazquez D. Inhibition of translation in eukaryotic systems by harringtonine. Eur J Biochem. 1977;72:323–330. doi: 10.1111/j.1432-1033.1977.tb11256.x. [DOI] [PubMed] [Google Scholar]
- 34.Tujebajeva RM, Graifer DM, Matasova NB, Fedorova OS, Odintsov VB, et al. Selective inhibition of the polypeptide chain elongation in eukaryotic cells. Biochim Biophys Acta. 1992;1129:177–182. doi: 10.1016/0167-4781(92)90484-h. [DOI] [PubMed] [Google Scholar]
- 35.Liao LL, Kupchan SM, Horwitz SB. Mode of action of the antitumor compound bruceantin, an inhibitor of protein synthesis. Mol Pharmacol. 1976;12:167–176. [PubMed] [Google Scholar]
- 36.Willingham W, Jr, Stafford EA, Reynolds SH, Chaney SG, Lee KH, et al. Mechanism of eukaryotic protein synthesis inhibition by brusatol. Biochim Biophys Acta. 1981;654:169–174. doi: 10.1016/0005-2787(81)90168-4. [DOI] [PubMed] [Google Scholar]
- 37.Huang MT. Harringtonine, an inhibitor of initiation of protein biosynthesis. Mol Pharmacol. 1975;11:511–519. [PubMed] [Google Scholar]
- 38.Rock KL, Gramm C, Rothstein L, Clark K, Stein R, et al. Inhibitors of the proteasome block the degradation of most cell proteins and the generation of peptides presented on MHC class I molecules. Cell. 1994;78:761–771. doi: 10.1016/s0092-8674(94)90462-6. [DOI] [PubMed] [Google Scholar]
- 39.Adams KW, Cooper GM. Rapid turnover of mcl-1 couples translation to cell survival and apoptosis. J Biol Chem. 2007;282:6192–6200. doi: 10.1074/jbc.M610643200. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Chou T, Talalay P. Quantitative analysis of dose-effect relationships: the combined effects of multiple drugs or enzyme inhibitors. Adv Enzyme Regul. 1984;22:27–55. doi: 10.1016/0065-2571(84)90007-4. [DOI] [PubMed] [Google Scholar]
- 41.Dolma S, Lessnick SL, Hahn WC, Stockwell BR. Identification of genotype-selective antitumor agents using synthetic lethal chemical screening in engineered human tumor cells. Cancer Cell. 2003;3:285–296. doi: 10.1016/s1535-6108(03)00050-3. [DOI] [PubMed] [Google Scholar]
- 42.Furusawa S, Nakano S, Wada M, Chiba H, Takayanagi M, et al. Augmentation of epirubicin cytotoxicity by cycloheximide. Res Commun Mol Pathol Pharmacol. 1996;91:245–248. [PubMed] [Google Scholar]
- 43.Smukste I, Bhalala O, Persico M, Stockwell BR. Using small molecules to overcome drug resistance induced by a viral oncogene. Cancer Cell. 2006;9:133–146. doi: 10.1016/j.ccr.2006.01.012. [DOI] [PubMed] [Google Scholar]
- 44.Zylicz Z, Wagener DJ, van Rennes H, Wessels JM, van der Kleijn E, et al. In vitro modulation of cisplatin cytotoxicity by sparsomycin inhibition of protein synthesis. J Natl Cancer Inst. 1987;78:701–705. [PubMed] [Google Scholar]
- 45.Hofs HP, Wagener DJ, de Valk-Bakker V, van Rennes H, Ottenheijm HC, et al. Concentration and sequence dependent synergism of ethyldeshydroxy-sparsomycin in combination with antitumor agents. Anticancer Drugs. 1994;5:35–42. doi: 10.1097/00001813-199402000-00006. [DOI] [PubMed] [Google Scholar]
- 46.Furusawa E, Lum MK, Furusawa S. Therapeutic activity of pretazettine on Ehrlich ascites carcinoma: adjuvant effect on standard drugs in ABC regimen. Chemotherapy. 1981;27:277–286. doi: 10.1159/000237992. [DOI] [PubMed] [Google Scholar]
- 47.Kano Y, Sakamoto S, Kasahara T, Akutsu M, Inoue Y, et al. Effects of amsacrine in combination with other anticancer agents in human acute lymphoblastic leukemia cells in culture. Leuk Res. 1991;15:1059–1066. doi: 10.1016/0145-2126(91)90112-7. [DOI] [PubMed] [Google Scholar]
- 48.Sah NK, Munshi A, Kurland JF, McDonnell TJ, Su B, et al. Translation inhibitors sensitize prostate cancer cells to apoptosis induced by tumor necrosis factor-related apoptosis-inducing ligand (TRAIL) by activating c-Jun N-terminal kinase. J Biol Chem. 2003;278:20593–20602. doi: 10.1074/jbc.M211010200. [DOI] [PubMed] [Google Scholar]
- 49.Budihardjo, Boerner SA, Eckdahl S, Svingen PA, Rios R, et al. Effect of 6-aminonicotinamide and other protein synthesis inhibitors on formation of platinum-DNA adducts and cisplatin sensitivity. Mol Pharmacol. 2000;57:529–538. doi: 10.1124/mol.57.3.529. [DOI] [PubMed] [Google Scholar]
- 50.Sakai T, Aoike A, Marui N, Kawai K, Nishino H, et al. Protection by cycloheximide against cytotoxicity induced by vincristine, colchicine, or delta 12-prostaglandin J2 on human osteosarcoma cells. Cancer Res. 1989;49:1193–1196. [PubMed] [Google Scholar]
- 51.Hromas R, Barlogie B, Swartzendruber D, Drewinko B. Selective protection by anguidine of normal versus transformed cells against 1-beta-D-arabinofuranosylcytosine and Adriamycin. Cancer Res. 1983;43:1135–1137. [PubMed] [Google Scholar]
- 52.Thakkar NS, Potten CS. Abrogation of adriamycin toxicity in vivo by cycloheximide. Biochem Pharmacol. 1992;43:1683–1691. doi: 10.1016/0006-2952(92)90697-h. [DOI] [PubMed] [Google Scholar]
- 53.Bai J, Cederbaum AI. Cycloheximide protects HepG2 cells from serum withdrawal-induced apoptosis by decreasing p53 and phosphorylated p53 levels. J Pharmacol Exp Ther. 2006;319:1435–1443. doi: 10.1124/jpet.106.110007. [DOI] [PubMed] [Google Scholar]
- 54.Savaraj N, Lu K, Dimery I, Feun LG, Burgess M, et al. Clinical pharmacology of homoharringtonine. Cancer Treat Rep. 1986;70:1403–1407. [PubMed] [Google Scholar]
- 55.Lu K, Savaraj N, Feun LG, Guo ZG, Umsawasdi T, et al. Pharmacokinetics of homoharringtonine in dogs. Cancer Chemother Pharmacol. 1988;21:139–142. doi: 10.1007/BF00257360. [DOI] [PubMed] [Google Scholar]
- 56.Benvenuto JA, Newman RA, Bignami GS, Raybould TJ, Raber MN, et al. Phase II clinical and pharmacological study of didemnin B in patients with metastatic breast cancer. Invest New Drugs. 1992;10:113–117. doi: 10.1007/BF00873128. [DOI] [PubMed] [Google Scholar]
- 57.Beasley VR, Bruno SJ, Burner JS, Choi BW, Rinehart KL, et al. Fate of tritiated didemnin B in mice: excretion and tissue concentrations after an intraperitoneal dose. Biopharm Drug Dispos. 2005;26:341–351. doi: 10.1002/bdd.466. [DOI] [PubMed] [Google Scholar]
- 58.Fong KL, Ho DH, Benjamin RS, Brown NS, Bedikian A, et al. Clinical pharmacology of bruceantin by radioimmunoassay. Cancer Chemother Pharmacol. 1982;9:169–172. doi: 10.1007/BF00257747. [DOI] [PubMed] [Google Scholar]
- 59.Wuilleme-Toumi S, Robillard N, Gomez P, Moreau P, Le Gouill S, et al. Mcl-1 is overexpressed in multiple myeloma and associated with relapse and shorter survival. Leukemia. 2005;19:1248–1252. doi: 10.1038/sj.leu.2403784. [DOI] [PubMed] [Google Scholar]
- 60.Podar K, Gouill SL, Zhang J, Opferman JT, Zorn E, et al. A pivotal role for Mcl-1 in Bortezomib-induced apoptosis. Oncogene. 2008;27:721–731. doi: 10.1038/sj.onc.1210679. [DOI] [PubMed] [Google Scholar]
- 61.Dang CV, O'Donnell KA, Zeller KI, Nguyen T, Osthus RC, et al. The c-Myc target gene network. Semin Cancer Biol. 2006;16:253–264. doi: 10.1016/j.semcancer.2006.07.014. [DOI] [PubMed] [Google Scholar]
- 62.Takahashi-Yanaga F, Sasaguri T. GSK-3beta regulates cyclin D1 expression: a new target for chemotherapy. Cell Signal. 2008;20:581–589. doi: 10.1016/j.cellsig.2007.10.018. [DOI] [PubMed] [Google Scholar]
- 63.Freemantle SJ, Liu X, Feng Q, Galimberti F, Blumen S, et al. Cyclin degradation for cancer therapy and chemoprevention. J Cell Biochem. 2007;102:869–877. doi: 10.1002/jcb.21519. [DOI] [PubMed] [Google Scholar]
- 64.Merino R, Ding L, Veis DJ, Korsmeyer SJ, Nunez G. Developmental regulation of the Bcl-2 protein and susceptibility to cell death in B lymphocytes. Embo J. 1994;13:683–691. doi: 10.1002/j.1460-2075.1994.tb06307.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Heys SD, Park KG, McNurlan MA, Calder AG, Buchan V, et al. Measurement of tumour protein synthesis in vivo in human colorectal and breast cancer and its variability in separate biopsies from the same tumour. Clin Sci (Lond) 1991;80:587–593. doi: 10.1042/cs0800587. [DOI] [PubMed] [Google Scholar]
- 66.Weinstein IB. Cancer. Addiction to oncogenes–the Achilles heal of cancer. Science. 2002;297:63–64. doi: 10.1126/science.1073096. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.