Abstract
The Bcl-2-associated death promoter BAD is a prognostic indicator for good clinical outcome of breast cancer patients; however, whether BAD affects breast cancer biology is unknown. Here we showed that BAD increased cell growth in breast cancer cells through two distinct mechanisms. Phosphorylation of BAD at S118 increased S99 phosphorylation, 14-3-3 binding and AKT activation to promote growth and survival. Through a second, more prominent pathway, BAD stimulated mitochondrial oxygen consumption in a novel manner that was downstream of substrate entry into the mitochondria. BAD stimulated complex I activity that facilitated enhanced cell growth and sensitized cells to apoptosis in response to complex I blockade. We propose that this dependence on oxidative metabolism generated large but nonaggressive cancers. This model identifies a non-canonical role for BAD and reconciles BAD-mediated tumor growth with favorable outcomes in BAD-high breast cancer patients.
Subject terms: Breast cancer, Cancer metabolism, Tumour biomarkers, Mechanisms of disease, Cell signalling
Introduction
The BH3-only protein BAD has multiple functions that are determined by cellular context. Apoptotic roles in lymphocyte development and metabolic roles in pancreatic glucose sensing have been clearly defined through physiological studies of genetic engineered mice [1–4]. Bad null animals had diminished apoptotic signalling and developed late-onset lymphomas [1, 5], as well as diminished glycolysis with altered glucose homeostasis [2]. Phosphorylation of BAD was critical to both of these phenotypes through cell-specific signaling. In developing B and T cells, phosphorylation of S155 (homologous to S118 in humans) within the BH3 domain inhibited apoptosis by preventing BAD binding to anti-apoptotic Bcl-2, and protection from mitochondrial outer membrane permeabilization [1]. In pancreatic cells, phosphorylated BAD was bound to the regulatory glycolytic enzyme glucokinase and stimulated catalytic activity necessary for insulin release and maintenance of circulating glucose levels [3, 6]. Other tissues affected by in vivo genetic manipulation of Bad were neurons and isolated mammary gland epithelial cells that showed alterations in both metabolism and apoptosis [4, 5].
Given that altered apoptosis is a hallmark of malignancy and cancer progression [7], multiple studies have identified associations between apoptotic regulators and clinical disease. In line with this, BAD is differentially expressed in human cancers of the ovary [8], lung [9], colon [10] and breast [11–13]. We showed that in primary breast cancer, elevated BAD levels correlated with a 3.7-fold increased likelihood of patient survival and was a better prognostic indicator than tumor grade, HER2 or estrogen receptor suggesting a causal contribution to tumor suppression [13]. Surprisingly, BAD did not sensitize breast cancer cells to apoptosis but instead stimulated progression through the cell cycle. Thus, the role of BAD in breast cancer and how this relates to clinical outcome is unclear. In order to explore this, we examined the effect of BAD on breast cancer cells and identified unexpected mechanisms regulating cell growth. We found that BAD regulated breast cancer cell growth by concurrent phosphorylation dependent and independent pathways. BAD phosphorylation drove cellular growth and tumor aggressiveness. BAD also regulated mitochondrial oxidative metabolism, independent of phosphorylation status. These studies identify novel BAD signaling pathways in breast cancer that may give insight to clinical outcomes.
Results
BAD regulates cell growth
To investigate the effect of BAD on breast cancer growth, we generated cell lines expressing BAD to characterize growth effects and gain mechanistic insight. MDA-MB-231 cells that have low endogenous BAD expression were stably transfected to express ectopic BAD [13]. Cells were grown in culture for 7 days without media change to mimic tumor-like conditions and cell counts were recorded (Fig. 1a). Vector control cells showed the expected cellular accumulation and reached a plateau by day 5. BAD-expressing cells, on the other hand, showed extended and increased cellular accumulation dependent on ectopic BAD expression (Supplementary Fig. 1A). To validate this result with loss-of-function studies, BAD expression was knocked out in mammary epithelial MCF10A cells, which express higher levels of endogenous BAD (Supplementary Fig. 1B). Loss of BAD inhibited cell accumulation demonstrating that this effect was not cell-line restricted (Supplementary Fig. 1C). Together, these results demonstrated that BAD expression supported cell growth.
BAD phosphorylation regulates cell and tumor growth
To investigate mechanism, we queried whether phosphorylation of BAD regulated this growth effect. In particular, BAD apoptotic activity is attenuated by phosphorylation of three key serine residues (S75, S99 and S118) in response to survival signaling [14–16]. We first assessed BAD phosphorylation in these cells. In 2D-IEF/SDS western blotting, BAD migrated as multiple isoforms that collapsed to a single spot in response to phosphatase treatment (Fig. 1b), indicating the presence of multiple phosphorylated forms of BAD. Phospho-specific antibodies confirmed that a proportion of these isoforms were phosphorylated at S99 and S118 (Fig. 1c, d). Since phosphorylation of S118 regulates binding to Bcl-XL and apoptotic and metabolic activities of BAD [2, 16–18], we directly tested the contribution of S118 phosphorylation on cell and tumor growth. We generated cell lines stably expressing phosphomimetic (S118D) or non-phosphorylatable (S118A) mutants of BAD. Relative to BAD-expressing cells, BAD-S118A-expressing cells showed a lower proportion of spots in the acidic range, whereas BAD-S118D-expressing cells showed increased proportion of acidic spots (Fig. 1e). BAD-S118A-expressing cells showed decreased growth properties to BAD-S118D-expressing cells, indicating that phosphorylation enhanced cell growth. (Fig. 1f). Cell synchronization revealed that ectopic BAD expression, irrespective of phospho-status, stimulated earlier exit out of G2/M compared to vector cells (Fig. 1g). Notably, S118A-expressing cells had significantly increased sub-G1 population compared to vector, which is consistent with the lower accumulation of S118A-expressing cells in the cell count assay. These results confirmed that the BAD growth effect was due to increased cell cycle dynamics and differential apoptosis.
We next tested whether BAD also regulated growth in a tumor-bearing model. We injected wild-type and mutant BAD-expressing cells into the subcutaneous flanks of mice and measured tumor volume over time. BAD-S118D-expressing cells formed the largest tumors and wild-type BAD-expressing cells formed intermediate sized tumors, which were both significantly larger than tumors from BAD-S118A- and vector control cells (Fig. 2a, b). S118D-derived tumors were generally solid whereas wild-type BAD-derived tumors had larger necrotic centers, suggesting that tumor growth in these two genotypes occurred via different molecular pathways (Supplementary Figure 2). To query pathways that contributed to differential tumor size, we examined proliferation and apoptosis markers in the xenograft tumor tissue (Fig. 2c, d). BAD-S118D-expressing tumors had significantly increased Ki67-positive and CD-31 positive cells, supporting that increased proliferation and angiogenesis contributed to tumor growth. Additionally, these tumors had decreased cleaved PARP levels, suggesting that decreased apoptosis contributed to larger tumor volume. On the other hand, tumors that expressed wild-type BAD shared characteristics between BAD-S118A or S118D tumors. Overall, enforced phosphorylation mimic of BAD at S118 drove tumor growth associated with increased proliferation, angiogenesis and decreased apoptosis.
BAD phosphorylation-mediated growth requires 14-3-3 binding
To decipher the BAD phosphorylation-dependent pathway, we further examined the effect of BAD-S118D on cell growth. We noted that S118D-expressing cells had a higher proportion of phosphorylated isoforms of BAD (Fig. 1e), including phosphorylation at S99 (Fig. 1c). Phosphorylation of S99 can be mediated by AKT [15] and is critical for 14-3-3 binding and attenuation of BAD apoptotic activity [15, 19–21]. BAD-S118D-expressing cells showed increased AKT activity compared to vector and WT cells, suggesting that BAD-S118D-expression enhanced survival signaling (Fig. 3a). AKT inhibition by the PI3K inhibitor Ly294002 did not attenuate pS99-BAD levels, indicating AKT does not phosphorylate BAD at S99 in our model. Phosphorylated S75 and S99 are bound by 14-3-3 [17, 22–24] and we reasoned that BAD-S118D mediated cell growth and survival through binding to 14-3-3. We mutated S99 to alanine within the S118D background (BAD-S99A/S118D) and examined 14-3-3-interaction (Fig. 3b). As expected, 14-3-3 bound to BAD-S118D and this binding was abrogated in the double mutant BAD-S99A/S118D (Fig. 3c). Importantly, the double mutation of S99A/S118D reduced the cellular growth rate to background vector levels, indicating that S118D-mediated growth was dependent on downstream phosphorylation of S99 (Fig. 3d). To test whether phosphorylation of S99 alone was sufficient to drive increased cell proliferation, we individually expressed single mutants BAD-S99D and BAD-S99A (Supplementary Fig. 3A). Neither of these mutants supported elevated cell proliferation likely due to their inability to bind 14-3-3 (Supplementary Fig. 3B), again suggesting that 14-3-3 binding to BAD enhanced cell growth. When injected into recipient mice, S99A/S118D-derived tumors showed no growth advantage and were indistinguishable from vector control cells (Fig. 3e, f). Therefore, the enhanced cellular and tumor growth imparted by BAD-S118D was dependent on S99 phosphorylation and associated with 14-3-3 binding and resistance to apoptosis. These results indicated that phosphorylation of BAD at S118 stimulated survival pathways that in turn phosphorylated BAD at S99 resulting in binding to 14-3-3 proteins.
Wild-type BAD mediates growth through a phosphorylation-independent mechanism
Wild-type BAD stimulated cell and tumor growth that was driven by different pathways than S118D. Unlike BAD-S118D, wild-type-BAD was minimally phosphorylated at S99 (Fig. 1c), did not increase AKT activity (Fig. 3a), and bound poorly to 14-3-3 (Fig. 3c). Additionally, wild-type BAD was predominanqtly located at the mitochondria, while BAD-S118D cells showed a different staining pattern with significantly less mitochondrial localization, again supporting different mechanisms for cell growth stimulation (Fig. 4a, b). Given that wild-type BAD bound strongly to Bcl-XL (Fig. 3c), we asked whether increased growth was mediated through a Bcl-XL-dependent pathway. We first assessed the proportion of wild-type BAD that was bound to Bcl-XL. We performed co-immunoprecipitation assays and compared the levels of BAD that were bound or not bound to Bcl-XL (Fig. 5a). Anti-Bcl-XL antibodies immunoprecipitated the majority of BAD from cell lysates, indicating that most of BAD was bound to Bcl-XL. While BAD:Bcl-XL binding liberates pro-apoptotic Bax/Bak to trigger cell death [25, 26], this was inconsistent with our observed increased cell/tumor volume and lack of apoptotic markers. Instead, in other contexts, BAD:Bcl-XL complexes that release BAX can indirectly trigger cell cycle entry into G1 [27]. Therefore, we hypothesized that expression of ectopic wild-type BAD sequestered excess Bcl-XL to stimulate cell proliferation.
To interrogate this, we generated a BAD-L114A mutant that disrupts Bcl-XL binding [28]. Co-immunoprecipitation experiments confirmed that the L114A mutants had diminished binding to Bcl-XL (Fig. 5b, c). If the BAD:Bcl-XL interaction was critical for the growth phenotype, BAD-L114A mutants would show decreased growth. However, the growth profile of these mutants was similar to wild-type BAD (Fig. 5d), indicating that the BAD:Bcl-XL interaction was dispensable for growth. Thus, wild-type BAD stimulated cell and tumor growth through an alternative pathway that did not require S118 phosphorylation, 14-3-3 binding or Bcl-XL interactions.
BAD increases mitochondrial metabolism
In addition to regulating apoptosis, BAD also modulates other cellular processes. In liver and pancreatic cells, BAD binds to glucokinase (hexokinase IV) near the active site to stimulate enzymatic activity and indirectly increase mitochondrial metabolism [2, 6]. It is unknown if this activity is relevant in our studies since breast cancer cells do not express the tissue-restricted glucokinase [29]. Nevertheless, these cells do express the related hexokinases I and II [30, 31]. Therefore, we examined whether BAD modulated cellular metabolism, and consequently, survival and proliferation of breast cancer cells. To test the role of wild-type BAD in metabolism, we measured hexokinase activity, lactate production and glucose uptake as markers of glycolysis. Elevated BAD levels did not alter hexokinase enzyme levels or activity (Fig. 6a, b), indicating that unlike liver and pancreatic cells, BAD did not appear to stimulate the first regulatory step of glycolysis. BAD-expressing cells however, did show altered glycolytic flux and produced significantly less lactate and took up less glucose compared to vector control cells (Fig. 6c, d), suggesting that BAD increased mitochondrial oxidative metabolism. We directly assessed oxidative metabolism with high-resolution respirometry and observed that BAD expression significantly increased cellular oxygen consumption (Fig. 6e, f). Inhibiting mitochondrial electron flow with the ATP synthase inhibitor oligomycin blocked oxygen uptake, confirming that oxygen consumption was via mitochondrial complex IV (Fig. 6f, Leak). When we depolarized the mitochondria with the uncoupler FCCP to measure maximal electron transport (ET) activity, BAD-expressing cells recovered increased oxygen consumption indicating that BAD stimulated electron flow through the ET (Fig. 6f, ET). BAD-induced stimulation of mitochondrial respiration did not require phosphorylation of S118 as both the WT-BAD and S118A mutants showed elevated oxygen consumption relative to vector control (Fig. 6f). However, the S118D mutant showed significantly less oxygen consumption relative to wild-type BAD expressing cells, but was still significantly higher than vector cells. We postulate that BAD-mediated stimulation of mitochondrial metabolism contributes, in part, to cell proliferation. Interestingly, while S118A increased ET and early G2/M exit out of the cell cycle, S118A also stimulated apoptosis (Fig. 1g) possibly accounting for its decreased overall cell number in the cell count assay.
To further query mechanisms of this oxidative effect and since BAD:Bcl-XL interactions are known to stimulate mitochondrial ATP production [32], we measured oxygen uptake in the presence of the BH3-mimetic ABT-737. ABT-737 decreased BAD:Bcl-XL interactions as expected, but did not diminish oxygen consumption (Supplementary Fig. 4). Therefore, BAD increased oxygen consumption through a novel mechanism that was downstream of glycolysis and was not dependent on S118 phosphorylation or Bcl-XL binding.
BAD increases complex I activity
Electrons enter the ET from either complex I (CI) or complex II (CII), converge at complex III (CIII) and are delivered to the site of oxygen reduction in complex IV (CIV). To dissect how BAD increased electron flow, we examined the dependence on specific ET complexes. We permeabilized the plasma membrane with digitonin in the absence of exogenous substrates to obtain baseline oxygen consumption rates (Fig. 7a, Leak). Vector and BAD-expressing cells had similar leak respiration rates indicating that BAD did not increase electron flow by increasing permeability of the inner membrane (Fig. 7a, Leak). Upon addition of substrates pyruvate/malate and ADP, BAD-expressing cells showed elevated oxygen consumption relative to control cells (Fig. 7a, CI). CII activity was measured by the subsequent addition of the CII substrate succinate with concomitant inhibition of CI with rotenone. This was necessary to isolate CII from CI activity, as both deliver electrons to CIII and CIV. BAD did not increase CII activity (Fig. 7a, CI vs. CII). Thus, BAD increased mitochondrial oxidative metabolism by stimulating electron flow through CI. Notably, pyruvate is one of the last metabolites produced in glycolysis meaning that BAD functioned downstream of glycolysis.
To examine whether BAD had a direct effect on mitochondria, we queried whether BAD-stimulated oxygen consumption was substrate-dependent. Carbons derived from different nutrient sources enter the mitochondria through different carriers and are converted to metabolites that converge at the TCA cycle to generate NADH and FADH2 that then donate electrons to the ET. Carbohydrates, amino acids and fatty acids deliver carbon to the mitochondria in the form of pyruvate, glutamate and palmitoyl-CoA, respectively. We had already determined that BAD increased oxidative metabolism of pyruvate, so we next measured oxygen consumption derived from glutamate or palmitoyl-CoA (Fig. 7b). BAD-expression increased CI activity regardless of carbon source suggesting increased activity at or downstream of the TCA (Fig. 7b). However, when comparing oxygen consumption between fuel sources, BAD-expressing cells showed the greatest oxygen consumption with pyruvate versus either palmitoyl-CoA or glutamate suggesting a fuel use preference. To assess whether BAD increased mitochondrial metabolism or increased mitochondrial biomass, we measured levels of the mitochondrial marker Tom20 [33] and citrate synthase activity. We found no difference between vector and BAD expressing cells, indicating that increased oxygen consumption was likely not related to increased mitochondrial biomass (Fig. 7c, d). Interestingly, BAD-expressing cells had increased levels of the 20 kDa subunit (iron-sulfur protein 7) of CI (Fig. 7c). We therefore directly measured CI enzyme activity in vitro (Fig. 7e). Wild-type BAD cells increased CI activity compared to vector, thus suggesting a mechanism by which BAD promoted mitochondrial mechanism. In conclusion, BAD stimulated ET activity and oxygen consumption through a novel mechanism.
To test the effects of increased mitochondrial metabolism, we inhibited CI activity and assessed cell growth. CI contributes to cellular proliferation [34] and rotenone-treated vector cells showed a dose-dependent decrease in cellular accumulation as expected (Fig. 7f left). BAD-expressing cells were more tolerant of rotenone effects with an EC50 that was approximately 15 times higher than that of vector control cells. Further, BAD-expressing cells were dependent on CI activity for survival, as these cells underwent apoptosis at high concentrations of rotenone (500 nM), whereas control cells were cytostatic, but did not die (Fig. 7f right). Possibly, this dependence on oxidative metabolism contributed to the necrotic centers we observed in BAD-expressing tumors (Supplementary Fig. 2). These results suggested that although BAD-expressing tumors were significantly larger than vector-derived tumors, they may not necessarily predict aggressive disease. Since tumors with high proportion of cancer stem cells are associated with aggressive disease [35], we assessed cancer stem-like properties through mammosphere assays. BAD expression did not affect the mammosphere-efficiency but decreased mammosphere area (Supplementary Fig. 5), suggesting that increased tumor volume was not driven by elevated cancer stem cells. Thus, BAD-expressing cells induced elevated oxygen consumption that facilitated cell growth and also sensitized to cell death in response to CI-blockade.
In summary, our data demonstrated that BAD increased cellular accumulation resulting in increased tumor volume (Fig. 8). Phosphorylation of BAD at S118 contributed to this phenotype by stimulating proliferative and survival pathways. Concurrently, BAD stimulated oxidative catabolism of carbohydrate, fatty acid and amino acid nutrient sources through a mechanism involving CI activation and oxygen consumption. Inhibition of BAD-mediated CI stimulation demonstrated a causal link between mitochondrial metabolism and BAD-regulated cell growth and survival.
Discussion
We show here that BAD increased the growth of breast cancer cells in culture and in a tumor-bearing model. Specifically, BAD increased cell cycle dynamics in association with mitochondrial localization and increased mitochondrial complex I oxidative metabolism. Enhanced mitochondrial metabolism did not require phosphorylation of regulatory S118, and was supported not only by glucose, but also by fatty acid and amino acid carbon sources, altogether pointing to a novel molecular mechanism. Phosphomimic S118D mutants additionally contributed to cell growth effects by stimulating survival and decreasing apoptotic pathways dependent on 14-3-3 binding, respectively. Thus, BAD increases breast tumor growth through two distinct pathways that can be differentiated by dependence on S118 phosphorylation.
Similarly, Smith et al. found an increase in prostate cancer cell number and tumor growth as a result of ectopic BAD expression [36]. BAD has been previously shown to increase cell cycle progression in fibroblasts through bypassing G0/G1 growth arrest via binding to Bcl-XL and Bcl-2 [27, 37]. Our studies, however, indicated that BAD:Bcl-XL interactions were dispensable as expression of mutant BAD-L114A cells maintained enhanced growth. Instead, enforced phosphorylation of BAD at S118 drove an aggressive growth phenotype that was dependent on S99 phosphorylation and binding to 14-3-3. This growth mechanism was similar to other studies where BAD phosphorylation at S118 enhanced cellular survival by inhibiting BAD:Bcl-XL interaction [16], while phosphorylation at S99 promoted BAD binding to 14-3-3 proteins and attenuated apoptosis [17, 24]. In line with this, BAD phosphorylation promoted gastric cancer cell survival in response to growth factors [38, 39]. Thus, forced expression of a BAD mutant with a phosphomimic at S118 can drive breast cancer cell and tumor growth. The physiological contexts where this is occurring however, is unclear as the majority of BAD was dephosphorylated in this model system.
Notably, we identified a novel growth-stimulating pathway that was dependent on BAD expression but not reliant on phosphorylation. BAD-expressing cells enhanced carbon catabolism preferentially from carbohydrates, but also from fatty acid and amino acid sources to elevate mitochondrial oxidative metabolism, which contributed to cell growth. Studies in mouse hepatocytes and pancreatic β-cells identified that BAD phosphorylation at S155 (homologous to S118 in human) specifically affected glucose metabolism by interacting with and stimulating glucokinase [2, 6, 40]. Ablation of BAD phosphorylation at S155 in primary cultures of cortical neurons and astrocytes significantly blunted their oxygen consumption rate [4]. In breast cancer cells of this study, however, BAD-mediated changes in glucose metabolism were downstream of glycolytic hexokinase and independent of phosphorylation status. BAD did not increase lactate production or glucose uptake; markers of increased glycolysis [41] and instead, increased mitochondrial oxygen consumption. Further, this effect was also induced by amino acid and fatty acid catabolism. Thus, this novel mechanism whereby BAD alters cellular carbon flux may be through direct mitochondrial effects.
How BAD-enhanced oxidative metabolism contributes to cell growth is likely complex. Oxidative metabolism opposes the Warburg effect whereby rapidly proliferating cells, including cancer cells, take up glucose and secrete lactate in the presence of oxygen, as a means to produce precursors for macromolecular synthesis [42]. However, cancer cells do maintain oxidative metabolism to some level, even in the face of increased glycolysis [34] as mitochondrial metabolism has also been shown to facilitate cell and tumor growth. For example, defects in mitochondrial respiration in renal tumors prevented progression as a result of p53 and AMPK activation [43]. Additionally, mitochondrial reactive oxygen species (ROS) production was required for Kras-mediated regulation of cell proliferation and tumorigenesis [44] and loss of mtDNA with subsequent loss of mitochondrial respiration in HEK293 cells significantly impaired cellular proliferation [45]. In line with this, we found BAD-mediated CI activation facilitated cellular proliferation since cells were resistant to growth inhibition by low doses of rotenone.
Although the wild-type BAD expressing cells grew more robustly in culture and formed large tumors compared to vector control, they were not more aggressive. BAD-expressing tumors did not show increased vascularization, which is a marker of metastasis. Their necrotic centers likely reflected increased sensitivity to stress conditions inherent in the tumor environment. Further, BAD decreased glycolysis, whereby aerobic glycolysis has been shown to drive metastasis in part through upregulation of HIF and SNAIL [46]. By instead promoting oxidative metabolism, BAD may skew tumor characteristics toward less aggressive cancers, as we identified BAD expression reduced the size of mammospheres, a marker for the stem cell population. BAD stimulated CI-mediated mitochondrial metabolism and inhibition of CI induced apoptosis specifically in BAD-expressing cells, suggesting an addiction to CI activity and possible increased sensitivity to stressors such as ROS. This understanding of BAD-mediated metabolic effects may yield new insights into cancer therapeutics. For example, the CI inhibitor and diabetic drug metformin was associated with decreased cancer risk [47] indicating potential application for BAD-high breast cancers.
In summary, we have identified a novel mechanism of BAD-mediated growth in breast cancer. BAD, located at the mitochondria, can stimulate cell cycle progression through increased oxidative phosphorylation and CI activity. Additionally, this metabolic effect generates non-resilient tumors and suggests a mechanism whereby BAD promotes cell growth while predicting favorable outcomes in clinical breast cancer.
Materials and methods
Cell culture and reagents
MDA-MB-231 and MCF10A cell lines were from ATCC (Manassas, VA, USA). Cells were cultured as described previously [13]. Cell lines were routinely tested negative for mycoplasma contamination using the MycoSensor Series PCR Assay Kit (Agilent Technologies, Santa Clara, CA, USA). Cells were passaged maximum 25 times after resuscitation. λ protein phosphatase was from New England Biolabs (Ipswich, Massachusetts, USA), Ly294002 was from Cell Signaling Technologies (Danvers, Massachusetts, USA), and ABT-737 was from Santa Cruz Biotechnology (Santa Cruz, California, USA).
Stable cell line creation
Human BAD cDNA was generated using Superscript III Reverse Transcriptase Polymerase Chain Reaction (Invitrogen, Carlsbad, CA, USA). Primers (IDT, Coralville, IA, USA) used are listed in Supplementary Table S1. BAD cDNA was cloned into the pcDNA3.2/V5-DEST vector (Invitrogen). BAD mutations were created using QuikChange Lightning Site-Directed Mutagenesis Kit (Stratagene, San Diego, CA, USA).
Cell count assay
A total of 1 × 105 cells were plated, in duplicate, in 60 mm tissue culture dishes and cells were counted in duplicate as for the time period indicated.
Protein analysis
A total of 2D gel electrophoresis was carried as previously described [48]. pH 4–7 gel strip and 12% SDS-PAGE were used for first and second dimensional electrophoresis, respectively. Further experimental details are described in Supplemental Materials and Methods.
Methodology for immunoblotting, co-immunoprecipitation and flow cytometry were as done previously [13].
Cell synchronization to G1/S boundary and DNA content analysis
Cell synchronization at G1/S by double thymidine block was similar to [49]. Briefly, cells were plated in 12-well plates at 25% confluency for 24 h prior to the initial addition of thymidine (2 mM) for 16 h. Cells were then released for 8 h prior to the second thymidine block (2 mM) for 16 h. Cells were then released and allowed to cycle through the cell cycle and harvested and fixed at the indicated time points prior to propidium iodide (Invitrogen) staining (0.1% Triton X-100, 2 mg/mL RNase, 20 μg/mL propidium iodide). Flow cytometry was performed using the BD AccuriTM C6 to analyze DNA content in the FL-2 channel.
Mouse studies
Animal procedures were performed in compliance with the Canadian Council on Animal Care and approved by the Institutional Animal Care and Use Committee (AUP00000386). Cells were injected into subcutaneous flanks of nude mice at a concentration of 3 × 106 cells in 100 μL matrigel/media mix (1:3 ratio). RPMI 1640 medium (Life Technologies, Carlsbad, CA, USA) with no supplemental serum or antibiotic and BD Matrigel Matrix was used (BD 354234, Mississauga, ON, CAN). Tumor volume was measured weekly for 7 weeks. Tumor volume (mm3) was calculated as follows: (length × width × height)/2.
Immunohistochemistry
Immunohistochemistry was similar to [50]. Antigen retrieval was performed in 10 mM sodium citrate, 0.05% Tween 20, pH 6.0 for antibodies to pBAD-S99, BAD, Ki-67, cleaved PARP, and CD-31 or 10 mM Tris base, 1 mM EDTA, 0.05% Tween 20, pH 9.0 for cleaved caspase-3. Images were taken with a Zeiss AxioObserver Z1 Microscope at ×20 with 1.6X Optovar with ZEISS ZEN imaging software. Ki-67 quantification was performed using ImmunoRatio software [51] that uses a color deconvolution algorithm to calculate percentage of positively stained nuclei. Cleaved caspase-3, CD-31, and cleaved PARP were quantified manually per field of view. Antibody information can be found in Supplemental Materials and Methods.
Immunofluorescence and confocal imaging
Cells were grown on coverslips in 24 well plates. Cells were pre-incubated with 200 nM MitoTracker™ Red (Invitrogen) for 15 min, followed by 10 min fixation with 4% PFA (ThermoFisher Scientific). For intracellular staining, cells were permeabilized with 0.1% Triton X-100 in PBS for 10 min and blocked with 0.3% BSA in PBS for 1 h. Primary antibodies were added in blocking buffer at 1:500 concentration at 4 °C overnight. Secondary antibodies were added for 1 h at room temperature in blocking buffer. DAPI (Sigma-Aldrich) was used to stain cell nuclei.
Confocal imaging was done on Quorum Technologies WaveFx spinning-disk microscope set up on Olympus IX81 inverted stand (Olympus). Images were acquired using 60 ×, 1.42 numerical aperture oil objective, electron multiplying charge-coupled device (EM-CCD) camera (Hamamatsu) and Volocity software (PerkinElmer). Antibody information and co-localization analysis can be found in Supplemental Materials and Methods.
Glucose uptake and lactate production
Cells were plated in complete growth medium for 48 h prior to glucose uptake measurement using the Amplex Red Glucose/Glucose Oxidase Assay Kit (Invitrogen). Lactate production was measured similarly, but after 96 h of growth in complete medium. Amplex Red Reagent (Invitrogen), lactate (MilliporeSigma, Burlington, MA, USA), and lactate oxidase (MilliporeSigma) were used to determine lactate concentration in the media. Fluorescence was measured at 590 nm. Background fluorescence was corrected for by subtracting the value of the control well. Fluorescence readings were then normalized to cell number.
High-resolution respirometry and enzyme activity assays
Cells were grown in normal growth conditions with complete medium for 3 days. To measure hexokinase activity, Hexokinase Colorimetric Assay Kit (MilliporeSigma) was used as per manufacturer’s instructions. Absorbance was normalized to cell number. To measure citrate synthase and complex I activity, cells were lysed at −80 °C. Citrate synthase activity was measured at 412 nm recording the linear reduction of 0.1 mM 5,5′-dithiobis-2-nitrobenzoic acid in the presence of 0.31 mM acetyl-CoA, 0.5 mM oxalacetic acid, 0.1 M Tris/HCl, 50 μm EDTA, 5 mM triethanolamine hydrochloride (pH 8.1) [52]. Complex I activity was measured at 540 nm recording the linear oxidation of 0.10 mM NADH in the presence of 60 μM ubiquinone, 30 mM sodium azide, 50 mM phosphate buffer (pH 7.5), 3 mg/mL bovine serum albumin, and 0.5 μM rotenone in the blank (slight modification from [53–56]). Detailed methods for high-resolution respirometry can be found in Supplemental Materials and Methods.
Statistical analysis
All statistical analysis was performed using GraphPad Prism Software. For comparisons between two groups, a Student’s t-test was used. For comparisons between greater than two groups, a one-way ANOVA followed by a Dunnett’s multiple comparisons test to compare all groups to a reference control, or a Tukey’s multiple comparisons test to compare all groups to each other was used. All data are presented as ± standard error of the mean (SEM). Experiments were performed at least three times. Statistical significance refers to *P < 0.05, **P < 0.01, ***P < 0.001, ****P < 0.0001.
Supplementary information
Acknowledgements
We thank Dr. Bernard Lemire (University of Alberta), Dr. Thomas Simmen (University of Alberta), and Dr. Manijeh Pasdar (University of Alberta) for their generous gift of reagents. Additionally, we acknowledge all Goping lab members for the meaningful discussions and contributions to this work. This work was supported by operating grants from the Women and Children’s Health Research Institute, Canadian Breast Cancer Foundation and Alberta Cancer Foundation to ISG.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
Footnotes
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
The online version of this article (10.1038/s41388-018-0673-6) contains supplementary material, which is available to authorized users.
References
- 1.Datta SR, Ranger AM, Lin MZ, Sturgill JF, Ma YC, Cowan CW, et al. Survival factor-mediated BAD phosphorylation raises the mitochondrial threshold for apoptosis. Dev Cell. 2002;3:631–43. doi: 10.1016/S1534-5807(02)00326-X. [DOI] [PubMed] [Google Scholar]
- 2.Danial NN, Gramm CF, Scorrano L, Zhang CY, Krauss S, Ranger AM, et al. BAD and glucokinase reside in a mitochondrial complex that integrates glycolysis and apoptosis. Nature. 2003;424:952–6. doi: 10.1038/nature01825. [DOI] [PubMed] [Google Scholar]
- 3.Danial NN, Walensky LD, Zhang CY, Choi CS, Fisher JK, Molina AJ, et al. Dual role of proapoptotic BAD in insulin secretion and beta cell survival. Nat Med. 2008;14:144–53. doi: 10.1038/nm1717. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Gimenez-Cassina A, Martinez-Francois JR, Fisher JK, Szlyk B, Polak K, Wiwczar J, et al. BAD-dependent regulation of fuel metabolism and K(ATP) channel activity confers resistance to epileptic seizures. Neuron. 2012;74:719–30. doi: 10.1016/j.neuron.2012.03.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Ranger AM, Zha J, Harada H, Datta SR, Danial NN, Gilmore AP, et al. Bad-deficient mice develop diffuse large B cell lymphoma. Proc Natl Acad Sci USA. 2003;100:9324–9. doi: 10.1073/pnas.1533446100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Gimenez-Cassina A, Garcia-Haro L, Choi CS, Osundiji MA, Lane EA, Huang H, et al. Regulation of hepatic energy metabolism and gluconeogenesis by BAD. Cell Metab. 2014;19:272–84. doi: 10.1016/j.cmet.2013.12.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Hanahan D, Weinberg RA. Hallmarks of cancer: the next generation. Cell. 2011;144:646–74. doi: 10.1016/j.cell.2011.02.013. [DOI] [PubMed] [Google Scholar]
- 8.Marchion DC, Cottrill HM, Xiong Y, Chen N, Bicaku E, Fulp WJ, et al. BAD phosphorylation determines ovarian cancer chemosensitivity and patient survival. Clin Cancer Res. 2011;17:6356–66. doi: 10.1158/1078-0432.CCR-11-0735. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Yu Y, Zhong Z, Guan Y. The downregulation of Bcl-xL/Bcl-2-associated death promoter indicates worse outcomes in patients with small cell lung carcinoma. Int J Clin Exp Pathol. 2015;8:13075–82. [PMC free article] [PubMed] [Google Scholar]
- 10.Sinicrope FA, Rego RL, Foster NR, Thibodeau SN, Alberts SR, Windschitl HE, et al. Proapoptotic Bad and Bid protein expression predict survival in stages II and III colon cancers. Clin Cancer Res. 2008;14:4128–33. doi: 10.1158/1078-0432.CCR-07-5160. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Al-Bazz YO, Underwood JC, Brown BL, Dobson PR. Prognostic significance of Akt, phospho-Akt and BAD expression in primary breast cancer. Eur J Cancer. 2009;45:694–704. doi: 10.1016/j.ejca.2008.11.044. [DOI] [PubMed] [Google Scholar]
- 12.Cannings E, Kirkegaard T, Tovey SM, Dunne B, Cooke TG, Bartlett JM. Bad expression predicts outcome in patients treated with tamoxifen. Breast Cancer Res Treat. 2007;102:173–9. doi: 10.1007/s10549-006-9323-8. [DOI] [PubMed] [Google Scholar]
- 13.Craik AC, Veldhoen RA, Czernick M, Buckland TW, Kyselytzia K, Ghosh S, et al. The BH3-only protein Bad confers breast cancer taxane sensitivity through a nonapoptotic mechanism. Oncogene. 2010;29:5381–91. doi: 10.1038/onc.2010.272. [DOI] [PubMed] [Google Scholar]
- 14.Zhou XM, Liu Y, Payne G, Lutz RJ, Chittenden T. Growth factors inactivate the cell death promoter BAD by phosphorylation of its BH3 domain on Ser155. J Biol Chem. 2000;275:25046–51. doi: 10.1074/jbc.M002526200. [DOI] [PubMed] [Google Scholar]
- 15.Datta SR, Dudek H, Tao X, Masters S, Fu H, Gotoh Y, et al. Akt phosphorylation of BAD couples survival signals to the cell-intrinsic death machinery. Cell. 1997;91:231–41. doi: 10.1016/S0092-8674(00)80405-5. [DOI] [PubMed] [Google Scholar]
- 16.Tan Y, Demeter MR, Ruan H, Comb MJ. BAD Ser-155 phosphorylation regulates BAD/Bcl-XL interaction and cell survival. J Biol Chem. 2000;275:25865–9. doi: 10.1074/jbc.M004199200. [DOI] [PubMed] [Google Scholar]
- 17.Datta SR, Katsov A, Hu L, Petros A, Fesik SW, Yaffe MB, et al. 14-3-3 proteins and survival kinases cooperate to inactivate BAD by BH3 domain phosphorylation. Mol Cell. 2000;6:41–51. doi: 10.1016/S1097-2765(05)00012-2. [DOI] [PubMed] [Google Scholar]
- 18.Yang J, Li JH, Wang J, Zhang CY. Molecular modeling of BAD complex resided in a mitochondrion integrating glycolysis and apoptosis. J Theor Biol. 2010;266:231–41. doi: 10.1016/j.jtbi.2010.06.009. [DOI] [PubMed] [Google Scholar]
- 19.Harada H, Becknell B, Wilm M, Mann M, Huang LJ, Taylor SS, et al. Phosphorylation and inactivation of BAD by mitochondria-anchored protein kinase A. Mol Cell. 1999;3:413–22. doi: 10.1016/S1097-2765(00)80469-4. [DOI] [PubMed] [Google Scholar]
- 20.Schurmann A, Mooney AF, Sanders LC, Sells MA, Wang HG, Reed JC, et al. p21-activated kinase 1 phosphorylates the death agonist bad and protects cells from apoptosis. Mol Cell Biol. 2000;20:453–61. doi: 10.1128/MCB.20.2.453-461.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Tan Y, Ruan H, Demeter MR, Comb MJ. p90(RSK) blocks bad-mediated cell death via a protein kinase C-dependent pathway. J Biol Chem. 1999;274:34859–67. doi: 10.1074/jbc.274.49.34859. [DOI] [PubMed] [Google Scholar]
- 22.Zha J, Harada H, Yang E, Jockel J, Korsmeyer SJ. Serine phosphorylation of death agonist BAD in response to survival factor results in binding to 14-3-3 not BCL-X(L) Cell. 1996;87:619–28. doi: 10.1016/S0092-8674(00)81382-3. [DOI] [PubMed] [Google Scholar]
- 23.Maslyar DJ, Aoki M, Vogt PK. The growth-promoting activity of the Bad protein in chicken embryo fibroblasts requires binding to protein 14-3-3. Oncogene. 2001;20:5087–92. doi: 10.1038/sj.onc.1204662. [DOI] [PubMed] [Google Scholar]
- 24.Masters SC, Yang H, Datta SR, Greenberg ME, Fu H. 14-3-3 inhibits Bad-induced cell death through interaction with serine-136. Mol Pharmacol. 2001;60:1325–31. doi: 10.1124/mol.60.6.1325. [DOI] [PubMed] [Google Scholar]
- 25.Hsu YT, Wolter KG, Youle RJ. Cytosol-to-membrane redistribution of Bax and Bcl-X(L) during apoptosis. Proc Natl Acad Sci USA. 1997;94:3668–72. doi: 10.1073/pnas.94.8.3668. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Willis SN, Chen L, Dewson G, Wei A, Naik E, Fletcher JI, et al. Proapoptotic Bak is sequestered by Mcl-1 and Bcl-xL, but not Bcl-2, until displaced by BH3-only proteins. Genes Dev. 2005;19:1294–305. doi: 10.1101/gad.1304105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Chattopadhyay A, Chiang CW, Yang E. BAD/BCL-[X(L)] heterodimerization leads to bypass of G0/G1 arrest. Oncogene. 2001;20:4507–18. doi: 10.1038/sj.onc.1204584. [DOI] [PubMed] [Google Scholar]
- 28.Adachi M, Imai K. The proapoptotic BH3-only protein BAD transduces cell death signals independently of its interaction with Bcl-2. Cell Death Differ. 2002;9:1240–7. doi: 10.1038/sj.cdd.4401097. [DOI] [PubMed] [Google Scholar]
- 29.Smith TA. Mammalian hexokinases and their abnormal expression in cancer. Br J Biomed Sci. 2000;57:170–8. [PubMed] [Google Scholar]
- 30.Mathupala SP, Ko YH, Pedersen PL. Hexokinase II: cancer’s double-edged sword acting as both facilitator and gatekeeper of malignancy when bound to mitochondria. Oncogene. 2006;25:4777–86. doi: 10.1038/sj.onc.1209603. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.John S, Weiss JN, Ribalet B. Subcellular localization of hexokinases I and II directs the metabolic fate of glucose. PLoS ONE. 2011;6:e17674. doi: 10.1371/journal.pone.0017674. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Fouque A, Lepvrier E, Debure L, Gouriou Y, Malleter M, Delcroix V, et al. The apoptotic members CD95, BclxL, and Bcl-2 cooperate to promote cell migration by inducing Ca(2+) flux from the endoplasmic reticulum to mitochondria. Cell Death Differ. 2016;23:1702–16. doi: 10.1038/cdd.2016.61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Goping IS, Millar DG, Shore GC. Identification of the human mitochondrial protein import receptor, huMas20p. Complementation of delta mas20 in yeast. FEBS Lett. 1995;373:45–50. doi: 10.1016/0014-5793(95)01010-C. [DOI] [PubMed] [Google Scholar]
- 34.DeBerardinis RJ, Chandel NS. Fundamentals of cancer metabolism. Sci Adv. 2016;2:e1600200. doi: 10.1126/sciadv.1600200. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Grun D, Adhikary G, Eckert RL. VEGF-A acts via neuropilin-1 to enhance epidermal cancer stem cell survival and formation of aggressive and highly vascularized tumors. Oncogene. 2016;35:4379–87. doi: 10.1038/onc.2015.507. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Smith AJ, Karpova Y, D’Agostino R, Jr., Willingham M, Kulik G. Expression of the Bcl-2 protein BAD promotes prostate cancer growth. PLoS One. 2009;4:e6224. doi: 10.1371/journal.pone.0006224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Janumyan YM, Sansam CG, Chattopadhyay A, Cheng N, Soucie EL, Penn LZ, et al. Bcl-xL/Bcl-2 coordinately regulates apoptosis, cell cycle arrest and cell cycle entry. EMBO J. 2003;22:5459–70. doi: 10.1093/emboj/cdg533. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Lee KH, Choi EY, Kim MK, Lee SH, Jang BI, Kim TN, et al. Hepatoma-derived growth factor regulates the bad-mediated apoptotic pathway and induction of vascular endothelial growth factor in stomach cancer cells. Oncol Res. 2010;19:67–76. doi: 10.3727/096504010X12864748215043. [DOI] [PubMed] [Google Scholar]
- 39.Lee KH, Choi EY, Kim MK, Hyun MS, Eun JR, Jang BI, et al. Hepatocyte growth factor promotes cell survival by phosphorylation of BAD in gastric cancer cells. Oncol Res. 2008;17:23–32. doi: 10.3727/096504008784046072. [DOI] [PubMed] [Google Scholar]
- 40.Osundiji MA, Godes ML, Evans ML, Danial NN. BAD modulates counterregulatory responses to hypoglycemia and protective glucoprivic feeding. PLoS ONE. 2011;6:e28016. doi: 10.1371/journal.pone.0028016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Weinberg SE, Chandel NS. Targeting mitochondria metabolism for cancer therapy. Nat Chem Biol. 2015;11:9–15. doi: 10.1038/nchembio.1712. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Cairns RA, Harris I, McCracken S, Mak TW. Cancer cell metabolism. Cold Spring Harb Symp Quant Biol. 2011;76:299–311. doi: 10.1101/sqb.2011.76.012856. [DOI] [PubMed] [Google Scholar]
- 43.Joshi S, Tolkunov D, Aviv H, Hakimi AA, Yao M, Hsieh JJ, et al. The Genomic landscape of renal oncocytoma identifies a metabolic barrier to tumorigenesis. Cell Rep. 2015;13:1895–908. doi: 10.1016/j.celrep.2015.10.059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Weinberg F, Hamanaka R, Wheaton WW, Weinberg S, Joseph J, Lopez M, et al. Mitochondrial metabolism and ROS generation are essential for Kras-mediated tumorigenicity. Proc Natl Acad Sci USA. 2010;107:8788–93. doi: 10.1073/pnas.1003428107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Martinez-Reyes I, Diebold LP, Kong H, Schieber M, Huang H, Hensley CT, et al. TCA cycle and mitochondrial membrane potential are necessary for diverse biological functions. Mol Cell. 2016;61:199–209. doi: 10.1016/j.molcel.2015.12.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Lu J, Tan M, Cai Q. The Warburg effect in tumor progression: mitochondrial oxidative metabolism as an anti-metastasis mechanism. Cancer Lett. 2015;356(2 Pt A):156–64. doi: 10.1016/j.canlet.2014.04.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Evans JM, Donnelly LA, Emslie-Smith AM, Alessi DR, Morris AD. Metformin and reduced risk of cancer in diabetic patients. BMJ. 2005;330:1304–5. doi: 10.1136/bmj.38415.708634.F7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Adams LD, Gallagher SR. Two-dimensional gel electrophoresis. Curr Protoc Mol Biol. 2004;Chapter 10:Unit10 4. doi: 10.1002/0471142727.mb1004s67. [DOI] [PubMed] [Google Scholar]
- 49.Czernick M, Rieger A, Goping IS. Bim is reversibly phosphorylated but plays a limited role in paclitaxel cytotoxicity of breast cancer cell lines. Biochem Biophys Res Commun. 2009;379:145–50. doi: 10.1016/j.bbrc.2008.12.025. [DOI] [PubMed] [Google Scholar]
- 50.Pandya V, Glubrecht D, Vos L, Hanson J, Damaraju S, Mackey J, et al. The pro-apoptotic paradox: the BH3-only protein Bcl-2 interacting killer (Bik) is prognostic for unfavorable outcomes in breast cancer. Oncotarget. 2016;7:33272–85. doi: 10.18632/oncotarget.8924. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Tuominen VJ, Ruotoistenmaki S, Viitanen A, Jumppanen M, Isola J. ImmunoRatio: a publicly available web application for quantitative image analysis of estrogen receptor (ER), progesterone receptor (PR), and Ki-67. Breast Cancer Res. 2010;12:R56. doi: 10.1186/bcr2615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Faloona GR, Srere PA. Escherichia coli citrate synthase. Purification and the effect of potassium on some properties. Biochemistry. 1969;8:4497–503. doi: 10.1021/bi00839a041. [DOI] [PubMed] [Google Scholar]
- 53.Spinazzi M, Casarin A, Pertegato V, Salviati L, Angelini C. Assessment of mitochondrial respiratory chain enzymatic activities on tissues and cultured cells. Nat Protoc. 2012;7:1235–46. doi: 10.1038/nprot.2012.058. [DOI] [PubMed] [Google Scholar]
- 54.Yang N, Weinfeld M, Lemieux H, Montpetit B, Goping IS. Photo-activation of the delocalized lipophilic cation D112 potentiates cancer selective ROS production and apoptosis. Cell death & Dis. 2017;8:e2587. doi: 10.1038/cddis.2017.19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Gnaiger E, Steinlechner-Maran R, Mendez G, Eberl T, Margreiter R. Control of mitochondrial and cellular respiration by oxygen. J Bioenerg Biomembr. 1995;27:583–96. doi: 10.1007/BF02111656. [DOI] [PubMed] [Google Scholar]
- 56.Gnaiger E, Mendez G, Hand SC. High phosphorylation efficiency and depression of uncoupled respiration in mitochondria under hypoxia. Proc Natl Acad Sci USA. 2000;97:11080–5. doi: 10.1073/pnas.97.20.11080. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.