Abstract
Many guanide-containing drugs are antihyperglycaemic but most exhibit toxicity, to the extent that only the biguanide metformin has enjoyed sustained clinical use. Here, we have isolated unique mitochondrial redox control properties of metformin that are likely to account for this difference. In primary hepatocytes and H4IIE hepatoma cells we found that antihyperglycaemic diguanides DG5-DG10 and the biguanide phenformin were up to 1000-fold more potent than metformin on cell signalling responses, gluconeogenic promoter expression and hepatocyte glucose production. Each drug inhibited cellular oxygen consumption similarly but there were marked differences in other respects. All diguanides and phenformin but not metformin inhibited NADH oxidation in submitochondrial particles, indicative of complex I inhibition, which also corresponded closely with dehydrogenase activity in living cells measured by WST-1. Consistent with these findings, in isolated mitochondria, DG8 but not metformin caused the NADH/NAD+ couple to become more reduced over time and mitochondrial deterioration ensued, suggesting direct inhibition of complex I and mitochondrial toxicity of DG8. In contrast, metformin exerted a selective oxidation of the mitochondrial NADH/NAD+ couple, without triggering mitochondrial deterioration. Together, our results suggest that metformin suppresses energy transduction by selectively inducing a state in complex I where redox and proton transfer domains are no longer efficiently coupled.
Keywords: Diabetes, Metformin, Mitochondria, NADH, NAD+
1. Introduction
Recently we have been using analogues of metformin to study how cellular effects of metformin relate to its chemical properties, which include a strongly hydrophilic character, metal-binding and a pKa within the physiological pH range [1], [2], [3], [4], [5], [6]. This collection of properties is not shared by other guanidine-containing compounds although many do have mitochondrial and antihyperglycaemic effects. In the 1920s for example, before the discovery of biguanides [7], [8], related compounds known as diguanides [9] were briefly evaluated as antidiabetic agents. Unlike biguanides, in diguanides, the two guanidine groups are separated by an alkyl chain of variable length (Fig. 1). In this series, antihyperglycaemic effects were found to increase, in proportion with toxicity, up to a linker size of 10–12 carbons [10], [11]. To achieve the maximum effect, the most potent and toxic diguanide, (N,N'-1,10-Decanediylbisguanidine, synthalin A, termed DG10 in our study, Fig. 1b) was used in humans but caused liver toxicity [12]. Owing to this failure, there has been little investigation of the mechanism of action of synthalins. Although the mechanism of antihyperglycaemic effects is poorly understood for either drug class, inhibition of mitochondrial respiration has been observed in response to both diguanides and biguanides [13], [14]. Early studies suggested that mitochondrial effects might be due to the ability of guanidine compounds to alter the functional and physical structure of membranes [15], [16]; however, this model does not readily account for the widely differing toxicities and potencies of diguanides compared with biguanides and in addition metformin is one of the most hydrophilic biguanides, unlikely to interact significantly with membranes. Later studies suggested that metformin acts by inhibiting complex I in the electron transport chain [14], [17]. Mitochondrial suppression by metformin activates AMPK [18], [19], [20], which has emerged as a common cellular response to biguanides, thiazolidinediones and salicylates [19], [21], [22], [23]; however, there are other possible targets, some of which are AMPK-independent. These include regulation of glucose 6-phosphate levels [24], dephosphorylation of the ribosomal protein S6 by metformin [25], [26] and suppression of redox transfer by mitochondrial glycerophosphate dehydrogenase (mGPD) [27]. For mGPD, it has been argued elsewhere that effects on glucose production might require additional inhibition of the alternative redox malate/aspartate shuttle [28]. None of these models readily explain the suppression of weight gain that is one of the key clinical hallmarks of metformin treatment [29].
Recent work on complex I has found evidence for different modes of complex regulation by metformin compared with rotenone, which is a neurotoxic complex I inhibitor [30]. In the current study we have investigated differences between the actions of metformin, diguanides and other guanide containing drugs, as these differences might ultimately explain the lower toxicity of metformin compared with other electron transport chain inhibitors. Investigating the impact of these agents on cellular oxygen consumption, gluconeogenic gene regulation, signalling and glucose production, we found that phenformin and several diguanides induce effects similar to metformin on these outputs. Our studies have however isolated differences in mitochondrial responses to these other agents that are likely to contribute towards observed differences in toxicity.
2. Methods
2.1. Materials
Diamines used in synthesising diguanides, methylisourea and the compound AG12 were sourced from Sigma Aldrich. DG4 and DG10 came from Tocris. DG6 came from Santa Cruz Biotechnology. The antibodies used have been described previously [2], [23]. Briefly, the antibody to Ser79-phosphorylated acetyl-CoA carboxylase (ACC) was a gift from the Division of Signal Transduction Therapy at the University of Dundee. Total ACC, total AMP activated protein kinase (AMPK) α, Thr172-phosphorylated AMPKα, total S6 ribosomal protein and Ser 240/244-phosphorylated S6 antibodies for immunoblotting were from Cell Signalling Technology. Actin antibody was from Merck. Antibodies used in the AMPK activity assays were a generous gift from Prof D. Grahame Hardie at the University of Dundee. Chemical structures were drawn using ChemSketch.
2.2. Diguanide synthesis
Diguanides were synthesized using a method adapted from Tricot [31] by reacting 1 mol of a diamine with 2 mol of methylisourea. The methylisourea was dissolved in ice-cold ultrapure water and the pH increased to 10 by drop-wise addition of 5 M KOH. The diamine was added and this was incubated for three hours, performing 15 min checks to ensure that the pH was maintained at 10. The guanidinylated products are insoluble at pH 10 and precipitates formed were collected by centrifugation and washed twice with 10 ml ice cold ultrapure water by re-centrifugation. The final precipitates collected were frozen at −20 °C and freeze dried. The success of the syntheses was initially assessed by positive mode direct injection mass spectrometry, then the purity of the diguanides confirmed by liquid chromatography mass spectrometry with MS2 fragmentation using an ion-pairing separation method (see Supplementary materials for details). In our experience with this method, the purity of the product was dictated predominantly by the purity of the starting material.
2.2.1. H4IIE cell culture and lysis for immunoblotting
Maintenance of H4IIE cells in DMEM (31885 Invitrogen) plus 5% Fetal calf serum (Seralab) has been described previously [2], [32], [33], [34]. Cells were used for no more than 30 passages. Briefly, prior to an experiment being carried out, fresh medium was added the evening before. Two hours prior to stimulation on the day of the experiment, cells were placed in DMEM without serum. Cells were scraped into ice-cold lysis buffer: (50 mM Tris acetate pH7.5, 1% (w/v) Triton ×100, 1 mM EDTA, 1 mM EGTA, 0.27 M sucrose, 50 mM NaF, 1 mM sodium orthovanadate, 10 mM β glycerophosphate, 5 mM sodium pyrophosphate, 1 mM benzamidine, 0.2 mM phenylmethylsulfonyl fluoride (PMSF) and 0.1% (v/v) β-mercaptoethanol) and then prepared for SDS-PAGE and immunoblotting as described previously [35], [36]. Protein concentration was measured using Bradford reagent (Pierce). Immunoblot densitometry was performed with Image Studio Lite version 5.2 (LI-COR).
2.2.2. Preparation of cell extracts, immunoprecipitation and assay of AMPK
This was carried out essentially as described previously [2]. Briefly, cells were washed twice in ice-cold PBS then harvested in ice-cold lysis buffer (50 mM Tris-HCl, pH 7.4, 50 mM sodium fluoride, 5 mM sodium pyrophosphate, 1 mM EDTA, 1 mM EGTA, 150 mM sodium chloride, 1 mM dithiothreitol (DTT), 0.1 mM benzamidine, 0.1 mM PMSF, 1% Triton X-100, and 5 μg/ml soybean trypsin inhibitor). Lysates were cleared of debris by centrifugation at 13,000g for 15 min at 4 °C, and the protein concentration measured as in the previous section. Cell extracts were incubated overnight with protein G sepharose conjugated to both anti-AMPKα1 and AMPKα2 antibodies (generously gifted by Professor Grahame Hardie) [37]. Immunoprecipitates were pelleted and rinsed twice with 1 ml ice-cold buffer (as above but with 0.5 M NaCl) and once with ice-cold HEPES buffer (50 mM HEPES pH 7.4, 0.03% Brij-35 and 1 mM DTT). AMPK kinase activity was assayed at 30 °C, in the presence of 0.1 μCi of [γ-32P]ATP, 0.33 mM cold ATP, 8.3 mM MgCl2, 0.33 mM AMP, and 0.33 mM HMRSAMSGLHLVKRR (SAMS) peptide. Kinase activity is expressed as phosphate incorporation into 1 nmol substrate in 1 min per mg of protein. Each bar of a graph consists of data from at least six separate immunoprecipitations, each from a separate dish of cells.
2.3. Hydrophobicity
Molecular representations of log P were generated in Marvin Sketch, as were calculations of log P, with 1:1:1 weighting for VG [38], KLOP [39] and PHYSPROP approaches.
2.3.1. Luciferase reporter and WST-1 assays
The reporter cell line LLHG stably expresses the human glucose 6-phosphatase promoter upstream of the luciferase reporter gene. This cell line was a generous gift from Dr Calum Sutherland. LLHG cells were plated into 12 well plates and left overnight. Cells were washed once in serum-free DMEM before serum starving for 6 h and subsequent overnight treatment with dexamethasone and cAMP [23] and drugs as indicated in the figures. For lysis, cells were washed once in PBS before addition of 1× Cell Culture Lysis Buffer (Promega). Wells were scraped and lysates spun for 2 mins, 4 °C, 13,000 rpm. For luciferase assay, 10 μl lysate was added to a 96-well, white walled, clear bottom plate and 100 μl luciferase assay reagent (Promega) added before quantification of luminescence. To correct for well-to-well variation, protein concentration was determined by Bradford assay. Data is represented as RLU/mg protein. Effects of each dose were measured at least six times, each from a separate well of cells. For WST-1 assays, H4IIE cells were seeded on a 96 well plate, placed in serum-free medium and treated with the appropriate drugs. WST-1 mixture (Roche) was added to each well, mixed and incubated for two hours. Effects of each dose were measured at least eight times, each from a separate well of cells. The absorbance of each sample was measured using a spectrophotometer at a wavelength of 440 nm.
2.3.2. Measurement of whole-cell oxygen consumption rate
Using the Seahorse XF24, OCR was measured as described previously [2]. Briefly, cells were plated at a density of 1 × 106 cells per well in serum-containing medium. Once attached, cells were washed once in serum-free DMEM and incubated for 2 h with de-gassing for the final hour. For the assay, cells were incubated in unbuffered DMEM containing 1 g/L glucose, 200 mM Glutamax-1, 100 mM sodium Pyruvate, 30 mM NaCl. Baseline OCR was measured for 30 mins before injection of appropriate compounds. OCR was continuously measured for a period of 145 min before uncoupling by addition of 100 uM 2,4 dinitrophenol (2,4, DNP).
2.4. Glucose assay
Treatment of cells for hepatocyte glucose production was carried out essentially as described previously, using primary mouse hepatocytes [2], [5], [23], [40]. Glucose production was determined after a 12 h incubation period in glucose-free DMEM with or without diguanide analogues, 2 mM metformin or 100 µM cAMP (Calbiochem, 116812). At the end of the incubation period of 12 h, medium was collected and glucose concentration determined by the hexokinase/glucose-6-P dehydrogenase method. Each bar of a graph consists of data from at least three separate measurements, each from a separate dish of cells, assayed by GAGO assay as described earlier [5].
2.4.1. Submitochondrial particles and intact mitochondria
Rat liver mitochondria were prepared in 70 mM sucrose, 210 mM mannitol, 5 mM HEPES, 1 mM EGTA and 0.5% fatty-free bovine serum albumin, pH 7.2 essentially as described by [41], [42]. The excised liver was cut with scissors to approx. 4-mm diameter pieces and homogenized in a Teflon-pestle Potter-Elvehjem homogenizer with two passes at 300 rpm. The homogenate was centrifuged at 750×g and the supernatant centrifuged at 8000×g. The pellet was resuspended in the isolation medium and centrifuged at 8000×g and the pellet resuspended in a volume of 1 ml/g original liver weight and kept in an ice bath.
Submitochondrial particles (SMP) were prepared according to [43] by suspending rat liver mitochondria in 30 mM potassium phosphate buffer, 0.4 mM EDTA and sonication for a total of 120 s with a 50% duty cycle in a Branson Sonifier Cell Disruptor B-30 using power setting 4 and a micro tip. The suspension was centrifuged at 8000×g and the resulting supernatant at 105,000×g for 45 min in a Ti60 fixed-angle rotor in a Beckman L8-70 M ultracentrifuge. The pellet was suspended in 30 mM potassium phosphate, pH 7.4. All manipulations, including chopping the liver, homogenizing, re-suspending and sonication were performed on an ice/water bath, centrifugation, and ultracentrifugation were performed in refrigerated centrifuges in rotors pre-cooled to 4 °C. Protein concentration in mitochondria and submitochondrial particles was measured with the biuret method.
2.4.1.1. Fluorometry
NADH (excitation 340 nm, emission 460 nm) fluorescence was measured in a Fluoromax-2 spectrofluorometer (Horiba Jobin Yvon, Inc., Edison, NJ, U.S.A).
Oxygen consumption by mitochondrial suspensions was measured with a polarographic Rank Brothers oxygen electrode with Perspex chamber (Rank Brothers, Cambridge, U.K.) with a magnetic stirrer. In experiments where fluorescence and oxygen consumption were monitored simultaneously, the fluorometric 1 cm × 1 cm cuvette was equipped with a magnetic stirrer, a stopper with an injection port and a miniature oxygen electrode (MI-730, Microelectrodes, Inc., Bedford, NH, U.S.A.).
2.4.2. Complex I electron transfer to hydrophilic electron acceptors
This was measured using the MitoTox Complex I OXPHOS Activity Microplate Assay (AbCam, ab109903). The assay was performed essentially following the manufacturer's instructions. The only difference was that ubiquinone was substituted with either 200 µM paraquat (Sigma, 36541) or 1 mM K3Fe(CN)6 (Sigma, 702587). Differing doses of metformin and DG5 as indicated were used as the compounds to be tested.
2.5. Data and statistical analyses
Errors in bar graphs are expressed as mean ± SEM. Comparisons between groups were made by one-way or two-way ANOVA with post-hoc test using Prism. EC50s and IC50s were determined using Prism. Differences were considered statistically significant if P was less than 0.05. *** denotes p < 0.001; ** denotes p < 0.01 and * denotes p < 0.05.
3. Results
3.1. Diguanides induce metformin-like effects on AMPK signalling and S6 phosphorylation
In the first experiments we compared the effect of commercially available diguanides with metformin (Fig. 1a,b) on AMPK and S6 signalling, focusing on metabolic signalling responses that we have studied previously in liver cells [2], [5]. At a single concentration, we found that two diguanides, 1,10-Bis(guanidino)decane (synthalin A, termed DG10 in this study) and 1,6-Bis(guanidino)hexane (DG6 in this study) had effects on both AMPK and S6 phosphorylation at 25 μM, whereas 1,4-Bis(guanidino)butane (arcaine, DG4 in this study) was ineffective (Fig. 1c, quantified in supplementary Fig. 1). Previous studies also established that alkylguanidines with chain lengths comparable with synthalin act as even more potent mitochondrial inhibitors than diguanides or biguanides [13] and therefore we tested dodecylguanidine (AG12), the most potent of these, and found that it too activated AMPK and suppressed S6 phosphorylation (Fig. 1c), demonstrating that the second guanidine group is dispensable for effects of diguanides on these signalling pathways.
In dose response experiments, we found that DG4 induced no apparent changes in AMPK, ACC or S6 at 2 mM, whilst the effects of DG10 on these readouts were apparent in the low micromolar range (Fig. 1d, calculated EC50s on ACC and AMPK and IC50s on S6 phosphorylation in Table 1a). Previous studies on glycaemia carried out in the 1930s [44] also found that diguanides with more than four carbons act very much more potently than biguanides. To study this further, we synthesized diguanides that are not commercially available, DG5, DG7 and DG8, using a modification of an earlier synthesis protocol. In this reaction, the products precipitate but the reactants remain in solution, which enabled us to obtain very pure preparations. Indeed, LC-MS analysis yielded single peaks of the expected mass for all diguanide compounds with estimated purity >95% (Fig. 2a). MS and MS2 data are presented (Supplementary Fig. 2). One effect of increasing chain length is increased hydrophobicity, and to enable a further test of the importance of this property in the action of the diguanides, an additional analogue was synthesized where the alkane chain in DG8 was disrupted by replacement with an amine group, to generate DG8N (Fig. 2b). Calculated hydrophobicity maps are presented showing the effects of this substitution compared with DG8 (Supplementary Fig. 3a,b). DG8N has a lower hydrophobicity than DG4 (clogD −10.08 against −7.68).
Table 1.
A | DG4 | DG5 | DG6 | DG7 | DG8 | DG10 | DG8N |
---|---|---|---|---|---|---|---|
pACC | >500 n = 3 | 11.0 (5.2–23.3) n = 3 | 2.4 (1.3–4.6) n = 4 | 3.4 (1.8–6.2) n = 5 | 3.1 (1.3–7.6) n = 3 | 2.2 (1.0–4.9) n = 4 | >500 n = 3 |
pAMPK | >500 n = 2 | 12.9 (4.7–35.1) n = 3 | 1.4 (0.6–3.0) n = 3 | 3.7 (1.6–8.4) n = 4 | 2.5 (1.5–4.2) n = 3 | 1.2 (0.8–1.8) n = 4 | >500 n = 3 |
pS6 | >500 n = 3 | 536 (163–1750) n = 3 | 2.8 (1.8–4.1) n = 3 | 4.9 (2.3–10.3) n = 5 | 14.8 (11–19) n = 3 | 3.9 (2.0–7.3) n = 4 | >500 n = 3 |
B | 2-methyl DG6 | 1-ethyl | 2,2-dimethyl |
---|---|---|---|
DG5 | DG5 | ||
pACC | 16 (7.4–33) n = 3 | >200 n = 3 | >200 n = 3 |
pAMPK | 27 (18–40) n = 3 | >200 n = 3 | >200 n = 3 |
pS6 | 32 (24–43) n = 3 | >200 n = 3 | >200 n = 3 |
3.2. A hydrophobicity threshold affecting potency of diguanides on AMPK, gluconeogenic gene expression and hepatocyte glucose output
We examined effects of synthesized diguanides on cell signalling (Fig. 2c) and calculated EC50s for ACC/AMPK phosphorylation and IC50s for S6 phosphorylation by analysis of densitometry data from blots. We found that DG5 was less potent than DG7, DG8 and DG10 on ACC, AMPK and S6 phosphorylation, with EC50s and IC50s for these latter drugs in the low micromolar range (Table 1a). The lack of effect of DG4 suggests that a chain length threshold of five is required for effects at this time-point. When we assayed effects of the drugs on cell AMPK activity, we found that DG5, the least potent of the active compounds, and DG10, the most potent, both increased AMPK activity at least as well as metformin and at much lower concentrations (Fig. 2d). To investigate further whether either chain length or hydrophobicity correlated with the potency of diguanide analogues, we compared DG8 with DG8N. In parallel experiments, we demonstrated low micromolar efficacy of DG8 on signalling responses (Fig. 2e) whilst in contrast, DG8N was inactive at much higher concentrations (Fig. 2e).
The western blotting data outlined above suggests that diguanides DG4-6 are progressively more potent as hydrophobicity increases, plateauing from DG6 upwards (Fig. 1, Fig. 2, e). We recognize that western blotting is best described as a semi-quantitative technique and to carry out further comparison of the diguanides and biguanides, we measured metformin-like effects of the compounds on activity of the glucose 6-phosphatase promoter (Table 2). Plotted on a graph, potency of the diguanides and biguanides both increased with the calculated LogD, with a sharp potency step-up, greatly lowering IC50s between DG4 and DG6 in diguanides and between biguanide/ metformin and phenformin in the biguanide drugs (Fig. 3a, squares L-R are DG4, DG5, DG6, DG7, DG8, DG10, whilst triangles L-R are biguanide, metformin, phenformin). The difference in hydrophobicity between metformin and phenformin due to the presence of the phenyl ring in phenformin is presented in Supplementary Fig. 4a,b. The IC50 of phenformin is well within the range exhibited by DGs, whilst the other two biguanides are less potent (Fig. 3a). A comparison of DG8 and DG8N showed a striking difference between the potencies of these two analogues, as DG8 inhibited the gene promoter at concentrations as low as 1 μM, while in contrast DG8N was ineffective at millimolar levels (Fig. 3b).
Table 2.
DG4 | DG5 | DG6 | DG7 | DG8 | DG10 | Biguanide | Metformin | Phenformin | |
---|---|---|---|---|---|---|---|---|---|
G6Pase | 597 (435–820) | 20.0 (12.6–31.8) | 1.8 (1.6–2.0) | 1.8 (1.5–2.1) | 0.8 (0.7–0.9) | 1.1 (0.9–1.5) | 1.9 mM (1.6–2.3) | 1.2 mM (0.8–1.8) | 8.2 (4.8–13.9) |
WST-1 | 173.5 (124.2–242.3) | 39.0 (10.9–138.9) | 4.5 (3.2–6.4) | 4.0 (2.8–5.5) | 1.6 (1.2–2.0) | 3.4 (2.3–5.1) | >500 | >500 | 57.8 (26.1–127.6) |
We also investigated the effects of DG5, DG8 and DG8N on hepatocyte glucose production, as this is thought to be the major clinical hallmark of metformin action [45], [46]. We found that the effects of the drugs were similar to those that we had observed on AMPK phosphorylation, as DG5 and DG8 both suppressed hepatocyte glucose production, in a dose-dependent manner whilst DG8N was ineffective (Fig. 3c). In primary hepatocytes we found a similar pattern of signalling, with DG5 and DG8 active but DG8N inactive on AMPK and ACC phosphorylation (Fig. 3d). In addition, consistent with recent work of ours that mitochondrial inhibition by biguanides can inhibit NF-κB signalling [5], we found that DG5 and DG8 but not DG8N inhibited TNFα-induced IκB degradation (Fig. 3d and Supplementary Fig. 5a-c).
3.3. A minimum hydrocarbon chain length affects potency of diguanides on AMPK, gluconeogenic gene expression and hepatocyte glucose output
Next, we examined the effect of branching of the hydrocarbon chain connecting the guanides in the DG molecule. We synthesized three further molecules, depicted in Fig. 4a. 2-methyl DG6 is a branched isomer of DG6. In this molecule the length of the hydrocarbon linker remains the same as the threshold compound DG5. In addition, two branched isomers of DG5 were generated with shorter hydrocarbon linkers. LCMS data in Fig. 4b indicated each compound was >95% pure, with the exception of the 2,2-dimethyl isomer with estimated purity of 90%. MS and MS2 data is presented in Supplementary Fig. 6a,b. When we compared these analogues side by side, we found that only the 2-methyl DG6 isomer induced AMPK signalling and suppressed S6 phosphorylation (Fig. 4c, Table 1b) and hepatocyte glucose production (Fig. 4d), indicating that in addition to possible contributions of hydrophobicity in itself, the DG compounds’ low micromolar signalling effects depend on a minimum hydrocarbon chain length of 5 carbons.
3.4. Mitochondrial responses to phenformin and diguanides differ from metformin
One possible explanation for the overlap in potencies that we observed between phenformin and diguanides is that there are targets for hydrophobic guanide-containing compounds that are inhibited by phenformin and with progressively increasing potency by diguanides. To study this further we investigated whether other cellular effects of phenformin correlate more closely with diguanides than metformin. Consistent with this we found that phenformin and diguanides inhibited mitochondrial dehydrogenase activity in cells, with IC50s in the WST-1 assay corresponding very closely with IC50s on the G6Pase promoter (Table 2, Fig. 5. DGs left to right are DG4, DG5, DG6, DG7, DG8 and DG10. Phenformin is the only triangle), whilst in contrast, we were unable to establish IC50s in the WST-1 assay for metformin and biguanide, despite them efficiently inhibiting G6Pase (Fig. 3a). In Seahorse microplate studies to measure mitochondrial respiratory activity in cells, we found that DG5, DG10, metformin and phenformin each suppressed oxygen consumption to a similar degree (Fig. 6a,b). In other experimental approaches however, further marked differences were detected between metformin and the other drugs. In a conventional oxygen electrode chamber, direct measurement of effects on oxidation of the NADH/NAD+ couple by liver submitochondrial particles corresponded much more closely with effects on the WST-1 assay. Effects of both phenformin and DG5 on NADH oxidation were observed at much lower concentrations than responses to metformin (Fig. 7). The effects of metformin and DG8 on intact mitochondria were also different. Treatment of mitochondria with DG8 modestly reduced oxygen consumption and reduced the NADH/NAD+ couple, consistent with complex I inhibition (Fig. 8). Once oxygen was depleted however, the NADH/NAD+ couple did not respond, indicative of mitochondrial deterioration. Metformin treatment also modestly reduced oxygen consumption but in contrast to DG8, this was accompanied by acute oxidation of the NADH/NAD+ couple (Fig. 8) and in addition, once oxygen was depleted, the NADH/NAD+ couple responded to this, indicating that the mitochondria remained functional (Fig. 8).
In a final series of experiments, we compared metformin and DG5 on complex I electron transfer activity to artificial electron acceptors K3Fe(CN)6 and paraquat, as previous studies have shown that metformin has opposing effects on these, inhibiting NADH:paraquat electron transfer reactions, whilst stimulating NADH:ferricyanide electron transfer [30]. With metformin we observed similar effects to those published previously. The direction of the responses to DG5 was the same; however, there were important differences between the two drugs. The effects of metformin and DG5 on K3Fe(CN)6 had similar shaped dose-response curves, with >50% maximal activity achieved at 12.5 mM for both drugs (Fig. 9a). In contrast, particularly at low concentrations of drug, the dose-effect response of metformin on paraquat was much shallower than that observed with DG5 (Fig. 9b). Consequently the IC50 of metformin on electron donation to paraquat was almost an order of magnitude less potent than DG5 (metformin IC50 91 mM (95% CI 69–118); DG5 IC50 12 mM (95%CI 9–15)).
4. Discussion
4.1. Similarities and differences between cellular responses to biguanides and diguanides
In this study, we synthesized a series of diguanide compounds, to compare their action on cells with biguanides. Diguanides are metformin analogues where two guanide groups are separated by an alkyl chain of variable length. Extension of this chain from 4 to 10 carbons yields compounds with increasing hydrophobicity, and anti-hyperglycaemic efficacy. We investigated whether these compounds produced metformin-like effects on cell signalling, including elevation of AMPK phosphorylation and dephosphorylation of S6. We found that DG4 had little or no effect but DG5-DG10 had effects reminiscent of metformin and both DG5 and DG8 suppressed hepatocyte glucose production. Consistent with earlier in vivo data that these more hydrophobic diguanides are much more potent than metformin [11], we found that their effects occurred in the very low micromolar range, in striking contrast to metformin, where millimolar amounts of the drug are required for acute effects on signalling. In addition to the relationship between hydrophobicity and DG potency in unbranched diguanides, we found that branching of DGs, if it generated a hydrocarbon chain shorter than five carbons, resulted in compounds without activity on glucose production. These data indicate that the structure of the hydrocarbon chain also contributes to molecular recognition/access aspects of drug action, reminiscent of recent work on biguanide analogues [47].
The differences between biguanides and diguanides are consistent with the notion that metformin and diguanides employ different mechanisms once they access the mitochondria. The difference is unlikely to be due to the increased charge of diguanides, as monoalkylguanides, which possess a single charge like metformin, are even more potent inhibitors of mitochondria than diguanides [13]. We also measured the effects of biguanides and diguanides on gluconeogenic gene expression. At the longer time-point of these measurements, even DG4 reduced gluconeogenic gene expression much more potently than metformin. Phenformin was the most potent of the biguanides, within the range exhibited by diguanides, suggesting that phenformin but not metformin might be sufficiently hydrophobic to share a target with the diguanides.
4.2. Comparison of effects of biguanides and diguanides on mitochondrial responses
Using Seahorse microplate methodology, we found that biguanides and diguanides suppressed oxygen consumption rate (OCR) to a similar extent (Fig. 6) and with either drug type, the OCR following uncoupling with DNP was suppressed, consistent with previous data for metformin [2], [48] suggesting disruption of the electron transport chain. Differences between metformin and the other drugs were apparent however when we carried out more detailed investigations. First, we considered effects of the drugs on the NADH/NAD+ couple in SMPs and intact mitochondria, where the drugs are thought to accumulate. Previous results showed for example that biguanides inhibit NADH oxidation in SMPs at concentrations much higher than those required to induce respiratory inhibition in cells [14], [30]. The discrepancy in doses required is understood to owe at least in part to protracted accumulation of these drugs into the mitochondria, such that short term in vitro studies necessitate higher doses [30]. Expanded to include diguanides, we found that both phenformin and DG5 but not metformin inhibited NADH oxidation, suggesting that inhibition of complex I corresponds well with effects of these drugs on cell viability on mitochondrial dehydrogenase activity in cells. One possible reason for the differences between metformin and other drugs could be that responses to this drug are self-limiting, because metformin is understood to require active mitochondria in order to accumulate [14]; however in SMPs, the drugs have free access to the enzymes but even here metformin remains much less potent than phenformin and even a diguanide whose calculated hydrophobicity is less than metformin. The effects of phenformin and DG5 were also qualitatively different, with the inhibition by DG5 being instantaneous, whilst phenformin's effects took longer to develop and appeared similar to effects observed with 100 mM metformin added to SMPs, which were previously attributed to biguanides stabilizing ‘deactive’ forms of complex I [30], [49] that arise in the absence of NADH. This suggests that DGs may target active conformations of complex I, whereas biguanides selectively target the ‘deactive’ conformation, although mitochondrial swelling, which we have found is induced by phenformin (data not shown), provides an alternative explanation for the unusually slow development of effects on oxygen consumption we observed with this drug
Qualitative and quantitative differences were also observed in intact mitochondria. Despite a substantial reduction of the NADH/NAD+ couple by DG8 addition, oxygen consumption was only modestly inhibited. NADH is the only electron donor in this setting and so these results are difficult to interpret. Once oxygen was depleted, the NADH/NAD+ couple did not respond to this either. Taken together with the data in SMPs, this suggests that hydrophobic guanide-containing compounds but not metformin may to varying degrees trigger mitochondrial swelling and mitochondrial pore permeability transition. Similar slow inhibition of oxygen consumption of intact mitochondria by DG10 was described previously [13]. Metformin also reduced oxygen consumption but in striking contrast to DG8, the mitochondria did not deteriorate with metformin and the drug acutely oxidised the NADH/NAD+ couple (Fig. 8). Reduction of NADH/NAD+ following oxygen depletion suggests that substrate transport, which is mediated mainly by malate aspartate shuttle components in isolated mitochondria, is still functional even in the presence of high concentrations of metformin.
In recent in vitro studies it was shown that besides inhibiting NADH: hexaammineruthenium(III) and NADH:paraquat electron transfer reactions, metformin-dependent loosening of nucleotide binding from the reduced flavin stimulates NADH:ferricyanide and shunting of electrons from NADH directly to O2 with production of reactive oxygen species including superoxide [30], [50]. In addition to the differences we observed in intact mitochondria, we found that at modest doses, DG5 was a much more potent inhibitor than metformin of NADH:paraquat electron transfer, while both drugs exhibited a similar dose response curve of stimulation for NADH:ferricyanide electron transfer. The physiological significance of the differences in electron transfer to these hydrophilic electron acceptors is uncertain. Oxidation of NADH/NAD+ by metformin in intact mitochondria might suggest that stimulation of complex I electron transfer to generate reactive oxygen species is more significant for this drug, with complex I inhibition the more important effect for diguanides, with phenformin potentially exploiting both mechanisms. This suggests metformin but not diguanides may selectively divert NADH electron transfer to non-energy-transducing reactions, which could in principle explain some of the suppression of weight gain associated with use of the drug. Recent mutational analysis of bacterial complex I confirms that NADH oxidation and proton transfer coupling ratios are modifiable [51]. Control experiments suggest that the concentrations of metformin used do not cause mitochondrial swelling (data not shown) and in addition, similar differences on the NADH/NAD+ couple were obtained previously comparing phenformin with octylguanidine [52]. Taken together, these results suggest metformin, phenformin and diguanides each modulate mitochondrial oxidation of complex I substrates by distinct mechanisms.
5. Conclusion
A variety of guanide-containing drugs inhibit the mitochondria. We found that even a single guanide group attached to a lipophilic tail is a viable pharmacophore for these effects. We present additional evidence however that metformin does not produce the mitochondrial damage observed with more hydrophobic guanide-containing drugs, inhibiting the mitochondria by a distinctive mechanism resulting in oxidation of the NADH/NAD+ couple. Our results strongly suggest that metformin, but none of the other guanide-containing drugs tested, inhibits energy transduction by selectively suppressing efficient coupling of the redox and proton transfer domains of complex I. Further study of these differences might account for the clinical observations that hydrophobic alkylguanides and diguanides are toxic [12], hydrophobic biguanides such as buformin and phenformin are readily capable of inducing lactic acidosis [53], whilst metformin does not very readily exhibit either of these properties [54] but does suppress weight gain [29].
Conflict of interest
No potential conflicts of interest relevant to this article were reported.
Acknowledgements
G.R. acknowledges funding from the UK Medical Research Council (MRC) (MR/K012924/1) and the Diabetes UK RW and JM Collins studentship, supporting C.F. (12/0004625). S.B. was supported by a Ph.D. studentship from the Rank Prize Funds to G.R., with additional support provided by the University of Dundee. K.P. was supported by a Wellcome Trust Clinical Ph.D. studentship. The research was also supported by further grants from Tenovus Scotland (G.R.), by the MRC (K.S.). D.S. and G.McD. acknowledge funding from The Scottish Government's Rural and Environment Science and Analytical Services Division. MJP acknowledges support from the Engineering and Physical Sciences Research Council (EPSRC) through platform grant EP/P001459/1.
Footnotes
Supplementary data associated with this article can be found in the online version at doi:10.1016/j.redox.2017.08.018.
Appendix A. Supplementary material
References
- 1.Repiščák P., Erhardt S., Rena G., Paterson M.J. Biomolecular mode of action of metformin in relation to its copper binding properties. Biochemistry. 2014;53:787–795. doi: 10.1021/bi401444n. [DOI] [PubMed] [Google Scholar]
- 2.Logie L., Harthill J., Patel K., Bacon S., McDougall G., Hamilton D.L. Cellular responses to the metal-binding properties of metformin. Diabetes. 2012;61:1423–1433. doi: 10.2337/db11-0961. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Ray R.K., Kauffman G.B. New Age International Publishers; New Delhi: 1999. Metal and Non-Metal Biguanide Complexes. [Google Scholar]
- 4.Quan X., Uddin R., Heiskanen A., Parmvi M., Nilson K., Donolato M. The copper binding properties of metformin - QCM-D, XPS and nanobead agglomeration. Chem. Commun. 2015;51:17313–17316. doi: 10.1039/c5cc04321b. [DOI] [PubMed] [Google Scholar]
- 5.Cameron A.R., Morrison V., Levin D., Mohan M., Forteath C., Beall C. Anti-inflammatory effects of metformin irrespective of diabetes status. Circ. Res. 2016;119:652–665. doi: 10.1161/CIRCRESAHA.116.308445. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Rena G., Pearson E.R., Hardie D.G. The mechanisms of action of metformin. Diabetologia. 2017 doi: 10.1007/s00125-017-4342-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Slotta K.H., Tschesche R. Über biguanide, II.: die blutzucker-senkende wirkung der biguanide. Ber. Dtsch Chem. Ges. 1929;62:1398–1405. [Google Scholar]
- 8.Hawgood B.J. Karl Heinrich Slotta (1895–1987) biochemist: snakes, pregnancy and coffee. Toxicon. 2001;39:1277–1282. doi: 10.1016/s0041-0101(00)00264-6. [DOI] [PubMed] [Google Scholar]
- 9.Frank E., Nothmann M., Wagner A. Über synthetisch dargestellte körper mit insulinartiger wirkung auf den normalen und diabetischen organismus. Klin Wochenschr. 1926;5:2100–2107. [Google Scholar]
- 10.Bischoff F., Sahyun M., Long M.L. Guanidine structure and hypoglycemia. J. Biol. Chem. 1929;81:325–349. [Google Scholar]
- 11.Kumagai T., Kawai S.-I., Shikinami Y. Über die Guanidinderivate, welche auf den blutzucker senkend wirken. Proc. Imp. Acad. 1928;4:23–26. [Google Scholar]
- 12.Mahler R.F. Chemistry of Hypoglycaemic Substances Other than Insulin. Brit. Med. Bull. 1960;16:250–254. doi: 10.1093/oxfordjournals.bmb.a069845. [DOI] [PubMed] [Google Scholar]
- 13.Pressman B.C. The effects of guanidine and alkylguanidines on the energy transfer reactions of mitochondria. J. Biol. Chem. 1963;1963(238):401–409. [Google Scholar]
- 14.Owen M.R., Doran E., Halestrap A.P. Evidence that metformin exerts its anti-diabetic effects through inhibition of complex 1 of the mitochondrial respiratory chain. Biochem J. 2000;348:607–614. [PMC free article] [PubMed] [Google Scholar]
- 15.Schafer G. On the mechanism of action of hypoglycemia-producing biguanides, a reevaluation and a molecular theory. Biochem Pharm. 1976;25:2005–2014. doi: 10.1016/0006-2952(76)90423-8. [DOI] [PubMed] [Google Scholar]
- 16.Schafer G. Guanidines and biguanides. In: Erecinska M., Wilson D.F., editors. Inhibitors of Mitochondrial Functions. Pergamon Press; New York: 1981. pp. 165–185. [Google Scholar]
- 17.El-Mir M.Y., Nogueira V., Fontaine E., Averet N., Rigoulet M., Leverve X. Dimethylbiguanide inhibits cell respiration via an indirect effect targeted on the respiratory chain complex I. J. Biol. Chem. 2000;275:223–228. doi: 10.1074/jbc.275.1.223. [DOI] [PubMed] [Google Scholar]
- 18.Zhou G., Myers R., Li Y., Chen Y., Shen X., Fenyl-Melody J. Role of AMP-activated protein kinase in mechanism of metformin action. J. Clin. Investig. 2001;108:1167–1174. doi: 10.1172/JCI13505. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Hawley S.A., Gadalla A.E., Olsen G.S., Hardie D.G. The antidiabetic drug metformin activates the AMP-activated protein kinase cascade via an adenine nucleotide-independent mechanism. Diabetes. 2002;51:2420–2425. doi: 10.2337/diabetes.51.8.2420. [DOI] [PubMed] [Google Scholar]
- 20.Duca F.A., Cote C.D., Rasmussen B.A., Zadeh-Tahmasebi M., Rutter G.A., Filippi B.M. Metformin activates a duodenal Ampk-dependent pathway to lower hepatic glucose production in rats. Nat. Med. 2015 6;21:506–511. doi: 10.1038/nm.3787. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Boyle J.G., Logan P.J., Ewart M.A., Reihill J.A., Ritchie S.A., Connell J.M.C. Rosiglitazone stimulates nitric oxide synthesis in human aortic endothelial cells via AMP-activated protein kinase. J. Biol. Chem. 2008;283:11210–11217. doi: 10.1074/jbc.M710048200. [DOI] [PubMed] [Google Scholar]
- 22.Hawley S.A., Fullerton M.D., Ross F.A., Schertzer J.D., Chevtzoff C., Walker K.J. The ancient drug salicylate directly activates AMP-activated protein kinase. Science. 2012:918–922. doi: 10.1126/science.1215327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Cameron A.R., Logie L., Patel K., Bacon S., Forteath C., Harthill J. Investigation of salicylate hepatic responses in comparison with chemical analogues of the drug. BBA Mol. Basis Dis. 2016;1862:1412–1422. doi: 10.1016/j.bbadis.2016.04.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Al-Oanzi Z.H., Fountana S., Moonira T., Tudhope S.J., Petrie J.L., Alshawi A. Opposite effects of a glucokinase activator and metformin on glucose-regulated gene expression in hepatocytes. Diabetes Obes. Metab. 2017;17:1078–1087. doi: 10.1111/dom.12910. [DOI] [PubMed] [Google Scholar]
- 25.Kalender A., Selvaraj A., Kim S.Y., Gulati P., Brule S., Viollet B. Metformin, independent of AMPK, inhibits mTORC1 in a rag GTPase-dependent manner. Cell Metab. 2010;11:390–401. doi: 10.1016/j.cmet.2010.03.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Kickstein E., Krauss S., Thornhill P., Rutschow D., Zeller R., Sharkey J. Biguanide metformin acts on tau phosphorylation via mTOR/protein phosphatase (PP2A) signalling. Proc. Natl. Acad. Sci. USA. 2010;107:21830–21835. doi: 10.1073/pnas.0912793107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Madiraju A.K., Erion D.M., Rahimi Y., Zhang X.-M., Braddock D.T., Albright R.A. Metformin suppresses gluconeogenesis by inhibiting mitochondrial glycerophosphate dehydrogenase. Nature. 2014;510:542–546. doi: 10.1038/nature13270. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.A. Baur Joseph J. Birnbaum Morris Control of gluconeogenesis by Metformin: does redox trump energy charge? Cell Metab. 20, 197-199. [DOI] [PMC free article] [PubMed]
- 29.Effect of intensive blood-glucose control with metformin on complications in overweight patients with type 2 diabetes (UKPDS 34). UK Prospective Diabetes Study (UKPDS) Group, The Lancet, 1998, 352, 854-65. [PubMed]
- 30.Bridges H.R., Jones A.J.Y., Pollak M.N., Hirst J. Effect of metformin and other biguanides on oxidative phosphorylation in mitochondria. Biochem J. 2014;462:475–487. doi: 10.1042/BJ20140620. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Tricot C., Pierard A., Stalon V. Comparative studies on the degradation of guanidino and ureido compounds by Pseudomonas. J. Gen. Microbiol. 1990;136:2307–2317. doi: 10.1099/00221287-136-11-2307. [DOI] [PubMed] [Google Scholar]
- 32.Cameron A.R., Anil S., Sutherland E., Harthill J., Rena G. Zinc-dependent effects of small molecules on the insulin-sensitive transcription factor FOXO1a and gluconeogenic genes. Metallomics. 2010;2:195–203. doi: 10.1039/b914984h. [DOI] [PubMed] [Google Scholar]
- 33.Cameron A.R., Anton S., Melville L., Houston N.P., Dayal S., McDougall G.J. Black tea polyphenols mimic insulin/IGF-1 signalling to the longevity factor FOXO1a. Aging Cell. 2008;7:69–77. doi: 10.1111/j.1474-9726.2007.00353.x. [DOI] [PubMed] [Google Scholar]
- 34.Cameron A.R., Wallace K., Logie L., Prescott A.R., Unterman T.G., Harthill J. The antineurodegenerative agent clioquinol regulates the transcription factor FOXO1a. Biochem J. 2012;443:57–64. doi: 10.1042/BJ20112124. [DOI] [PubMed] [Google Scholar]
- 35.Rena G., Guo S.D., Cichy S.C., Unterman T.G., Cohen P. Phosphorylation of the transcription factor forkhead family member FKHR by protein kinase B. J. Biol. Chem. 1999;274:17179–17183. doi: 10.1074/jbc.274.24.17179. [DOI] [PubMed] [Google Scholar]
- 36.Rena G., Prescott A.R., Guo S.D., Cohen P., Unterman T.G. Roles of the forkhead in rhabdomyosarcoma (FKHR) phosphorylation sites in regulating 14-3-3 binding, transactivation and nuclear targetting. Biochem J. 2001;354:605–612. doi: 10.1042/0264-6021:3540605. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Hunter R.W., Treebak J.T., Wojtaszewski J.F.P., Sakamoto K. Molecular mechanism by which AMP-activated protein kinase activation promotes glycogen accumulation in muscle. Diabetes. 2011;60:766–774. doi: 10.2337/db10-1148. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Viswanadhan V.N., Ghose A.K., Revankar G.R., Robins R.K. Atomic physicochemical parameters for three dimensional structure directed quantitative structure-activity relationships. 4. additional parameters for hydrophobic and dispersive interactions and their application for an automated superposition of certain naturally occurring nucleoside antibiotics. J. Chem. Inf. Comput. Sci. 1989;29:163–172. [Google Scholar]
- 39.Klopman G., Li J.-Y., Wang S., Dimayuga M. Computer automated log P calculations based on an extended group contribution approach. J. Chem. Inf. Comput. Sci. 1994;34:752–781. [Google Scholar]
- 40.Foretz M., Hébrard S., Leclerc J., Zarrinpashneh E., Soty M., Mithieux G. Metformin inhibits hepatic gluconeogenesis in mice independently of the LKB1/AMPK pathway via a decrease in hepatic energy state. J. Clin. Investig. 2010;120:2355–2369. doi: 10.1172/JCI40671. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Chappell J.B., Hansford R.G. Preparation of mitochondria from animal tissues and yeasts. In: Birnie G.D., editor. Subcellular Components: Preparation and Fractionation. Butterworths; London: 1972. pp. 77–91. [Google Scholar]
- 42.Rogers G.W., Brand M.D., Petrosyan S., Ashok D., Elorza A.A., Ferrick D.A. High throughput microplate respiratory measurements using minimal quantities of isolated mitochondria. PLoS One. 2011;6:e21746. doi: 10.1371/journal.pone.0021746. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Kielly W.W., Bronk J.R. Oxidative phosphorylation in mitochondrial fragments obtained by sonic vibration. J. Biol. Chem. 1958;230:521–533. [PubMed] [Google Scholar]
- 44.Broom W.A. The toxicity and glycaemic properties of a number of amidine and guanidine derivatives. J. Pharmacol. Exp. Ther. 1936;57:81–97. [Google Scholar]
- 45.Rena G., Pearson E.R., Sakamoto K. Molecular mechanism of action of metformin: old or new insights? Diabetologia. 2013;56:1898–1906. doi: 10.1007/s00125-013-2991-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Rena G., Pearson E.R., Sakamoto K. Molecular action and pharmacogenetics of metformin: current understanding of an old drug. Diabetes Manag. 2012;2:439–452. [Google Scholar]
- 47.Bridges H.R., Sirviö V.A., Agip A.-N.A., Hirst J. Molecular features of biguanides required for targeting of mitochondrial respiratory complex I and activation of AMP-kinase. BMC Biol. 2016;14:65. doi: 10.1186/s12915-016-0287-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Hawley S.A., Ross F.A., Chevtzoff C., Green K.A., Evans A., Fogarty S. Use of cells expressing gamma subunit variants to identify diverse mechanisms of AMPK activation. Cell Metab. 2010;11:554–565. doi: 10.1016/j.cmet.2010.04.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Matsuzaki S., Humphries K.M. Selective inhibition of deactivated mitochondrial complex I by biguanides. Biochemistry. 2015;54:2011–2021. doi: 10.1021/bi501473h. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Pryde K.R., Hirst J. Superoxide is produced by the reduced flavin in mitochondrial complex I: a single, unified mechanism that applies during both forward and reverse electron transfer. J. Biol. Chem. 2011;286:18056–18065. doi: 10.1074/jbc.M110.186841. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Patsi J., Kervinen M., Kytovuori L., Majamaa K., Hassinen I.E. Effects of pathogenic mutations in membrane subunits of mitochondrial Complex I on redox activity and proton translocation studied by modeling in Escherichia coli. Mitochondrion. 2015;22:23–30. doi: 10.1016/j.mito.2015.02.007. [DOI] [PubMed] [Google Scholar]
- 52.Pressman B.C. Specific inhibitors of energy transfer. In: Chance B., editor. Energy-Linked Functions of Mitochondria. Academic Press; New York: 1963. pp. 181–203. [Google Scholar]
- 53.Luft D., Schilling R.M., Eggstein M. Lactic acidosis in biguanide-treated diabetics. Diabetologia. 1978;14:75–87. doi: 10.1007/BF01263444. [DOI] [PubMed] [Google Scholar]
- 54.Salpeter S.R., Greyber E., Pasternak G.A., Salpeter E.E. Risk of fatal and nonfatal lactic acidosis with metformin use in type 2 diabetes mellitus. Cochrane Database Syst. Rev. 2010 doi: 10.1002/14651858.CD002967.pub3. (CD002967) [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.