Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2012 May 3;7(5):e34525. doi: 10.1371/journal.pone.0034525

Biochemical Issues in Estimation of Cytosolic Free NAD/NADH Ratio

Feifei Sun 1,#, Chunyan Dai 1,#, Jiansheng Xie 1, Xun Hu 1,*
Editor: Libing Song2
PMCID: PMC3343042  PMID: 22570687

Abstract

Cytosolic free NAD/NADH ratio is fundamentally important in maintaining cellular redox homeostasis but current techniques cannot distinguish between protein-bound and free NAD/NADH. Williamson et al reported a method to estimate this ratio by cytosolic lactate/pyruvate (L/P) based on the principle of chemical equilibrium. Numerous studies used L/P ratio to estimate the cytosolic free NAD/NADH ratio by assuming that the conversion in cells was at near-equilibrium but not verifying how near it was. In addition, it seems accepted that cytosolic free NAD/NADH ratio was a dependent variable responding to the change of L/P ratio. In this study, we show (1) that the change of lactate/glucose (percentage of glucose that converts to lactate by cells) and L/P ratio could measure the status of conversion between pyruvate + NADH and lactate + NAD that tends to or gets away from equilibrium; (2) that cytosolic free NAD/NADH could be accurately estimated by L/P only when the conversion is at or very close to equilibrium otherwise a calculation error by one order of magnitude could be introduced; (3) that cytosolic free NAD/NADH is stable and L/P is highly labile, that the highly labile L/P is crucial to maintain the homeostasis of NAD/NADH; (4) that cytosolic free NAD/NADH is dependent on oxygen levels. Our study resolved the key issues regarding accurate estimation of cytosolic free NAD/NADH ratio and the relationship between NAD/NADH and L/P.

Introduction

Cytosolic free NAD/NADH ratio plays a very important role in maintaining cellular redox homeostasis and it could be generally considered as a cellular metabolic readout [1], [2]. Given the fact that over 700 oxidoreductive enzymes use NAD or NADH as cofactors, the cytosolic free NAD/NADH ratio is globally involved in cellular biochemical processes. Therefore, a change of cytosolic free NAD/NADH could infer a metabolic alteration and is closely linked to physiological or pathological states [3][24].

NAD and NADH in cells exist in protein-bound and free forms. Current techniques can only measure total NAD and total NADH [2], [25][29] but could not distinguish between protein-bound and free form. Since it is the free form of NAD/NADH that regulates cellular redox potential, measurement of total NAD/NADH virtually tells no information of in vivo redox state. Williamson et al developed a method to estimate the cytosolic free NAD/NADH ratio based on the principle of chemical equilibrium [30]. When the conversion between pyruvate + NADH and lactate + NAD is at equilibrium, cytosolic free NAD/NADH ratio could be calculated by L/P ratio according to the equation of chemical equilibrium. The procedure to determine the ratio involves 3 steps: first, assume the intracellular conversion between pyruvate + NADH and lactate + NAD is at equilibrium or near-equilibrium; second, quantitatively determine intracellular pyruvate and lactate; finally, calculate the ratio according to the equation as described above.

How to correctly apply this method to estimate cytosolic free NAD/NADH remains a problematic issue. Many studies ([3][24], [31][41]) seem to have the measurement problem which apparently persists and has not been recognized at all. The reason that leads to the incorrect measurement is owing to the misuse of the equation of chemical equilibrium. In the cited studies, the cytosolic NAD/NADH ratio was calculated by lactate/pyruvate based the equation of chemical equilibrium, simply assuming that the conversion in cells was at near equilibrium without verifying how near it was. This is rationally incorrect, because the mass action ratio (Q) at near-equilibrium could differ from the Keq at equilibrium by 1 or 2 orders of magnitude ([42]). Hence, cytosolic NAD/NADH estimated as such could be deviated from the true values by 1 or 2 orders of magnitude. This has been a blind spot that misleads the estimation ever since. Another equally important issue is the relationship between NAD/NADH and L/P, which is not clear. The cytosolic free NAD/NADH ratio seems to be regarded as a variable that is dependent on the cytosolic L/P ratio, hence a change of L/P under different physiological and patholological conditions represents a corresponding change of NAD/NADH [10][22], [31][36]. However, it should be borne in mind that NAD/NADH is not necessarily a dependent variable that responds to the change of cytosolic L/P ratio. The fact that cytosolic free NAD/NADH ratio is involved in many biochemical reactions argues strongly against its dependence on a single reaction in cells. We reiterate, however, that we do not at all intend to criticize the previous studies, but that it is very important to resolve the issue regarding how to correctly apply this method in order to accurately estimate the ratio. Lin & Guarente [2] in their review article summarized the reported values of cytosolic free NAD/NADH in various tissues or cells from different species, which varied markedly from 0.1 to 644, hence they pointed out that ‘to understand the role of NAD as a metabolic regulator, it is therefore very important to investigate which reported number for the NAD:NADH ratio represents the real situation in cells’.

In this study, we sought to resolve the following issues. How is the conversion at equilibrium or at near-equilibrium in cells defined? What significant calculation error might be introduced when the method is applied to estimate cytosolic free NAD/NADH without verifying the equilibrium status of the conversion? Is the cytosolic free NAD/NADH dependent on cytosolic L/P ratio? Is this ratio a dependent variable responding to oxygen level?

Unless otherwise indicated, the word conversion indicates the conversion between lactate + NAD and pyruvate + NADH, and the NAD/NADH ratio indicates cytosolic free NAD/NADH ratio.

Results and Discussion

Intracellular Lactate Concentration and L/P Ratio are Highly Labile

Human breast cancer cell line Bcap-37 cells were incubated in medium with sufficient supply of glucose. At indicated intervals, intracellular pyruvate and lactate were measured. It was noted that intracellular lactate concentration changed drastically throughout the incubation time (Figure 1A), whereas pyruvate concentration kept relatively constant (Figure 1B). Thus, intracellular lactate concentration and L/P ratio were highly labile (Figure 1C). L/P ratios at 2- and 84-hour points were 26.2±1.2 and 158.6±11.8, respectively. If the equation of the chemical equilibrium was used to estimate NAD/NADH ratio regardless of the equilibrium status of the conversion, the estimated NAD/NADH ratios in Bcap-37 could vary from 343.3±15.7 to 57±4 (Figure 1D).

Figure 1. Intracellular lactate concentration and L/P ratio are highly labile in Bcap-37 cells.

Figure 1

Bcap-37 cells were incubated in complete RPMI-1640 medium containing 12 mM glucose and supplemented with 6 mM glucose every 24 hours. At the indicated time point, intracellular lactate and pyruvate, glucose consumption and lactate generation by Bcap-37 cells, and cell growth were monitored. (A) Intracellular lactate; (B) Intracellular pyruvate; (C) Intracellular L/P ratio; (D) Cytosolic free NAD/NADH ratio erroneously estimated from the corresponding L/P ratio; (E) Cell proliferation curves; (F) Glucose consumption; (G) Lactate generation; (H) L/G ratio (the generated lactate divided by the consumed glucose between 2 time points). Data are mean±SD. Data were confirmed by 2 independent experiments.

Apparently, such estimated NAD/NADH ratios were highly problematic. In the previous studies, it was envisaged that NAD/NADH ratio was relatively constant under physiological condition [10][22], [31][36]. In cells, there are over 700 oxidoreductases that use NAD/NADH as cofactors to catalyze numerous biochemical reactions involving endogenous or exogenous reactants. In cells, except the exergonic reactions that are far from equilibrium, most reactions are reversible and at near-equilibrium. At near-equilibrium, Q and Keq often differ by one order of magnitude of each other, there is a small difference between forward and reverse rates of reaction, so that small change of substrate/product ratio can result in a large change of reaction rate and even can change the direction of the net flow [42]. Because NAD and NADH are reciprocal substrate and product in these reactions, the change of the ratio directly interferes with the rate or even the direction of numerous oxidoreductive reactions. If NAD/NADH ratio was highly unstable, the rate and the direction of these reactions would be elusive, and cellular redox homeostasis would be easily disturbed. Thus, NAD/NADH ratio should be relatively constant in order for the physiological processes to proceed.

The change of the intracellular lactate was simply a result of lactate production by Bcap-37 cells. Bcap-37 cells are highly glycolytic and they can convert most of the incoming glucose to lactate, as manifested by the glucose consumption and lactate generation accompanying their growth and proliferation (Figure 1E–G). This explains the positive correlation between incubation time and intracellular lactate concentration.

L/G and L/P Could Measure the Conversion Status between Lactate + NAD and Pyruvate + NADH that Tends to or Gets Away from Equilibrium

It was noted that L/G changed significantly throughout the incubation (Figure 1H). L/G ratio indicates percentage of incoming glucose that converts to lactate. One molecule of glucose via complete aerobic glycolysis can yield 2 molecules of lactate. Therefore, L/G ratio is ranging between 2 – 0, reflecting 100 – 0% incoming glucose (or pyruvate and NADH generated from glycolysis) converting to lactate. The L/G value also reflects the status of the conversion between pyruvate/NADH and lactate/NAD, the smaller the value, the closer the conversion is to the equilibrium, and vice versa. At initial culture, the L/G ratio is 1.47 (Figure 1H), indicating that ∼75% of pyruvate/NADH generated from glycolysis converted to lactate/NAD. Extending incubation time led to lactate accumulation, and L/G ratio gradually decreased to 0.63±0.04, indicating that only ∼30% of pyruvate/NADH converted to lactate/NAD, hence the conversion from pyruvate to lactate was approaching equilibrium, suggesting that the estimated NAD/NADH ratio at 84-hour incubation point was closest to the true value in cells.

Under regular culture, the conversion was at near-equilibrium state, as demonstrated by the change of intracellular L/P (Figure 1C) and L/G (Figure 1H) throughout the entire incubation. The intracellular L/P ratio only increased by 6 folds, whereas the L/G ratio was significantly reduced from 1.47±0.06 to 0.63±0.04, indicating the conversion was approaching equilibrium. If the conversion was far from equilibrium, 6-fold change of product/substrate ratio would not significantly affect the conversion state [42]. Thus, our data are fully agreeable with the generally accepted perception that this conversion in cells is at near equilibrium [10][22], [31][36].

Hence, L/G and L/P could measure the conversion status between NAD + lactate and pyruvate + NADH that tends to or gets away from equilibrium.

Similar results were obtained by experimentations on other cancer cell lines (Figure S1 and S2).

Defining the Equilibrium Status of the Conversion is Essential to Estimate NAD/NADH Using L/P

How to define the equilibrium status of the conversion is a key issue to correctly estimate NAD/NADH. The equilibrium status of the conversion in cells could be defined by its rate. The net flow of the conversion depends on the intracellular Q. When the Q is smaller than the Keq, reaction proceeds to the direction of lactate formation; when the Q is equal to the Keq, the forward and reverse rates are equal, there is neither gain nor loss of lactate; when the Q is bigger than the Keq, the reaction proceeds to pyruvate formation. Based on this principle, we can verify whether this reaction in cells is at equilibrium or not.

Most cancer cells have very high glycolytic rates that result in excessive generation of pyruvate and NADH [43][45], which are beyond the capacity of pyruvate dehydrogenase and NADH mitochondrial shuttle [46]. As a result, excessive pyruvate and NADH are instantly converted to lactate and NAD by lactate dehydrogenase (LDH). Lactate is then disposed by cells via monocarboxylate transporters (MCT) [47]. Therefore, most cancer cells in culture produce quantity of lactate, reflecting that the net flow of the intracellular conversion is from pyruvate to lactate. On the other hand, considering the conversion is at near-equilibrium in cells, lactate accumulation would eventually bring the conversion to equilibrium. In order to test this hypothesis, we incubated cells in culture medium supplemented with serial concentrations of lactate. Cells would uptake lactate via MCT [47]. When intracellular lactate concentration increases to a certain level, the Q would be equal to Keq, leading to the conversion at equilibrium.

In order to see the effect of extracellular lactate on intracellular L/P ratio, we incubated Bcap-37 cells in culture medium containing 20 mM lactate and determined time-dependent lactate uptake. The steady-state lactate accumulation was attained in 10 minutes (Figure 2A), indicating a fast lactate uptake by Bcap-37 cells or a fast equilibrium of lactate concentration across plasma membrane. On the other hand, intracellular pyruvate concentration was not significantly changed (Figure 2B). As a result, L/P ratio throughout entire incubation increased by about 8 folds. Given the near-equilibrium status of the conversion in cells with Q value that is smaller but often within one order of magnitude less than Keq, this 8-fold increase of L/P ratio would likely lead the conversion to equilibrium.

Figure 2. The effect of extracellular lactate concentration on intracellular lactate concentration and intracellular L/P ratio in Bcap-37 cells.

Figure 2

Bcap-37 cells were incubated in complete RPMI-1640 medium containing 12 mM glucose supplemented with 20 mM lactate. At the indicated time point, intracellular lactate and pyruvate were measured. (A) Intracellular lactate; (B) Intracellular pyruvate; (C) Intracellular L/P ratio. Data are mean ± SD. Data were confirmed by 2 independent experiments.

In order to test whether the increase of L/P ratio could affect the equilibrium state, we measured glucose consumption and lactate generation by Bcap-37 cells that were incubated in medium containing exogenous lactate (Figure 3A–D). In the absence of exogenous lactate, cells converted quantity glucose to lactate with a high L/G ratio (Figure 3D), indicating that the net flow is from pyruvate to lactate. In the presence of exogenous 16 mM lactate, the L/G ratio was dramatically reduced to 0.2±0.03, indicating that the conversion was approaching equilibrium. In the presence of 19 mM lactate, cells produced negligible lactate and the L/G ratio was close to zero, indicating that the conversion was at or very close to equilibrium. In the presence of 22 mM lactate, cells consumed lactate, indicating that the direction of the conversion was reversed. We then measured the intracellular concentration of lactate and pyruvate, and L/P ratios in cells cultured under above conditions (Figure 3E–G). If the equilibrium state was taken into consideration, the value of NAD/NADH ratio was around 45 (Figure 3H). Otherwise, the values of NAD/NADH ratio could vary from 143.6±11.1 to 46±9.7 (Figure 3H). In principle, only when the conversion is at equilibrium, it is appropriate to use the equation ([NAD]/[NADH] = Keq×[pyruvate]/[lactate], where Keq = 9000). It is noted that when the conversion is very close to equilibrium under culture conditions of 16, 19, or 22 mM lactate, the estimated NAD/NADH values are similar to each other without significant difference. It is also noticed that NAD/NADH ratio estimated from L/P ratio at 84-hour point (Figure 1D) is close to this value. Hence, NAD/NADH ratio could be correctly estimated by L/P when the conversion is at equilibrium or very near to equilibrium.

Figure 3. Cytosolic free NAD/NADH ratio estimated at the conversion at equilibrium in Bcap-37 cells.

Figure 3

Bcap-37 cells were incubated in complete RPMI-1640 medium containing 12 mM glucose supplemented with or without lactate (x axis). After 24-hour incubation, glucose consumption and lactate generation by Bcap-37 cells, cell growth, and intracellular lactate and pyruvate were measured. (A) Cell proliferation; (B) Glucose consumption; (C) Lactate generation; (D) L/G ratio; (E) Intracellular pyruvate; (F) Intracellular lactate; (G) Intracellular L/P ratio; (H) Cytosolic free NAD/NADH ratio estimated from the corresponding L/P ratio(see corresponding text). Data are mean±SD. Data were confirmed by 3 independent experiments.

It was noted that glucose consumption was significantly reduced in cells cultured in the presence of 19 mM exogenous lactate, but cell growth rate did not significantly slow down, in comparison to the cells cultured in the absence of exogenous lactate (Figure 3A). This reflects different efficiency of glucose utilization. In the absence of exogenous lactate, most of the incoming glucose was converted to lactate as a metabolic waste, resulting in a low efficiency of glucose utilization. In the presence of 19 mM lactate, glucose was not wasted, so that the efficiency of glucose utilization is higher.

Similar results were obtained by experimentations on other cancer cell lines (Figure S3 and S4). Our study demonstrated that NAD/NADH ratio could be accurately estimated.

Relationship between NAD/NADH and L/P

We propose here that the highly labile L/P ratio is crucial to maintain the stability of NAD/NADH ratio. Under physiological conditions, cellular catabolism could produce more NADH and pyruvate than required [18], [20], [43][45]. If NADH could not be instantly recycled back to NAD, the ratio of NAD/NADH would be dramatically altered, the altered NAD/NADH ratio in turn would affect numerous oxidoredutive reactions. LDH catalyzed conversion can instantly recycle excessive NADH back to NAD and thus plays a very important role in maintaining a relatively constant NAD/NADH ratio. In line with the general biochemical principles, our data (Figure 3G, Figure S3G and S4G) also demonstrate that L/P ratio is increasing or decreasing in response to the conversion status approaching equilibrium with net flow from pyruvate to lactate or reverse. Lactate is the major variable for the L/P ratio. Cancer cells have abnormally high glycolytic rate that generates excessive pyruvate and NADH, which are instantly converted to lactate and NAD by LDH, because LDH catalyzed rate is about 2 orders of magnitude higher than the glycolytic rate (data not shown). In this conversion, since NADH is recycled back to NAD, lactate is the only net gain, so that lactate concentration and L/P are highly labile and NAD/NADH is relatively constant.

Ignoring the Equilibrium State Could Introduce a Calculation Error by One Order of Magnitude

Simply using L/P ratio to estimate NAD/NADH ratio irrespective of equilibrium state would introduce a significant calculation error, e.g., the minimal value (Bcap-37 cells incubated in culture medium without supplementing lactate at 2-hour incubation point, Figure 1D) and the maximal value (Bcap-37 cells incubated in culture medium supplementing 22 mM lactate at 24-hour incubation point, Figure 3H) of L/P ratios were 26.2±1.2 and 201.1±4.4, respectively, so that the value of NAD/NADH calculated could vary for 8.3 folds.

NAD/NADH is a Dependent Variable Responding to Oxygen Level

Oxygen level is the fundamental determinant of the oxidoreductive potential. Decrease of oxygen level reduces the oxidative potential and increases the reductive potential, and vice versa. Presumably, NAD/NADH is a dependent variable responding to oxygen levels.

Previously, NAD/NADH ratio under hypoxia and normoxia was simply estimated by the L/P ratio, without considering the equilibrium state of the conversion [10][24], [37][41]. Since cellular glycolysis rate is much higher under hypoxia than normoxia, the cellular lactate concentration and L/P ratio are naturally different under different oxygen levels, hence the observed change of L/P ratio principally do not represent a corresponding change of NAD/NADH ratio associated to oxygen level, unless the equilibrium status of the conversion is defined.

NAD/NADH was a dependent variable responding to oxygen level. When Hela cells were cultured without supplementing exogenous lactate and incubated under oxygen level from 21% to 1%, cell growth rate (Figure 4A) was positively correlated with, but the rates of glucose consumption (Figure 4B), lactate generation (Figure 4C), and L/G ratio (Figure 4D) were inversely correlated with the oxygen level. L/G ratios were 1.81 and 1.35 under 1% and 21% oxygen (Figure 4D), indicating that the lower the oxygen, the farther the conversion was away from equilibrium. Accordingly, the intracellular L/P ratio was inversely correlated with oxygen level, owing to decrease of pyruvate and increase of lactate (Figure 4E–G). If L/P ratio and the equation of the chemical equilibrium were used to estimate the NAD/NADH ratio, the values of NAD/NADH ratio under 21–1% oxygen could vary from 145 to 43 (Figure 4H). Such estimation could be erroneous, because the equilibrium status of the conversion was not taken into consideration, as described in the preceding sections.

Figure 4. The effect of oxygen levels on intracellular concentration of lactate and pyruvate in Hela cells.

Figure 4

Hela cells were incubated in complete RPMI-1640 medium containing 12 mM glucose. After 24-hour incubation, glucose consumption and lactate generation by Hela cells, cell growth, and intracellular lactate and pyruvate were measured. (A) Cell proliferation; (B) Glucose consumption; (C) Lactate generation; (D) L/G ratio; (E) Intracellular pyruvate; (F) Intracellular lactate; (G) Intracellular L/P ratio; (H) Cytosolic free NAD/NADH ratio erroneously estimated from the corresponding L/P ratio. Data are mean±SD. Data were confirmed by 2 independent experiments.

In order to correctly estimate the NAD/NADH ratio under different oxygen levels, we must first determine the equilibrium status of the conversion under different oxygen levels. We incubated cells in medium supplemented with 20 mM lactate under oxygen level from 21% to 1%, and monitored cell growth, glucose consumption, lactate generation, and L/G ratio (Figure 5A–D). Under 21% oxygen, there was no generation of lactate but a little consumption of exogenous lactate (Figure 5C), indicating that the Q was a little bigger than the Keq and the net flow of the conversion was from lactate to pyruvate. With the decrease of oxygen level, lactate generation was increasing (Figure 5C), indicating the net flow of the conversion was from pyruvate to lactate. The lower the oxygen, the farther the conversion was away from equilibrium, as manifested by enhanced glucose consumption, lactate generation, and increasing L/G ratio (Figure 5B–D). Intracellularly, whereas lactate concentration was inversely correlated with oxygen level, pyruvate concentration was on the opposite, resulting in an inverse correlation of L/P ratio with the oxygen level (Figure 5E–G). When oxygen level was 1%, despite that intracellular L/P was increased to 369, the conversion was far from equilibrium, as reflected by glucose consumption, lactate generation, and the L/G ratio (Figure 5B–D). Under 1% oxygen, the L/G ratio was 1.8, which was virtually the same as that in culture without exogenous lactate, indicating the conversion was not close to equilibrium. Thus, the NAD/NADH ratio estimated under 1% oxygen should be far smaller than 24 (Figure 5H), in contrast to 88 under normoxia (figure S3H). It should be also pointed out that the NAD/NADH ratios in cells under oxygen levels (1–16%) in Figure 5H were all overestimated to a varying degree and thus did not represent the true values, given the fact that the conversion was not at equilibrium. We were not able to accurately measure the NAD/NADH ratio under low oxygen level, because further increase of lactate concentration over 20 mM in medium was toxic to cells. Similar results were obtained using Bcap-37 cells (Figure S5).

Figure 5. The effect of oxygen levels on cytosolic free NAD/NADH ratios in Hela cells.

Figure 5

Hela cells were incubated in complete RPMI-1640 medium containing 12 mM glucose supplemented with 20 mM lactate under oxygen levels between 21% to 1%. After 24-hour incubation, glucose consumption and lactate generation by Hela cells, cell growth, and intracellular lactate and pyruvate were measured. (A) Cell proliferation; (B) Glucose consumption; (C) Lactate generation; (D) L/G ratio; (E) Intracellular pyruvate; (F) Intracellular lactate; (G) Intracellular L/P ratio; (H) Cytosolic free NAD/NADH ratio estimated from the corresponding L/P ratio (see description in text). Data are mean±SD. Data were confirmed by 2 independent experiments.

The NAD/NADH ratio is a dependent variable responding to oxygen levels. Under hypoxia, the ratio is drastically reduced. Given the fact that NAD/NADH-involved oxidoreductive reactions are reversible and at near-equilibrium, the change of the ratio would likely alter the global biochemical processes in cells, i.e., the rates of many of these reactions would be significantly affected and many of the reactions would even proceed to the opposite direction under hypoxia, in comparison to those under normoxia. The change of biochemical processes corresponding to hypoxia-linked NAD/NADH, however, has not yet attracted sufficient attention.

It was noted that intracellular pyruvate was proportional to oxygen level, whereas lactate was negatively correlated with oxygen level (Figure 4E & F, Figure 5E & F). This might be explained by the mitochondrial shuttle, whose activity depends on oxygen level. Under normoxic condition, a fraction of NADH generated from glycolysis is recycled back to NAD via mitochondrial shuttle that spares a fraction of pyruvate. Under hypoxia, mitochondrial shuttle is blocked, and LDH catalyzed reaction is the only major way to turn NADH back to NAD, resulting in more pyruvate converting to lactate. As a result, less pyruvate and more lactate were observed under hypoxia than under normoxia.

In summary, our study (1) clarifies that NAD/NADH is stable and L/P is highly labile, that NAD/NADH is not a dependent variable responding to the change of L/P ratio, and that the highly labile L/P is crucial to maintain the stability of NAD/NADH; (2) reveals a long ignored blind spot in estimation of cytosolic free NAD/NADH ratio; (3) defines that the change of L/G and L/P could measure the status of conversion between pyruvate + NADH and lactate + NAD that tends to or gets away from equilibrium.

Materials and Methods

Measurement of Cell Division, Glucose Consumption, and Lactate Generation

Human breast cancer cell line Bcap-37, gastric cancer cell line SGC7901, and cervical carcinoma cell line Hela were maintained in RPMI-1640 (Invitrogen) with 10% FBS, 1% penicillin/streptomycin and 2 mM L-glutamine. Unless otherwise indicated, 8×105 cells were seeded into six-well plate (Corning) to allow attachment overnight in a humidified CO2 incubator under normoxia or in a Workstation Invivo2 300 (RUSKINN) adjusted to a desired oxygen level (16%, 12%, 8%, 4%, or 1%). Then the culture medium was replaced with fresh RPMI-1640 medium supplemented with pure lactic acid to desired lactate concentration. At the indicated time, cell number, glucose consumption and lactate generation were determined. Cell count was carried out with a hematocytometer under optical microscope. Glucose was measured automatically by HK colorimetric method using Olympus AU2700 system. Lactate was determined by VITROS Chemistry Product LAC Slides using VITROS 5.1 FS system.

Determination of Intracellular Pyruvate and Lactate

For intracellular pyruvate and lactate determination, cells in the plates were washed with ice-cold PBS 3 times and lysed with 500 µl acetonitrile, and transferred to eppendorf tube for centrifugation (20,000 g for 15 minutes at 4°C). 40 µl of supernatant was subjected for HPLC analysis for quantitative determination of intracellular pyruvate and lactate. An ICSEP ICE-ION-300 Column (Transgenomic) was attached to HEWLETT PACKARD series 1100 HPLC system and maintained at 57°C. The mobile phase was 0.005 M H2SO4 and the flow rate was 0.4 ml/min. The peak of UV trace (210 nm) corresponding to pyruvate (retention time, 15.3 min.) and lactate (retention time, 21.3 min.) were quantitated according to the standard curves.

Calculation of NAD/NADH Ratio

The cytosolic lactate and pyruvate concentration were determined by HPLC as described above. NAD/NADH was estimated by the L/P ratio and the equation of the chemical equilibrium which is reported by Williamson et al [30]. Apparent Keq = [pyruvate]eq[NADH]eq[H+]/([Lactate]eq[NAD]eq) = 1.11×10−11, where pH is 7.0, If LDH catalyzed reaction is allowed to proceed to equilibrium, the final products and reactants could be expressed by the equation: Apparent Keq = Keq [H+], where Keq = [pyruvate]eq[NADH]eq/([Lactate]eq[NAD]eq) = 1.11×10−7 [48], [49], or [NAD]/[NADH] = [pyruvate]eq/(Keq[Lactate]eq).

Supporting Information

Figure S1

Intracellular lactate concentration and L/P ratio are highly labile in Hela cells. Hela cells were incubated in complete RPMI-1640 medium containing 12 mM glucose and supplemented with 6 mM glucose every 24 hours. At the indicated time point, intracellular lactate and pyruvate, glucose consumption and lactate generation by Hela cells, and cell growth were monitored. (A) Intracellular lactate; (B) Intracellular pyruvate; (C) Intracellular L/P ratio; (D) Cytosolic free NAD/NADH ratio erroneously estimated from the corresponding L/P ratio; (E) Cell proliferation curves; (F) Glucose consumption; (G) Lactate generation; (H) L/G ratio (the generated lactate divided by the consumed glucose between 2 time points). Data are mean±SD. Data were confirmed by 2 independent experiments.

(DOC)

Figure S2

Intracellular lactate concentration and L/P ratio are highly labile in SGC7901 cells. SGC7901 cells were incubated in complete RPMI-1640 medium containing 12 mM glucose and supplemented with 6 mM glucose every 24 hours. At the indicated time point, intracellular lactate and pyruvate, glucose consumption and lactate generation by SGC7901 cells, and cell growth were monitored. (A) Intracellular lactate; (B) Intracellular pyruvate; (C) Intracellular L/P ratio; (D) Cytosolic free NAD/NADH ratio erroneously estimated from the corresponding L/P ratio; (E) Cell proliferation curves; (F) Glucose consumption; (G) Lactate generation; (H) L/G ratio (the generated lactate divided by the consumed glucose between 2 time points). Data are mean±SD. Data were confirmed by 2 independent experiments.

(DOC)

Figure S3

Cytosolic free NAD/NADH ratio estimated at the conversion at or close to equilibrium in Hela cells. Hela cells were incubated in complete RPMI-1640 medium containing 12 mM glucose supplemented with or without lactate. After 24-hour incubation, glucose consumption and lactate generation by Hela cells, cell growth, and intracellular lactate and pyruvate were measured. (A) Cell proliferation; (B) Glucose consumption; (C) Lactate generation; (D) L/G ratio; (E) Intracellular pyruvate; (F) Intracellular lactate; (G) Intracellular L/P ratio; (H) Cytosolic free NAD/NADH ratio (note that cytosolic free NAD/NADH at equilibrium of the conversion is 88.1±3.7) estimated from the corresponding L/P ratio. Data are mean±SD. Data were confirmed by 3 independent experiments.

(DOC)

Figure S4

Cytosolic free NAD/NADH ratio estimated at the conversion at or close to equilibrium in SGC7901 cells. SGC7901 cells were incubated in complete RPMI-1640 medium containing 12 mM glucose supplemented with or without lactate. After 24-hour incubation, glucose consumption and lactate generation by SGC7901 cells, cell growth, and intracellular lactate and pyruvate were measured. (A) Cell proliferation; (B) Glucose consumption; (C) Lactate generation; (D) L/G ratio; (E) Intracellular pyruvate; (F) Intracellular lactate; (G) Intracellular L/P ratio; (H) Cytosolic free NAD/NADH ratio (note that cytosolic free NAD/NADH at equilibrium of the conversion is 129.2±2.5) estimated from the corresponding L/P ratio. Data are mean±SD. Data were confirmed by 3 independent experiments.

(DOC)

Figure S5

The effect of oxygen levels on cytosolic free NAD/NADH ratios. Bcap-37 cells were incubated in complete RPMI-1640 medium containing 12 mM glucose supplemented with 20 mM lactate under 21% or 1% oxygen. After 24-hour incubation, glucose consumption and lactate generation by Bcap37 cells, cell growth, and intracellular lactate and pyruvate were measured. (A) Cell proliferation; (B) Glucose consumption; (C) Lactate generation; (D) L/G ratio; (E) Intracellular pyruvate; (F) Intracellular lactate; (G) Intracellular L/P ratio; (H) Cytosolic free NAD/NADH ratio estimated from the corresponding L/P ratio. Note that the NAD/NADH ratio under 1% oxygen should be far smaller than the value presented (see description in text). Data are mean±SD. Data were confirmed by 2 independent experiments.

(DOC)

Footnotes

Competing Interests: The authors have declared that no competing interests exist.

Funding: This work was supported in part by National 863 project (2007AA02Z143); China Natural Sciences Foundation projects (30772544, 81071802); and the Fundamental Research Funds for the Central Universities, National Ministry of Education, China, all to Dr. Hu. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Ying W. NAD+/NADH and NADP+/NADPH in cellular functions and cell death: regulation and biological consequences. Antioxid Redox Signal. 2008;10:179–206. doi: 10.1089/ars.2007.1672. [DOI] [PubMed] [Google Scholar]
  • 2.Lin SJ, Guarente L. Nicotinamide adenine dinucleotide, a metabolic regulator of transcription, longevity and disease. Curr Opin Cell Biol. 2003;15:241–246. doi: 10.1016/s0955-0674(03)00006-1. [DOI] [PubMed] [Google Scholar]
  • 3.Bakker BM, Overkamp KM, van Maris AJ, Kotter P, Luttik MA, et al. Stoichiometry and compartmentation of NADH metabolism in Saccharomyces cerevisiae. FEMS Microbiol Rev. 2001;25:15–37. doi: 10.1111/j.1574-6976.2001.tb00570.x. [DOI] [PubMed] [Google Scholar]
  • 4.Berger F, Ramirez-Hernandez MH, Ziegler M. The new life of a centenarian: signalling functions of NAD(P). Trends Biochem Sci. 2004;29:111–118. doi: 10.1016/j.tibs.2004.01.007. [DOI] [PubMed] [Google Scholar]
  • 5.Droge W. Free radicals in the physiological control of cell function. Physiol Rev. 2002;82:47–95. doi: 10.1152/physrev.00018.2001. [DOI] [PubMed] [Google Scholar]
  • 6.Lin SJ, Ford E, Haigis M, Liszt G, Guarente L. Calorie restriction extends yeast life span by lowering the level of NADH. Genes Dev. 2004;18:12–16. doi: 10.1101/gad.1164804. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Veech RL, Raijman L, Krebs HA. Equilibrium relations between the cytoplasmic adenine nucleotide system and nicotinamide-adenine nucleotide system in rat liver. Biochem J. 1970;117:499–503. doi: 10.1042/bj1170499. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Williamson JR, Chang K, Frangos M, Hasan KS, Ido Y, et al. Hyperglycemic pseudohypoxia and diabetic complications. Diabetes. 1993;42:801–813. doi: 10.2337/diab.42.6.801. [DOI] [PubMed] [Google Scholar]
  • 9.Ziegler M. A vital link between energy and signal transduction. FEBS J. 2005;272:4561–4564. doi: 10.1111/j.1742-4658.2005.04893.x. [DOI] [PubMed] [Google Scholar]
  • 10.Obrosova IG, Van Huysen C, Fathallah L, Cao XC, Greene DA, et al. An aldose reductase inhibitor reverses early diabetes-induced changes in peripheral nerve function, metabolism, and antioxidative defense. FASEB J. 2002;16:123–125. doi: 10.1096/fj.01-0603fje. [DOI] [PubMed] [Google Scholar]
  • 11.Ido Y, Chang K, Williamson JR. NADH augments blood flow in physiologically activated retina and visual cortex. Proc Natl Acad Sci U S A. 2004;101:653–658. doi: 10.1073/pnas.0307458100. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Burgess SC, Iizuka K, Jeoung NH, Harris RA, Kashiwaya Y, et al. Carbohydrate-response element-binding protein deletion alters substrate utilization producing an energy-deficient liver. J Biol Chem. 2008;283:1670–1678. doi: 10.1074/jbc.M706540200. [DOI] [PubMed] [Google Scholar]
  • 13.Hausler N, Browning J, Merritt M, Storey C, Milde A, et al. Effects of insulin and cytosolic redox state on glucose production pathways in the isolated perfused mouse liver measured by integrated 2H and 13C NMR. Biochem J. 2006;394:465–473. doi: 10.1042/BJ20051174. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Ido Y, Kilo C, Williamson JR. Cytosolic NADH/NAD+, free radicals, and vascular dysfunction in early diabetes mellitus. Diabetologia. 1997;40(Suppl 2):S115–117. doi: 10.1007/s001250051422. [DOI] [PubMed] [Google Scholar]
  • 15.Barron JT, Gu L, Parrillo JE. NADH/NAD redox state of cytoplasmic glycolytic compartments in vascular smooth muscle. Am J Physiol Heart Circ Physiol. 2000;279:H2872–2878. doi: 10.1152/ajpheart.2000.279.6.H2872. [DOI] [PubMed] [Google Scholar]
  • 16.Tanaka J, Sato T, Kamiyama Y, Jones RT, Cowley RA, et al. Bacteremic shock: aspects of high-energy metabolism of rat liver following living Escherichia coli injection. J Surg Res. 1982;33:49–57. doi: 10.1016/0022-4804(82)90008-7. [DOI] [PubMed] [Google Scholar]
  • 17.Arieff AI, Kerian A. Lactic acidosis: an experimental model. Metabolism. 1976;25:306–312. doi: 10.1016/0026-0495(76)90088-3. [DOI] [PubMed] [Google Scholar]
  • 18.Wasserman K, Beaver WL, Whipp BJ. Gas exchange theory and the lactic acidosis (anaerobic) threshold. Circulation. 1990;81:II14–30. [PubMed] [Google Scholar]
  • 19.Nitta N, Yamamoto S, Ozaki N, Morimoto T, Mori K, et al. Is the deterioration of liver viability due to hepatic warm ischemia or reinflow of pooled-portal blood in intermittent portal triad cross-clamping? Res Exp Med (Berl) 1988;188:341–350. doi: 10.1007/BF01851202. [DOI] [PubMed] [Google Scholar]
  • 20.Mintun MA, Vlassenko AG, Rundle MM, Raichle ME. Increased lactate/pyruvate ratio augments blood flow in physiologically activated human brain. Proc Natl Acad Sci U S A. 2004;101:659–664. doi: 10.1073/pnas.0307457100. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Bassenge E, Sommer O, Schwemmer M, Bunger R. Antioxidant pyruvate inhibits cardiac formation of reactive oxygen species through changes in redox state. Am J Physiol Heart Circ Physiol. 2000;279:H2431–2438. doi: 10.1152/ajpheart.2000.279.5.H2431. [DOI] [PubMed] [Google Scholar]
  • 22.Vary TC, Jurasinski C, Kimball SR. Reduced 40S initiation complex formation in skeletal muscle during sepsis. Mol Cell Biochem. 1998;178:81–86. doi: 10.1023/a:1006826331115. [DOI] [PubMed] [Google Scholar]
  • 23.Zhang Q, Piston DW, Goodman RH. Regulation of corepressor function by nuclear NADH. Science. 2002;295:1895–1897. doi: 10.1126/science.1069300. [DOI] [PubMed] [Google Scholar]
  • 24.Zhang Q, Wang SY, Nottke AC, Rocheleau JV, Piston DW, et al. Redox sensor CtBP mediates hypoxia-induced tumor cell migration. Proc Natl Acad Sci U S A. 2006;103:9029–9033. doi: 10.1073/pnas.0603269103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Wimpenny JW, Firth A. Levels of nicotinamide adenine dinucleotide and reduced nicotinamide adenine dinucleotide in facultative bacteria and the effect of oxygen. J Bacteriol. 1972;111:24–32. doi: 10.1128/jb.111.1.24-32.1972. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Hu B. London: Academic Press; 1974. Methods in Enzymatic Analysis. [Google Scholar]
  • 27.Leonardo MR, Dailly Y, Clark DP. Role of NAD in regulating the adhE gene of Escherichia coli. J Bacteriol. 1996;178:6013–6018. doi: 10.1128/jb.178.20.6013-6018.1996. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Swierczynski J, Slominska E, Smolenski RT, Mayer D. Increase in NAD but not ATP and GTP concentrations in rat liver by dehydroepiandrosterone feeding. Pol J Pharmacol. 2001;53:125–130. [PubMed] [Google Scholar]
  • 29.Anderson RM, Bitterman KJ, Wood JG, Medvedik O, Cohen H, et al. Manipulation of a nuclear NAD+ salvage pathway delays aging without altering steady-state NAD+ levels. J Biol Chem. 2002;277:18881–18890. doi: 10.1074/jbc.M111773200. [DOI] [PubMed] [Google Scholar]
  • 30.Williamson DH, Lund P, Krebs HA. The redox state of free nicotinamide-adenine dinucleotide in the cytoplasm and mitochondria of rat liver. Biochem J. 1967;103:514–527. doi: 10.1042/bj1030514. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Schwartz JP, Passonneau JV, Johnson GS, Pastan I. The effect of growth conditions on NAD+ and NADH concentrations and the NAD+:NADH ratio in normal and transformed fibroblasts. J Biol Chem. 1974;249:4138–4143. [PubMed] [Google Scholar]
  • 32.Siess EA, Brocks DG, Lattke HK, Wieland OH. Effect of glucagon on metabolite compartmentation in isolated rat liver cells during gluconeogenesis from lactate. Biochem J. 1977;166:225–235. doi: 10.1042/bj1660225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Sauer LA, Dauchy RT. Regulation of lactate production and utilization in rat tumors in vivo. J Biol Chem. 1985;260:7496–7501. [PubMed] [Google Scholar]
  • 34.Sistare FD, Haynes RC., Jr The interaction between the cytosolic pyridine nucleotide redox potential and gluconeogenesis from lactate/pyruvate in isolated rat hepatocytes. Implications for investigations of hormone action. J Biol Chem. 1985;260:12748–12753. [PubMed] [Google Scholar]
  • 35.Mazurek S, Michel A, Eigenbrodt E. Effect of extracellular AMP on cell proliferation and metabolism of breast cancer cell lines with high and low glycolytic rates. J Biol Chem. 1997;272:4941–4952. doi: 10.1074/jbc.272.8.4941. [DOI] [PubMed] [Google Scholar]
  • 36.Fantin VR, St-Pierre J, Leder P. Attenuation of LDH-A expression uncovers a link between glycolysis, mitochondrial physiology, and tumor maintenance. Cancer Cell. 2006;9:425–434. doi: 10.1016/j.ccr.2006.04.023. [DOI] [PubMed] [Google Scholar]
  • 37.Granholm L, Lukjanova L, Siesjo BK. The effect of marked hyperventilation upon tissue levels of NADH, lactate, pyruvate, phosphocreatine, and adenosine phosphates of rat brain. Acta Physiol Scand. 1969;77:179–180. doi: 10.1111/j.1748-1716.1969.tb04562.x. [DOI] [PubMed] [Google Scholar]
  • 38.Bachelard HS, Lewis LD, Ponten U, Siesjo BK. Mechanisms activating glycolysis in the brain in arterial hypoxia. J Neurochem. 1974;22:395–401. doi: 10.1111/j.1471-4159.1974.tb07605.x. [DOI] [PubMed] [Google Scholar]
  • 39.Gibson GE, Blass JP. Impaired synthesis of acetylcholine in brain accompanying mild hypoxia and hypoglycemia. J Neurochem. 1976;27:37–42. doi: 10.1111/j.1471-4159.1976.tb01540.x. [DOI] [PubMed] [Google Scholar]
  • 40.Katz A, Sahlin K. Effect of decreased oxygen availability on NADH and lactate contents in human skeletal muscle during exercise. Acta Physiol Scand. 1987;131:119–127. doi: 10.1111/j.1748-1716.1987.tb08213.x. [DOI] [PubMed] [Google Scholar]
  • 41.Yager JY, Brucklacher RM, Vannucci RC. Cerebral oxidative metabolism and redox state during hypoxia-ischemia and early recovery in immature rats. Am J Physiol. 1991;261:H1102–1108. doi: 10.1152/ajpheart.1991.261.4.H1102. [DOI] [PubMed] [Google Scholar]
  • 42.David LNelsonMMC. New York: W. H. Freeman and Company; 2008. Lehninger Principles of Biochemistry.1100 [Google Scholar]
  • 43.Warburg O. On respiratory impairment in cancer cells. Science. 1956;124:269–270. [PubMed] [Google Scholar]
  • 44.Gatenby RA, Gillies RJ. Why do cancers have high aerobic glycolysis? Nat Rev Cancer. 2004;4:891–899. doi: 10.1038/nrc1478. [DOI] [PubMed] [Google Scholar]
  • 45.Vander Heiden MG, Cantley LC, Thompson CB. Understanding the Warburg effect: the metabolic requirements of cell proliferation. Science. 2009;324:1029–1033. doi: 10.1126/science.1160809. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Curi R, Newsholme P, Newsholme EA. Metabolism of pyruvate by isolated rat mesenteric lymphocytes, lymphocyte mitochondria and isolated mouse macrophages. Biochem J. 1988;250:383–388. doi: 10.1042/bj2500383. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Halestrap AP, Price NT. The proton-linked monocarboxylate transporter (MCT) family: structure, function and regulation. Biochem J 343 Pt. 1999;2:281–299. [PMC free article] [PubMed] [Google Scholar]
  • 48.Ward LD, Winzor DJ. Thermodynamic studies of the activation of rabbit muscle lactate dehydrogenase by phosphate. Biochem J. 1983;215:685–691. doi: 10.1042/bj2150685. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Bisswanger H. Verlag GmbH, Weinheim: WILEY-VCH; 2002. Enzyme Kinetics: Principles and Methods. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Figure S1

Intracellular lactate concentration and L/P ratio are highly labile in Hela cells. Hela cells were incubated in complete RPMI-1640 medium containing 12 mM glucose and supplemented with 6 mM glucose every 24 hours. At the indicated time point, intracellular lactate and pyruvate, glucose consumption and lactate generation by Hela cells, and cell growth were monitored. (A) Intracellular lactate; (B) Intracellular pyruvate; (C) Intracellular L/P ratio; (D) Cytosolic free NAD/NADH ratio erroneously estimated from the corresponding L/P ratio; (E) Cell proliferation curves; (F) Glucose consumption; (G) Lactate generation; (H) L/G ratio (the generated lactate divided by the consumed glucose between 2 time points). Data are mean±SD. Data were confirmed by 2 independent experiments.

(DOC)

Figure S2

Intracellular lactate concentration and L/P ratio are highly labile in SGC7901 cells. SGC7901 cells were incubated in complete RPMI-1640 medium containing 12 mM glucose and supplemented with 6 mM glucose every 24 hours. At the indicated time point, intracellular lactate and pyruvate, glucose consumption and lactate generation by SGC7901 cells, and cell growth were monitored. (A) Intracellular lactate; (B) Intracellular pyruvate; (C) Intracellular L/P ratio; (D) Cytosolic free NAD/NADH ratio erroneously estimated from the corresponding L/P ratio; (E) Cell proliferation curves; (F) Glucose consumption; (G) Lactate generation; (H) L/G ratio (the generated lactate divided by the consumed glucose between 2 time points). Data are mean±SD. Data were confirmed by 2 independent experiments.

(DOC)

Figure S3

Cytosolic free NAD/NADH ratio estimated at the conversion at or close to equilibrium in Hela cells. Hela cells were incubated in complete RPMI-1640 medium containing 12 mM glucose supplemented with or without lactate. After 24-hour incubation, glucose consumption and lactate generation by Hela cells, cell growth, and intracellular lactate and pyruvate were measured. (A) Cell proliferation; (B) Glucose consumption; (C) Lactate generation; (D) L/G ratio; (E) Intracellular pyruvate; (F) Intracellular lactate; (G) Intracellular L/P ratio; (H) Cytosolic free NAD/NADH ratio (note that cytosolic free NAD/NADH at equilibrium of the conversion is 88.1±3.7) estimated from the corresponding L/P ratio. Data are mean±SD. Data were confirmed by 3 independent experiments.

(DOC)

Figure S4

Cytosolic free NAD/NADH ratio estimated at the conversion at or close to equilibrium in SGC7901 cells. SGC7901 cells were incubated in complete RPMI-1640 medium containing 12 mM glucose supplemented with or without lactate. After 24-hour incubation, glucose consumption and lactate generation by SGC7901 cells, cell growth, and intracellular lactate and pyruvate were measured. (A) Cell proliferation; (B) Glucose consumption; (C) Lactate generation; (D) L/G ratio; (E) Intracellular pyruvate; (F) Intracellular lactate; (G) Intracellular L/P ratio; (H) Cytosolic free NAD/NADH ratio (note that cytosolic free NAD/NADH at equilibrium of the conversion is 129.2±2.5) estimated from the corresponding L/P ratio. Data are mean±SD. Data were confirmed by 3 independent experiments.

(DOC)

Figure S5

The effect of oxygen levels on cytosolic free NAD/NADH ratios. Bcap-37 cells were incubated in complete RPMI-1640 medium containing 12 mM glucose supplemented with 20 mM lactate under 21% or 1% oxygen. After 24-hour incubation, glucose consumption and lactate generation by Bcap37 cells, cell growth, and intracellular lactate and pyruvate were measured. (A) Cell proliferation; (B) Glucose consumption; (C) Lactate generation; (D) L/G ratio; (E) Intracellular pyruvate; (F) Intracellular lactate; (G) Intracellular L/P ratio; (H) Cytosolic free NAD/NADH ratio estimated from the corresponding L/P ratio. Note that the NAD/NADH ratio under 1% oxygen should be far smaller than the value presented (see description in text). Data are mean±SD. Data were confirmed by 2 independent experiments.

(DOC)


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES