Abstract
Background
In the field of drug discovery, assessing the potential of multidrug therapies is a difficult task because of the combinatorial complexity (both theoretical and experimental) and because of the requirements on the selectivity of the therapy. To cope with this problem, we have developed a novel method for the systematic in silico investigation of synergistic effects of currently available drugs on genome-scale metabolic networks.
Results
The algorithm finds the optimal combination of drugs which guarantees the inhibition of an objective function, while minimizing the side effect on the other cellular processes. Two different applications are considered: finding drug synergisms for human metabolic diseases (like diabetes, obesity and hypertension) and finding antitumoral drug combinations with minimal side effect on the normal human cell. The results we obtain are consistent with some of the available therapeutic indications and predict new multiple drug treatments. A cluster analysis on all possible interactions among the currently available drugs indicates a limited variety on the metabolic targets for the approved drugs.
Conclusion
The in silico prediction of drug synergisms can represent an important tool for the repurposing of drugs in a realistic perspective which considers also the selectivity of the therapy. Moreover, for a more profitable exploitation of drug-drug interactions, we have shown that also experimental drugs which have a different mechanism of action can be reconsider as potential ingredients of new multicompound therapeutic indications. Needless to say the clues provided by a computational study like ours need in any case to be thoroughly evaluated experimentally.
Keywords: Metabolic network, Drug synergism, Flux balance analysis, Metabolic diseases, Cancer
Background
In spite of the advances in molecular and computational biology, the discovery of new drugs still remains a very challenging task which requires a very long period of research and development before any new compound can be commercialized. A possible alternative to the search of new active compounds is to make use of the unexploited properties of already available drugs, since a wide knowledge about both their therapeutic and toxicity effects has already been gathered during the study for their approval. In this perspective, a natural approach to broaden the range of applications of the existing drugs is to try to combine them in multiple drug therapies [1-3]. However, even though both the financial burden of conducting trials as well as the risk of adverse events in trial populations is expected to be sensibly lower for already approved drugs, so far the experimental investigations of multicomponent therapies have been quite limited [4,5]. Major obstacles to this approach are the high number of possible combinations but also our limited understanding of the complex mode of action of a multidrug treatment. Indeed, multiple perturbations can show three types of interaction, which have been classified as synergistic, antagonistic and additive [6] (alternatively called, aggravating, buffering and non-epistatic [7]). We have focused our attention on the first type, where the use of drug combinations represents an enhancement with respect to the superposition of the single perturbations.
In order to identify synergistic effects, Ref. [4] investigated all pairs of a set of known drugs at different doses, obtaining a functional classification of the interactions by looking at their inhibitory effect. Various computational approaches, based on reconstructed genome-scale metabolic networks, have been also developed in Refs. [7-10], in order to identify the synergistic effects triggered by multiple drugs or multiple genetic perturbations (for example the so-called “synthetic lethality”). Unfortunately, a systematic evaluation of the effects of all possible combinations of drugs is unfeasible, because their number scales exponentially with the number of chemicals taken into account (for an exhaustive search over 40 drugs, more than a trillion possible combinations should be tested). Moreover, a drug profile is given by both its therapeutic effect and by its side effect, the latter being related to its selectivity. For example, drugs such as anticancer agents have to selectively act only on tumor cells [11]. Similarly, metabolic diseases are induced by the imbalance of key metabolic pathways which, if modulated without affecting other vital functions, can rescue from the pathology [12,13]. Referring to these specific needs, we have developed an algorithm based on the metabolic network of humans and on the comparison between the metabolic networks of human and cancer cells (as reconstructed recently in [14]) aimed at expanding the spectrum of applications of the existing drugs to new selective treatments against metabolic diseases and tumors.
The algorithm here proposed is based on Flux Balance Analysis (FBA) [15,16]: in spite of its simple formalism, FBA has already proven to be reliable in providing quantitative understanding of cell metabolism. The computational method presented in this paper is based on a bilevel optimization which, after reformulation through duality theory, allows the algorithm to efficiently search the interactions between drugs. With respect to the available literature [7-9,17-19], the procedure we are proposing presents at least three important differences: (i) the synergisms are efficiently explored over all drug combinations without limiting only to pairwise combinations but without doing an exhaustive search, thanks to the application of duality theory; (ii) the multiple drug treatments suggested by the method guarantee both the inhibition of the chosen target (efficacy) and a minimal side effect on the other cellular functions (selectivity); (iii) in our procedure, any metabolic process of the network can be chosen as possible disease and phenotype readout, not only cell growth as common in the FBA literature (a more detailed comparison with the current literature is reported in the Additional file 1). Inspired by works such as Refs. [20,21], we treat the inhibition of a metabolic reaction by a drug as the silencing of the gene which codes for the catalyzing enzyme. In this simplified framework, the synergistic effect resulting from multiple perturbations of the metabolic network is still well captured [7,22] (see Figure 1 for a simple example). The selectivity of any drug treatment is correlated to its side effect, which is estimated as number of stopped reactions (see Figure 1 (C) objvs (D)) plus a correction term for the known non-metabolic targets. Further details are described in the Methods Section. It is worth noting that, because of the steady state assumption of FBA, this formalism does not identify synergisms between drugs that manifest themselves as alterations of kinetic parameters and consequently of concentration of metabolites, like the case of drugs which act on the same linear path (as e.g. Trimethoprim and Sulfamethoxazole do on folate synthesis [23]). Similarly, interactions where for instance one drug inhibits the biodegradation of the others cannot be found by FBA-based methods [24].
In spite of the limitations of restricting our analysis only to metabolic networks, the results presented in the following provide a promising example of how in silico models can be used as practical tools for exploring the functional interactions between drugs and of the (little explored) potential offered by synergistic drug combinations.
Results and discussion
In order to explore its potentialities and limitations, the algorithm (described in the Methods Section) has been applied to two different case studies:
1. finding drug synergisms for metabolic diseases (like diabetes, obesity and hypertension) on the human network [25];
2. finding antitumoral drug combinations with minimal side effect on the normal human cell (using the cancer network of [14] to model the metabolism of a human tumor).
Some features of these two metabolic networks are listed in Table 1, together with the number of drugs currently approved (from [26]). In particular, in order to generate realistic solutions, the available information about these existing drugs has been carefully filtered, selecting only inhibitions of metabolic human targets that have been experimentally proven (more details in Methods, Additional file 1: Table S1 and Additional file 2).
Table 1.
Human [[25]] | Cancer [[14]] | |
---|---|---|
Number of reactions |
2469 |
940 |
Number of metabolites |
1587 |
654 |
Number of compartments |
8 |
8 |
Number of pathways |
83 |
62 |
Number of drugs | 85 | 55 |
The human network has been obtained from BIGG (http://bigg.ucsd.edu/), whereas the cancer network has been provided us by the authors of [14]. The number of reactions here reported is before the splitting of every reversible process in a pair of irreversible reactions. Drugs have been selected from DrugBank database [26] as described in Methods. The complete list is reported in Additional file 1: Table S1).
Human metabolism
In this Section, we consider the inhibition of specific functions of the human metabolism obtained without impairing other vital processes. First, the inhibitory effect of each single drug on the whole network has been calculated. Then, the following screening is performed: we systematically consider each reaction of the network as a potential objective function and we apply the algorithm, searching for the most selective synergism capable of blocking this objective reaction. Comparing this solution with the single-drug effects evaluated in advance, we distinguish three cases:
the drug combination leads to a new inhibition since no single drug can stop the objective reaction;
the objective reaction can be stopped also by a single drug but the drug combination is more selective (has a minor side effect);
the objective reaction can be stopped also by a single drug and the multiple drug solution is less selective (this solution is not interesting because it triggers a larger side effect).
In all cases where a single or a multidrug solution is found, also all suboptimal solutions are hierarchically identified, iterating the procedure while excluding the current optimum, until the problem becomes unfeasible (i.e. no more solutions exist, capable of blocking that objective reaction). At the end of the screening, we obtained a set of 32 multicomponent solutions, ranging from combinations of two up to four compounds (see Table 2). The following characterization of the synergistic effects is performed. For each combination we identify the set Y of metabolic reactions which cannot be stopped by any single drug of the combination, but which are stopped when all these drugs are used together. Then, the synergism is described by the vector , where sj = 1 if reaction j belongs to Y (Nr is the number of reactions in the metabolic network). From the vectors s of the 32 multiple drug solutions a matrix of distances can be constructed and a cluster analysis performed on these distances; the resulting distance-based tree (similar to a phylogenetic tree) is drawn in Figure 2 (upper panel). The synergisms are clustered in six classes (with clearly identifiable subclasses in some of them) labeled from “A” to “F”. This classification can be used to build also a proximity network for the drugs, linking those that belong to the same synergistic interaction. The outcome is drawn in Figure 2 (bottom panel) and shows that the same clustering applies to the drugs involved in the synergisms. The result highlights how drugs can often be used in alternative one to the others: for example, the synergistic pairs of class C contain one drug among those labeled with the number 7 or 55 (Rosiglitazone or Acetylsalicylic acid) in combination with one drug among number 4 or 43 or 60 (Pravastatin or Naftifine or Tioconazole; see Additional file 1: Table S1 for all correspondences between names and numbers). Being the cardinality of class C equal to 6, we can deduce that these solutions are generated only by the combination of the pair and the triplet just mentioned. Three exceptions to the sharp clusterization of Figure 2 are represented by drugs labeled with the numbers 7, 22 and 50, respectively Rosiglitazone, Indomethacin and Pentoxifylline. Indeed Rosiglitazone targets many metabolic reactions (60, all in the fatty acid metabolism) which allow two types of interaction: class A for fatty acid activation and class C for cholesterol metabolism. On the other hand, Indomethacin causes only 7 inhibitions, some belonging to glycerolphospholipids metabolism and some others to pyruvate pathways: the first interact synergistically with drugs which target fatty acid reactions (class A), whereas the second can be combined with drugs acting on pyruvate metabolism (like Fomepizole, drug number 75, in class B). Finally, Pentoxifylline inhibits reactions both in the salvage pathway for nucleotides (which give synergisms in class E) and in pyrimidine catabolism (class F).
Table 2.
Drugs | Side eff. | Syn. | ratio | Class |
---|---|---|---|---|
Rosiglitazone (#7) - Quinacrine (#36) - Cerulenin (#62) - Tyloxapol (#85) |
363.8 |
91 |
25.0% |
A |
Rosiglitazone (#7) - Quinacrine (#36) - Orlistat (#65) - Tyloxapol (#85) |
377.7 |
91 |
24.0% |
A |
Rosiglitazone (#7) - Indomethacin (#22) - Cerulenin (#62) - Tyloxapol (#85) |
390.6 |
91 |
23.2% |
A |
Rosiglitazone (#7) - Diclofenac (#35) - Cerulenin (#62) - Tyloxapol (#85) |
397.5 |
91 |
22.8% |
A |
Rosiglitazone (#7) - Indomethacin (#22) - Orlistat (#65) - Tyloxapol (#85) |
404.5 |
91 |
22.4% |
A |
Rosiglitazone (#7) - Diclofenac (#35) - Orlistat (#65) - Tyloxapol (#85) |
411.4 |
91 |
22.1% |
A |
Rosiglitazone (#7) - Cerulenin (#62) |
298.9 |
52 |
17.3% |
A |
Rosiglitazone (#7) - Orlistat (#65) - |
312.8 |
52 |
16.6% |
A |
Indomethacin (#22) - Fomepizole (#75) |
84.7 |
1 |
1.1% |
B |
Naftifine (#43) - Acetylsalicylic acid (#55) |
116.0 |
6 |
5.1% |
C |
Acetylsalicylic acid (#55) - Tioconazole (#60) |
116.0 |
6 |
5.1% |
C |
Simvastatin/Pravastatin (#4) - Acetylsalicylic acid (#55) |
123.9 |
6 |
4.8% |
C |
Rosiglitazone (#7) - Tioconazole (#60) |
280.9 |
6 |
2.1% |
C |
Rosiglitazone (#7) - Naftifine (#43) |
280.9 |
6 |
2.1% |
C |
Simvastatin/Pravastatin (#4) - Rosiglitazone (#7) |
288.8 |
6 |
2.0% |
C |
Carbidopa (#6) - Droxidopa (#24) |
93.1 |
1 |
1.0% |
D |
Droxidopa (#24) - Selegiline (#45) |
96.1 |
1 |
1.0% |
D |
Droxidopa (#24) - Minaprine (#49) |
152.4 |
1 |
0.6% |
D |
Droxidopa (#24) - Zonisamide (#54) |
289.7 |
1 |
0.3% |
D |
Mycophenolic acid (#42) - Mercaptopurine (#58) |
11.0 |
5 |
45.4% |
E |
Ribavirin (#51) - Mercaptopurine (#58) |
23.9 |
5 |
20.9% |
E |
Udenafil (#10) - Mycophenolic acid (#42) - Mercaptopurine (#58) - |
18.0 |
7 |
38.8% |
E |
Mycophenolic acid (#42) - Dipyridamole (#57) - Mercaptopurine (#58) |
22.0 |
7 |
31.8% |
E |
Udenafil (#10) - Ribavirin (#51) - Mercaptopurine (#58) |
30.9 |
7 |
22.6% |
E |
Ribavirin (#51) - Dipyridamole (#57) - Mercaptopurine (#58) |
34.9 |
7 |
20,0% |
E |
Theophylline (#18) - Mycophenolic acid (#42) - Mercaptopurine (#58) |
41.7 |
7 |
16.7% |
E |
Mycophenolic acid (#42) - Pentoxifylline (#50) - Mercaptopurine (#58) |
53.8 |
7 |
13.0% |
E |
Theophylline (#18) - Ribavirin (#51) - Mercaptopurine (#58) |
54.6 |
6 |
10.9% |
E |
Pentoxifylline (#50) - Ribavirin (#51) - Mercaptopurine (#58) |
66.7 |
6 |
8.9% |
E |
Pentoxifylline (#50) - Arsenic trioxide (#72) |
118.2 |
17 |
14.3% |
F |
Cladribirne (#16) - Pentoxifylline (#50) |
118.2 |
17 |
14.3% |
F |
Gemcitabine (#30) - Pentoxifylline (#50) | 157.8 | 15 | 9.5% | F |
The table reports the multiple drug solutions in the human metabolic network, the side effect σ(D), the synergism size (i.e. the number of stopped reactions which exceeds the linear superposition of single drug effects), the ratio between these two quantities, and their classification (see Figure 2 and main text for the clustering analysis). Drug numbers refer to Additional file 1: Table S1. Bold font indicates that the solution (or part of it) has an experimental validation.
The analysis of the complete results obtained from the screening over all metabolic reactions is shown in Figure 3, where the stoppable reactions are grouped on the basis of the metabolic pathway to which they belong. Figure 3 reports also the class and the targets of the drug combinations which induces the inhibition. As one can see, some synergisms occur between reactions which belong to different pathways: in particular, sphingolipids subsystems, CoA and pyrimidine biosynthesis contain reactions whose inhibitions are caused by interactions situated in other pathways, since none of the combined drugs have targets on them. Moreover, among the multiple drug solutions of Figure 3, there are several new inhibitions and a few more selective cases (a comparison of the side effects induced by single and multiple drug solutions is reported in Additional file 1: Figure S1).
Among the cases of new inhibitions, the case of Guanylate kinase, although of no therapeutic interest, represents an easily visualizable example of the nonlinearity in the superposition of the effects as anticipated in the hypothetical situation presented in Figure 1. We consider the phosphorylation of GMP into GDP catalyzed by guanylate kinase as objective reaction. Since the blockage of GMP production will cause also the arrest of any transcription process, this inhibition constitutes only a toy example of synergism devoid of any practical value. For this problem, the algorithm proposes the combination of Mercaptopurine, Dipyridamole and Mycophenolic acid: the synergism takes place through the simultaneous inhibition of guanine phosphoribosyltransferase, 3′,5′-cyclic-nucleotide phosphodiesterase and IMP dehydrogenase (see Figure 4 for a representation of the corresponding subnetwork). Indeed, these reactions are alternative ways of GMP biosynthesis. When and only when they are all blocked, Guanylate kinase lacks its substrate and stops as well.
The complete list of the objective reactions, with relative pathways and synergistic inhibitions, is reported in Additional file 1: Table S2: this list contains many inhibitions in the fatty acid, cholesterol and carnitine transport pathways, which may represent solutions for obesity. In particular, concerning the case of hyperlipidemia diseases, the algorithm finds the combination of Rosiglitazone and Cerulenin (class A) as inhibitor of many reactions in the carnitine transferase and fatty acid desaturase pathways. This synergism has been reported in the literature for being active versus the biosynthesis of fatty acids in prostate tumors [27]: the mean IC50 are 45μM and 32μM for Rosiglitazone and Cerulenin alone, whereas it reduces to 5μM when they are combined: the authors claimed that this effect comes from the reduced production of fatty acids preventing the growth and differentiation of prostate cells. It is worth noting that we predict this combination also in three anticancer solutions (together with an additional target on palmitate conversion, see next subsection). Moreover, this pair is part of other six synergisms on the human metabolism, all concerning the same pathways (i.e. a very similar mechanism of interaction).
Another significant example is represented by the inhibition of Dihydroceramide desaturase. Indeed, ceramide is the hydrophobic membrane anchor of sphingolipids and is involved as a bioactive molecule in cell growth regulation, apoptosis, senescence, and diverse cell responses, particularly those linked to stress situations [28,29]; moreover, recent studies have shown the role for ceramide biosynthesis in body weight regulation, energy expenditure, hence in the metabolic obesity syndrome [30]. For these reasons Dihydroceramide desaturase has been proposed as a promising potential target for metabolic diseases. Currently some specific inhibitors of Dihydroceramide desaturase are under investigation and development (for example GT11, XM462 and analogous [31,32]) although there is no approved drug yet. Indeed in our model no single drug can stop this reaction. Our algorithm finds some possible multidrug treatments that block this reaction: among them, there are the synergistic pairs of Rosiglitazone plus Simvastatin (Pravastatin), and Acetylsalicyclic acid plus Atorvastatin (Pravastatin). Concerning the first synergism, clinical experiments have shown that combining these two drugs a significant reduction (about 30% less) of the intracellular accumulation of lipid is achieved [33]. Moreover, the authors of [34] investigate the adverse effect of single and combined therapies (hypoglycemia, body weight increase) and claim that adverse events are generally similar (the safety profile of Rosiglitazone was not adversely affected by the addition of Atorvastatin). Also our results predict a limited worsening of the adverse effect: indeed, after the combination with Atorvastatin the side effect of Rosiglitazone passes from 252.7 (Additional file 1: Table S1) to 288.8 (Table 2), i.e. it increases of about 14% only. For the same therapeutic purpose, the pair of Acetylsalicyclic acid and Atorvastatin has been also studied. Clinical trials are currently ongoing [35] and some of them have already shown promising results [36]. The rationale for this approach is based on the restoration of platelet sensitivity by reduction of the cholesterol levels. Moreover, as mentioned above, it is known that ceramide is involved in apoptosis. Indeed, this combination has been tested for the treatment of prostate cancer: the results have shows a linear synergism between these two drugs [37].
Human vs Cancer
A similar approach can be used to improve the selectivity and specificity of the treatment when dealing simultaneously with more than one type of cells. With a small adjustment, our procedure can force the solution to preserve the metabolism of one cell while inhibiting an objective reaction of another (see Additional file 1 for a detailed formulation). Indeed, a drug interaction can explore the differences in the topologies of the metabolic networks and, in this way, bypass the restrictions caused for instance by targets homology. This is crucial in case of anticancer therapy since tumoral and normal cells share the same genes.
For this purpose, we use the metabolic network of a generic human cancer assembled in [14] and the human metabolic network. We apply the modified version of the algorithm to the biomass reaction of the cancer network (which must be stopped), while minimizing the side effect on the regular human metabolism. As in the previous section, the procedure is iterated until the problem becomes unfeasible. The results are shown in Figure 5 and Table 3. The solutions are mainly single drugs which differ one from the other in terms of side effect on the human network. Many are known chemotherapeutic agents such as Floxuridine, Mycophenolic acid, Methotrexate, Pemetrexed, Ribavirin, Myo-Inositol, Simvastatin, Leflunomide, Indomethacin, Hydroxyurea, Arsenic trioxide, Gemcitabine [38-49]. Since only one synergism is present, between Fomepizole and Auranofin, these results suggest that approved drugs do not seem to induce significant interactions at the level of the metabolism.
Table 3.
# | Drugs | Side effect |
---|---|---|
1 |
Floxuridine (#20) |
1 |
2 |
Mycophenolic acid (#42) |
4 |
3 |
Trimethoprim (#29) |
5 |
4 |
Methotrexate (#11) |
5 |
5 |
Atovaquone (#69) |
6 |
6 |
Tyloxapol (#85) |
6 |
7 |
Ezetimibe (#56) |
12 |
8 |
Pemetrexed (#41) |
15 |
9 |
Ribavirin (#51) |
17 |
10 |
Quinacrine (#36) |
22 |
11 |
Myo-Inositol (#82) |
29 |
12 |
Tioconazole (#60) |
34 |
13 |
Naftifine (#43) |
34 |
14 |
Simvastatin (#4) |
42 |
15 |
Leflunomide (#66) |
42 |
16 |
Auranofin (#59) - Fomepizole (#75) |
47 |
17 |
Indomethacin (#22) |
48 |
18 |
Diclofenac (#35) |
55 |
19 |
Hydroxyurea (#16) |
56 |
20 |
Arsenic trioxide (#72) |
56 |
21 | Gemcitabine (#30) | 99 |
We report the solutions and the side effects σ(D) for the inhibition with approved drugs. Drug numbers refer to Additional file 1: Table S1. Bold font indicates that the solution has an experimental validation.
In order to increase the range of putative synergisms, we have tried to use the algorithm to set up a search for targets potentially interacting with the currently available drugs. Instead of searching for the reactions which are synthetically lethal (as partially done, for instance, in [14]) and proposing them as potential new targets, we look for the reactions whose single inhibition may give a lethal synergism with any combination of the approved drugs. The problem is formally equivalent to the one we have already described: we search again for the optimal drug combination after having deleted a reaction in the cancer network (the same reaction is removed also from the human network; this reaction is called “additional target” since it will be the target of an additional new drug). We systematically consider each reaction of the cancer network as an additional target; the results of this screening are reported in Additional file 3: Table S3. After a search in literature of possible inhibitors of the additional targets of the results, we identify some interesting solutions. For instance, the inhibition of methenyltetrahydrofolate cyclohydrolase (combined with the use of Mimosine) can be induced by the experimental drug 5,6,7,8- tetrahydro-N5,N10- carbonylfolic acid [50]; therefore, its combination with Mimosine could represent a potential antitumor therapy. Also for other four additional targets there exist experimental inhibitors whose activity is reported in the literature [51-53] (details are shown in Additional file 3: Table S3). Concerning the drug solutions identified by the algorithm, the pair Rosiglitazone plus Cerulenin is proposed in combination with three possible additional targets. One is the palmitate fatty acid conversion: it is worth noting that the validated antitumoral activity of this pairs versus prostate cancer cells (as mentioned above) is due to the reduction of the synthesis of fatty acids [27]. In our prediction, indeed, among the metabolites which are no longer available because of this inhibition, there are cholesterol ester, mono-, di- and tri-acylglycerol. The other two additional targets are related to phosphatidylcholine. Part of the phosphatidyilcholine pathway has been already identified as synthetic lethal [14], but without mentioning any possible exploitation. Our results suggest the use of a combined drug therapy as possible way to take advantage of this synthetic lethality.
Conclusions
The field of drug combinatorics is largely unexplored experimentally and the potential of combined drug therapies is difficult to assess, mostly for lack of suitable systematic methodologies. To try to fill this gap, we have developed an algorithm which is capable of exploring efficiently the optimal synergisms among all possible drug combinations and of characterizing them in terms of side effect and selectivity. Indeed, the success of a drug discovery process depends on multiple aspects, not least on the fulfillment of requirements regarding selectivity and toxicity: for metabolic diseases the modulation of the key pathways without affecting the other vital functions can be instrumental for rescuing from the pathology. Similarly, anticancer compounds should only kill cancer cells without affecting normal ones. These requirements are rarely taken into account in standard computational approaches. The results we obtained by applying our algorithm to the human and tumor vs human metabolic networks show the possibility to take advantage of drug synergisms in proposing new therapies: the potentialities lay in the possibility to intervene with a different mechanism of action with respect to those that are currently available. In this enlarged repertoire of possibilities, we have identified examples of drug repurposing (some of them were previously demonstrated experimentally), a procedure which is becoming more and more attractive thanks to the reduced costs on the preclinical and clinical steps.
One of the main features of FBA-based knockout studies is that metabolic networks appear to be robust [1,17], meaning that there seem to be an high degree of redundancy of the pathways inside a network (property alternatively reported as “nonessentiality” of the gene in Refs. [8,19]). In the context of drug synergism, this property reflects into the presence of optimal solutions consisting of many drugs (in our case up to four, or even more if we consider the number of inhibition targets of each drug). For the same reason, the results show the necessity to extend the search to all possible drug combinations without limiting to those of low cardinality. This fact becomes significant especially when the drugs to combine present a high similarity in terms of inhibited targets; indeed, the characterization of the synergisms we have found shows a limited variety of possible interactions between the available drugs (only six classes were identified, see Figure 2). However, beside increasing the cardinality of the solutions, a very strong robustness may also reduce the total number of solutions because it makes more difficult to induce the simultaneous inhibition of all the redundant pathways; indeed, if the screening we have run on the human metabolism is applied also to the less robust cancer network (seen as stand-alone network), the number of possible inhibitions is much higher (see Additional file 1: Figure S2 in comparison with Figure 3). Moreover, when we want to stop the biomass reaction of the cancer, mainly single drug solutions are found: this is again an index of the low redundancy of the cancer network (see Table 3) and of the limited variety in the metabolic targets for the available drugs.
Nevertheless, adding the possibility to inhibit an extra target, we could identified some experimental compounds (other than the drugs from DrugBank) which may be used as anticancer in a combination with the approved drugs (see Additional file 3: Table S3). These examples show that predictive tools like the method we are proposing become more important if one considers also the possibility of combining active compounds which are not yet approved but for which a minimal characterization of the mechanism of action is available. In this perspective, experimental compounds which inhibit additional targets that are different from those affected by the approved drugs may represent a good chance for improving, through synergism, the spectrum of the whole set of the currently available drugs. Moreover, the application of our method can be extended to situations where multiple networks are compared and contrasted. It is expected that problems like this will become important as soon as tissue-specific networks of human metabolism and cancer-specific networks will become available in the near future.
In a broader perspective, if instead of confining our study only to the human network we consider also the metabolism of microorganisms, the exploitation of drug synergisms obtained with our algorithm can be useful in investigating a wide range of situations: (i) when specific enzyme inhibitors are not currently available, multiple drug solutions could represent an example of the reprofiling of existing drugs for new therapeutic indications; (ii) when the target enzyme has undergone a mutation rendering ineffective the original therapy, a synergistic solution may bypass the resistance acting on other enzymes and therefore help in fighting resistance; (iii) when the optimal synergism has no lethal impact while the single drug solution has. This change in lethality can be important for instance in cases of human-hosted bacteria producing toxic by-products: in order to save the useful symbiosis with these commensal bacteria, a selective (but not lethal) inhibition of the toxic processes must be pursued [54,55].
Apart from the specific cases we have studied, the main objective of this paper is to propose an efficient method to single out drug combinations with potentially interesting therapeutic effect. Given the exponential character of the combinatorics involved, unguided “fishing expeditions” are intrinsically ill posed. Hence we expect that methods like the one proposed in this paper should be of help in dealing with such a complex problem. Needless to say, as the predictions are based on in silico models of metabolic pathways, the validity of the results must be assessed experimentally, but this is beyond the scope of the work.
Methods
The drug-synergism algorithm is developed in the framework of FBA (see Supporting Information for a brief comparison with the available literature on similar methods). The problem deals with the following sets (and numbers):
Then, the optimal synergism problem can be stated as follows:
Problem:Given:
• a metabolic network, which means a stoichiometric matrixand a vector of fluxes v with upper-bounds U, both laying in;
• an objective reaction flux vobj which has to be stopped;
• the setof drugs together with their inhibition targets;
we want to find the subset of drugssuch that D blocks v obj causing the minimal side effect, i.e. a minimum perturbation on the overall reaction fluxes.
Of course, we are not interested in procedures which perform an exhaustive search in the space of all drugs combinations.
By decomposing any reversible reaction in a couple of irreversible reactions, we can always assume that fluxes have non-negative values. Then, the space H of all possible steady state fluxes v as defined by FBA is
where vj and Uj are the j-th components of the vectors v and U respectively. Given the inhibition targets of each drug, we assume that a drug inhibits completely the enzymes responsible for the targeted reactions, hence stopping the relative fluxes. Therefore, adding a drug combination D to the problem means forcing (directly or indirectly) to zero some of the fluxes. We introduce the binary variables such that
Then, if the k-th drug targets the j-th reaction we write:
This reduces the space of feasible steady state fluxes to a subset H(D) ⊂ H (notice that H(∅) ≡ H). We can now introduce a definition which quantifies the side effect, σ(D), of a drug combination D on the reaction fluxes.
Clearly, there are many possible definitions. If we were dealing with microorganisms we could adapt the analogous MOMA (Minimization of Metabolic Adjustment) or ROOM (Regulatory On/Off Minimization) [20,21] criteria modeling the perturbation effect (induced by knockout effect, in the literature) on the fluxes with respect to the “wild type” fluxes. This requires however to know the unperturbed fluxes (the wild type reference) which for a microorganism corresponds to using the biomass production as cost function of the FBA problem [56]. Unfortunately, for human metabolic network such a commonly accepted FBA criterion is unavailable, hence it is not possible to determine the metabolic fluxes for the unperturbed network (“wild type”). Consequently, also the calculation of the perturbed fluxes and the quantification of the side effect are more ambiguous. Our choice in this paper is to quantify the side effect as number of stopped reaction (more precisely the number of reactions that cannot take place because of the perturbation). This bypasses the lack of the reference fluxes and allows to quantify the number of cellular functions which are no longer available, regardless to the type of tissue to which the human cell belongs.
Since the available drugs we selected do not have only metabolic targets, a measure of the side effect based exclusively on metabolic reactions disregards the perturbation induced by the drugs on other cellular functions (for example signaling cascades, protein synthesis, etc). This additional information can be incorporated in the model weighting each drug variable dk in the objective function according to its non-metabolic effects (for which only a pure superposition is considered because of the lack of more quantitative models). Following this approach, we define:
(1) |
where the parameter βk is an estimation of the non-metabolic perturbation induced by drug k and yj is a binary variable such that yj = 0 when the flux is lower than a threshold ϵ (ϵ = 0.1 in this paper); this can be expressed by means of the following linear constraints:
In order to avoid a double count, for reversible reactions we impose the additional constraint
Although the choice of the weights βk is quite arbitrary, we have tried to evaluate both terms of (1) using a homogeneous criteria, relating the values of βk to the number of non-metabolic targets of each drug. In particular we set:
where the numerical coefficient captures the spread of the perturbation across the non-metabolic systems. In analogy with the metabolic network, is equal to the mean number of metabolic reactions that are stopped when a single metabolic target is inhibited. Referring to the human metabolic network and averaging over all drugs we selected, we obtain .
The optimal solution can be described as follows:
Solution: For any subset of drugs, we can find the set H(D) and the minimal perturbation σ(D). By restricting to drug combinations which inhibit the objective reaction (i.e. such that) the optimal solution Y is
(2) |
The resulting bilevel optimization is a min-max integer linear programming problem [57]. The inner problem adjusts the fluxes in order to achieve the maximum flow for the objective reaction when all fluxes are subjected to the inhibitions (drugs) imposed by the outer problem and to the stoichiometric constraints. The outer problem selects the combination of drugs which minimizes the side effect, restricting to those solutions of the inner problem which guarantee no flow for the objective reaction.
The bilevel optimization problem is the following:
where the parameter b ≪ 1 (b = 0.001 in this paper) is introduced in the objective function of the outer problem in order to exclude the combinations containing redundant inhibitions and therefore avoiding an “over-selection” of drugs.
To solve this bilevel optimization we apply the strong duality theorem which consists in appending a list of constraints corresponding to the dual of the inner problem and setting the primal objective function equal to the dual [58,59]. This leads to a single minimization problem. By calling the dual variables as follows
the final optimization problem becomes:
Minimize
such that
(3) |
The key simplification is that the nonlinear terms δidk =: zik in (3) (the strong duality theorem equality) are exactly linearizable as follows:
(4) |
(5) |
where is the upper bound for the dual variable δi(chosen arbitrarily big in the implementation).
The codes for the algorithm have been developed in MATLAB (MathWorks R2010b) and are available in Additional files 4, 5, 6, 7, 8 and 9. All Mixed Integer Linear Optimizations have been performed using the ILOG-IBM CPLEX 12.1, under free academic license.
Selection procedure for the drugs
In order to generate realistic solutions, drugs have been accurately selected from http://www.drugbank.ca[26] according to the following procedure (the output of the query is summarized in Additional file 1: Table S1):
1. the whole database contains 6708 drugs;
2. only approved drugs have been picked out, restricting the search to 1570 drugs;
3. we filter for drugs which act on human enzymes (identified by the EC number): the set reduces to 473 drugs;
4. we select only drugs for which an inhibitory effect on at least one enzyme of the human metabolism has been experimentally proven. The set reduces to 267 drugs (with the EC numbers of the inhibited enzymes). For these drugs, we count the number of non-metabolic targets, including also cases of agonism, antagonism and activation, since they all represent a perturbation to the regular functioning of the target (activation is not considered for metabolic targets because it does not affect the number of stopped reaction in our FBA formulation).
5. the reactions of the metabolic network directly inhibited by each drug are identified through the available correspondence between EC numbers of the inhibited enzymes and the gene codes first, and then through the correspondence between gene codes and metabolic reactions. During this step, it may happen that many genes, and hence many reactions, are associated to the same EC number. Therefore, although in the original database a drug inhibits only a single or a few targets, the number of metabolic reactions affected by the drug can be high. For instance, this is the case of Rosiglitazone which inhibits a single target, the long-chain-fatty-acid-CoA ligase an enzyme responsible for the binding of the acyl-CoA group to a long fatty acid chain. Since the substrate of this enzyme can be any carbon chain, regardless of the unsaturation (presence or not of double bonds C=C) and of the exact length (it just requires a chain longer than 12 carbons atoms), we end up with a drug which inhibits up to 60 metabolic targets.
6. drugs which have exactly the same metabolic targets are grouped; the final 85 groups are listed in Additional file 1: Table S1. For each group only a representative is reported, namely the drug which has the minimal number of targets outside the metabolism. The full list of drugs in each group is reported in the Additional file 2.
Abbreviations
FBA: Flux Balance Analysis; MOMA: Minimization of Metabolic Adjustment.
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
MZ and CA conceived and initiated the project. GF developed the method and performed the calculations. All authors participated in the discussions of the results, have been involved in drafting the manuscript and approved the final manuscript’s preparation.
Supplementary Material
Contributor Information
Giuseppe Facchetti, Email: gfacchet@sissa.it.
Mattia Zampieri, Email: zampieri@imsb.biol.ethz.ch.
Claudio Altafini, Email: altafini@sissa.it.
Acknowledgments
We would like to thank the anonymous Reviewers for their valuable comments and constructive suggestions. We would like to thank also Eytan Ruppin, Tomer Shlomi and their collaborators for discussions and for providing us the cancer network. This work is supported by a grant from MIUR (Ministero dell’Istruzione, Università e Ricerca)
References
- Lehar J, Krueger A, Zimmermann G, Borisy A. High-order combination effect and biological robustness. Mol Syst Biol. 2008;4:215.. doi: 10.1038/msb.2008.51. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chou T. Theoretical basis, experimental design, and computerized simulation of synergism and antagonism in drug combination studies. Pharmacol Rev. 2006;58(3):621–681. doi: 10.1124/pr.58.3.10. [DOI] [PubMed] [Google Scholar]
- Csermely P, Agoston V, Pongor S. The efficiency of multi-target drugs: the network approach might help drug design. Trends Pharmacol Sci. 2005;26:178–182. doi: 10.1016/j.tips.2005.02.007. [DOI] [PubMed] [Google Scholar]
- Yeh P, Tschumi A, Kishony R. Functional classification of drugs by properties of their pairwise interaction. Nature Gen. 2006;38(4):489–494. doi: 10.1038/ng1755. [DOI] [PubMed] [Google Scholar]
- Keith C, Borisy A, Stockwell B. Multicomponent therapeutics for networked systems. Nat Rev Drug Discov. 2005;4:1–8. doi: 10.1038/nrd1609. [DOI] [PubMed] [Google Scholar]
- Yeh P, Kishony R. Networks from drug-drug surface. Mol Syst Biol. 2007;3:85–87. doi: 10.1038/msb4100133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Segré D, De Luna A, Church G, Kishony R. Modular epistasis in yeast metabolism. Nat Genet. 2005;37(1):77–83. doi: 10.1038/ng1489. [DOI] [PubMed] [Google Scholar]
- Suthers P, Zomorrodi A, Maranas C. Genome-scale gene/reaction essentiality and synthetic lethality analysis. Mol Syst Biol. 2005;5:301. doi: 10.1038/msb.2009.56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burgard A, Pharkya P, Maranas C. OptKnock: A bilevel programming framework for identifying gene knockout strategies for microbial strain optimization. Biotechnol Bioeng. 2003;84(6):647–657. doi: 10.1002/bit.10803. [DOI] [PubMed] [Google Scholar]
- Sridhar P, Song B, Kahveci T, Ranka S. Mining metabolic networks for optimal drug targets. Pac Symp Biocomput. 2008;13:291–302. [PubMed] [Google Scholar]
- Kaelin W. The concept of synthetic lethality in the context of anticancer therapy. Nat Rev Cancer. 2005;5:689–698. doi: 10.1038/nrc1691. [DOI] [PubMed] [Google Scholar]
- Goh K, Cusick M, Valle D, Childs B, Vidal M, Barabási A. The human disease network. Proc Natl Acad Sci USA. 2007;104(21):8685–8690. doi: 10.1073/pnas.0701361104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ferrannini E. Physiological and metabolic consequences of obesity. Metabolism. 1995;44(3):15–17. doi: 10.1016/0026-0495(95)90313-5. [DOI] [PubMed] [Google Scholar]
- Folger O, Jerby L, Frezza C, Gottlieb E, Ruppin E, Shlomi T. Predicting selective drug targets in cancer through metabolic networks. Mol Syst Biol. 2011;7:501.. doi: 10.1038/msb.2011.35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Palsson B. Systems Biology: Properties of Reconstructed Networks. New York: Cambridge University Press; 2006. [Google Scholar]
- Raman K, Chandra N. Flux balance analysis of biological systems: applications and challenges. Brief Bioinform. 2009;10(4):435–449. doi: 10.1093/bib/bbp011. [DOI] [PubMed] [Google Scholar]
- Deutscher D, Meilijson I, Kupiec M, Ruppin E. Multiple knockout analysis of genetic robustness in the yeast metabolic network. Nat Gen. 2006;38(9):993–998. doi: 10.1038/ng1856. [DOI] [PubMed] [Google Scholar]
- Vazquez A. Optimal drug combinations and minimal hitting sets. BMC Syst Biol. 2009;3:81–87. doi: 10.1186/1752-0509-3-81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Imielinski M, Belta B. Deep epistasis in human metabolism. Chaos. 2010;20(2):026104. doi: 10.1063/1.3456056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Segré D, Vitkup D, Church G. Analysis of optimality in natural and perturbed metabolic networks. Proc Natl Acad Sci USA. 2002;99(23):15112–15117. doi: 10.1073/pnas.232349399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shlomi T, Berkman O, Ruppin E. Regulatory on/off minimization of metabolic flux changes after genetic perturbations. Proc Natl Acad Sci USA. 2005;102(21):7695–7700. doi: 10.1073/pnas.0406346102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Snitkin E, Mackay T. Segrè D. Epistatic interaction maps relative to multiple metabolic phenotypes. PLoS Genet. 2011;7(2):e1001294. doi: 10.1371/journal.pgen.1001294. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salter A. Overview. Trimethoprim-sulfamethoxazole: an assessment of more than 12 years of use. Rev Infect Dis. 1982;4(2):196–236. doi: 10.1093/clinids/4.2.196. [DOI] [PubMed] [Google Scholar]
- Weinreb O, Amit T, Bar-Am O, Youdim M. Rasagiline: a novel anti-Parkinsonian monoamine oxidase-B inhibitor with neuroprotective activity. Prog Neurobiol. 2010;92(3):330–344. doi: 10.1016/j.pneurobio.2010.06.008. [DOI] [PubMed] [Google Scholar]
- Duarte N, Becker S, Jamshidi N, Thiele I. et al. Global reconstruction of the human metabolic network based on genomic and bibliomic data. PNAS. 2007;104(6):1777–1782. doi: 10.1073/pnas.0610772104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knox C, Law V, Jewison T, Liu P, Ly S, Frolkis A, Pon A, Banco K, Mak C. et al. DrugBank 3.0: a comprehensive resource for ‘omics’ research on drugs. Nucleic Acids Res. 2011;39(Suppl 1):D1035–D1041. doi: 10.1093/nar/gkq1126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mansour M, Schwarts D, Judd R, Akingbemi B, Braden T, Morrison E, Dennis J, Bartol F, Hazi A, Napier I, Abdel-Mageed A. Thiazolidinediones/PPARγ agonists and fatty acid synthase inhibitors as an experimental combination therapy for prostate cancer. Int J Oncol. 2010;38(2):537–546.. doi: 10.3892/ijo.2010.877. 103892/ijo2010877. [DOI] [PubMed] [Google Scholar]
- Luberto C, Hannun Y. Ceramide in the eukaryotic stress response. Trends Cell Biol. 2000;10(2):73–80. doi: 10.1016/S0962-8924(99)01694-3. [DOI] [PubMed] [Google Scholar]
- Obeid L, Hannun Y. The Ceramide-centric universe of lipid-mediated cell regulation: stress encounters of the lipid kind. J Biol Chem. 2002;277:25847–25850. doi: 10.1074/jbc.R200008200. [DOI] [PubMed] [Google Scholar]
- Yang G, Badeanlou L, Bielawski J, Roberts A, Hannun Y, Samad F. Central role of ceramide biosynthesis in body weight regulation, energy metabolism, and the metabolic syndrome. Am J Physiol Endocrinol Metab. 2009;297:E211—E224. doi: 10.1152/ajpendo.91014.2008. [ http://ajpendo.physiology.org/content/297/1/E211.abstract] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Triola G, Fabrias G, Dragusin M, Niederhausen L, Broere R. et al. Specificity of the Dihydroceramide Desaturase Inhibitor N-[(1R,2S)-2-Hydroxy-1-hydroxymethyl-2-(2-tridecyl-1-cyclopropenyl)ethyl]o ctanamide (GT11) in Primary Cultured Cerebellar Neurons. Mol Pharmacol. 2004;66(6):1671–1678. doi: 10.1124/mol.104.003681. [DOI] [PubMed] [Google Scholar]
- Munoz-Olaya J, Matabosch X, Bedia C, Egido-Gabs M, Casas J. et al. Synthesis and biological activity of a novel inhibitor of Dihydroceramide Desaturase. Chem Med Chem. 2009;3:946–953. doi: 10.1002/cmdc.200700325. [DOI] [PubMed] [Google Scholar]
- Llaverias G, Lacasa D, Viñals M, Vázquez-Carrera M, Sánchez R, Laguna J, Alegret M. Reduction of intracellular cholesterol accumulation in THP-1 macrophages by a combination of rosiglitazone and atorvastatin. Biochem pharmacol. 2004;68:155–163. doi: 10.1016/j.bcp.2004.03.009. [DOI] [PubMed] [Google Scholar]
- Freed M, Ratner R, Marcovina S, Kreider M, Biswas N, Cohen B, Brunzell J. Effects of Rosiglitazone alone and in combination with Atorvastatin on the metabolic abnormalities in type 2 diabetes mellitus. Ame J Cardiology. 2002;90(9):947–952. doi: 10.1016/S0002-9149(02)02659-0. [DOI] [PubMed] [Google Scholar]
- De Berardis G, Sacco M, Evangelista V, Filippi A, Giorda C, Tognoni G, Valentini U, Nicolucci A. et al. Aspirin and Simvastatin Combination for Cardiovascular Events Prevention Trial in Diabetes (ACCEPT-D): design of a randomized study of the efficacy of low-dose aspirin in the prevention of cardiovascular events in subjects with diabetes mellitus treated with statins. Trials. 2007;8:21. doi: 10.1186/1745-6215-8-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Armstrong P Lorell B Nissen S Borer J 97th Meeting of the Cardiovascular and Renal Drugs Advisory Committee July 18th and 19th, 2002 Circulation 20021066e9011–e9012.12187916 [Google Scholar]
- Murtola T, Pennanen P, Syvälä H, Bläuer M, Ylikomi T, Tammela T. Effects of simvastatin, acetylsalicylic acid, and rosiglitazone on proliferation of normal and cancerous prostate epithelial cells at therapeutic concentrations. Prostate. 2009;69(9):1017–1023. doi: 10.1002/pros.20951. [DOI] [PubMed] [Google Scholar]
- Weiss G, Garnick M, Osteen R, Steele G, Wilson R, Schade D, Kaplan W, Boxt L, Kandarpa K, Mayer R. Long-term hepatic arterial infusion of 5-fluorodeoxyuridine for liver metastases using an implantable infusion pump. J Clin Oncology. 1983;1(5):337–344. doi: 10.1200/JCO.1983.1.5.337. [DOI] [PubMed] [Google Scholar]
- Carter S, Franklin T, Jones D, Leonard B, Mills S, Turner R, Turner W. Mycophenolic acid: an anti-cancer compound with unusual properties. Nature. 1969;223:848–850. doi: 10.1038/223848a0. [DOI] [PubMed] [Google Scholar]
- Bleich H, Boro E, Frei III E, Jaffe N, Tattersall M, Pitman S, Parker L. New approaches to cancer chemotherapy with methotrexate. New England J Med. 1975;292(16):846–851. doi: 10.1056/NEJM197504172921607. [DOI] [PubMed] [Google Scholar]
- Hazarika M, White R, Johnson J, Pazdur R. FDA drug approval summaries: Pemetrexed (Alimta®) The oncologist. 2004;9(5):482–488. doi: 10.1634/theoncologist.9-5-482. [DOI] [PubMed] [Google Scholar]
- Borden K, Culjkovic-Kraljacic B. Ribavirin as an anti-cancer therapy: acute myeloid leukemia and beyond? Leukemia Lymphoma. 2010;51(10):1805. doi: 10.3109/10428194.2010.496506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lam S, McWilliams A, MacAulay C, Wattenberg L, Szabo E. et al. A phase I study of myo-inositol for lung cancer chemoprevention. Cancer Epidemiol Biomarkers Prev. 2006;15(8):1526–1531. doi: 10.1158/1055-9965.EPI-06-0128. [DOI] [PubMed] [Google Scholar]
- Cho S, Kim J, Kim J, Lee J, Jung H, Song I. Simvastatin induces apoptosis in human colon cancer cells and in tumor xenografts, and attenuates colitis-associated colon cancer in mice. Int J Cancer. 2008;123(4):951–957. doi: 10.1002/ijc.23593. [DOI] [PubMed] [Google Scholar]
- Baumann P, Mandl-Weber S, Völkl A, Adam C, Bumeder I, Oduncu F, Schmidmaier R. Dihydroorotate dehydrogenase inhibitor A771726 (leflunomide) induces apoptosis and diminishes proliferation of multiple myeloma cells. Mol cancer ther. 2009;8(2):366. doi: 10.1158/1535-7163.MCT-08-0664. [DOI] [PubMed] [Google Scholar]
- Zhang G, Tu C, Zhang G, Zhou G, Zheng W. Indomethacin induces apoptosis and inhibits proliferation in chronic myeloid leukemia cells. Leukemia res. 2000;24(5):385–392. doi: 10.1016/S0145-2126(99)00198-8. [DOI] [PubMed] [Google Scholar]
- Schrell U, Rittig M, Anders M, Kiesewetter F, Marschalek R, Koch U, Fahlbusch R. Hydroxyurea for treatment of unresectable and recurrent meningiomas. I. Inhibition of primary human meningioma cells in culture and in meningioma transplants by induction of the apoptotic pathway. J Neurosurg. 1997;86(5):845–852. doi: 10.3171/jns.1997.86.5.0845. [DOI] [PubMed] [Google Scholar]
- Antman K. Introduction: the history of arsenic trioxide in cancer therapy. The oncologist. 2001;6(Suppl 2):1–2. doi: 10.1634/theoncologist.6-suppl_2-1. [DOI] [PubMed] [Google Scholar]
- von der Maase H, Hansen S, Roberts J, Dogliotti L, Oliver T, Moore M, Bodrogi I, Albers P, Knuth A, Lippert C. et al. Gemcitabine and cisplatin versus methotrexate, vinblastine, doxorubicin, and cisplatin in advanced or metastatic bladder cancer: results of a large, randomized, multinational, multicenter, phase III study. J Clin Oncology. 2000;18(17):3068–3077. doi: 10.1200/JCO.2000.18.17.3068. [DOI] [PubMed] [Google Scholar]
- Temple Jr C, Bennett Jr L, Rose J, Elliott R, Montgomery J. Synthesis of pseudocofactor analogs as potential inhibitors of the folate enzymes. J Med Chem. 1982;25(2):161–166. doi: 10.1021/jm00344a014. [DOI] [PubMed] [Google Scholar]
- Mahfouz M, Johnson S, Holman R. Inhibition of desaturation of palmitic, linoleic and eicosa-8, 11, 14-trienoic acids in vitro by isomeric cis-octadecenoic acids. Biochimica et Biophysica Acta (BBA)-Lipids and Lipid Metabolism. 1981;663:58–68. doi: 10.1016/0005-2760(81)90194-6. [DOI] [PubMed] [Google Scholar]
- Borges T, Glauert H, Robertson L. Perfluorodecanoic acid noncompetitively inhibits the peroxisomal enzymes enoyl-CoA hydratase and 3-hydroxyacyl-CoA dehydrogenase. Toxicol Appl Pharmacol. 1993;118:8–15. doi: 10.1006/taap.1993.1003. [DOI] [PubMed] [Google Scholar]
- Tserng K, Jin S, Hoppel C. Spiropentaneacetic acid as a specific inhibitor of medium-chain acyl-CoA dehydrogenase. Biochemistry. 1991;30(44):10755–10760. doi: 10.1021/bi00108a021. [DOI] [PubMed] [Google Scholar]
- Mazumdar V, Snitkin E, Amar S, Segré D. Metabolic network model of a human oral pathogen. J Bacteriol. 2009;191(1):74–90. doi: 10.1128/JB.01123-08. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hooper L, Gordon J. Commensal host–bacterial relationships in the gut. Science. 2001;292:1115–1118. doi: 10.1126/science.1058709. [DOI] [PubMed] [Google Scholar]
- Palsson B, Varma A. Metabolic capabilities of Escherichia coli II: optimal growth pattern. J Theor Biol. 1993;165:503–522. doi: 10.1006/jtbi.1993.1203. [DOI] [PubMed] [Google Scholar]
- Dempe S. Foundations of bilevel programming. New York: Kluwer Academic Publisher; 2010. [Google Scholar]
- Matoušek J Gärtner B. Understanding and Using Linear Programming. Berlin: Springer; 2000. [Google Scholar]
- Schrijver A. Theory of Linear and Integer Programming. New York: John Wiley Sons; 1986. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.