Skip to main content
International Journal of Molecular Sciences logoLink to International Journal of Molecular Sciences
. 2022 Jun 13;23(12):6604. doi: 10.3390/ijms23126604

Application of Sensitivity Analysis to Discover Potential Molecular Drug Targets

Malgorzata Kardynska 1,2, Jaroslaw Smieja 2,*, Pawel Paszek 3, Krzysztof Puszynski 2
Editor: Hidayat Hussain
PMCID: PMC9223434  PMID: 35743048

Abstract

Mathematical modeling of signaling pathways and regulatory networks has been supporting experimental research for some time now. Sensitivity analysis, aimed at finding model parameters whose changes yield significantly altered cellular responses, is an important part of modeling work. However, sensitivity methods are often directly transplanted from analysis of technical systems, and thus, they may not serve the purposes of analysis of biological systems. This paper presents a novel sensitivity analysis method that is particularly suited to the task of searching for potential molecular drug targets in signaling pathways. Using two sample models of pathways, p53/Mdm2 regulatory module and IFN-β-induced JAK/STAT signaling pathway, we show that the method leads to biologically relevant conclusions, identifying processes suitable for targeted pharmacological inhibition, represented by the reduction of kinetic parameter values. That, in turn, facilitates subsequent search for active drug components.

Keywords: bioinformatics, chemotherapy, sensitivity analysis, molecular drug targets, systems biology

1. Introduction

Computational models of dynamics of intracellular processes have been extensively used in recent years as a support tool in unveiling the structure of regulatory networks [1,2], crosstalk between signaling pathways [3,4], analysis of therapeutic drug effects [5,6,7] or in studies focused on general properties of such systems [8,9,10]. They facilitate preliminary testing of biological hypotheses and provide insights into systems that, for various reasons, cannot be explored experimentally.

For several years, sensitivity analysis have become an ubiquitous tool in the analysis of the mathematical models. In general, sensitivity analysis allows to study the impact of model inputs on its outputs. This work focuses only on examining the impact of model parameters changes on its response. Various techniques have been developed, from local approaches with sensitivity functions [11,12] or sloppy/stiff analysis [13,14,15], to global, variance-based methods [16]. Though some of the papers utilized sensitivity analysis in the context of potential drug targets [17], the methods employed there did not take into account the relation between drug action and kinetic parameters changes. The desired therapeutic actions may consist of either increasing or decreasing the kinetic rates of the processes that are targeted. In mathematical models, this would be reflected in increasing or decreasing corresponding parameters, respectively.

In this paper, we present a novel method of sensitivity analysis that is specifically tailored to the goal of finding potential molecular drug targets. It is based on the analysis of models, given in the form of ordinary differential equations, describing dynamics of responses of a signaling pathway of interest. It allows to study the drug-induced changes in model responses by introducing changes in parameter values, representing effects of drug action. Furthermore, the method makes it possible to tackle the problem of heterogeneity of cellular responses to a drug in a cell population [18,19], using a particular parameter randomization procedure, tailored to the model application.

The proposed method belongs to the family of one-at-a-time (OAT) sensitivity methods, which are based on changing a single model parameter while retaining nominal values of remaining parameters. In general, such approaches are not recommended for nonlinear models or those with interactions between inputs [20]. However, it should be emphasized that the purpose of this work is not to investigate model sensitivity in general, but to utilize sensitivity analysis methods for a precisely defined aim—in the search for potential molecular drug targets. The idea is to find a single parameter whose change significantly alters a single intracellular process. In mathematical models describing biochemical reactions, each parameter is related to a single biochemical process, or the sequence of processes simplified to a single-step process, and reflect the kinetic properties of the molecules (e.g., enzymes) involved in this process [21]. The creation of a parameter ranking facilitates finding a process, the alteration of which, e.g., by drug actions, will lead to significant changes in cellular responses to a given stimuli [12]. Assuming that parameters are independent from each other and that the drug selectively binds to a single target molecule (and thus, altering the kinetic rate of the process in which the molecule participates), it is the OAT approach that should be used.

The highest-ranking parameters lead to the processes that should be targeted in order to make the highest impact on the system responses. The subsequent identification of molecules involved in these processes provides information about potential molecular drug targets. This, in turn, could be the preliminary step before a particular active drug molecule is searched for, using the methods reviewed in, e.g., [22]. On the other hand, the proposed approach might be considered as complementary to network-based methods, also reviewed in [22].

2. Results

In order to check the feasibility of the proposed method, two models of different signaling pathways were analyzed: a p53/Mdm2 signaling pathway and an IFN-β-induced JAK/STAT signaling pathway. They represent different dynamical properties (the time responses of the p53 model are oscillatory, whereas in the IFN-β-induced JAK/STAT model the time responses are aperiodic) and different complexities (the p53 model contains much fewer variables than the second one, but its nonlinearities are more complex). The detailed equations and nominal parameters are not listed in this paper, as they have been implemented exactly in the form described in the literature.

The results obtained using the described method were compared with the results of a classic, local sensitivity analysis using the sensitivity functions with parameter rankings based on the area under the curve of the sensitivity function [12,23].

2.1. p53 Regulatory Module

The first example involves the regulatory module controlling the level of tumor protein p53 in a cell. p53, often called the Guardian of the Genome [24], is involved in many intracellular processes, among which the most important is cell cycle arrest, expression of DNA repair proteins and induction of cell apoptosis in response to moderate and strong stress signals [25,26,27]. The activation of the p53 signaling pathway occurs in response to environmental stress factors that cause DNA damage or mutations (e.g., ionizing radiation [28]). p53 protein dysfunctions are of great importance in cancer progression. It has been shown that about half of the cancer types have mutations in the p53 gene (TP53), while in many others, malfunctions of other proteins involved in the p53 signaling pathway are observed [29]. Therefore, a search for a potential drug target might be based on the primary goal of inducing a high level of p53 in cells, ultimately leading to their death [19]. Moreover, the results of the sensitivity analysis can be related to the existing research on anticancer drugs targeting the p53 system [30,31].

We chose a relatively simple model of the p53 signaling pathway [32] described by 12 differential equations and 43 parameters (see the Supplementary Materials for the equations). The model describes the negative feedback loop between p53 protein and its inhibitor—the murine double minute 2 (Mdm2) protein, as well as positive feedback loop, in which p53 via phosphatase and tensin homolog deleted on chromosome ten (PTEN), phosphatidylinositol (3,4,5)-trisphosphate (PIP3) and Protein kinase B (Akt) inhibits its own Mdm2 inhibitor. The interactions occurring in this model are shown in the diagram (Figure 1). The level of phosphorylated p53 (p53PN) protein has been chosen as the variable, whose sensitivity to the parameter changes represents the sensitivity of the whole system.

Figure 1.

Figure 1

Schematic diagram of the p53 signaling pathway model [32]. The model involves two-compartmental kinetics of p53 protein, its primary inhibitor Mdm2, phosphatase PTEN, phosphatidylinositol 3-phosphate (PIP3) and Akt kinase and is activated by IR radiation, which leads to DNA damage (DNADAM). The N index stands for nuclear concentrations and P for phosphorylated molecules. Solid lines represent direct interactions in the model, such as production, degradation (deg) or state change (e.g., phosphorylated/nonphosphorylated) of selected molecules. Dashed lines represent indirect interactions, such as the catalysis of reactions or regulation of gene expression.

Out of the 38 parameters in the model, 3 describe constants such as the Michaelis Menten coefficients or saturation constants and were assumed to take the nominal values and not considered in sensitivity analysis of them (h0, NSAT, dDAM). The sensitivity ranking for the remaining 35 parameters is presented in the lower panel of Figure 2 and compared with one of the standard rankings based on sensitivity functions in the upper panel of Figure 2. Parameter names corresponding to the numbers in the ranking are presented in Table 1.

Figure 2.

Figure 2

Parameter rankings for the p53 model: based on sensitivity functions (upper panel) and based on the method proposed in this paper (lower panel). The horizontal (X) axis represents the consecutive model parameters, whose names have been replaced by numbers for better readability. The parameter annotation associated with these numbers is given in Table 1. The red line in the lower panel corresponds to the A index value representing no influence of parameter change on the model response. Points located above this line represent parameters whose change (as described in the algorithm details) amplify the model response, while those below represent the parameters whose change lead to suppression of the model response.

Table 1.

List of parameters appearing in the p53 signaling pathway model [32].

No. Par. Description No. Par. Description
1 a6 Max DNA damage rate 19 d0 Mdm2 spontaneous deg. rate (all Mdm2 forms)
2 q3 Coefficient governing apoptotic factor synthesis 20 d1 DSB-induced Mdm2 deg. rate (all Mdm2 forms)
3 d9 Apoptotic factors degradation rate 21 d2 PTEN degradation rate
4 p1 Max synthesis rate of apoptotic factor 22 d3 Spontaneous p53n degradation rate
5 a0 Spontaneous p53n phosphorylation rate 23 d4 Mdm2pn-induced p53n degradation rate
6 a1 DSB-induced p53n phosphorylation rate 24 d5 Spontaneous p53pn degradation rate
7 a2 PIP activation rate 25 d6 Mdm2pn-induced p53pn degradation rate
8 a3 AKT activation rate 26 d7 Mdm2t degradation rate
9 a4 Mdm2 phosphorylation rate 27 d8 PTENt degradation rate
10 c0 PIPp dephosphorylation rate (by PTEN) 28 i0 Mdm2p nuclear import
11 c1 AKTp inactivation rate 29 e0 Mdm2pn nuclear export
12 c2 Mdm2p dephosphorylation rate 30 AKTtot Total number of Akt molecules (AKT+AKTp)
13 c3 Spontaneous p53pn dephosphorylation rate 31 PIPtot Total number of PIP molecules (PIP+PIPp)
14 p0 p53n production rate 32 drep DNA repair rate
15 s0 Mdm2 transcription rate 33 q0 Spontaneous activation of Mdm2 and PTEN genes
16 s1 PTEN transcription rate 34 q1 p53pn-depended activation of Mdm2 and PTEN genes
17 t0 Mdm2 translation rate 35 q2 Mdm2 and PTEN genes inactivation rate
18 t1 PTEN translation rate

Assuming the apoptosis-promoting character of the potential drug for which the molecular targets would be searched for, the parameters of interest should be located above the 100 threshold line, as indicated in the closing paragraph of the Materials and Methods section. Then, their increase would lead to prolonged elevated levels of nuclear p53.

The ranking, shown in Figure 2 (bottom panel) apparently indicates different parameters than those drawn from a sensitivity functions-based one (Figure 2 (upper panel)). It suggests that the system response would be affected most efficiently by decreasing one of the parameters represented by the following numbers: 7, 8, 9, 15, 17, 21, 27, 28, 30 and 31. For all these parameters, we observe similar, high values of the A index (Figure 2 (bottom panel)). Having checked their meaning (Table 1), we found that parameters 7, 8, 21, 27, 30 and 31 are associated with processes related to proteins PTEN, PIP3 and AKT, which are also involved in regulation of other intracellular processes, not associated directly with apoptosis (e.g., mTOR or glucagon pathways). Therefore, we decided to leave them out of further analysis.

Of the remaining four parameters, we chose parameters no. 15 and 17, representing Mdm2 transcription rate and Mdm2 translation rate (s0 and t0—see Table 1) for further analysis. To verify the conclusion drawn from the ranking, a simulation was run for a nominal parameters and mean of the reduced parameter s0 (0.15s0) and t0 (0.15t0), respectively.

The results show that the time course of the p53 level in a cell would be substantially altered, following the parameter value reduction (Figure 3), leading to elevated p53 levels that could, ultimately, result in cell apoptosis. In all simulations, obtained after changing the top-ranking parameter values, the up-regulation of p53 is persistent and levels of p53 should be sufficient to induce desired cellular response, but in the case of the reduction of parameters s0 and t0, it is substantially stronger and appears earlier.

Figure 3.

Figure 3

Comparison of p53 protein responses in the model with nominal parameters (black line) and parameters s0, t0 reduced by α=0.15 (gray dashed lines).

Though the response is shown for a single cell only, the high ranking of the chosen parameters means that a similar response would be observed in most cells in a population (Figure 4), due to the structure of the algorithm and the distribution of the reduction factor α that was used for ranking calculation.

Figure 4.

Figure 4

Simulated p53 protein responses in the model with parameter t0 altered by the reduction factor α. The figure shows 100 randomly selected p53 protein responses (gray lines) and average p53 protein responses (black line) calculated from 1000 simulations.

Contrary to our method, a ranking based on sensitivity functions suggested that the drep parameter (DNA repair rate) should be more important than the parameters associated with the Mdm2 transcription and translation (s0 and t0). Figure 5 shows that the reduction of the drep parameter altered the p53 protein response; however, a substantially higher level of p53 was obtained after reducing parameters s0 or t0.

Figure 5.

Figure 5

Comparison of p53 protein responses in the model with nominal parameters (black line) and parameter drep reduced by α=0.15 (gray dashed line).

Moreover, some parameters, e.g., d2, d4 and d6, are low-ranked in the sensitivity function-based ranking (see the upper panel in Figure 2), and as such, would not be considered for further investigations, if that method was applied. However, Figure 6 clearly shows that these parameters should be ranked higher. This example demonstrates that classical sensitivity analysis methods based on sensitivity functions are not suitable for searching for molecular targets for new drugs.

Figure 6.

Figure 6

Comparison of p53 protein responses in the model with nominal parameters (black line) and parameters d2, d4 and d6, reduced by α=0.15 (gray dashed line).

2.2. IFN-β-Induced JAK/STAT Signaling Pathway

As the second example, the model of Interferon-β (IFN-β) induced Janus kinase/signal transducer and activator of transcription (JAK/STAT) signaling pathway has been considered. It plays a critical role in the pro-inflammatory immune responses to viral infections [33,34]. The IFN-β cytokine is used in treatment of many diseases, including multiple sclerosis and cancer (see, e.g., [35,36,37]), as well as in viral infections [38,39].

The model from [1] has been chosen (Figure 7). Its temporal response, contrary to the previous example, is not oscillatory. The model contains 27 variables and 50 parameters (see the Supplementary Materials file for the equations). Interferon regulatory factor 1 (IRF1) mRNA concentration has been selected as the variable representing system behavior, whose sensitivity to parameter changes is analyzed. For a detailed description of equations and the meaning of parameters, see [1].

Figure 7.

Figure 7

Schematic diagram of the IFN-β-induced JAK/STAT signaling pathway model. PHYactive and PHYinactive represent unknown active and inactive phosphatases, respectively, hypothesized in the model [1].

Two parameters of the model were omitted in the sensitivity analysis: ks1_phos_sat and ks2_phos_sat. They represent saturation constants and, as such, would not provide information about a prospective molecular drug target. The resulting parameter rankings are shown in Figure 8. Parameter names corresponding to the numbers on the ranking can be read from Table 2.

Figure 8.

Figure 8

Parameter rankings for IFN-β-induced JAK/STAT signaling pathway model: based on sensitivity functions (top panel) and based on the method proposed in this paper (bottom panel). The horizontal (X) axis represents consecutive model parameters, whose names have been replaced by numbers for better readability. The parameter annotation associated with these numbers is given in Table 2. The red line in the lower panel corresponds to the A index value representing no influence of parameter changes on the model response. Points located above this line represent parameters whose change (as described in the algorithm details) amplify the model response, while those below represent the parameters whose change lead to the suppression of the model response.

Table 2.

List of parameters appearing in the IFN-β-induced JAK/STAT signaling pathway model [1].

No. Par. Description No. Par. Description
1 kv cytoplasmic/nuclear volume ratio 25 ks1i1deg [STAT1|IRF1] degradation rate
2 vi1t IRF1 transcription rate 26 ks1s1 [STAT1p|STAT1p] complex creation rate
3 vs1t STAT1 transcription rate 27 ks1s2 [STAT1p|STAT2p] complex creation rate
4 vl2t LMP2 transcription rate 28 kphys1s1 [PHY|STAT1p|STAT1p] complex creation rate
5 vt1t TAP1 transcription rate 29 ks1i1 nuc. [IRF1|STAT1] complex creation rate
6 ktransl translation rate 30 kactivation PHY activation
7 T time constant for inertial elements 31 kinacti1 IRF1 inactivation rate
8 ks1deg STAT1 degradation rate 32 ks1tprod STAT1 constitutive mRNA production rate
9 ks1pdeg STAT1p degradation rate 33 ks2tprod STAT2 constitutive mRNA production rate
10 ks2deg STAT2 degradation rate 34 kl2tprod LMP2 constitutive mRNA production rate
11 ks2pdeg STAT2p degradation rate 35 kt1tprod TAP1 constitutive mRNA production rate
12 ki1deg IRF1active degradation rate 36 es1 STAT1 nuclear export
13 ki1_indeg IRF1inactive degradation rate 37 is1 STAT1 nuclear import
14 ks1t_deg STAT1 transcript degradation rate 38 es2 STAT2 nuclear export
15 ks2t_deg STAT2 transcript degradation rate 39 is2 STAT2 nuclear import
16 ki1t_deg IRF1 transcript degradation rate 40 is1s1 [STAT1p|STAT1p] nuclear import
17 kl2t_deg LMP2 transcript degradation rate 41 is1s2 [STAT1p|STAT2p] nuclear import
18 kt1t_deg TAP1 transcript degradation rate 42 ii1 IRF1active nuclear import
19 kinv_s1s1 cyt. [STAT1p|STAT1p] dissociation rate 43 ei1 IRF1active nuclear export
20 kinv_s1s1_n nuc. [STAT1p|STAT1p] dissociation rate 44 ei1_in IRF1inactive nuclear export
21 kinv_s1s2 cyt. [STAT1p|STAT2p] dissociation rate 45 ks1_phos STAT1 phosphorylation rate
22 kinv_s1s2_n nuc. [STAT1p|STAT2p] dissociation rate 46 ks1_dephc STAT1p dephosphorylation rate
23 kinv_phys1s1 nuc. [STAT1p|STAT1p|PHY] dissociation rate 47 ks2_phos STAT2 phosphorylation rate
24 kinv_s1i1 nuc. [STAT1|IRF1active] dissociation rate 48 ks2_dephc STAT2p dephosphorylation rate

Interestingly, in the case of the IFN-β-induced JAK/STAT signaling pathway, both rankings indicate the same parameters as the most important for the pathway temporal response, which may result from a smaller number of nonlinear terms in the IFN-β-induced JAK/STAT signaling pathway model. However, the method proposed in this paper allows to discern parameters that inhibit the pathway response from those that amplify it.

If the desired drug action was to amplify the pathway response, in order to strengthen the immune response, then the ranking suggests that any of the parameters below the red threshold line in Figure 8 (bottom panel) should be considered for further analysis. The meaning of the mentioned parameters can be found in Table 2. Of these, parameters 23, 28 and 30 correspond to processes involving a hypothetical pathway-activated phosphatase (PHY), suggested in [1] and as such could not be used in drug search, unless it is identified in experimental research. The parameters 22 and 47 are related to processes involving the STAT2 protein, which is important for other processes of immune response, and changing them would amplify these, in turn. Therefore, we focused on parameter 16 (ki1t_deg in the original model), which is the degradation rate constant of the IRF1 mRNA. The result of decreasing its value is shown in Figure 9 with a dotted line.

Figure 9.

Figure 9

Comparison of IRF1 mRNA responses in the model with nominal parameters (solid black line) and parameters reduced by a factor of α=0.15 (gray dashed and dotted lines).

If the desired drug action was to inhibit the pathway response, e.g., in autoimmune diseases, p45 (ks1_phos in the original model—STAT1 phosphorylation rate) would be the parameter of choice, according to the ranking shown in Figure 8. Reduction of its value would lead to almost complete inhibition of the system response (Figure 9, dashed line).

3. Discussion

In both examples introduced in the preceding section, sensitivity rankings provided information about important parameters, associated with particular processes to be targeted by a potential drug. The direct effect of the drug is assumed to be the reduction of kinetic rates of these processes. Such reduction might be achieved, e.g., by binding of an active drug component to one of the molecules involved in the given process. With that in mind, a search for such component might be initiated with molecular dynamics methods.

In the first model, two parameters, t0 and s0, were the most important in the model. These two parameters are associated with processes leading to Mdm2 protein production (the former one indirectly, through the production of Mdm2 mRNA). Since the translation process may be targeted by specifically designed siRNA, the parameter t0, representing the Mdm2 translation rate, seems to indicate a promising candidate for a molecular drug target. According to the ranking results, devising siRNA that would target Mdm2 mRNA would significantly alter system responses, which was already proposed in another in silico study [40]. There are also other high-ranking parameters, and each of them should be looked at from biological point of view. For example, the parameters d4 and d6 (no. 23 and 25, respectively, in Figure 2), representing the Mdm2-induced degradation rates of p53 and phospho-p53, respectively, might be another parameters of interest. In fact, nutlin, a drug targeting that Mdm2-induced degradation of p53 has been clinically tested [7,41]. Since nutlin targets Mdm2 and, thus, affects p53 degradation regardless of p53 form, we have also checked the impact of simultaneous reduction of d4 and d6, representing nutlin actions (Figure 10). The corresponding level of p53 induction is lower than the one exhibited by changing parameters t0 or s0, but still sufficient to induce cell apoptosis.

Figure 10.

Figure 10

Comparison of p53 protein responses in the model with nominal parameters (black line) and parameters d4 and d6 reduced by α=0.15.

The ranking obtained in the second example shows that, depending on the desired drug action, molecular targeting should concentrate on decreasing of either the degradation rate ki1t_deg of the IRF1 transcript (increasing its half-life) or phosphorylation rate ks1_phos of STAT1 proteins. In the first case, the aim would be to prolong the cellular response to the pathway activation through stabilizing IRF1 mRNA. Although at the moment there are no available means of increasing IRF1 transcript half-life, this might change in the future, e.g., through the use of microRNAs (miRNAs) and molecules targeted at miRNAs (antimiRs) [42] or other RNA drugs-oriented methods (reviewed recently in [43]). In the second case, the decrease of the STAT1 phosphorylation rate would be important for attenuating inflammatory responses. This is particularly interesting, as it would mean restoring the SOCS-1-mediated regulatory mechanism [44,45,46], not present in HeLa cells, for which the mathematical model of the pathway was developed [1]. Therefore, inhibiting STAT1 phosphorylation by means of an active drug component which acts in an SOCS-1-like manner, could prevent prolonged inflammation.

4. Materials and Methods

4.1. The General Class of Models Considered

There are many methods of modeling signaling pathways and regulatory networks [22,47,48,49]. The approach presented in this paper assumes that the mathematical model is given in the form of ordinary differential equations, describing changes in concentrations of molecular species involved in the intracellular processes under investigation.

In general, these equations may be written as follows:

dXdt=F(X,P,u) (1)

where X=[X1XiXn]T, P=[p1pipk]T, with Xi and pi denoting concentration or number of molecules of type i and model parameters, respectively. The vector u, which is a control vector in systems theory, represents external or internal excitation of the system. It is worth noting that the function F does not have to be continuous and may contain stochastic switches representing random signaling events [6].

Let the solution of the model (1) be given by:

X=X(Pnom,t,u), (2)

where Pnom denotes the nominal parameter vector. Nominal values of parameters of the model (1) are estimated basing on the results of biological experiments, in procedures that provide the best fit to experimental data. The general goal of sensitivity analysis is to find parameters whose change affects the solution (2) the most. In order to do that, a rank of each parameter is established, according to the value of the sensitivity index, defined by the method used in the analysis. For complex systems, building such rankings requires introduction of some kind of a combined ranking index, as the extent to which each of the variables xi is affected by a parameters change may vary. However, when the analysis is focused on regulatory networks or signaling pathways, usually, one variable is chosen to be representative of the system, thus simplifying the task. That variable denotes the concentration of a protein, transcript, protein complex or other key molecule that, e.g., defines the fate of the system, such as the p53 protein in the example that is included in this paper.

4.2. Sensitivity Rankings

The solution of the model (1) is a function of time. Depending on a goal the model has been developed for, one may consider one of different response characteristics to be the focal point of the sensitivity analysis. These include, among others, steady state value, time needed to reach the steady state, the dominant oscillation frequency, frequency spectrum of the system transient response [50,51,52] or the transient time response. Though in many cases, steady state is the preferred system characteristic, in general, it would be unsuitable for cases when it is the transient response, not the steady state, that is affected by the parameter change. The simplest example would be a temporary increase of a protein level, followed by fallback to its initial condition. Similarly, a dominant oscillation frequency would not be a proper choice for aperiodic systems. Moreover, when the study is focused on finding potential drug targets, it seems that quantitative changes are more important than qualitative ones, and therefore, in this paper, we propose to base the sensitivity indices on the area under the curve (AUC) of the model time response.

Following the assumption given in the Introduction section, in the approach presented below, one of the state variables is arbitrarily chosen to represent the system output, due to its importance both in the particular pathway/regulatory module under investigation and in other cell responses. That simplifies the ranking construction and seems to be acceptable, at least in the examples that follow.

The difference between the system responses xi obtained for nominal and modified parameter pj is given by:

Δxi(pj,t)=xi(pj,t)xi,nom(pnom,t). (3)

The following integral can be used as a measure of the effect of parameter change over the time horizon T, forming a foundation for the parameter ranking:

Rj=0TΔxi(pj,t)dt (4)

Usually, such an integral is calculated of either (Δx)2 or |(Δx)|. However, taking into account the goal of the analysis, significant parameters should yield a Δx that is of the same sign over the time horizon T. Therefore, using (4) is acceptable and yields additional information about the type of the parameter impact—the negative value is related to the inhibition drug action, whereas a positive value is related to the drug-induced amplification of the system response.

A molecular drug may either increase or decrease the ratio of a biochemical process in a pathway of interest. The respective kinetic parameter should be substantially increased or reduced, correspondingly (by the so-called amplification or reduction factor) and the impact of such change measured. Since individual cells may be affected to a different degree by the drug [18,19], the alteration factor should be a random number. That way, heterogeneity of cellular responses to a drug in a cell population is incorporated into analysis.

The basic algorithm, proposed in this paper involves the following steps:

  1. Run the simulation for nominal parameter values pnom, obtaining Xnom(pnom,t), and select a state variable representing the system output xi,nom(pnom,t).

  2. For each parameter pj, generate a large set of its random values α·pj,nom, where α is an alteration (amplification/reduction) factor drawn from a chosen distribution with mean μ equal to the the average drug effect in the population of cells and standard deviation σ representing a heterogeneous response to this drug.

  3. For each generated parameter value pj:

    • Run a simulation with randomized parameter pj and remaining parameters at their nominal values, obtaining xi(pj,t);

    • Calculate the difference between the nominal response and the new response, defined by (3);

    • Calculate the sensitivity index:
      Sj=0TΔxi(pj,t)dt0Txi,nom(pnom,t)dt (5)
      where T is the end time of the simulation.
  4. Calculate the mean μ¯ of the index S for each parameter:
    Aj=μ¯(Sj). (6)
  5. Create a parameter ranking, where each parameter pj has been assigned the value Aj.

The general idea of the proposed algorithm is illustrated in Figure 11.

Figure 11.

Figure 11

A simplified diagram showing the idea behind the algorithms used for sensitivity analysis.

As mentioned in the preceding section, we concentrate on inhibitory drug actions. For example, when binding to their respective targets, a drug may block the active site that becomes unavailable for other molecules, and thus, makes the target unavailable for a given process. By blocking the active sites of selected molecules, it is also possible to indirectly stimulate the process, e.g., through blocking the inhibitor of that process [7]. The method shown in the paper is general enough also in the case when stimulation is straightforward, as is in the case of recombinant proteins [53]. The only difference from the case studies shown in the Results section would be in the distribution used for sampling α values that should be the amplification factor.

The inhibitory drug actions are represented in a model by parameter reduction. The choice of a range, from which the reduction factor α should be sampled is based on the following assumptions:

  • If the potential drug is to be effective, it must substantially reduce the kinetic parameter—by 85% or more in most cells;

  • Some of the cells may be partially or totally resistant to the drug.

The latter assumption would not be satisfied, if a uniform distribution was used for sampling α, as suggested in [54].

The reduction factor α, representing the drug inhibitory potential, was drawn from the log-normal distribution with μ=2.08 and σ=0.61. Log-normal distribution parameters were chosen to obtain an average value of the factor α equal to 0.15 (85% parameter reduction). The distribution of the reduction factor α is shown in Figure 12.

Figure 12.

Figure 12

The distribution of reduction factor α.

However, drug impact might be brought by an increase of parameter values, instead of their decrease. This is the case, e.g., in enhancing signal transmission by the drug retigabine [55,56]. Another example can be found in Michelis–Menten-type kinetics, with the process kinetic ratio given by kx(t)km+x(t), where the drug targeting an enzyme that facilitates the process would lead to increasing the value of km. Then, the only change in the algorithm would involve sampling parameter α>>1 (which would become an amplification, not a reduction factor) in step 3 of the proposed algorithm. In the case of reducing parameter values, the sampling described in the preceding paragraph may be considered to be general, regardless of the process associated with a parameter. However, when increasing parameters, the choice of a range parameter sampling would have to be determined separately for each specific case. Expert opinions on the feasible maximum amplification factor would be needed. Therefore, in the examples shown in the subsequent section, we constrain ourselves to the examples which consider potential drug-induced reduction of parameter values only.

Negative S values, resulting from negative Δxi(pj,t), should be interpreted as the suppression of the model response after changing the parameter, and the minimum S value may be equal to 1, which represents the complete suppression of the model response (i.e., after changing the parameter value, the variable xi, representing the level of i-th molecules, has the value 0 over the entire simulation). Positive values of S correspond to the elevated level of the i-th molecules, and the maximum value of S is not limited. Therefore, if it is the parameter reduction-oriented analysis, it seems reasonable to present the parameters ranking on a logarithmic scale (with values of A scaled up by adding 1 to avoid negative arguments in log function). Then, in the rankings presented in this paper, values above 100 correspond to the amplification of the model response, while values below 100 correspond to the suppression of the model response. In other words, if the goal is to inhibit a signal in a pathway, parameters much below that threshold are of interest (the lower the value, the better). Otherwise, if drug action should yield a response amplification, the highest-located points represent parameters of interest.

Simulations were run in MATLAB R2020b using the ode23tb function.

5. Conclusions

The method of parameter ranking creation that has been introduced in this paper allows to find parameters most sensitive to targeted inhibition in signaling pathways and regulatory network models. It can be applied to a model of any pathway, regardless of its size, complexity and dynamical properties, as long as it is described by ordinary differential equations. The examples included in this paper prove that the conclusions drawn from the rankings are biologically relevant. It should be noted that the method takes into account heterogeneity in cell populations and allows to find prospective targets even if some cells ultimately appear to be not responding to treatment. The range of such heterogeneity is defined by two parameters of the distribution used to sample the reduction factor α in the model.

The approach presented in the paper may also be used in analysis focused on drugs amplifying cellular responses as represented by kinetic ratio increase. That, however, requires expert knowledge of a pathway under consideration at the time of simulations setup, as only parameters whose increase would be biologically relevant should be tested in the computational procedures.

Once the most important parameters and the processes they are associated with are identified, the next step would be to employ bioinformatics algorithms and molecular modeling [57,58] to find prospective drug components that would bind to the molecules involved in these processes, thus completing in silico search for a potential drug and preparing the stage for biological experiments.

Though the methods and examples introduced in this paper are very promising, one should remember that the models analyzed describe only a selected part of a very complex system of regulatory networks regulating intracellular processes. Such models are always based on an assumption that processes not included do not affect significantly the behavior of the system under investigation (at least, over the time horizon that is used in the simulation study). Moreover, responses to the given stimuli may be cell-type or tissue-specific, and a model that provides a good fit to experimental data in one experimental setup may need to be redesigned for another one. Therefore, in silico findings may not necessarily apply in biological in vitro or in vivo systems. Additionally, there may be off-target effects; inhibiting one target may affect other regulatory networks, and while the proposed approach is useful in search for prospective drug targets, one should be aware of its limitations, which can be summarized as follows:

  • A drug may affect several parameters simultaneously and drive the parameters change in the same direction [59].

  • Results of the analysis depend on the structure of the model and nominal parameter values. As a consequence, a model with estimated parameters that fits experimental data is needed, possibly one that takes into account, e.g., mutant proteins and their effects on the regulatory network.

  • It is not necessary that in silico findings will apply in biological in vitro and in vivo systems.

  • Signaling pathway models describe only a small fraction of much larger systems. The drug may also affect other signaling pathways (unforeseen side effects of drugs)—bioinformatics analysis is needed and expert knowledge is required to confirm the biomedical relevance of the findings.

Nevertheless, despite the limitations listed above, the approach proposed in this paper should facilitate faster advances in search for new molecular drug targets, with its ability to indicate where to look for the most efficient way of affecting cellular responses.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijms23126604/s1. Refs~[1,32] cited in Supplementary Materials.

Author Contributions

Conceptualization, J.S.; methodology, M.K. and J.S.; software, M.K.; validation, M.K. and J.S.; formal analysis, M.K., J.S. and P.P.; resources, K.P.; data curation, M.K.; writing—original draft preparation, M.K. and J.S.; writing—review and editing, M.K., J.S., P.P. and K.P.; visualization, M.K.; supervision, J.S.; funding acquisition, K.P. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This research was partially supported by the NCN grants DEC–2020/37/B/ST6/01959 (J.S.) and internal SUT grants 07/040/BK_22/1011 (M.K.) and 02/040/BK_22/1022 (K.P.).

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Smieja J., Jamaluddin M., Brasier A.R., Kimmel M. Model-based analysis of interferon-β induced signaling pathway. Bioinformatics. 2008;24:2363–2369. doi: 10.1093/bioinformatics/btn400. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Jonak K., Kurpas M., Szoltysek K., Janus P., Abramowicz A., Puszynski K. A novel mathematical model of ATM/p53/NF-κB pathways points to the importance of the DDR switch-off mechanisms. BMC Syst. Biol. 2016;10:75. doi: 10.1186/s12918-016-0293-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Choudhary K.S., Rohatgi N., Halldorsson S., Briem E., Gudjonsson T., Gudmundsson S., Rolfsson O. EGFR Signal-Network Reconstruction Demonstrates Metabolic Crosstalk in EMT. PLoS Comput. Biol. 2016;12:e1004924. doi: 10.1371/journal.pcbi.1004924. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Kardynska M., Paszek A., Smieja J., Spiller D., Widlak W., White M.R.H., Paszek P., Kimmel M. Quantitative analysis reveals crosstalk mechanisms of heat shock-induced attenuation of NF-κB signaling at the single cell level. PLoS Comput. Biol. 2018;14:e1006130. doi: 10.1371/journal.pcbi.1006130. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Allen H.R., Ptashnyk M. Mathematical modelling and analysis of the brassinosteroid and gibberellin signalling pathways and their interactions. J. Theor. Biol. 2017;432:109–131. doi: 10.1016/j.jtbi.2017.08.013. [DOI] [PubMed] [Google Scholar]
  • 6.Ochab M., Puszynski K., Swierniak A. Influence of parameter perturbations on the reachability of therapeutic target in systems with switchings. Biomed. Eng. OnLine. 2017;16:77. doi: 10.1186/s12938-017-0360-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Puszynski K., Gandolfi A., d’Onofrio A. The Pharmacodynamics of the p53-Mdm2 Targeting Drug Nutlin: The Role of Gene-Switching Noise. PLoS Comput. Biol. 2014;10:e1003991. doi: 10.1371/journal.pcbi.1003991. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Jaruszewicz J., Zuk P.J., Lipniacki T. Type of noise defines global attractors in bistable molecular regulatory systems. J. Theor. Biol. 2013;317:140–151. doi: 10.1016/j.jtbi.2012.10.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Kozlowska E., Puszynski K. Application of bifurcation theory and siRNA-based control signal to restore the proper response of cancer cells to DNA damage. J. Theor. Biol. 2016;408:213–221. doi: 10.1016/j.jtbi.2016.08.017. [DOI] [PubMed] [Google Scholar]
  • 10.Puszynski K., Gandolfi A., d’Onofrio A. The role of stochastic gene switching in determining the pharmacodynamics of certain drugs: Basic mechanisms. J. Pharmacokinet. Pharmacodyn. 2016;43:395–410. doi: 10.1007/s10928-016-9480-2. [DOI] [PubMed] [Google Scholar]
  • 11.Zi Z., Cho K.H., Sung M.H., Xia X., Zheng J., Sun Z. In silico identification of the key components and steps in IFN-γ induced JAK-STAT signaling pathway. FEBS Lett. 2005;579:1101–1108. doi: 10.1016/j.febslet.2005.01.009. [DOI] [PubMed] [Google Scholar]
  • 12.Puszynski K., Lachor P., Kardynska M., Smieja J. Sensitivity analysis of deterministic signaling pathways models. Bull. Pol. Acad. Sci. Tech. Sci. 2012;60:471–479. doi: 10.2478/v10175-012-0060-3. [DOI] [Google Scholar]
  • 13.Daniels B.C., Chen Y.J., Sethna J.P., Gutenkunst R.N., Myers C.R. Sloppiness, robustness, and evolvability in systems biology. Curr. Opin. Biotechnol. 2008;19:389–395. doi: 10.1016/j.copbio.2008.06.008. [DOI] [PubMed] [Google Scholar]
  • 14.Kardynska M., Smieja J. Sensitivity Analysis of Signaling Pathway Models Based on Discrete-Time Measurements. Arch. Control Sci. 2017;27:239–250. doi: 10.1515/acsc-2017-0015. [DOI] [Google Scholar]
  • 15.Myasnikova E., Spirov A. Relative sensitivity analysis of the predictive properties of sloppy models. J. Bioinform. Comput. Biol. 2018;16:1840008. doi: 10.1142/S0219720018400085. [DOI] [PubMed] [Google Scholar]
  • 16.Sinha S. Hilbert-Schmidt and Sobol sensitivity indices for static and time series Wnt signaling measurements in colorectal cancer—Part A. BMC Syst. Biol. 2017;11:120. doi: 10.1186/s12918-017-0488-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Rateitschak K., Winter F., Lange F., Jaster R., Wolkenhauer O. Parameter Identifiability and Sensitivity Analysis Predict Targets for Enhancement of STAT1 Activity in Pancreatic Cancer and Stellate Cells. PLoS Comput. Biol. 2012;8:e1002815. doi: 10.1371/journal.pcbi.1002815. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Flusberg D., Roux J., Spencer S., Sorger P. Cells surviving fractional killing by TRAIL exhibit transient but sustainable resistance and inflammatory phenotypes. Mol. Biol. Cell. 2013;24:2157–2298. doi: 10.1091/mbc.e12-10-0737. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Paek A.L., Liu J.C., Loewer A., Forrester W.C., Lahav G. Cell-to-Cell Variation in p53 Dynamics Leads to Fractional Killing. Cell. 2016;165:631–642. doi: 10.1016/j.cell.2016.03.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Saltelli A., Aleksankina K., Becker W., Fennell P., Ferretti F., Holst N., Li S., Wu Q. Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices. Environ. Model. Softw. 2019;114:29–39. doi: 10.1016/j.envsoft.2019.01.012. [DOI] [Google Scholar]
  • 21.Fischer H.P. Mathematical modeling of complex biological systems: From parts lists to understanding systems behavior. Alcohol Res. Health J. Natl. Inst. Alcohol Abus. Alcohol. 2008;31:49–59. [PMC free article] [PubMed] [Google Scholar]
  • 22.Liu C., Ma Y., Zhao J., Nussinov R., Zhang Y.C., Cheng F., Zhang Z.K. Computational network biology: Data, models, and applications. Phys. Rep. 2020;846:1–66. doi: 10.1016/j.physrep.2019.12.004. [DOI] [Google Scholar]
  • 23.Leis J.R., Kramer M.A. Sensitivity analysis of systems of differential and algebraic equations. Comput. Chem. Eng. 1985;9:93–96. doi: 10.1016/0098-1354(85)87008-3. [DOI] [Google Scholar]
  • 24.Toufektchan E., Toledo F. The Guardian of the Genome Revisited: p53 Downregulates Genes Required for Telomere Maintenance, DNA Repair, and Centromere Structure. Cancers. 2018;10:135. doi: 10.3390/cancers10050135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Tyson J.J. Another turn for p53. Mol. Syst. Biol. 2006;2:0032. doi: 10.1038/msb4100060. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Chen J. The Cell-Cycle Arrest and Apoptotic Functions of p53 in Tumor Initiation and Progression. Cold Spring Harb. Perspect. Med. 2016;6:a026104. doi: 10.1101/cshperspect.a026104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Pistritto G., Trisciuoglio D., Ceci C., Garufi A., D’Orazi G. Apoptosis as anticancer mechanism: Function and dysfunction of its modulators and targeted therapeutic strategies. Aging. 2016;8:603–619. doi: 10.18632/aging.100934. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Gostissa M., Hofmann T.G., Will H., Del Sal G. Regulation of p53 functions: Let us meet at the nuclear bodies. Curr. Opin. Cell Biol. 2003;15:351–357. doi: 10.1016/S0955-0674(03)00038-3. [DOI] [PubMed] [Google Scholar]
  • 29.Airley R. Cancer Chemotherapy: Basic Science to the Clinic. John Wiley & Sons; Hoboken, NJ, USA: 2009. [Google Scholar]
  • 30.Wang X., Simpson E.R., Brown K.A. p53: Protection against Tumor Growth beyond Effects on Cell Cycle and Apoptosis. Cancer Res. 2015;75:5001–5007. doi: 10.1158/0008-5472.CAN-15-0563. [DOI] [PubMed] [Google Scholar]
  • 31.Liu J., Zhu Z., Liu Y., Wei L., Li B., Mao F., Zhang J., Wang Y., Liu Y. MDM2 inhibition-mediated autophagy contributes to the pro-apoptotic effect of berberine in p53-null leukemic cells. Life Sci. 2020;242:117228. doi: 10.1016/j.lfs.2019.117228. [DOI] [PubMed] [Google Scholar]
  • 32.Puszynski K., Hat B., Lipniacki T. Oscillations and bistability in the stochastic model of p53 regulation. J. Theor. Biol. 2008;2:452–465. doi: 10.1016/j.jtbi.2008.05.039. [DOI] [PubMed] [Google Scholar]
  • 33.Hijano D.R., Vu L.D., Kauvar L.M., Tripp R.A., Polack F.P., Cormier S.A. Role of Type I Interferon (IFN) in the Respiratory Syncytial Virus (RSV) Immune Response and Disease Severity. Front. Immunol. 2019;10:566. doi: 10.3389/fimmu.2019.00566. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Karimi Y., Giles E.C., Vahedi F., Chew M.V., Nham T., Loukov D., Lee A.J., Bowdish D.M., Ashkar A.A. IFN-γ signalling regulates RAW 264.7 macrophage activation, cytokine production, and killing activity. Innate Immun. 2020;26:172–182. doi: 10.1177/1753425919878839. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Lin W.S., Kuo M.F., Peng S.S.F., Fan P.C. Long-term Outcome of Schilder Disease Treated With Interferon-β. Pediatrics. 2019;144 doi: 10.1542/peds.2019-0505. [DOI] [PubMed] [Google Scholar]
  • 36.Ebrahimi Monfared M., Shapoori S., Mosayebi G., Khansarinejad B., Ghazavi A., Rezagholizamenjany M., Ganji A. Assessment of CCL27 and IL-11 in Multiple Sclerosis Patients Treated with Interferon-β and Glatiramer Acetate. Neuroimmunomodulation. 2019;26:301–306. doi: 10.1159/000505098. [DOI] [PubMed] [Google Scholar]
  • 37.Lohmann B., Le Rhun E., Silginer M., Epskamp M., Weller M. Interferon-β sensitizes human glioblastoma cells to the cyclin-dependent kinase inhibitor, TG02. Oncol. Lett. 2020;19:2649–2656. doi: 10.3892/ol.2020.11362. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Sheahan T.P., Sims A.C., Leist S.R., Schäfer A., Won J., Brown A.J., Montgomery S.A., Hogg A., Babusis D., Clarke M.O., et al. Comparative therapeutic efficacy of remdesivir and combination lopinavir, ritonavir, and interferon beta against MERS-CoV. Nat. Commun. 2020;11:222. doi: 10.1038/s41467-019-13940-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Ahsan W., Javed S., Bratty M.A., Alhazmi H.A., Najmi A. Treatment of SARS-CoV-2: How far have we reached? Drug Discov. Ther. 2020;14:67–72. doi: 10.5582/ddt.2020.03008. [DOI] [PubMed] [Google Scholar]
  • 40.Puszyński K., Jaksik R., Świerniak A. Regulation of p53 by siRNA in radiation treated cells: Simulation studies. Int. J. Appl. Math. Comput. Sci. 2012;22:1011–1018. doi: 10.2478/v10006-012-0075-9. [DOI] [Google Scholar]
  • 41.Vassilev L.T., Vu B.T., Graves B., Carvajal D., Podlaski F., Filipovic Z., Kong N., Kammlott U., Lukacs C., Klein C., et al. In Vivo Activation of the p53 Pathway by Small-Molecule Antagonists of MDM2. Science. 2004;303:844–848. doi: 10.1126/science.1092472. [DOI] [PubMed] [Google Scholar]
  • 42.Rupaimoole R., Slack F.J. MicroRNA therapeutics: Towards a new era for the management of cancer and other diseases. Nat. Rev. Drug Discov. 2003;16:203–222. doi: 10.1038/nrd.2016.246. [DOI] [PubMed] [Google Scholar]
  • 43.Yu A.M., Choi Y.H., Tu M.J. RNA Drugs and RNA Targets for Small Molecules: Principles, Progress, and Challenges. Pharmacol. Rev. 2020;72:862–898. doi: 10.1124/pr.120.019554. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Qin H., Niyongere S.A., Lee S.J., Baker B.J., Benveniste E.N. Expression and Functional Significance of SOCS-1 and SOCS-3 in Astrocytes. J. Immunol. 2008;181:3167–3176. doi: 10.4049/jimmunol.181.5.3167. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Paracha R.Z., Ahmad J., Ali A., Hussain R., Niazi U., Tareen S.H.K., Aslam B. Formal Modelling of Toll like Receptor 4 and JAK/STAT Signalling Pathways: Insight into the Roles of SOCS-1, Interferon-β and Proinflammatory Cytokines in Sepsis. PLoS ONE. 2014;9:e108466. doi: 10.1371/journal.pone.0108466. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Hawiger J., Zienkiewicz J. Decoding inflammation, its causes, genomic responses, and emerging countermeasures. Scand. J. Immunol. 2019;90:e12812. doi: 10.1111/sji.12812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Handly L.N., Yao J., Wollman R. Signal Transduction at the Single-Cell Level: Approaches to Study the Dynamic Nature of Signaling Networks. J. Mol. Biol. 2016;428:3669–3682. doi: 10.1016/j.jmb.2016.07.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Covert M.W. Fundamentals of Systems Biology: From Synthetic Circuits to Whole-cell Models. CRC Press; Boca Raton, FL, USA: 2017. [Google Scholar]
  • 49.Gedeon T. Multi-parameter exploration of dynamics of regulatory networks. Biosystems. 2020;190:104113. doi: 10.1016/j.biosystems.2020.104113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Kruse K., Julicher F. Oscillations in cell biology. Curr. Opin. Cell Biol. 2005;17:20–26. doi: 10.1016/j.ceb.2004.12.007. [DOI] [PubMed] [Google Scholar]
  • 51.Wang Y., Paszek P., Horton C.A., Kell D.B., White M.R., Broomhead D.S., Muldoon M.R. Interactions among oscillatory pathways in NF-kappa B signaling. BMC Syst. Biol. 2011;5:23. doi: 10.1186/1752-0509-5-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Kardynska M., Smieja J. Sensitivity Analysis of Signaling Pathways in the Frequency Domain. In: Pietka E., Badura P., Kawa J., Wieclawek W., editors. Information Technologies in Medicine. Springer International Publishing; Cham, Switzerland: 2016. pp. 275–285. [Google Scholar]
  • 53.Abinaya R.V., Viswanathan P. Chapter 2—Biotechnology-based therapeutics. In: Hasija Y., editor. Translational Biotechnology. Academic Press; Cambridge, MA, USA: 2021. pp. 27–52. [DOI] [Google Scholar]
  • 54.Smieja J., Kardynska M., Pudlo M. Sensitivity Analysis Aimed at Finding Potential Molecular Drug Targets. Math. Appl. 2019;47:197–205. doi: 10.14708/ma.v47i2.6488. [DOI] [Google Scholar]
  • 55.Porter R.J., Nohria V., Rundfeldt C. Retigabine. Neurotherapeutics. 2007;4:149–154. doi: 10.1016/j.nurt.2006.11.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Czuczwar P., Wojtak A., Cioczek-Czuczwar A., Parada-Turska J., Maciejewski R., Czuczwar S.J. Retigabine: The newer potential antiepileptic drug. Pharmacol. Rep. 2010;62:211–219. doi: 10.1016/S1734-1140(10)70260-7. [DOI] [PubMed] [Google Scholar]
  • 57.Smolinska K., Pacholczyk M. EMQIT: A machine learning approach for energy based PWM matrix quality improvement. Biol. Direct. 2017;12:17. doi: 10.1186/s13062-017-0189-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.De Souza Neto L.R., Moreira-Filho J.T., Neves B.J., Maidana R.L.B.R., Guimaraes A.C.R., Furnham N., Andrade C.H., Silva F.P. In silico Strategies to Support Fragment-to-Lead Optimization in Drug Discovery. Front. Chem. 2020;8:93. doi: 10.3389/fchem.2020.00093. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Li X.L., Ogedengbe S., Qian L., Dougherty E.R. Sensitivity analysis for drug effect study: An NF-κB pathway example; Proceedings of the 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP); Atlanta, GA, USA. 3–5 December 2014; pp. 1418–1421. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

Not applicable.


Articles from International Journal of Molecular Sciences are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES