Abstract
The control of nonlinear dynamical systems is always a notable problem in science. According to control theory, suitable inputs for a controllable dynamical system are critical. Previous studies have shown some principles to determine control nodes and design control function. In this work, we propose a new control strategy of nonlinear systems by constructing impulsive control functions, i.e., we can realize the transition from an undesired state to a desired one by controlling appropriately chosen nodes in a discrete manner. In order to demonstrate the effectiveness of the strategy, we apply it to two biological networks: the epithelial–mesenchymal transition (EMT) network and the Notch1–Dll1–Jag1 signaling pathway. The strategy can not only be used to guide pharmacological design in a more feasible form but can also be applied into the fields of biological, medical and other multistable dynamical systems.
Keywords: Nonlinear dynamical system, Control function, Impulsive, EMT network, Notch1–Dll1–Jag1 signaling pathway
Introduction
In recent years, one of the most notable problems in science and engineering has been the control of networks [1]. Although great effort has been devoted to deciphering the interaction between networks and dynamical processes taking place on various natural and technological systems, the control of dynamical biological networks remains an outstanding problem [2]. Previous studies have investigated the controllability of networks with linear dynamics [3] and how to determine the driving nodes [4]. Actually, almost all dynamical processes on networks are nonlinear. Therefore, the control of a nonlinear dynamical network must be considered and the controllability of nonlinear systems is similar to linear systems in many aspects [4, 5]. Many studies have focused on the controllability of nonlinear dynamical systems [6]. For instance, a nonlinear dynamical network, in which the nodes are distinct attractors of the system, has been introduced to investigate the transitions between different attractors by applying the parameter perturbation technique [7]. Although there have been significant advances in controlling nonlinear dynamics in biological organisms in recent years, more effective and easily realized control strategies remain to be fully investigated.
According to control theory, a dynamical system is controllable if, with a suitable choice of input, it can be driven from any initial state to any desired final state within finite time [8]. A common feature of nonlinear dynamical systems is the existence of a number of distinct attractors [9]. For a disease-related nonlinear system, multiple types of stable states (attractors) can occur. Some of them correspond to healthy (desirable) states, while others are disease (undesirable) states. The main purpose here is to propose a more effective and easily realized control strategy by which the transition from a disease or pre-disease state to a healthy or normal state can be realized. It is hoped that the results presented here will provide a new perspective on how network dynamics is controlled by the impulsive strategy and further guidance for drug design in the biological and medical fields [10].
A previous study proposed a good principle to determine the driving nodes of the biological networks [5]. However, the complexity of the control function makes it difficult to realize in real biological systems. In this paper, we propose an impulsive control strategy by which the transition between two alternative stable states can be realized. Therefore, when multiple stable states corresponding to disease and healthy states exist, the transition from a disease state to a healthy one can be realized when spontaneous transition cannot be performed. We first construct an impulsive control system to model the process of periodically perturbing the driving nodes with appropriate impulsive control amounts, and further study its effects on the dynamics of the controlled system. We can realize the desired transition by changing the frequency and amplitude of the periodic stimuli. The EMT and the Notch1–Dll1–Jag1 networks are used to show the effectiveness of the proposed method. The results not only provide a perspective to understand the interactions between external stimuli and intrinsic physiological dynamics but also may lead to development of realistic artificial control strategy and medical therapy.
Theoretical result of impulse control
The nonlinear dynamics of networks can often be represented by a set of nonlinear ordinary differential equations. Without loss of generality, we consider an n-node network whose n-dimensional dynamical state x(t) is described as:
| 1 |
where F(x(t)) ∈ Rn is a nonlinear function, which is continuously differentiable with respect to x, x(t) ∈ Rn is the state vector [11, 12]. If we add a control function u(t) to system (1), we obtain the corresponding control system:
| 2 |
where is the control function. It should be noted that system (2) is exactly system (1) when u(t) = 0.
Without loss of generality, we assume that nonlinear system (1) exhibits at least two stable steady states (attractors): and (. We postulate is the ON state and is the OFF state. In other words, the ON state is the disease state and we hope to transform it to a desirable and healthy OFF state. Based on the impulsive control theory, an artificial control strategy is proposed. When spontaneous transition from a disease state to a healthy one cannot be achieved, an external input can be used to compensate the inefficiency of some regulations and thus induce a controlled transition. To address these problems, we consider the following control system:
| 3 |
where B ∈ Rn×m(m ≤ n) is the control input matrix. Matrix B = {eij} consists of m column unit vectors with eij = 1 if controller j directly acts on variable (node) i and eij = 0 otherwise [12]. Without loss of generality, we assume that the first m variables are selected and controlled, i.e., the sub-matrix consisting of the first m row of B is an identity matrix.
For convenience, to prove the following theorem, we use the following notations:
where X(t) and Y (t) represent the controlled and uncontrolled nodes, respectively and
Theorem 1
Nonlinear system (3) can be impulsivelycontrolled if there exists a impulsive controlfunctionsuchthat the corresponding solutionx(t) ofsystem (3) satisfies.The time t is divided into a sequence with step size T, i.e.,t = t0 + jTandwe assume that T is sufficiently small.
Proof
The proof includes two main steps. The first step is to determine the control variables that include m variables and the second step is to design the control function u(t) and prove that system (3) can be controlled.
First, we show how to determine the index set of control variables that include m variables. Let K be an index set (possibly empty set) of variables. The purpose of K is to screen out the variables whose partial derivatives are not constantly negative. If there exists a time t and a state x(t) ∈ Rn such that the following inequality:
| 4 |
holds, then r ∈ K.
Let Q be an index set of variables containing q elements, Q = {1,⋯q}, where q is the most smallest positive integer satisfying:
| 5 |
where C = Q ∪ K = {1,⋯ ,m} is the index set of control variables, {m + 1,⋯ ,n} is the index set of variables that do not need to be controlled and N(p) is the index set of variables that are in the p-th equations of system (3) but exclude the index p. It is obvious that m ≤ n [5]. Actually, the dynamical equation of the remaining variables (xm+ 1,⋯ ,xn) are explicit functions of selected variables (x1,⋯ ,xm).
Second, we design the control function as follows:
| 6 |
where λ < 0.
Recall that the first m rows of B constitute an identity matrix. Substituting (6) into (3), we obtain:
| 7 |
Next, we divide time t with step size T, then, t = t0 + jT. A perturbation uj is given at instants jT. For any controlled node xi(t) ∈ X(t) ∈ Rm, (i = 1,2,⋯ ,m), we have:
| 8 |
| 9 |
where [10].
We consider a sequence xi(t0 + jT), . We only assess the case of , (the proof is similar for the case of ), then uj > 0. If we assume that T is sufficiently small and by using (9), we obtain:
When a suitable λ is chosen, we can guarantee that the following equation holds:
which means that is a monotonically increasing and bounded sequence, therefore, its limit value exists and its supremum is , i.e.,
Due to
Therefore, we have:
According to Theorem 3.1 in [5], when the formula is satisfied, we have . □
Remark 1
There are two fundamental problems in the control of nonlinear dynamical networks; one is how to identify the driving nodes and the other is how to design the impulsive control function. According to [5], we can obtain a strategy for identifying the driving nodes that are required to ensure that the system is controllable. Compared with [5], the impulsive control function is more practical due to its simpler form. The impulsive control uj at each time T is in a discrete form rather than a continuous one, which is more practical in guiding pharmacological design and medical therapy.
Remark 2
In the proof of Theorem 1, the stability of is not required. Therefore, if is an equilibrium point (no matter whether is stable or not), the transition can be achieved. When is stable, the impulsive control can be stopped after some times of perturbations due to the existence of an attractive region. Otherwise, the control can never be stopped.
Remark 3
In Theorem 1, we assume that time step T is sufficiently small. Actually, the transition can also be realized even for relatively larger T in simulating some biological networks.
Impulsive control of the EMT core network
We first applied the approach to the EMT core network as shown in Fig. 1a [13–15]. Its dynamics can be expressed as:
| 10 |
where xi (i = 1,⋯ ,6) represents the activity level of CDH1, SNAI1, ZEB1, ZEB2, miR-200, and miR-203, respectively. Kij denotes the regulatory strength from node j to i and di is the degradation rate of xi. The parameter values used to perform numerical simulations are Kij = 1, d1 = 0.5, d2 = 0.3, d3 = 0.5, d4 = 0.5, d5 = 0.5, and d6 = 0.3.
Fig. 1.

The EMT core network and control strategy for its phenotype transition. a Diagram of the EMT core network. The arrows and short bars represent activation and inhibition, respectively. b The control nodes (genes) for realizing the impulsive control. Mesenchymal cells can be induced from epithelial cells and back by impulsive control of two genes miR-200 and miR-203
The system has two locally stable attractors according to linear stability analysis, i.e., the signs of real parts of eigenvalues of the matrix Df(x0) (the derivative of f(x) at x0, x0 is an equilibrium point of nonlinear system (10)) [16]. Two stable states are shown in Table 1, which correspond to the epithelial and mesenchymal state, respectively. According to Theorem 1, we can easily determine the controlled nodes of system (10). It is clear that the index set K that satisfies (4) is empty. We rewrite system (10) into the following form:
| 11 |
Table 1.
Two attractors of the EMT core network with A and B corresponding to the epithelial state and mesenchymal states [15], respectively
| x i | A | B | x i | A | B |
|---|---|---|---|---|---|
| x1(CDH1) | 1.7924 | 0.1111 | x4(ZEB2) | 0.0170 | 1.8169 |
| x2(SNAI1) | 0.3359 | 3.2229 | x5(miR-200) | 1.7924 | 0.1111 |
| x3 (ZEB1) | 0.0522 | 1.8224 | x6(miR-203) | 2.9873 | 0.1851 |
By successive evaluation of the dynamical equations, we can obtain the equivalent system as:
| 12 |
It is easy to recognize that the values of variables (x1,x2,x3,x4) at equilibrium are explicit functions of variables (x5,x6), suggesting that the control of x5 and x6 can indeed steer system (10) to evolve to a desired attractor as shown in Fig. 1b. According to formula (5), it can be easily obtained that N(2) = {6}, , and . Therefore, we can choose Q = {5,6} and C = Q ∪ K = {5,6}.
The above analysis indicates that we can realize the transition from epithelial to mesenchymal cells and back by controlling miR-200 (x5) and miR-203 (x6). Based on (6), the impulsive control function, uj = (u1,j,u2,j)T (t0 = 0), for the driving nodes miR-200 and miR-203 takes the form:
where xi(jT) (i = 5,6) is the level of the i-th component at time jT and is the equilibrium of the i-th component of the desired attractor. The successful transition from one stable state to another by impulsive control is shown in Fig. 2.
Fig. 2.
The transition from the epithelial state to the mesenchymal state by the impulsive control of the driving nodes x5 (miR-200) and x6 (miR-203). The system stays at epithelial state if no perturbation occurs (blue lines). When an appropriate impulsive control is performed, the transition from the epithelial state to the mesenchymal state is realized (red lines). The red stars represent the points at which the control is performed. The black lines represent control functions. When the transition is realized, the control can be stopped
The parameter λ in the control function may affect the control process. Within a certain range of λ, the higher the absolute value of λ, the shorter time it takes to reach the desired state [5]. Generally, the value of λ should be as small as possible from the viewpoint of medical science. In the numerical simulations, we take the time step T is 10 and λ is − 0.35. After some times perturbations (j = 15), the transition is successfully realized. Actually, the control can be stopped after some times of control when the system states fall into the attractive region of the desired attractor.
The size of step size T can affect the control performance. Generally, the smaller T is, the shorter time to reach the desired state, as shown in Fig. 3.
Fig. 3.
The effect of time step T on control performance. We take numerical simulation on x6 of the EMT network with different T. aT = 5; bT = 10; cT = 15
Impulsive control of Notch–Delta–Jagged signaling pathway
Next, we apply the approach to the Notch–Delta–Jagged signaling pathway, as shown in Fig. 4, which consists of four nodes. The notch receptor in one cell can interact with both of the ligands, i.e., Delta and Jagged, in the same cell (cis-interaction), or with Dext or Jext in the neighboring cells (trans-interaction). The cis-interaction, also referred to as cis-inhibition, causes the degradation of both of the interacting proteins. Meanwhile, the trans-interaction, also referred to as trans-activation, leads to the release of the Notch intracellular domain (NICD), which can translocate to the nucleus and initiate transcription of its target genes [17].
Fig. 4.
Schematic illustration of the Notch–Delta–Jagged signaling pathway. The trans-activation occurs when the receptor (Notch) of the receiver cell interacts with the ligand of the sender cell (Delta or Jagged) or with external ligands in a soluble form (Dext or Jext). The released signal NICD activates the expression of Notch and Jagged and inhibits the expression of Delta. The cis-inhibition occurs between the receptor and ligand in the same cell and leads to the degradation of both proteins
The dynamics of Notch (x1), Delta (x2), Jagged (x3), and NICD (x4) are given by the following equations:
| 13 |
where γ represents the degradation rate of all three transmembrane proteins Notch, Jagged, and Delta and γI the degradation rate of NICD. kc and kt are the strengths of cis-inhibition and trans-activation, respectively. N0, D0 and J0 are the production rates of Notch, Delta and Jagged, respectively. Dext and Jext represent the amount of protein available for binding, which can be on the membrane surface of neighboring cells or in a soluble form. The parameter values used to perform the numerical simulation are: N0 = 1600, D0 = 1800, J0 = 1200, I0 = 200, kc = 0.00135, kt = 0.0135, Dext = 100, Next = 600, Jext = 1000, γ = 0.1 and γI = 0.5 [17–19].
System (13) has three stable states, thus, the Notch signaling operates as a three-way switch. The three stable states correspond to a sender cell state (S), a receiver cell state (R) and a hybrid sender/receiver cell state (S/R), as shown in Table 2.
Table 2.
The attractors of the Notch–Delta–Jagged signaling pathway. The attractors A, B, and C correspond to the receiver (R), hybrid sender/receiver (S/R), and sender (S), respectively [17]
| x i | S | R | S/R |
|---|---|---|---|
| x1(Notch) | 2999.3532 | 618.4437 | 184.5724 |
| x2(Delta) | 20.5765 | 961.1550 | 3891.9800 |
| x3 (Jagged) | 568.6468 | 1647.9910 | 2793.8860 |
| x4 (NICD) | 888.4379 | 183.6777 | 54.8179 |
It is clear that there is no set satisfying (4), therefore, K is an empty set. We can rewrite system (13) as:
| 14 |
where Gi(xj) and Di(xi) indicate the terms related to other variables (j≠i) and itself (xi) in the i-th equation, respectively. By successive evaluation of the dynamical equations, we obtain the equivalent system:
| 15 |
As shown in (15), the values of variables x2, x3, x4 at equilibrium are explicit functions of the selected variables x1. Therefore, the dynamics of the variables x2, x3, x4 is determined by the variable x1. For system (14), according to formula (5), it can easily be shown that N(4) = {1}, N(3) = {1}, N(2) = {1}, and . Therefore, we have Q = {1} and C = Q ∪ K = {1}. Thus, we can choose Notch (x1) (t0 = 0) as the control node as shown in Fig. 5. The control function can be designed as:
where is the value of x1 at the target equilibrium. Under the impulsive control of the Notch, the transition among the states S, R, and S/R can be realized. In the numerical simulations, the time step T is 0.1 and the number of pulses performed n is 15. The transition processes are depicted in Figs. 6, 7 and 8, which indicate that the approach can successfully realize the transition between different stable states. These results are consistent with previous experimental results [17].
Fig. 5.

The transition among different states S, R, and S / R can be realized by impulsive control of Notch
Fig. 6.
The impulsive control of the Notch–Delta–Jagged signaling pathway to realize the transition from S to R state by controlling Notch with λ = − 0.8. The blue solid lines show the system stays at the S state when no perturbation occurs. The red lines show the transition from S/R to S state by controlling Notch. The red stars represent the points at which the control is performed. The black lines represent control functions
Fig. 7.
The impulsive control of the Notch–Delta–Jagged signaling pathway to realize the transition from R to S/R state by controlling Notch with λ = − 1.5
Fig. 8.
The impulsive control of the Notch–Delta–Jagged signaling pathway to realize the transition from R to S state by controlling Notch with λ = − 0.6
Parameter control of Notch–Delta–Jagged signaling pathway
The aim of impulsive control is to entrain the driving nodes to their target states and further entrain the whole system to its target. Actually, such a goal can be similarly obtained by perturbing related parameters that significantly affect the dynamics of the driving nodes. For instance, for the Notch–Delta–Jagged signaling pathway, besides the impulsive control of Notch, the perturbation of I0 can also be used to realize the transition between different steady states because the perturbation can significantly change the dynamics of Notch and further the dynamics of the whole system, as shown in Fig. 9.
Fig. 9.
Bifurcation diagram of the Notch–Delta–Jagged signaling pathway with I0 as a control parameter. The red solid lines represent the stable states R, S, and S/R. The black dotted lines represent the unsteady states. The transition among three types of stable states can be realized by perturbing the parameter I0
Discussion
In this paper, we proposed an impulsive control strategy by which the transition between different states can be realized. The process mainly includes two steps: (1) determining the driving nodes and (2) constructing an appropriate impulsive control of the driving nodes. We further apply it into the EMT core network and the Notch1–Dll1–Jag1 signaling pathway to show effectiveness of the approach. Such an impulsive control strategy can be more easily performed in real life. Different from the continuous control in [5], which is so elaborate that it is relatively difficult to perform in the real world, the impulsive strategy is in a discrete form [20] and therefore can be easily performed. For instance, from a medical point of view, patients who need treatment can not be given sustained medication, time intervals of medication are necessarily required. The strategy can not only be used to guide pharmacological design but can also be applied into the fields of biological, medical, and other fields.
Generally, the target is stable. Actually, we can also control a system to an unstable state by the impulsive strategy. As we see in the proof of theorem 1, stability of the target state is not required. For example, for the Notch–Delta–Jagged signaling pathway, we can control the system to an unstable state x∗ = (471,1475,1678,140), as shown in Fig. 10. Different from the case of stable states, when we control a system to an unstable state, the control can not be stopped because the attractive region does not exist for the unstable state.
Fig. 10.
The transition from S state to the unstable equilibrium point x∗ by impulsive control of the Notch with λ = − 3
In contrast to from the impulsive control approach, the parameter perturbation strategy can also be applied to realize the transition between different states. In the impulse control, we need to calculate the exact value of each steady state in advance, so, we can realize the transition more accurately. While in the parameter control, we do not need to compute the exact value of each steady state but we need to find the bifurcation point between different steady states. Before using any one control strategy, we need to determine the driving nodes in advance. These strategies have significant clinical or experimental implications [21, 22]. For instance, better understanding of the external periodic (impulsive) input may lead to the development of better medical therapies.
Funding
This study was funded by the National Science Foundation of Shanghai (Grant No. 17ZR1410800).
Compliance with Ethical Standards
Conflict of interest
This paper has three authors: Min Luo, Jianfeng Jiao, and Ruiqi Wang. We declare that we have no conflicts of interest.
References
- 1.Ruths J, Ruths D. Control profiles of complex networks. Science. 2014;343:1373–1376. doi: 10.1126/science.1242063. [DOI] [PubMed] [Google Scholar]
- 2.Yuan Z, Zhao C, Di Z, Wang WX, Lai YC. Exact controllability of complex networks. Nat. Commun. 2013;4:2447. doi: 10.1038/ncomms3447. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Maryland U.O. Park C. Contributions to differential equations. New York: Interscience Publishers; 1963. [Google Scholar]
- 4.Wu FX, Wu L, Wang J, Liu J, Chen L. Transittability of complex networks and its applications to regulatory biomolecular networks. Sci. Rep. 2014;4:4819. doi: 10.1038/srep04819. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Zou X, Wu F, Jin S. Domain control of nonlinear networked system and applications to complex disease networks. Discrete Contin. Dynam. Syst.-Ser. 2017;8:22. [Google Scholar]
- 6.Jorge G, Yanga Z, Alberta R. Structure-based control of complex networks with nonlinear dynamics. Proc. Natl. Acad. Sci. USA. 2017;114:7234–7239. doi: 10.1073/pnas.1617387114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Wang LZ, Su RQ, Huang ZG, Xiao W, Wang WX, Celso G, et al. A geometrical approach to control and controllability of nonlinear dynamical networks. Nat. Commun. 2016;7:11323. doi: 10.1038/ncomms11323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Liu Y, Slotine JJ, Barabasi AL. Controllability of complex networks. Nature. 2011;473:167. doi: 10.1038/nature10011. [DOI] [PubMed] [Google Scholar]
- 9.Khalil H. Nonlinear Systems, 3rd edn. Englewood: Prentice Hall; 2002. [Google Scholar]
- 10.Wang R, Chen L, Aihara K. Synchronizing a multicellular system by external input: an artificial control strategy. Bioinformatics. 2006;22:1775. doi: 10.1093/bioinformatics/btl182. [DOI] [PubMed] [Google Scholar]
- 11.Bi Sze, H.: Ordinary Differential Equations with Applications (2013)
- 12.Jin S, Wang D, Zou X. Trajectory control in nonlinear networked systems and its applications to complex biological systems. SIAM J. Appl. Math. 2018;78(1):629–649. doi: 10.1137/17M1116143. [DOI] [Google Scholar]
- 13.Lamouille S, Xu J, Derynck R. Molecular mechanisms of epithelial–mesenchymal transition. Nat. Rev. Mol. Cell Biol. 2014;15(3):178–196. doi: 10.1038/nrm3758. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Tian XJ, Zhang H, Xing J. Coupled reversible and irreversible bistable switches underlying TGFb-induced epithelial-to-mesenchymal transition. Biophys. J. 2013;105(4):1079–1089. doi: 10.1016/j.bpj.2013.07.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Balint S, Kaslik E, Balint AM, Grigis A. Methods for determination and approximation of the domain of attraction in the case of autonomous discrete dynamical systems. Nonlinear Anal. Theory Methods Appl. 2005;60(4):703–717. doi: 10.1016/j.na.2004.09.046. [DOI] [Google Scholar]
- 16.Marsden JE, Sirovixh L, Golubitsky M. Differential Equations and Dynamical Systems. Lisbon Portugal: American Mathematical Society; 2000. [Google Scholar]
- 17.Boareto M, Jolly MK, Lu M, Onuchic JN, Clementi C, Benjacob E. Jagged–Delta asymmetry in Notch signaling can give rise to a sender/receiver hybrid phenotype. Proc. Natl. Acad. Sci. USA. 2015;112(5):402–409. doi: 10.1073/pnas.1416287112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Hicks C, Johnston SH, Disibio G, Collazo A, Vogt TF, Weinmaster G. Fringe differentially modulates Jagged1 and Delta1 signalling through Notch1 and Notch2. Nat. Cell Biol. 2000;2(8):515–520. doi: 10.1038/35019553. [DOI] [PubMed] [Google Scholar]
- 19.Shimizu K, Chiba S, Saito T, Kumano K, Takahashi T, Hirai H. Manic fringe and lunatic fringe modify different sites of the Notch2 extracellular region resulting in different signaling modulation. J. Biol. Chem. 2001;276(28):25753–25758. doi: 10.1074/jbc.M103473200. [DOI] [PubMed] [Google Scholar]
- 20.Kuznetsov YA. Elements of Applied Bifurcation Theory, 2nd edn. New York: Springer; 2000. [Google Scholar]
- 21.Yang K, Bai H, Ouyang Q, Lai L, Tang C. Finding multiple target optimal intervention in disease-related molecular network. Mol. Syst. Biol. 2008;4:228. doi: 10.1038/msb.2008.60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Li Y, Jin S, Lei L, Pan Z, Zou X. Deciphering deterioration mechanisms of complex diseases based on the construction of dynamic networks and systems analysis. Sci. Rep. 2015;5:9283. doi: 10.1038/srep09283. [DOI] [PMC free article] [PubMed] [Google Scholar]








