Abstract
There has been tremendous development in linear controllability of complex networks. Real-world systems are fundamentally nonlinear. Is linear controllability relevant to nonlinear dynamical networks? We identify a common trait underlying both types of control: the nodal “importance”. For nonlinear and linear control, the importance is determined, respectively, by physical/biological considerations and the probability for a node to be in the minimum driver set. We study empirical mutualistic networks and a gene regulatory network, for which the nonlinear nodal importance can be quantified by the ability of individual nodes to restore the system from the aftermath of a tipping-point transition. We find that the nodal importance ranking for nonlinear and linear control exhibits opposite trends: for the former large-degree nodes are more important but for the latter, the importance scale is tilted towards the small-degree nodes, suggesting strongly the irrelevance of linear controllability to these systems. The recent claim of successful application of linear controllability to Caenorhabditis elegans connectome is examined and discussed.
Subject terms: Ecology, Control theory, Complex networks, Nonlinear phenomena
Linear controllability theories have stimulated research on control of complex networks. Here the authors investigate the concordance between linear and nonlinear approaches in ranking the importance of nodes in nonlinear networks, and conclude that linear controllability may not be applicable.
Introduction
In the development of a field that involves dynamical systems, when knowledge has accumulated to certain degree, the question of control would arise naturally. For example, in nonlinear dynamics, the principle of controlling chaos was articulated in 19901, after approximately a decade of intense research focusing on the fundamental understanding of chaotic dynamical systems. Likewise, in complex networks, the issue of control began to be addressed2,3 also approximately after 10 years of tremendous growth of research triggered by the pioneering work on small world and scale-free networks. A key development is the systematic adoption of the linear structural controllability theory to complex networks with directed interactions4. Since then, there has been a great deal of effort in investigating the linear controllability of complex networks5–21.
Control of linear dynamical systems is a traditional field in engineering22,23. Because of the simplicity in the possible dynamical behaviors that a linear dynamical system can generate (in contrast to nonlinear dynamical systems where the behaviors are extremely rich and diverse), the general objective is to design proper control signals to drive the system from an arbitrarily initial state to an arbitrarily final state in finite time. When applying the linear controllability theory to complex networks, a primary goal has been to determine the minimum number of controllers. This problem was addressed4 for complex directed networks through the development of a minimum input theory based on the concept of maximum matching24–26. To generalize the linear controllability theory to networks of arbitrary structures (e.g., weighted or unweighted, directed or undirected), an exact controllability theory was developed9 based on the Popov–Belevitch–Hautus (PBH) rank condition27. The exact controllability theory provides a computationally extremely efficient method to determine not only the minimum number of controllers but also the set of the nodes to which the control signals should be applied—the set of driver nodes, for complex networks of arbitrary topology and link structures9.
The development of the linear controllability theories has played the role of stimulating research on controlling complex networks28. However, its limitations must not be forgotten. The fundamental assumption used in any linear controllability theory is that the nodal dynamics are described by a set of coupled linear, first-order differential equations. While such a setting may be relevant to engineering control systems, real-world systems are governed by nonlinear dynamics, such as biologically inspired networks29. In classical control engineering, it is well recognized that controllability for nonlinear systems requires a different set of tools to be developed compared to what is known for the controllability of linear systems30. A serious concern is the tendency to overstate the use or the predictive power of the linear controllability theories when they are applied to real-world physical or biological systems. For example, it was claimed recently31 that linear network control principles can predict the neuron function in the Caenorhabditis elegans connectome, a highly nonlinear dynamical neuronal network. The goal of the present work is to legitimize this concern in a quantitative manner by presenting concrete and statistical evidence that linear network controllability may not be relevant to physically or biologically meaningful control of nonlinear networks.
The physical world is nonlinear. Network dynamics in biological or ecological systems are governed by nonlinear rules with no exceptions. Control of real world complex networks based on the rules of nonlinear dynamics has remained to be an extremely difficult problem. Existing strategies include local pinning32–35, feedback vertex set control36–38, controlled switch among coexisting attractors39, or local control21. These methods belong to the category of open-loop control, i.e., one applies pre-defined control signals or parameter perturbations to a feedback vertex set chosen according to some physical criteria. For certain nonlinear dynamical networks, especially those in ecology, closed-loop control can be articulated and has been demonstrated to be effective40. Recently, how to exploit biologically inspired agent-based control method to choose different alternative states in engineered multiagent network systems has been studied41.
In order to answer the question “is linear controllability relevant to nonlinear dynamical networks?”, two challenges must be met. Firstly, because of lack of general controllability framework for nonlinear networks, it is necessary to focus on specific contexts where nonlinear network control can be done in a physically or biologically meaningful way. We choose two such contexts: mutualistic networks in ecology42–49 and a gene regulatory network from systems biology50–52. Secondly and more importantly, linear and nonlinear dynamical networks are fundamentally and characteristically different in many aspects, so are the respective control methods. How do we compare their control performances? (How can an apple be compared with a banana?) Our idea is that, even in the analog of apple–banana comparison, if one finds a common trait, e.g., the amount of sugar contained per gram of the substance, then a comparison between an apple and a banana in terms of the specific common trait is meaningful. We are thus led to seek a feature or a characteristic that is common in both nonlinear and linear network control. Specifically, we identify the statistical importance of individual nodes in control as such a common trait.
Our approach and main results can be described, as follows. Given a nonlinear dynamical network with its structure determined from empirical data, we focus on the concrete problem of harnessing a tipping point at which the system transitions from a normal state to a catastrophic state (e.g., massive extinction) or from a catastrophic state to a normal state abruptly as a system parameter changes through a critical point45,49,53–59. We exploit the ability of the individual nodes, via control, to make the system recover from the aftermath of a tipping point transition that puts the system in an extinction state. This enables a quantitative ranking of the importance of the individual nodes to be determined. The ranking is generally found to be linearly correlated with the nodal degree of the network, in agreement with intuition. The individual nodes, in terms of their ability to make the system recover, are drastically distinct. We then perform linear control on the same network by assuming artificial linear nodal dynamics. Using the exact controllability theory9, we calculate the minimal control set. A key feature of linear network control, which was usually not emphasized in most existing literature on linear controllability5–21 but was mentioned in a recent paper60, is that the minimal control set of nodes is not unique. For a reasonably large network (e.g., of size of a few hundred), there can be vastly many such sets that are equivalent to each other in terms of control realization. Thus, in principle, there is a finite probability for a node in the network to be chosen as a control driver and the corresponding probability can be calculated from the ensemble of the minimal control sets. This probability can be defined as a kind of importance of the node in control relative to other nodes so that a nodal importance ranking can be determined. Because of the generality and universality of the linear control framework, the method to determine the nodal importance is applicable to any complex network. For a large number of real pollinator–plant mutualistic networks reconstructed from empirical data from different geographical regions of the world (Supplementary Table 2) and a representative gene regulatory network, we find that the linear importance ranking favors the small degree nodes, in stark contrast to the case of nonlinear control where large degree nodes are typically more valuable. The characteristic difference in the importance ranking of the nodes in terms of their role in control, linear or nonlinear, suggests that linear controllability may not be relevant to physically or biologically justified nonlinear control for the mutualistic and gene regulatory networks.
Results
Irrelevance of linear controllability in a complex pollinator–plant mutualistic network
The assumptions of this study are as follows. For linear dynamical networks, a general controllability framework exists, which can be used to determine the nodal importance ranking and is applicable to all networks. For nonlinear networks, because of the rich diversity in their dynamics, at the present a general control framework does not exist. The control strategy thus depends on the specific physical or biological context of the network.
To demonstrate the characteristic statistical difference between nonlinear and linear control, we take a representative pollinator–plant mutualistic network (network A), and calculate the node based, nonlinear and linear control importance according to Eqs. (1) and (7), respectively, as described in the “Methods” section. Figure 1 shows the 38 pollinator and plant species (Supplementary Table 1), together with the relative nonlinear and linear control importance as represented by the lengths of the green and blue bars beneath the images, respectively. There is a wide spread in the nonlinear control importance, but the linear control importance appears approximately uniform across the species. There are cases where a node is not important at all for nonlinear control (e.g., the first, fifth, and sixth species in the bottom row), but the node is important for linear control. The statistical characteristics of the nodal importance in nonlinear and linear control are thus drastically distinct. An examination of other empirical mutualistic systems reveals that, for some networks, the behaviors are similar to those in Fig. 1, while in others, the nodal importance shows opposite trends in nonlinear and linear control. For example, there are cases where the nonlinear control importance tends to increase with the nodal degree, but the linear nodal importance shows the opposite trend. These results suggest that linear controllability may not be useful for controlling the actual nonlinear dynamical network.
Nonlinear and linear control importance
We present quantitative results of nonlinear and linear control importance for four empirical mutualistic networks described in the “Methods” section, as shown in Fig. 2. (Similar results from a large number of additional networks are presented in Supplementary Figs.) For a given empirical network, to calculate the nonlinear control importance based on definition (1), we begin from a zero value of the average mutualistic interaction strength γ0, where the system is in an extinction state without control, apply the control by setting the abundance of a pollinator species at AS = 1.5, and systematically increase the value of γ0 towards a relatively large value (e.g., 3.0). During this process, the recovery point can be obtained. When the values of the recovery point for all pollinator species have been calculated, Eq. (1) gives the control importance for each species, as shown in Fig. 2a–d for networks A−D, respectively, where the index of the pollinator species on the abscissa is arranged according to the nodal degree. Apart from statistical fluctuations, there is a high level of positive correlation between the nonlinear control importance and degree, i.e., larger degree nodes tend to be more important. In particular, managed control of larger degree nodes is more effective for species recovery. To obtain the linear control importance according to Eq. (7), we use 1000 random minimum controller sets as determined by the linear exact controllability to calculate the probability for each species to be chosen as a driver node. Note that, because of the artificial imposition of linear time-invariant dynamics on each node, there is a probability for any species to be a driver node, regardless of whether it is a pollinator or a plant species. The results are presented in Fig. 2e–h for networks A−D, respectively, where the linear control importance of the pollinators (red dots) and that of the plants (green dots)—separated by the vertical dashed line, are shown. The common feature among the four empirical networks is that the linear control importance ranking has an opposite trend to the nonlinear control importance ranking. That is, smaller degree nodes tend to be more important for linear control. The correlation between linear control importance and degree is thus negative, which is in stark contrast to the behavior of nonlinear control importance. Overall, Fig. 2a–h reveals that, for nonlinear control of tipping points, managing large degree nodes can be significantly more effective than harnessing small degree nodes, but for linear control of the same network, the large degree nodes play little role in control as they rarely appear in any minimum controller set.
The linear control importance measure, as defined in Eq. (7), is rooted in the fact that, in the linear controllability theory, typically there are many equivalent minimum controller sets60. It is useful to visualize such sets. Figure 3a exhibits a graphical representation of an empirical mutualistic network—network E described in the “Methods” section, where the pollinators (red dots) and plants (green dots) are arranged along a circle, and the size of a dot is proportional to the degree of the corresponding node. By definition, mutualistic interactions mean that there are no direct links between any pair of dots with the same color—any link in the network must be between a red and a green dot. For this network, there are altogether ~1012 minimum controller sets of exactly the same size—three examples are shown in Fig. 3b–d, respectively, where the driver nodes are represented by black dots. A feature is that the minimum controller sets tend to avoid nodes of very large degrees in the network, which is consistent with the results in Fig. 2. The corresponding linear and nonlinear control importance rankings are shown in Fig. 3e, f, respectively. A comparison of these results indicates that the ranking behaviors are characteristically distinct, suggesting the difference between linear controllability and nonlinear control—the same message conveyed by Fig. 2 (and many additional examples in Supplementary Figs).
Gene regulatory networks
The opposite behaviors in the nodal importance ranking for linear controllability and nonlinear control also arise in gene regulatory networks. For such networks, tipping point dynamics similar to those in mutualistic networks can occur when a biological parameter is reduced, rendering feasible a similar control strategy (see “Methods”). Figure 4 shows, for the network of S. cerevisiae described in “Methods”, the nonlinear and linear control importance rankings for two subnetworks: the giant component (Fig. 4a, c) and the subnetwork of all nodes with input connections (Fig. 4b, d). Because of the dense connectivity in the giant component subnetwork, for linear control the size of the minimum controller set is ND = 4 (Fig. 4c). For the subnetwork in (Fig. 4b, d), we have ND = 17. Note that, for nonlinear control of the subnetwork (Fig. 4b), there are several genes that have zero nonlinear control importance, i.e., external management of the activation level of any of these genes is unable to restore the network function destroyed by a tipping point transition. The striking finding is that, for linear control, these genes are exceptionally important because the probability for any of these genes to belong to a minimum controller set is disproportionally high (e.g., >80%). If one follows the prediction of the linear controllability theory to identify those nodes as important and attempts to use them as the relevant nodes for actual control of the nonlinear network, one would be disappointed as harnessing any of these genes will have no effect on the tipping-point dynamics of the network. The occurrence of such genes with zero nonlinear control importance is the result of the interplay between the Holling-type of nonlinear dynamics and the complex network structure.
Pearson correlation and cosine distance
For the five mutualistic networks (A−E) and two gene regulatory subnetworks tested so far, the correlation between nonlinear and linear control importance is negative, as shown in Figs. 2–4. To test if this holds for a broad range of empirical networks, we calculate the Pearson correlation and the cosine distance between linear and nonlinear control importance for a large number of real networks, as shown in Fig. 5. In most cases, the correlation is negative and the cosine distance is large. There are a few mutualistic networks with positive but small correlation. Out of the 43 mutualistic networks, only one has a large correlation value and a small cosine distance (one corresponding to the rightmost green circle). A peculiar feature of this network is that it has only six pollinator species and any minimum controller set in linear control contains four such species, rendering atypical this case.
Our detailed comparison between the control importance ranking in a type of biologically meaningful nonlinear control and in linear control for a large number of real pollinator–plant mutualistic networks and a gene regulatory network provides evidence that linear controllability may generate results that are drastically inconsistent with nonlinear dynamical behaviors and control of the system. In no way should this be a surprise, as the assumption of linear, time-invariant dynamics cannot be expected to hold for nonlinear dynamical networks in the real world. However, there is a recent tendency to apply the linear controllability framework to real-world nonlinear systems, such as the C. elegans connectome31 and brain networks61–64. Although the linear control framework may provide insights into nonlinear dynamical networks under some specific circumstances, controlling highly nonlinear dynamical networks is still an open problem at the present. Nonetheless, a thorough analysis of the linear controllability would give clues to its inappropriateness and likely failure in real world systems (see Supplementary Note 1 and Supplementary Figs. 1 and 2).
Discussion
It is apparent that the assumption of linear, time invariant nodal dynamics is not compatible with natural systems in the real world that are governed by nonlinear dynamical processes. Why then study the linear controllability of complex networks? There were two reasons for this. Firstly, when the development of the field of complex network had reached the point at which the problem of control emerged as a forefront problem (around 2011), to adopt linear controllability, a well established framework in traditional control engineering, to complex networks seemed to be a natural starting point. The well-developed mathematical foundation of linear control made it possible to address the effect of complex network structure on the controllability in a rigorous manner4,9, physical or biological irrelevance notwithstanding. Secondly, to study the linear controllability of complex networks is justified from the point of view of engineering, as linear dynamical systems are relevant to subfields in engineering, such as control and signal processing. That being said, the applicability of the linear controllability to real physical, chemical, and biological systems is fundamentally limited because of the ubiquity of nonlinear dynamics in natural systems—a well accepted fact, thanks to more than four decades of extensive and intensive study of nonlinear dynamics and chaos theory. It is imperative and a common sense understanding that the linear controllability of complex networks not be overemphasized and its importance and significance not be overstated.
Quite contrary to the common sense understanding, there are recent claims that linear network controllability is applicable to real biological systems31,61–64 for gaining new understanding. Curiosity demands a thorough reexamination of these claims. More importantly, such claims, if they are indeed unjustified but remain uncorrected, can potentially generate undesirable and negative impacts on the further development of the field of complex network control. These considerations motivated our present work.
The main question we have set out to answer is whether linear controllability is actually relevant to controlling nonlinear dynamical networks. To be able to address this question, it is necessary to have nonlinear networked systems for which a certain type of physically or biologically meaningful control can be carried out. We have identified two classes of such systems: complex pollinator–plant mutualistic networks in ecology and gene regulatory networks in systems biology. We focus on the physically significant issue of controlling tipping points, which enables the nodal importance in the control to be ranked. This is essentially a ranking associated with nonlinear control. Ignoring the nonlinear dynamics and simply using the network structure to treat it as a linear, time-invariant system enable us to calculate the minimum controller set in the linear controllability framework. Taking advantage of the exact controllability theory9, we identify a large number of equivalent configurations of the minimum controller set and find that, typically, there is a probability for almost every node to be in such a set. This probability serves as the base for ranking the nodal importance in linear controllability. The two types of control importance rankings, one nonlinear and another linear, can then be meaningfully compared. The main finding of this paper is that the nonlinear and linear rankings are characteristically different for a large number of real world mutualistic networks and the gene regulatory network of S. cerevisiae. In particular, the nonlinear control importance ranking typically exhibits a behavior that in general favors high degree nodes. However, linear ranking typically exhibits the opposite trend that favors small degree nodes. These results are evidence that linear controllability theory generates information that is not useful for nonlinear control of tipping point dynamics in complex biological networks. A quite striking finding is that, for the gene regulatory network of S. cerevisiae, there are four genes with essentially zero nonlinear control importance in the sense that managed control of any of these genes is unable to recover the system from the aftermath of a tipping point transition. However, in linear control, these four genes are far more important than other nodes in the network. Thus, for the particular gene regulatory network studied here, linear controllability absolutely has nothing to do with the actual control of the nonlinear dynamical network.
In a recent work31, it was claimed that linear structural controllability predicts neuron function in the C. elegans connectome. This real neuronal network has about 300 neurons, which contains four different types of neurons including the sensory neurons, inter-neurons, and motor neurons. A sensory neuron can generate an action potential propagating to other neurons, while an inter-neuron can receive action potentials from sensory neurons or other inter-neurons. The processes of generating and propagating action potentials are highly nonlinear. The claim of ref. 31 is thus questionable. We find that the C. elegans connectome, when artificially treated as a linear network, is uncontrollable if the control signals are to be applied to sensory neurons only. A calculation of the linear control importance reveals an approximately uniform ranking across all neurons. The surprising feature is that, on average, a muscle cell is almost twice as important as a motor neuron in terms of linear controllability, but biologically any control signal must flow from neurons to muscle cells, not in the opposite direction. Linear controllability thus yields a result that is apparently biologically meaningless. In fact, the ability to predict neuron function is based on signal propagation from some sensory to some motor neurons, which can be accomplished through random stimulation of some sensory neurons. Because of the existence of great many equivalent minimal control driver sets, which sensory neuron should be chosen to deliver a control signal is completely random. From the point of view of signal paths, there exist vastly large numbers of direct paths from the sensory to the motor neurons. Because of the approximately uniform ranking in nodal importance as a result of the existence of many equivalent minimum controller sets, linear controllability theory, when being used fairly in the sense of taking into considerations of the many controller set realizations, cannot possibly yield any path that is more special than others to uncover hidden biological functions (see Supplementary Note 1). That is, it is not necessary to use linear controllability to predict any neuron function, contradicting the claim in ref. 31. If control were to play a role in predicting some functions, it must be some kind of nonlinear control (which has not been achieved so far) due to the network dynamics’ being fundamentally nonlinear.
Is it possible to use linear controllability as a kind of centrality measure for complex networks? The answer is “it depends.” An essential requirement for such a measure is the ability to distinguish and rank the nodes in the network according to some criteria. Intuitively, one would hope that the nodes in the minimum controller set may be special and bear importance relative to other nodes. However, as demonstrated in our work, in a complex mutualistic network, the minimum controller set can be anything but unique. For a network of reasonable size, there is typically a vast number of equivalent configurations or realizations of the set, a fact that was seldom stated or studied in the existing literature of linear controllability of complex networks. We note that, besides the linear structural4 and exact9 controllability theories, there are alternative frameworks, such as the energy or linear Gramian-based controllability61. However, the Gramian matrix depends on the chosen minimum controller set and the control signal input matrix. Our finding that, for some networks, almost all nodes can be in some realizations of the minimum controller set with approximately equal probability makes it difficult to use or exploit linear controllability as a centrality measure for nodal ranking, such as network A in Fig. 2e. However, for other networks, some nodes are always or never in a driver set, which give a distribution of nodes in the minimum controller set. The distribution with respect to the topology of the network may be informative and characteristic of some empirical contexts11,60.
The type of nonlinear control exploited in this paper for comparison with linear controllability is controlled management of the aftermath of a tipping point transition to enable species recovery. While this is a special type of control, its merit is rooted in the feasibility to quantify and rank the ability of individual nodes to promote recovery of the nonlinear dynamical network, so that the node-based, nonlinear control importance can be meaningfully compared with the corresponding linear control importance. Is there a more general approach to nonlinear network control which can be used for comparison with linear network control? We do not have an answer at the present, as the collective behaviors of nonlinear dynamical networks are extremely diverse, so are the possible control strategies21,32–39. However, regardless of the type of nonlinear control, heterogeneity in the nodal importance ranking can be anticipated in general, due to the interplay between the nonlinear nodal dynamics and network structure. In contrast, as demonstrated in this paper, nodal importance ranking associated with linear controllability of complex networks exhibits a kind of heterogeneity opposite to that with nonlinear control, rendering linear controllability not useful for nonlinear dynamical networks in general.
Methods
General principle
To obtain a statistical description of the roles played by the individual nodes and compare the nodal importance for nonlinear and linear control, we seek real world systems that meet the following two criteria: (a) the underlying dynamical network is fundamentally nonlinear, for which a detailed mathematical description of the model is available, and (b) there exists an issue of practical significance, with which nonlinear control is feasible. We find that mutualistic networks with a Holling type of dynamics65,66 in ecology42–49 and gene regulatory networks with Michaelis–Menten type of dynamics in systems biology50–52 satisfy these two criteria, with respect to the significant and broadly interesting issue of controlling tipping points. The detailed models of the two types of networks are presented in Supplementary Note 3.
Nonlinear dynamical networks
We have performed calculations and analyses for a large number of real-world pollinator–plant mutualistic networks available from the Web of Life database (http://www.web-of-life.es), which were reconstructed from empirical data collected from different geographic regions across different continents and climatic zones. The results reported in the main text are from the following five representative mutualistic networks: (a) network A (NA = 38 and NP = 11 with the number of mutualistic links L = 106) from empirical data from Tenerife, Canary Islands67, (b) network B (NA = 79, NP = 25, and L = 299) from Bristol, England68, (c) network C (NA = 36, NP = 61, and L = 178) from Morant Point, Jamaica69, (d) network D (NA = 51, NP = 17, and L = 129) from Tenerife, Canary Islands, and (e) network E (NA = 55, NP = 29, and L = 145) from Garajonay, Gomera, Spain. Results from additional such networks are presented in Supplementary Figs. 6–13.
As a concrete example of gene regulatory networks, we study the transcription network of S. cerevisiae of 4441 nodes, for the representative parameter setting51 B = 1, f = 1, and h = 2. In spite of the large number of genes involved in the network, the giant connected component in which each node can reach and is reachable from others along a directed path has 60 nodes only, and the size of the component in which each and every node has at least one incoming connection is 81.
Nonlinear control importance ranking
For convenience, here we use the term “nonlinear control importance” to mean the statistical characterization of the nodal importance when carrying out a physically meaningful type of control of the nonlinear dynamical network. Especially, we focus on controlling tipping points in complex pollinator–plant mutualistic networks and gene regulatory networks.
For the mutualistic networks, a typical scenario for a tipping point to occur is when the average mutualistic strength γ0 is decreased towards zero. The tipping point occurs at a critical value , at which the abundances of all species decrease to near zero values. There is global extinction for . When γ0 is increased from a value in the extinction region (e.g., in an attempt to restore the species abundances through improvement of the environment), recovery is not possible without control. A realistic control strategy was articulated, in which the abundance of a single pollinator species is maintained at a constant value, say AS, through external means such as human management. We have observed numerically that, in the presence of control, a full recovery of all species abundances can be achieved—the phenomenon of “control enabled recovery.” For the same value of the controlled species level AS, the critical γ0 value of the recovery point depends on the particular species (node) subject to control. A smaller recovery point in γ0 thus indicates that the control is more effective, which is species dependent. The species, or nodes in the network, can then be ranked with respect to the control. This provides a way to define the nodal importance associated with control of the underlying nonlinear network. In particular, let be the system recovery point when the ith pollinator is subject to control. Choosing each and every pollinator species in turn as the controlled species, we obtain a set of values of the recovery point: . Let and be the maximum and minimum values of the set. The importance of the pollinator species i associated with control of the tipping point can then be defined as
1 |
where and the control is more effective or, equivalently, the node subject to the control is more “important” if its corresponding value of is larger.
For the gene regulatory network, decreasing the value of the bifurcation parameter C from one will result in a tipping point at which the activities of all genes suddenly collapse to near zero values. The behavior of sudden extinction at the tipping point can be harnessed by maintaining the activity level of a single active gene, e.g., the most active gene. In particular, when such control is present, the genes “die” in a benign way in that the death occurs one after another as the value of C approaches zero, effectively eliminating the tipping point. We also find that, without control, it is not possible to recover the gene activities by increasing the value of C, but a full recovery can be achieved with control. When a different gene is chosen as the controlled target, for the same level of maintained activity, the recovery point on the C-axis, denoted as Cc, is different, which provides the base to rank the “importance” of the genes with respect to control of the nonlinear network. A gene with a relatively smaller value of Cc is more important, as control targeted at it is more effective to restore the gene activities in the network.
Similar to our approach to ranking the control importance for the pollinator–plant mutualistic networks, we define the following importance measure for gene i:
2 |
where is the critical expression level to recover the whole system when the gene is subject to control, and are the maximum and minimum values of the recovery point among all the genes in the network.
Linear control importance ranking
Here, the term “linear control importance ranking” is referred to as the statistical ranking of the nodes in terms of their roles in the control of the underlying linear dynamical network. This ranking can be determined by the exact linear controllability theory9. To do so, we follow the existing studies that advocate the use of linear controllability for real world networked systems, such as those in refs. 31,61–64. That is, we completely ignore the fact that the mutualistic network system and the gene regulatory network are highly nonlinear dynamical systems and instead treat them fictitiously as linear dynamical networks. For a network of N nodes whose connecting topology is characterized by the adjacent matrix , the linear control problem is formulated according to the following standard setting of canonically linear, time-invariant dynamical system:
3 |
where x(t) ≡ (x1(t), …, xN(t))T is the state vector of the system, is the N × M input matrix (M ≤ N) that specifies the control configuration—the set of M nodes (driver nodes) to which external control signals u(t) = (u1(t), …, uM(t))T should be applied. In general, the linear networked system Eq. (3) can be controlled70 for properly chosen control vector u and for M ≥ ND, where ND is the minimum number of external signals required to fully control the network. The classic Kalman controllability rank condition22 states that, system Eq. (3) is controllable in the sense that it can be driven from any initial state to any desired final state in finite time if and only if the following N × NM controllability matrix
has full rank:
For a complex directed network, the linear structural controllability theory23 can be used to determine ND through identification of maximum matching4, the maximum set of links that do not share starting or ending nodes. A node is matched if there is a link in the maximum matching set points at it, and the directed network can be fully controlled if and only if there is a control signal on each unmatched node, so ND is simply the number of unmatched nodes in the network.
An alternative linear controllability framework, which is applicable to complex networks of arbitrary topology (e.g., directed or undirected, weighted or unweighted), is the exact controllability theory9 derived from the PBH rank condition27. In particular, the linear system Eq. (3) is fully controllable if and only if the following PBH rank condition
4 |
is met for any complex number c, where is the N × N identity matrix. For any complex network defined by the general interaction matrix , it was proven9 that the network is fully controllable if and only if each and every eigenvalue λ of satisfies Eq. (4). For a set of control input matrices , ND can be determined as ND = min{rank(B)}. An equivalent but more practically useful criterion9 is that, for a directed network, ND is nothing but the maximum geometric multiplicity μ(λi) of the eigenvalue λi of A:
5 |
where λi (i = 1, …, l ≤ N) are the distinct eigenvalues of and geometric multiplicity of λi is given by
For a directed network, the exact controllability theory gives the same value of ND as determined by the structural controllability theory. For an undirected network with arbitrary link weights, ND is determined by the maximum algebraic multiplicity (the eigenvalue degeneracy) δ(λi) of λi:
6 |
An issue of critical importance to our work but which is often ignored in the existing literature on linear network controllability is the non-uniqueness of the set of the required driver nodes. In fact, for an arbitrary network with the value of ND determined, there can be a large number of equivalent configurations of the driver node set. This can be seen from the matrix that appears in the PBH rank condition Eq. (4). When c is replaced by one of the eigenvalues of , say λi (the one with the maximum algebraic multiplicity), the matrix contains at least one dependent row. The quantity ND is nothing but the number of linearly dependent rows of . The control signals should then be applied to those nodes that correspond to the linearly dependent rows to make full rank the combined matrix in Eq. (4), as illustrated in Fig. 6 for a small network of size N = 10. The key fact is that there can be multiple but equivalent choices of the linearly dependent rows of the matrix . For the small 10 × 10 network in Fig. 6, there are 54 such choices. The ND = 5 driver nodes can then be chosen from the N′ = 9 nodes as determined by the linearly dependent rows of . When the network size N is large, the driver nodes can be chosen from N′ ≲ N nodes. Since , there can be great many distinct possibilities for choosing the set of driver nodes (the number increases faster than exponential with the network size). It is thus justified to define the probability for a node to be chosen as one of the driver nodes, so that the importance of each individual node in linear control can be determined. Specifically, the linear control importance of node i can be defined as
7 |
where F is the total number of configurations of the minimum controller sets calculated and Fi is the times that the ith node appears in these configurations. The probability thus gives the linear control importance ranking of the network, which can be meaningfully compared with the nonlinear control importance ranking.
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Supplementary information
Acknowledgements
We would like to acknowledge support from the Vannevar Bush Faculty Fellowship program sponsored by the Basic Research Office of the Assistant Secretary of Defense for Research and Engineering and funded by the Office of Naval Research through Grant no. N00014-16-1-2828.
Author contributions
Y.-C.L. conceived the project. J.J. performed computations and analysis. Both analyzed data. Y.-C.L. wrote the paper with help from J.J.
Data availability
All relevant data are available from the authors upon request.
Code availability
All relevant computer codes are available from the authors upon request.
Competing interests
The authors declare no competing interests.
Footnotes
Peer review information: Nature Communications thanks the anonymous reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary Information accompanies this paper at 10.1038/s41467-019-11822-5.
References
- 1.Ott E, Grebogi C, Yorke JA. Controlling chaos. Phys. Rev. Lett. 1990;64:1196–1199. doi: 10.1103/PhysRevLett.64.1196. [DOI] [PubMed] [Google Scholar]
- 2.Lombardi A, Hörnquist M. Controllability analysis of networks. Phys. Rev. E. 2007;75:056110. doi: 10.1103/PhysRevE.75.056110. [DOI] [PubMed] [Google Scholar]
- 3.Rahmani A, Ji M, Mesbahi M, Egerstedt M. Controllability of multi-agent systems from a graph-theoretic perspective. SIAM J. Control Optim. 2009;48:162–186. doi: 10.1137/060674909. [DOI] [Google Scholar]
- 4.Liu Y-Y, Slotine J-J, Barabási A-L. Controllability of complex networks. Nature. 2011;473:167–173. doi: 10.1038/nature10011. [DOI] [PubMed] [Google Scholar]
- 5.Wang W-X, Ni X, Lai Y-C, Grebogi C. Optimizing controllability of complex networks by minimum structural perturbations. Phys. Rev. E. 2012;85:026115. doi: 10.1103/PhysRevE.85.026115. [DOI] [PubMed] [Google Scholar]
- 6.Nacher JC, Akutsu T. Dominating scale-free networks with variable scaling exponent: heterogeneous networks are not difficult to control. New J. Phys. 2012;14:073005. doi: 10.1088/1367-2630/14/7/073005. [DOI] [Google Scholar]
- 7.Yan G, Ren J, Lai Y-C, Lai C-H, Li B. Controlling complex networks: How much energy is needed? Phys. Rev. Lett. 2012;108:218703. doi: 10.1103/PhysRevLett.108.218703. [DOI] [PubMed] [Google Scholar]
- 8.Nepusz T, Vicsek T. Controlling edge dynamics in complex networks. Nat. Phys. 2012;8:568–573. doi: 10.1038/nphys2327. [DOI] [Google Scholar]
- 9.Yuan Z, Zhao C, Di Z, Wang W-X, Lai Y-C. Exact controllability of complex networks. Nat. Commun. 2013;4:2447. doi: 10.1038/ncomms3447. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Menichetti G, Dall’Asta L, Bianconi G. Network controllability is determined by the density of low in-degree and out-degree nodes. Phys. Rev. Lett. 2014;113:078701. doi: 10.1103/PhysRevLett.113.078701. [DOI] [PubMed] [Google Scholar]
- 11.Ruths J, Ruths D. Control profiles of complex networks. Science. 2014;343:1373–1376. doi: 10.1126/science.1242063. [DOI] [PubMed] [Google Scholar]
- 12.Wuchty S. Controllability in protein interaction networks. Proc. Natl Acad. Sci. USA. 2014;111:7156–7160. doi: 10.1073/pnas.1311231111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Yuan Z-Z, Zhao C, Wang W-X, Di Z-R, Lai Y-C. Exact controllability of multiplex networks. New J. Phys. 2014;16:103036. doi: 10.1088/1367-2630/16/10/103036. [DOI] [Google Scholar]
- 14.Whalen AJ, Brennan SN, Sauer TD, Schiff SJ. Observability and controllability of nonlinear networks: The role of symmetry. Phys. Rev. X. 2015;5:011005. doi: 10.1103/PhysRevX.5.011005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Nacher JC, Akutsu T. Structurally robust control of complex networks. Phys. Rev. E. 2015;91:012826. doi: 10.1103/PhysRevE.91.012826. [DOI] [PubMed] [Google Scholar]
- 16.Summers TH, Cortesi FL, Lygeros J. On submodularity and controllability in complex dynamical networks. IEEE Trans. Control Netw. Syst. 2015;3:91–101. doi: 10.1109/TCNS.2015.2453711. [DOI] [Google Scholar]
- 17.Iudice FL, Garofalo F, Sorrentino F. Structural permeability of complex networks to control signals. Nat. Commun. 2015;6:8349. doi: 10.1038/ncomms9349. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Chen Y-Z, Wang L-Z, Wang W-X, Lai Y-C. Energy scaling and reduction in controlling complex networks. R. Soc. Open Sci. 2016;3:160064. doi: 10.1098/rsos.160064. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Wang L-Z, Chen Y-Z, Wang W-X, Lai Y-C. Physical controllability of complex networks. Sci. Rep. 2017;7:40198. doi: 10.1038/srep40198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Klickstein I, Shirin A, Sorrentino F. Energy scaling of targeted optimal control of complex networks. Nat. Commun. 2017;8:15145. doi: 10.1038/ncomms15145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Klickstein I, Shirin A, Sorrentino F. Locally optimal control of complex networks. Phys. Rev. Lett. 2017;119:268301. doi: 10.1103/PhysRevLett.119.268301. [DOI] [PubMed] [Google Scholar]
- 22.Kalman RE. Mathematical description of linear dynamical systems. J. Soc. Ind. Appl. Math. Ser. A. 1963;1:152–192. doi: 10.1137/0301010. [DOI] [Google Scholar]
- 23.Lin C-T. Structural controllability. IEEE Trans. Autom. Control. 1974;19:201–208. doi: 10.1109/TAC.1974.1100557. [DOI] [Google Scholar]
- 24.Hopcroft JE, Karp RM. An n5/2 algorithm for maximum matchings in bipartite graphs. SIAM J. Comput. 1973;2:225–231. doi: 10.1137/0202019. [DOI] [Google Scholar]
- 25.Zhou, H.-J. & Ou-Yang, Z.-C. Maximum matching on random graphs. arXiv:cond-mat/0309348 (2003).
- 26.Zdeborová L, Mézard M. The number of matchings in random graphs. J. Stat. Mech. 2006;5:05003. doi: 10.1088/1742-5468/2006/05/P05003. [DOI] [Google Scholar]
- 27.Hautus MLJ. Controllability and observability conditions of linear autonomous systems. Ned. Akad. Wet. Proc. Ser. A. 1969;72:443–448. [Google Scholar]
- 28.Liu Y-Y, Barabási A-L. Control principles of complex systems. Rev. Mod. Phys. 2016;88:035006. doi: 10.1103/RevModPhys.88.035006. [DOI] [Google Scholar]
- 29.Albert R, Baillieul J, Motter AE. Introduction to the special issue on approaches to control biological and biologically inspired networks. IEEE Trans. Control Netw. Syst. 2018;5:690–693. doi: 10.1109/TCNS.2018.2836303. [DOI] [Google Scholar]
- 30.Nijmeijer, H. & Van der Schaft, A. Nonlinear Dynamical Control Systems, 1st edn (Springer, 1990).
- 31.Yan G, et al. Network control principles predict neuron function in the Caenorhabditis elegans connectome. Nature. 2017;550:519. doi: 10.1038/nature24056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Wang XF, Chen G. Pinning control of scale-free dynamical networks. Physica A. 2002;310:521–531. doi: 10.1016/S0378-4371(02)00772-0. [DOI] [Google Scholar]
- 33.Li X, Wang XF, Chen G. Pinning a complex dynamical network to its equilibrium. IEEE Trans. Circuits Syst. I. 2004;51:2074–2087. doi: 10.1109/TCSI.2004.835655. [DOI] [Google Scholar]
- 34.Sorrentino F, di Bernardo M, Garofalo F, Chen G. Controllability of complex networks via pinning. Phys. Rev. E. 2007;75:046103. doi: 10.1103/PhysRevE.75.046103. [DOI] [PubMed] [Google Scholar]
- 35.Yu W, Chen G, Lü J. On pinning synchronization of complex dynamical networks. Automatica. 2009;45:429–435. doi: 10.1016/j.automatica.2008.07.016. [DOI] [Google Scholar]
- 36.Fiedler B, Mochizuki A, Kurosawa G, Saito D. Dynamics and control at feedback vertex sets. I: Informative and determining nodes in regulatory networks. J. Dyn. Differ. Eq. 2013;25:563–604. doi: 10.1007/s10884-013-9312-7. [DOI] [PubMed] [Google Scholar]
- 37.Mochizuki A, Fiedler B, Kurosawa G, Saito D. Dynamics and control at feedback vertex sets. II: a faithful monitor to determine the diversity of molecular activities in regulatory networks. J. Theor. Biol. 2013;335:130–146. doi: 10.1016/j.jtbi.2013.06.009. [DOI] [PubMed] [Google Scholar]
- 38.Zañudo JGT, Yang G, Albert R. Structure-based control of complex networks with nonlinear dynamics. Proc. Natl Acad. Sci. USA. 2017;114:7234–7239. doi: 10.1073/pnas.1617387114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Wang L-Z, et al. A geometrical approach to control and controllability of nonlinear dynamical networks. Nat. Commun. 2016;7:11323. doi: 10.1038/ncomms11323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Sun Y-Z, Leng S-Y, Lai Y-C, Grebogi C, Lin W. Closed-loop control of complex networks: a trade-off between time and energy. Phys. Rev. Lett. 2017;119:198301. doi: 10.1103/PhysRevLett.119.198301. [DOI] [PubMed] [Google Scholar]
- 41.Gray R, Franci A, Srivastava V, Leonard NE. Multiagent decision-making dynamics inspired by honeybees. IEEE Trans. Control Network Syst. 2018;5:793–806. doi: 10.1109/TCNS.2018.2796301. [DOI] [Google Scholar]
- 42.Bascompte J, Jordano P, Melián CJ, Olesen JM. The nested assembly of plant–animal mutualistic networks. Proc. Natl Acad. Sci. USA. 2003;100:9383–9387. doi: 10.1073/pnas.1633576100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Guimaraes PR, Jordano P, Thompson JN. Evolution and coevolution in mutualistic networks. Ecol. Lett. 2011;14:877–885. doi: 10.1111/j.1461-0248.2011.01649.x. [DOI] [PubMed] [Google Scholar]
- 44.Nuismer SL, Jordano P, Bascompte J. Coevolution and the architecture of mutualistic networks. Evolution. 2013;67:338–354. doi: 10.1111/j.1558-5646.2012.01801.x. [DOI] [PubMed] [Google Scholar]
- 45.Lever JJ, Nes EH, Scheffer M, Bascompte J. The sudden collapse of pollinator communities. Ecol. Lett. 2014;17:350–359. doi: 10.1111/ele.12236. [DOI] [PubMed] [Google Scholar]
- 46.Rohr RP, Saavedra S, Bascompte J. On the structural stability of mutualistic systems. Science. 2014;345:1253497. doi: 10.1126/science.1253497. [DOI] [PubMed] [Google Scholar]
- 47.Dakos V, Bascompte J. Critical slowing down as early warning for the onset of collapse in mutualistic communities. Proc. Natl Acad. Sci. USA. 2014;111:17546–17551. doi: 10.1073/pnas.1406326111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Guimaraes PR, Pires MM, Jordano P, Bascompte J, Thompson JN. Indirect effects drive coevolution in mutualistic networks. Nature. 2017;550:511–514. doi: 10.1038/nature24273. [DOI] [PubMed] [Google Scholar]
- 49.Jiang J, et al. Predicting tipping points in mutualistic networks through dimension reduction. Proc. Natl Acad. Sci. USA. 2018;115:E639–E647. doi: 10.1073/pnas.1714958115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Alon, U. An Introduction to Systems Biology: Design Principles of Biological Circuits (CRC Press, 2006).
- 51.Balaji S, Babu MM, Iyer LM, Luscombe NM, Aravind L. Comprehensive analysis of combinatorial regulation using the transcriptional regulatory network of yeast. J. Mol. Biol. 2006;360:213–227. doi: 10.1016/j.jmb.2006.04.029. [DOI] [PubMed] [Google Scholar]
- 52.Gao J, Barzel B, Barabási A-L. Universal resilience patterns in complex networks. Nature. 2016;530:307. doi: 10.1038/nature16948. [DOI] [PubMed] [Google Scholar]
- 53.Scheffer M, et al. Early-warning signals for critical transitions. Nature. 2009;461:53–59. doi: 10.1038/nature08227. [DOI] [PubMed] [Google Scholar]
- 54.Scheffer M. Complex systems: foreseeing tipping points. Nature. 2010;467:411–412. doi: 10.1038/467411a. [DOI] [PubMed] [Google Scholar]
- 55.Wysham DB, Hastings A. Regime shifts in ecological systems can occur with no warning. Ecol. Lett. 2010;13:464–472. doi: 10.1111/j.1461-0248.2010.01439.x. [DOI] [PubMed] [Google Scholar]
- 56.Drake JM, Griffen BD. Early warning signals of extinction in deteriorating environments. Nature. 2010;467:456–459. doi: 10.1038/nature09389. [DOI] [PubMed] [Google Scholar]
- 57.Dai L, Vorselen D, Korolev KS, Gore J. Generic indicators for loss of resilience before a tipping point leading to population collapse. Science. 2012;336:1175–1177. doi: 10.1126/science.1219805. [DOI] [PubMed] [Google Scholar]
- 58.Boettiger C, Hastings A. Tipping points: from patterns to predictions. Nature. 2013;493:157–158. doi: 10.1038/493157a. [DOI] [PubMed] [Google Scholar]
- 59.Tylianakis JM, Coux C. Tipping points in ecological networks. Trends Plant Sci. 2014;19:281–283. doi: 10.1016/j.tplants.2014.03.006. [DOI] [PubMed] [Google Scholar]
- 60.Campbell C, et al. Correlations in the degeneracy of structurally control lable topologies for networks. Sci. Rep. 2017;7:46251. doi: 10.1038/srep46251. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Gu S, et al. Controllability of structural brain networks. Nat. Commun. 2015;6:8414. doi: 10.1038/ncomms9414. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Muldoon SF, et al. Stimulation-based control of dynamic brain networks. PLoS Comput. Biol. 2016;12:e1005076. doi: 10.1371/journal.pcbi.1005076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Tang E, et al. Developmental increases in white matter network controllability support a growing diversity of brain dynamics. Nat. Commun. 2017;8:1252. doi: 10.1038/s41467-017-01254-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Tang E, Bassett DS. Colloquium: control of dynamics in brain networks. Rev. Mod. Phys. 2018;90:031003. doi: 10.1103/RevModPhys.90.031003. [DOI] [Google Scholar]
- 65.Holling CS. Some characteristics of simple types of predation and parasitism. Can. Entomol. 1959;91:385–398. doi: 10.4039/Ent91385-7. [DOI] [Google Scholar]
- 66.Holling CS. Resilience and stability of ecological systems. Annu. Rev. Ecol. Syst. 1973;4:1–23. doi: 10.1146/annurev.es.04.110173.000245. [DOI] [Google Scholar]
- 67.Dupont YL, Hansen DM, Olesen JM. Structure of a plant–flower-visitor network in the high-altitude sub-alpine desert of Tenerife, Canary Islands. Ecography. 2003;26:301–310. doi: 10.1034/j.1600-0587.2003.03443.x. [DOI] [Google Scholar]
- 68.Memmott J. The structure of a plant–pollinator food web. Ecol. Lett. 1999;2:276–280. doi: 10.1046/j.1461-0248.1999.00087.x. [DOI] [PubMed] [Google Scholar]
- 69.Percival M. Floral ecology of coastal scrub in southeast jamaica. Biotropica. 1974;6:104–129. doi: 10.2307/2989824. [DOI] [Google Scholar]
- 70.Rugh WJ. Linear Systems Theory. 2nd edn. New Jersey: Prentice-Hall; 1996. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All relevant data are available from the authors upon request.
All relevant computer codes are available from the authors upon request.