Abstract
Interacting dynamical systems are widespread in nature. The influence that one such system exerts on another is described by a coupling function; and the coupling functions extracted from the time-series of interacting dynamical systems are often found to be time-varying. Although much effort has been devoted to the analysis of coupling functions, the influence of time-variability on the associated dynamics remains largely unexplored. Motivated especially by coupling functions in biology, including the cardiorespiratory and neural delta-alpha coupling functions, this paper offers a contribution to the understanding of effects due to time-varying interactions. Through both numerics and mathematically rigorous theoretical consideration, we show that for time-variable coupling functions with time-independent net coupling strength, transitions into and out of phase- synchronization can occur, even though the frozen coupling functions determine phase-synchronization solely by virtue of their net coupling strength. Thus the information about interactions provided by the shape of coupling functions plays a greater role in determining behaviour when these coupling functions are time-variable.
This article is part of the theme issue ‘Coupling functions: dynamical interaction mechanisms in the physical, biological and social sciences’.
Keywords: coupling functions, coupled oscillators, interactions, dynamical systems
1. Introduction
Many dynamical systems, both natural and man-made, are composed of interacting parts. Examples include Josephson junctions [1,2], neuronal networks [3–5], the cardiorespiratory system [6–8], cardiorespiratory–brain interactions [9–12], and systems occurring in social sciences [13,14], communications [15,16] and chemistry [17–19]. Such systems often have external influences leading to time-variability in their mathematical description, e.g. time-varying frequency or a time-varying form of coupling function [20–24]. Dynamical systems whose evolution law is time-dependent, as opposed to temporally homogeneous, are said to be non-autonomous [25].
In a differential equation or stochastic differential equation describing a system of interacting components, the terms on the right-hand side arising from the interactions between the components are referred to as coupling functions. Coupling functions can be reconstructed from time series recorded from the interacting components, as a result of which one can obtain information about the interactions. For example, from cardiac and respiratory time series one can obtain the phase at which the cardiac beat is most susceptible to respiratory drive, from which one can extract the respiratory-related component of heart rate variability [26]. Another example is that general anaesthesia can lead to important changes in the forms of coupling function between brain waves [11]. Several studies show that the possession of time-varying coupling functions typifies the behaviour of interacting systems in real situations [27–29], and that such time-variations can play a major role in the dynamics [30–32].
The coupling function can be described by its net coupling strength, and its form [33]. By the net coupling strength, we mean the norm of the coupling function; its form, on the other hand, defines the functional law specifying the interactions, and it thereby introduces a new dimension and perspective [28,29,33]. Thus the net coupling strength quantifies only one aspect of the coupling. Many recent studies of interactions are designed for, and focus exclusively on, the effect of the net coupling strength of interacting systems. This approach is often found in information-theoretic methods for the detection of directionality and causality of influence between time-series including, for example, methods for Granger causality, transfer entropy, mutual information and symbolic transfer entropy [34–37]. From this perspective, time-variability of coupling strength was observed in cardiorespiratory interaction in [36].
In this paper, we extend [23] by studying theoretically the effects of time-varying coupling functions that induce a transition to synchronization, while keeping the net coupling strength constant. In particular, we will analyse numerically a model of two coupled oscillators with time-varying coupling functions while maintaining a constant net coupling strength. We will thus obtain information about synchronization epochs and phase slips in terms of the dynamics of the phase difference of the oscillators. Then we will set out theoretical considerations and theorems for quantifying these phenomena. For all of this, we will consider unidirectional coupling, i.e. the master-slave configuration. We will demonstrate that fixing a constant value for the net coupling strength does not necessarily enable one to predict whether or not synchronization transitions will occur, even though for the same set-up in the absence of time-variability, the value of the net coupling strength would have been sufficient to determine synchronization.
The paper is organized as follows. To set the context and to provide some motivation for the study, §2 describes an experiment on the time-variability of biological interactions. Section 3 presents a typical model of two coupled phase oscillators. Some basic concepts regarding coupling functions are presented in §4. Section 5 is devoted to the numerical simulations of the model. Theoretical consideration of the results, together with theorems formalizing these considerations, and their proofs, are given in §6. Discussion of connections to related work is presented in §7. Finally, we draw conclusions in §8.
2. Motivation from time-variability of biological interactions
Much of the motivation for studying time-varying coupling functions has come from biology. In particular, numerous situations arise where there are inherent time-variations, not only in the internal parameters and the quantitative characteristics of components of the system but also in the physical laws and functions that define the interactions between these components.
For example, the coupling functions of cardiorespiratory interactions were found to vary in time in [27], where it was shown that not only the coupling strength but also the form of the coupling function varies over time. Similarly, human delta-alpha neural coupling functions in the resting state also vary in time [28]. To illustrate, we now consider an example of time-varying cardiorespiratory and delta-alpha neural coupling functions, calculated using simultaneous recordings from the same subject. More specifically, the cardiorespiratory interactions were analysed from an ECG signal and a respiration-belt signal, while the delta and alpha brainwaves were extracted from an EEG signal, measured on the left forehead (equivalent to an FP1 electrode in the 10-20 EEG standard). These particular relationships were chosen for analysis, as they had previously been found significant when tested against surrogates. During recordings, the subject was resting in a supine position. The data are drawn from an earlier study of the effects of general anaesthesia on physiological oscillations [11]. Here, in order to demonstrate the time-variability properties, we consider data from only one of the earlier subjects.
Coupling functions were extracted from the phase dynamics using the dynamical Bayesian inference method [27,38,39], which involves the use of a sliding time-window to reveal the time-dependence. It was assumed that within each time-window, the phases ϕ1(t) and ϕ2(t) of the two interacting oscillators are governed by coupled differential equations of the general form (3.3, see §3 below) with the addition of Gaussian white noise, i.e.
and
where ωi and ϕi are the natural frequency and phase of oscillator i, ξi(t) is Gaussian white noise, and qi is the coupling function describing the influence of oscillator j on the phase of oscillator i. First, from the recorded time-series the phases of the cardiac ϕh, the respiratory ϕr, the delta brainwave ϕδ and the alpha brainwave ϕα oscillations were extracted using the Hilbert protophase-to-phase procedure [40]. The coupling functions were then inferred within each time-window up to a second order of Fourier expansion on the 2-torus. In this way, we inferred the time-evolving cardiorespiratory coupling function qh(ϕr, ϕh) for the influence of the respiration on the heart, and the time-evolving neural cross-frequency coupling function qα(ϕδ, ϕα) for the influence of δ brainwaves on α brainwaves.
Figure 1 shows the results for cardiorespiratory interactions in (a–c) and for interactions in the neural delta and alpha waves in (d–f ). We show the time-variations in quantitative measures of the coupling functions (figure 1a), namely the coupling strength ε(t), and the similarity index ρ(t)∈[ − 1, 1] between the form of the coupling function and the form of the time-averaged coupling function. The coupling strength ε(t) is the norm (with respect to L2) of the coupling function at time t, as described in §4a; the similarity index ρ(t) [26,29,33,41] is the cosine similarity (again with respect to L2) between the coupling function at time t and the time-averaged coupling function. Note that both ε(t) and ρ(t) are time-varying, but they often vary differently, reinforcing the argument that the strength and form of the coupling represent two separate dimensions of the coupling function, often carrying different information about the interactions. By observing the time-variability of the cardiorespiratory coupling functions across different time windows (figure 1b) it is evident that there are smaller or larger variations in the form of the function when compared, for example, to the time-averaged coupling function (figure 1c).
Similarly, the delta-alpha neural coupling functions exhibit variations in form over time. Namely, the quantitative measures ε(t) and ρ(t) in figure 1d show different and even greater variability. The coupling functions calculated in different windows (figure 1e) vary abruptly and are not very similar to the time-averaged coupling function (figure 1f ). It seems possible that even greater variations of the separate coupling functions may have occurred within individual time windows, but that these variations were largely averaged out.
Comparing the cardiorespiratory and neural interactions shows that the former exhibits the more stable and invariant form, in that it varies less between different time windows, arguably implying greater determinism as described in the time-averaged coupling function. On the other hand, the neural coupling functions vary more and are individually less similar to the time-averaged coupling function. (These findings are consistent with previous results for the resting state in the multi-subject studies [11]). Common to both of the interactions is that they are time-varying, to a lesser or greater extent, and that the coupling strength and the form of the function often vary over time quite differently from each other. Hence, these characteristics can have correspondingly different effects on the outcome and the possible transitions caused by the interactions—a phenomenon worth exploring further theoretically.
3. Model
Rhythmic phenomena can be described by a stable periodic dynamics. Consider two weakly coupled oscillators described by the dynamical system
3.1 |
where f1,2 represent the unperturbed dynamics of the first and second oscillators, g1,2 represent the effects of one oscillator on the other and ε is a small parameter which represents the strength of the perturbations. We assume that fi has an exponentially stable limit cycle γi of period Ti for i = 1, 2; and that the phase of the ith oscillator ϕi is defined on the limit cycle γi in such a way that it grows monotonically with time, satisfying the phase equation
3.2 |
for i = 1, 2, where ωi = 2π/Ti is the natural frequency of the ith oscillator.
One can apply the phase reduction method to reduce the dynamics of the high-dimensional system equation (3.1) to lower-dimensional phase equations [42–46]. Small external perturbations to each oscillator xi, such as its interaction with the other oscillator xj, may force xi off the limit cycle γi of fi. Therefore, for phase reduction of equation (3.1), one needs to define the phases outside the limit cycles. Using the concept of ‘isochrons’ [43,47,48] which are the level sets of phases, one can extend the definitions of the phases ϕ1 and ϕ2 of the oscillators to the whole basins of the corresponding limit cycles γ1 and γ2 in such a way that they rotate uniformly according to equation (3.2), not only on the cycle, but also in their corresponding neighbourhoods. With this, the model (3.2) of interacting oscillators can be reduced to a phase model taking the form
3.3 |
where the functions q1(ϕ1, ϕ2) and q2(ϕ1, ϕ2) are 2π-periodic with respect to their arguments. We refer to these functions q1 and q2 as the coupling functions for the phase-reduced model (3.3). When considering time-variable interactions, the coupling functions will be time-dependent functions q1t(ϕ1, ϕ2) and q2t(ϕ1, ϕ2).
In what follows, we will specifically consider unidirectional coupling, meaning that q1 = 0. But first, before we carry out our numerical and theoretical analysis of the model, we will in the next section introduce the concepts of net coupling strength and synchronization transitions.
4. Basic concepts
(a). Net coupling strength
Because each coupling function q is 2π-periodic in both arguments, we can identify it on a torus of the form , where . Hence, the torus can be identified by the square [ − π, π]2 or [0, 2π]2. We define the inner product in [49] by
If the coupling function q is smooth, then we can decompose q into a Fourier series on the square [ − π, π]2, using Parseval's identity [49] to compute the norm in terms of Fourier coefficients.
In applications, the coupling functions can be well approximated by using a finite number of Fourier terms. Each coupling function is typically of the diffusive type
4.1 |
where c1(t) and c2(t) are time-varying parameters. With the second expression for qt in equation (4.1) being a finite sum of Fourier components, Parseval's identity gives
4.2 |
This norm provides a quantitative measure of the net coupling strength between the linked systems. For any specified (time-dependent) form of coupling function, this norm represents the scaling parameter of the coupling function.
(b). Intermittent synchronization
A mark of the level of adjustment of rhythmic behaviour due to interaction is whether it is sufficient to cause synchronization of the oscillators [42]. For time-variable coupling functions, the time-variability can cause transitions into or out of synchronization, i.e. it can cause there to be both epochs of synchrony during which the phase difference remains nearly constant and epochs of phase slipping during which the phase difference changes rapidly. An example to illustrate these behaviours is shown in figures 2 and 3 which plot time series of the phase difference between two coupled oscillators. We will sometimes refer to this behaviour as intermittent synchronization. We emphasize that these transitions into and out of synchronization are not the same as the intermittency of apparent synchronization often occurring in autonomous systems with parameters close to or on the boundary of a region of synchronization or chaos [42].
Transitions into and out of synchronization occurring due to time-variability of the coupling functions in equation (3.3) correspond physically to dynamical consequences of the openness of a coupled-oscillator system to time-variable external influences. An example of intermittent synchronization induced by such non-autonomicity of models of open systems is the focus of this present paper. It is also known that for closed systems, transitions into or out of synchronization can occur due to the time-evolution of slow variables within the system representing internal adaptation based on the current or previous state of the oscillators, as exemplified in [50] for a large network with slowly adaptive coupling via time-delays. The intermittency in this latter case is similar to intermittency induced by non-autonomicity, but represents a very different physical cause of the exhibited dynamical behaviour.
5. Numerics
Our main goal is to establish numerically the effect of time-variation in the coupling functions between two-phase oscillators. Our focus will be on the case where the coupling exists in one direction only, sometimes known as unidirectional coupling, or the master-slave configuration. We choose this configuration because it provides the clearest case where time-varying coupling functions can lead to synchrony and phase slips, while the net coupling strength remains constant.
Consider the master-slave configuration
5.1 |
where the coupling function qt(ϕ1, ϕ2) is equal to the expression in equation (4.1) and ω1, ω2 are the natural frequencies of the oscillators. The presence of the coupling term qt(ϕ1, ϕ2) could cause the fundamental frequency of the driven oscillator (whose phase is represented by ϕ2(t)) to become different from its natural frequency ω2, and to become time-dependent as qt varies over time.
From the previous section, the net coupling strength of the master-slave configuration qt in equation (5.1) can be defined as
where c1(t) and c2(t) are the time-varying coupling parameters of the coupling functions [23]. In the autonomous case, where the coupling parameters c1 and c2 are constant, if the net coupling strength then the oscillators will synchronize [23]. In the present study, unlike the autonomous case, the oscillators are not guaranteed to be synchronized all of the time. With constant net coupling strength , we will show that the oscillators can undergo transitions between synchrony and phase slipping.
To analyse whether the two oscillators synchronize or not, we consider the phase difference
between them. From equation (5.1) with qt as in equation (4.1), the phase difference ψ(t) obeys the equation
5.2 |
where Ω = ω1 − ω2 is the natural frequency difference (sometimes called the frequency mismatch, or detuning) between the oscillators. For numerical investigation of synchrony in our coupled oscillator model, we simulate the differential equation (5.2), taking the time-dependent coupling parameters c1(t) and c2(t) as
5.3 |
where f(t) is a T-periodic function defined by
5.4 |
with k > ε≥0, and with the values of ε, (T/2 − T1)/T and (T − T2)/T being small. The expression for the function in equation (5.4) has been chosen to exhibit the existence of synchrony epochs and phase slips in the dynamics of the phase difference. Note that, from equation (5.3), we obtain
showing that the net coupling strength is constant for all time.
In all our simulations, the length of the simulated time series is set to 5000 s and the sampling step is set as h = 0.001 s, and we use the following parameter values: Ω = 1.08 rad s−1, T = 1000 s, T1 = 490 s, T2 = 990 s. We will consider different possible values for the remaining parameters k, ε and α. We simulate equation (5.2) via its simplified form equation (6.1) with φ(t): = f(t)t, taking the initial value of the phase difference as ψ(0) = 0.
Figure 2 presents a time series of the phase difference ψ(t) (red) and the function f(t) (blue), and the zoomed figure (top-left inset) shows the transition to synchrony. Further numerical simulations were carried out using different parameter values, for which results are shown in figure 3. For both figures, the net coupling strength α is constant over time, with being greater than the magnitude of the natural frequency difference Ω.
In both figures 2 and 3a–d, we see intermittency of synchronization, similar to that observed experimentally and numerically in [7,20,24,27,51]: there is an alternation between synchronized epochs (plateaux) and phase slips (rapid increases) in ψ(t). While φ(t): = f(t)t is slowly varying—i.e. on the intervals [nT, nT + T1] where f(t) has small magnitude—we have phase synchrony. But while φ(t) has rapid angular velocity—i.e. on the intervals where f(t) is large—we have unbounded slipping of the phase difference.
Given that the net coupling strength between the systems was invariant, it is evident that the continuing alternation between synchronization epochs and phase slips was just due to time-variation in the coupling function. This shows that the net coupling strength does not in itself give us enough information to characterize the interactions of the oscillators. Based on the numerics implemented in this section, we can generalize the choices of the coupling parameters c1(t) and c2(t) in order to analyse the effects of the time-varying coupling functions.
6. Explanation and generalization of numerical findings
Consider equation (5.3) with a general function φ(t) in place of f(t)t. Based on its behaviour, we determine the dynamics of the phase difference ψ(t) of the oscillators. Whether they exhibit synchronous and/or asynchronous states hinges on three considerations:
-
(i)
If φ(t) is a slowly varying function, i.e. is small, then the phase difference ψ(t) corresponds to a synchronous state for a finite time T1: for arbitrarily large T1 we can take sufficiently small that the solution will remain in an arbitrarily small ball. See theorem 6.1 and corollary 6.2 for the proof.
-
(ii)
If the phase shift φ(t) is fast-winding round the circle (i.e. its unwrapped phase is rapidly growing) then, using an averaging argument, we can show that the dynamics induces phase slips. See theorem 6.3. The averaging argument essentially means that due to the fast timescale of φ, the oscillators ϕ1 and ϕ2 feel no interactions and they rotate independently at their own natural angular velocities.
-
(iii)
If the function φ(t) has both the behaviours stated in (i) and (ii), then the coupled oscillators will synchronize when φ proceeds on the slow timescale, but they will exhibit phase drifts when φ proceeds on the fast timescale. Hence, the dynamics of the phase difference in equation (6.1) subject to a function φ(t) with both slow variation and fast winding induces both synchronous and asynchronous states.
We now provide rigorous theorems to justify these three considerations. Before doing so, however, we briefly discuss the setup. The phase difference ψ(t) = ϕ1(t) − ϕ2(t) obeys equation (5.2). We take the parameters c1(t) and c2(t) in equation (5.2) to be of the form
for some constant α > 0 and C1 function . The constant α corresponds to the net coupling strength.
Equation (5.2) can be written as
6.1 |
Note that equation (6.1) is a non-autonomous system, and we can consider the effect of both slow variation and fast variation of φ(t). Introducing a new variable η(t) = ψ(t) + φ(t), the dynamics of equation (6.1) is then equivalent to the dynamics of the equation
6.2 |
In the case that , let η* and η** be respectively the stable and unstable fixed points of the equation
6.3 |
The following theorems address the effect of the time-varying coupling functions, while the net coupling strength is invariant. First, in Theorem 6.1 and its subsequent corollary, we consider the synchronization exhibited for slowly varying φ.
Theorem 6.1. —
Assume . For all and , there exist ε0, T0 > 0 such that for all t > T0, if on [0, t] then the solution ψ of equation (6.1) with ψ(0) = η0 − φ(0) satisfies for all s∈(T0, t].
Proof. —
Fix and , assuming without loss of generality that η0 lies in the arc extending anticlockwise from η** to η*, and that ). Thus the function is strictly positive on and strictly negative at . Accordingly, we can pick and let
Then we have the following:
- (i)
If on an interval [0, t], then is positive at and negative at for all s∈[0, t]. Therefore, any solution η( · ) of equation (6.2) with for some t0∈[0, t) has for all s∈(t0, t].
- (ii)
If on [0, T0], then there exists t0∈(0, T0] such that the solution η( · ) of equation (6.2) with η(0) = η0 has .
Combining these gives the result. ▪
Corollary 6.2. —
Assume . For all and there exists T0 > 0 such that for all T1 > T0, there exists ε > 0 such that if on [0, T1] then the solution ψ of equation (6.1) with ψ(0) = η0 − φ(0) satisfies for all t∈(T0, T1].
Proof. —
Take ε0 and T0 as in Theorem 6.1, and then for T1 > T0 take ). So if on [0, T1] then for all t∈[0, T1], and so we have the desired result. ▪
Now in Theorem 6.3, we consider the unbounded phase slips exhibited for fast-winding φ. The following theorem may be regarded as a kind of non-autonomous averaging principle. For a detailed exposition of averaging principles, see [52].
Theorem 6.3. —
For all there exist K1, K2 > 0 such that if φ is twice differentiable on an interval [0, t] with for all s∈[0, t], then any solution ψ of equation (6.1) has
for all s∈[0, t].
Proof. —
As in the proof of Theorem 6.1, let . First take arbitrary K1 > 0 and , and suppose that for all s∈[0, t]. Define recursively a sequence 0 = t0 < t1 < · s < tN < t by , with N being the largest possible such that tN < t. It follows in particular that . For each i < N, we have that
and therefore
6.4 Now fix any s∈(ti, ti+1). We have that s − ti < 2π/K1 and so
6.5 Also, by Taylor's theorem, we have that
for some ξ1(s)∈(ti, s). But by the mean value theorem we have that for some ξ2(s)∈(ti, ξ1(s)),
and so
6.6 Combining equations (6.4), (6.5) and (6.6), we have that
Hence, for each i ≤ N,
6.7 Now for any s∈[0, t], taking the largest i with ti ≤ s, we have
and so
6.8 Combining equations (6.7) and (6.8) gives that
for all s∈[0, t]. So now, given any choose K1, K2 sufficiently large that and . ▪
Combining theorems 6.1 and 6.3, we have that if φ has alternating epochs of slow variation and rapid oscillation, this can lead to the system (5.1) having alternating epochs of synchrony and asynchrony.
7. The results in context
There are different ways in which time-variability can enter a system, and so other forms of non-autonomous driving that give rise to intermittent synchronization have also been considered. Of particular interest has been the case where time-variability enters through modulation of the natural frequency of the driving oscillator [22,24,53]. As shown in [24,53], for fixed-frequency driving we have synchronization either all of the time or none of the time, but when the driving frequency is allowed to vary then we can have intermittent synchronization. Through the finite-time dynamical considerations of [24] to account for a free shape of variation over time, it was shown that this intermittent synchronization results overall in stability of the driven oscillations, as indicated by negativity of Lyapunov exponents; and in this manner, greater time-variability of the driving frequency increases the region of stability in parameter space. Similar results were also observed numerically for higher-dimensional oscillatory systems.
The theoretical and numerical considerations of [24] for a unidirectionally coupled pair of phase oscillators have been extended to phase-oscillator networks in [54]. The considerations of this present paper can be generalized to networks such as those considered in [55]: network structure can also have an impact on the dynamics exhibited, such as synchronization [30,56]. Network synchronization induced by sufficiently fast non-autonomous driving has been considered in [57], where the non-autonomous driving consists of rapid switching between the existence and non-existence of links between given nodes, while the dynamical interaction along existing nodes takes a specific time-independent form.
As intermittent synchronization in [24,54] led to stability, we likewise expect that the intermittent synchronization obtained in our present study leads to stability of the driven oscillations, as would be indicated by a stability analysis of the non-autonomous one-dimensional differential equation
where ϕ(t) is the phase of the driven oscillator and ϕ1(0) + ω1t is the phase of the driving oscillator.
8. Conclusion
Interacting dynamical systems can have time-varying coupling functions, where the net coupling strength depends in a number of different ways on the time, sometimes resulting in synchronization transitions. The experiments on the cardiorespiratory and neural delta-alpha coupling functions whose results are shown in figure 1, for example, illustrate the existence of time-varying functional relationships that can cause synchronization transitions.
A model of two coupled oscillators with time-evolving coupling functions has been shown to exhibit transitions to/from synchronization even when the net coupling strength remains constant. The analysis was carried out in terms of the phase difference between the oscillators. The corresponding numerical simulations show that, in the case of time-varying coupling functions, one can have sequential epochs of synchrony and asynchrony while the net coupling strength remains unchanged. Thus, by itself, the net coupling strength does not provide enough information to describe the dynamics of the interacting systems. To generalize the results, based on the model considered, we discussed three main ideas arising from the periodic function f(t). The first of these was that, when φ(t): = f(t)t varies slowly with time, the dynamics of the two coupled oscillators induces synchrony over the slow timescale. The second was that when, by contrast, φ(t) has rapid angular velocity, the oscillators do not synchronize. The third observation was the combined effect: the oscillators can exhibit sudden changes between synchrony and drifting phase difference occurring at transitions between slow variation and fast winding of φ(t). So we have transitions in exhibited behaviour due to time-variability of the coupling functions despite constant net coupling strength. This confirms that, in the time-variable setting, the net coupling strength does not give sufficient information about the interaction of the oscillators to predict their behaviour.
Note that this insufficiency of the net coupling strength as a criterion carries implications for information-theoretic methods that assess the statistical mutual dependences of signals from interacting systems [10,34–36,58,59]. The latter are statistical measures that can determine a causal relationship and the predominant direction of influence, thus measuring a directed functional connectivity. In this way, however, they usually reveal only the net coupling strength and direction, but are unable to detect variations in sub-coupling components like those used in the present study.
Acknowledgements
We are most grateful to Sam McCormack for his help with the Python code for numerical simulations and plotting for figures 2 and 3.
Data accessibility
Data used for analysis of coupling functions shown in figure 1 were collected during the project BRACCIA https://cordis.europa.eu/project/rcn/74753/factsheet/en and are available upon request to A.S. Codes used to generate data in figures 2 and 3 are also available.
Authors' contributions
T.S. conceived the ideas of the paper, and discussed rigorous mathematical formulation with T.P. Then Z.H. and J.N. provided the rigorous mathematical formulation. A.S. provided data, and initiated and supervised the work of this paper. The first draft of manuscript was provided by T.S., Z.H. and T.P. P.V.E.McC., J.N. and A.S. subsequently edited the manuscript. All authors approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Funding
The work was supported by the Engineering and Physical Sciences Research Council through grants nos EP/I00999X/1 and EP/M006298/1, by the EU's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement no. 642563, and by the Slovenian Research Agency (ARRS) programme P2-0232. Z.H. received funding from a CNPq-TWAS Postgraduate Fellowship.
References
- 1.Zhang G, Ma J, Alsaedi A, Ahmad B, Alzahrani F. 2018. Dynamical behavior and application in Josephson junction coupled by memristor. Appl. Math. Comput. 321, 290–299. ( 10.1016/j.amc.2017.10.054) [DOI] [Google Scholar]
- 2.Wiesenfeld K, Colet P, Strogatz SH. 1996. Synchronization transitions in a disordered Josephson series array. Phys. Rev. Lett. 76, 404–407. ( 10.1103/PhysRevLett.76.404) [DOI] [PubMed] [Google Scholar]
- 3.Cessac B. 2010. A view of neural networks as dynamical systems. Intern. J. Bifurc. Chaos 20, 1585–1629. ( 10.1142/S0218127410026721) [DOI] [Google Scholar]
- 4.Ma J, Mi L, Zhou P, Xu Y, Hayat T. 2017. Phase synchronization between two neurons induced by coupling of electromagnetic field. Appl. Math. Comput. 307, 321–328. ( 10.1016/j.amc.2017.03.002) [DOI] [Google Scholar]
- 5.Sun XJ, Perc M, Kurths J. 2017. Effect of partial time delays on phase synchronization in Watts-Strogatz small-world neuronal networks. Chaos 27, 053113 ( 10.1063/1.4983838) [DOI] [PubMed] [Google Scholar]
- 6.Schäfer C, Rosenblum MG, Kurths J, Abel HH. 1998. Heartbeat synchronised with ventilation. Nature 392, 239–240. ( 10.1038/32567) [DOI] [PubMed] [Google Scholar]
- 7.Stefanovska A, Haken H, McClintock PVE, Hožič M, Bajrović F, Ribarič S. 2000. Reversible transitions between synchronization states of the cardiorespiratory system. Phys. Rev. Lett. 85, 4831–4834. ( 10.1103/PhysRevLett.85.4831) [DOI] [PubMed] [Google Scholar]
- 8.Iatsenko D, Bernjak A, Stankovski T, Shiogai Y, Owen-Lynch PJ, Clarkson PBM, McClintock PVE, Stefanovska A. 2013. Evolution of cardio-respiratory interactions with age. Phil. Trans. R. Soc. A 371, 20110622 ( 10.1098/rsta.2011.0622) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Musizza B, Stefanovska A, McClintock PVE, Paluš M, Petrovčič J, Ribarič S, Bajrović FF. 2007. Interactions between cardiac, respiratory, and EEG-δ oscillations in rats during anæsthesia. J. Physiol. (London) 580, 315–326. ( 10.1113/jphysiol.2006.126748) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Faes L, Nollo G, Jurysta F, Marinazzo D. 2014. Information dynamics of brain–heart physiological networks during sleep. New J. Phys. 16, 105005 ( 10.1088/1367-2630/16/10/105005) [DOI] [Google Scholar]
- 11.Stankovski T, Petkoski S, Raeder J, Smith AF, McClintock PVE, Stefanovska A. 2016. Alterations in the coupling functions between cortical and cardio-respiratory oscillations due to anaesthesia with propofol and sevoflurane. Phil. Trans. R. Soc. A 374, 20150186 ( 10.1098/rsta.2015.0186) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Morelli MS, Greco A, Valenza G, Giannoni A, Emdin M, Scilingo EP, Vanello N. 2018. Analysis of generic coupling between EEG activity and PETCO2 in free breathing and breath-hold tasks using Maximal Information Coefficient (MIC). Sci. Rep. 8, 4492 ( 10.1038/s41598-018-22573-6) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ranganathan S, Spaiser V, Mann RP, Sumpter DJT. 2014. Bayesian dynamical systems modelling in the social sciences. PLoS ONE 9, e86468 ( 10.1371/journal.pone.0086468) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Blomqvist BRH, Mann RP, Sumpter DJT. 2018. Using Bayesian dynamical systems, model averaging and neural networks to determine interactions between socio-economic indicators. PLoS ONE 13, e0196355 ( 10.1371/journal.pone.0196355) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Stankovski T, McClintock PVE, Stefanovska A. 2014. Coupling functions enable secure communications. Phys. Rev. X 4, 011026 ( 10.1103/PhysRevX.4.011026) [DOI] [Google Scholar]
- 16.Nadzinski G, Dobrevski M, Anderson C, McClintock PVE, Stefanovska A, Stankovski M, Stankovski T. 2018. Experimental realization of the coupling function secure communications protocol and analysis of its noise robustness. IEEE Trans. Info. Forens. Secur. 13, 2591–2601. ( 10.1109/TIFS.2018.2825147) [DOI] [Google Scholar]
- 17.Kiss IZ, Rusin CG, Kori H, Hudson JL. 2007. Engineering complex dynamical structures: sequential patterns and desynchronization. Science 316, 1886–1889. ( 10.1126/science.1140858) [DOI] [PubMed] [Google Scholar]
- 18.Blaha KA, Pikovsky A, Rosenblum M, Clark MT, Rusin CG, Hudson JL. 2011. Reconstruction of two-dimensional phase dynamics from experiments on coupled oscillators. Phys. Rev. E 84, 046201 ( 10.1103/PhysRevE.84.046201) [DOI] [PubMed] [Google Scholar]
- 19.Kori H, Kuramoto Y, Jain S, Kiss IZ, Hudson JL. 2014. Clustering in globally coupled oscillators near a Hopf bifurcation: theory and experiments. Phys. Rev. E 89, 062906 ( 10.1103/PhysRevE.89.062906) [DOI] [PubMed] [Google Scholar]
- 20.Stefanovska A, Luchinsky DG, McClintock PVE. 2001. Modelling couplings among the oscillators of the cardiovascular system. Physiol. Meas. 22, 551–564. ( 10.1088/0967-3334/22/3/312) [DOI] [PubMed] [Google Scholar]
- 21.Petkoski S, Stefanovska A. 2012. Kuramoto model with time-varying parameters. Phys. Rev. E 86, 046212 ( 10.1103/PhysRevE.86.046212) [DOI] [PubMed] [Google Scholar]
- 22.Suprunenko YF, Clemson PT, Stefanovska A. 2013. Chronotaxic systems: a new class of self-sustained nonautonomous oscillators. Phys. Rev. Lett. 111, 024101 ( 10.1103/PhysRevLett.111.024101) [DOI] [PubMed] [Google Scholar]
- 23.Stankovski T. 2017. Time-varying coupling functions: dynamical inference and cause of synchronization transitions. Phys. Rev. E 95, 022206 ( 10.1103/PhysRevE.95.022206) [DOI] [PubMed] [Google Scholar]
- 24.Lucas M, Newman J, Stefanovska A. 2018. Stabilization of dynamics of oscillatory systems by nonautonomous perturbation. Phys. Rev. E 97, 042209 ( 10.1103/PhysRevE.97.042209) [DOI] [PubMed] [Google Scholar]
- 25.Kloeden PE, Rasmussen M. 2011. Nonautonomous dynamical systems. New York, NY: AMS Mathematical Surveys and Monographs. [Google Scholar]
- 26.Kralemann B, Frühwirth M, Pikovsky A, Rosenblum M, Kenner T, Schaefer J, Moser M. 2013. In vivo cardiac phase response curve elucidates human respiratory heart rate variability. Nat. Commun. 4, 2418 ( 10.1038/ncomms3418) [DOI] [PubMed] [Google Scholar]
- 27.Stankovski T, Duggento A, McClintock PVE, Stefanovska A. 2012. Inference of time-evolving coupled dynamical systems in the presence of noise. Phys. Rev. Lett. 109, 024101 ( 10.1103/PhysRevLett.109.024101) [DOI] [PubMed] [Google Scholar]
- 28.Stankovski T, Ticcinelli V, McClintock PVE, Stefanovska A. 2017. Neural cross-frequency coupling functions. Front. Syst. Neurosci. 11, 33 ( 10.3389/fnsys.2017.00033) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Ticcinelli V, Stankovski T, Iatsenko D, Bernjak A, Bradbury A, Gallagher A, Clarkson PBM, McClintock PVE, Stefanovska A. 2017. Coherence and coupling functions reveal microvascular impairment in treated hypertension. Front. Physiol. 8, 749 ( 10.3389/fphys.2017.00749) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Maia DMN, Macau EEN, Pereira T. 2016. Persistence of network synchronization under nonidentical coupling functions. SIAM J. Appl. Dyn. Syst. 15, 1563–1580. ( 10.1137/15M1049786) [DOI] [Google Scholar]
- 31.Komarov M, Pikovsky A. 2013. Multiplicity of singular synchronous states in the Kuramoto model of coupled oscillators. Phys. Rev. Lett. 111, 204101 ( 10.1103/PhysRevLett.111.204101) [DOI] [PubMed] [Google Scholar]
- 32.Chishti S, Ramaswamy R. 2018. Design strategies for generalized synchronization. Phys. Rev. E 98, 032217 ( 10.1103/PhysRevE.98.032217) [DOI] [Google Scholar]
- 33.Stankovski T, Pereira T, McClintock PVE, Stefanovska A. 2017. Coupling functions: universal insights into dynamical interaction mechanisms. Rev. Mod. Phys. 89, 045001 ( 10.1103/RevModPhys.89.045001) [DOI] [Google Scholar]
- 34.Granger CW. 1969. Investigating causal relations by econometric models and cross-spectral methods. Econ: J. Econ. Soc. 37, 424–438. ( 10.2307/1912791) [DOI] [Google Scholar]
- 35.Schreiber T. 2000. Measuring information transfer. Phys. Rev. Lett. 85, 461–464. ( 10.1103/PhysRevLett.85.461) [DOI] [PubMed] [Google Scholar]
- 36.Paluš M, Stefanovska A. 2003. Direction of coupling from phases of interacting oscillators: an information-theoretic approach. Phys. Rev. E 67, 055201 ( 10.1103/PhysRevE.67.055201) [DOI] [PubMed] [Google Scholar]
- 37.Staniek M, Lehnertz K. 2008. Symbolic transfer entropy. Phys. Rev. Lett. 100, 158101 ( 10.1103/PhysRevLett.100.158101) [DOI] [PubMed] [Google Scholar]
- 38.Smelyanskiy VN, Luchinsky DG, Stefanovska A, McClintock PVE. 2005. Inference of a nonlinear stochastic model of the cardiorespiratory interaction. Phys. Rev. Lett. 94, 098101 ( 10.1103/PhysRevLett.94.098101) [DOI] [PubMed] [Google Scholar]
- 39.Stankovski T, Duggento A, McClintock PVE, Stefanovska A. 2014. A tutorial on time-evolving dynamical Bayesian inference. Eur. Phys. J. Special Topics 223, 2685–2703. ( 10.1140/epjst/e2014-02286-7) [DOI] [Google Scholar]
- 40.Kralemann B, Cimponeriu L, Rosenblum M, Pikovsky A, Mrowka R. 2008. Phase dynamics of coupled oscillators reconstructed from data. Phys. Rev. E 77, 066205 ( 10.1103/PhysRevE.77.066205) [DOI] [PubMed] [Google Scholar]
- 41.Stankovski T, Ticcinelli V, McClintock PVE, Stefanovska A. 2015. Coupling functions in networks of oscillators. New J. Phys. 17, 035002 ( 10.1088/1367-2630/17/3/035002) [DOI] [Google Scholar]
- 42.Pikovsky A, Rosenblum M, Kurths J. 2001. Synchronization: a universal concept in nonlinear sciences. Cambridge, UK: Cambridge University Press. [Google Scholar]
- 43.Kuramoto Y. 1984. Chemical oscillations, waves, and turbulence. Berlin, Germany: Springer. [Google Scholar]
- 44.Kurebayashi W, Shirasaka S, Nakao H. 2013. Phase reduction method for strongly perturbed limit cycle oscillators. Phys. Rev. Lett. 111, 214101 ( 10.1103/PhysRevLett.111.214101) [DOI] [PubMed] [Google Scholar]
- 45.Nakao H. 2015. Phase reduction approach to synchronisation of nonlinear oscillators. Contemp. Phys. 57, 1–27. ( 10.1080/00107514.2015.1094987) [DOI] [Google Scholar]
- 46.Park Y, Ermentrout B. 2016. Weakly coupled oscillators in a slowly varying world. J. Comput. Neurosci. 40, 269–281. ( 10.1007/s10827-016-0596-6) [DOI] [PubMed] [Google Scholar]
- 47.Winfree AT. 1967. Biological rhythms and the behavior of populations of coupled oscillators. J. Theor. Biol. 16, 15–42. ( 10.1016/0022-5193(67)90051-3) [DOI] [PubMed] [Google Scholar]
- 48.Winfree AT. 1980. The geometry of biological time. New York, NY: Springer. [Google Scholar]
- 49.Rudin W. 1966. Real and complex analysis. New York, NY: McGraw-Hill, Inc. [Google Scholar]
- 50.Skardal PS, Taylor D, Restrepo JG. 2014. Complex macroscopic behavior in systems of phase oscillators with adaptive coupling. Physica D 267, 27–35. ( 10.1016/j.physd.2013.01.012) [DOI] [Google Scholar]
- 51.Kenwright DA, Bahraminasab A, Stefanovska A, McClintock PVE. 2008. The effect of low-frequency oscillations on cardio-respiratory synchronization. Eur. Phys. J. B. 65, 425–433. ( 10.1140/epjb/e2008-00199-4) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Sanders JA, Verhulst F, Murdock J. 2010. Averaging methods in nonlinear dynamical systems. Applied Mathematical Sciences, No. 59 New York, NY: Springer. [Google Scholar]
- 53.Jensen RV. 2002. Synchronization of driven nonlinear oscillators. Am. J. Phys. 70, 607–619. ( 10.1119/1.1467909) [DOI] [Google Scholar]
- 54.Lucas M, Fanelli D, Stefanovska A. 2019. Nonautonomous driving induces stability in network of identical oscillators. Phys. Rev. E 99, 012309 ( 10.1103/PhysRevE.99.012309) [DOI] [PubMed] [Google Scholar]
- 55.Pereira T, Eroglu D, Bagci GB, Tirnakli U, Jensen HJ. 2013. Connectivity-driven coherence in complex networks. Phys. Rev. Lett. 110, 234103 ( 10.1103/PhysRevLett.110.234103) [DOI] [PubMed] [Google Scholar]
- 56.Poignard C, Pade JP, Pereira T. 2019. The effects of structural perturbations on the synchronizability of diffusive networks. J. Nonlinear Sci. 29, 1919–1942. ( 10.1007/s00332-019-09534-7) [DOI] [Google Scholar]
- 57.Belykh IV, Belykh VN, Hasler M. 2004. Blinking model and synchronization in small-world networks with a time-varying coupling. Physica D 195, 188–206. ( 10.1016/j.physd.2004.03.013) [DOI] [Google Scholar]
- 58.Faes L, Nollo G, Porta A. 2011. Information-based detection of nonlinear Granger causality in multivariate processes via a nonuniform embedding technique. Phys. Rev. E 83, 051112 ( 10.1103/PhysRevE.83.051112) [DOI] [PubMed] [Google Scholar]
- 59.Barrett AB, Barnett L. 2013. Granger causality is designed to measure effect, not mechanism. Front. Neuroinf. 7, 6 ( 10.3389/fninf.2013.00006) [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data used for analysis of coupling functions shown in figure 1 were collected during the project BRACCIA https://cordis.europa.eu/project/rcn/74753/factsheet/en and are available upon request to A.S. Codes used to generate data in figures 2 and 3 are also available.