Skip to main content
Chaos logoLink to Chaos
. 2021 Oct 5;31(10):103108. doi: 10.1063/5.0063724

Dynamical ergodicity DDA reveals causal structure in time series

Claudia Lainscsek 1,2,1,2,a), Sydney S Cash 3, Terrence J Sejnowski 1,2,4,1,2,4,1,2,4, Jürgen Kurths 5,6,7,5,6,7,5,6,7
PMCID: PMC12640249  PMID: 34717330

Abstract

Determining synchronization, causality, and dynamical similarity in highly complex nonlinear systems like brains is challenging. Although distinct, these measures are related by the unknown deterministic structure of the underlying dynamical system. For two systems that are not independent on each other, either because they result from a common process or they are already synchronized, causality measures typically fail. Here, we introduce dynamical ergodicity to assess dynamical similarity between time series and then combine this new measure with cross-dynamical delay differential analysis to estimate causal interactions between time series. We first tested this approach on simulated data from coupled Rössler systems where ground truth was known. We then applied it to intracranial electroencephalographic data from patients with epilepsy and found distinct dynamical states that were highly predictive of epileptic seizures.


Epilepsy is the fourth most common chronic neurological disorder and affects more than 50 million people worldwide. It is characterized by seizures, periods of unusual behavior, sensations, and, in some cases, loss of awareness. Unpredictable seizures are dangerous and disruptive. Drug resistant seizures require intervention to localize and remove the brain regions where the seizures are initiated. Seizure prediction could allow less invasive intervention but current prediction methods are unreliable. Synchronization and causality are two major aspects of seizures: Causal interactions between cortical areas drive synchrony, and extreme synchrony leads to seizures. Synchronization and causality are related by dynamical similarity. We introduce dynamical ergodicity, a measure of dynamical similarity that is effective under non-stationary conditions that include phase shifts. Dynamical ergodicity is studied first in a chaotic model system and is then applied to intracranial electroencephalographic (iEEG) recordings from epilepsy patients. We report promising results that may lead to a better understanding of the mechanisms underlying epileptic states and better methods to predict and prevent seizures.

I. INTRODUCTION

Chaos theory and ergodic theory are both motivated by related questions concerning dynamical systems.5,10,23 In the classic chaos theory, the dynamics of the system is governed by deterministic dynamical equations without noise or random perturbations. Thus, the statistics of these systems are generated solely by dynamics. In a chaotic system, phase space trajectories at nearby points diverge exponentially with a positive Lyapunov exponent. Ergodic theory is concerned with whether the trajectory of a dynamical system eventually covers its phase space over time. The Poincaré recurrence theorem8,9,27,28 states that an ergodic system will, after a sufficiently long but finite time, return to a state arbitrarily close to its initial state. Under certain conditions, the time average of a function along the trajectories of an ergodic system exists almost everywhere and is related to the space average.

Here, the concept of ergodicity is used as the basis for estimating the dynamical similarity of data from multiple sources and is used to improve causality estimates. In applying ergodicity to time series, the temporal average is replaced by a delay differential analysis (DDA) feature for each time series (e.g., EEG recording channels) and the ensemble average is taken over the DDA features from all the time series. If the two are similar, the time series is part of an ergodic or dynamically similar group of time series. This then can be used to estimate the reliability of our causality measure, CD-DDA (cross-dynamical DDA).16 CD-DDA, along with most causality measures, relies on comparing a model of one time series with a model that includes inputs from another time series. A reduction of the error is interpreted as causal information flow between the two systems that generate the two time series. If two systems are very similar or are already synchronized, they cannot be considered independent and the causality measure might be unreliable.

CD-DDA was introduced in Ref. 16 (and references therein) and put in context to Granger causality (GC),12 the work of Wiener,37 alternative and nonlinear Granger causality approaches,1–3,6,7,13,14 transfer entropy (TE),4,33 and convergent cross mapping (CCM).35 More approaches and reviews for causality detection can be found in the study by Smirnov34 and the focus issue in Chaos.30,38 In Ref. 16, we introduced CD-DDA and critically compared it to GC, TE, and CCM, and CD-DDA was superior for causality detection.

We first explore how the similarity of systems and synchronization affect causality estimates for unidirectionally coupled Rössler systems where we know the ground truth. The second application is to obtain intracranial electroencephalographic (iEEG) data from an epilepsy patient that was studied previously with DDA.17 This patient exhibited chimera states in the pre-ictal period before seizures, during which different channels exhibited chaotic and synchronous activity simultaneously. We show that dynamical ergodicity in combination with CD-DDA can detect distinct state changes that are indicative for pre-, post-, and inter-ictal data. Dynamical ergodicity revealed a new pre-pre-ictal state that preceded all seizures. These states lasted from minutes to hours. Since our analysis extended to days of recordings with a high temporal resolution, we were able to find causal connections between brain areas in the pre-pre-ictal states. This is a proof of concept example that distinct dynamical states may exist in some patients. We are currently analyzing over 100 patients with more than 1000 seizures. The results from this analysis will be published in a medical journal.

The paper is organized as follows. Section II introduces dynamical ergodicity and puts it into the context of previously introduced flavors of DDA. Section III applies dynamical ergodicity to unidirectionally coupled Rössler systems and shows how dynamical ergodicity can be used to improve the reliability of causality estimates. In Sec. IV, we then apply the same analysis to iEEG data from a patient with epilepsy and show how dynamical ergodicity together with causality can identify multiple states that precede all the seizures with high confidence. These results are summarized in Sec. V.

II. DDA AND DYNAMICAL ERGODICITY

DDA combines differential embeddings with linear and nonlinear nonuniform functional delay embeddings24,32,36 to relate the current derivatives of a system to the current and past values of the system variables.15,16,20 Inspired by Planck’s “natural units,”26 the DDA model maps experimental data onto a set of natural embedding coordinates.

For DDA models with two time delays and three terms to reduce complexity, the general nonlinear DDA model is

u˙(t)=i=13aiu(tτ1)miu(tτ2)ni+ρu=Fu+ρu, (1)

where u(t) is a time series and mi,ni,τ1,2N0 and a degree mj+nj4 of nonlinearity. We then use the coefficients ai and the least square error ρu between left- and right-hand sides in Eq. (1) as features. Note, that we explicitly added ρu to highlight its use in the dynamical ergodicity DDA measure introduced below. The derivative on the left side is computed using a five-point center derivative algorithm.21,22 The coefficients ai are estimated with numerical singular value decomposition (SVD) to minimize the least square error.29

DDA is a two step process. (i) For a new class of data (e.g., epilepsy iEEG data) the best DDA model [i.e., the coefficients mi and ni in Eq. (1) as well as the delays or fixed parameters τ1,2] that best fits the overall dynamical properties of the system has to be found. This can be done by supervised (maximizing the classification performance) or unsupervised (minimizing the least square error) structure selection from a list of candidate models (see, e.g., Refs. 19 and 20). This step does not have to be repeated for data from the same data class. (ii) As soon as a DDA model is fixed, data can be analyzed by fitting the data to that model and estimating the features or free parameters ai in Eq. (1). We usually estimate the parameters from the data without any pre-processing or filtering except normalizing each data window to zero mean and unit variance.

DDA has four flavors (see Fig. 1):

  • 1.

    Single trial or channel DDA (ST-DDA)19 is the classical variant developed for analyzing single time series. It can be used for detection and classification problems to assess dynamical differences in data, to find the DDA model that fits the data best, and to assess observability.11

  • 2.

    Cross trial or channel DDA (CT-DDA)18 determines the overall dynamics of multiple time series simultaneously.

  • 3.

    Cross-dynamical DDA (CD-DDA)16 measures causality between two time series.

  • 4.

    Dynamical ergodicity DDA (DE-DDA) is a combination of ST-DDA and CT-DDA that is used to assess dynamical ergodicity or similarity from data in the following way:

Consider an ST-DDA model that is applied to a time series u(t) of length L,

u˙(t)=a1u(tτ1)+a2u(tτ2)+a3u(tτ1)2=a1uτ1+a2uτ2+a3uτ12. (2)

The free parameters (features) A=(a1,a2,a3) are estimated by solving the equations for A using SVD,29

(u˙(t+1)u˙(t+2)u˙(t+3)u˙(t+L))=(u(t+1τ1)u(t+1τ2)u(t+1τ2)2u(t+2τ1)u(t+2τ2)u(t+2τ2)2u(t+3τ1)u(t+3τ2)u(t+3τ2)2u(t+Lτ1)u(t+Lτ2)u(t+Lτ2)2)×(a1a2a3),u˙=MuA. (3)

Note that Mu is an ( L×3) matrix. The additional feature is the error,

ρ=1Lk=1L(MuAu˙)k2, (4)

yielding Eq. (1),

u˙=MuA+ρa=Fu+ρu. (5)

Note that the error sometimes is denoted by ρa or ρu depending on whether the emphasis is on the time series u or the features A.

FIG. 1.

FIG. 1.

Flavors of DDA: ST-DDA is used for single time series. CT-DDA combines multiple time series to estimate the combined features. DE-DDA combines these two measures to assess dynamical ergodicity. CD-DDA detects causality from two time series.

Multiple time series can be analyzed with CT-DDA. For two time series, u1(t) and u2(t), the features can be either computed for each time series separately, resulting in (A,ρa)1 and (A,ρa)2, or in a combined way by solving the equation

(u˙1u˙2)=(Mu1Mu2)B, (6)

for the features B=(b1,b2,b3). In (6), the vector (u˙1u˙2) has 2L elements since the two time series u1(t) and u2(t) are each of length L. (Mu1Mu2) is a ( 2L×3) matrix and Mu1 and Mu2 each have the same form as Mu in Eq. (3). Therefore, B=(b1,b2,b3) is a vector with three elements. This can be extended to any number of time series (see Fig. 2 for the example of six time series). Note that for ST-DDA, there are as many feature sets (A,ρa) as there are time series, while for CT-DDA there is only one combined feature vector (B,ρb).

FIG. 2.

FIG. 2.

DE-DDA combines ST DDA and CT DDA to test for dynamical ergodicity. An example with six time series is shown, extending the dimensionality in Eq. (6).

CT-DDA only makes sense if the dynamics in the two time series u1(t) and u2(t) are similar and therefore can be used to test for dynamical similarity. This motivates dynamical ergodicity: Consider two time series u1(t) and u2(t) and the two corresponding ST-DDA feature vectors (A,ρa)1 and (A,ρa)2. From CT-DDA, there is one combined feature vector (B,ρb). The mean of the two ST-DDA errors ρa¯ and the CT-DDA error ρb should be similar if the analyzed time series have a similar dynamics and the quotient should be close to one. Dynamical Ergodicity as used in DE-DDA is defined as

E=|ρa¯ρb1|. (7)

Figure 2 shows an example with six time series. The smaller E is, the more similar is the dynamics of the time series under investigation. If both time series are identical, E will be zero. Furthermore, E is invariant to non-stationarities and phase shifts.

For recordings from patients with epilepsy, it is important to group data from different channels according to their dynamics regardless of phase shifts or non-stationarities in the data. For example, at the onset of a seizure, only data from a few channels might share the same dynamics.

Dynamical ergodicity can be further used to check the reliability of causality. Here, we use CD-DDA as introduced in Ref. 16 to assess causality. For CD-DDA, we consider two dynamical systems X and Y resulting in the time series u(t) and v(t). The first step is to compute a set of features C=(c1,c2,c3) with

u˙=MuC+ρu, (8)

where u˙ is a vector of length L and the delay matrix Mu is a ( L×3) matrix. To check if there is a causal connection from Y to X, we add the delay matrix from the other time series, Mv, to the equation

u˙=(MuMv)E+ρuv. (9)

(MuMv) now is a ( L×6) matrix resulting in E=(e1,e2,,e6) with six elements. If there is a causal connection from Y to X, then the last three elements of E will make the model better and the error ρuv should decrease. If there is no causal connection from Y to X, then the last three elements of E will be irrelevant and the error ρuv should not change. The difference

Cuv=ρuρuv (10)

can, therefore, be used to quantify causality from Y to X. A causal connection from X to Y can be tested in the same way, starting with

v˙=MvD+ρv, (11)

where v˙ is a vector of length L and Mv is a ( L×3) matrix. Once again, the second delayed matrix Mu can be added to the equation,

v˙=(MuMv)F+ρvu. (12)

(MuMv) is the same combined ( L×6) delay matrix as in Eq. (9) resulting in F with six elements. Whether the first three terms of F are relevant or not tells us whether there is a causal connection and

Cvu=ρvρvu (13)

is used to quantify causality from X to Y. However, this and all other causality measures assume that the two dynamical systems are not similar or synchronized to each other. A better causality measure can, therefore, be obtained by multiplying these two measures: CE, where C is Cuv or Cvu.

III. UNIDIRECTIONALLY COUPLED RÖSSLER SYSTEMS

Two Rössler systems were unidirectionally coupled by modifying the system in Ref. 25 as explained in Ref. 16,

R1{x˙1=ω1y1z1,y˙1=x1+a1y1,z˙1=bcz1+z1x1,R2{x˙2=ω2y2z2+σ(x1x2),y˙2=x2+a2y2,z˙2=bcz2+z2x2, (14)

with b=0.2 and c=10. We consider the following two cases: (1) a chaotic Rössler system driving a periodic Rössler system and (2) a periodic Rössler system driving a chaotic Rössler system. In the first case, we set ω1=1.030225, ω2=0.970225, and a1=a2=0.15. In the second case, we set ω1=0.970225, ω2=1.030225, a1=0.15, and a2=0.3. The coupling strength σ was varied between 0.001 and 0.25 in the first case and between 0.001 and 0.55 in the second case, each in 120 equally spaced steps. The initial conditions were the same for all numerical experiments. The integration step size δt was set to 0.05 with a transient of 25 000 time points discarded. DDA was run with a window length of 6000 δt and a window shift of 1554 δt resulting in 29 windows, the same as in Ref. 16. The same DDA model as in Ref. 16 was used,

Fu=a1uτ1+a2uτ2+a3uτ13, (15)

with uτj=u(tτj), u=x1,2, and the adjusted delays τ1=64δt and τ2=18δt. The numerical derivatives were estimated with a center derivative as explained in Refs. 21 and 22. We further show the noise-free cases and the case of added white noise to all signals with a signal-to-noise ratio (SNR) of 10 dB.

A. Chaotic Rössler system driving a periodic Rössler system

The driven attractors for ω1=1.030225, ω2=0.970225, and a1=a2=0.15 in Eq. (14) are shown in Fig. 3 with no noise. The colors change in the upper panel with the coupling strength σ from blue to red. The CD-DDA plot, showing C, for the noise-free case is similar to the one in Ref. 16. C denotes here both Cuv and Cvu for the corresponding direction of causality. Note the abrupt onset of synchronization at σ=0.15.

FIG. 3.

FIG. 3.

A chaotic Rössler system driving a periodic Rössler system with no noise. In the top plot, the attractors are shown for different coupling strengths. The colors change from blue to red with increasing coupling strength. In the bottom plots, C denotes Cuv in cyan and Cvu in magenta.

Two problems are apparent in Fig. 3: For small coupling strengths, causality cannot be detected and the direction of causality is reversed when the two systems are synchronized. In the high-noise case, causality cannot be detected for small coupling strengths and is even reversed after synchronization.

The dynamical ergodicity E in Eq. (7) is plotted in the middle panels of Figs. 3 and 4. E is small when the two time series have similar dynamics. This is the case when the coupling strength is small or when they are synchronized. These are exactly the cases when the causality C ( Cuv and Cvu) is ambiguous. One possible solution is to use the product CE, as shown in the bottom panels. Without noise, this is very small for the cases where causality makes little sense. For the high-noise case, there is too much noise in the two time series to assess causality because they are similar. Such cases always should be viewed with caution.

FIG. 4.

FIG. 4.

A chaotic Rössler system driving a periodic Rössler system with high noise. The colors change from blue to red with increasing coupling strength. C denotes Cuv in cyan and Cvu in magenta. White noise with SNR = 10 dB was added.

B. Periodic Rössler system driving a chaotic Rössler system

The driven attractors for ω2=1.030225, ω1=0.970225, a1=0.15, and a2=0.3 and no noise are shown in Fig. 5. The coupling strength σ was varied between 0.001 and 0.55 in 120 equally spaced steps. In the upper panel, the colors change with the coupling strength σ from blue to red. The driven attractors with noise are shown in Fig. 6 (SNR = 10 dB). In this example, causality C is detected in the correct direction, except for small coupling strengths and after the systems synchronize. Again, dynamical ergodicity E helps identify when causality makes sense.

FIG. 5.

FIG. 5.

A periodic Rössler system driving a chaotic Rössler system with no noise. In the top plot, the attractors are shown for different coupling strengths. The colors change from blue to red with increasing coupling strength. C denotes here both Cuv (in cyan) and Cvu (in magenta).

FIG. 6.

FIG. 6.

A periodic Rössler system driving a chaotic Rössler system with high noise. C denotes here both Cuv (in cyan) and Cvu (in magenta). White noise with SNR = 10 dB was added.

IV. CAUSALITY AND DYNAMICAL ERGODICITY IN EPILEPTIC SEIZURES

The causality measures introduced above are applied here to recordings from a patient with epilepsy that were analyzed previously in Ref. 17 using same DDA model,

u˙=a1uτ1+a2uτ2+a3uτ14+ρu=Fu+ρu, (16)

where uτi=u(tτi) and u(t) are iEEG data. The delay pair is τ=(7,10) δt, where δt=1fs with the sampling rate fs=500 Hz. The choice of this model is explained in Refs. 17 and 19. The patient demographics and characteristics are described in Ref. 19. All data analyses were performed under protocols monitored by the Massachusetts General Hospital according to National Institutes of Health guidelines. Figure 7 shows the schematic of the implanted iEEG electrode locations for 77 recording sites.

FIG. 7.

FIG. 7.

Locations of the implanted iEEG electrodes. The onset channels, as determined by a neurologist, are highlighted in blue. Recordings from the two hemispheres are stacked and displayed in the top and bottom portions of the plots in subsequent figures.

The ST-DDA features for each channel were computed separately for sliding windows with a length of 250 ms and a window shift of half that length. Additionally, CT-DDA as well as the CD-DDA features were computed for each pair of channels, resulting in 2926 pairwise channel combinations. There were three ( 77×77) matrices ( E, ECxy, and ECyx) for each 250 ms time window. To reduce the dimension by one, truncated higher-order SVD (THOSVD)19 was performed on 100 time windows (about 13 s) on each of these matrices and then all channels that correlated to the same singular values were identified and given the same color in the figures. Each color, therefore, represents a community.31

Figure 8 shows analysis of the recordings 10 min before to 10 min after the onset of seizure 4. The channels were not sorted. A chimera state identified for this patient before this seizure17 has lighter/whiter colors in the upper plot and belongs to the same community shown in blue in the ergodicity plot, second from the top. The synchronized channels belong to a different community and are shown in orange. The brief green vertical regions are micro events. During the seizure, the kaleidoscope of colors indicate dynamical diversity. After the seizure, most channels become synchronized, as indicated by the vertical red region, which is followed by a shift to another state.

FIG. 8.

FIG. 8.

Analysis of 77 channels 10 min before to 10 min after onset of seizure 4. The panels show ρ and THOSVD analysis of E, ECxy, and ECyx. For ρ (upper plot), the colors represent the value of ρ. For the remaining plots, the colors represent communities (see text). The vertical lines near the center indicate the seizure onset as marked by a neurologist. The onset channels are in the red region of the third panel from the top preceding the seizure.

In Fig. 9, a much longer 72-h recording is shown comprising seven seizures, and in Fig. 10, an expansion is shown 10 min before the third seizure to 10 min after the onset of seizure 4. The orange and blue regions are chimera states (explained in detail in Ref. 17) that occur before each of the seven seizures and last for up to 2 h. Importantly, before the chimera states, there are three distinct states of about 10 min each (seen most clearly in Fig. 10). Exactly, the same sequence of states occurs before each seizure and varies only in duration.

FIG. 9.

FIG. 9.

72 h of data; 77 channels; ρ and THOSVD analysis of E, ECxy, and ECyx are shown.

FIG. 10.

FIG. 10.

Seizures 3 and 4. ρ and THOSVD analysis of E, ECxy, and ECyx are shown.

This newly identified pre-pre-ictal state before the orange/blue chimera state also appears as a decrease of the blue community around channel 10 in the ECxy plot (third from the top) in Fig. 9 and at 109.5 h in Fig. 10. Red regions increase as blue regions decrease. These blue channels (left posterior temporal, Fig. 7) are outside the seizure onset zone but enable the chimera pre-ictal states. The red channels are the onset channels (right posterior frontal, Fig. 7). In Fig. 9, the two hemispheres (top half and bottom half) show clear differences in the two lower causality plots but not in the top two plots, reflecting the ability of the causal measure to detect the origin of the seizure in one of the hemispheres.

V. DISCUSSION

Dynamical ergodicity E was introduced as a measure of dynamical similarity that is invariant to non-stationarities. We then applied E to simulated data from two coupled Rössler systems. Channels that are too similar or are synchronized cannot be assessed for causality because these channels are not independent and already share information. By identifying these conditions, dynamical ergodicity can add reliability to any causality measure by focusing analysis on those channels that are more likely to carry causal information. After successfully validating this new causal measure on simulated data, we then applied this analysis on 72 h of iEEG recordings from a patient having seven seizures.

A previously identified pre-ictal chimera state17 was preceded by a newly identified pre-pre-ictal state that occurs away from the onset channels and has high predictive power for the pre-ictal chimera state. The cortex enters the pre-pre-ictal state early enough for feedback intervention to reduce the severity or possibly prevent the predicted epileptic seizure. These findings from one patient are a proof of concept. Further analysis of recordings from a larger cohort of patients (over 1000 seizures from around 100 patients) will explore the diversity of seizures. A paper is in preparation and will be published in a medical journal.

The ability to detect multiple cortical states and the transitions between them makes it possible to study the dynamic regulation of the cortical activity that occurs during sleep stages and levels of arousal and attention. DDA can be computed in real time and is insensitive to artifacts, opening up the possibility of closing the loop with feedback.

ACKNOWLEDGMENTS

C.L. and T.J.S. were supported by the NIH Grant Nos. 5 R01 EB026899-03 and R01 NS104368-03 and also by the Swartz Foundation. J.K. was supported by the Ministry of Science and Higher Education of the Russian Federation within the framework of state support for the creation and development of World-Class Research Centers “Digital biodesign and personalized healthcare” (Grant No. 075-15-2020-926).

Note: This paper is part of the Focus Issue, In Memory of Vadim S. Anishchenko: Statistical Physics and Nonlinear Dynamics of Complex Systems.

DATA AVAILABILITY

The data that support the findings of this study are available from the corresponding author upon reasonable request.

REFERENCES

  • 1.Baek E. and Brock W., “A general test for nonlinear Granger causality: Bivariate model” (Korea Development Institute, University of Wisconsin-Madison, 1992), Vol. 15, pp. 197–235 (unpublished).
  • 2.Bai Z., Hui Y., Jiang D., Lv Z., Wong W.-K., and Zheng S., “A new test of multivariate nonlinear causality,” PLoS ONE 13(1), 1–14 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Bai Z., Wong W.-K., and Zhang B., “Multivariate linear and nonlinear causality tests,” Math. Comput. Simul. 81(1), 5–17 (2010). 10.1016/j.matcom.2010.06.008 [DOI] [Google Scholar]
  • 4.Barnett L., Barrett A. B., and Seth A. K., “Granger causality and transfer entropy are equivalent for Gaussian variables,” Phys. Rev. Lett. 103, 238701 (2009). 10.1103/PhysRevLett.103.238701 [DOI] [PubMed] [Google Scholar]
  • 5.Boltzmann L., “Ergoden in chapter III, §32,” in Vorlesungen über Gastheorie, edited by J. A. B. Leipzig (1898).
  • 6.Brock W., Dechect W., and Scheinkman J., “A test for independence based on the correlation dimension” (Department of Economics, 1987) (unpublished).
  • 7.Brock W., Dechect W., and Scheinkman J., “A test for independence based on the correlation dimension,” Econometric Rev. 15, 197–235 (1996). 10.1080/07474939608800353 [DOI] [Google Scholar]
  • 8.Carathéodory C., Über den Wiederkehrsatz von Poincaré (Sitzungsberichte, Berlin, 1919), pp. 580–584. [Google Scholar]
  • 9.Carathéodory C., Gesammelte Mathematische Schriften V (C. H. Beck’sche Verlagsbuchhandlung, 1957). [Google Scholar]
  • 10.Eckmann J. P. and Ruelle D., “Ergodic theory of chaos and strange attractors,” Rev. Mod. Phys. 57, 617 (1985). 10.1103/RevModPhys.57.617 [DOI] [Google Scholar]
  • 11.Gonzalez C. E., Lainscsek C., Sejnowski T. J., and Letellier C., “Assessing observability of chaotic systems using delay differential analysis,” Chaos 30(10), 103113 (2020). 10.1063/5.0015533 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Granger C. W., “Investigating causal relations by econometric models and cross-spectral methods,” Econometrica 37, 424–438 (1969). 10.2307/1912791 [DOI] [Google Scholar]
  • 13.Grassberger P. and Procaccia I., “Measuring the strangeness of strange attractors,” Physica D 9, 189 (1983). 10.1016/0167-2789(83)90298-1 [DOI] [Google Scholar]
  • 14.Hiemstra C. and Jones J. D., “Testing for linear and nonlinear Granger causality in the stock price-volume relation,” J. Finance 49(5), 1639–1664 (1994). 10.1111/j.1540-6261.1994.tb04776.x [DOI] [Google Scholar]
  • 15.Kremliovsky M. and Kadtke J., “Using delay differential equations as dynamical classifiers,” AIP Conf. Proc. 411, 57 (1997). 10.1063/1.54215 [DOI] [Google Scholar]
  • 16.Lainscsek C., Gonzalez C. E., Sampson A. L., Cash S. S., and Sejnowski T. J., “Causality detection in cortical seizure dynamics using cross-dynamical delay differential analysis,” Chaos 29(10), 101103 (2019). 10.1063/1.5126125 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Lainscsek C., Rungratsameetaweemana N., Cash S. S., and Sejnowski T. J., “Cortical chimera states predict epileptic seizures,” Chaos 29(12), 121106 (2019). 10.1063/1.5139654 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Lainscsek C., Sampson A. L., Kim R., Thomas M. L., Man K., Lainscsek X., The COGS Investigators, Swerdlow N. R., Braff D. L., Sejnowski T. J., and Light G. A., “Nonlinear dynamics underlying sensory processing dysfunction in schizophrenia,” Proc. Natl. Acad. Sci. U.S.A. 116(9), 3847–3852 (2019c). 10.1073/pnas.1810572116 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Lainscsek C., Weyhenmeyer J., Cash S. S., and Sejnowski T. J., “Delay differential analysis of seizures in multichannel electrocorticography data,” Neural Comput. 29(12), 3181–3218 (2017). 10.1162/neco_a_01009 [DOI] [PubMed] [Google Scholar]
  • 20.Lainscsek C., Weyhenmeyer J., Hernandez M., Poizner H., and Sejnowski T., “Non-linear dynamical classification of short time series of the Rössler system in high noise regimes,” Front. Neurol. 4, 182 (2013). 10.3389/fneur.2013.00182 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Miletics E. and Molnárka G., “Taylor series method with numerical derivatives for initial value problems,” J. Comput. Methods Sci. Eng. 4(1–2), 105–114 (2004), available at https://dl.acm.org/doi/10.5555/1411367.1411380. [Google Scholar]
  • 22.Miletics E. and Molnárka G., “Implicit extension of Taylor series method with numerical derivatives for initial value problems,” Comput. Math. Appl. 50(7), 1167–1177 (2005). 10.1016/j.camwa.2005.08.017 [DOI] [Google Scholar]
  • 23.Ornstein D., “Ergodic theory, randomness, and ‘chaos,’” Science 243(4888), 182–187 (1989). 10.1126/science.243.4888.182 [DOI] [PubMed] [Google Scholar]
  • 24.Packard N. H., Crutchfield J. P., Farmer J. D., and Shaw R. S., “Geometry from a time series,” Phys. Rev. Lett. 45, 712 (1980). 10.1103/PhysRevLett.45.712 [DOI] [Google Scholar]
  • 25.Palus M. and Vejmelka M., “Directionality of coupling from bivariate time series: How to avoid false causalities and missed connections,” Phys. Rev. E 75, 056211 (2007). 10.1103/PhysRevE.75.056211 [DOI] [PubMed] [Google Scholar]
  • 26.Planck M., “Über irreversible strahlungsvorgänge,” Ann. Phys. 306(1), 69–122 (1900). 10.1002/andp.19003060105 [DOI] [Google Scholar]
  • 27.Poincaré H., OEuvres VII, 262–490 (Theorem 1 Section 8), Mécanique Céleste et Astronomie (Gauthier-Villars, Paris, 1890). [Google Scholar]
  • 28.Poincaré H., “Sur le problème des trois corps et les équations de la dynamique,” Acta Math. 13, 1–270 (1890), available at https://projecteuclid.org/journals/acta-mathematica/volume-13/issue-1-2. [Google Scholar]
  • 29.Press W., Flannery B., Teukolsky S., and Vetterling W., Numerical Recipes in C (Cambridge University Press, New York, 1990). [Google Scholar]
  • 30.Ruan Y., Donner R. V., Guan S., and Zou Y., “Ordinal partition transition network based complexity measures for inferring coupling direction and delay from time series,” Chaos 29(4), 043111 (2019). 10.1063/1.5086527 [DOI] [PubMed] [Google Scholar]
  • 31.Runge J., Petoukhov V., Donges J. F., Hlinka J., Jajcay N., Vejmelka M., Hartman D., Marwan N., Paluš M., and Kurths J., “Identifying causal gateways and mediators in complex spatio-temporal systems,” Nat. Commun. 6, 8502 (2015). 10.1038/ncomms9502 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Sauer T., Yorke J. A., and Casdagli M., “Embedology,” J. Stat. Phys. 65, 579 (1991). 10.1007/BF01053745 [DOI] [Google Scholar]
  • 33.Schreiber T., “Measuring information transfer,” Phys. Rev. Lett. 85, 461–464 (2000). 10.1103/PhysRevLett.85.461 [DOI] [PubMed] [Google Scholar]
  • 34.Smirnov D. A., “Quantification of causal couplings via dynamical effects: A unifying perspective,” Phys. Rev. E 90, 062921 (2014). 10.1103/PhysRevE.90.062921 [DOI] [PubMed] [Google Scholar]
  • 35.Sugihara G., May R., Ye H., Hsieh C.-H., Deyle E., Fogarty M., and Munch S., “Detecting causality in complex ecosystems,” Science 338(6106), 496–500 (2012). 10.1126/science.1227079 [DOI] [PubMed] [Google Scholar]
  • 36.Takens F., “Detecting strange attractors in turbulence,” in Dynamical Systems and Turbulence, Warwick 1980, Lecture Notes in Mathematics Vol. 898, edited by D. A. Rand and L.-S. Young (Springer, Berlin, 1981), pp. 366–381.
  • 37.Wiener N., Modern Mathematics for Engineers, The Theory of Prediction (McGraw Hill, New York, 1956), pp. 165–190.
  • 38.Zou Y., Donner R. V., Marwan N., Donges J. F., and Kurths J., “Complex network approaches to nonlinear time series analysis,” Phys. Rep. 787, 1–97 (2019). 10.1016/j.physrep.2018.10.005 [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.


Articles from Chaos are provided here courtesy of American Institute of Physics

RESOURCES