Skip to main content
Proceedings of the National Academy of Sciences of the United States of America logoLink to Proceedings of the National Academy of Sciences of the United States of America
. 2019 Feb 11;116(9):3847–3852. doi: 10.1073/pnas.1810572116

Nonlinear dynamics underlying sensory processing dysfunction in schizophrenia

Claudia Lainscsek a,b,1, Aaron L Sampson a,c, Robert Kim a,c, Michael L Thomas d,e, Karen Man a,f, Xenia Lainscsek a,g; The COGS Investigators, Neal R Swerdlow d, David L Braff d,h, Terrence J Sejnowski a,b,i,1, Gregory A Light d,h,1
PMCID: PMC6397565  PMID: 30808768

Significance

One of the fundamental challenges of neuroscience is to understand the seamless orchestration of many interconnected brain regions, which is needed to produce the integrated experience of cognition. This paper describes a method based on dynamical systems theory to identify important nonlinear features underlying brain signals. We show that this method can indeed detect unique dynamical states underlying normal and altered auditory information processing in large cohorts of healthy subjects and schizophrenia patients. These dynamical states correspond to network changes preceding well-known auditory–neurophysiological responses. Results indicate that brain signals can be analyzed using a rather unconventional method to extract important large-scale dynamical information that is not apparent from conventional methods commonly used in the study of neuropsychiatric disorders.

Keywords: nonlinear dynamics, delay differential analysis, mismatch negativity, schizophrenia, EEG

Abstract

Natural systems, including the brain, often seem chaotic, since they are typically driven by complex nonlinear dynamical processes. Disruption in the fluid coordination of multiple brain regions contributes to impairments in information processing and the constellation of symptoms observed in neuropsychiatric disorders. Schizophrenia (SZ), one of the most debilitating mental illnesses, is thought to arise, in part, from such a network dysfunction, leading to impaired auditory information processing as well as cognitive and psychosocial deficits. Current approaches to neurophysiologic biomarker analyses predominantly rely on linear methods and may, therefore, fail to capture the wealth of information contained in whole EEG signals, including nonlinear dynamics. In this study, delay differential analysis (DDA), a nonlinear method based on embedding theory from theoretical physics, was applied to EEG recordings from 877 SZ patients and 753 nonpsychiatric comparison subjects (NCSs) who underwent mismatch negativity (MMN) testing via their participation in the Consortium on the Genetics of Schizophrenia (COGS-2) study. DDA revealed significant nonlinear dynamical architecture related to auditory information processing in both groups. Importantly, significant DDA changes preceded those observed with traditional linear methods. Marked abnormalities in both linear and nonlinear features were detected in SZ patients. These results illustrate the benefits of nonlinear analysis of brain signals and underscore the need for future studies to investigate the relationship between DDA features and pathophysiology of information processing.


In neuropsychiatric disorders, subtle abnormalities in low-level processes contribute to the complex constellation of symptoms. Schizophrenia (SZ) is among the most intractable and disabling illnesses, with impairments in multiple domains of cognitive and psychosocial functioning (1). In this study, a nonlinear analysis technique for characterizing large-scale systems from a theoretical physics perspective was applied to leading candidate biomarkers in healthy nonpsychiatric subjects and SZ patients.

Among many domains of clinically relevant dysfunctions, altered early auditory information processing (EAIP), as measured by event-related potentials (ERPs), is a fundamental feature of SZ (2, 3). Mismatch negativity (MMN) is an ERP biomarker of EAIP with promise for improving our understanding and treatment of SZ. MMN has been shown to reliably correlate with cognition and psychosocial functioning (1, 4). MMN can be used for predicting the development of psychosis among individuals at high clinical risk and is sensitive to interventions that target cognition (5, 6). MMN is automatically elicited via a passive auditory oddball paradigm in response to infrequent deviant sounds randomly interspersed in a sequence of frequently presented standard sounds. MMN is followed by a positive component also reflective of EAIP that peaks at 250–300 ms called P3a. Although less studied, the P3a is followed by a negative wave called the reorienting negativity (RON) (7). This MMN–P3a–RON response has been referred to as the auditory deviance response (ADR) complex (8). Many studies have found significant ADR component reductions in SZ that correlate with impairments across multiple domains of higher-order cognitive and psychosocial functioning (9, 10). Recently, Thomas et al. (1) proposed and validated a hierarchical information processing cascade model, where impairments in these early auditory sensory processing measures propagate and substantially contribute to deficits in cognition, clinical symptoms, and real-world functional disability in SZ. Thus, small changes in early auditory processing measures contribute to deficits in higher-order functions and macroscopic manifestations of SZ.

The vast majority of ERP studies in neuropsychiatry have used linear analysis of EEG signals. These linear methods include ERP peaks and latencies (11, 12), frequency (13) or time frequency analyses (14, 15), and cross-frequency coupling (16, 17). Such conventional linear methods, while highly informative, focus on a priori determined time-locked events or frequency ranges (i.e., delta, theta, gamma bands) and therefore, fail to capture important underlying nonlinear system dynamics. Thus, characterizing general dynamical components of broadband data without such restrictions may reveal information about altered systems-level states associated with SZ.

To characterize the large-scale, neural system-level dynamics present in brain electrical activity in patients with SZ, computational models based on nonlinear dynamics and systems theory recently emerged as a promising tool in neuroscience (18, 19). In contrast to our prevailing focus on microscale neuronal activity, methods that characterize large-scale, system-level dynamics may help us understand emergent phenomena of behavior and cognition (18, 20). This perspective also underlies past work linking nonlinear analysis of the EEG to the “disconnection hypothesis” of SZ (21, 22). Breakspear and Terry (23) used a technique for estimating the nonlinear dynamical interdependence of several EEG channels across and within both hemispheres and found significant differences in the topography of dynamical interdependence across the scalp between SZ patients and matched healthy comparison subjects (24). Here, we apply a distinct but related technique to probe the nonlinear dynamics of a single EEG channel, which allows us to investigate the nonlinear properties of a broader range of data. Delay differential analysis (DDA) is designed to capture large-scale dynamics present in nonlinear time series signals (2528). DDA operates in the time domain and maps unprocessed data onto a functional embedding basis. Embeddings are used in nonlinear dynamics to reveal invariant dynamical properties underlying a more extensive, largely unknown dynamical system (i.e., the brain) when only a single time series (e.g., EEG data) is available. Previous studies have shown that DDA can be used to extract disease-specific dynamical features: Parkinson’s movement data (29, 30), ECG recordings (27, 31), sleep EEG (26), classification of Parkinson’s disease EEG data (32, 33), and electrocorticography data for epileptic seizure characterization (34).

In this study, DDA was applied to the unprocessed EEG recordings from SZ patients and nonpsychiatric comparison subjects (NCSs) who participated in the Consortium on the Genetics of Schizophrenia (COGS-2), a multicenter case-control study of SZ and related endophenotypes (10). In contrast to our prior focus on linear ERP features (MMN and P3a amplitudes) (1, 10), this study aimed to determine (i) whether nonlinear dynamics can be detected in raw EEG recordings and if so, (ii) if they can be used to differentiate SZ patients from NCSs; by mapping the trial information onto the DDA feature space, we also aimed to determine (iii) whether the MMN, P3a, and RON responses reflect nonlinear processes even after controlling for SZ–NCS amplitude differences, which would provide an important perspective on EAIP deficits in SZ. Such information may be important for guiding future studies of the genomic and neural substrates of SZ and may provide targets for treatment developments.

DDA

We developed and applied a signal processing technique, DDA, based on embedding theory in nonlinear dynamics. DDA combines two types of embeddings via a delay differential equation: delay embedding and derivative embedding. The general nonlinear DDA model can be formulated as

x˙=i=1Iain=1Nxτnmn,i, [1]

where τn, mn,iN0 with x=x(t), xτn=x(tτn), relating the signal derivative x˙(t) to delayed versions of the signal. Most of the terms in this template are set to zero depending on the data type. The following DDA model has been shown to capture important dynamical information from EEG signals (26, 3335):

x˙=a1x1+a2x2+a3x12. [2]

This model was chosen through a structure selection procedure, repeated random subsampling cross-validation (36) (SI Appendix), using separate EEG and intracranial EEG datasets (26, 3335). The coefficients a1,2,3 were used as features to distinguish dynamical differences in time series data. Together with these coefficients, the least squares error ρ was also considered. Therefore, the full DDA feature set was composed of {a1,a2,a3,ρ}. These previous studies have shown that the four DDA parameters of Eq. 2 reflect both linear and nonlinear features underlying nonlinear signals (25). Since previous results converged on a3 as most informative (25), this parameter was carried forward for detailed characterization in this dataset.

Results

ADR Complex.

Consistent with established methods (10), individual subject deviant minus standard waveform averages derived from the preprocessed ERP signals showed significantly reduced MMN and P3a positivity components for the SZ patients (Fig. 1A, Upper). The group-averaged signals (Fig. 1A, Lower) also revealed significantly diminished ADR complex composed of MMN, P3a positivity, and RON for the SZ group.

Fig. 1.

Fig. 1.

DDA identified dynamical state changes preceding each of the ADR complex components. (A) NCSs demonstrated robust MMN, P3a, and RON components as shown in the heat map of the individual subject difference (deviant tone ERP − standard tone ERP) average signals (Upper). All three components of the ADR (MMN, P3a, and RON) can be appreciated in the group-level average signals (Lower). (B) DDA a3 coefficient values averaged within each subject revealed significantly decreased a3 in the SZ patients (Upper). As with the ERP results, the DDA group averages displayed three components with homologous waveform morphology and severity of deficits in SZ, but the DDA components (numbered 1–3 in Lower) preceded their corresponding ERP peaks identified in A by 71, 54, and 82 ms, respectively. The shaded regions in the group average signals represent group differences that are statistically significant after adjusting for multiple comparisons (false discovery rate). Cohen’s d, t values, and degrees of freedom are shown in SI Appendix, Fig. S9.

Performing the DDA on the difference waveforms and computing individual subject a3 averages showed significantly lower a3 values across the SZ patients in the 180- to 240-ms time window (Fig. 1B, Upper) (mean t value = 10.8, mean Cohen’s d = 0.55). The group-averaged a3 signals revealed three distinct areas corresponding to the ADR components (numbered areas in Fig. 1B, Lower). Interestingly, the timing of the three DDA peaks occurred before their corresponding ADR components identified in the group-averaged ERP signals. For instance, the peak group difference in area 1 in Fig. 1B occurred 70 ms before the peak group difference in the ERP MMN window in Fig. 1A. This suggests that DDA reflects dynamical state changes (as estimated by the amplitude changes in a3) occurring immediately before each of the ERP ADR components. Thus, DDA not only captures the group differences but also, identifies the underlying dynamical state changes that contribute to the linear ERP changes of the ADR complex components.

Responses to Constituent Deviant and Standard Tones.

To determine whether findings in the deviant minus standard difference waves were driven by effects to constituent tones, responses to deviant and standard tones were also examined separately. Consistent with the results presented above, similar waveform morphology and magnitude of SZ impairment were observed in both ERP and DDA results. Also consistent with the previous section, peaks observed with DDA, including those related to SZ deficits, occurred earlier than those observed in the ERP analysis.

Responses to deviant tones.

Averaging the ERP signals corresponding to only deviant tones revealed three ERP components (Fig. 2A) that were reduced for the SZ group, consistent with other studies (10). DDA identified dynamical changes unique to each group occurring before each of the ERP components (Fig. 2B). In addition, the dynamical states of the NCS group were significantly different from those of the SZ patients during the 50- to 100-ms time window (black arrow in Fig. 2B) (mean t value = −2.6, mean Cohen’s d = −0.13). Notably, this window corresponds to the earliest time window during which a stimulus can be identified as deviant, since the deviant auditory tones were 100 ms in duration (vs. 50 ms for the standard tones). No such difference was observed in the grand average ERP signals (Fig. 2A).

Fig. 2.

Fig. 2.

ADR components were evident from both ERP analysis and DDA of waveforms elicited by deviant auditory tones. (A) Individual subject average signals from deviant tones revealed pronounced MMN and P3a components in the NCSs (Upper). The grand average signals from the two groups showed significantly different ADR component signals (Lower). (B) DDA a3 amplitude changes were observed before each of the ADR components (numbered 1–3 in Lower). Furthermore, statistically significant differences in a3 amplitude between groups were detected during the earliest time window (50–100 which ms) in an auditory tone could be processed as deviant (black arrow; mean t value = −2.6, mean Cohen’s d = −0.13).

Responses to standard tones.

Unlike the robust group differences observed in the ERP responses to the deviant tones, the group differences in the standard tone ERP responses were much more modest as shown in Fig. 3A. DDA identified a similar group difference occurring between 90 and 130 ms (Fig. 3B). Consistent with ERP analysis of the standard tones, no significant dynamical changes were detected in the 50- to 100-ms time window.

Fig. 3.

Fig. 3.

DDA of standard tones detected significant dynamical state alterations preceding the P150 window. (A) ERP signals corresponding to the standard tones revealed a reduced P150 component in the SZ grand average signal (Lower). (B) Dynamic changes preceding the P150 ERP changes were observed in the 90- to 130-ms window (Lower; mean t value = 3.3, mean Cohen’s d = 0.17). The a3 changes were reduced for the SZ group during this time window.

Discussion

In this study, DDA, a technique based on dynamical systems theory, was used to determine whether nonlinear features significantly contribute to leading neurophysiologic biomarker candidates of EAIP. The concept that nonlinear, chaos theory-based perturbations occur early in information processing in SZ patients has been hypothesized for some time (36). In this context, these early dynamical state changes precede commonly studied ERP features in both groups. SZ-related impairments in DDA metrics may contribute to impairments in higher-order neurocognitive and psychosocial functioning. A challenge has been with the identification and quantification of these early nonlinear abnormalities in the information processing cascade of function (1). DDA may provide a solution to this longstanding challenge.

DDA was used on large cohorts of 877 SZ patients and 753 NCSs using a well-validated paradigm from the COGS-2 multicenter study. DDA revealed nonlinear dynamical state changes, which preceded well-established ADR components of the ERP.

Importantly, the dynamical information extracted from EEG may also provide additional information about the underlying nature of the MMN, P3a, and RON components of the ADR. Interestingly, nonlinear features are evident nearly instantaneously in response to standard and deviant auditory stimulus onset as well as in the deviant minus standard comparison that is commonly used for measuring the ADR components. DDA detected nonlinear activity >50 ms before conventional ERP peaks. Since this early DDA effect does not seem to be an artifact of the analysis method, questions remain as to the functional significance of these early nonlinear effects. It is possible that the nonlinear features captured via DDA provide a more proximal and direct readout of the neurophysiological substrate of ERP measures and the earliest detectable changes in the brain representing deviance detection.

DDA utilizes embeddings to reveal the underlying dynamical patterns of brain activity in the feature space. These patterns, which are otherwise not observable in the EEG using conventional linear ERP methods, are sensitive to even small perturbations in brain network dynamics—including those on a small regional scale. The extracted features also provide a natural measure of the magnitude of dynamical changes, which may correspond to the severity of dysfunction in neuropsychiatric illness. In addition to revealing important information about nonlinear dynamics hidden in the EEG signals, DDA offers a number of important technical advantages over commonly used ERP measures: it is computationally fast, provides fine temporal resolution (10-ms data windows), and requires only minimal preprocessing (i.e., demeaning of the data) to avoid discarding meaningful contextual information. Since time-consuming preprocessing steps (e.g., blink correction and filtering) are not required for DDA, even very large datasets can be analyzed in minutes rather than days, weeks, or even months.

Although DDA has great promise, several caveats should be noted. As a measure, DDA findings do not neatly map onto the vast existing literature, which has nearly exclusively relied on linear methods; DDA findings, therefore, may be challenging to interpret. Likewise, the DDA methods have not undergone the same degree of validation for use in clinical studies (e.g., reliability, suitability for use as a repeated measure, sensitivity to therapeutic interventions). As with the original papers describing the underlying data used in this report, another caveat is that medications in the SZ patients were not experimentally controlled. It is possible that some of the observed deficits in the DDA features of the SZ patients could be attributable to differences in their medication status. Likewise, other clinical factors could also influence DDA findings. It is noteworthy that the large COGS-2 dataset allows for additional tests to verify that the observed SZ-related effects are not driven by group differences in age or sex (SI Appendix, Figs. S10 and S11). Future studies are required to disentangle medication effects and interacting clinical variables from the current DDA findings in SZ (1, 10). However, if DDA is sensitive to medication or clinical changes, this rapid approach may be useful for biomarker-guided clinical trial approaches.

Despite the caveats of this study, these results represent a clear and powerful demonstration of the potential benefits of using nonlinear techniques to study important nonlinear aspects of natural phenomena, including neural function. By applying DDA to this large, rich dataset, we were able to obtain linear and nonlinear features related to auditory information processing in healthy subjects and corresponding deficits observed in SZ patients. Elucidating the links among DDA features and brain network dynamics can lead to a better understanding of pathophysiology of cognitive impairment in SZ and neuropsychiatric disorders as well as contribute to biomarker-guided strategies to accelerate the development of treatments for CNS disorders.

Materials and Methods

The COGS-2 Data Collection.

Data were collected at five centers across the United States: the University of California, San Diego; the University of California, Los Angeles; the University of Washington; the University of Pennsylvania; and Mount Sinai School of Medicine. Written consent was obtained from all of the participants, and the study was approved by the local human research protection committees at each site. Samples from a total of 1,630 COGS-2 subjects were analyzed: 877 SZ patients and 753 NCSs. Trains of auditory stimuli presented to each subject consisted of 50-ms standard tones (90% of stimuli) and 100-ms deviant tones (10% of stimuli) as shown in Fig. 4. There were a minimum of 1 standard tone and a maximum of 18 standard tones between deviants. EEG recordings were conducted at a sampling rate of 1 kHz from a single electrode at the CZ (central zero) position.

Fig. 4.

Fig. 4.

Subjects in both SZ and NCS groups were presented with auditory stimuli consisting of 50-ms standard tones with randomly interspersed 100-ms deviant tones. Data were analyzed according to a traditional ERP paradigm (Left) and using DDA to assess nonlinear dynamics (Right). In the standard ERP approach, EEG time series from standard (dashed lines) and deviant trials (solid lines) were averaged after preprocessing, and the difference waveform was computed from these averages. With DDA, a three-term delay differential equation was applied to the data, and the nonlinear coefficient a3 was computed for both standard and deviant trials. Both ERP difference waveforms and the DDA a3 coefficient time courses are aligned to tone onset, which is marked with vertical dashed lines at 0 ms.

ERP Analysis.

The COGS-2 data for each subject were segmented into trials with duration of 550 ms. Each trial contained 100-ms pretone and 450-ms posttone ERP signals. Trials corresponding to deviant tones (n = 150) and standard tones (n = 150) were extracted from each subject. Eye movement artifact was removed using a second-order blind identification algorithm, and trials containing residual artifact (signal activity >±50 μV) were discarded. Finally, the average standard tone responses were subtracted from the average deviant tone responses.

DDA of EEG Data.

DDA features are usually estimated from a data window of length L as shown in Fig. 5. The data for each such window are normalized to zero mean and unit variance to remove amplitude information. Sliding overlapping windows are then applied to the data. For the COGS-2 data, windows of 10 ms were used, and the corresponding points are plotted at the beginning of each time window for all of the figures. Fig. 5 shows the single-trial version of DDA. The feature set {a1,2,3,ρ} is estimated from each trial, and then, the mean over several trials is taken as the nonlinear counterpart to traditional ERP, where the mean of the data (after preprocessing) is used. The difference is that, for DDA, the raw data are processed for each data window separately. To improve the performance and to reduce the number of trials needed, cross-trial DDA was used (SI Appendix, Fig. S3). Using the ergodic hypothesis (37), data windows of multiple trials were combined, and features were computed across trials. The DDA coefficients were estimated simultaneously from 150 trial windows (SI Appendix, Figs. S1–S11). Supervised structure selection was used to identify the delays that led to optimal group classification (A) (32). Note that these delays have no frequency correspondence due to the nonlinear nature of the DDA model (25). Results from a3, the most salient feature, are presented. As a measure of classification performance, the area A under the receiver operating characteristic was used (38). An unpaired Student’s t test was used to assess the significance of differences between the SZ and NCS groups as observed in both traditional trial mean difference waveforms and the DDA a3 coefficient. The false discovery rate was adjusted using the Benjamini–Hochberg procedure. The optimal delays for the COGS-2 dataset were τ=(3,8)time points, corresponding to (3, 8) ms.

Fig. 5.

Fig. 5.

Estimation of the features a1,2,3 for a data window of length L for Eq. 2.

Supplementary Material

Supplementary File

Acknowledgments

This work was supported in part by NIH Grants R01-MH065571, R01-MH042228, R01-MH07977, K23-MH102420, R01-MH065554, R01-MH65707, R01-MH65578, R01-MH65558, R01-MH059803, and R01-MH094320. This work was also supported by the Sidney R. Baer, Jr. Foundation; the Department of Veterans Affairs; the Medical Research Service of the Veterans Affairs San Diego Health Care System; the Department of Veterans Affairs Desert Pacific Mental Illness Research, Education, and Clinical Center; and the Brain and Behavior Research Foundation.

Footnotes

Conflict of interest statement: G.A.L. has served as a consultant to Astellas, Boehringer-Ingelheim, Dart Neuroscience, Heptares, Lundbeck, Merck, NASA, NeuroSig, and Takeda. The other authors report no biomedical financial interests or potential conflicts of interests.

2A complete list of the COGS Investigators can be found in SI Appendix.

This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1810572116/-/DCSupplemental.

Contributor Information

Collaborators: Gregory A. Light, Neal R. Swerdlow, Michael L. Thomas, Michael F. Green, Tiffany A. Greenwood, Raquel E. Gur, Ruben C. Gur, Laura C. Lazzeroni, Keith H. Nuechterlein, Allen D. Radant, Larry J. Seidman, Richard F. Sharp, Larry J. Siever, Jeremy M. Silverman, Joyce Sprock, William S. Stone, Catherine A. Sugar, Debby W. Tsuang, Ming T. Tsuang, Bruce I. Turetsky, and David L. Braff

References

  • 1.Thomas ML, et al. Modeling deficits from early auditory information processing to psychosocial functioning in schizophrenia. JAMA Psychiatry. 2017;74:37–46. doi: 10.1001/jamapsychiatry.2016.2980. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Del Re E, et al. Analysis of schizophrenia-related genes and electrophysiological measures reveals ZNF804A association with amplitude of P300b elicited by novel sounds. Transl Psychiatry. 2014;4:e346. doi: 10.1038/tp.2013.117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Turetsky BI, et al. The utility of P300 as a schizophrenia endophenotype and predictive biomarker: Clinical and socio-demographic modulators in COGS-2. Schizophr Res. 2015;163:53–62. doi: 10.1016/j.schres.2014.09.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Wynn JK, Sugar C, Horan WP, Kern R, Green MF. Mismatch negativity, social cognition, and functioning in schizophrenia patients. Biol Psychiatry. 2010;67:940–947. doi: 10.1016/j.biopsych.2009.11.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Swerdlow NR, et al. Memantine effects on sensorimotor gating and mismatch negativity in patients with chronic psychosis. Neuropsychopharmacology. 2016;41:419–430. doi: 10.1038/npp.2015.162. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Perez VB, et al. Mismatch negativity is a sensitive and predictive biomarker of perceptual learning during auditory cognitive training in schizophrenia. Neuropsychopharmacology. 2017;42:2206–2213. doi: 10.1038/npp.2017.25. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Rissling AJ, et al. Disentangling early sensory information processing deficits in schizophrenia. Clin Neurophysiol. 2012;123:1942–1949. doi: 10.1016/j.clinph.2012.02.079. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Rissling AJ, et al. Cortical substrates and functional correlates of auditory deviance processing deficits in schizophrenia. NeuroImage Clin. 2014;6:424–437. doi: 10.1016/j.nicl.2014.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Todd J, Michie PT, Schall U, Ward PB, Catts SV. Mismatch negativity (MMN) reduction in schizophrenia–Impaired prediction-error generation, estimation or salience? Int J Psychophysiology. 2012;83:222–231. doi: 10.1016/j.ijpsycho.2011.10.003. [DOI] [PubMed] [Google Scholar]
  • 10.Light GA, et al. Validation of mismatch negativity and P3a for use in multi-site studies of schizophrenia: Characterization of demographic, clinical, cognitive, and functional correlates in COGS-2. Schizophr Res. 2015;163:63–72. doi: 10.1016/j.schres.2014.09.042. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Oribe N, et al. Progressive reduction of visual P300 amplitude in patients with first-episode schizophrenia: An ERP study. Schizophr Bull. 2015;41:460–470. doi: 10.1093/schbul/sbu083. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Turetsky BI, et al. The utility of P300 as a schizophrenia endophenotype and predictive biomarker: Clinical and socio-demographic modulators in COGS-2. Schizophr Res. 2015;163:53–62. doi: 10.1016/j.schres.2014.09.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Knott V, Mahoney C, Kennedy S, Evans K. EEG power, frequency, asymmetry and coherence in male depression. Psychiatry Res Neuroimaging. 2001;106:123–140. doi: 10.1016/s0925-4927(00)00080-9. [DOI] [PubMed] [Google Scholar]
  • 14.Roach BJ, Mathalon DH. Event-related EEG time-frequency analysis: An overview of measures and an analysis of early gamma band phase locking in schizophrenia. Schizophr Bull. 2008;34:907–926. doi: 10.1093/schbul/sbn093. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Light GA, et al. Single-dose memantine improves cortical oscillatory response dynamics in patients with schizophrenia. Neuropsychopharmacology. 2017;42:2633–2639. doi: 10.1038/npp.2017.81. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Moran LV, Hong LE. High vs low frequency neural oscillations in schizophrenia. Schizophr Bull. 2011;37:659–663. doi: 10.1093/schbul/sbr056. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Kirihara K, Rissling AJ, Swerdlow NR, Braff DL, Light GA. Hierarchical organization of gamma and theta oscillatory dynamics in schizophrenia. Biol Psychiatry. 2012;71:873–880. doi: 10.1016/j.biopsych.2012.01.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Breakspear M. Dynamic models of large-scale brain activity. Nat Neurosci. 2017;20:340–352. doi: 10.1038/nn.4497. [DOI] [PubMed] [Google Scholar]
  • 19.Murray JD, et al. Linking microcircuit dysfunction to cognitive impairment: Effects of disinhibition associated with schizophrenia in a cortical working memory model. Cereb Cortex. 2014;24:859–872. doi: 10.1093/cercor/bhs370. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Paulus MP, Braff DL. Chaos and schizophrenia: Does the method fit the madness? Biol Psychiatry. 2003;53:3–11. doi: 10.1016/s0006-3223(02)01701-8. [DOI] [PubMed] [Google Scholar]
  • 21.Breakspear M, et al. A disturbance of nonlinear interdependence in scalp EEG of subjects with first episode schizophrenia. Neuroimage. 2003;20:466–478. doi: 10.1016/s1053-8119(03)00332-x. [DOI] [PubMed] [Google Scholar]
  • 22.Stephan KE, Baldeweg T, Friston KJ. Synaptic plasticity and dysconnection in schizophrenia. Biol Psychiatry. 2006;59:929–939. doi: 10.1016/j.biopsych.2005.10.005. [DOI] [PubMed] [Google Scholar]
  • 23.Breakspear M, Terry J. Topographic organization of nonlinear interdependence in multichannel human eeg. Neuroimage. 2002;16:822–835. doi: 10.1006/nimg.2002.1106. [DOI] [PubMed] [Google Scholar]
  • 24.Terry JR, Breakspear M. An improved algorithm for the detection of dynamical interdependence in bivariate time-series. Biol Cybern. 2003;88:129–136. doi: 10.1007/s00422-002-0368-4. [DOI] [PubMed] [Google Scholar]
  • 25.Lainscsek C, Sejnowski T. Delay differential analysis of time series. Neural Comput. 2015;27:594–614. doi: 10.1162/NECO_a_00706. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Lainscsek C, Messager V, Portman A, Sejnowski TJ, Letellier C. 2014. Automatic sleep scoring from a single electrode using delay differential equations. Applied Non-Linear Dynamical Systems, Springer Proceedings in Mathematics & Statistics, ed Awrejcewicz J (Springer, Cham, Switzerland), Vol 93, pp 371–382.
  • 27.Lainscsek C, Sejnowski T. Electrocardiogram classification using delay differential equations. Chaos. 2013;23:023132. doi: 10.1063/1.4811544. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Kremliovsky M, Kadtke J. Using delay differential equations as dynamical classifiers. AIP Conf Proc. 1997;411:57. [Google Scholar]
  • 29.Lainscsek C, et al. Nonlinear DDE analysis of repetitive hand movements in Parkinson’s disease. In: In V, Longhini P, Palacios A, editors. Applications of Nonlinear Dynamics, Understanding Complex Systems. Springer; Berlin: 2009. pp. 421–427. [Google Scholar]
  • 30.Lainscsek C, et al. Finger tapping movements of Parkinson’s disease patients automatically rated using nonlinear delay differential equations. Chaos. 2012;22:013119. doi: 10.1063/1.3683444. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Lainscsek C, Sejnowski T. Delay differential equation models of electrocardiograms. In: In V, Palacios A, Longhini P, editors. Proceedings of the International Conference on Theory and Applications in Nonlinear Dynamics. Springer International Publishing; Cham, Switzerland: 2013. pp. 67–76. [Google Scholar]
  • 32.Lainscsek C, Weyhenmeyer J, Hernandez M, Poizner H, Sejnowski T. Non-linear dynamical classification of short time series of the Rössler system in high noise regimes. Front Neurol. 2013;4:182. doi: 10.3389/fneur.2013.00182. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Lainscsek C, Hernandez ME, Weyhenmeyer J, Sejnowski TJ, Poizner H. Non-linear dynamical analysis of EEG time series distinguishes patients with Parkinson’s disease from healthy individuals. Front Neurol. 2013;4:200. doi: 10.3389/fneur.2013.00200. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Lainscsek C, Weyhenmeyer J, Cash SS, Sejnowski TJ. Delay differential analysis of seizures in multichannel electrocorticography data. Neural Comput. 2017;29:3181–3281. doi: 10.1162/neco_a_01009. [DOI] [PubMed] [Google Scholar]
  • 35.Sampson AL, et al. Delay differential analysis for dynamical sleep spindle detection. J Neurosci Methods. 2019 doi: 10.1016/j.jneumeth.2019.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Kohavi R. Proceedings of the 14th International Joint Conference on Artificial Intelligence—Volume 2, IJCAI’95. Morgan Kaufmann Publishers Inc.; San Francisco: 1995. A study of cross-validation and bootstrap for accuracy estimation and model selection; pp. 1137–1143. [Google Scholar]
  • 37.Boltzmann L. Vorlesungen über Gastheorie. J.A. Barth; Leipzig, Germany: 1898. [Google Scholar]
  • 38.Hand D, Till R. A simple generation of the area under the ROC curve for multiple class classification problems. Machine Learn. 2001;45:171–186. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary File

Articles from Proceedings of the National Academy of Sciences of the United States of America are provided here courtesy of National Academy of Sciences

RESOURCES