Abstract
Schizophrenia is among the most debilitating neuropsychiatric disorders. However, clear neurophysiological markers that would identify at-risk individuals represent still an unknown. The aim of this study was to investigate possible alterations in the resting alpha oscillatory activity in normal population high on schizotypy trait, a physiological condition known to be severely altered in patients with schizophrenia. Direct comparison of resting-state EEG oscillatory activity between Low and High Schizotypy Group (LSG and HSG) has revealed a clear right hemisphere alteration in alpha activity of the HSG. Specifically, HSG shows a significant slowing down of right hemisphere posterior alpha frequency and an altered distribution of its amplitude, with a tendency towards a reduction in the right hemisphere in comparison to LSG. Furthermore, altered and reduced connectivity in the right fronto-parietal network within the alpha range was found in the HSG. Crucially, a trained pattern classifier based on these indices of alpha activity was able to successfully differentiate HSG from LSG on tested participants further confirming the specific importance of right hemispheric alpha activity and intrahemispheric functional connectivity. By combining alpha activity and connectivity measures with a machine learning predictive model optimized in a nested stratified cross-validation loop, current research offers a promising clinical tool able to identify individuals at-risk of developing psychosis (i.e., high schizotypy individuals).
Subject terms: Neuroscience, Cognitive neuroscience, Consciousness
Introduction
Schizophrenia is a highly debilitating and complex mental disorder characterized by impairments in integrating sensory and cognitive functions leading to incoherent perception. Schizophrenia often arises in late adolescence or early adulthood and is typically preceded by a high-risk (prodromal) phase, during which subtle neurocognitive impairments and sub-threshold psychotic symptoms usually emerge1. For this reason, increasing research efforts are focused upon identifying predictive neurobiological markers for early diagnosis in individuals at risk. Heightened risk for the development of a psychotic disorder is associated with schizotypal traits2. Substantial overlapping has been found between schizotypy and schizophrenia at genetic, biological and neurocognitive levels3–5, strongly supporting the claim of a continuous nature of schizotypy. Specifically, genome-wide association (GWA) research indicates that a vast number of independent polymorphisms confer risk6–8 for psychosis proneness, whereas schizophrenia represents the extreme of these multiple quantitative dimensions. These genetic factors explain about 50% of the schizotypic variance3, whereas the remaining variance can be explained by biological9–12 and psychosocial13–16 factors. Taken together, these common genetic and environmental underpinnings have led to the assumption that schizotypy reflects the subclinical expression of the symptoms of schizophrenia in the general population17–19.
Several studies of patients at different stages of schizophrenia, including the prodromal phases preceding the onset of the disorder, have recently reported abnormal spontaneous alpha oscillations and altered resting-state functional connectivity of the alpha rhythm20–23. Crucially, alpha rhythm is generated by a complex interplay between thalamic and cortical pacemakers and propagates via short and long range cortico-cortical, cortico-thalamic, and thalamo-cortical connections24,25. It is well known that large bursts of alpha (7–13 Hz) band activity dominate the human electroencephalogram (EEG) during periods of rest26. However, whether abnormalities of resting-state alpha rhythm are already present in individuals with high schizotypal personality traits, and can be taken as early risk predictors for these individuals, is still unknown. There is plenty of evidence in support of this hypothesis.
Murphy and Ongur27 reported decreased peak alpha frequency in first episode psychosis patients. Specifically, they found alpha slowing in posterior regions, while peak alpha frequency did not decrease significantly in frontal and temporal regions. Further supporting the clinical relevance of abnormal peak alpha frequency to schizophrenia, there is evidence available for therapeutic effects of individualized alpha frequency transcranial magnetic stimulation on the negative symptoms of schizophrenia28.
Moreover, according to the idea that schizophrenia originates as a disconnection syndrome29, first episode psychosis patients show abnormal functional connectivity, as estimated using the phase lag index (PLI), especially in the alpha rhythm. Hence, also alpha PLI, in addition to peak alpha frequency, seems to be valuable for producing clinical significance already at the onset of schizophrenia20.
Interestingly, alpha waves propagate from anterior-to-posterior and from the cortex to the thalamus30–33, so that cortico-cortical and cortico-thalamo-cortical connections allow frontal regions to drive posterior alpha activity. All in all, this evidence led to the idea that alpha rhythm plays an important role during top-down processing in healthy conditions34–36. Rest EEG connectivity studies specifically testing the association between abnormal directionality of the anterior-to-posterior propagating alpha rhythm and schizophrenia risk are currently unavailable though. However, the altered alpha band activity recorded in ultra-high-risk individuals during an auditory oddball task has been proposed to indicate that a deficit in top-down control exists before the onset of schizophrenia37. In sum, while there is now enough evidence available indicating that abnormal rest EEG alpha rhythm characterizes already the onset of schizophrenia, its potential role as an early marker of a predisposition toward schizophrenia in non-clinical populations is still poorly investigated20,38.
To fill this gap in the literature, in the present study we first established the association between sub-clinical schizotypy and specific indices of rest EEG alpha oscillatory activity (i.e., individual alpha peak frequency, IAF) and connectivity using both non-directional (i.e., weighted phase lag index, wPLI) and directional (i.e., time lag index, TLI) indices. The choice of investigating resting-state EEG features, rather than task-based EEG signals, has been motivated by both theoretical and practical reasons. From a theoretical standpoint, schizotypy is defined as a stable personality trait, thus possible alterations of EEG activity should be present already during resting-state. On a practical note, due to its simplicity and versatility, resting-state EEG recording can be considered an efficient screening tool that enables task-independent standardized measures for large scale assessments. Moreover, diagnostic accuracy in early onset psychosis and schizophrenia might be improved using machine learning approaches39, as already demonstrated in studies using genetic and neuroimaging features6,40. Similarly, machine learning methods allow to classify EEG features and thus identify clinical conditions based on EEG patterns. Indeed, recent machine learning studies in schizophrenia patients identified altered amplitudes and time lag in frontal event-related potentials41, lower levels of frontal alpha amplitude during working memory tasks42, functional alterations of alpha power spectrum over occipital-parietal and frontal areas43 and altered thalamo-cortical connectivity44. Therefore, we trained and tested a pattern classifier to create a predictive model able to assess the presence of high schizotypal traits based on the alpha resting state activity of an individual.
Results
Resting-state EEG activity was recorded in a sample of 48 participants. Participants were divided into two groups based on the presence of schizotypal traits, estimated via Schizotypal Personality Questionnaire (SPQ)45. Two groups of 24 participants were subsequently created, based on SPQ score: a Low Schizotypal Group (LSG) with scores below the 20th percentile (Mean score: M = 7.62, Standard Error of the mean: SE = 0.52), and a High Schizotypal Group (HSG) with scores above the 80th percentile (M = 43.29, SE = 1.29). EEG was recorded from 64 scalp electrodes at rest for two minutes, while participants kept their eyes closed. An Independent Component Analysis (ICA) was performed for each participant to identify topographies reflecting activity in frontal and parieto-occipital areas for both the left and right hemisphere, representing our regions of interest (ROIs) for functional connectivity and alpha activity analyses.
EEG features
Power spectra over the ROIs, reflecting individual alpha frequency and amplitude (i.e., alpha activity) are shown in Fig. 1. In the following, t-test have been adjusted for multiple comparisons with corrected significance threshold p value of 0.013 for four comparisons (for details see methods). Analyses show a general faster alpha frequency, across groups (HSG vs. LSG) and ROIs (frontal and parieto-occipital), in the right hemisphere (M = 10.38 Hz, SE = 0.12 Hz) compared to the left hemisphere (M = 10.25 Hz, SE = 0.11 Hz) (main effect of hemisphere F(1,46) = 10.37, p = 0.002, pη2 = 0.18, 90% CI [0.03; 0.37]). More in detail, a significant three-way interaction (Group x Hemisphere x ROIs, F(1,46) = 4.44, p = 0.040, pη2 = 0.09, 90% CI [0.01; 0.23]) suggests that this hemispheric asymmetry in alpha frequency is more prominent at a parieto-occipital relative to frontal level, and specific for the LSG (Mleft = 10.39 Hz, SE = 0.14 Hz; Mright = 10.70 Hz; SE = 0.17 Hz) (one-tailed t(23) = 2.48, p = 0.011, Effect size Cohen’s d = 0.51, 90% CI [0.14; 0.86]). Interestingly, at a parieto-occipital level also a group difference emerged, with faster alpha frequency in LSG (M = 10.70 Hz, SE = 0.17 Hz) compared to HSG (M = 10.09 Hz, SE = 0.17 Hz) (one-tailed t(46) = 2.60, p = 0.006, d = 0.75, 90% CI [0.25; 1.24]).
In line with the notion of a postero-anterior gradient46, our analyses also showed greater alpha amplitude over the parieto-occipital ROI (M = 9.50μv, SE = 0.95μv) compared to the frontal ROI (M = 1.26μv, SE = 0.94μv) (main effect of the ROI, F(1,46) = 135.43, p < 0.001, pη2 = 0.75, 90% CI [0.63; 0.81]). Additionally, as for alpha frequency, a similar hemispheric asymmetry emerged for alpha amplitude (main effect of hemisphere F(1,46) = 5.13, p = 0.028, pη2 = 0.10, 90% CI [0.03; 0.32]). In particular, the right hemisphere shows lower alpha amplitude (M = 5.16μv, SE = 0.88μv) compared to the left hemisphere (M = 5.60μv, SE = 0.88μv). Importantly, the mentioned patterns of alpha amplitude are differently modulated between groups (significant three-way interaction F(1,46) = 6.30, p = 0.016, pη2 = 0.12, 90% CI [0.01; 0.27]). Specifically, the described inter-hemispheric asymmetries in the alpha amplitude distribution are present in the LSG only over the frontal ROIs, with a higher alpha amplitude in the left hemisphere (M = 2.03μv, SE = 1.27μv) compared to the right hemisphere (M = 1.13μv, SE = 1.22μv) (t(23) = 2.51, p = 0.019, d = 0.51, 90% CI [0.15; 0.86]) which however, does not survive multiple comparisons (corrected significance threshold p = 0.013; see Methods). On the other hand, there is an analogous asymmetry shifted back over the parieto-occipital ROI in the HSG (Mleft = 9.39μv, SE = 1.51μv; Mright = 8.37μv, SE = 1.58μv) (t(23) = 2.09, p = 0.048, d = 0.43, 90% CI [0.07; 0.77]), which however, does not survive multiple comparisons (corrected significance threshold p = 0.013; see Methods).
Functional connectivity across groups (LSG and HSG) was estimated based on phase connectivity measures between ROIs in the alpha frequency peak (Fig. 2). In the following, t-test have been adjusted for multiple comparisons with corrected significance threshold p value of 0.017 for three comparisons (for details see methods). An inter-group difference in the wPLI was found over the fronto-parieto-occipital connectivity in the right hemisphere (t(46) = 3.26, p = 0.002, d = 0.94, 90% CI [0.43; 1.44]), with the HSG showing a lower value of wPLI compared to the LSG (Mhigh = 0.08, SEhigh = 0.01; Mlow = 0.15, SElow = 0.02). No differences in connectivity were found between groups over the other considered ROIs (all ts < 0.90, all ps > 0.37, all ds < 0.26). Analysis of the time lag yielded similar results, further confirming the nature of the differential effect between HSG and LSG selectively observed between frontal and parieto-occipital ROIs in the right hemisphere (t(46) = 2.85, p = 0.006, d = 0.82, 90% CI [0.32; 1.31]). More in detail, the mean values of the TLI suggest that not only timing, but also the direction of communication in the right hemisphere is significantly different in the two groups (Mhigh = 7.04 ms, SEhigh = 4.67 ms; Mlow = − 11.21 ms, SElow = 4.37 ms). Indeed, while in the LSG the phase of the frontal precedes the phase of the parieto-occipital ROI, in the HSG the opposite trend is observed.
Taken together, EEG data show group differences in the right hemisphere in terms of alpha speed (slower alpha in the HSG) and in the hemispheric distribution of alpha amplitude (asymmetry shifted from frontal to parieto-occipital ROIs for HSG compared to LSG). Moreover, connectivity measures in the HSG support the disconnection syndrome hypothesis29 by pointing to a reduced and even altered fronto-parieto-occipital connectivity in the right hemisphere.
Machine learning pattern classifiers
According to information gathered from the literature on EEG markers of schizophrenia, a pattern classifier has been trained and tested with the aim of creating a predictive model able to assess the presence of schizotypal traits based on the alpha resting state activity and connectivity (Fig. 3). In particular, we have looked at alpha peak frequency, shown to be generally reduced in schizophrenia21,27, alpha amplitude, also shown to be altered in schizophrenia23,47, and measures of fronto-parietal connectivity (including wPLI and TLI), as schizophrenia has been defined as a functional disconnection syndrome within the default mode network encompassing fronto-parietal networks20,48,49.
Moreover, in order to distinguish between HSG and LSG, these features were included as possible input features of the models either for both right and left hemisphere or separately for each hemisphere. At the same time, we looked separately at frontal and posterior features with particular focus on posterior alpha activity and intrahemispheric connectivity. This was determined by the fact that literature on schizophrenia has shown an important discrepancy between studies supporting a general alteration of these features22,23,50, other pointing to a more specific hemispheric alteration20,38,51,52 and finally findings revealing altered alpha indices specifically at posterior sites and excluding frontal regions in patients with first episode psychosis27. Using a tenfold nested cross-validation (CV) procedure, repeated 1000 times, in the test sets of the outer CV, we observed a sensitivity of 78.8% (4.9%) [mean (standard deviation)], specificity of 69.7% (5.2%), balanced accuracy of 74.3% (3.8%) and area under the receiver operating characteristic – curve (AUC) of 0.83 (0.04). The plot of the average ROC curve across 10 000 outer loops of the nested CV (10 folds × 1000 repetitions) along with the standard deviation and the 99.9% confidence interval of the average is shown in Fig. 4. The ranking of the best feature combination has been reported in Fig. 5.
The first three combinations included only the right hemisphere activity and, overall, accounted for the 96.2% of the total occurrences. The remaining 3.8% was accounted for by the left + right hemisphere activity. Feature combinations including only left features were never selected.
In general, machine learning results suggest that differences between groups are maximal over the right hemisphere, or in other words, that right hemispheric features of alpha activity are the best predictors of schizotypal traits.
Discussion
In the present study, we used a machine learning approach to identify biomarkers able to predict which individuals are at higher risks of developing schizophrenic symptoms. To the best of our knowledge, our study represents the first application of machine learning techniques to investigate resting-state EEG features in assessing the presence of high schizotypy traits. In particular, we investigated possible alterations of resting-state alpha oscillatory activity, known to be impaired in patients with schizophrenia, in the healthy population either high or low in schizotypy traits. To this aim, different parameters of resting-state alpha band activity have been included in the study: (1) alpha-amplitude (2) individual alpha frequency (IAF) (3) and indices of phase connectivity between distant neural ensembles within the alpha frequency range. Additionally, measures of alpha-amplitude and IAF have been investigated separately across the two hemispheres (left and right clusters of electrodes) and individually for two different regions of interest (frontal and parieto-occipital clusters), along with both interhemispheric (between parieto-occipital electrodes of left and right hemisphere) and intrahemispheric (between frontal and parieto-occipital electrodes of both left and right hemisphere) measures of alpha phase connectivity. Crucially, the above-mentioned indices of alpha activity were used as input features of a state-of-the-art pattern classifier, with the aim of building a model able to predict the presence of schizotypy traits of an individual based on resting-state alpha activity, thus even establishing a distinct and influential role of alpha oscillatory activity as electrophysiological marker of schizotypy dimension. The pattern classifier used a nested stratified CV loop to perform, at the same time, in the inner CV loop, selection of the best feature combination in discriminating the presence of schizotypal traits, as well as the best classifier (between C-SVM with linear kernel and logistic regression with L2 penalty) along with their hyper-parameter optimization.
Our results indicate that alterations of IAF are present in the high schizotypy group. In particular, high schizotypy seems to be accompanied by a decreased IAF in the right occipital component. The slowing of resting-state alpha activity has been reported in schizophrenia patients21, as well as in first episode psychosis27. Here, we found that this slowing is present also in the high schizotypy population, but restricted to the right parieto-occipital region.
In addition to these changes in IAF, high schizotypals also demonstrated an asymmetry of alpha-amplitude in parieto-occipital regions, with reduced alpha-amplitude in the right hemisphere. Diminished resting-state alpha-amplitude has previously been found both in individuals with psychotic disorders and their healthy relatives22,23, although even opposite results have been reported47, as well as null differences between first episode psychosis patients and healthy controls27. These discrepancies could be due to between-study differences in methodology and EEG data processing, illness chronicity or diagnostic heterogeneity, some of which could be clarified by systematically investigating the identified biomarkers both in clinical and subclinical populations.
Finally, measures of long-range connectivity in the alpha range have shown a distinct alteration in HSG. Specifically, similar to IAF results, differences between groups emerge only in the right hemisphere, with a reduced connectivity between frontal and parieto-occipital areas in HSG as measured by wPLI that, furthermore seems to follow an opposite parieto-frontal direction as shown through TLI measures. Moreover, no differences in interhemispheric connectivity have been observed between HSG and LSG. Altogether connectivity analyses point to reduced resting-state functional communication between frontal and parietal areas within the alpha range in the HSG, in line with previous results describing a similar pattern in schizophrenia patients20 but restricted to the right hemisphere in schizotypy.
In order to affirm that high schizotypals can be identified on a single subject level based on neural indices, thus by observing their resting-state alpha activity, a pattern classifier has been trained and tested which, if the hypothesis holds, should be able to successfully differentiate between HSG and LSG. Apart from being able to predict the participants group membership (low vs. high schizotypy) based on all the examined features of resting-state alpha activity (74.3% of balanced accuracy), two interesting dissociations have emerged. The first one concerns frontal and parieto-occipital features, with solely the latter being able to successfully differentiate between the two groups (frontal features do not seem to contribute to differentiating the two groups; see Fig. 5). This outcome is in line with previous findings which have not revealed altered alpha indices over frontal regions in patients with first episode psychosis27. Secondly, differences in alpha activity between the HSG and LSG seem to be present only in the right hemisphere (best feature rankings including only left features were never selected). Throughout the years, several theories have been proposed describing schizophrenia as an interhemispheric imbalance. Amongst the proposed genesis of this imbalance, both hypo-functioning and/or hyper-functioning of the one hemisphere have been hypothesized53–55, although often without firm empirical grounds to dissociate these alternatives. Our results support an altered pattern within the right hemisphere showing a slower and reduced alpha activity and an exclusively intrahemispheric altered communication between frontal and parietal regions. Following the dimensional approach, one could hypothesize either that the right hemisphere dysfunction could be more pronounced in schizophrenia, or alternatively, can instantiate the insurgence of first psychotic symptoms by spreading the right hemisphere dysfunction to the left hemisphere, thus resulting in a more generalized disconnection syndrome. Current research in schizophrenia does not point to the idea of a hindered right hemispheric activity but to a more spread dysconnectivity so future research should systematically point to identify whether the neurophysiological prodromal phase leading from a subclinical to a clinical psychotic condition may reside in an interhemispheric spreading.
Conclusions
Overall, our results clearly demonstrate that the altered patterns of resting-state alpha activity observed in schizophrenia patients can be tracked already before the onset of the psychosis. Specifically, we observe the presence of an altered pattern concerning the resting-state alpha oscillatory activity in the high, relative to the low schizotypy population. Thus, alpha activity seems to represent an important electrophysiological marker, which may likely pave a higher risk of developing schizophrenia spectrum psychopathology according to specific indices as pointed out by our study. Interestingly, these differences are most evident in the right posterior region and its’ functional connections with the right anterior cortex. The right parieto-occipital deficit and fronto-parietal disconnection syndrome in the HSG may significantly alter both sensory processing per se, but also top-down influence on controlling sensory processing. Therefore, this research offers a firm ground to future investigations to identify patterns of neural and cognitive developments anticipating at high-risk individuals and in describing neurocognitive (dis)functioning across the schizophrenia spectrum.
Although representing a valid tool for detection and measurement of schizotypy45, SPQ still represents a self-report questionnaire, thus facing various methodological issues56,57. Crucially, current research has employed computational methods in order to affirm the relevance of identified oscillatory features as important electrophysiological markers of schizotypy. Specifically, by building a pattern classifier, we were not only able to describe the existence of possible differences in alpha activity between HSG and LSG, but also to demonstrate their ability to successfully identify individuals high in schizotypy. Thus, this approach offers a novel accurate diagnostic tool able to detect biomarkers defining at-risk individuals of developing schizophrenia spectrum disorders, based on resting state alpha activity. In addition, the inclusion of other features (e.g., genetic and neuroimaging data) would likely enhance the over-all performance of the model, although not always feasible, due to time and resource constraints. Moreover, we note that due to the relatively small sample, it would be interesting to confirm the results obtained with our built pattern classifier by extending future machine learning applications to an independent and wider sample of participants. The availability of larger datasets will also pave the way to the adoption of deep learning approaches which may improve the overall performance.
The main aim of the current study was to identify EEG configurational pattern of activity that could represent a fingerprint of schizophrenia proneness. As such, the focus of this study was not on comparing EEG activity across different mental disorders. Therefore, by using state-of-the-art machine learning analysis of the EEG patterns implemented here, future studies should empirically test whether the EEG activity pattern identified here is specific for schizophrenia risk or rather represents a transdiagnostic biomarker of risk for psychopathology.
Finally, the question remains how do altered patterns in alpha activity during rest translate into relevant cognitive processing? Both alpha amplitude and long-range fronto-parietal alpha synchronization have a well-determined roles in visuo-attentional inhibition and selection58, along with occipital alpha peak frequency acting as temporal and spatial sampling mechanism59–66. Therefore, should we expect these altered patterns to persist even during visuo-attentional tasks, leading to reduced attentional efficiency and altered perception in schizotypy? Future research is expected to address these questions, establishing a tight link between schizotypy and schizophrenia, thus enabling an accurate and detailed description of early markers of psychosis.
Materials and methods
Participants
Participants were selected on a sample of 350 students from the University of Bologna based on the presence of schizotypal traits, estimated via Schizotypal Personality Questionnaire (SPQ). Two age- (t(46) = 1.56, p = 0.124, d = 0.45, 90% CI [− 0.12; 1.02]) and gender-matched (χ2 = 0.76, p = 0.38) groups of 24 participants were subsequently created, based on SPQ score: a Low Schizotypal Group (LSG) with scores below the 20th percentile (Mean score: M = 7.62, Standard Error of the mean: SE = 0.52), and a High Schizotypal Group (HSG) with scores above the 80th percentile (M = 43.29, SE = 1.29) who agreed to take part in the present study. As a result, a sample of 48 participants (see Table 1 for detailed demographics) was recruited for electrophysiological data collection.
Table 1.
LSG | HSG | |
---|---|---|
Participants | 24 | 24 |
Mean age (yrs) (SEM) | 23.12 (0.50) | 22.08 (0.44) |
Males | 9 | 12 |
Females | 15 | 12 |
SPQ score range (M) | 3–11 (7.62) | 32–57 (43.29) |
Each group counted one left-handed subject. All participants signed a written informed consent prior to take part in the study, which was conducted in accordance with the Declaration of Helsinki67, and approved by the Bioethics Committee of the University of Bologna. All participants had no neurocognitive or psychiatric disorders.
EEG recordings
Participants were comfortably seated in a room with dimmed lights. EEG was recorded at rest for two minutes, while participants kept their eyes closed68. A set of 64 Ag/AgCl electrodes was mounted according to the international 10–20 system (Fast’n Easy-Electrode, Easycap, Herrsching, Germany). Additionally, four EoG channels were positioned: on the outer canthi of both eyes, as well as above and below the left eye. The right and left mastoids were used as the online and off-line reference, respectively. Ground was positioned on the right cheek of the subject. All impedances were kept below 10 kΩ. EEG signals were recorded with a pass band filter 0.5–50 Hz (as set in Brain Vision Recorder, Brain Products, Gilching, Germany) at a sampling rate of 1000 Hz. Off-line data were resampled at 500 Hz (function pop_resample on EEGLab) and re-referenced to the average of all electrodes.
All EEG analyses were implemented by custom-made routines developed in Matlab R2013a (The MathWorks, Inc., Natick, Massachusetts, United States) using EEGLab toolbox functions (v. 13.0.1)69.
EEG data processing
Resting state EEG data were band-pass filtered (using a Hamming windowed sync FIR filter implemented in the pop_eegfiltnew function on EEGLab) for alpha frequency 6 to 14 Hz, and epoched in 2000 ms temporal windows. An Independent Component Analysis (ICA) was performed for each participant to identify topographies reflecting activity in frontal and parieto-occipital areas for both the left and right hemisphere, representing our regions of interest (ROIs) for alpha analysis (see Fig. 6). ICA method separates EEG data on distinct information sources (i.e., independent components) and provides the weighted projection from each independent component to each scalp electrode70–72. In particular, individual alpha frequency peak (IAF) and alpha amplitude were extracted from individual power spectra separately over each ROI in subclusters of electrodes selected by visual inspection of the identified topographies: frontal ROIs (left electrode cluster: F1, FC1, C1, FC3, right electrode cluster: F2, FC2, C2, FC4), as well as parieto-occipital ROIs f (left electrode cluster: PO7, PO3 and 01, right electrode cluster: PO8, PO4 and O2). Weighted phase lag Index (wPLI)73 and time lag were used as indices of connectivity. In particular, inter-hemispheric connectivity was estimated between right and left parieto-occipital ROI and intra-hemispheric connectivity was estimated in both hemispheres between frontal and parieto-occipital ROIs.
First, four templates, reflecting spatial topography of the ROIs, were identified via visual inspection within all ICs: two central frontal components and two parieto-occipital components, one for each hemisphere (left and right). Subsequently, for each subject, relevant ICs were identified via automatic multistep correlational template matching (CORRMAP, 0.80 correlation threshold)74. Topographies of ICs labeled as frontal and parieto-occipital components were visually inspected and back-projected to the data for frequency, amplitude and connectivity analyses75. For each participant, a minimum of one and maximum of three components were identified per template.
EEG features extraction
Individual alpha peak and alpha amplitude were extracted from power spectra of each participant using an automated peak-detection algorithm (function RestingIAF on EEGLab)76. This algorithm uses a Sovitzky-Golay filter (SGF, frequency resolution 0.24 Hz, polynomial order 5 of the SGF), which smooth power spectra and attenuate random noise. Alpha amplitude was defined as the maximum alpha power, expressed in normalized power (10*log10(μv)2). To calculate wPLI, EEG resting state data were divided into 2500 ms non-overlapping windows77. Then the cross-spectrum of the time series signals was calculated and the wPLI estimates the magnitude of the imaginary part of the cross-spectrum. For each participant, wPLI was estimated as a function of individual alpha frequency peak and 14X14 connectivity matrices were generated over the selected electrode clusters (see above). Time lag estimates the mean difference in milliseconds of two time series spectra.
EEG features
Individual independent components (ICs) were analyzed in order to extract electrophysiological features both for frontal and occipito-parietal regions of interest (ROIs) in the right and left hemisphere to be entered in the machine learning pattern classifier.
The following EEG features were extracted:
Individual alpha frequency (IAF)
For each participant, IAF was defined as the exact frequency in the alpha range (7–13 Hz) containing the maximum power. It was extracted from the individual power spectra in the alpha range and calculated using an automated peak-detection algorithm (function RestingIAF on EEGLab)76.
Alpha amplitude
For each participant, alpha amplitude was defined as the maximum power in the alpha range (7–13 Hz), expressed in normalized power (10*log10(μv)2).
Weighted phase lag index (wPLI)
This feature was extracted to calculate functional connectivity in the alpha range. This is a measure of phase-based connectivity calculated in a specific frequency, which accounts only for non-zero phase lag/lead relations between two time series signals73. wPLI is calculated between two neurophysiologic signals and can assume values between 0 and 1. Larger values of wPLI reflect a consistent phase relation between two signals. If the relation between two signals is random, the wPLI value is 0. Connectivity between frontal and parieto-occipital ROIs in the right hemisphere was estimated on the averaged wPLI values calculated over the following electrode clusters: right frontal ROI (F2,FC2,C2,FC4) and right parieto-occipital ROI (PO8,PO4,O2). Similarly, left fronto parieto-occipital connectivity was estimated over left frontal ROI (F1,FC1,C1,FC3) and parieto-occipital ROI (PO7,PO3,O1).
Time lag index (TLI)
This feature adds a further dimension to the wPLI as it provides information about the directionality of the communication between two synchronized signals78. It represents the means of the temporal phase lag in the cross-spectrum between time series signals of the selected clusters and, unlike the wPLI, it offers further insight regarding the temporal dimension of the synchronization. Specifically, TLI is used to determine the averaged phase differences in milliseconds of two considered signals78. Positive values of the TLI indicate a lag in the phase of the first considered signal with respect to the other, thus indicating the directionality of the communication between two synchronized signals.
EEG data analysis
2 × 2 × 2 mixed-model ANOVAs were performed on IAF and alpha amplitude, with the between subject factor GROUP (HSG, LSG) and the within subject factors HEMISPHERE (left and right) and ROI (frontal and parieto-occipital ICs). Specific differences in the alpha activity were further tested both for alpha frequency (with paired and independent samples one-tailed t-tests as a directionality hypothesis was formulated14) and alpha amplitude (with paired and independent samples two-tailed t-tests). Between groups planned comparison were performed on wPLI and TLI using independent samples two-tailed t-tests. p values < 0.05 were considered significant, along with Dunn-Sidak correction procedures for multiple comparison being applied where necessary79, with a corrected significance threshold p value of 0.013 for four comparisons (alpha activity analyses) and a corrected significance threshold p value of 0.017 for three comparisons (connectivity analyses).
Machine learning pattern classifiers
To train, validate and test the classifier, we employed a tenfold nested stratified CV loop (Fig. 7). In particular, empirical evidence suggested that 5- or 10-fold CV should be preferred to leave-one-out (LOO) CV as consistently reported by both current literature80–83 and state-of-the-art machine learning development tools documentation (see, e.g., https://scikit-learn.org/stable/modules/cross_validation.html).
This strategy allowed us to perform, at the same time, in the inner CV loop, selection of the best feature combination in discriminating the presence of schizotypal traits, as well as the best classifier (between C-SVM with linear kernel and logistic regression with L2 penalty) along with their hyper-parameter optimization. Indeed, given that it is not possible to define a priori which is the best machine learning algorithm with respect to the data and the specific problem to address84, we used two well-established classifiers (C-SVM with linear kernel and logistic regression with L2 regularization), which are generally appropriate choices for reducing overfitting in a small sample. In particular, for a binary classification task, a C-SVM constructs a hyperplane in a high-dimensional space separating the training data into two classes. Since, in general, the larger the margin the lower the generalization error of the classifier, a good separation is achieved by the hyperplane that has the largest distance to the nearest training data points of any class85. On the other hand, logistic regression measures the relationship between the categorical dependent variable and one or more independent variables by estimating probabilities using a logistic sigmoid function86. The C hyperparameter of both the C-SVM and logistic regression classifiers takes a value that is proportional to the inverse of the regularization strength used during the training phase. For the C-SVM classifier, e.g., the choice of the C value is a trade-off between misclassification of training examples and simplicity of the decision surface. A low C value makes the decision surface smooth, while a high C value aims at classifying all training examples correctly. In this study, we varied the C value of both the C-SVM and logistic regression in the set {0.1, 0.2, 0.3}. We refer to specialized reference textbooks for a deeper description of these state-of-the-art systems85–87. Once the best estimator (determined by the best classifier/hyper-parameter/feature combination) maximizing the balanced accuracy was found in the inner CV, it was re-trained on the outer training set and tested on the test set kept out from the outer CV to obtain an unbiased estimation of the model’s prediction error. This procedure was repeated for each fold of the outer CV. Before each training (both in the inner and outer CV), each feature was standardized with reference to the training set only. Test set data were not used in any way during the learning process, thus preventing any form of peeking effect88.
Since the performance and the selected features may vary depending on how the data are split in each fold of the CV, we repeated the nested stratified CV procedure 1000 times recording the frequency that each feature combination was selected from each fold of the round of the outer CV. Average and standard deviation of the results from all repetitions in terms of sensitivity (the proportion of high schizotypes correctly identified as such), specificity (the proportion of low schizotypes correctly identified as such), balanced accuracy, and AUC were computed to get a final model assessment score in the test set of the outer-CV. The average ROC curve77 across 10 000 outer loops of the nested CV (10 folds × 1000 repetitions) along with the standard deviation and the 99.9% confidence interval of the average was also computed.
We used own code, freely available at https://github.com/sdiciotti/Schizotypy-prediction, developed in Python programming language (release 3.9.1) for data analysis using the scikit-learn module.
Author contributions
V.R. conceived the project; V.R., J.T., F.D.G., F.F., S.D. designed the experiment; V.R., J.T., F.D.G. Implemented the experiment; J.T. conducted the experiment; F.D.G., C.M. and S.D. analysed data; V.R., J.T., F.D.G., F.F., S.D. wrote the first draft of the paper. V.R., J.T., F.D.G., F.F., C.M., S.D. contributed to the final draft of the paper.
Funding
V.R. is supported by BIAL Foundation (204/18). FDG is supported by the Ministero della Salute (SG-2018–12367527).
Competing interests
The authors declare no competing interests.
Footnotes
The original online version of this Article was revised: The original version of this Article contained an error in Reference 6, which was incorrectly given as: Wu, Y. et al. Multi-trait analysis for genome-wide association study of five psychiatric disorders. Transl. Psychiatry 10.1038/s41398-020-00924-0 (2020). The correct reference is listed below: Wu, Y., Cao, H., Baranova, A. et al. Multi-trait analysis for genome-wide association study of five psychiatric disorders. Transl Psychiatry 10, 209 (2020). 10.1038/s41398-020-00902-6.
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Change history
6/23/2021
A Correction to this paper has been published: 10.1038/s41598-021-92571-8
References
- 1.Klosterkötter J, Hellmich M, Steinmeyer EM, Schultze-Lutter F. Diagnosing schizophrenia in the initial prodromal phase. Arch. Gen. Psychiatry. 2001;58:158–164. doi: 10.1001/archpsyc.58.2.158. [DOI] [PubMed] [Google Scholar]
- 2.Kwapil TR, Gross GM, Silvia PJ, Barrantes-Vidal N. Prediction of psychopathology and functional impairment by positive and negative schizotypy in the chapmans’ ten-year longitudinal study. J. Abnorm. Psychol. 2013;122:807–815. doi: 10.1037/a0033759. [DOI] [PubMed] [Google Scholar]
- 3.Barrantes-Vidal N, Grant P, Kwapil TR. The role of schizotypy in the study of the etiology of schizophrenia spectrum disorders. Schizophr. Bull. 2015;41:S408–S416. doi: 10.1093/schbul/sbu191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Fenner B, Cooper N, Romei V, Hughes G. Individual differences in sensory integration predict differences in time perception and individual levels of schizotypy. Conscious. Cogn. 2020;84:102979. doi: 10.1016/j.concog.2020.102979. [DOI] [PubMed] [Google Scholar]
- 5.Ferri F, Venskus A, Fotia F, Cooke J, Romei V. Higher proneness to multisensory illusions is driven by reduced temporal sensitivity in people with high schizotypal traits. Conscious. Cogn. 2018;65:263–270. doi: 10.1016/j.concog.2018.09.006. [DOI] [PubMed] [Google Scholar]
- 6.Wu Y, Cao H, Baranova A, et al. Multi-trait analysis for genome-wide association study of five psychiatric disorders. Transl Psychiatry. 2020;10:209. doi: 10.1038/s41398-020-00902-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Plomin R, Haworth CMA, Davis OSP. Common disorders are quantitative traits. Nat. Rev. Genet. 2009;10:872–878. doi: 10.1038/nrg2670. [DOI] [PubMed] [Google Scholar]
- 8.Ripke S, et al. Genome-wide association analysis identifies 13 new risk loci for schizophrenia. Nat. Genet. 2013;45:1150–1159. doi: 10.1038/ng.2742. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bakan P, Peterson K. Pregnancy and birth complications: a risk factor for schizotypy. J. Pers. Disord. 1994;8:299–306. [Google Scholar]
- 10.Compton MT, Chien VH, Bollini AM. Associations between past alcohol, cannabis, and cocaine use and current schizotypy among first-degree relatives of patients with schizophrenia and non-psychiatric controls. Psychiatr. Q. 2009;80:143–154. doi: 10.1007/s11126-009-9102-x. [DOI] [PubMed] [Google Scholar]
- 11.Yan X, Zhao X, Li J, He L, Xu M. Effects of early-life malnutrition on neurodevelopment and neuropsychiatric disorders and the potential mechanisms. Prog. Neuro-Psychopharmacol. Biol. Psychiatry. 2018;83:64–75. doi: 10.1016/j.pnpbp.2017.12.016. [DOI] [PubMed] [Google Scholar]
- 12.Matheson SL, Shepherd AM, Laurens KR, Carr VJ. A systematic meta-review grading the evidence for non-genetic risk factors and putative antecedents of schizophrenia. Schizophr. Res. 2011;133:133–142. doi: 10.1016/j.schres.2011.09.020. [DOI] [PubMed] [Google Scholar]
- 13.Varese F, et al. Childhood adversities increase the risk of psychosis: a meta-analysis of patient-control, prospective-and cross-sectional cohort studies. Schizophr. Bull. 2012;38:661–671. doi: 10.1093/schbul/sbs050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.De Sousa P, Varese F, Sellwood W, Bentall RP. Parental communication and psychosis: a meta-analysis. Schizophr. Bull. 2014;40:756–768. doi: 10.1093/schbul/sbt088. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Saha S, Scott JG, Varghese D, McGrath JJ. Socio-economic disadvantage and delusional-like experiences: a nationwide population-based study. Eur. Psychiatry. 2013;28:59–63. doi: 10.1016/j.eurpsy.2011.09.004. [DOI] [PubMed] [Google Scholar]
- 16.Bourque F, Van Der Ven E, Malla A. A meta-analysis of the risk for psychotic disorders among first- and second-generation immigrants. Psychol. Med. 2011;41:897–910. doi: 10.1017/S0033291710001406. [DOI] [PubMed] [Google Scholar]
- 17.Lenzenweger MF. Schizotypy an organizing framework for schizophrenia research. Curr. Dir. Psychol. Sci. 2006;15:162–166. [Google Scholar]
- 18.Raine A. Schizotypal personality: neurodevelopmental and psychosocial trajectories. Annu. Rev. Clin. Psychol. 2006;2:291–326. doi: 10.1146/annurev.clinpsy.2.022305.095318. [DOI] [PubMed] [Google Scholar]
- 19.Debbané M, Mohr C. Integration and development in schizotypy research: an introduction to the special supplement. Schizophr. Bull. 2015;41:S363–S365. doi: 10.1093/schbul/sbv003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Liu T, et al. Occipital alpha connectivity during resting-state electroencephalography in patients with ultra-high risk for psychosis and schizophrenia. Front. Psychiatry. 2019;10:1–9. doi: 10.3389/fpsyt.2019.00553. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Harris A, Melkonian D, Williams L, Gordon E. Dynamic spectral analysis findings in first episode and chronic schizophrenia. Int. J. Neurosci. 2006;116:223–246. doi: 10.1080/00207450500402977. [DOI] [PubMed] [Google Scholar]
- 22.Clementz BA, Sponheim SR, Iacono WG, Beiser M. Resting EEG in first-episode schizophrenia patients, bipolar psychosis patients, and their first-degree relatives. Psychophysiology. 1994;31:486–494. doi: 10.1111/j.1469-8986.1994.tb01052.x. [DOI] [PubMed] [Google Scholar]
- 23.Goldstein MR, Peterson MJ, Sanguinetti JL, Tononi G, Ferrarelli F. Topographic deficits in alpha-range resting EEG activity and steady state visual evoked responses in schizophrenia. Schizophr. Res. 2015;168:145–152. doi: 10.1016/j.schres.2015.06.012. [DOI] [PubMed] [Google Scholar]
- 24.Hughes SW, Crunelli V. Thalamic mechanisms of EEG alpha rhythms and their pathological implications. Neuroscientist. 2005;11:357–372. doi: 10.1177/1073858405277450. [DOI] [PubMed] [Google Scholar]
- 25.Schreckenberger M, et al. The thalamus as the generator and modulator of EEG alpha rhythm: a combined PET/EEG study with lorazepam challenge in humans. Neuroimage. 2006;32:485. doi: 10.1016/j.neuroimage.2004.01.047. [DOI] [PubMed] [Google Scholar]
- 26.Millett D. Hans berger: from psychic energy to the EEG. Perspect. Biol. Med. 2001;44:522–542. doi: 10.1353/pbm.2001.0070. [DOI] [PubMed] [Google Scholar]
- 27.Murphy M, Öngür D. Decreased peak alpha frequency and impaired visual evoked potentials in first episode psychosis. NeuroImage Clin. 2019;22:101693. doi: 10.1016/j.nicl.2019.101693. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Jin Y, et al. Therapeutic effects of individualized alpha frequency transcranial magnetic stimulation (αTMS) on the negative symptoms of schizophrenia. Schizophr. Bull. 2006;32:556–561. doi: 10.1093/schbul/sbj020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Friston KJ, Frith CD. Schizophrenia: a disconnection syndrome? Clin. Neurosci. (New York, N.Y.) 1995;3:89–97. [PubMed] [Google Scholar]
- 30.Ito J, Nikolaev AR, Van Leeuwen C. Spatial and temporal structure of phase synchronization of spontaneous alpha EEG activity. Biol. Cybern. 2005;92:54–60. doi: 10.1007/s00422-004-0533-z. [DOI] [PubMed] [Google Scholar]
- 31.Bahramisharif A, et al. Propagating neocortical gamma bursts are coordinated by traveling alpha waves. J. Neurosci. 2013;33:18849–18854. doi: 10.1523/JNEUROSCI.2455-13.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Halgren M, et al. The generation and propagation of the human alpha rhythm. Proc. Natl. Acad. Sci. U. S. A. 2019;116:23772–23782. doi: 10.1073/pnas.1913092116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Manjarrez E, Vázquez M, Flores A. Computing the center of mass for traveling alpha waves in the human brain. Brain Res. 2007;1145:239–247. doi: 10.1016/j.brainres.2007.01.114. [DOI] [PubMed] [Google Scholar]
- 34.Becker R, Van de Ville D, Kleinschmidt A. Alpha oscillations reduce temporal long-range dependence in spontaneous human brain activity. J. Neurosci. 2018;38:755–764. doi: 10.1523/JNEUROSCI.0831-17.2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Hanslmayr S, Gross J, Klimesch W, Shapiro KL. The role of alpha oscillations in temporal attention. Brain Res. Rev. 2011;67:331–343. doi: 10.1016/j.brainresrev.2011.04.002. [DOI] [PubMed] [Google Scholar]
- 36.Samaha J, Bauer P, Cimaroli S, Postle BR. Top-down control of the phase of alpha-band oscillations as a mechanism for temporal prediction. Proc. Natl. Acad. Sci. U. S. A. 2015;112:8439–8444. doi: 10.1073/pnas.1503686112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Koh Y, et al. An MEG study of alpha modulation in patients with schizophrenia and in subjects at high risk of developing psychosis. Schizophr. Res. 2011;126:36–42. doi: 10.1016/j.schres.2010.10.001. [DOI] [PubMed] [Google Scholar]
- 38.Fuggetta G, Bennett MA, Duke PA, Young AMJ. Quantitative electroencephalography as a biomarker for proneness toward developing psychosis. Schizophr. Res. 2014;153:68–77. doi: 10.1016/j.schres.2014.01.021. [DOI] [PubMed] [Google Scholar]
- 39.Tandon N, Tandon R. Using machine learning to explain the heterogeneity of schizophrenia. Realizing the promise and avoiding the hype. Schizophr. Res. 2019;214:70–75. doi: 10.1016/j.schres.2019.08.032. [DOI] [PubMed] [Google Scholar]
- 40.Noor MBT, Zenia NZ, Kaiser MS, Mamun SA, Mahmud M. Application of deep learning in detecting neurological disorders from magnetic resonance images: a survey on the detection of Alzheimer’s disease, Parkinson’s disease and schizophrenia. Brain Inform. 2020;7:1–21. doi: 10.1186/s40708-020-00112-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Zhang, L. EEG Signals Classification Using Machine Learning for the Identification and Diagnosis of Schizophrenia. Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. EMBS 4521–4524 (2019). doi:10.1109/EMBC.2019.8857946 [DOI] [PubMed]
- 42.Johannesen JK, Bi J, Jiang R, Kenney JG, Chen C-MA. Machine learning identification of EEG features predicting working memory performance in schizophrenia and healthy adults. Neuropsychiatric Electrophysiol. 2016 doi: 10.1186/s40810-016-0017-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Thilakavathi B, Shenbaga Devi S, Malaiappan M, Bhanu K. EEG power spectrum analysis for schizophrenia during mental activity. Australas. Phys. Eng. Sci. Med. 2019;42:887–897. doi: 10.1007/s13246-019-00779-w. [DOI] [PubMed] [Google Scholar]
- 44.Iwabuchi SJ, Palaniyappan L. Abnormalities in the effective connectivity of visuothalamic circuitry in schizophrenia. Psychol. Med. 2017;47:1300–1310. doi: 10.1017/S0033291716003469. [DOI] [PubMed] [Google Scholar]
- 45.Raine A. The SPQ: a scale for the assessment of schizotypal personality based on DSM-III-r criteria. Schizophr. Bull. 1991;17:555–564. doi: 10.1093/schbul/17.4.555. [DOI] [PubMed] [Google Scholar]
- 46.St. Louis, E. et al. Electroencephalography (EEG): An Introductory Text and Atlas of Normal and Abnormal Findings in Adults, Children, and Infants. Electroencephalography (EEG): An Introductory Text and Atlas of Normal and Abnormal Findings in Adults, Children, and Infants (2016). doi:10.5698/978-0-9979756-0-4 [PubMed]
- 47.Narayanan B, et al. Resting state electroencephalogram oscillatory abnormalities in schizophrenia and psychotic bipolar patients and their relatives from the bipolar and schizophrenia network on intermediate phenotypes study. Biol. Psychiatry. 2014;76:456–465. doi: 10.1016/j.biopsych.2013.12.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Garrity AG, et al. Aberrant ‘default mode’ functional connectivity in schizophrenia. Am. J. Psychiatry. 2007 doi: 10.1176/ajp.2007.164.3.450. [DOI] [PubMed] [Google Scholar]
- 49.Öngür D, et al. Default mode network abnormalities in bipolar disorder and schizophrenia. Psychiatry Res. Neuroimaging. 2010 doi: 10.1016/j.pscychresns.2010.04.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Omori M, et al. Quantitative EEG in never-treated schizophrenic patients. Biol. Psychiatry. 1995;38:303–309. doi: 10.1016/0006-3223(95)00300-6. [DOI] [PubMed] [Google Scholar]
- 51.Jetha MK, Schmidt LA, Goldberg JO. Resting frontal eeg asymmetry and shyness and sociability in schizophrenia: a pilot study of community-based outpatients. Int. J. Neurosci. 2009;119:847–856. doi: 10.1080/00207450701242966. [DOI] [PubMed] [Google Scholar]
- 52.Merrin EL, Floyd TC. Negative symptoms and EEG alpha activity in schizophrenic patients. Schizophr. Res. 1992;8:11–20. doi: 10.1016/0920-9964(92)90056-b. [DOI] [PubMed] [Google Scholar]
- 53.Yozawitz A, et al. Dichotic perception: evidence for right hemisphere dysfunction in affective psychosis. Br. J. Psychiatry. 1979;135:224–237. doi: 10.1192/bjp.135.3.224. [DOI] [PubMed] [Google Scholar]
- 54.Walker E, McGuire M. Intra- and interhemispheric information processing in schizophrenia. Psychol. Bull. 1982;92:701–725. [PubMed] [Google Scholar]
- 55.Gur RE. Left hemisphere dysfunction and left hemisphere overactivation in schizophrenia. J. Abnorm. Psychol. 1978;87:226–238. doi: 10.1037//0021-843x.87.2.226. [DOI] [PubMed] [Google Scholar]
- 56.Fan X, Miller BC, Park K, Christensen M, Tai RH. An exploratory study about inaccuracy and invalidity in adolescent self-report surveys. Field Methods. 2015;18:223–244. [Google Scholar]
- 57.Austin EJ, Deary IJ, Gibson GJ, Mcgregort MJ, Dent JB. Individual response spread in self-report scales: personality correlations and consequences. Pers. Individ. Differ. 1998;24:421–438. [Google Scholar]
- 58.Doesburg SM, Green JJ, McDonald JJ, Ward LM. From local inhibition to long-range integration: a functional dissociation of alpha-band synchronization across cortical scales in visuospatial attention. Brain Res. 2009;1303:97–110. doi: 10.1016/j.brainres.2009.09.069. [DOI] [PubMed] [Google Scholar]
- 59.Cecere R, Rees G, Romei V. Individual differences in alpha frequency drive crossmodal illusory perception. Curr. Biol. 2015;25:231–235. doi: 10.1016/j.cub.2014.11.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Samaha J, Postle BR. The speed of alpha-band oscillations predicts the temporal resolution of visual perception. Curr. Biol. 2015;25:2985–2990. doi: 10.1016/j.cub.2015.10.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Minami S, Amano K. Illusory jitter perceived at the frequency of alpha oscillations. Curr. Biol. 2017;27:2344–2351.e4. doi: 10.1016/j.cub.2017.06.033. [DOI] [PubMed] [Google Scholar]
- 62.Migliorati D, et al. Individual alpha frequency predicts perceived visuotactile simultaneity. J. Cogn. Neurosci. 2020;32:1–11. doi: 10.1162/jocn_a_01464. [DOI] [PubMed] [Google Scholar]
- 63.Cooke J, Poch C, Gillmeister H, Costantini M, Romei X. Oscillatory properties of functional connections between sensory areas mediate cross-modal illusory perception. J. Neurosci. 2019;39:5711–5718. doi: 10.1523/JNEUROSCI.3184-18.2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Wutz A, Melcher D, Samaha J. Frequency modulation of neural oscillations according to visual task demands. Proc. Natl. Acad. Sci. U. S. A. 2018;115:1346–1351. doi: 10.1073/pnas.1713318115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Battaglini L, et al. The effect of alpha tACS on the temporal resolution of visual perception. Front. Psychol. 2020;11:1–10. doi: 10.3389/fpsyg.2020.01765. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Ronconi L, Busch NA, Melcher D. Alpha-band sensory entrainment alters the duration of temporal windows in visual perception. Sci. Rep. 2018;8:1–10. doi: 10.1038/s41598-018-29671-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.World Medical Association World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. Bull. World Health Organ. 2001 doi: 10.1590/S0042-96862001000400016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Barry RJ, Clarke AR, Johnstone SJ, Magee CA, Rushby JA. EEG differences between eyes-closed and eyes-open resting conditions. Clin. Neurophysiol. 2007;118:2765–2773. doi: 10.1016/j.clinph.2007.07.028. [DOI] [PubMed] [Google Scholar]
- 69.Delorme A, Makeig S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods. 2004;134:9–21. doi: 10.1016/j.jneumeth.2003.10.009. [DOI] [PubMed] [Google Scholar]
- 70.Bell AJ, Sejnowski TJ. An information-maximization approach to blind separation and blind deconvolution. Neural Comput. 1995 doi: 10.1162/neco.1995.7.6.1129. [DOI] [PubMed] [Google Scholar]
- 71.Onton J, Delorme A, Makeig S. Frontal midline EEG dynamics during working memory. Neuroimage. 2005;27:341–356. doi: 10.1016/j.neuroimage.2005.04.014. [DOI] [PubMed] [Google Scholar]
- 72.Makeig S, et al. Electroencephalographic brain dynamics following manually responded visual targets. PLoS Biol. 2004;2:e176. doi: 10.1371/journal.pbio.0020176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Vinck M, Oostenveld R, Van Wingerden M, Battaglia F, Pennartz CMA. An improved index of phase-synchronization for electrophysiological data in the presence of volume-conduction, noise and sample-size bias. Neuroimage. 2011;55:1548–1565. doi: 10.1016/j.neuroimage.2011.01.055. [DOI] [PubMed] [Google Scholar]
- 74.Campos Viola F, et al. Semi-automatic identification of independent components representing EEG artifact. Clin. Neurophysiol. 2009;120:868–877. doi: 10.1016/j.clinph.2009.01.015. [DOI] [PubMed] [Google Scholar]
- 75.Di Gregorio F, Ernst B, Steinhauser M. Differential effects of instructed and objective feedback reliability on feedback-related brain activity. Psychophysiology. 2019 doi: 10.1111/psyp.13399. [DOI] [PubMed] [Google Scholar]
- 76.Corcoran AW, Alday PM, Schlesewsky M, Bornkessel-Schlesewsky I. Toward a reliable, automated method of individual alpha frequency (IAF) quantification. Psychophysiology. 2018 doi: 10.1111/psyp.13064. [DOI] [PubMed] [Google Scholar]
- 77.Lee H, et al. Relationship of critical dynamics, functional connectivity, and states of consciousness in large-scale human brain networks. Neuroimage. 2019;188:228–238. doi: 10.1016/j.neuroimage.2018.12.011. [DOI] [PubMed] [Google Scholar]
- 78.Cohen MX. Analyzing Neural Time Series Data: Theory and Practice. Cambridge: MIT Press; 2014. [Google Scholar]
- 79.Šidák Z. Rectangular confidence regions for the means of multivariate normal distributions. J. Am. Stat. Assoc. 1967;62:626–633. [Google Scholar]
- 80.Breiman L, Spector P. Submodel selection and evaluation in regression. The X-random case. Int. Stat. Rev. Rev. Int. Stat. 1992;60:291. [Google Scholar]
- 81.Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning. The Business of Giving. New York: Springer; 2009. [Google Scholar]
- 82.James G, Witten D, Hastie T, Tibshirani R. An Introduction to Statistical Learning Current Medicinal Chemistry. New York: Springer; 2013. [Google Scholar]
- 83.Kohavi, R. A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. in Proceedings of the 14th International Joint Conference on Artificial Intelligence - Volume 2 1137–1143 (Morgan Kaufmann Publishers Inc., 1995).
- 84.Wolpert, D. H. The Lack of a Priori Distinctions between Learning Algorithms. Neural Computation8, (1996).
- 85.Bishop, C. M. Sparse Kernel Machines. in Pattern Recognition and Machine Learning, Information Science and Statistics (Springer, New York, 2006).
- 86.Bishop, C. M. Logistic Regression. in Pattern Recognition and Machine Learning, Information Science and Statistics (Springer, New York, 2006). doi:10.1108/k.2010.06739hae.001
- 87.Alpaydin E. Introduction to Machine Learning. Adaptive Computation and Machine Learining. Cambridge: MIT Press; 2010. [Google Scholar]
- 88.Diciotti, S., Ciulli, S., Mascalchi, M., Giannelli, M., Toschi, N. The “ Peeking ” Effect in Supervised Feature Selection on Diffusion Tensor Imaging Data. 34, 3685 (2013). [DOI] [PMC free article] [PubMed]