Abstract
Previous evidence showed a 75.5% best accuracy in the classification of 120 Alzheimer's disease (AD) patients with dementia and 100 matched normal elderly (Nold) subjects based on cortical source current density and linear lagged connectivity estimated by eLORETA freeware from resting state eyes-closed electroencephalographic (rsEEG) rhythms (Babiloni et al., 2016a). Specifically, that accuracy was reached using the ratio between occipital delta and alpha1 current density for a linear univariate classifier (receiver operating characteristic curves). Here we tested an innovative approach based on an artificial neural network (ANN) classifier from the same database of rsEEG markers. Frequency bands of interest were delta (2–4 Hz), theta (4–8 Hz Hz), alpha1 (8–10.5 Hz), and alpha2 (10.5–13 Hz). ANN classification showed an accuracy of 77% using the most 4 discriminative rsEEG markers of source current density (parietal theta/alpha 1, temporal theta/alpha 1, occipital theta/alpha 1, and occipital delta/alpha 1). It also showed an accuracy of 72% using the most 4 discriminative rsEEG markers of source lagged linear connectivity (inter-hemispherical occipital delta/alpha 2, intra-hemispherical right parietal-limbic alpha 1, intra-hemispherical left occipital-temporal theta/alpha 1, intra-hemispherical right occipital-temporal theta/alpha 1). With these 8 markers combined, an accuracy of at least 76% was reached. Interestingly, this accuracy based on 8 (linear) rsEEG markers as inputs to ANN was similar to that obtained with a single rsEEG marker (Babiloni et al., 2016a), thus unveiling their information redundancy for classification purposes. In future AD studies, inputs to ANNs should include other classes of independent linear (i.e., directed transfer function) and non-linear (i.e., entropy) rsEEG markers to improve the classification.
Keywords: Alzheimer's disease (AD), electroencephalography (EEG), exact low-resolution brain electromagnetic tomography (eLORETA), linear lagged connectivity, artificial neural networks (ANNs)
Introduction
Alzheimer's disease (AD) is the most prevalent neurodegenerative disorder affecting the aged people. In AD, a progressive neurodegeneration leads to dementia, characterized by severe cognitive deficits, behavioral symptoms, and loss of autonomy in the daily life (Braak and Braak, 1995).
In the past years, the International Working Group (IWG) and the US National Institute on Aging–Alzheimer's Association (NIA-AA) have proposed an algorithm for the diagnosis of AD based on in vivo biomarkers and clinical phenotypes of disease (Förstl and Kurz, 1999; Dubois et al., 2007, 2014; Jack et al., 2010; Albert et al., 2011; McKhann et al., 2011; Sperling et al., 2011). According to the last IWG guidelines (Dubois et al., 2014), diagnostic biomarkers are limited to pathophysiological markers. On one hand, these markers include cerebrospinal fluid (CSF) markers, as revealed by the measures of Aβ-42, total tau, and phospho-tau; on the other hand, they include abnormal Aβ-42 and tau accumulation in the brain, as revealed by ligand positron emission tomography (PET) (Förstl and Kurz, 1999). The last IWG guidelines encourage the use of topographic markers even if they are not diagnostic. These markers are quite useful to map structural and functional impairment of the brain over time, especially in elderly subjects with initial objective evidence of mild cognitive impairment (MCI) including memory and other cognitive domains but with preserved independence in the daily activities. The topographic markers include maps of brain hypometabolism, as revealed by FDG-PET, and maps of brain atrophy and abnormalities of structural and functional brain connectivity, as revealed by structural and functional magnetic resonance imaging (MRI). All those methodologies can capture several processes of disease, but their use is limited because of low availability of the instruments, costs or invasiveness, especially for serial recordings over time.
Keeping in mind the intrinsic limitations of the CSF, MRI, and PET, several independent research groups tested indexes of resting state eyes-closed electroencephalographic (rsEEG) rhythms as candidate topographic markers of AD (Babiloni et al., 2016b). EEG rhythms are the most important feature of collective behavior of brain neural populations and are very relevant for human cognition. Furthermore, EEG procedures are largely available in any country, well tolerated by patients, not affected by subjects' anxiety or task difficulty, and can be repeated over time without habituation effects (Babiloni et al., 2016b).
Previous studies in AD patients and elderly subjects with amnesic MCI have shown that rsEEG may be promising markers for a neurophysiological evaluation of disease status as topographic markers. When compared to groups of normal elderly (Nold) subjects, AD groups have been characterized by high power of widespread delta and theta rhythms, as well as by low power of posterior alpha and/or beta rhythms (Dierks et al., 1993, 2000; Huang et al., 2000; Ponomareva et al., 2003; Jeong, 2004).
The use of rsEEG variables as neurophysiologic topographic markers of AD implies that these variables can classify Nold and AD individuals at least with a moderate classification accuracy of 75–80%. In the past years, two papers revised the literature on the accuracy of the classification between AD and Nold individuals by rsEEG features systematically. The article of Jonkman (1997) reviewed 16 studies published in 1983–1995. In those studies, the classification accuracy ranged from 54 to 100% (median of 81%) for the discrimination of the patients with AD dementia and Nold subjects. In the same vein, the paper of Jelic and Kowalski (2009) reviewed 46 studies published in 1980–2008. The classification accuracy ranged from 80 to 85% for the discrimination of the patients with AD dementia (or MCI) and control subjects such as Nold or other forms of dementia.
The present research group has been investigating markers of rsEEG rhythms in MCI, AD, and control subjects in the framework of “BRAINON” program (http://www.brainon.eu). In previous studies of this program, cortical sources of rsEEG rhythms in MCI, AD, and control groups of subjects were estimated by the freeware low-resolution brain electromagnetic tomography (LORETA; Pascual-Marqui et al., 1994). The aim was to enhance spatial information content of scalp-recorded EEG data and to unveil topography of EEG abnormalities associated with AD from prodromal to overt clinical stages (Babiloni et al., 2004, 2008, 2009, 2010, 2011a,b, 2013a,b, 2016b). It was reported that temporal, parietal, and occipital cortical sources of delta and alpha rhythms were altered in AD groups compared with control groups as a function cognitive deficits and abnormalities in brain integrity (Babiloni et al., 2004, 2008, 2009, 2010, 2011a,b, 2013a,b, 2016b).
Recently, our research group tested the hypothesis that Nold and AD individuals with dementia can be discriminated with a moderate accuracy using topographic markers of the rsEEG source current density and functional connectivity (Babiloni et al., 2016a). Results showed a classification accuracy of 75.5% in the discrimination of 120 AD patients with dementia and 100 matched Nold subjects based on cortical source current density (Babiloni et al., 2016a). Of note, this accuracy was obtained by an univariate classifier such as receiver operating characteristic (ROC) curve from the ratio between occipital delta (2–4 Hz) and alpha 1 (8–10.5 Hz) current density. Here we tested if a multivariate classification with artificial neural networks (ANNs) improved that classification accuracy of those original rsEEG markers in AD and Nold individuals. The main issue was whether the combined use of cortical source current density and functional connectivity as inputs of a trained ANN would provide more accurate classifications than those obtained with the two classes of spectral EEG markers considered separately.
Materials and methods
Details on the subjects, rsEEG database, eLORETA source estimation, and classification with ROC curves were reported in the reference paper quoted in the previous section (Babiloni et al., 2016a). In the following sections, we provide a short description of those methodological procedures for readers' convenience.
Subjects and diagnostic criteria
The clinical and rsEEG data of the present study refer to 120 AD with dementia and 100 Nold individuals, matched for age, years of education, and gender. Committees of local institutional ethics approved the recording and analysis of EEG data for scientific purposes. Each participant or caregiver subscribed informed consent, in line with the Code of Ethics of the World Medical Association (Declaration of Helsinki).
Probable AD was diagnosed according to the criteria of the Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM-IV-TR; American Psychiatric Association) and the National Institute of Neurological Disorders and Stroke–Alzheimer Disease and Related Disorders (NINCDS-ADRDA) working group (McKhann et al., 1984). Individuals underwent medical, neuropsychological, neurological, and psychiatric assessments including Instrumental Activities of Daily Living scale (IADL; Lawton and Brody, 1969), Mini-Mental State Examination (Folstein et al., 1975), Clinical Dementia Rating (CDR; Hughes et al., 1982), and Geriatric Depression Scale (GDS; Yesavage et al., 1983). Exclusion criteria included any kind of evidence of other forms or causes of dementia such as frontotemporal dementia (The Lund and Manchester Groups, 1994), vascular dementia diagnosed according to the criteria of the National Institute of Neurological Disorders and Stroke and Association Internationale pour la Recherché et l'Enseignement en Neurosciences (NINDS-AIREN) working group (Román et al., 1993), Parkinson disease (PD), Dementia with Lewy Bodies (DLB; McKeith et al., 2005), metabolic syndrome, nutritional deficits, tumors, etc. When given, benzodiazepines, antidepressant and/or antihypertensive were suspended for about 24 h before EEG recordings. This procedure did not ensure a complete washout of the drug–longer periods would not have been applicable for obvious ethical reasons- but it made it possible to compare the drug condition across the AD patients. Of note, most of the AD patients (114 out of 120 patients, i.e., 95%) followed a long-term treatment with standard daily doses of acetylcholinesterase inhibitors. In detail, they followed a treatment with donepezil (71 patients; 5–10 mg/die), rivastigmine (29 patients; 10 mg/die) or galantamine (14 patients; 16–36 mg/die).
The Nold subjects underwent medical, neurological, and psychiatric assessments including MMSE (Folstein et al., 1975), Clinical Dementia Rating (CDR; Hughes et al., 1982) and geriatric depression scale (GDS; Yesavage et al., 1983), to exclude from the study subjects with a history of neurological, or psychiatric disorders (including abuse of substances). Finally, a further exclusion criterion was a score in the MMSE lower than 27 for the Nold subjects and higher than 24 for the AD subjects, according to Alzheimer‘s Disease Neuroimaging Initiative (ADNI; http://adni.loni.usc.edu).
Table 1 summarizes some demographic and clinical data of the subjects. T-test evaluated the differences (p < 0.05, one-tailed) between the groups (Nold and AD) for age, education, MMSE score, and individual alpha frequency (IAF; see below for a description of this index). As expected, a statistically significant difference was found for the MMSE score (p < 0.0001; higher MMSE score in the Nold than in the AD group) and for the IAF (p < 0.0001; higher IAF in the Nold than in the AD group), while no statistically significant difference was found for age, gender, and education (p > 0.05).
Table 1.
Gender (female/male) | Age (years) | Education (years) | MMSE (score) | |
---|---|---|---|---|
Nold (n = 100) | 62/38 | 69 ± 0.9 SE | 9.7 ± 0.4 SE | 28.8 ± 0.1 SE |
AD (n = 120) | 78/42 | 69.8 ± 0.7 SE | 9.2 ± 0.4 SE | 19 ± 0.3 SE |
Legend: MMSE, Mini Mental State Examination.
EEG recordings and preliminary data analysis
During rsEEG recordings, all subjects had to stay with eyes closed in a relaxing state, not moving or talking. 5 min of rsEEG data (EB-Neuro Be-light©, Firenze, Italy) were recorded (128 Hz or higher sampling rate, with a bandpass between 0.01 and 100 Hz) from 19 scalp electrodes positioned over the whole scalp according to the 10–20 System (i.e., Fp1, Fp2, F7, F3, Fz, F4, F8, T3, C3, Cz, C4, T4, T5, P3, Pz, P4, T6, O1, and O2). EEG recordings were performed using frontal cephalic or extracephalic (linked earlobe) reference. Linked earlobe reference electrode was preferred because frontal cephalic reference could attenuate the extracerebral ocular activity on prefrontal (i.e., Fp1, Fp2) and frontal (i.e., F7, F3, Fz, F4, F8) electrodes. However, the use of extracephalic reference was not mandatory to respect the methodological facilities and standard internal protocols of the clinical recording units when the data collection occurred outside a formal clinical trial with a harmonized protocol for the electrode montage. A ground electrode was located between the AFz and Fz electrodes, and scalp electrodes impedances were kept below 5 Kohm. Horizontal and vertical electro-oculographic (EOG) potentials (0.3–70 Hz bandpass) were also recorded to monitor blinking and eye movements.
As a methodological remark, all the mentioned clinical units recorded EEG data with the sampling rate and EEG bandpass set to avoid aliasing. A minority of these rsEEG data (less than 20%) was acquired with 128-Hz sampling frequency. Noteworthy, the use of 128 Hz sampling frequency was sub-optimal for a correct reconstruction of rsEEG signal beyond 40 Hz without aliasing (One has to set a factor from 3 or 4 between the low-pass limit of the analog bandpass filter and the rsEEG sampling frequency).
The EEG data were divided into segments of 2 s and analyzed off-line. The epochs affected by any physiological (ocular, muscular) or non-physiological artifacts were preliminarily identified by an automatic computerized procedure. Two independent experimenters manually checked the artifact-free EEG epochs, before successive analysis. Particular attention was dedicated to the identification of extracerebral contamination of ocular activity (i.e., blinking) in frontal (i.e., F7, F3, Fz, F4, and F8) and prefrontal (Fp1 and Fp2) electrodes, comparing EOG and EEG traces, in EEG recordings with frontal cephalic reference. Finally, all recorded artifact-free EEG data were off-line re-referenced to common average to harmonize the EEG data collected with different reference electrodes.
We computed the spectral power density of the EEG rhythms using a 0.5 Hz frequency resolution Fast Fourier Transform (FFT, Welch algorithm, Hanning window, no phase shift). In line with previous relevant EEG studies (Jelic et al., 1996; Besthorn et al., 1997; Chiaramonti et al., 1997; Babiloni et al., 2005, 2006, 2011b, 2013c), we considered the following standard frequency bands of interest: Delta (2–4 Hz), theta (4–8 Hz), alpha 1 (8–10.5 Hz), alpha 2 (10.5–13 Hz), beta 1 (13–20 Hz), beta 2 (20–30 Hz), and gamma (30–40).
Cortical sources of rsEEG rhythms as computed by eLORETA
We used the free tool “exact LORETA” (eLORETA) for the linear estimation of the cortical sources activity of rsEEG rhythms in the frequency domain (Pascual-Marqui, 2007a). eLORETA represents the improved version of the previous pieces of software called LORETA (Pascual-Marqui et al., 1994) and standardized LORETA (Pascual-Marqui et al., 2002). Both standardized LORETA and eLORETA showed the same low spatial resolution, with zero localization error in the presence of measurement and biological noise (Pascual-Marqui et al., 2002; Pascual-Marqui, 2007a). However, eLORETA exhibited a better source location in some control parameters (Canuet et al., 2011).
eLORETA uses a head volume conductor model composed of the scalp, skull, and brain. In the scalp compartment, exploring electrodes can be virtually positioned to give EEG data as an input to the source estimation (Jurcak et al., 2007). The brain model is based on a realistic cerebral shape taken from a template typically used in the neuroimaging studies, namely that of the Montreal Neurological Institute (MNI152 template; Mazziotta et al., 1995). The electrical brain source space is formed by 6239 voxels with 5 mm resolution, restricted to cortical gray matter (Fuchs et al., 2002). An equivalent current dipole is located in each voxel. eLORETA solves the so-called EEG inverse problem in the mentioned head volume conductor model estimating “neural” current density values at any cortical voxel for each frequency bin. Input for this regularized inverse estimation (Pascual-Marqui et al., 2002) is the EEG spectral power density computed at all virtual scalp electrodes.
In line with the general low spatial resolution of the present EEG methodological approach (i.e., 19 scalp electrodes), the eLORETA solutions were averaged across all voxels in a given cortical macroregion of interest (ROI). The ROIs corresponding to frontal, central, parietal, occipital, temporal, and limbic large regions are shown in Figure 1. These eLORETA solutions were used as rsEEG markers of “cortical source current density reflecting neural synchronization” for the present classification purposes.
eLORETA was also used to estimate the functional connectivity between pairs of ROIs as a measurement of the neural signal communication across distributed populations of cortical neurons in the resting state condition. To this aim, we used the so-called lagged linear connectivity (LLC) tool of eLORETA (Pascual-Marqui, 2007b; Pascual-Marqui et al., 2011). LLC is a linear measure of rsEEG coherence that overcomes the problem of the high phase synchronization and the zero-lag coherence possibly introduced by the procedure of eLORETA source estimation. LLC is also expected to minimize the influence of a third rsEEG source having an influence on the instantaneous coherence between two rsEEG sources not dependent each other (the so-called “common feeding” issue).
For each subject and rsEEG frequency band of interest (i.e., delta, theta, alpha 1, alpha 2, beta 1, beta 2, and gamma), the LLC was computed for 6 ROIs (i.e., frontal, central, parietal, occipital, temporal, and limbic). For the inter-hemispherical analysis, the LLC estimates were calculated between all voxels of the mentioned ROIs of each hemisphere with the corresponding ones of the other hemisphere. The LLC solutions for all voxels of a given pair of ROIs were averaged. For the intra-hemispherical analysis, the LLC estimates were computed for all voxels of a particular ROI with all voxels of another ROI of the same hemisphere. The LLC solutions for all voxels of a given pair of ROIs were averaged, for both the right and the left hemisphere. Those LLC solutions were used as rsEEG markers of “cortical functional connectivity” for the present classification purposes.
The rsEEG markers used as inputs for artificial neural networks (ANNs)
In the present study, we selected the markers of eLORETA source current density and functional connectivity (LLC) showing a better discrimination between the Nold and AD individuals as revealed by an area under the ROC curves over 70% in the reference study (Babiloni et al., 2016a). According to this criterion, alpha 2, beta 1, beta 2, and gamma rsEEG markers were not considered in the following.
For the eLORETA source current density, we considered 10 markers showing a classification accuracy higher than 75%, namely parietal, temporal, occipital, limbic, central, and frontal theta/alpha1 (i.e., ratio between theta and alpha 1) as well as parietal, temporal, occipital, and limbic delta/alpha1 (i.e., ratio between delta and alpha 1).
For the eLORETA source functional connectivity (LLC), we used 4 markers exhibiting a classification accuracy better than 70%, namely inter-hemispherical occipital delta/alpha 1 as well as intra-hemispherical left occipital-temporal theta/alpha 1, right parietal-limbic alpha 1, and right occipital-temporal theta/alpha 1.
ANNs: architecture and procedure for the classification of rsEEG markers in Nold and AD individuals
ANN is a mathematical machine learning technique inspired by the core functioning of a biologic nervous system composed of simple processing elements that are interconnected and layered. The main elements of the ANN were inputs, internal, and output layers, which were composed of virtual neurons highly interconnected with each other according to different topologies. Any virtual neuron of a layer was connected to all the neurons of the adjacent layers. Every connection between two virtual neurons was expressed by weight, which represented the “strength” of the connection itself. The weight between each pair of virtual neurons was computed by a learning algorithm along the training phase of ANN, when a set of input examples (training dataset with known classification output) were used as an input to ANN to allow this network to represent the implicit rules that link input features and the classification required as an output (e.g., in the present study, Nold vs. AD individuals). At the end of the training phase, the weights between pairs of neurons represented such rules. In the testing phase, the ability of the ANN to classify was tested in an independent series of datasets.
From a formal point of view, let us indicate with N1 the number of virtual neurons belonging to the lth layer and with ok the output of the kth neuron of the lth layer. Then, the computation performed by each virtual neuron can be expressed as:
Where is the weighted sum of the k neurons of the lth layer, wkj is the weight by which the same virtual neuron multiplies the output of the jth neuron of the previous layer, and f(.) is the so-called activation function, (Basheer and Hajmeer, 2000). The principal activation functions are: log-sigmoid function (logsig), tangent sigmoid function (tansig), saturating linear function (satlin), symmetric saturating linear function (satlins), and pure linear function (purelin).
In the present study, the ANN procedure for the classification of the Nold and AD individuals was formed by the following three steps (see details in Bevilacqua et al., 2016).
In the first step of the procedure, the optimal topology and minimization functions of the ANNs were defined, namely the proper number of ANN hidden layers, the types of activation functions and the number of virtual neurons per any layer, based on the general features of the rsEEG markers in the Nold and AD individuals to be classified. Several approaches could be found in the literature for the search of ANNs best topology using genetic algorithms, e.g., in Bevilacqua et al. (2006). In a previous study (Bevilacqua et al., 2015) a Multi-Objective Genetic Algorithm strategy was proposed to design a robust supervised ANN classifier between AD and NOLD based on EEG markers. Conversely, in this work the search of ANNs best topology was performed by using a Mono-Objective Genetic Algorithm (see details in Bevilacqua et al., 2016) maximizing the mean accuracy calculated on 500 iterations of training, validation and test using random permutations of the input dataset.
Specifically, each “chromosome” modeled all the main features of ANN topology, or rather the number of neurons in the hidden layers (ranging between 1 and 256 for the first hidden layer and from 0 to 255 for the other layers) and their activation functions; in this work, the considered activation functions were the logsig, tansig, purelin, and satlins. Moreover, the activation function set for the neuron in the output layer was the hyperbolic tangent sigmoid (tansig). Before training phase, the whole dataset was standardized using the z-score technique (Zill and Cullen, 2000) whose aim was to rescale data absolute value in an interval centered in 0 and with variance equal to 1.
In the second step of the procedure, the ANNs were trained to determine the connection weights for all virtual neurons and layers. These weights had to optimize the association between the rsEEG source markers in the Nold and AD individual datasets as an input and the correct classification as “Nold” or “AD” in the output virtual neuron. This second step started with the initialization of the connection weights of the virtual neurons by the Nguyen-Widrow's algorithm (Nguyen and Widrow, 1990), which is an efficient method to speed up such a training phase.
After that initialization, the ANNs were trained by a standard supervised learning algorithm namely “Resilient Backpropagation” (Riedmiller and Braun, 1993), adapting the connection weights to minimize the error in the association between the rsEEG source markers in the virtual input neurons and the correct classification as “Nold” or “AD”. In the training phase, the ANN assumed to the best connection weights for all virtual neurons and layers to optimize that association. To this purpose, the whole database of the mentioned rsEEG source markers was divided into three subsets corresponding to 60% (training subset), 20% (validation subset), and 20% (testing subset) of all Nold and AD individual datasets available, respectively. During the second step of the procedure, the training subset was used to train the ANN while the validation subset served to adapt the connection weights of the virtual neurons to avoid the overfitting problem (Witten and Frank, 2005). When the connection weights computed from the training subset produced higher classification errors in the association of the inputs (rsEEG markers) and classification outputs (“Nold” vs. “AD”) in the validation set, the ANN was assumed to fit too much the training set (“overfitting state”). This case was avoided stopping early the ANN training if the network performance fails to improve or remains the same for a number of epochs fixed to 100.
In the third step of the procedure, the performance of the ANNs to classify the Nold and AD individual datasets of the testing subset only (not used in the training and validation phases). That performance in the binary classification (Nold vs. AD) was measured by the following indexes expressed as percentages (%):
Sensitivity, defined as the rate of the AD individual testing datasets classified as AD correctly; this index was termed true positive (TP) or TP rate (TPR);
Specificity, defined as the rate of the Nold individual testing datasets classified as Nold correctly; this index was termed as true negative (TN) or TN rate (TNR);
Accuracy, defined as the sum of the TP and the TN divided by the total number of the individual datasets of the two classes (AD and Nold).
This step-wise classification procedure with training subset, validation subset, and a testing subset was repeated 500 times (iterations). Any iteration produced a value of sensitivity, specificity, and accuracy. The findings reported in the “Results” section refer to the average of the values of sensitivity, specificity, and accuracy over all 500 iterations.
ANNs: experimental design and statistical analysis
The experimental design aimed at computing the sensitivity, specificity, and accuracy of the classifications of the Nold and AD individual datasets for the following sessions:
The 4 most discriminant markers of eLORETA source current density (SCD), namely parietal, temporal, and occipital theta/alpha1 and the occipital delta/alpha 1;
The 4 most discriminant markers of eLORETA source functional connectivity (LLC) as listed in the previous section entitled “The rsEEG markers used as inputs for ANNs”;
The combination of the mentioned 8 most discriminant markers of eLORETA source current density (SCD) and the functional connectivity (LLC).
Figure 2 shows the peculiar architectures of the ANNs used for the above three sessions (they were optimized by the MOGA technique; Bevilacqua et al., 2006). For a given session, the mean and standard deviation of the classification accuracy were computed using the accuracy values of all 500 iterations of that session.
The freeware tool “R” (https://www.r-project.org/) was used to compare the means of the classification accuracy for the following statistical contrasts (p < 0.05):
The 4 most discriminant markers of eLORETA source current density (SCD) vs. the 4 most discriminant markers of eLORETA source functional connectivity (LLC);
The 4 most discriminant markers of eLORETA source current density (SCD) vs. the combination of the mentioned 8 most discriminant markers of eLORETA source current density (SCD) and the functional connectivity (LLC);
The 4 most discriminant markers of eLORETA source functional connectivity (LLC) vs. the combination of the mentioned 8 most discriminant markers of eLORETA source current density (SCD) and the functional connectivity (LLC);
The 4 most discriminant markers of eLORETA source current density (SCD) vs. the 10 most discriminant markers of eLORETA source current density (SCD).
These statistical contrasts were performed by Shapiro-Wilk normality test (p < 0.05). The dependent variable was the classification accuracy while the factor was the Session (4 best discriminant variables of eLORETA source current density, 4 best discriminant variables eLORETA source connectivity, etc.). Dunn's post-hoc test was used for multiple comparisons (p < 0.05). Tables 2, 3 listed the best 10 markers of SCD and LLC.
Table 2.
Source Current Density (SCD) | Sensitivity (%) | Specificity (%) | Accuracy (%) | AUROC |
---|---|---|---|---|
Parietal delta/alpha1 | 77.5 | 70 | 74.1 | 0.79 |
Occipital delta/alpha1 | 73.3 | 78 | 75.4 | 0.82 |
Temporal delta/alpha1 | 78.3 | 70 | 74.5 | 0.78 |
Limbic delta/alpha1 | 75.8 | 72 | 74.1 | 0.77 |
Frontal theta/alpha1 | 70 | 72 | 70.9 | 0.76 |
Central theta/alpha1 | 83.3 | 65 | 75.0 | 0.79 |
Parietal theta/alpha1 | 78.3 | 74 | 76.3 | 0.82 |
Occipital theta/alpha1 | 83.3 | 68 | 76.3 | 0.83 |
Temporal theta/alpha1 | 70.8 | 83 | 76.3 | 0.82 |
Limbic theta/alpha1 | 83.3 | 68 | 76.3 | 0.81 |
Specifically, those composite rsEEG markers were obtained by computing the ratio between the delta and alpha 1 source current density (SCD). The same procedure was followed to form the composite EEG markers obtained by computing the ratio between the theta and alpha 1 SCD. The classification rate is computed by the analysis of the area under the receiver operating characteristic curve (AUROC). The table reports the classification indexes for the composite EEG markers having an AUROC higher than 0.70 (i.e., 70%).
Table 3.
Linear Lagged Connectivity (LLC) | Sensitivity (%) | Specificity (%) | Accuracy (%) | AUROC |
---|---|---|---|---|
Intra-hemispheric left parietal limbic | 70 | 74 | 71.8 | 0.74 |
Intra-hemispheric left occipital limbic | 73.3 | 64 | 69.1 | 0.71 |
Intra-hemispheric right temporal limbic | 79.2 | 55 | 68.2 | 0.71 |
Intra-hemispheric right central occipital | 80.8 | 54 | 68.6 | 0.70 |
Intra-hemispheric right parietal occipital | 71.7 | 72 | 71.8 | 0.73 |
Intra-hemispheric right parietal temporal | 67.5 | 71 | 69.1 | 0.71 |
Intra-hemispheric right parietal limbic | 68.3 | 71 | 69.5 | 0.72 |
Intra-hemispheric right occipital temporal | 70.8 | 72 | 71.3 | 0.74 |
Intra-hemispheric right occipital limbic | 66.7 | 76 | 70.9 | 0.73 |
Intra-hemispheric right temporal limbic | 76.7 | 64 | 70.9 | 0.73 |
Specifically, those composite EEG markers were obtained by computing the ratio between the theta lagged linear connectivity and the alpha 1 linear lagged connectivity, exept the intra-hemispheric right temporal limbic linear lagget connectivity, computed with the ratio between the delta lagged linear connectivity and the alpha 1 linear lagged connectivity. The classification rate is computed by the analysis of area under the receiver operating characteristic curve (AUROC). The table reports the classification indexes for the composite EEG markers having an AUROC higher than 0.70 (i.e., 70%).
Results
Classification performance of the ANNs
Among the above sessions of ANN classification of the Nold and AD individuals, the best 4 discriminant markers of the rsEEG source current density reached the following best sorting rate: A sensitivity of 79.3%, a specificity of 74.3%, and an accuracy of 77%. Furthermore, the best 4 discriminant markers of the rsEEG source lagged linear connectivity showed a sensitivity of 74.2%, a specificity of 68.9%, and an accuracy of 71.6%. Finally, the combination of the above best 8 discriminant markers of the rsEEG source current density and linear lagged connectivity exhibited a sensitivity of 80%, a specificity of 72.7%, and an accuracy of 76.7%. Table 4 reports these values associated with their standard deviations. Figure 3 illustrates a topographical representation of the best 8 discriminant markers of the rsEEG source current density and linear lagged connectivity. The Shapiro-Wilk normality test (p < 0.05) showed that the accuracy values in the 500 iterations of any classification session (i.e., the best 4 discriminant markers of the rsEEG source current density; the best 4 discriminant markers of the rsEEG linear lagged connectivity; the above best 8 discriminant markers) were not Gaussian as distributions. From these distributions, Kruskal-Wallis test disclosed a statistically significant effect (p < 0.0001) while Dunn's post-hoc test revealed some interesting statistically significant differences in the classification accuracy between session pairs. Specifically, the classification accuracy was higher for the best 4 discriminant markers of rsEEG source current density than the best 4 discriminant markers of rsEEG source linear lagged connectivity (p < 0.0001). Furthermore, this accuracy was lower for the best 4 discriminant markers of rsEEG source linear lagged connectivity than the best 8 discriminant markers of the rsEEG source current density and linear lagged connectivity (p < 0.0001). In contrast, no difference in the classification accuracy was found between the best 4 discriminant markers of the rsEEG source current density and the best 8 discriminant markers of the rsEEG source current density and linear lagged connectivity (p > 0.05).
Table 4.
4 SCD | 4 LLC | 4 SCD + 4 LLC | |
---|---|---|---|
Sensitivity (%) | 79.3 ± 10.6 | 74.2 ± 11.4 | 80 ± 10.8 |
Specificity (%) | 74.3 ± 13.2 | 68.9 ± 14.6 | 72.7 ± 12.9 |
Accuracy (%) | 77 ± 5 | 71.6 ± 6.5 | 76.7 ± 5.2 |
Legend: SCD, Source Current Density; LLC, Lagged Linear Connectivity; TPR, True Positive Rate; TNR, True Negative Rate.
Control analysis
As reported above, the highest ANN classification of the Nold and AD individuals was obtained with the best 4 discriminant markers of the rsEEG source current density. Therefore, we tested if the 10 best discriminant markers of rsEEG source current density would improve this classification accuracy (Table 2 reports the list of those 10 rsEEG markers). To this aim, the MOGA procedure (Bevilacqua et al., 2006) optimized an ANN with the following features: 1 hidden layer composed of 54 virtual neurons with a LOGSIG activation function; an output neuron with a TANSIG activation function. With this ANN, the best 10 discriminant markers of rsEEG source current density showed a sensitivity of 77.1%, a specificity of 68%, and an accuracy of 74.2%. Again, the distribution of the accuracy values was not Gaussian (Shapiro-Wilk normality test, p < 0.05), so we used Wilcoxon test (p < 0.05) to evaluate the possible statistically significant differences in the classification of the Nold and AD individuals between the best 10 vs. the best 4 discriminant markers of the rsEEG source current density. Results showed no statistically significant difference (p > 0.05).
Discussion
The present Consortium designed a research program to define and validate rsEEG topographic markers useful to understand the neurophysiological underpinnings of the AD status and the effects of new medications on those underpinnings. Furthermore, the program has to investigate if rsEEG topographic markers can stratify AD individuals based on these neurophysiological bases, namely AD people with “Nold-like” rsEEG markers from those with “AD-like” rsEEG markers. A reliable classification ability of these rsEEG markers would be quite useful in both clinical practice and clinical trials (see Jelic and Kowalski, 2009, for a review). Indeed, AD people with “AD-like” rsEEG markers are expected to have a lower cerebral reserve across the disease evolution. In this line, we have previously used rsEEG markers of the cortical source current density and lagged linear connectivity for the classification of 120 AD patients with dementia and 100 Nold subjects with a linear univariate classifier such as the computation of ROC curves. The results showed that the best classification accuracy of 75.5% was reached using occipital delta/alpha 1 source current density (sensitivity of 73.3% and specificity of 78%). In the present study, we re-analyzed the same database of rsEEG markers with a non-linear multivariate classifier such as the ANN.
The results of the present study showed that the ANN classification produced a classification accuracy of 77% (sensitivity of 79.3% and specificity of 74.3%) using the best 4 discriminant markers of the rsEEG source current density (i.e., occipital, temporal, and parietal theta/alpha 1; occipital delta/alpha 1). Noteworthy, this accuracy was higher than that (71.6%) obtained by the best 4 discriminant markers of the rsEEG source lagged linear connectivity (i.e., inter-hemispherical occipital delta/alpha 1 as well as intra-hemispherical left and right occipital-temporal theta/alpha 1, and right parietal-limbic alpha 1). Furthermore, it did not differ from those reached using the mentioned 8 discriminant rsEEG markers (76.7%) or the best 10 rsEEG markers of source current density (77.1%). Overall, the multivariate non-linear ANN classifiers of the present study reached a moderate classification accuracy that cross-validated that obtained with a standard univariate linear classifier (i.e., ROC curves) from the same database of rsEEG marker (Babiloni et al., 2016a). The same consideration is true for other databases of rsEEG markers of source current density. In previous studies, we have reported that the occipital alpha or the ratio between parietooccipital delta and alpha source current density showed a moderate accuracy of about 75–80% in the classification of Nold subjects and AD patients with dementia (Babiloni et al., 2015, 2016a; Lizio et al., 2015).
The present findings extend to rsEEG markers of source current density and linear lagged connectivity a bulk of previous evidence of other research groups indicating that rsEEG activity provided qualitative markers allowing a moderate discrimination of about 80% between Nold and AD individuals (Brenner et al., 1986, 1988; Hooijer et al., 1990; Strijers et al., 1997; Claus et al., 1999). The present findings also extend the following previous pieces of evidence using quantitative rsEEG markers for classification purposes, mostly from spectral analysis. Huang et al. (2000) combined alpha and theta global field power to reach an accuracy of 84% to classify Nold individuals and AD patients with dementia, and an accuracy of 78% to discriminate the AD patients with dementia and MCI individuals. Adler et al. (2003) reported that the left temporal alpha coherence and the global theta power density returned an accuracy of 80% for the classification of Nold individuals and AD patients with dementia. Moretti et al. (2011) showed that increased global theta/gamma and alpha 3/alpha 2 power density ratios predicted the conversion from MCI to AD or non-AD dementia with an accuracy of 88%. Trambaiolli et al. (2011) described that the temporal modulation of the energy in the delta, theta, alpha, beta, and gamma bands gave an accuracy of 91% in the classification of Nold individuals and AD patients with dementia. Engedal et al. (2015) reported that 20 rsEEG markers (including the alpha frequency peak, total power density, and coherence between electrodes) allowed an accuracy of 90% in the classification of AD patients with dementia from elderly subjects without or with other forms of dementia (e.g., Parkinson's Disease, Dementia with Lewy Bodies). As mentioned in the Introduction section, a full review of the rsEEG classification studies can be found in two articles. One of them (Jonkman, 1997) reported an accuracy ranging from 54 to 100% in the classification of the Nold and AD subjects while the other article (Jelic and Kowalski, 2009) reported an accuracy of about 80–85% between the patients with AD dementia or MCI and the individuals without or with other forms of dementia. Noteworthy, these rates of classification accuracy are in the same order of those obtained from other reliable CSF and neuroimaging biomarkers of AD (Stoeckel et al., 2004; van der Flier, 2005; Klöppel et al., 2008; Álvarez et al., 2009).
Another interesting finding of the present study was that the classification accuracy was not improved combining the (eLORETA) rsEEG markers of the cortical source current density and lagged linear connectivity from the delta, theta, and alpha rhythms recorded during a resting state eyes-closed condition. In this condition of quiet wakefulness, healthy subjects show dominant rsEEG oscillations at about 8–13 Hz in posterior areas of cerebral cortex, the so-called alpha rhythms. These rhythms are associated with a fluctuating cortical inhibition due to a widespread synchronization of activity of cortical pyramidal neurons. These neurons would receive synchronizing signals at around 10 Hz from neurons of thalamocortical, brainstem-cortical, and corticocortical circuits underpinning vigilance and several cognitive functions such as attention and memory (Steriade and Llinás, 1988; Rossini et al., 1991; Neubauer and Freudenthaler, 1995; Klimesch et al., 1996; Klimesch, 1999; Pfurtscheller and Lopes da Silva, 1999; Roh et al., 2011). In the condition of quiet wakefulness, healthy subjects also show low values of delta (<4 Hz) and theta (4–7 Hz) rsEEG rhythms. When delta rhythms reach high power values in that condition, an abnormal tonic “disconnection mode” of the cerebral cortex can be hypothesized. In the quiet wakefulness, these abnormal delta rhythms might have a different neural substrate from sleep delta rhythms (i.e., in stage 4) caused by low-frequency oscillatory signals across cortico-thalamic (<1 Hz) and thalamocortical (<4 Hz) circuits (Steriade, 2003).
Here we report that the classification accuracy based on 8 (linear) rsEEG markers as inputs to ANN (e.g., about 76%) was similar to that obtained with a single rsEEG marker in a previous seminal study on the same database (75.5%; Babiloni et al., 2016a). How can we interpret this finding? From a neurophysiological point of view, the present rsEEG markers of source current density would probe cortical neural synchronization while rsEEG markers of functional connectivity would probe the functional interdependence and efficiency of neurotransmission in different regions of the cerebral cortex. Although these linear rsEEG source markers unveil different relevant neurophysiological mechanisms underpinning low cortical arousal and vigilance in AD patients, they may provide the same core neurophysiological information for the classification of Nold and AD individuals. A high degree of redundancy would prevent an improvement of the classification accuracy either be combining the present linear rsEEG markers of source current density and functional connectivity or increasing the number of rsEEG markers used. To improve the classification accuracy, future studies may use other independent linear and non-linear classes of rsEEG markers as an input to the ANNs, in addition to the present ones. On the one hand, the additional linear markers could be derived from autoregressive models, directed transfer function (DTF), and Granger causality (Granger, 1969; Kaminski and Blinowska, 1991; Kaminski et al., 1997; Korzeniewska et al., 1997; Blinowska, 2011; Katarzyn and Jaroslaw, 2011; Babiloni et al., 2016a). On the other hand, the non-linear ones could be derived from chaos, entropy, and synchronization likelihood (Micheloyannis et al., 1998; Stam, 2005). It can be speculated that those independent mathematical procedures would produce less correlated and redundant input variables for ANNs.
Conclusions
In a previous study, we showed the best accuracy of 75.5% in the classification of 120 AD patients with dementia and 100 matched Nold subjects based on eLORETA cortical source current density and lagged linear connectivity estimated from rsEEG rhythm (Babiloni et al., 2016a). Specifically, that accuracy was reached using the ratio between occipital delta and alpha1 current density as an input to a linear univariate classifier (i.e., ROC curves). In the present study, we tested the use of ANNs with the same database of eLORETA rsEEG markers. Frequency bands of interest were delta, theta, alpha 1, and alpha 2. Results showed that ANN classification reached an accuracy of 77% using the most 4 discriminative rsEEG markers of source current density (delta/alpha 1 and theta/alpha 1 ratios in posterior cortical lobes). The ANN classification exhibited an accuracy of 72% using the most 4 discriminative rsEEG markers of source lagged linear connectivity (alphas between posterior cortical lobes). With these 8 markers combined, an accuracy of 76% was reached.
Overall, the present results suggest that a non-linear (ANN) multivariate classification rate cross-validated that obtained using a linear univariate classifier in the previous reference study (Babiloni et al., 2016a). Although the linear rsEEG markers of cortical current density and connectivity probe different relevant neurophysiological mechanisms underpinning cortical arousal and vigilance in AD patients, they provide quite redundant information for classification purposes. In future AD studies, inputs to ANNs should combine the present markers with other linear (i.e., directed transfer function, phase lag index) and non-linear (i.e., chaos, entropy, synchronization likelihood) rsEEG markers to improve the classification accuracy of the present moderate values (about 75–80%).
Author contributions
AT, CBa, RF, RL, CD, and VB gave their contributions to the conception and design of the work. AS, RF, FN, LG, RT, VC, MB, AG, PS, SA, GB, GS, GLo, GLa, FO, CBu, FG, FS and GF were responsible for the enrollments, all the clinical evaluations, and the recordings of EEG data. AT, RL, and CD performed the analysis of data. VB and AB built and trained the Artificial Neural Networks. AT, CD, RL, FC, and GT performed the statistical analysis. AT, CBa, RL, and CD gave their contribution in the interpretation of the results. AT, CD, RL, VB, and CBa contributed in drafting the work and revising it critically for important intellectual content. AS, RF, FN, LG, RT, VC, MB, AG, PS, SA, GB, GS, GLo, GLa, FO, CBu, FG, FS, and GF contributed to the revision of the first and later versions of the manuscript.
Conflict of interest statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The present study was developed and granted in the framework of the following projects: “Smart Health 2.0” (Italian Ministry of University and Technological Research, Pon04a2_C-MIUR D.D. 626/Ric e 703/Ric), “Italian DIAfN” (Italian Ministry of Health, Finalized Research program, RF-2010-2319722) and “GRIDCORE” (Italian Ministry of Health, Finalized Research program, prot. RF-2010-2319113).
References
- Adler G., Brassen S., Jajcevic A. (2003). EEG coherence in Alzheimer's dementia. J. Neural Transm. 110, 1051–1058. 10.1007/s00702-003-0024-8 [DOI] [PubMed] [Google Scholar]
- Albert M. S., DeKosky S. T., Dickson D., Dubois B., Feldman H. H., Fox N. C., et al. (2011). The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimer's & Dementia? J. Alzheimer's Assoc. 7, 270–279. 10.1016/j.jalz.2011.03.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Álvarez I., López M., Górriz J. M., Ramírez J., Salas-Gonzalez D., Puntonet C. G., et al. (2009). Automatic classification system for the diagnosis of alzheimer disease using Component-Based SVM aggregations, in Advances in Neuro-Information Processing, (Heidelberg; Auckland: Springer; ), 402–409. [Google Scholar]
- Babiloni C., Binetti G., Cassetta E., Cerboneschi D., Dal Forno G., Del Percio C., et al. (2004). Mapping distributed sources of cortical rhythms in mild Alzheimer's disease. A multicentric EEG study. Neuroimage 22, 57–67. 10.1016/j.neuroimage.2003.09.028 [DOI] [PubMed] [Google Scholar]
- Babiloni C., Brancucci A., Capotosto P., Romani G. L., Arendt-Nielsen L., Chen A. C., et al. (2005). Slow cortical potential shifts preceding sensorimotor interactions. Brain Res. Bull. 65, 309–316. 10.1016/j.brainresbull.2004.11.023 [DOI] [PubMed] [Google Scholar]
- Babiloni C., Brancucci A., Vecchio F., Arendt-Nielsen L., Chen A. C., Rossini P. M. (2006). Anticipation of somatosensory and motor events increases centro-parietal functional coupling: an EEG coherence study. Clin. Neurophysiol. 117, 1000–1008. 10.1016/j.clinph.2005.12.028 [DOI] [PubMed] [Google Scholar]
- Babiloni C., Del Percio C., Boccardi M., Lizio R., Lopez S., Carducci F., et al. (2015). Occipital sources of resting-state alpha rhythms are related to local gray matter density in subjects with amnesic mild cognitive impairment and Alzheimer's disease. Neurobiol. Aging 36, 556–570. 10.1016/j.neurobiolaging.2014.09.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Babiloni C., Del Percio C., Bordet R., Bourriez J.-L., Bentivoglio M., Payoux P., et al. (2013c). Effects of acetylcholinesterase inhibitors and memantine on resting-state electroencephalographic rhythms in Alzheimer's disease patients. Clin. Neurophysiol. 124, 837–850. 10.1016/j.clinph.2012.09.017 [DOI] [PubMed] [Google Scholar]
- Babiloni C., Frisoni G. B., Pievani M., Vecchio F., Infarinato F., Geroldi C., et al. (2008). White matter vascular lesions are related to parietal-to-frontal coupling of EEG rhythms in mild cognitive impairment. Hum. Brain Mapp. 29, 1355–1367. 10.1002/hbm.20467 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Babiloni C., Frisoni G. B., Pievani M., Vecchio F., Lizio R., Buttiglione M., et al. (2009). Hippocampal volume and cortical sources of EEG alpha rhythms in mild cognitive impairment and Alzheimer disease. Neuroimage 44, 123–135. 10.1016/j.neuroimage.2008.08.005 [DOI] [PubMed] [Google Scholar]
- Babiloni C., Frisoni G. B., Vecchio F., Lizio R., Pievani M., Cristina G., et al. (2011a). Stability of clinical condition in mild cognitive impairment is related to cortical sources of alpha rhythms: an electroencephalographic study. Hum. Brain Mapp. 32, 1916–1931. 10.1002/hbm.21157 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Babiloni C., Frisoni G. B., Vecchio F., Pievani M., Geroldi C., De Carli C., et al. (2010). Global functional coupling of resting EEG rhythms is related to white-matter lesions along the cholinergic tracts in subjects with amnesic mild cognitive impairment. J. Alzheimers. Dis. 19, 859–871. 10.3233/JAD-2010-1290 [DOI] [PubMed] [Google Scholar]
- Babiloni C., Infarinato F., Aujard F., Bastlund J. F., Bentivoglio M., Bertini G., et al. (2013a). Effects of pharmacological agents, sleep deprivation, hypoxia and transcranial magnetic stimulation on electroencephalographic rhythms in rodents: towards translational challenge models for drug discovery in Alzheimer's disease. Clin. Neurophysiol. 124, 437–451. 10.1016/j.clinph.2012.07.023 [DOI] [PubMed] [Google Scholar]
- Babiloni C., Infarinato F., Triggiani A. I., Lizio R., Percio C., Del Marzano N., et al. (2013b). Resting state EEG rhythms as network disease markers for drug discovery in Alzheimer's disease. Drug Discov. Today Ther. Strateg. 10, e85–e90. 10.1016/j.ddstr.2014.02.003 [DOI] [Google Scholar]
- Babiloni C., Lizio R., Carducci F., Vecchio F., Redolfi A., Marino S., et al. (2011b). Resting state cortical electroencephalographic rhythms and white matter vascular lesions in subjects with Alzheimer's disease: an Italian multicenter study. J. Alzheimers. Dis. 26, 331–346. 10.3233/JAD-2011-101710 [DOI] [PubMed] [Google Scholar]
- Babiloni C., Lizio R., Marzano N., Capotosto P., Soricelli A., Triggiani A. I., et al. (2016b). Brain neural synchronization and functional coupling in Alzheimer's disease as revealed by resting state EEG rhythms. Int. J. Psychophysiol. 103, 88–102. 10.1016/j.ijpsycho.2015.02.008 [DOI] [PubMed] [Google Scholar]
- Babiloni C., Triggiani A. I., Lizio R., Cordone S., Tattoli G., Bevilacqua V., et al. (2016a). Classification of single normal and alzheimer's disease individuals from cortical sources of resting state EEG rhythms. Front. Neurosci. 10:47. 10.3389/fnins.2016.00047 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Basheer I. A., Hajmeer M. (2000). Artificial neural networks: fundamentals, computing, design, and application. J. Microbiol. Methods 43, 3–31. 10.1016/S0167-7012(00)00201-3 [DOI] [PubMed] [Google Scholar]
- Besthorn C., Zerfass R., Geiger-Kabisch C., Sattel H., Daniel S., Schreiter-Gasser U., et al. (1997). Discrimination of Alzheimer's disease and normal aging by EEG data. Electroencephalogr. Clin. Neurophysiol. 103, 241–248. [DOI] [PubMed] [Google Scholar]
- Bevilacqua V., Brunetti A., Triggiani M., Magaletti D., Telegrafo M., Moschetta M. (2016). An optimized feed-forward artificial neural network topology to support radiologists in breast lesions classification, in Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion, (Denver: ACM; ), 1385–1392. [Google Scholar]
- Bevilacqua V., Mastronardi G., Menolascina F., Pannarale P., Pedone A. (2006). A novel multi-objective genetic algorithm approach to artificial neural network topology optimisation: the breast cancer classification problem, in Neural Networks, IJCNN'06. International Joint Conference on (Vancouver, BC: ), 1958–1965. [Google Scholar]
- Bevilacqua V., Salatino A. A., Di Leo C., Tattoli G., Buongiorno D., Signorile D., et al. (2015). Advanced classification of Alzheimer's disease and healthy subjects based on EEG markers, in 2015 International Joint Conference on Neural Networks (IJCNN), (Killarney: IEEE; ), 1–5. [Google Scholar]
- Blinowska K. J. (2011). Review of the methods of determination of directed connectivity from multichannel data. Med. Biol. Eng. Comput. 49, 521–529. 10.1007/s11517-011-0739-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Braak H., Braak E. (1995). Staging of Alzheimer's disease-related neurofibrillary changes. Neurobiol. Aging 16, 271–278. [DOI] [PubMed] [Google Scholar]
- Brenner R. P., Reynolds C. F., III, Ulrich R. F. (1988). Diagnostic efficacy of computerized spectral versus visual EEG analysis in elderly normal, demented and depressed subjects. Electroencephalogr. Clin. Neurophysiol. 69, 110–117. 10.1016/0013-4694(88)90206-4 [DOI] [PubMed] [Google Scholar]
- Brenner R. P., Ulrich R. F., Spiker D. G., Sclabassi R. J., Reynolds C. F., III, Marin R. S., et al. (1986). Computerized EEG spectral analysis in elderly normal, demented and depressed subjects. Electroencephalogr. Clin. Neurophysiol. 64, 483–492. 10.1016/0013-4694(86)90184-7 [DOI] [PubMed] [Google Scholar]
- Canuet L., Ishii R., Pascual-Marqui R. D., Iwase M., Kurimoto R., Aoki Y., et al. (2011). Resting-state EEG source localization and functional connectivity in schizophrenia-like psychosis of epilepsy. PLoS ONE 6:e27863. 10.1371/journal.pone.0027863 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chiaramonti R., Muscas G. C., Paganini M., Müller T. J., Fallgatter A. J., Versari A., et al. (1997). Correlations of topographical EEG features with clinical severity in mild and moderate dementia of Alzheimer type. Neuropsychobiology 36, 153–158. [DOI] [PubMed] [Google Scholar]
- Claus J. J., Strijers R. L., Jonkman E. J., Ongerboer de Visser B. W., Jonker C., Walstra G. J., et al. (1999). The diagnostic value of electroencephalography in mild senile Alzheimer's disease. Clin. Neurophysiol. 110, 825–832. [DOI] [PubMed] [Google Scholar]
- Dierks T., Ihl R., Frölich L., Maurer K. (1993). Dementia of the Alzheimer type: effects on the spontaneous EEG described by dipole sources. Psychiatry Res. 50, 151–162. 10.1016/0925-4927(93)90027-F [DOI] [PubMed] [Google Scholar]
- Dierks T., Jelic V., Pascual-Marqui R. D., Wahlund L., Julin P., Linden D. E., et al. (2000). Spatial pattern of cerebral glucose metabolism (PET) correlates with localization of intracerebral EEG-generators in Alzheimer's disease. Clin. Neurophysiol. 111, 1817–1824. 10.1016/S1388-2457(00)00427-2 [DOI] [PubMed] [Google Scholar]
- Dubois B., Feldman H. H., Jacova C., Dekosky S. T., Barberger-Gateau P., Cummings J., et al. (2007). Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS-ADRDA criteria. Lancet. Neurol. 6, 734–746. 10.1016/S1474-4422(07)70178-3 [DOI] [PubMed] [Google Scholar]
- Dubois B., Feldman H. H., Jacova C., Hampel H., Molinuevo J. L., Blennow K., et al. (2014). Advancing research diagnostic criteria for Alzheimer's disease: the IWG-2 criteria. Lancet Neurol. 13, 614–629. 10.1016/S1474-4422(14)70090-0 [DOI] [PubMed] [Google Scholar]
- Engedal K., Snaedal J., Hoegh P., Jelic V., Bo Andersen B., Naik M., et al. (2015). Quantitative EEG applying the statistical recognition pattern method: a useful tool in dementia diagnostic workup. Dement. Geriatr. Cogn. Disord. 40, 1–12. 10.1159/000381016 [DOI] [PubMed] [Google Scholar]
- Folstein M. F., Folstein S. E., McHugh P. R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12, 189–198. [DOI] [PubMed] [Google Scholar]
- Förstl H., Kurz A. (1999). Clinical features of Alzheimer's disease. Eur. Arch. Psychiatry Clin. Neurosci. 249, 288–290. [DOI] [PubMed] [Google Scholar]
- Fuchs M., Kastner J., Wagner M., Hawes S., Ebersole J. S. (2002). A standardized boundary element method volume conductor model. Clin. Neurophysiol. 113, 702–712. 10.1016/S1388-2457(02)00030-5 [DOI] [PubMed] [Google Scholar]
- Granger C. W. J. (1969). Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37, 424–438. 10.2307/1912791 [DOI] [Google Scholar]
- Hooijer C., Jonker C., Posthuma J., Visser S. L. (1990). Reliability, validity and follow-up of the EEG in senile dementia: sequelae of sequential measurement. Electroencephalogr. Clin. Neurophysiol. 76, 400–412. [DOI] [PubMed] [Google Scholar]
- Huang C., Wahlund L.-O., Dierks T., Julin P., Winblad B., Jelic V. (2000). Discrimination of Alzheimer's disease and mild cognitive impairment by equivalent EEG sources: a cross-sectional and longitudinal study. Clin. Neurophysiol. 111, 1961–1967. 10.1016/S1388-2457(00)00454-5 [DOI] [PubMed] [Google Scholar]
- Hughes C. P., Berg L., Danziger W. L. (1982). A new clinical scale for the staging of dementia. Br. J. Psychiatry 140, 566–572. 10.1192/bjp.140.6.566 [DOI] [PubMed] [Google Scholar]
- Jack C. R., Knopman D. S., Jagust W. J., Shaw L. M., Aisen P. S., Weiner M. W., et al. (2010). Hypothetical model of dynamic biomarkers of the Alzheimer's pathological cascade. Lancet. Neurol. 9, 119–128. 10.1016/S1474-4422(09)70299-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jelic V., Kowalski J. (2009). Evidence-based evaluation of diagnostic accuracy of resting EEG in dementia and mild cognitive impairment. Clin. EEG Neurosci. 40, 129–142. 10.1177/155005940904000211 [DOI] [PubMed] [Google Scholar]
- Jelic V., Shigeta M., Julin P., Almkvist O., Winblad B., Wahlund L. O. (1996). Quantitative electroencephalography power and coherence in Alzheimer's disease and mild cognitive impairment. Dementia 7, 314–323. 10.1159/000106897 [DOI] [PubMed] [Google Scholar]
- Jeong J. (2004). EEG dynamics in patients with Alzheimer's disease. Clin. Neurophysiol. 115, 1490–1505. 10.1016/j.clinph.2004.01.001 [DOI] [PubMed] [Google Scholar]
- Jonkman E. J. (1997). The role of the electroencephalogram in the diagnosis of dementia of the Alzheimer type: an attempt at technology assessment. Neurophysiol. Clin. Neurophysiol. 27, 211–219. [DOI] [PubMed] [Google Scholar]
- Jurcak V., Tsuzuki D., Dan I. (2007). 10/20, 10/10, and 10/5 systems revisited: their validity as relative head-surface-based positioning systems. Neuroimage 34, 1600–1611. 10.1016/j.neuroimage.2006.09.024 [DOI] [PubMed] [Google Scholar]
- Kaminski M., Blinowska K., Szclenberger W. (1997). Topographic analysis of coherence and propagation of EEG activity during sleep and wakefulness. Electroencephalogr. Clin. Neurophysiol. 102, 216–227. 10.1016/S0013-4694(96)95721-5 [DOI] [PubMed] [Google Scholar]
- Kaminski M. J., Blinowska K. J. (1991). A new method of the description of the information flow in the brain structures. Biol. Cybern. 65, 203–210. 10.1007/BF00198091 [DOI] [PubMed] [Google Scholar]
- Katarzyna J. B., Jaroslaw Z. (2011). Series in Medical Physics and Biomedical Engineering. CRC Press, 324. [Google Scholar]
- Klimesch W. (1999). EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res. Brain Res. Rev. 29, 169–195. [DOI] [PubMed] [Google Scholar]
- Klimesch W., Doppelmayr M., Schimke H., Pachinger T. (1996). Alpha frequency, reaction time, and the speed of processing information. J. Clin. Neurophysiol. 13, 511–518. [DOI] [PubMed] [Google Scholar]
- Klöppel S., Stonnington C. M., Chu C., Draganski B., Scahill R. I., Rohrer J. D., et al. (2008). Automatic classification of MR scans in Alzheimer's disease. Brain 131, 681–689. 10.1093/brain/awm319 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Korzeniewska A., Kasicki S., Kamiński M., Blinowska K. J. (1997). Information flow between hippocampus and related structures during various types of rat's behavior. J. Neurosci. Methods 73, 49–60. 10.1016/S0165-0270(96)02212-1 [DOI] [PubMed] [Google Scholar]
- Lawton M. P., Brody E. M. (1969). Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist 9, 179–186. 10.1093/geront/9.3_Part_1.179 [DOI] [PubMed] [Google Scholar]
- Lizio R., Del Percio C., Marzano N., Soricelli A., Yener G. G., Başar E., et al. (2015). Neurophysiological assessment of Alzheimer's disease individuals by a single electroencephalographic marker. J. Alzheimers. Dis. 49, 159–177. 10.3233/JAD-143042 [DOI] [PubMed] [Google Scholar]
- Mazziotta J. C., Toga A. W., Evans A., Fox P., Lancaster J. (1995). A probabilistic atlas of the human brain: theory and rationale for its development. The International Consortium for Brain Mapping (ICBM). Neuroimage 2, 89–101. 10.1006/nimg.1995.1012 [DOI] [PubMed] [Google Scholar]
- McKeith I. G., Dickson D. W., Lowe J., Emre M., O'Brien J. T., Feldman H., et al. (2005). Diagnosis and management of dementia with Lewy bodies: third report of the DLB consortium. Neurology 65, 1863–1872. 10.1212/01.wnl.0000187889.17253.b1 [DOI] [PubMed] [Google Scholar]
- McKhann G., Drachman D., Folstein M., Katzman R., Price D., Stadlan E. M. (1984). Clinical diagnosis of Alzheimer's disease: report of the NINCDS-ADRDA work group under the auspices of department of health and human services task force on alzheimer's disease. Neurology 34, 939–944. 10.1212/WNL.34.7.939 [DOI] [PubMed] [Google Scholar]
- McKhann G. M., Knopman D. S., Chertkow H., Hyman B. T., Jack C. R., Kawas C. H., et al. (2011). The diagnosis of dementia due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 7, 263–269. 10.1016/j.jalz.2011.03.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Micheloyannis S., Flitzanis N., Papanikolaou E., Bourkas M., Terzakis D., Arvanitis S., et al. (1998). Usefulness of non-linear EEG analysis. Acta Neurol. Scand. 97, 13–19. [DOI] [PubMed] [Google Scholar]
- Moretti D. V., Frisoni G. B., Fracassi C., Pievani M., Geroldi C., Binetti G., et al. (2011). MCI patients' EEGs show group differences between those who progress and those who do not progress to AD. Neurobiol. Aging 32, 563–571. 10.1016/j.neurobiolaging.2009.04.003 [DOI] [PubMed] [Google Scholar]
- Neubauer A. C., Freudenthaler H. H. (1995). Ultradian rhythms in cognitive performance: no evidence for a 1.5-h rhythm. Biol. Psychol. 40, 281–298. 10.1016/0301-0511(95)05121-P [DOI] [PubMed] [Google Scholar]
- Nguyen D., Widrow B. (1990). Improving the learning speed of 2-layer neural networks by choosinginitial values of the adaptive weights, in International Joint Conference Neural Networks. (San Diego, CA: ). [Google Scholar]
- Pascual-Marqui R. D. (2007a). Discrete, 3D distributed, linear imaging methods of electric neuronal activity. Part 1: exact, zero error localization. arXiv:0710.3341. Available online at: https://arxiv.org/abs/0710.3341
- Pascual-Marqui R. D. (2007b). Instantaneous and lagged measurements of linear and nonlinear dependence between groups of multivariate time series: frequency decomposition. arXiv:0711.1455 [stat.ME]. Available online at: http://arxiv.org/abs/0711.1455
- Pascual-Marqui R. D., Michel C. M., Lehmann D. (1994). Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. Int. J. Psychophysiol. 18, 49–65. [DOI] [PubMed] [Google Scholar]
- Pascual-Marqui R. D., Esslen M., Kochi K., Lehmann D. (2002). Functional imaging with low-resolution brain electromagnetic tomography (LORETA): a review. Methods Find. Exp. Clin. Pharmacol. 24(Suppl. C), 91–95. 10.1016/j.jneumeth.2006.10.023 [DOI] [PubMed] [Google Scholar]
- Pascual-Marqui R. D., Lehmann D., Koukkou M., Kochi K., Anderer P., Saletu B., et al. (2011). Assessing interactions in the brain with exact low-resolution electromagnetic tomography. Philos. Trans. R. Soc. London A Math. Phys. Eng. Sci. 369, 3768–3784. 10.1098/rsta.2011.0081 [DOI] [PubMed] [Google Scholar]
- Pfurtscheller G., Lopes da Silva F. H. (1999). Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin. Neurophysiol. 110, 1842–1857. 10.1016/S1388-2457(99)00141-8 [DOI] [PubMed] [Google Scholar]
- Ponomareva N. V., Selesneva N. D., Jarikov G. A. (2003). EEG alterations in subjects at high familial risk for Alzheimer's disease. Neuropsychobiology 48, 152–159. 10.1159/000073633 [DOI] [PubMed] [Google Scholar]
- Riedmiller M., Braun H. (1993). A direct adaptive method for faster backpropagation learning: The RPROP algorithm, in IEEE International Conference on Neural Networks - Conference Proceedings (San Francisco, CA: ), 586–591. [Google Scholar]
- Roh J. H., Park M. H., Ko D., Park K.-W., Lee D.-H., Han C., et al. (2011). Region and frequency specific changes of spectral power in Alzheimer's disease and mild cognitive impairment. Clin. Neurophysiol. 122, 2169–2176. 10.1016/j.clinph.2011.03.023 [DOI] [PubMed] [Google Scholar]
- Román G. C., Tatemichi T. K., Erkinjuntti T., Cummings J. L., Masdeu J. C., Garcia J. H., et al. (1993). Vascular dementia: diagnostic criteria for research studies. Report of the NINDS-AIREN International Workshop. Neurology 43, 250–260. 10.1212/WNL.43.2.250 [DOI] [PubMed] [Google Scholar]
- Rossini P. M., Desiato M. T., Lavaroni F., Caramia M. D. (1991). Brain excitability and electroencephalographic activation: non-invasive evaluation in healthy humans via transcranial magnetic stimulation. Brain Res. 567, 111–119. 10.1016/0006-8993(91)91442-4 [DOI] [PubMed] [Google Scholar]
- Sperling R. A., Jack C. R., Black S. E., Frosch M. P., Greenberg S. M., Hyman B. T., et al. (2011). Amyloid-related imaging abnormalities in amyloid-modifying therapeutic trials: Recommendations from the Alzheimer's Association Research Roundtable Workgroup. Alzheimer's Dement. 7, 367–385. 10.1016/j.jalz.2011.05.2351 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stam C. J. (2005). Nonlinear dynamical analysis of EEG and MEG: review of an emerging field. Clin. Neurophysiol. 116, 2266–2301. 10.1016/j.clinph.2005.06.011 [DOI] [PubMed] [Google Scholar]
- Steriade M. (2003). Cerebello-cerebral interactions during states of vigilance. Cerebellum 2, 82–83. 10.1080/14734220309404 [DOI] [PubMed] [Google Scholar]
- Steriade M., Llinás R. R. (1988). The functional states of the thalamus and the associated neuronal interplay. Physiol. Rev. 68, 649–742. [DOI] [PubMed] [Google Scholar]
- Stoeckel J., Ayache N., Malandain G., Koulibaly P. M., Ebmeier K. P., Darcourt J. (2004). Automatic classification of SPECT images of Alzheimer's disease patients and control subjects. Lecture Notes in Computer Science (Sophia Antipolis: ), 3217(1 PART 2), 654, 662 Available online at: https://www.scopus.com/inward/record.uri?eid=2-s2.0-20344398668&partnerID=40&md5=b8af0975f7f7ffdcdb25dc5ca60006b5 [Google Scholar]
- Strijers R. L., Scheltens P., Jonkman E. J., de Rijke W., Hooijer C., Jonker C. (1997). Diagnosing Alzheimer's disease in community-dwelling elderly: a comparison of EEG and MRI. Dement. Geriatr. Cogn. Disord. 8, 198–202. [DOI] [PubMed] [Google Scholar]
- The Lund Manchester Groups (1994). Clinical and neuropathological criteria for frontotemporal dementia. The Lund Manchester Groups. J. Neurol. Neurosurg. Psychiatry 57, 416–418. 10.1136/jnnp.57.4.416 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Trambaiolli L. R., Lorena A. C., Fraga F. J., Kanda P. A. M., Anghinah R., Nitrini R. (2011). Improving Alzheimer's disease diagnosis with machine learning techniques. Clin. EEG Neurosci. 42, 160–165. [DOI] [PubMed] [Google Scholar]
- van der Flier W. M. (2005). Use of laboratory and imaging investigations in dementia. J. Neurol. Neurosurg. Psychiatry 76, v45–v52. 10.1136/jnnp.2005.082149 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Witten I. H., Frank E. (2005). Data Mining: Practical Machine Learning Tools and Techniques. Available online at: http://www.amazon.com/Data-Mining-Practical-Techniques-Management/dp/0120884070/ref=sr_1_2?s=books&ie=UTF8&qid=1329477320&sr=1-2
- Yesavage J. A., Brink T. L., Rose T. L., Lum O., Huang V., Adey M., et al. (1983). Development and validation of a geriatric depression screening scale: a preliminary report. J. Psychiatr. Res. 17, 37–49. [DOI] [PubMed] [Google Scholar]
- Zill D. G., Cullen M. R. (2000). Advanced Engineering Mathematics. Biotechnol. Bioeng. 90, 926 10.1002/bit.20432 [DOI] [Google Scholar]