Skip to main content
Age and Ageing logoLink to Age and Ageing
. 2024 Jun 27;53(6):afae121. doi: 10.1093/ageing/afae121

Small World derived index to distinguish Alzheimer’s type dementia and healthy subjects

Fabrizio Vecchio 1,2,, Francesca Miraglia 3,4, Chiara Pappalettera 5,6, Lorenzo Nucci 7, Alessia Cacciotti 8,9, Paolo Maria Rossini 10
PMCID: PMC11210397  PMID: 38935531

Abstract

Background

This article introduces a novel index aimed at uncovering specific brain connectivity patterns associated with Alzheimer's disease (AD), defined according to neuropsychological patterns.

Methods

Electroencephalographic (EEG) recordings of 370 people, including 170 healthy subjects and 200 mild-AD patients, were acquired in different clinical centres using different acquisition equipment by harmonising acquisition settings. The study employed a new derived Small World (SW) index, SWcomb, that serves as a comprehensive metric designed to integrate the seven SW parameters, computed across the typical EEG frequency bands. The objective is to create a unified index that effectively distinguishes individuals with a neuropsychological pattern compatible with AD from healthy ones.

Results

Results showed that the healthy group exhibited the lowest SWcomb values, while the AD group displayed the highest SWcomb ones.

Conclusions

These findings suggest that SWcomb index represents an easy-to-perform, low-cost, widely available and non-invasive biomarker for distinguishing between healthy individuals and AD patients.

Keywords: Alzheimer’s, graph theory, electroencephalographic (EEG), neurorehabilitation, Small World, older people

Key Points

  • Electroencephalographic (EEG) Small World (SW) organisation in brain networks is examined for potential insights into neurodegeneration in conditions like Alzheimer's disease (AD).

  • A derived SW index as a reliable biomarker for early diagnosis and risk stratification.

  • AD affects brain's network architecture, emphasising the importance of understanding the complex brain organisation in ageing.

Introduction

Alzheimer’s disease (AD), the predominant type of dementia, affects various cognitive domains [1] and imposes an enormous burden on patients and healthcare systems [2].

Neurodegeneration disrupts the brain's network architecture leading to cognitive decline and brain damage [3]. Understanding the organisation of the human brain as a complex network has emerged as a powerful framework to study ageing and neurodegeneration processes.

Over the past two decades, the application of innovative mathematical approaches such as graphs theory on electroencephalographic (EEG) data has experienced a significant increase [4, 5]. The graph theory allows describing the brain through a mathematic model, the graph, which provides a simple representation of a complex system. The graph is a network model consisting of nodes, representing sets of neurons, and edges, which are the connections existing between the nodes. The characteristics of the graph are measurable through several parameters, such as the Clustering Coefficient, which represents the number of connections that exist between the nearest neighbours of a node as a proportion of maximum number of possible connections and reflects the tendency of a network to form topologically organised circuits, or the Path Length, the minimum number of edges that must be traversed to go from one node to another.

In particular, a key discovery highlights the Small World (SW) organisation existence in human brain networks. The SW index, assessed on brain networks, represents the organisation of the brain network as it estimates the balance between segregation, local connectedness, and integration, global connectedness, of a network supporting efficient information transfer as well as some local specialisation [6]. The small-worldness measure of the network was determined by the ratio of the normalised clustering coefficient, representing the network's ability to create separate clusters, to the normalised path length, the network's ability to become interconnected and exchange information.

This dynamic structure exhibits significant alterations in neurological disorders [7] suggesting that SW might unravel the neural dynamics of neurodegeneration and possible changes in connectivity in conditions like AD. Therefore, over the years, as AD has been increasingly considered as a synaptic disconnection syndrome, its complex brain dynamics have been studied with the network approach.

Previous research explored network differences to aid the early diagnosis of dementia and distinguish AD patients from healthy individuals [8]. In particular, SW index values seem to increase in the alpha band [9] and to decrease in delta, theta and beta bands [10–12] in AD patients compared to healthy subjects. Furthermore, studies reported a significant reduction in the SW of mild AD patients in all the EEG frequency bands compared to healthy controls [13, 14]. Regarding the conversion to AD, Miraglia et al. [15], studying SW in the Default Mode Network, discovered that SW index in the gamma band decreased in converted MCI subjects compared to stable MCI subjects. Moreover, in converted MCI subjects with impairment in linguistic domain, the SW index significantly decreased in the delta band, while in those converted MCI subjects with impairment in the executive domain, the SW index decreased in the delta and gamma bands and increased in the alpha 1 band. Furthermore, several studies have highlighted correlations between SW index with neuropsychological tests and other AD biomarkers. In particular, a correlation between SW in beta and gamma bands and the deposition of the protein tau has been reported [16], meaning that the higher tau burden in early AD’s disease was associated with a shift away from the optimal SW organisation and a more fragmented network, especially in the beta and gamma bands. Tait and collaborators [17] found a positive correlation between SW calculated in the temporal lobe and the language sub-score of mini-mental state examination (MMSE), indicating that disruption in temporal lobe connectivity plays an important role in the language impairments of AD subjects.

Based on these results, it is evident how the SW index succeeds in representing networks dysfunctions induced by AD and in distinguishing the organisation of pathological networks from healthy ones. Moreover, it is evident that these changes occur differently in the distinct frequency bands of the EEG (delta, theta, alpha 1, alpha 2, beta 1, beta 2 and gamma). Following these lines, we believe that considering only one SW based index, incorporating all the EEG frequency bands, rather than considering frequency bands separately represents most effectively all the changes brought by the pathology.

Therefore, this study presents an innovative approach that proposes a new derived SW EEG index, incorporating information of the seven EEG rhythms, aimed to identify specific patterns that differentiate healthy ageing from AD, which could potentially serve as a reliable biomarker for early diagnosis and risk stratification.

Subjects and methods

Subjects

A total of 170 healthy subjects (55.3% females; mean age = 71.07 years, Standard Error (SE) = 0.45y) and 200 patients with mild-AD (65% females; mean age = 72.32 years, SE = 0.49y) were included. Participants were recruited from a wide range of Italian facilities including hospitals, Institutes of Scientific Research and Healthcare (IRCCSs—Instituti di Ricovero e Cura a Carattere Scientifico) and research centres. Demographic and clinical information are provided in Table 1. No significant correlations between demographic data and the derived SW index were found. This analysis strengthens the robustness of our findings and underscores the reliability of the SWcomb index as a measure unaffected by demographic factors within the range considered.

Table 1.

Demographic and clinical characteristics of the three groups enrolled in this study, healthy and AD patients. The table includes information on years (y) of age and education, and MMSE scores for each group in terms of mean values and SE

Age Education MMSE
Healthy 71.07y ± 0.45y 10.78y ± 0.33y 28.37 ± 0.135
AD 72.32y ± 0.49y 8.36y ± 0.34y 20.54 ± 0.276

Recruitment criteria for healthy subjects included no history of neurological or psychiatric disorders, or current vasoactive or psychotropic medication treatment.

The mild-AD diagnosis was established according to the National Institute on Aging-Alzheimer’s Association workgroups [18] and DSM IV TR criteria [19] and based on neuropsychological testing.

In this article, we have exclusively focused on mild AD patients, primarily due to their representation of the initial phases of the disease. During these stages, patients typically exhibit higher levels of autonomy and cooperation, making them suitable candidates for EEG recordings conducted for research purposes. Additionally, our research interest lies in delving into the distinct characteristics of brain networks during the early phases of AD. We aim to potentially expand this analysis to include the prodromal stage (MCI) in the near future. Informed consent was obtained from each participant, adhering to the Code of Ethics of the World Medical Association (1997) and following the principles outlined in the Declaration of Helsinki.

Data recordings and preprocessing

Brain activity was recorded from each subject through EEG recording for at least 5 min in eyes-closed rest condition. The EEG recordings were obtained from different clinical centres (hospitals, IRCCSs and research centres) using different equipment, with at least 19 wet electrodes placed according to the International 10–20 system, after an acquisition procedures harmonisation. Vertical and horizontal electrooculographies (EOGs) were used for eye movements and blinking. Impedance was kept below 10 KΩ and the sampling rate was at least 256 Hz. The data were processed in Matlab R2022b using scripts based on EEGLAB.

All recordings were down-sampled to 256 Hz and were band-pass filtered from 0.2 to 47 Hz using a finite impulse response filter. The imported data were divided into 2 s epochs, and records were cleaned. Regarding the artefact cleaning procedure, our pipeline involves two main steps. Initially, we manually inspect epochs to identify and remove those containing isolated artefacts within the epoch itself. Following this inspection, we apply the Infomax Independent Component Analysis (ICA) algorithm. The ICA algorithm is a powerful technique used to separate mixed signals into their constituent sources. In our study, it helps us effectively remove various types of artefacts that are distributed throughout the EEG recording. For instance, in conditions where participants have their eyes open, as in the present experiment, we can efficiently remove blink artefacts using ICA. Similarly, if a channel exhibits high-frequency artefacts consistently throughout the experiment, ICA enables us to clean that channel by removing the artefact and reconstructing the underlying brain activity. Additionally, ICA is instrumental in addressing artefacts such as cardiac interference, which can occur if a channel is positioned near a blood vessel. This type of artefact typically affects the entire EEG recording, but with ICA, we can successfully mitigate its effects. Each type of artefact exhibits distinct power spectra and characteristic topographies, facilitating their identification and removal using ICA. Overall, the combination of manual epoch inspection and ICA-based artefact removal ensures robust data quality by effectively eliminating various types of artefacts while preserving the integrity of the EEG signals.

Functional connectivity analysis

Connectivity between 84 regions of interest (ROIs) based on the 42 Brodmann areas available for both hemispheres [20, 21] was assessed using the eLORETA software.

The intracortical Lagged linear connectivity was calculated for all possible pairs of the 84 ROIs within each of the seven EEG frequency bands, namely delta (2–4 Hz), theta (4–8 Hz), alpha 1 (8–10.5 Hz), alpha 2 (10.5–13 Hz), beta 1 (13–20 Hz), beta 2 (20–30 Hz) and gamma (30–45 Hz), for each subject.

Graph analysis

The graph analysis represents the network as a complex system consisting of nodes (vertices) and links (edges) connecting nodes.

Weighted and undirected brain networks were constructed using the Brain Connectivity Toolbox, adapted into Matlab scripts. The cortical sources estimated in the Brodmann areas served as vertices, and the edges were weighted using the Lagged linear connectivity values between each pair of vertices.

The SW index was determined by calculating the ratio of the normalised clustering coefficient to the normalised characteristic path length for all EEG frequency bands [20].

Small world derived index (SWcomb)

AD altered all the EEG frequency bands. A suitable approach appears to be the combination of the seven parameters into a single index instead of selecting a single band or a subset. COBYLA (Combined by Linear Approximations), used to find the optimal combination of parameters, was applied to combine the seven EEG parameters into a single index capable to maximise the discriminative power between AD and healthy subjects.

COBYLA iteratively explores different combinations of feature weights while adhering to predefined constraints, such as the need to preserve the EEG original information. This allows the creation of a composite index that enhances the accuracy, sensibility, specificity and effectiveness of AD diagnosis.

graphic file with name DmEquation1.gif

Statistical analysis

The aim of this study is to investigate whether the SWcomb index differs in healthy subjects and AD patients. Subsequently, a one-way analysis of variance (ANOVA) with the factors Group (healthy, AD) was conducted with a significance level of 0.05 using Statistica v.8 (StatSoft Inc).

A machine learning approach was used to quantify the SWcomb parameter ability in distinguish healthy and AD groups. A fine Gaussian Support Vector Machine (SVM) was employed using the SWcomb as a feature. A 5-fold cross-validation approach was used to optimise the SVM parameters. Moreover, in order to have an exhaustive evaluation of the classifier's performance, the 5-fold cross-validation was iterated 100 times. The accuracy is reported as the mean of accuracy for all the iteration and to assess the variance between each fold the standard deviation was also computed. The same approach was used to evaluate the specificity, sensitivity, while Area Under the Curve (AUC) and the Receiver Operating Characteristic (ROC) curve of the best classifier were represented in Figure 2.

Figure 2.

Figure 2

The ROC curve and AUC for Alzheimer's vs. healthy individuals best classification are represented.

Results

The weights obtained using COBYLA are as follows:

graphic file with name DmEquation2.gif

The mean and SE of SWcomb index, reported in Figure 1, are −5.13945 ± 1.942736 for healthy and 1.753125 ± 0.122933 for AD group. The ANOVA revealed a statistically significant interaction (F(1, 370) = 14.734066, P = 0.000145683), indicating that the two groups exhibited distinct SWcomb values, demonstrating that the healthy group displayed lower SWcomb values compared to the AD ones (P = 0.000145683).

Figure 1.

Figure 1

SWcomb indexes (mean values and SE) in healthy and AD groups are reported.

Furthermore, the partial eta squared of the ANOVA analysis was computed, resulting in a value of 0.038. This value represents a medium-average effect size based on the values defined by Cohen.

Regarding the classification between AD and healthy groups using the SWcomb parameter, the SVM reached an accuracy of 87.027% ± 1.99, a sensibility of 95.5% ± 1.57, a specificity of 77.1588% ± 2.86 and an AUC of 0.9386. The classification ROC curve and the AUC of the best classifier are shown in Figure 2.

Discussion

The present study aimed to investigate the potential of a novel index applied to EEG distinguishing healthy ageing from AD.

The SWcomb serves as a comprehensive metric designed to integrate essential information from all seven SW EEG parameters, computed across the typical EEG frequency bands, creating a unified index that effectively distinguishes individuals with AD from healthy ones.

Results revealed a statistically significant interaction between the two groups that exhibited distinct SWcomb values. Specifically, the healthy group displayed the lowest SWcomb values, while the AD group had the highest.

The discriminative capability of this index in distinguishing AD from healthy individuals was validated through the SVM achieving an accuracy of 87.027% ± 1.99, a sensitivity of 95.5% ± 1.57, a specificity of 77.1588% ± 2.86 and an AUC of 0.9386.

This index is born from the assumption that the AD is characterised by alterations across various frequency bands. Delta and theta rhythms reflect interruption of connectivity and ‘isolation’ of local neuronal assemblies [22] in healthy subjects, and AD present an increased prevalence and amplitude of these rhythms, even during wakefulness [4]. Conversely, the alpha rhythms experience a power reduction in AD [4]. Additionally, beta rhythms, associated with active cognitive processes and attention, present a power decrease in AD [23]. Gamma rhythms, associated with complex cognitive functions, manifest changes in amplitude and coherence in AD [24].

Studying these alterations from the perspective of network analysis and graph theory provides valuable insights into AD brain connectivity.

Vecchio and colleagues [21, 25] have already demonstrated a SW pattern, assessed in healthy elderlies and AD patients, presenting a healthy>AD trend in the low frequencies and the opposite trend in the alpha band. The reduction of SW index within the low-frequency bands in AD patients was explained as a gradual decline in the communication/information flow among brain regions, indicating a shift towards a more ordered brain structure. In dementia, this decline in slow activity can be primarily attributed to the structural and functional deterioration of long corticocortical tracts [25].

In contrast, the alpha rhythms displayed a more random organisation (higher values of SW) in AD compared to healthy subjects. This increased randomness in the patients' network suggests a diminished cognitive efficiency, resulting in a reduction of cortical network performance [12]. Altogether, prior studies speculated that the lower SW values in low-frequency bands and higher SW values in alpha may indicate a functional disconnection [26].

Concerning the beta band, AD was distinguished by an extended characteristic path length, accompanied by a relative preservation of local clustering [27].

We proposed the SWcomb as a comprehensive index incorporating information of the seven EEG rhythms, with the aim of outlining the distinctive EEG characteristics associated with AD.

In conclusion, this study represents an important step towards identifying reliable biomarkers for AD early diagnosis, allowing timely and personalised interventions, and distinguishing AD from other forms of dementia and healthy ageing.

Contributor Information

Fabrizio Vecchio, Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, 00166 Rome, Italy; Department of Theoretical and Applied Sciences, eCampus University, Novedrate, Como, Italy.

Francesca Miraglia, Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, 00166 Rome, Italy; Department of Theoretical and Applied Sciences, eCampus University, Novedrate, Como, Italy.

Chiara Pappalettera, Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, 00166 Rome, Italy; Department of Theoretical and Applied Sciences, eCampus University, Novedrate, Como, Italy.

Lorenzo Nucci, Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, 00166 Rome, Italy.

Alessia Cacciotti, Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, 00166 Rome, Italy; Department of Theoretical and Applied Sciences, eCampus University, Novedrate, Como, Italy.

Paolo Maria Rossini, Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, 00166 Rome, Italy.

Data availability:

The data that support the findings of this study are available on request from the corresponding author.

Declaration of Conflicts of Interest:

None declared.

Declaration of Sources of Funding:

This work was funded by the European Union—Next Generation EU—PNRR M6C2—Investimento 2.1 Valorizzazione e potenziamento della Ricerca biomedica del SSN PNRR-MAD-2022-12376667.

References

  • 1. Botto R, Callai N, Cermelli Aet al. Anxiety and depression in Alzheimer's disease: a systematic review of pathogenetic mechanisms and relation to cognitive decline. Neurol Sci 2022; 43: 4107–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Association As . 2016 Alzheimer's disease facts and figures. Alzheimers Dement 2016; 12: 459–509. [DOI] [PubMed] [Google Scholar]
  • 3. Agosta F, Pievani M, Geroldi Cet al. Resting state fMRI in Alzheimer's disease: beyond the default mode network. Neurobiol Aging 2012; 33: 1564–78. [DOI] [PubMed] [Google Scholar]
  • 4. Cecchetti G, Agosta F, Basaia Set al. Resting-state electroencephalographic biomarkers of Alzheimer's disease. Neuroimage Clin 2021; 31: 102711. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Vecchio F, Miraglia F, Maria RP. Connectome: graph theory application in functional brain network architecture. Clin Neurophysiol Pract 2017; 2: 206–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Stam CJ, Reijneveld JC. Graph theoretical analysis of complex networks in the brain. Nonlinear Biomed Phys 2007; 1: 3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Miraglia F, Vecchio F, Pappalettera Cet al. Brain connectivity and graph theory analysis in Alzheimer's and Parkinson's disease: the contribution of electrophysiological techniques. Brain Sci 2022; 12:402. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Cassani R, Estarellas M, San-Martin Ret al. Systematic review on resting-state EEG for Alzheimer's disease diagnosis and progression assessment. Dis Markers 2018; 2018: 5174815. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Vecchio F, Miraglia F, Piludu Fet al. "Small World" architecture in brain connectivity and hippocampal volume in Alzheimer's disease: a study via graph theory from EEG data. Brain Imaging Behav 2017; 11: 473–85. [DOI] [PubMed] [Google Scholar]
  • 10. Miraglia F, Vecchio F, Rossini PM. Searching for signs of aging and dementia in EEG through network analysis. Behav Brain Res 2017; 317: 292–300. [DOI] [PubMed] [Google Scholar]
  • 11. Haan W, Pijnenburg YA, Strijers RLet al. Functional neural network analysis in frontotemporal dementia and Alzheimer's disease using EEG and graph theory. BMC Neurosci 2009; 10: 101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Vecchio F, Miraglia F, Quaranta Det al. Cortical connectivity and memory performance in cognitive decline: a study via graph theory from EEG data. Neuroscience 2016; 316: 143–50. [DOI] [PubMed] [Google Scholar]
  • 13. Wang R, Wang J, Yu Het al. Decreased coherence and functional connectivity of electroencephalograph in Alzheimer's disease. Chaos 2014; 24: 033136. [DOI] [PubMed] [Google Scholar]
  • 14. Frantzidis CA, Vivas AB, Tsolaki Aet al. Functional disorganization of small-world brain networks in mild Alzheimer's disease and amnestic mild cognitive impairment: an EEG study using relative wavelet entropy (RWE). Front Aging Neurosci 2014; 6: 224. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Miraglia F, Vecchio F, Marra Cet al. Small world index in default mode network predicts progression from mild cognitive impairment to dementia. Int J Neural Syst 2020; 30: 2050004. [DOI] [PubMed] [Google Scholar]
  • 16. Kocagoncu E, Quinn A, Firouzian Aet al. Tau pathology in early Alzheimer's disease is linked to selective disruptions in neurophysiological network dynamics. Neurobiol Aging 2020; 92: 141–52. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Tait L, Stothart G, Coulthard Eet al. Network substrates of cognitive impairment in Alzheimer's disease. Clin Neurophysiol 2019; 130: 1581–95. [DOI] [PubMed] [Google Scholar]
  • 18. McKhann GM, Knopman DS, Chertkow Het al. The diagnosis of dementia due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 2011; 7: 263–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Dubois B, Feldman HH, Jacova Cet al. Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS-ADRDA criteria. Lancet Neurol 2007; 6: 734–46. [DOI] [PubMed] [Google Scholar]
  • 20. Vecchio F, Miraglia F, Marra Cet al. Human brain networks in cognitive decline: a graph theoretical analysis of cortical connectivity from EEG data. J Alzheimers Dis 2014; 41: 113–27. [DOI] [PubMed] [Google Scholar]
  • 21. Miraglia F, Vecchio F, Bramanti P, Rossini PM. EEG characteristics in "eyes-open" versus "eyes-closed" conditions: small-world network architecture in healthy aging and age-related brain degeneration. Clin Neurophysiol 2016; 127: 1261–8. [DOI] [PubMed] [Google Scholar]
  • 22. Ferri R, Rundo F, Bruni Oet al. The functional connectivity of different EEG bands moves towards small-world network organization during sleep. Clin Neurophysiol 2008; 119: 2026–36. [DOI] [PubMed] [Google Scholar]
  • 23. Özbek Y, Fide E, Yener GG. Resting-state EEG alpha/theta power ratio discriminates early-onset Alzheimer's disease from healthy controls. Clin Neurophysiol 2021; 132: 2019–31. [DOI] [PubMed] [Google Scholar]
  • 24. Rossini PM, Di Iorio R, Granata Get al. From mild cognitive impairment to Alzheimer's disease: a new perspective in the "Land" of human brain reactivity and connectivity. J Alzheimers Dis 2016; 53: 1389–93. [DOI] [PubMed] [Google Scholar]
  • 25. Vecchio F, Miraglia F, Alú Fet al. Contribution of graph theory applied to EEG data analysis for Alzheimer's disease versus vascular dementia diagnosis. J Alzheimers Dis 2021; 82: 871–9. [DOI] [PubMed] [Google Scholar]
  • 26. Rossini PM, Di Iorio R, Vecchio Fet al. Early diagnosis of Alzheimer's disease: the role of biomarkers including advanced EEG signal analysis. Report from the IFCN-sponsored panel of experts. Clin Neurophysiol 2020; 131: 1287–310. [DOI] [PubMed] [Google Scholar]
  • 27. Stam CJ, Jones BF, Nolte Get al. Small-world networks and functional connectivity in Alzheimer's disease. Cereb Cortex 2007; 17: 92–9. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data that support the findings of this study are available on request from the corresponding author.


Articles from Age and Ageing are provided here courtesy of Oxford University Press

RESOURCES