Abstract
Objective:
To measure the repeatability of metrics that quantify brain network architecture derived from resting-state functional MRI in a cohort of paediatric patients with epilepsy.
Methods:
We identified patients with: (1) epilepsy; (2) brain MRI at 3 T; (3) two identical resting-state functional MRI acquisitions performed on the same day. Undirected, weighted networks were constructed based on the resting-state time series using a range of processing parameters including parcellation size and graph threshold. The following topological properties were calculated: degree, strength, characteristic path length, global efficiency, clustering coefficient, modularity and small worldness. Based on repeated measures, we then calculated: (1) Pearson correlation coefficient; (2) intraclass correlation coefficient; (3) root-mean-square coefficient of variation; (4) repeatability coefficient; and (5) 95% confidence limits for change.
Results:
26 patients were included (age range: 4–21 years). Correlation coefficients demonstrated a highly consistent relationship between repeated observations for all metrics, and the intraclass correlation coefficients were generally in the excellent range. Repeatability in the data set was not significantly influenced by parcellation size. However, trends towards decreased repeatability were observed at higher graph thresholds.
Conclusion:
These findings demonstrate the reliability of network metrics in a cohort of paediatric patients with epilepsy.
Advances in knowledge:
Our results point to the potential for graph theoretical analyses of resting-state data to provide reliable markers of network architecture in children with epilepsy. At the level of an individual patient, change over time greater than the repeatability coefficient or 95% confidence limits for change is unlikely to be related to intrinsic variability of the method.
INTRODUCTION
Epilepsy is a common neurological condition that confers a weighty disease-related burden on individuals and families with the condition.1,2 In children, developmental and other structural lesions are a frequent source of medically intractable seizures.3 Although resection of these epileptogenic lesions can be curative, seizure-free and cognitive outcomes remain variable even in highly selected surgical cohorts.3,4 The fact that so called “focal” or “localization-related” epilepsies are in many cases associated with global alterations of the cerebral network likely contributes to such inconsistencies.5–7
Computational methods have been developed with the capacity to model the cerebral network at the whole-brain scale.8 In this context, the brain is represented as a collection of anatomical elements, or nodes; connections between pairs of nodes, referred to as edges, are then measured non-invasively. Once constructed, the architecture of the resulting network can be quantified according to graph theoretical principles.9 These techniques, therefore, offer the potential to capture physiologically relevant features of the cerebral network. Prototypical network metrics include: (a) clustering coefficient: the tendency of nodes to segregate into relatively independent local neighbourhoods (i.e. the ability to support functional subspecialization within the brain); (b) characteristic path length: the number of edges required to traverse the distance between two nodes (i.e. the ability to support integration of information across the network); and (c) small worldness: the ratio of the clustering coefficient to the path length—a guiding principle in cerebral organization representing a means by which the same network can support both integration and subspecialization.
Resting-state functional MRI (rs-fMRI), a sequence that measures the blood-oxygen-level-dependent (BOLD) signal over time, is one method by which edges in the brain network can be quantified. As this sequence is task free, it offers the potential to measure the functional status of children who are too young or too impaired to co-operate with traditional functional imaging. Elements of the brain that interact in order to support a given function continue to exhibit similar BOLD fluctuations at rest.10 Hence, the strength of a connection between each pair of nodes can be inferred from the magnitude of correlation between their BOLD signal time courses.
Previous rs-fMRI studies have demonstrated global alterations of the cerebral network in various disease states, including epilepsy.11–15 Efficient brain network organization, as quantified by graph theory metrics, has even been reported to relate to cognitive function in both adults6,16 and healthy children.17 These preliminary results point to the potential for graph theoretical analyses of resting-state data to provide biomarkers of cognitive function in children. Widespread application of this technique, however, will require an understanding of its reproducibility, particularly with regard to its ability to quantify network topology. A further consideration in paediatric populations, especially those with neurological disorders, is the reliance in a significant fraction of the individuals on general anaesthesia during MRI. As anaesthesia is known to alter neurovascular coupling and BOLD synchrony,18 an assessment of reproducibility in this population should include metrics measured under general anaesthesia. To date, however, the reproducibility of graph theory metrics derived from rs-fMRI has not been widely studied and, in particular, there is very little data from either the paediatric or epilepsy populations.19 The goal of this study is to measure the repeatability of graph theory metrics derived from functional brain networks in a cohort of paediatric patients with localization-related epilepsy.
METHODS AND MATERIALS
This health insurance portability and accountability act–compliant study was approved by the local institutional review board. Patients were identified retrospectively from the medical record with the following inclusion criteria: (1) paediatric age group (less than or equal to 21 years); (2) clinical diagnosis of localization-related epilepsy; (3) MRI of the brain performed at 3 T; (4) two separate but identical rs-fMRI sequences performed during the same MRI session. Refinements to the above-defined population were based on the following exclusion criterion: any brain surgery performed prior to MRI. Clinical severity of epilepsy for each patient was measured by the childhood epilepsy severity score,20 which includes six measures of epilepsy severity (time period over which seizures occurred; seizure frequency; number of seizure types; occurrence and duration of status epilepticus; number of anticonvulsant medications used; response to treatment).
MRI
All imaging was performed on a 3-T magnet (Philips Achieva®; Philips Healthcare, Andover, MA) with a 32-channel phased-array coil. The following sequences were obtained: (1) sagittal volumetric T1 weighted structural image [three-dimensional fast field echo; repetition time/echo time: 7.2/2.9 ms; one acquisition; flip angle: 7°, inversion time: 1100 ms; field of view: 22 cm; voxel (mm): 1 × 1 × 1]. (2) Axial single-shot echo planar functional MRI (fMRI) [repetition time/echo time (ms): 2000/30; flip angle: 80°; one acquisition; voxel (mm): 3 × 3 × 3] performed in the resting state. Two identical resting-state scans, each of 10-min duration, were acquired for each subject during the same imaging session.
IMAGE PROCESSING AND ANALYSIS
Network node definition
Image processing was implemented using MATLAB® scripts v. 7.13 (MathWorks®, Inc, Natick, MA) with adapter functions embedded to execute FreeSurfer reconstruction v. 5.3.0 (http://surfer.nmr.mgh.harvard.edu) and tools from the FMRIB Software Library (FSL) suite.21 FreeSurfer was used to reconstruct grey–white and pial surfaces using the structural image. This reconstruction includes skull stripping, grey matter segmentation and automated parcellation.22,23 Cortical surfaces generated in this step were inspected for accuracy using the Freeview software.
Next, a self-developed MATLAB program was used to further subdivide the 75 standard Freesurfer grey matter parcels according to their surface area (as defined on the Freesurfer grey–white surface mesh). Each grey matter parcel was iteratively divided into two new parcels of equal size until the surface area of each output parcel was less than a predefined threshold value. Two different threshold values were used to generate two networks of different sizes in each patient: 350 mm2 (fine parcellation) and 600 mm2 (coarse parcellation). Each surface parcel was then converted into a volume mask of grey matter at that region. Each resulting grey matter volume of interest formed a node in the brain network. The network, then, consisted of approximately 700 and 400 nodes for the “fine” and “coarse” parcellation thresholds, respectively.
Network edge definition
The first five images in each resting state sequence were discarded to allow magnetization to reach equilibrium. Pre-processing of the functional data sets was performed with FSL Multivariate Exploratory Linear Optimized Decomposition into Independent Components which included motion correction, interleaved slice timing correction, brain extraction, spatial smoothing with a Gaussian kernel of full width at half maximum of 5 mm and high-pass temporal filtering equivalent to 100 s per cycle (0.01 Hz). Noise related to motion and other physiological nuisance was addressed according to an independent component analysis (ICA) technique.24 Non-signal components were removed manually by an expert operator with 5 years' experience using ICA in this patient population. Although the optimal strategies for noise removal in fMRI remain the subject of debate,25,26 an ICA technique was selected, as it has been shown to minimize the impact of motion on network metrics while at the same time decreasing loss of temporal degrees of freedom and preserving the signal of interest across a variety of resting-state data sets.25 Motion parameters measured during pre-processing were summarized for each patient, as previously described, by the framewise displacement.25 Both of the resting-state image volumes for each patient were registered to that individual's skull-stripped structural T1 data set using FSL FMRIB's Linear Image Registration Tool. Voxelwise BOLD signal time series were averaged over each node. The strength of an edge between two nodes was defined as the absolute value of the Pearson correlation coefficient between their time series.
Graph construction
Weighted, undirected connection matrices were constructed consisting of the pairwise correlation between BOLD time series over all network nodes. At the completion of this step, four connection matrices (two different parcellation sizes of two separate resting-state acquisitions) were available for each patient. A two-step threshold technique was then applied to each connection matrix. In the first step, non-significant correlations were excluded based on adjusted p-values. In a network with N number of nodes, correlations were calculated. Therefore, the p-value of each pairwise correlation in the connection matrix was multiplied by and thresholded at 0.05. In the second step, the graph was further thresholded on the basis of the correlation coefficient. As the optimal cut-off was uncertain, a range of thresholds from 0 to 0.9 (interval: 0.1) was applied. Edges weaker than the threshold were set to zero. At the completion of this step, 40 weighted, undirected connection matrices (two different resting-state acquisitions × 2 different parcellations × 10 different thresholds) were available for each patient.
Network metric calculation
For each weighted connection matrix, MATLAB scripts available from The Brain Connectivity Toolbox (https://sites.google.com/site/bctnet/) were used to compute eight common metrics that summarize global network architecture (Table 1). For the purposes of this article, these will be referred to as “raw” metrics. In a paediatric population, brain volumes change across development, and furthermore, network size can be impacted in a heterogeneous fashion by pathology. To account for differences in network size inherent to this population, a second group of metrics was generated in which the raw metrics for each patient were normalized to the exact same metric computed on a random network of identical size. The random network is generated by the Brain Connectivity Toolbox and, by definition, preserves the degree, strength and weight distributions of the original brain network.27 As such, degree, strength and weight were only considered as raw metrics.
Table 1.
Metric | Description | Range |
---|---|---|
Degree | Average number of edges associated with each node | [0, N − 1] |
Strength | Average weight of edges associated with each node | [0, N − 1] |
Density | Fraction of edges that exist out of the total number of possible edges in the network | [0, 1] |
Characteristic path length | Minimum number of edges required to traverse the distance between two nodes averaged over the network | [1, ∞] |
Global efficiency | Inverse of the shortest path length averaged over the network | [0, 1] |
Clustering coefficient | The fraction of a given node's neighbours that are also neighbours of each other | [0, 1] |
Modularity | The degree to which the network tends to segregate into relatively independent modules | [0, 1] |
Small worldness | Clustering coefficient divided by path length | [0, 1] |
N, number of nodes in the graph.
Statistical analyses
All statistical analyses were performed using the R statistical software package v. 3.0.2 (R Foundation for Statistical Computing, Vienna, Austria).28 The Wilcoxon signed-rank test (alpha: 0.05 corrected for multiple comparisons) was used to assess potential differences in repeatability between: (1) patients with structurally normal brains vs those with structural abnormalities; (2) patients undergoing general anaesthesia during MRI scanning vs conscious patients. If no significant differences in repeatability are detected between these subgroups, the cohort will then be considered in aggregate for the remaining analyses.
For each metric, the following statistics were computed: (1) mean and standard deviation; (2) intraclass correlation coefficient (ICC). To be specific, ICC(3,1) was calculated according to the following formula:29
where BMS is the between-subjects mean square, EMS is the error mean square and k is the number of repeated sessions. This calculation was performed using the psych package developed by Revelle.30 According to previous studies,19,31,32 ICCs between 0.4 and 0.59 were considered fair, those between 0.6 and 0.74 were considered good and those >0.74 were considered excellent. (3) Root-mean-square coefficient of variation. (4) Pearson correlation coefficient.
Finally, to estimate the magnitude of change that would be clinically detectable in an individual child, root-mean-square coefficients of variation were used to calculate the 95% confidence limits for detection of change.7 A repeatability coefficient was also calculated as described by Bland and Altman.33 For an individual patient, changes greater in absolute magnitude than the repeatability coefficient or in fractional magnitude than the 95% confidence limits for change are unlikely to be related to intramethod variability in the measurement of network architecture.
RESULTS
Patients
All imaging was performed from July 2013 to February 2015. 26 patients with localization-related epilepsy (age range: 4–21 years; median: 11 years) comprised the final study group. Of this cohort, 10 patients had structurally normal brains and 16 patients had demonstrable structural abnormalities at MRI, including: focal cortical dysplasia (n = 3), mesial temporal sclerosis (n = 3), encephalomalacia (n = 3), tuberous sclerosis complex (n = 2), Sturge-Weber syndrome (n = 2), low-grade tumour (n = 2) and Rasmussen's encephalitis (n = 1). 16 patients (65%) underwent general anaesthesia during MRI scanning. The degree of patient motion during imaging was not significantly associated with either patient age (p = 0.67) or severity of epilepsy (p = 0.79).
Repeatability
Repeatability across the data set was generally consistent. Specifically, the mean difference between observations in structurally normal brains did not differ from those in brains with structural abnormalities (p-value range: 0.90–0.99). Similarly, there was no significant difference in metric repeatability in patients with vs without the use of general anaesthesia for any metric at any threshold (p-value range: 0.24–0.99). Finally, there was no significant association between repeatability and patient age (p-value range: 0.38–0.99). Hence, the entire cohort was considered in aggregate for the remaining analyses.
Test–retest estimates for network metrics computed on weighted connection matrices thresholded only by a corrected p-value of 0.05 are presented in Table 2 (coarse parcellation) and Table 3 (fine parcellation). Correlation coefficients demonstrated a highly consistent relationship between repeated observations for all metrics, and ICCs were generally in the excellent range (Tables 2 and 3). Patient level repeatability varied moderately with the specific metric of interest; 95% confidence limits for change in an individual patient ranged from 3% to 21% (Tables 2 and 3). Repeatability in the data set was not significantly influenced by parcellation size. However, trends towards decreased repeatability were observed at higher graph thresholds for both raw (Figure 1) and normalized (Figure 2) metrics. This effect was more pronounced in normalized metrics (Figure 2).
Table 2.
Metric | Mean (Std) | Pearson | Repeatability coefficient | ICC (95% CI) | RMS CoV | 95% CL change (%) |
---|---|---|---|---|---|---|
Degree | 277.14 (70.25) | 0.92 | 55.12 | 0.92 (0.83–0.96) | 0.05 | 13.4 |
Strength | 108.43 (69.61) | 0.95 | 42.27 | 0.95 (0.9–0.98) | 0.10 | 17.4 |
Density | 0.72 (0.16) | 0.90 | 0.14 | 0.9 (0.78–0.95) | 0.05 | 13.5 |
CPL | 3.5 (1.05) | 0.94 | 0.74 | 0.94 (0.87–0.97) | 0.06 | 15.5 |
CPL (norm) | 1.17 (0.08) | 0.88 | 0.08 | 0.88 (0.74–0.94) | 0.02 | 4.4 |
Efficiency | 0.9 (0.05) | 0.89 | 0.05 | 0.89 (0.77–0.95) | 0.01 | 4.0 |
Efficiency (norm) | 0.76 (0.14) | 0.94 | 0.10 | 0.94 (0.86–0.97) | 0.04 | 9.8 |
Clustering coeff. | 0.29 (0.17) | 0.96 | 0.10 | 0.95 (0.9–0.98) | 0.09 | 15.4 |
Clustering coeff. (Norm) | 1.04 (0.04) | 0.83 | 0.04 | 0.83 (0.66–0.92) | 0.01 | 2.8 |
Modularity | 0.13 (0.06) | 0.87 | 0.06 | 0.87 (0.74–0.94) | 0.14 | 18.1 |
Modularity (norm) | 5.4 (1.56) | 0.95 | 1.00 | 0.95 (0.89–0.98) | 0.05 | 12.9 |
Small worldness | 0.12 (0.14) | 0.97 | 0.07 | 0.96 (0.92–0.98) | 0.14 | 19.7 |
Small worldness (norm) | 0.89 (0.04) | 0.89 | 0.04 | 0.89 (0.76–0.95) | 0.01 | 3.1 |
CI, confidence interval; CL, confidence limit; coeff., coefficient; CPL, characteristic path length; ICC, intraclass correlation coefficient; norm, normalized; Pearson, Pearson correlation coefficient; RMS CoV, root-mean-square coefficient of variation; Std, standard deviation.
Data presented here reflect connection matrices thresholded only by p-value (0.05 corrected).
Table 3.
Metric | Mean (Std) | Pearson | Repeatability coefficient | ICC (95% CI) | RMS CoV | 95% CL change (%) |
---|---|---|---|---|---|---|
Degree | 441.8 (120.1) | 0.93 | 90.62 | 0.93 (0.85–0.97) | 0.05 | 14.0 |
Strength | 165.2 (109.0) | 0.96 | 62.90 | 0.96 (0.91–0.98) | 0.10 | 17.3 |
Density | 0.7 (0.16) | 0.90 | 0.14 | 0.9 (0.79–0.95) | 0.05 | 14.0 |
CPL | 3.61 (1.04) | 0.94 | 0.73 | 0.94 (0.87–0.97) | 0.05 | 14.5 |
CPL (norm) | 1.18 (0.08) | 0.88 | 0.08 | 0.88 (0.75–0.94) | 0.02 | 4.5 |
Efficiency | 0.34 (0.14) | 0.96 | 0.08 | 0.96 (0.91–0.98) | 0.05 | 15.2 |
Efficiency (norm) | 0.88 (0.06) | 0.90 | 0.05 | 0.9 (0.79–0.95) | 0.01 | 4.0 |
Clustering coeff. | 0.27 (0.16) | 0.96 | 0.10 | 0.96 (0.91–0.98) | 0.09 | 15.0 |
Clustering coeff. (norm) | 1.05 (0.04) | 0.84 | 0.04 | 0.84 (0.68–0.93) | 0.01 | 2.8 |
Modularity | 0.14 (0.06) | 0.87 | 0.06 | 0.87 (0.73–0.94) | 0.12 | 13.0 |
Modularity (norm) | 6.41 (1.54) | 0.76 | 2.18 | 0.74 (0.51–0.88) | 0.08 | 21.1 |
Small worldness | 0.1 (0.12) | 0.97 | 0.06 | 0.96 (0.92–0.98) | 0.14 | 18.3 |
Small worldness (norm) | 0.89 (0.04) | 0.88 | 0.04 | 0.88 (0.75–0.94) | 0.01 | 3.3 |
CI, confidence interval; CL, confidence limit; coeff., coefficient; CPL, characteristic path length; ICC, intraclass correlation coefficient; norm, normalized; Pearson, Pearson correlation coefficient; RMS CoV, root-mean-square coefficient of variation; Std, standard deviation.
Data presented here reflect connection matrices thresholded only by p-value (0.05 corrected).
DISCUSSION
Our primary aim was to investigate the test–retest repeatability of graph theoretical metrics derived from rs-fMRI in children with epilepsy. We constructed weighted, undirected networks over a range of technical parameters for two separate resting-state acquisitions in the same patient. We observed excellent repeatability, in terms of the ICC, for all metrics. Furthermore, repeatability coefficients and 95% confidence limits for the detection of change were quantified which allow significance to be attached to changes in these metrics that occur over time in an individual patient.
Second, we observed that the size and number of network nodes did not significantly alter the repeatability of global metrics of network architecture. During network construction, large nodes potentially include adjacent but functionally distinct cortical regions into a single node. The averaged BOLD time course from a large node, therefore, may not accurately reflect the actual time course of any of the functional regions contained therein. Measuring pairwise correlations between such time courses would then be handicapped with respect to their ability to capture the brain's true topology. Hence, higher resolution networks may better capture physiologically meaningful features of the cerebral network. On the other hand, small regions of interest are accompanied by lower signal-to-noise ratios, all other parameters being equal. At some point, parcellation schemes may become noise limited. Hence, optimal parcellation should balance these competing concerns in such a way that global metrics most closely reflect true brain network topology. Our results indicate that a smaller node, at least within a range of sizes commonly seen in the literature,19 can be used without reducing the reproducibility of global network metrics. It is of interest that Cao et al32 reported better reproducibility of global metrics derived from fMRI using a finer parcellation. However, the parcellation methods in their study differed by more than simply size; the finer parcellation was defined using a functional, rather than an anatomical, atlas. By contrast, our networks were constructed using the same parcellation method only at different resolutions. Other methodological differences between the studies, including performance of a task during fMRI acquisition in Cao et al,32 could also have contributed to the discrepant findings.
Third, we report that more stringent thresholding of the network was associated with poorer reproducibility. In functional networks, edges in the graph are weighted by the strength of correlation between BOLD signal time courses. Thresholds are generally applied to eliminate spurious connections.9 As one continues to increase the graph threshold, however, real connections are removed and the network becomes more fragmentary and heterogeneous which contributes to greater variability.31 Our results demonstrate that, above some threshold, this heterogeneity can reduce the reliability of global network metrics derived from rs-fMRI. Of note, this effect was exaggerated for normalized metrics. Unlike in normal cohorts, pathological heterogeneity across patients can contribute to significant differences in basic network characteristics such as size. This issue is particularly relevant in paediatric populations, which demonstrate significant additional heterogeneity on the basis of normal development. Although these interpatient differences may not be relevant to brain function, they do impact global metric calculation and, therefore, render comparisons more difficult. To account for such differences between patients, metrics computed from an individual patient's graph can be normalized to the same metrics calculated on a random network of identical sizes.34 As the random networks used in normalization introduce an additional source of variability, it is not surprising that the threshold effects described above are exaggerated for normalized metrics. Our findings with regard to graph threshold are consistent with the work by Telesford et al35 who demonstrated reduced reproducibility of graph metrics at higher thresholds in normal adults. The impact of normalization on metric repeatability in this context has not been previously reported.
Finally, we observed no decrement in repeatability for patients whose imaging was acquired under general anaesthesia. The question of general anaesthesia is a complicated one, as it can be accomplished according to a variety of drug regimens, each of which may have a different effect on resting-state networks.36 Of particular relevance to this study, several groups have reported a relative decrease in connectivity within whole-brain networks during propofol-induced loss of consciousness.37,38 Our work suggests that, regardless of relative changes that may occur with regard to the intrinsic characteristics of the resting-state signal, graph metrics derived from resting-state functional networks seem to be feasible across a range of states of consciousness. This idea is supported by work in electrocorticography that found large-scale brain networks to be a fundamental aspect of the brain's physiology that does not depend on the state of consciousness.39
To our knowledge, these data represent the first report of the reproducibility of graph-based metrics in either children or in patients with localization-related epilepsy. Our results, however, are comparable to those reported in fMRI studies of healthy adult populations.35,40 Interestingly, ICCs observed in our study were also similar to those generated based on graph theory analysis of data from magnetoencephalography41 and near-infra-red spectroscopy.42 Finally, our results are comparable overall with similar studies using diffusion tensor imaging, rather than fMRI, to construct cerebral networks.19 Together, these findings raise the possibility that global network metrics may be robust across a range of patient populations and imaging modalities. It is worth noting, however, that Braun et al31 reported lower ICCs in a cohort of healthy subjects. Several methodological differences between their study and ours [including the use of healthy subjects (vs a clinical epilepsy population), the use of binary (vs weighted) networks, the size of network nodes, the use of regression-based denoising techniques (vs ICA-based denoising) and a scanning interval of two weeks (vs same day)] likely account for the discrepant results.
This study has several limitations. First, these data originate from a selected cohort of patients with localization-related epilepsy. Generalization to patients with other types of neurological disorders would require further study. Second, all imaging was performed on the same MR scanner with the same phased-array coil according to the same resting-state fMRI sequence. Further study regarding the reproducibility of these metrics across a wider range of MR hardware would be of great practical value to widespread implementation. Third, although we detected no significant difference in repeatability between patients on general anaesthesia and non-sedated patients, this study was not powered to conclude that repeatability is the same in the two states. Our goal, however, was not to measure systematically the impact of anaesthesia on resting-state networks. Rather, we sought to measure repeatability under conditions that are representative of those experienced by the clinical epilepsy population; this includes anaesthesia in a significant number of patients. Fourth, we studied the reliability of metrics derived from resting-state sequences when performed on the same day in the same session. We selected this design in an attempt to isolate variability of the method from real change over time. Functional networks can change over a very short time scale. In fact, durable alterations in resting-state connectivity have been observed after relatively minor interventions lasting hours43,44 or even minutes.45,46 In order to avoid the confounding effect of network reorganization over time, a particular issue in patients with intractable epilepsy, re-testing was performed on the same day. Finally, it is important to note that metrics with the best repeatability are not necessarily the most physiologically meaningful. Optimization of these metrics with regard to their capacity to probe physiologically relevant features of the brain network in paediatric patients with epilepsy will be an important next step.
CONCLUSION
In conclusion, we have quantified the repeatability of graph-based metrics of global network topology in children with epilepsy. ICCs overall were in the excellent range, though reduced at stringent graph thresholds. This work suggests that graph theory analyses of resting-state networks can provide robust markers of brain network architecture despite the influences imparted by brain pathology, normal development with age and the use of general anaesthesia during image acquisition. These data represent a significant advance in our understanding of the reproducibility of these metrics which may one day serve to guide management in patients with localization-related epilepsy.
Contributor Information
Michael J Paldino, Email: michael.paldino@gmail.com.
Zili D Chu, Email: zdchu@texaschildrens.org.
Mary L Chapieski, Email: lynnchapieski@gmail.com.
Farahnaz Golriz, Email: fhgolriz@gmail.com.
Wei Zhang, Email: wxzhang1@texaschildrens.org.
REFERENCES
- 1.Boyle CA, Decoufle P, Yeargin-Allsopp M. Prevalence and health impact of developmental disabilities in US children. Pediatrics 1994; 93: 399–403. [PubMed] [Google Scholar]
- 2.Cascino GD. Improving quality of life with epilepsy surgery: the seizure outcome is the key to success. Neurology 2007; 1967–1968: 68. doi: https://doi.org/10.1212/01.wnl.0000268067.70492.8b [DOI] [PubMed] [Google Scholar]
- 3.Phi JH, Cho BK, Wang KC, Lee JY, Hwang YS, Kim KJ, et al. Longitudinal analyses of the surgical outcomes of pediatric epilepsy patients with focal cortical dysplasia. J Neurosurg Pediatr 2010; 6: 49–56. doi: https://doi.org/10.3171/2010.3.peds09497 [DOI] [PubMed] [Google Scholar]
- 4.Westerveld M, Sass KJ, Chelune GJ, Hermann BP, Barr WB, Loring DW, et al. Temporal lobectomy in children: cognitive outcome. J Neurosurg 2000; 92: 24–30. doi: https://doi.org/10.3171/jns.2000.92.1.0024 [DOI] [PubMed] [Google Scholar]
- 5.Fox RJ, Sakaie K, Lee JC, Debbins JP, Liu Y, Arnold DL, et al. A validation study of multicenter diffusion tensor imaging: reliability of fractional anisotropy and diffusivity values. AJNR Am J Neuroradiol 2012; 33: 695–700. doi: https://doi.org/10.3174/ajnr.a2844 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Li Y, Liu Y, Li J, Qin W, Li K, Yu C, et al. Brain anatomical network and intelligence. PLos Comput Biol 2009; 5: e1000395. doi: https://doi.org/10.1371/journal.pcbi.1000395 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Roberts C, Issa B, Stone A, Jackson A, Waterton JC, Parker GJ, et al. Comparative study into the robustness of compartmental modeling and model-free analysis in DCE-MRI studies. J Magn Reson Imaging 2006; 23: 554–63. doi: https://doi.org/10.1002/jmri.20529 [DOI] [PubMed] [Google Scholar]
- 8.Hagmann P, Cammoun L, Gigandet X, Meuli R, Honey CJ, Wedeen VJ, et al. Mapping the structural core of human cerebral cortex. PLoS Biol 2008; 6: e159. doi: https://doi.org/10.1371/journal.pbio.0060159 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Rubinov M, Sporns O. Complex network measures of brain connectivity: uses and interpretations. NeuroImage 2010; 52: 1059–69. doi: https://doi.org/10.1016/j.neuroimage.2009.10.003 [DOI] [PubMed] [Google Scholar]
- 10.Biswal BB, Van Kylen J, Hyde JS. Simultaneous assessment of flow and BOLD signals in resting-state functional connectivity maps. NMR Biomed 1997; 10: 165–70. doi: https://doi.org/10.1002/(sici)1099-1492(199706/08)10:4/5<165::aid-nbm454>3.0.co;2-7 [DOI] [PubMed] [Google Scholar]
- 11.He H, Sui J, Yu Q, Turner JA, Ho BC, Sponheim SR, et al. Altered small-world brain networks in schizophrenia patients during working memory performance. PLoS One 2012; 7: e38195. doi: https://doi.org/10.1371/journal.pone.0038195 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Gottlich M, Munte TF, Heldmann M, Kasten M, Hagenah J, Krämer UM. Altered resting state brain networks in Parkinson's disease. PLoS One 2013; 8: e77336. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Brier MR, Thomas JB, Fagan AM, Hassenstab J, Holtzman DM, Benzinger TL, et al. Functional connectivity and graph theory in preclinical Alzheimer's disease. Neurobiol Aging 2014; 35: 757–68. doi: https://doi.org/10.1016/j.neurobiolaging.2013.10.081 [Google Scholar]
- 14.Sanz-Arigita EJ, Schoonheim MM, Damoiseaux JS, Rombouts SA, Maris E, Barkhof F, et al. Loss of “small-world” networks in Alzheimer's disease: graph analysis of FMRI resting-state functional connectivity. PLoS One 2010; 5: e13788. doi: https://doi.org/10.1371/journal.pone.0013788 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.van Diessen E, Zweiphenning WJ, Jansen FE, Stam CJ, Braun KP, Otte WM. Brain network organization in focal epilepsy: a systematic review and meta-analysis. PLoS One 2014; 9: e114606. doi: https://doi.org/10.1371/journal.pone.0114606 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.van den Heuvel MP, Stam CJ, Kahn RS, Hulshoff Pol HE. Efficiency of functional brain networks and intellectual performance. J Neurosci 2009; 29: 7619–24. doi: https://doi.org/10.1523/jneurosci.1443-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Kim DJ, Davis EP, Sandman CA, Sporns O, O'Donnell BF, Buss C, et al. Children's intellectual ability is associated with structural network integrity. Neuroimage 2016; 124(Pt A): 550–6. doi: https://doi.org/10.1016/j.neuroimage.2015.09.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Peltier SJ, Kerssens C, Hamann SB, Sebel PS, Byas-Smith M, Hu X. Functional connectivity changes with concentration of sevoflurane anesthesia. Neuroreport 2005; 16: 285–8. doi: https://doi.org/10.1097/00001756-200502280-00017 [DOI] [PubMed] [Google Scholar]
- 19.Welton T, Kent DA, Auer DP, Dineen RA. Reproducibility of graph-theoretic brain network metrics: a systematic review. Brain Connect 2015; 5: 193–202. doi: https://doi.org/10.1089/brain.2014.0313 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Humphrey A, Ploubidis GB, Yates JR, Steinberg T, Bolton PF. The early childhood epilepsy severity scale (E-Chess). Epilepsy Res 2008; 79: 139–45. doi: https://doi.org/10.1016/j.eplepsyres.2008.01.007 [DOI] [PubMed] [Google Scholar]
- 21.Smith SM, Jenkinson M, Woolrich MW, Beckmann CF, Behrens TE, Johansen-Berg H, et al. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 2004; 23(Suppl. 1): S208–19. doi: https://doi.org/10.1016/j.neuroimage.2004.07.051 [DOI] [PubMed] [Google Scholar]
- 22.Fischl B, Liu A, Dale AM. Automated manifold surgery: constructing geometrically accurate and topologically correct models of the human cerebral cortex. IEEE Trans Med Imaging 2001; 20: 70–80. doi: https://doi.org/10.1109/42.906426 [DOI] [PubMed] [Google Scholar]
- 23.Fischl B, Salat DH, van der Kouwe AJ, Makris N, Segonne F, Quinn BT, et al. Sequence-independent segmentation of magnetic resonance images. Neuroimage 2004; 23(Suppl. 1): S69–84. [DOI] [PubMed] [Google Scholar]
- 24.Thomas CG, Harshman RA, Menon RS. Noise reduction in BOLD-based fMRI using component analysis. Neuroimage 2002; 17: 1521–37. doi: https://doi.org/10.1006/nimg.2002.1200 [DOI] [PubMed] [Google Scholar]
- 25.Pruim RH, Mennes M, Buitelaar JK, Beckmann CF. Evaluation of ICA-AROMA and alternative strategies for motion artifact removal in resting state fMRI. Neuroimage 2015; 112: 278–87. doi: https://doi.org/10.1016/j.neuroimage.2015.02.063 [DOI] [PubMed] [Google Scholar]
- 26.Bright MG, Murphy K. Is fMRI “noise” really noise? Resting state nuisance regressors remove variance with network structure. Neuroimage 2015; 114: 158–69. doi: https://doi.org/10.1016/j.neuroimage.2015.03.070 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Rubinov M, Sporns O. Weight-conserving characterization of complex functional brain networks. Neuroimage 2011; 56: 2068–79. doi: https://doi.org/10.1016/j.neuroimage.2011.03.069 [DOI] [PubMed] [Google Scholar]
- 28.R: Language and environment for statistical computing [computer program]. Vienna, Austria: R Foundation for Statistical Computing; 2014.
- 29.Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 1979; 86: 420–8. doi: https://doi.org/10.1037/0033-2909.86.2.420 [DOI] [PubMed] [Google Scholar]
- 30.psych: procedures for psychological, psychometric, and personality research [computer program]. v. 1.5.8. Evanston, Illinois, USA: Northwestern University; 2015.
- 31.Braun U, Plichta MM, Esslinger C, Sauer C, Haddad L, Grimm O, et al. Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures. Neuroimage 2012; 59: 1404–12. doi: https://doi.org/10.1016/j.neuroimage.2011.08.044 [DOI] [PubMed] [Google Scholar]
- 32.Cao H, Plichta MM, Schafer A, Haddad L, Grimm O, Schneider M, et al. Test–retest reliability of fMRI-based graph theoretical properties during working memory, emotion processing, and resting state. Neuroimage 2014; 84: 888–900. doi: https://doi.org/10.1016/j.neuroimage.2013.09.013 [DOI] [PubMed] [Google Scholar]
- 33.Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res 1999; 8: 135–60. doi: https://doi.org/10.1191/096228099673819272 [DOI] [PubMed] [Google Scholar]
- 34.van Wijk BC, Stam CJ, Daffertshofer A. Comparing brain networks of different size and connectivity density using graph theory. PLoS One 2010; 5: e13701. doi: https://doi.org/10.1371/journal.pone.0013701 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Telesford QK, Morgan AR, Hayasaka S, Simpson SL, Barret W, Kraft RA, et al. Reproducibility of graph metrics in FMRI networks. Front Neuroinform 2010; 4: 117. doi: https://doi.org/10.3389/fninf.2010.00117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kalthoff D, Po C, Wiedermann D, Hoehn M. Reliability and spatial specificity of rat brain sensorimotor functional connectivity networks are superior under sedation compared with general anesthesia. NMR Biomed 2013; 26: 638–50. doi: https://doi.org/10.1002/nbm.2908 [DOI] [PubMed] [Google Scholar]
- 37.Boveroux P, Vanhaudenhuyse A, Bruno MA, Noirhomme Q, Lauwick S, Luxen A, et al. Breakdown of within- and between-network resting state functional magnetic resonance imaging connectivity during propofol-induced loss of consciousness. Anesthesiology 2010; 113: 1038–53. doi: https://doi.org/10.1097/ALN.0b013e3181f697f5 [DOI] [PubMed] [Google Scholar]
- 38.Monti MM, Lutkenhoff ES, Rubinov M, Boveroux P, Vanhaudenhuyse A, Gosseries O, et al. Dynamic change of global and local information processing in propofol-induced loss and recovery of consciousness. PLoS Comput Biol 2013; 9: e1003271. doi: https://doi.org/10.1371/journal.pcbi.1003271 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Liu X, Yanagawa T, Leopold DA, Fujii N, Duyn JH. Robust long-range coordination of spontaneous neural activity in waking, sleep and anesthesia. Cereb Cortex 2015; 25: 2929–38. doi: https://doi.org/10.1093/cercor/bhu089 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Liao XH, Xia MR, Xu T, Dai ZJ, Cao XY, Niu HJ, et al. Functional brain hubs and their test–retest reliability: a multiband resting-state functional MRI study. Neuroimage 2013; 83: 969–82. doi: https://doi.org/10.1016/j.neuroimage.2013.07.058 [DOI] [PubMed] [Google Scholar]
- 41.Deuker L, Bullmore ET, Smith M, Christensen S, Nathan PJ, Rockstroh B, et al. Reproducibility of graph metrics of human brain functional networks. Neuroimage 2009; 47: 1460–8. doi: https://doi.org/10.1016/j.neuroimage.2009.05.035 [DOI] [PubMed] [Google Scholar]
- 42.Niu H, Li Z, Liao X, Wang J, Zhao T, Shu N, et al. Test–retest reliability of graph metrics in functional brain networks: a resting-state fNIRS study. PLoS One 2013; 8: e72425. doi: https://doi.org/10.1371/journal.pone.0072425 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Powers AR, 3rd, Hevey MA, Wallace MT. Neural correlates of multisensory perceptual learning. J Neurosci 2012; 32: 6263–74. doi: https://doi.org/10.1523/JNEUROSCI.6138-11.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Sami S, Miall RC. Graph network analysis of immediate motor-learning induced changes in resting state BOLD. Front Hum Neurosci 2013; 7: 166. doi: https://doi.org/10.3389/fnhum.2013.00166 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Urner M, Schwarzkopf DS, Friston K, Rees G. Early visual learning induces long-lasting connectivity changes during rest in the human brain. Neuroimage 2013; 77: 148–56. doi: https://doi.org/10.1016/j.neuroimage.2013.03.050 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Albert NB, Robertson EM, Miall RC. The resting human brain and motor learning. Curr Biol 2009; 19: 1023–7. doi: https://doi.org/10.1016/j.cub.2009.04.028 [DOI] [PMC free article] [PubMed] [Google Scholar]