Abstract
Goal: Structural brain graphs are conventionally limited to defining nodes as gray matter regions from an atlas, with edges reflecting the density of axonal projections between pairs of nodes. Here we explicitly model the entire set of voxels within a brain mask as nodes of high-resolution, subject-specific graphs. Methods: We define the strength of local voxel-to-voxel connections using diffusion tensors and orientation distribution functions derived from diffusion MRI data. We study the graphs' Laplacian spectral properties on data from the Human Connectome Project. We then assess the extent of inter-subject variability of the Laplacian eigenmodes via a procrustes validation scheme. Finally, we demonstrate the extent to which functional MRI data are shaped by the underlying anatomical structure via graph signal processing. Results: The graph Laplacian eigenmodes manifest highly resolved spatial profiles, reflecting distributed patterns that correspond to major white matter pathways. We show that the intrinsic dimensionality of the eigenspace of such high-resolution graphs is only a mere fraction of the graph dimensions. By projecting task and resting-state data on low-frequency graph Laplacian eigenmodes, we show that brain activity can be well approximated by a small subset of low-frequency components. Conclusions: The proposed graphs open new avenues in studying the brain, be it, by exploring their organisational properties via graph or spectral graph theory, or by treating them as the scaffold on which brain function is observed at the individual level.
Keywords: Brain graph, diffusion MRI, functional MRI, graph signal processing, spectral graph theory
I. Introduction
Magnetic resonance imaging (MRI) has provided an effective means to map the brain's anatomical scaffold, using diffusion MRI, and, in parallel, to track brain neural activity using functional MRI (fMRI). Extensive datasets that include diffusion and functional data on the same set of subjects, such as the Human Connectome Project (HCP) [2], have been made freely available, and with such accessibility, various methodological developments that aim to integrate the two modalities have emerged.
Computational neuroimaging has successfully adopted graph theory, creating a new field of interdisciplinary research called network neuroscience [3]. Structural and functional connectomes are independently defined, and consequently analyzed using graph theory measures to provide a better understanding of their organizing network principles [4]. There is also an increasing interest in deciphering how underlying brain anatomy supports the emergence of spatially and temporally varying distributed patterns of functional activity [5], [6], [7]. In this perspective, it is fitting to consider advancing network neuroscience to a more unifying analysis approach that accounts for the interplay between brain structure and function. The study of signal propagation on structural connectomes [8], [9] is an example avenue of research that is gaining momentum. Leveraging principles from the recently emerged field of graph signal processing (GSP) [10], [11], an alternative framework is taking form, in which functional data are interpreted as functions defined atop of a graph that describes the morphological or wiring structure of the brain, and, in turn, processed using spectral methods that are informed by the underlying brain structure.
GSP generalizes principles from classical discrete signal processing for time series to data defined on irregular domains. GSP has found numerous applications across multiple domains—see e.g. [11] for a recent review, and in particular within neuroimaging, examples include: brain state decoding [12], [13], [14], brain signal denoising [15], brain activation mapping [16], [17], [18], source localization [19], diagnosing neuropathology [20], tracking fast spatiotemporal cortical dynamics [21], [22], brain fingerprinting and task decoding [23] via quantifying the degree of coupling between brain function and structure [24], identifying dynamically evolving populations of neurons [25], deciphering signatures of attention switching [26], manifesting white matter pathways that mediate cortical activity [27], and elucidating perturbations of consciousness induced by brain injury or drugs [28], [29].
The majority of existing applications of GSP in functional brain imaging are limited to region-wise analyses, where regions are defined using a priori brain atlases having 100 to 1000 regions. Motivated by the promising results from existing region-wise GSP studies in linking brain structure and function, and novel recent methods for high-resolution connectomics [30] and activation mapping [31], it is fitting to further explore the benefits of large-scale brain graphs at the resolution of voxels. Here we present models to derive the strength of connection between adjacent voxels using diffusion MRI data, one based on tensors estimated from diffusion tensor imaging (DTI) [32], and the other based on diffusion orientation distribution functions (ODF) estimated from high angular resolution diffusion imaging (HARDI) data [33]; we consider the two signal representation settings to make the methodology applicable to a larger set of available diffusion MRI data. Using data of 100 subjects from the HCP [2], we validate the graphs via studying their nodal and spectral measures. We then probe the intrinsic dimensionality of their eigenspace using a Procrustes validation scheme that characterizes inter-subject variability. Finally, we demonstrate the relevance of such high-spatial-resolution voxel-wise graphs within a GSP setting, particularly through studying the energy spectral density of resting-state and task fMRI data on these graphs. We conclude the paper by discussing potential future research avenues in using voxel-wise graphs, in particular, in studying the interaction between brain structure and function.
II. Materials and Methods
A. Datasets
We used MRI data from the publicly available HCP dataset—the 100 unrelated subjects, WU-Minn Consortium [2]. MRI acquisition protocols of the dataset and preprocessing guidelines for diffusion MRI are extensively described elsewhere [34]. We used the minimally preprocessed diffusion and anatomical data. The resting-state and task fMRI scans of each subject were realigned to their mean images, and were registered and resampled onto the diffusion data through rigid-body registration using SPM.1 Two signal reconstruction methods were applied to the diffusion data: (1) DTI tensor fitting using FSL,2 and (2) ODF estimations using DSI Studio.3
B. Graphs and Their Spectra
Let
denote an undirected, single-connected, weighted graph, consisting of a node set
, where
, and a symmetric
weighted adjacency matrix
, wherein any of its nonzero elements
represent the weight of an edge
in the graph. The normalized graph Laplacian [35] is defined as
![]() |
where
denotes the identity matrix, and
denotes the graph degree matrix, which is diagonal with elements
.
can be diagonalized as
where
is an orthonormal matrix stacking the eigenvectors
,
, and
is a diagonal matrix stacking the corresponding eigenvalues
, which are real and non-negative due to symmetry and positive semi-definiteness of
. Without loss of generality, we assume that the diagonal elements in
, and the corresponding columns in
, are sorted based on the magnitude of the eigenvalues, i.e.,
if
then
. As such, the graph Laplacian eigenvalue set satisfies
where the upper bound is guaranteed due to the use of the normalized Laplacian matrix [35]. This set defines the Laplacian spectrum of the graph, and the eigenvector set
defines an orthonormal basis that spans the
space of vectors defined on the nodes of the graph; in the following, we occasionally refer to the Laplacian eigenvectors also as eigenmodes, a nomenclature commonly used in the neuroimaging community.
The eigenvalues of a graph Laplacian carry a notion of frequency, which is directly linked to the extent of spatial saliency manifested by their corresponding eigenvectors. To understand this link, a metric known as total variation (TV) [36] can be computed for each eigenvector, or more precisely, for any given graph signal. A graph signal defined on the nodes of a graph can be represented as a vector
, where the
-th element,
, is the signal value at the
-th node of the graph. For a given graph signal
, the TV of
is defined as
, a measure that quantifies the extent of variation observed in
relative to the underlying graph structure. Given that the eigenvectors are orthonormal, i.e.,
, and that
, it follows that the TV of Laplacian eigenvectors reduces to
showing that the variability of each Laplacian eigenvector is reflected by the associated eigenvalue, or in other words, that Laplacian eigenvectors associated to larger eigenvalues reflect a greater extent of spatial variability. Alternatively, spatial variability of graph signals/eigenmodes can be quantified via a measure of zero-crossings [37], [38]. In particular, we define a weighted zero-crossing measure as [17]
![]() |
where
is the Heaviside step function and
is the edge weight that connects voxels
and
. The higher the zero-crossing metric, the greater the associated variability in the eigenvectors' spatial patterns.
C. Spectral Decomposition of Graph Signals
For a given graph signal
, its spectral representation, commonly referred to as the graph Fourier transform (GFT) of
, is given as
![]() |
The signal can be perfectly recovered through the inverse GFT operation as,
. As such, any given graph signal can be seen as a linear combination of the orthonormal set of Laplacian eigenvectors. In particular,
gives the energy spectral density of the signal associated to the
-th eigenmode. Given a set of graph signals
(e.g. graph signals derived from individual time frames of a given fMRI session) we compute the ensemble energy spectral density (EESD) of the lower end of the spectrum of
as
![]() |
where
denotes a desired cutoff index specifying the number of lower end spectral indices to be studied (
in this study), and
denotes the demeaned and normalized version of
obatined as
![]() |
which ensures
and
.
D. Brain Graph Design
For each subject, we define a weighted brain graph characterized by a node set
defined based on the set of voxels that fall within the subject's brain mask, covering gray matter (GM), white matter (WM) and cerebrospinal fluid (CSF), representing a 3D mesh arrangement. In particular, each node
is associated to a voxel, denoted
, with coordinates
. The graph edges are defined based on the adjacency of voxels within the Moore neighborhood cubic lattice of size
and
, where the latter size is only used in the ODF-based design. For the
design, voxels in the outer layer that fall in parallel to the voxels within the inner layer were excluded, enabling encoding of connections to a maximum of 98 voxels/directions in the neighborhood of each focal voxel, whereas the
design enables encoding connections to a maximum of 26 different directions. As such, the 5-connectivity design trades localization for better angular resolutions. With this definition of edges, each node
entails a neighborhood set of the indices of nodes in
that are adjacent to it, denoted
, where
and
for the 3- and 5-connectivity designs, respectively.
We define the edge weights based on a measure of inter-voxel fiber coherence across all pairs of adjacent voxels. In particular, to make the presented method applicable to a wider range of available diffusion MRI data, we present two edge weighting schemes using two signal representation models, one using diffusion tensors and one using diffusion ODFs; we denote the resulting edge weighting schemes as the DTI-based and ODF-based methods, respectively. The tensor and ODF models both aim to represent structural information on the intra-voxel axon fiber arrangement. The diffusion tensor model can be seen as a multivariate Gaussian describing the distribution of fiber bundle alignment, whereas the diffusion ODF model defines the radial projection of the diffusion function, providing an estimate of the empirical distribution of water diffusion.
Let
denote the vector pointing from the center of the voxel
to the center of the voxel
. Let
denote estimates of the extent of diffusion at voxel
in directions
. In the following, we first present a DTI-based and an ODF-based approach to estimate
. We then use these estimates to define the graph edge weights.
1). DTI-Based Quantification of Diffusion Orientation
DTI is a model-based method for reconstructing the diffusion signal from diffusion MRI. The assumption in DTI is that the diffusion pattern follows the shape of a 3D ellipsoid. The molecular displacement of water at voxel
in the direction
can be approximated by a 3D Gaussian distribution with real symmetric diffusion tensor
as the covariance matrix:
![]() |
where
is the determinant of the diffusion tensor. The calculation of
requires a discretization step that guarantees a one-to-one mapping between the (continuous) multivariate Gaussian model and the (discrete) weighting of nodes in the brain graph. For the
neighborhood encoding scheme, for a given voxel
, the set of values
can be arranged into
discrete representation, which mimics the structure of a 3D finite impulse response (FIR) filter. As such, the problem of obtaining
can be alternatively seen as that of obtaining the coefficients of an FIR filter. We provide the details of this procedure in the Supplementary Materials.
2). ODF-Based Quantification of Diffusion Orientation
Unlike diffusion tensors, ODFs do not follow a specific model and shape. Thus, a one-to-one discretization of a continuous function similar to that presented for the DTI model cannot be applied. Here we build on the construction previously presented by Iturria-Medina [39]. Within standard spherical coordinates, parametrized by
, let
denote the ODF associated to voxel
with its center of coordinate being the voxel's center, with
denoting the unit direction vector. Given
, a measure of the extent of diffusion at voxel
along direction
can be obtained as
![]() |
where
denotes a given solid angle around
,
denotes the infinitesimal solid angle element; in particular, a solid angle of
and
is used for the 3- and 5-connectivity schemes, respectively. The exponent
is a desired power factor that is used to sharpen the ODF given the limited degree to which diffusion ODFs can differentiate fiber orientations [40]. As such,
gives an average measure of the surface area of the ODF within a spherical cap defined by the solid angle. Given a discrete representation of
in form of
samples, denoted
, along
spherical directions from the center of voxel
, (7) can be approximated as
![]() |
where
denotes a subset of direction indices
whose associated set of directions fall within
. The normalization by the cardinality of
is due to the difference in the number of ODF samples that fall within the solid angle subtended along the different neighborhood directions.
3). Brain Graph Edge Weights
The graph edge weights
are defined by using the estimates of diffusion orientation at the associated voxels
and
, i.e.,
and
, as well as the strength of anisotropy at those voxels. In particular, for a given voxel
, let
and
denote the voxel's fractional anisotropy (FA) and quantitative anisotropy (QA), respectively. FA can be calculated directly from the eigenvalues of the diffusion tensor [41] and QA pertains to the amount of diffusion anisotropy along the fiber orientation as originally defined by Yeh et al. [42]. Using these measures, we define the graph edge weights
as
![]() |
where
,
and
denotes the magnitude of anisotropy at voxel
, defined as
![]() |
The connectivity structure of the graph is then characterized in
, such that
, given as in (9), if nodes
and
are connected through an edge, and
if otherwise.
The orientation term in (9) gives a measure of diffusion orientation coherence between the two connected voxels, whereas the anisotropies give a magnitude measure that is useful in delineating tissues; the use of anisotropies is in contrast to using probabilistic tissue maps as used in [39], enabling the design of the graphs using only the diffusion data. Given two adjacent voxels that exhibit highly coherent diffusion orientations, a large weight is associated to the connection only if the two voxels also exhibit notably large anisotropies. This interplay between the orientation term and magnitude term enables, for example, to prevent associating large weight to an edge between a WM voxel and a CSF voxel. Furthermore, the normalizations incorporated in the definition, i.e., the
and
terms, ensure having an unbiased definition of weights relative to the structure of the diffusion tensors/ODFs across the brain, and, mathematically, they impose bounds on the orientation and magnitude terms—both terms bounded to [0,1], which in turn results in
also being bounded to [0,1].
E. Group-Level Eigenmodes
The voxel-wise nature of the studied graphs renders their size excessively large, with
nodes across the 100 subjects considered. The sheer size of the voxel-wise graphs impedes computing the full eigendecomposition of the graph Laplacian, and, therefore, we compute and study the first leading 1000 eigenvectors corresponding to the lowest spectral frequencies. To preserve subtle subject-specific spatial details, we construct all graphs in the native space of each subject's diffusion data. To enable inter-subject comparison of eigenmodes, the DARTEL normalization algorithm [43] implemented in SPM12 was used to define a group-level template coordinate space, based on the group's T1-weighted MRI data. This results in a structural T1-weighted template as well as a set of transformation maps per subject. Each subject's eigenmodes are then transformed into the template space using the subject-specific transformations, resulting in inter-subject spatially aligned eigenmodes.
F. Consistent Inter-Subject Ordering of Eigenmodes
The ordering of DARTEL-normalized eigenmodes is not necessarily consistent across subjects, including sign ambiguity and linear combinations between modes with close eigenvalues. To obtain a consistent ordering of the eigenmodes, and enable inter-subject comparison of individual eigenmodes, we used the Procrustes transform [44], which finds the optimal rotation, translation, and/or reflection between two linear subspaces. We implemented a scheme of Procrustes transformation, where the subspace is defined by the first
DARTEL-normalized eigenmodes of any
subset of subjects. Let
denote the
-th eigenmode of subject
, and let
.
Algorithm 1: Group-Level Matching of Eigenmodes.
for
to
dofor
to
do
Reorder columns in
such that the resulting permuted matrix best matches 
end for
average 
end for
The reordering is done based on Procrustes transformation estimates, and
denotes the optimal number of iterations to ensure that
does not remain biased towards its initial value, i.e.,
. The columns of the resulting
are reordered in such a way that they optimally match each other and can thus be compared across the subjects. Although the Procrustes transformation removes much of the variance that is common between subjects, it cannot discount for subject-specific details; in the following section we define a metric that quantifies the extent of remaining inter-subject structural variability.
G. Quantification of the Extent of Inter-Subject Structural Variability as Encoded in Brain Graphs
The precision of the Procrustes transformation can be evaluated by quantifying the cosine similarity between corresponding eigenmodes of different subjects, after DARTEL normalization and Procrustes transformation. For any pair of subjects, a symmetric cosine similarity matrix is obtained, where the deviation of the off-diagonal elements of the matrix from zero quantifies inter-subject structural variability. If the set of eigenmodes of two subjects has been ideally matched, the cosine similarity matrix should be the identity matrix. Therefore, to quantify the mismatch between a pair of subjects
and
based on their first
eigenmodes, we define a measure of the extent of inter-subject structural variability, termed Procrustes error, via computing the cosine similarity between pairs of eigenmodes as
![]() |
We used this error term to determine
in Algorithm 1 and also to compare the different graph designs.
To validate the performance of the Procrustes transformation, we implemented a bootstrap scheme, which successively applies the transformation on the first K eigenmodes of two randomly chosen subjects; the implementation is summarized in the following algorithm:
Algorithm 2: Procrustes Validation.
for
to
step
dofor
to
do
randomly select 2 values 
Algorithm 1 on 
end for
mean of 
standard deviation of 
end for
When comparing two brain graph designs, the design that results in a higher
, with reasonably small
, is interpreted as capturing more subject-specific structural features.
H. Spectral Decomposition of fMRI Data
As proof-of-concept of the applicability of the proposed whole-brain, voxel-wise brain graphs, we evaluated the extent to which brain fMRI data are spatially shaped by the underlying brain structure as encoded by the graphs. In particular, we constructed fMRI graph signals from six functional tasks as well a resting-state acquisition, across 100 subjects. Each fMRI time frame was transformed in to a single graph signal. This was done by extracting the fMRI voxels associated to the graph vertices, i.e., voxels that fall within each subject's brain mask, arranging them as a vector, ordered based on the order of vertices as reflected in each subject's graph adjacency matrix. As such, for each subject, a time-evolving series of graph signals were obtained from each of the subjects' task or resting-state 4D fMRI volumes. We studied the energy spectral density of the extracted graph signals associated to the first 1000 spectral indices of the ODF-3 graph. To serve as a null, we also evaluated the energy spectral density of synthesized shuffled fMRI signals—obtained through random permutation of voxel indices of each fMRI volume to destroy spatial order, as well as white Gaussian noise signals.
III. Results
Fig. 1 shows the degree distributions of the graphs across the different tissue types. The connectivity strength is highest in WM nodes compared to GM and CSF nodes. The degree distribution of ODF-5 graphs is a shifted version of that of the ODF-3 graphs towards a higher degree, reflecting the larger number of connections possible with the ODF-5 design. It can be observed that the nodal degrees within gray matter and CSF almost coincide for the DTI design whereas this is much less pronounced in the ODF designs (compare Fig. 1(a) with Fig. 1(b) and (c)); this is more pronounced for the ODF-3 design, which reflects that the ODF-3 design bears larger differences across tissue types compared to the DTI-3 design. Fig. 1(d) shows the distribution of nodes for the different tissue types across all subjects; the median number of nodes for GM, WM, and CSF were 254 299, 221 964, and 294 028, respectively, with standard deviations 25 322, 28 579, and 25 742, respectively.
Fig. 1.
Degree distribution of the (a) DTI-3, (b) ODF-3, and (c) ODF-5 voxel-wise brain graphs for a representative subject. (d) Distribution of the number of nodes in each tissue type across all subjects.
A. Spectral Comparison
Fig. 2(a) shows the first Laplacian eigenmodes obtained from the three brain graphs of a representative subject. Noting that the first eigenmode of
is a function of the graph nodal degrees—
where
denotes the constant function that assumes the value of 1 on each node, the spatial pattern manifested by the first eigenmodes is a corroboration of the results shown in Fig. 1(a)–(c), demonstrating that the distinction between tissue types naturally arises from the assignment of the connectivity weights in the brain graph, in particular through the assignment of the magnitude term in (9). Moreover, the first eigenmode manifests a specific profile of local tissue structure, in which higher values reflect voxels/regions that are more strongly connected to their surrounding neighbourhood, particularly observed at regions of less ambiguous fiber structure, e.g. within the corpus callosum The second and third eigenmodes shown in Fig. 2(b) manifest global morphological organization of the brain, contrasting the posterior and anterior, and the left and right brain regions, respectively. The next eigenmodes exhibit a greater extent of spatial variability and localized information.
Fig. 2.
(a) First Laplacian eigenmode of 3-connectivity DTI, 3-connectivity ODF and 5-connectivity ODF brain graphs of a representative subject. (b) The next lowest frequency eigenmodes corresponding to the 3-connectivity ODF brain graph.
Fig. 3(a) shows the lower-end graph spectra in which the rate of increase in the first 1000 eigenvalues are shown. The ODF-5 graph has relatively larger eigenvalues than the ODF-3 and DTI-3 graphs. Given that the eigenvalues entail a notion of spatial saliency, the increase in local connectivity in the ODF-5 implies that the associated eigenmodes have greater degrees of freedom, and as such, spatial saliency can become higher. The spatial saliency of the eigenmodes' can be quantified by computing their weighted zero-crossing, cf. (2). Fig. 3(b) shows a trend that is consistent with that of the eigenvalues, thereby confirming the general notion that higher indexed eigenmodes encompass a larger extent of spatial saliency.
Fig. 3.
(a) Lower-end eigenvalues of DTI-3, ODF-3 and ODF-5 graphs, consisting of their first 1000 eigenvalues. (b) weighted zero-crossing the corresponding eigenmodes; cf. (2); solid lines show the mean and shades show the standard deviation across the 100 subjects.
B. Procrustes Validation
We evaluated the inherent inter-subject variability encoded in two voxel-wise brain graph designs via the Procrustes transform, which finds the optimal configuration that matches single subject eigenmodes to an averaged set. This step, however, cannot account for subject-specific fiber pathways encoded in the eigenmodes, as manifested by the cosine similarity analysis of pairs of subjects. The cosine similarity matrices of two sets of eigenmodes before and after applying Procrustes transformation are shown in Fig. 4. The diagonal structure of the cosine similarity matrix associated to the transformed eigenmodes shows the effectiveness of the transformation in aligning eigenmodes of the same neuroanatomical spatial nature. The insets show traces of flipped signs and unordered eigenmodes in the original vectors, which were corrected after Procrustes transformation. The precision of the Procrustes analysis improves after several rounds of the transformation; see Fig. 1 in Supplementary Materials.
Fig. 4.
Cosine similarity between the first 300 eigenmodes before and after Procrustes transformation (PT) for two representative subjects.
Fig. 5 shows the Procrustes error when different subset of eigenmodes are used, for each of the three graph designs, reflecting the extent of inter-subject structural variability captured by the eigenmodes. Furthermore, to serve as a null for comparing and validating the brain graphs, we synthesized 100 random orthonormal vectors of the same dimension as each of the subject-specific eigenmodes, applied DARTEL normalization, and then subjected the resulting vectors to Procrustes validation. All three brain graphs show a decreasing trend, and they get closer to that of the null upon reaching higher
-values. Despite the differences in the Procrustes errors across the three brain graphs for low values of
, all errors eventually converge to a single point for high
. In addition, the ODF-based designs show higher Procrustes errors than the DTI-based design, across K. The ODF-5 design slightly outperformed the ODF-3 design, suggesting the benefit of using the larger neighborhood in encoding fiber orientations with better angular resolution.
Fig. 5.
Quantification of the extent of inter-subject structural variability captured by the eigenmodes, cf. Algorithm 2. The four markers (DTI-3, ODF-3, ODF-5, and Null) within each vertical shade are associated to the same K.
C. Spectral Decomposition of fMRI
Fig. 6(a) shows the ensemble energy spectral densities of the fMRI. The energy spectral density of the fMRI data is characterized by a power-law behavior. The lowest frequency component eigenmodes capture the majority of the energy content (spatial variability), which is about two orders of magnitude greater than what is captured by the 1000th eigenmode. Moreover, a notable dispersion is observed in the energy profiles of approximately the first 100 spectral indices across the different tasks, whereas for the higher spectral indices, the profiles are more closely packed, following a steady power-law drop. This observation is more apparent by inspecting the cumulative ensemble energy (CEE) profiles, see Fig. 6(b); results are shown also for synthesized shuffled fMRI signals (cf. Section II-H) and Gaussian noise signals. In particular, the CEE profiles of task and rest fMRI sharply differ from that of Gaussian noise as well as shuffled fMRI data. For Gaussian noise, each eigenmode captures a fraction of the total energy equivalent to approximately
, where
is the number of the graph nodes, whereas shuffled fMRI still entails the distribution of values as in the real fMRI data, but lacks the exquisite spatial dependencies manifested in fMRI data that is linked to the underlying structure. The CEE profiles of fMRI data show that functional brain activity is expressed preferentially by lower-frequency components; approximately 85% of the total signal energy content4 captured by the first 1000 eigenvectors, wherein the contributions from the first eigenmode are equal to zero due to that the data were demeaned, cf. Section II-C.
Fig. 6.
(a) Ensemble average energy spectral density of fMRI data of 100 subjects for the first 1000 eigenmodes of ODF-3 brain graph. (b) Same as in (a) but showing the cumulative values as well as a comparison to shuffled fMRI data and white Gaussian noise.
IV. Discussion
Voxel-wise brain graphs enable overcoming several limitations associated to existing region-wise brain graphs. For example, they obviate the need for cortical parcellation, and as such, downstream analysis will not be affected by the choice of parcellation scheme [45]. Moreover, analyses on local-encoding voxel-wise graphs prevents variations in results as a function of the algorithm that is employed to approximate the number of WM tracts for region-wise graphs [46]. Lastly, given that the proposed graphs are constructed at the native diffusion space and encompass the whole brain, tissue segmentation and subsequent transformation to a template space is not needed, which can be challenging especially in populations that exhibit a complex mixture of brain structural deficits.
Results on fMRI show that despite the high dimensionality of voxel-wise graphs, brain functional activity can be well approximated by merely a small subset of their low-frequency Laplacian harmonics, whereas in contrast for region-wise brain graphs a larger subset of their total number of Laplacian harmonics is required [21], [24], [28]. This observation shows that functional brain maps are smooth relative to the underlying fiber architecture and tissue profile morphologies, which, on the one hand, is consistent with energy profile of fMRI graph signals on tissue-specific, voxel-wise graphs [16], [47], and on the other hand, can be linked to the decreasing trend observed in the Procrustes validation errors (see Fig. 5), where increasing K-values reduce the error close to that of a randomly generated graph. This energy pattern is reminiscent of a power-law behaviour, which is interesting in light of the evidence of scale-free behaviour in human brain activity [48], [49] observed in both temporal and spatial scales. Moreover, a practical implication of such energy profiles is that the lower-spectral-end energy content of fMRI data on whole-brain voxel-wise graphs has the potential to provide signatures of mental activity, similar to that observed for cerebral cortex gray matter graphs [50], which substantially reduces the computational burden associated to diagonalization of the graph Laplacian. Alternatively, to study the energy profile across the spectrum, a filter design scheme that adapts to the ensemble signal content can be used to efficiently partition the spectrum [51], which can be implemented in a computationally efficient manner [52], obviating the need to even compute individual eigenvectors.
Voxel-wise brain graphs hold the potential to open new research avenues to study the brain. One avenue is to study the graphs from a pure structural perspective, using spectral graph theoretical measures that have been used to e.g. discriminate auditory gyri subtypes [53], or to perform subject identification and characterization of hemispheric asymmetries [54]. A second, more interesting, avenue of research is to employ voxel-wise brain graphs within the context of relating brain structure to function. The proposed voxel-wise graphs can be leveraged to perform whole-brain anatomically-informed spatial filtering and interpolation of fMRI data, operations that are inherent within numerous fMRI processing pipelines; e.g. spatial smoothing to enhance whole-brain fMRI activation mapping, as done using tissue-specific designs in gray matter [16], [18] and white matter [17], [31]. Moreover, it yet remains to be studied how functional connectivity (FC) and their associated measures can be extended to accurately integrate structural information. FC has often been associated to Euclidean distance [55], whereas by using the Laplacian eigenmodes of the proposed graph, functional distance can be better interpreted in relation to the underlying brain structure. That is, functional variations that are captured using low-frequency eigenmodes are smooth with respect to long-distance white matter bundles, whereas localized and short-distance functional associations are expected to be dominated by higher frequency components. Lastly, the exquisite voxel-wise scale of the proposed graphs can enable assessing the extent to which brain structural-functional relations hold at spatially finer mesoscales [30]; e.g. by using graph Slepians [56], [57], [58] or variants of localized graph filter banks [59], [60] and spectral transforms [61], [62], [63], focus can be placed on a particular subset of nodes, thus, providing a finer level of analytical resolution than that provided by conventional region-wise graphs.
V. Conclusion
Two methods for constructing voxel-wise brain graphs from diffusion MRI data were studied. Through a Procrustes validation scheme that reflects inter-subject structural differences, it was shown that low-frequency eigenmodes of such high spatial resolution graphs reflect the highest amount of structural information from diffusion MRI. This finding was corroborated by the manifested energy spectral density of functional signals showing the preferential expression of human brain activity onto lower frequency components. Overall, the presented results signify the capability of voxel-wise brain graphs' eigenmodes in capturing anatomically-constrained functional variations that are specific to different cognitive tasks. By treating voxel-wise brain graphs as the scaffold on which brain function is observed, they hold the potential to open new research avenues to study the brain, in particular, enabling the development of novel GSP methods to study the interplay between brain structure and function, in health and disease.
Funding Statement
This work was supported in part by the Swiss National Science Foundation under Grant 205321-163376, and in part by the Swedish Research Council under Grant 2018-06689.
Footnotes
For each graph signal, the first eigenmode captured approximately 70% of the total signal energy. In the demeaning step, cf. Section II-C, the contribution from the first eigenmode was regressed out. As such, baed on Fig. 6(b), the total amount of energy captured by the first 1000 eigenmodes amounts to approximately 85% of total signal energies of the original signals, i.e.,
.
Contributor Information
Hamid Behjat, Email: hamid.behjat@epfl.ch.
Anjali Tarun, Email: anjalibtarun@gmail.com.
David Abramian, Email: david.abramian@liu.se.
Martin Larsson, Email: martin.larsson@math.lth.se.
Dimitri Van De Ville, Email: dimitri.vandeville@epfl.ch.
References
- [1].Tarun A., Abramian D., Behjat H., and De Ville D. V., “Graph spectral analysis of voxel-wise brain graphs from diffusion-weighted MRI,” in Proc. IEEE Int. Symp. Biomed. Imag., 2019, pp. 159–163. [Google Scholar]
- [2].Essen D. V., Smith S. M., Barch D. M., Behrens T. E. J., Yacoub E., and Ugurbil K., “The WU-Minn human connectome project: An overview,” Neuroimage, vol. 80, pp. 62–79, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [3].Bassett D. S. and Sporns O., “Network neuroscience,” Nature Neurosci., vol. 20, no. 3, pp. 353–364, 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [4].Bullmore E. and Sporns O., “Complex brain networks: Graph theoretical analysis of structural and functional systems,” Nature Rev. Neurosci., vol. 10, no. 3, pp. 186–198, 2009. [DOI] [PubMed] [Google Scholar]
- [5].Mišić B. et al., “Cooperative and competitive spreading dynamics on the human connectome,” Neuron, vol. 86, no. 6, pp. 1518–1529, 2015. [DOI] [PubMed] [Google Scholar]
- [6].Iraji A. et al. , “The spatial chronnectome reveals a dynamic interplay between functional segregation and integration,” Hum. Brain Mapping, vol. 40, no. 10, pp. 3058–3077, 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [7].Suárez L. E., Markello R. D., Betzel R. F., and Misic B., “Linking structure and function in macroscale brain networks,” Trends Cogn. Sci., vol. 24, no. 4, pp. 302–315, 2020. [DOI] [PubMed] [Google Scholar]
- [8].Vézquez-Rodríguez B., Liu Z.-Q., Hagmann P., and Misic B., “Signal propagation via cortical hierarchies,” Netw. Neurosci., vol. 4, no. 4, pp. 1072–1090, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [9].Weninger L. et al. , “Information content of brain states is explained by structural constraints on state energetics,” Phys. Rev. E, vol. 106, no. 1, 2022, Art. no. 014401. [DOI] [PubMed] [Google Scholar]
- [10].Shuman D. I., Narang S. K., Frossard P., Ortega A., and Vandergheynst P., “The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains,” IEEE Signal Process. Mag., vol. 30, no. 3, pp. 83–98, May 2013. [Google Scholar]
- [11].Ortega A., Frossard P., Kovačević J., Moura J. M. F., and Vandergheynst P., “Graph signal processing: Overview, challenges, and applications,” Proc. IEEE, vol. 106, no. 5, pp. 808–828, May 2018. [Google Scholar]
- [12].Petrantonakis P. C. and Kompatsiaris I., “Single-trial NIRS data classification for brain–computer interfaces using graph signal processing,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 26, no. 9, pp. 1700–1709, Sep. 2018. [DOI] [PubMed] [Google Scholar]
- [13].Ghoroghchian N., Groppe D. M., Genov R., Valiante T. A., and Draper S. C., “Node-centric graph learning from data for brain state identification,” IEEE Trans. Signal Inf. Process. Netw., vol. 6, pp. 120–132, 2020. [Google Scholar]
- [14].Cattai T., Scarano G., Corsi M.-C., Bassett D. S., Fallani F. D. V., and Colonnese S., “Improving J-divergence of brain connectivity states by graph laplacian denoising,” IEEE Trans. Signal Inf. Process. Netw., vol. 7, pp. 493–508, 2021. [Google Scholar]
- [15].Einizade A. and Sardouie S. H., “A unified approach for simultaneous graph learning and blind separation of graph signal sources,” IEEE Trans. Signal Inf. Process. Netw., vol. 8, pp. 543–555, 2022. [Google Scholar]
- [16].Behjat H., Leonardi N., Sörnmo L., and De Ville D. Van, “Anatomically-adapted graph wavelets for improved group-level fMRI activation mapping,” Neuroimage, vol. 123, pp. 185–199, 2015. [DOI] [PubMed] [Google Scholar]
- [17].Abramian D., Larsson M., Eklund A., Aganj I., Westin C.-F., and Behjat H., “Diffusion-informed spatial smoothing of fMRI data in white matter using spectral graph filters,” Neuroimage, vol. 237, 2021, Art. no. 118095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [18].Behjat H., Westin C.-F., and Aganj I., “Cortical surface-informed volumetric spatial smoothing of fMRI data via graph signal processing,” in Proc. IEEE 43rd Int. Conf. Eng. Med. Biol. Soc., 2021, pp. 3804–3808. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [19].Hyde D. E., Peters J., and Warfield S. K., “Multi-resolution graph based volumetric cortical basis functions from local anatomic features,” IEEE Trans. Biomed. Eng., vol. 66, no. 12, pp. 3381–3392, Dec. 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [20].Itani S. and Thanou D., “Combining anatomical and functional networks for neuropathology identification: A case study on autism spectrum disorder,” Med. Image Anal., vol. 69, 2021, Art. no. 101986. [DOI] [PubMed] [Google Scholar]
- [21].Glomb K. et al. , “Connectome spectral analysis to track EEG task dynamics on a subsecond scale,” Neuroimage, vol. 221, 2020, Art. no. 117137. [DOI] [PubMed] [Google Scholar]
- [22].Rué-Queralt J. et al. , “The connectome spectrum as a canonical basis for a sparse representation of fast brain activity,” NeuroImage, vol. 244, 2021, Art. no. 118611. [DOI] [PubMed] [Google Scholar]
- [23].Griffa A., Amico E., Liégeois R., Ville D. Van De, and Preti M. G., “Brain structure-function coupling provides signatures for task decoding and individual fingerprinting,” Neuroimage, vol. 250, 2022, Art. no. 118970. [DOI] [PubMed] [Google Scholar]
- [24].Preti M. G. and De Ville D. Van, “Decoupling of brain function from structure reveals regional behavioral specialization in humans,” Nature Commun., no. 1, 2019, Art. no. 4747. [DOI] [PMC free article] [PubMed]
- [25].Charles A. S., Cermak N., Affan R. O., Scott B. B., Schiller J., and Mishne G., “GraFT: Graph filtered temporal dictionary learning for functional neural imaging,” IEEE Trans. Image Process., vol. 31, pp. 3509–3524, 2022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [26].Huang, W.Bolton T. A. W., Medaglia J. D., Bassett D. S., Ribeiro A., and De Ville D. Van, “A graph signal processing perspective on functional brain imaging,” Proc. IEEE, vol. 106, no. 5, pp. 868–885, May 2018. [Google Scholar]
- [27].Tarun A., Behjat H., Bolton T., Abramian D., and De Ville D. Van, “Structural mediation of human brain activity revealed by white-matter interpolation of fMRI,” Neuroimage, vol. 213, 2020, Art. no. 116718. [DOI] [PubMed] [Google Scholar]
- [28].Atasoy S., Roseman L., Kaelen M., Kringelbach M. L., Deco G., and Carhart-Harris R. L., “Connectome-harmonic decomposition of human brain activity reveals dynamical repertoire re-organization under LSD,” Sci. Rep., vol. 7, no. 1, 2017, Art. no. 17661. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [29].Luppi A. I. et al. , “Distributed harmonic patterns of structure-function dependence orchestrate human consciousness,” Commun. Biol., vol. 6, 2022, Art. no. 117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [30].Mansour-L S., Tian Y., Yeo B. T. T., Cropley V., and Zalesky A., “High-resolution connectomic fingerprints: Mapping neural identity and behavior,” Neuroimage, vol. 229, 2021, Art. no. 117695. [DOI] [PubMed] [Google Scholar]
- [31].Zhao Y. et al. , “Detection of functional activity in brain white matter using fiber architecture informed synchrony mapping,” NeuroImage, vol. 258, 2022, Art. no. 119399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [32].Basser P., Mattiello J., and Lebihan D., “Estimation of the effective self-diffusion tensor from the NMR spin echo,” J. Magn. Reson., Ser. B, vol. 103, no. 3, pp. 247–254, Mar. 1994. [DOI] [PubMed] [Google Scholar]
- [33].Tuch D. S., “Q-ball imaging,” Mag. Reson. Med., vol. 52, no. 6, pp. 1358–1372, 2004. [DOI] [PubMed] [Google Scholar]
- [34].Glasser M. F. et al., “The minimal preprocessing pipelines for the human connectome project,” Neuroimage, vol. 80, pp. 105–124, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [35].Chung F., Spectral Graph Theory. Providence, RI, USA: AMS, 1997. [Google Scholar]
- [36].Sandryhaila A. and Moura J. M. F., “Discrete signal processing on graphs: Frequency analysis,” IEEE Trans. Signal Process., vol. 62, no. 12, pp. 3042–3054, Jun. 2014. [Google Scholar]
- [37].Petrantonakis P. C., “Higher order crossings analysis of signals over graphs,” IEEE Signal Process. Lett., vol. 28, pp. 837–841, 2021. [Google Scholar]
- [38].Petrantonakis P. C. and Kompatsiaris I., “Fast feature extraction from large scale connectome data sets using zero crossing counts over graphs,” in Proc. IEEE 30th Eur. Signal Process. Conf., 2022, pp. 927–931. [Google Scholar]
- [39].Iturria-Medina Y. et al. , “Characterizing brain anatomical connections using diffusion weighted MRI and graph theory,” Neuroimage, vol. 36, no. 3, pp. 645–660, 2007. [DOI] [PubMed] [Google Scholar]
- [40].Jones D. K., Knösche T. R., and Turner R., “White matter integrity, fiber count, and other fallacies: The do's and don'ts of diffusion MRI,” Neuroimage, vol. 73, pp. 239–254, 2013. [DOI] [PubMed] [Google Scholar]
- [41].Alexander A. L., Lee J. E., Lazar M., and Field A. S., “Diffusion tensor imaging of the brain,” Neurotherapeutics, vol. 4, no. 3, pp. 316–329, 2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [42].Yeh F. C., Wedeen V. J., and Tseng W. Y. I., “Generalized q-sampling imaging,” IEEE Trans. Med. Imag., vol. 29, no. 9, pp. 1626–1635, Sep. 2010. [DOI] [PubMed] [Google Scholar]
- [43].Ashburner J., “A fast diffeomorphic image registration algorithm,” Neuroimage, vol. 38, no. 1, pp. 95–113, 2007. [DOI] [PubMed] [Google Scholar]
- [44].C. Goodall, “Procrustes methods in the statistical analysis of shape,” J. Roy. Stat. Soc.. Ser. B. (Methodological), vol. 53, no. 2, pp. 285–339, 1991. [Google Scholar]
- [45].de Reus M. A. and Heuvel M. P. Van den, “The parcellation-based connectome: Limitations and extensions,” Neuroimage, vol. 80, pp. 397–404, 2013. [DOI] [PubMed] [Google Scholar]
- [46].Maier-Hein K. H. et al. , “The challenge of mapping the human connectome based on diffusion tractography,” Nature Commun., vol. 8, no. 1, 2017, Art. no. 1349. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [47].Behjat H., Aganj I., Abramian D., Eklund A., and Westin C.-F., “Characterization of spatial dynamics of fMRI data in white matter using diffusion-informed white matter harmonics,” in Proc. IEEE 18th Int. Symp. Biomed. Imag., 2021, pp. 1586–1590. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [48].Ville D. Van De, Britz J., and Michel C. M., “EEG microstate sequences in healthy humans at rest reveal scale-free dynamics,” Proc. Nat. Acad. Sci., vol. 107, no. 42, pp. 18179–18184, 2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [49].Ciuciu P., Varoquaux G., Abry P., Sadaghiani S., and Kleinschmidt A., “Scale-free and multifractal time dynamics of fMRI signals during rest and task,” Front. Neurosci., vol. 3, pp. 1–18, 2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [50].Behjat H. and Larsson M., “Spectral characterization of functional MRI data on voxel-resolution cortical graphs,” in Proc. IEEE Int. Symp. Biomed. Imag., 2020, pp. 558–562. [Google Scholar]
- [51].Behjat H., Richter U., Ville D. Van De, and Sörnmo L., “Signal-adapted tight frames on graphs,” IEEE Trans. Signal Process., vol. 64, no. 22, pp. 6017–6029, Nov. 2016. [Google Scholar]
- [52].Behjat H. and De Ville D. Van, “Spectral design of signal-adapted tight frames on graphs,” in Vertex-Frequency Analysis of Graph Signals. Berlin, Germany: Springer, 2019, pp. 177–206. [Google Scholar]
- [53].Maghsadhagh S., Rocha J. L. D. da, Benner J., Schneider P., Golestani N., and Behjat H., “A discriminative characterization of Heschl's gyrus morphology using spectral graph features,” in Proc. IEEE 43rd Int. Conf. Eng. Med. Biol. Soc., 2021, pp. 3577–3581. [DOI] [PubMed] [Google Scholar]
- [54].Wachinger C., Salat D., Weiner M., Reuter M., and Initiative A. D. N., “Whole-brain analysis reveals increased neuroanatomical asymmetries in dementia for hippocampus and amygdala,” Brain, vol. 139, no. 12, pp. 3253–3266, 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [55].Alexander-Bloch A. F.et al., “The anatomical distance of functional connections predicts brain network topology in health and schizophrenia,” Cereb. Cortex, vol. 23, no. 1, pp. 127–138, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [56].Ville D. Van De, Demesmaeker R., and Preti M. G., “When Slepian meets Fiedler: Putting a focus on the graph spectrum,” IEEE Signal Process. Lett., vol. 24, no. 7, pp. 1001–1004, Jul. 2017. [Google Scholar]
- [57].Petrovic M., Bolton T. A. W., Preti M. G., Liégeois R., and De Ville D. Van, “Guided graph spectral embedding: Application to the C. elegans connectome,” Netw. Neurosci., vol. 3, no. 3, pp. 807–826, 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [58].Georgiadis K., Adamos D. A., Nikolopoulos S., Laskaris N., and Kompatsiaris I., “Covariation informed graph slepians for motor imagery decoding,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 29, pp. 340–349, 2021. [DOI] [PubMed] [Google Scholar]
- [59].Shuman D. I., “Localized spectral graph filter frames: A unifying framework, survey of design considerations, and numerical comparison,” IEEE Signal Process. Mag., vol. 37, no. 6, pp. 43–63, Nov. 2020. [Google Scholar]
- [60].Isufi E., Gama F., Shuman D. I., and Segarra S., “Graph filters for signal processing and machine learning on graphs,” 2022, arXiv:2211.08854.
- [61].Ghandehari M., Guillot D., and Hollingsworth K., “Gabor-type frames for signal processing on graphs,” J. Fourier Anal. Appl., vol. 27, no. 2, pp. 1–23, 2021. [Google Scholar]
- [62].Loynes B. de, Navarro F., and Olivier B., “Localized Fourier analysis for graph signal processing,” Appl. Comput. Harmon. Anal., vol. 57, pp. 1–26, 2022. [Google Scholar]
- [63].Tay D. B., “Spectral mappings for graph wavelets,” IEEE Trans. Signal Process., vol. 70, pp. 3107–3122, 2022. [Google Scholar]

















